Reply to thread

Message

<blockquote data-quote="Merlyn" data-source="post: 787674" data-attributes="member: 114248">AW: FilmInfo+ - A german movie details scraper with auto groupingThanks CandyAndy!In general it should be no problem to get further info from others sites as long as they provide a method to directly access the correct movie details page. If you have a website, that allows to search for the movie by imdb id I'm willing to include it in the scraper.It gets problematic however if a full movie search by title or other info has to be committed as then the whole scraping process starts anew. Of course this could still be done but it would greatly increase the time the average scraping takes. And then there's no guarantee, that the second or third website we scrape has the desired information and we have to ask how many websites should be searched until we are satisfied with the results? For how many movies is this really necessary? video.de for instance does not seem to have a usable search engine. It is necessary to be able to search for the movie by imdb id as searching by movie title only would in most cases yield more than one result which would make it necessary to analyze the search results. It would just take too long.</blockquote>

[QUOTE="Merlyn, post: 787674, member: 114248"] [b]AW: FilmInfo+ - A german movie details scraper with auto grouping[/b] Thanks CandyAndy! In general it should be no problem to get further info from others sites as long as they provide a method to directly access the correct movie details page. If you have a website, that allows to search for the movie by imdb id I'm willing to include it in the scraper. It gets problematic however if a full movie search by title or other info has to be committed as then the whole scraping process starts anew. Of course this could still be done but it would greatly increase the time the average scraping takes. And then there's no guarantee, that the second or third website we scrape has the desired information and we have to ask how many websites should be searched until we are satisfied with the results? For how many movies is this really necessary? video.de for instance does not seem to have a usable search engine. It is necessary to be able to search for the movie by imdb id as searching by movie title only would in most cases yield more than one result which would make it necessary to analyze the search results. It would just take too long. [/QUOTE]

Verification