Moderator - Spanish Forums
- August 4, 2007
Ok. If I can do something more, just ask.
That makes sense, because I moved a whole dir with more than 200 films... I must think now how to do it slower.I did notice the following in your log file:
09-Sep-2019 09:09:15 Debug [ ScraperNode]: Retrieving URL: FilmAffinity
09-Sep-2019 09:09:15 Error [ WebGrabber]: Connection failed: URL=FilmAffinity, Status=429, Description=Too Many Requests.
So they appear to be blocking you from hitting them with too many requests, which then invalidates any results.
The scraper-script fall back logic then seems to fail, so instead of just aborting it ends up storing incorrect data.
Will look into fixing that.
In the meantime for you, try importing at a very slow rate, as FilmAffinity quickly sees you as trying to DDoS them and blocks your requests. That is a major benefit of Amazon owning IMDb.com as you can hit them with hundreds of requests per seconds and they just take it