home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
MediaPortal 1 Plugins
Popular Plugins
Moving Pictures
Spanish Scraper FilmAffinity.com with IMDb.es bonus to get fanarts -- v2.1.0
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="RoChess" data-source="post: 1261755" data-attributes="member: 18896"><p>I did notice the following in your log file:</p><p></p><p>09-Sep-2019 09:09:15 Debug [ ScraperNode]: Retrieving URL: <a href="https://www.filmaffinity.com/es/advsearch.php?stext=10%20000&fromyear=2008&toyear=2008" target="_blank">FilmAffinity</a></p><p>09-Sep-2019 09:09:15 Error [ WebGrabber]: Connection failed: URL=<a href="https://www.filmaffinity.com/es/advsearch.php?stext=10%20000&fromyear=2008&toyear=2008" target="_blank">FilmAffinity</a>, Status=429, Description=Too Many Requests.</p><p></p><p>So they appear to be blocking you from hitting them with too many requests, which then invalidates any results.</p><p></p><p>The scraper-script fall back logic then seems to fail, so instead of just aborting it ends up storing incorrect data.</p><p></p><p>Will look into fixing that.</p><p></p><p>In the meantime for you, try importing at a very slow rate, as FilmAffinity quickly sees you as trying to DDoS them and blocks your requests. That is a major benefit of Amazon owning IMDb.com as you can hit them with hundreds of requests per seconds and they just take it <img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite27" alt=":whistle:" title="Whistling :whistle:" loading="lazy" data-shortname=":whistle:" /></p></blockquote><p></p>
[QUOTE="RoChess, post: 1261755, member: 18896"] I did notice the following in your log file: 09-Sep-2019 09:09:15 Debug [ ScraperNode]: Retrieving URL: [URL="https://www.filmaffinity.com/es/advsearch.php?stext=10%20000&fromyear=2008&toyear=2008"]FilmAffinity[/URL] 09-Sep-2019 09:09:15 Error [ WebGrabber]: Connection failed: URL=[URL="https://www.filmaffinity.com/es/advsearch.php?stext=10%20000&fromyear=2008&toyear=2008"]FilmAffinity[/URL], Status=429, Description=Too Many Requests. So they appear to be blocking you from hitting them with too many requests, which then invalidates any results. The scraper-script fall back logic then seems to fail, so instead of just aborting it ends up storing incorrect data. Will look into fixing that. In the meantime for you, try importing at a very slow rate, as FilmAffinity quickly sees you as trying to DDoS them and blocks your requests. That is a major benefit of Amazon owning IMDb.com as you can hit them with hundreds of requests per seconds and they just take it :whistle: [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
MediaPortal 1 Plugins
Popular Plugins
Moving Pictures
Spanish Scraper FilmAffinity.com with IMDb.es bonus to get fanarts -- v2.1.0
Contact us
RSS
Top
Bottom