Spanish Scraper FilmAffinity.com with IMDb.es bonus to get fanarts -- v2.1.0 (3 Viewers)

[peque]

Ok. If I can do something more, just ask.

 

[CATRonin]

Hola.

A mi no me ha funcionado.

He sustituido la dll por la que hay en archivos de programa.... plugins windows y me da el error que adjunto.

Habia hecho antes un backup de la dll y la he vuelto a poner.

Tengo .Net 4.5

Alguna idea?

Edito: Tengo Windows 7

Saludos.

 

[peque]

Scrapper is totally failing for me... anyone else with problems? Any decent alternative for spanish people?

PD: Filmaffinity web layout is quite the same, I think.

PD2: Logs added.

 

[RoChess]

They probably made some HTML changes that cause the RegEx to fail.

Should be able to fix it with the logs you provided if they contain the error in detail.

Will check later tonight after work.

 

[RoChess]

I did notice the following in your log file:

09-Sep-2019 09:09:15 Debug [ ScraperNode]: Retrieving URL: FilmAffinity
09-Sep-2019 09:09:15 Error [ WebGrabber]: Connection failed: URL=FilmAffinity, Status=429, Description=Too Many Requests.

So they appear to be blocking you from hitting them with too many requests, which then invalidates any results.

The scraper-script fall back logic then seems to fail, so instead of just aborting it ends up storing incorrect data.

Will look into fixing that.

In the meantime for you, try importing at a very slow rate, as FilmAffinity quickly sees you as trying to DDoS them and blocks your requests. That is a major benefit of Amazon owning IMDb.com as you can hit them with hundreds of requests per seconds and they just take it

 

[peque]

I did notice the following in your log file:

09-Sep-2019 09:09:15 Debug [ ScraperNode]: Retrieving URL: FilmAffinity
09-Sep-2019 09:09:15 Error [ WebGrabber]: Connection failed: URL=FilmAffinity, Status=429, Description=Too Many Requests.

So they appear to be blocking you from hitting them with too many requests, which then invalidates any results.

The scraper-script fall back logic then seems to fail, so instead of just aborting it ends up storing incorrect data.

Will look into fixing that.

In the meantime for you, try importing at a very slow rate, as FilmAffinity quickly sees you as trying to DDoS them and blocks your requests. That is a major benefit of Amazon owning IMDb.com as you can hit them with hundreds of requests per seconds and they just take it

That makes sense, because I moved a whole dir with more than 200 films... I must think now how to do it slower.

Desde el móvil...

 

[RoChess]

Moving-Pictures advanced settings default multi-threading is 5 movies at a time if memory serves me.

Changing that to 1 slows things down a lot, and might be enough.

 

[peque]

I'm back...

Now I would say I'm not "blacklisted", but I can't retrieve movie details. I attach log.

It seems it's retrieving search results Ok, but then fails trying to get film details. It seems film details url is not correct.

 

[RoChess]

Dealing with issues at work, so will look at it tomorrow

 

[RoChess]

Irritated while waiting for NOC to call me back, so perfect time to calm down looking at regular expressions

Try 2.1.8 which is available now. FilmAffinity changed the way they reference URLs so the RegEx was failing.