IMDb Scraper with RottenTomatoes rating (check end of thread for final versions) | Page 5

Discussion in 'Moving Pictures' started by RoChess, January 3, 2010.

  1. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,210
    Likes Received:
    1,325
    Ratings:
    +1,718 / 2
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4



    Select movie and click on the green arrow to refresh all the info based on the scraper used to originally obtain the info. If you want to overwrite with another scraper then use the drop down list option on the same icon (little arrow pointing down) and select the new scraper you want to use.

    To just refresh with the original scraper used, you can do so from within the GUI as well.
     
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. superted125

    superted125 Portal Member

    Joined:
    September 16, 2009
    Messages:
    30
    Likes Received:
    3
    Ratings:
    +3 / 0
    Home Country:
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Hi thanks for the reply.

    I actually tried doing that but it was still keeping imdb scores even with that disabled user sources and selecting the RT one. But I have readded my library now so fingers crossed!

    Apparently this didnt work...all the movies are using imdb scores even though they show the primary source as being IMDB (with rotten tomato...etc)

    this is the latest version of Moving Pictures, MP and StreamedMP
     
  4. drealit

    drealit Portal Pro

    Joined:
    March 15, 2008
    Messages:
    190
    Likes Received:
    17
    Ratings:
    +17 / 0
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Are you using either of the 2 updated scrapers that mortstar and I uploaded on the previous page? Because the scripts in the OP are outdated at this point and weren't working correctly which is why he released his own updated version and I followed with a US based modification.
     
  5. Surferosa

    Surferosa Portal Pro

    Joined:
    September 2, 2009
    Messages:
    55
    Likes Received:
    5
    Ratings:
    +5 / 0
    Home Country:
    England England
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Unfortunately, it just doesn't seem to be completely working for me. Have pm'd Mortstar to see if he can fix- though would be good to know if its just me or anyone else.

    Ive gone through and checked a few films. If it helps- Ive listed them here:

    The Illusionist:
    The Illusionist Movie Reviews, Pictures - Rotten Tomatoes
    It has a score of 74%. Im getting a scraped score of 6.2

    The Good the Bad the Ugly
    ROTTEN TOMATOES: Movie Reviews & Previews
    It has a score of 98%. Im getting a scraped score of 8.4

    Marley and Me
    Marley & Me Movie Reviews, Pictures - Rotten Tomatoes
    It has a score of 62%. Im getting a scraped score of 7.4.

    Others seem to be working perfectly (The Matrix, for example). I have a few hundred films catelogged- but I noticed some strange scores popping up and thats when I started checking.

    Ive tried everything to get these others working. Ive tried manually refreshing them from this specific source (ie morstars scraper); Ive resent the film back to the importer (which overwrites everything); Ive manually set the film to 0 then run it to make sure it was updating (it did); and I have deleted all other imdb scripts (including the default)- yet still can't get them to work.

    Im pulling my hair out on this- trouble is, its so damned useful in comparison to the imdb ratings :(
     
  6. superted125

    superted125 Portal Member

    Joined:
    September 16, 2009
    Messages:
    30
    Likes Received:
    3
    Ratings:
    +3 / 0
    Home Country:
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    yup tried both scrapers from the previous page..neither worked.

    I have been trying 2001 a space odysee and 500 days of summer
     
  7. drealit

    drealit Portal Pro

    Joined:
    March 15, 2008
    Messages:
    190
    Likes Received:
    17
    Ratings:
    +17 / 0
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    I finally took the time to revisit my collection: I can confirm with Surferrosa that The Good the Bad and the Ugly is not being scraped from RT correctly (mine says 7.6 oddly enough)... however, both of superted125's are working perfectly fine for me which leads me to believe he doesn't have his setup correctly.

    But yes it would seem that some have scraped perfectly fine while others haven't.
     
  8. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,210
    Likes Received:
    1,325
    Ratings:
    +1,718 / 2
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    I'll fix the problems, but only if I'm provided with a scraper-enabled log file that is as clean as possible with the problem movie re-imported or refreshed and nothing else. Otherwise it takes too much time reading the log file to solve the underlying cause.
     
  9. mortstar
    • Premium Supporter

    mortstar MP Donator

    Joined:
    January 30, 2008
    Messages:
    415
    Likes Received:
    41
    Ratings:
    +41 / 0
    Home Country:
    England England
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Attached is a debug-level log with scraper-debugging enabled, whilst importing a dummy 'The Illusionist.mkv' file.

    The scraper doesn't find a score from RottenTomatoes and falls back to the next scraper (in my case this happens to be OFDb). This all occurs between lines 24508 and 25699.

    This is using the modified scraper script that I posted previously.

    Thanks for looking in to it RoChess.

    EDIT: I've been taking a look at the log file. The RottenTomatoes site is returning a 'Sorry we couldn't find what you were looking for' error page...however, if you manually navigate to the link that is being created by the scraper (http://www.rottentomatoes.com/alias?type=imdbid&s=0443543) it properly redirects to The Illusionist page at RT?! (I'm even using 'User Agent Switcher' plugin for Firefox to use the same User Agent as the scraper and it still works! Strange one...)
     
  10. drealit

    drealit Portal Pro

    Joined:
    March 15, 2008
    Messages:
    190
    Likes Received:
    17
    Ratings:
    +17 / 0
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Yep I had the exact same thought last night. RT for some reason isn't recognizing the titles of the problem movies. I did a few tests with The Good, the Bad and the Ugly last night with different names (it has alternate titles)but I wasn't able to get anywhere with it.
     
  11. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,210
    Likes Received:
    1,325
    Ratings:
    +1,718 / 2
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Something is Rotten at RottenTomatoes.

    FAIL = http://www.rottentomatoes.com/alias/?type=imdbid&s=0800080
    FAIL = http://www.rottentomatoes.com/alias/?type=imdbid&s=0443543

    WORKS = http://uk.rottentomatoes.com/alias/?type=imdbid&s=0800080
    WORKS = http://uk.rottentomatoes.com/alias/?type=imdbid&s=0443543

    Maybe they don't like Edward Norton movies on the US version or RottenTomatoes :D

    Anyway, edit the scraper to use the uk.rottentomatoes.com URI and that should fix things (even for the US-rating version).
     
    • Like Like x 2
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!