IMDb.com scraper v1.4.7 (FIXES: Bunch of stuff :o)

Discussion in 'Moving Pictures' started by RoChess, January 9, 2010.

  1. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,205
    Likes Received:
    1,319
    Ratings:
    +1,709 / 2
    Attached is an update to the IMDb.com scraper that includes the following fixes:

    Issue #726 = Fixed score/rating
    Issue #728 = Enhanced scraper to never skip the exact title match
    Issue #730 = Fixed writers
    Issue #730 = Fixed tagline, to properly decode " char
    Issue #745 = Fixed exact title match

    To install:

    1. Download the .xml file (attachment at bottom of this post) to a location you remember. I actually put mine in the "C:\ProgramData\Team MediaPortal\MediaPortal\scripts\Moving Pictures\" folder (different location on XP), but it shouldn't matter.
    2. Open "MediaPortal - Configuration", go to the "plugins" and select "Moving Pictures" and "Config".
    3. Select the "Importer Settings" tab.
    4. In the "Data Sources:" section select the "Manually manage movie data sources" radio button.
    5. Click the "Movie Details Data Sources" button.
    6. In the popup click the arrow just to the right of the "+" button and pick "Add a New Data Source".
    7. Browse to the new .xml scraper file and click OK.
    8. It should automatically update the existing "imdb.com" scraper to version 1.4.7.

    Enjoy.


     

    Attached Files:

    • Like Like x 9
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. trekkiedj

    trekkiedj Portal Pro

    Joined:
    August 7, 2009
    Messages:
    80
    Likes Received:
    0
    Location:
    Cirencester
    Ratings:
    +0 / 0
    Home Country:
    United Kingdom United Kingdom
    Re: IMDb.com scraper v1.3.4 (Fixes missing score/rating)

    This is great Rochess... any way of editing the scraper to pick up the studio details? (i.e. 20th Century Fox, Dreamworks, pixar etc...)
     
  4. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,205
    Likes Received:
    1,319
    Ratings:
    +1,709 / 2
    Re: IMDb.com scraper v1.3.4 (Fixes missing score/rating)

    Yes, it is no problem to obtain this information, but the problem is showing it.

    This is because there is no MovingPictures database support for the production studio info as of yet (this is planned for v1.3.0 as per the link below). Now I can still make this a part of a custom scraper for you, so it will work, but then you have to tell me in what existing field you want this info. I could for example use the existing text/string field 'Writers', so you get something like this:

    Writers:
    Some Writer, Another Writer, (Production Studio)​

    So let me know if you want this now, or if you want to wait for the planned support @ Issue 458 - moving-pictures - Allow scraper scripts to provide "Production Company" information - Project Hosting on Google Code
     
  5. trekkiedj

    trekkiedj Portal Pro

    Joined:
    August 7, 2009
    Messages:
    80
    Likes Received:
    0
    Location:
    Cirencester
    Ratings:
    +0 / 0
    Home Country:
    United Kingdom United Kingdom
    Re: IMDb.com scraper v1.3.4 (Fixes missing score/rating)

    The reason for wanting the studio details for me it to categorise movies by studio, and i have a nice set of PNG's for them too. so i may wait until the official support...

    Nevertheless, great work Rochess, thanks again:D
     
  6. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,205
    Likes Received:
    1,319
    Ratings:
    +1,709 / 2
    Re: IMDb.com scraper v1.3.4 (Fixes missing score/rating)

    Yes, in that situation it is better to wait.

    Don't forget to star the issue, that way you are not only informed about any updates, it also helps the developers decide what bugs they should focus on :)
     
  7. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,205
    Likes Received:
    1,319
    Ratings:
    +1,709 / 2
    Re: IMDb.com scraper v1.4.0 (FIXES: Score/Rating + Exact Title)

    Released v1.4.0 which solves the problem of an 'exact title match' getting disabled from too many popular matches.
     
  8. ysmp
    • Team MediaPortal

    ysmp Design Group

    Joined:
    May 17, 2008
    Messages:
    1,861
    Likes Received:
    701
    Gender:
    Male
    Location:
    Seoul.
    Ratings:
    +790 / 1
    Home Country:
    South Korea South Korea
    Re: IMDb.com scraper v1.4.0 (FIXES: Score/Rating + Exact Title)

    hi RoChess ! thank you for the update ..
    can i ask you how can i change the scraper to get the surt summry ?
    as i know IMDB they have long summry and surt summry (not tag line )

    thank's,
     
  9. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,205
    Likes Received:
    1,319
    Ratings:
    +1,709 / 2
    Re: IMDb.com scraper v1.4.0 (FIXES: Score/Rating + Exact Title)

    Attached is a custom version that will do that.

    WARNING: This version will replace the default IMDb scraper and only use the short summary. The following attachment is only meant for ysmp, do *NOT* use it unless you understand what the implications are.
     

    Attached Files:

    • Like Like x 1
  10. ysmp
    • Team MediaPortal

    ysmp Design Group

    Joined:
    May 17, 2008
    Messages:
    1,861
    Likes Received:
    701
    Gender:
    Male
    Location:
    Seoul.
    Ratings:
    +790 / 1
    Home Country:
    South Korea South Korea
    Re: IMDb.com scraper v1.4.0 (FIXES: Score/Rating + Exact Title)

    Thank you very mach ...:)

    Edit : WORK GREAT ..... Thank's ,
     
  11. Surferosa

    Surferosa Portal Pro

    Joined:
    September 2, 2009
    Messages:
    55
    Likes Received:
    5
    Ratings:
    +5 / 0
    Home Country:
    England England
    Re: IMDb.com scraper v1.4.4 (FIXES: Score/Rating + Exact Title + Writers)

    Great work again RoChess. As you know, Im really pleased with the Rotten Tomatoes scroing on the other thread- but the short summary is something I'd also prefer. So I just had a thought- how easy would it be to make a configurable scraper app? So in my head Ive got a small app (runs independent of imdb) with options that change what is scraped (ie use long / short summary; use imdb / RT score; append RT scores after summary; etc). Im sure there are more- but these are the 3 that immediately spring to mind. This app would then generate the xml code that can be used to generate the actual scrape used.

    Just a thought mind and I guess you've already got enough on your plate...
     
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!