FIXED: IMDb website update breaks IMDb+ AKA search system | Page 2

Discussion in 'IMDb+' started by RoChess, November 30, 2012.

  1. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,172
    Likes Received:
    1,301
    Ratings:
    +1,675 / 2
    Ok, so did test on your first one and this is what I get:

    09-Dec-2012 12:24:55 Info [ MovieImporter]: Watcher queued Scooby-Doo Meets The Boo Brothers.avi for processing.
    09-Dec-2012 12:24:56 Debug [ ScraperNode]: Retrieving URL: http://akas.imdb.com/find?s=tt&q=Scooby-Doo Meets The Boo Brothers
    09-Dec-2012 12:24:58 Debug [ DataProviderManager]: SEARCH: Title='Scooby-Doo Meets The Boo Brothers', Provider='IMDb+', Version=4.3.9, Number of Results=1
    09-Dec-2012 12:24:58 Debug [ MovieSignature]: MATCHING: 'scooby doo meets the boo brothers' WITH: 'Scooby-Doo Meets the Boo Brothers' RESULT: TitleScore=0, YearScore=0, ImdbMatch=False, AlternateTitleUsed=False, AlternateTitle='', AutoApprove=True
    09-Dec-2012 12:24:58 Debug [ DatabaseManager]: INSERTING: Scooby-Doo Meets The Boo Brothers.avi
    09-Dec-2012 12:25:02 Info [ ScraperNode]: IMDb+ Scraper: Title adjusted via Default Rename XML for: tt0189070
    09-Dec-2012 12:25:02 Info [ ScraperNode]: IMDb+ Scraper: SortBy adjusted via Default Rename XML for: tt0189070
    09-Dec-2012 12:25:02 Debug [ DataProviderManager]: UPDATE: Title='Scooby-Doo! I: Meets the Boo Brothers', Provider='IMDb+', Version=4.3.9, Result=SUCCESS
    So it works fine for me and there are also a ton of Scooby-Doo rename references in the default database, to be exact the following:

    <rename id="tt0267913" title="Scooby-Doo I" />
    <rename id="tt0331632" title="Scooby-Doo II: Monsters Unleashed" />
    <rename id="tt1258157" title="Scooby-Doo III: The Mystery Begins" />
    <rename id="tt1618435" title="Scooby-Doo IV: Curse of the Lake Monster" />
    <rename id="tt0189070" title="Scooby-Doo! I: Meets the Boo Brothers" sortby="Scooby-Doo! 01" />
    <rename id="tt0189071" title="Scooby-Doo! II: ...and the Ghoul School" sortby="Scooby-Doo! 02" />
    <rename id="tt0189072" title="Scooby-Doo! III: ...and the Reluctant Werewolf" sortby="Scooby-Doo! 03" />
    <rename id="tt0192578" title="Scooby-Doo! IV: ...in Arabian Nights" sortby="Scooby-Doo! 04" />
    <rename id="tt0274804" title="Scooby-Doo! V: Mystery Mask Mix-Up" sortby="Scooby-Doo! 05" />
    <rename id="tt0166792" title="Scooby-Doo! VI: ...on Zombie Island" sortby="Scooby-Doo! 06" />
    <rename id="tt0196931" title="Scooby-Doo! VII: ...and the Witch's Ghost" sortby="Scooby-Doo! 07" />
    <rename id="tt0253658" title="Scooby-Doo! VIII: ...and the Alien Invaders" sortby="Scooby-Doo! 08" />
    <rename id="tt0290057" title="Scooby-Doo! IX: ...and the Cyber Chase" sortby="Scooby-Doo! 09" />
    <rename id="tt0255581" title="Scooby-Doo! X: Creepiest Capers" sortby="Scooby-Doo! 10" />
    <rename id="tt0357139" title="Scooby-Doo! XI: ...and the Legend of the Vampire" sortby="Scooby-Doo! 11" />
    <rename id="tt0369903" title="Scooby-Doo! XII: ...and the Monster of Mexico" sortby="Scooby-Doo! 12" />
    <rename id="tt0199003" title="Scooby-Doo! XIII: Greatest Mysteries" sortby="Scooby-Doo! 13" />
    <rename id="tt0418141" title="Scooby-Doo! XIV: ...and the Loch Ness Monster" sortby="Scooby-Doo! 14" />
    <rename id="tt0433771" title="Scooby-Doo! XV: Aloha, Scooby-Doo" sortby="Scooby-Doo! 05" />
    <rename id="tt1097636" title="Scooby-Doo! XVI: Chill Out, Scooby-Doo!" sortby="Scooby-Doo! 16" />
    <rename id="tt1295021" title="Scooby-Doo! XVII: ...and the Goblin King" sortby="Scooby-Doo! 17" />
    <rename id="tt2162709" title="Scooby-Doo! XVIII: Music of the Vampire" sortby="Scooby-Doo! 18" />
    Pretty sure that covers them all.

    Are you not able to find those in your rename dbase? It should have auto-downloaded it, and v1.5.4 is current.


     
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. TheBatfink
    • Premium Supporter

    TheBatfink MP Donator

    Joined:
    June 11, 2007
    Messages:
    1,285
    Likes Received:
    164
    Gender:
    Male
    Occupation:
    Business System Analyst
    Location:
    Nottingham
    Ratings:
    +221 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Is that imdb+ log file? I'll clear the logs and run another import with debug on..

    And yeah I saw the existing renames but wasnt really interested in the numbering, just the grouping.
     
    Last edited: December 9, 2012
  4. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,172
    Likes Received:
    1,301
    Ratings:
    +1,675 / 2
    No thats from movingpictures.log, but I have debug verbosity enabled, as well as Moving-Pictures scraper-script debugging. That way when something goes wrong it immediatly tells me where it went wrong. But with the exception of the [ScraperNode] entries that show "Debug", you should have gotten all the other ones that say "Info" and if you had debug log verbosity enabled in MediaPortal config, also all the others that say "Debug".

    I add custom log entries from inside the IMDb+ scraper-script, you can open movingpictures.log and do a CTRL+F search on " IMDb+ Scraper: " to locate all those, which makes navigating the giant log files (with scraper-debugging mode mine are like 3MB log file *PER* movie) a lot easier.

    And yes the numbering used in default rename database you might not care for, but it is impossible to make a single system that pleases everybody. It does make it easier to copy-n-paste it to the custom rename file, so you do not have to retype most of it :)
     
    Last edited: December 9, 2012
  5. TheBatfink
    • Premium Supporter

    TheBatfink MP Donator

    Joined:
    June 11, 2007
    Messages:
    1,285
    Likes Received:
    164
    Gender:
    Male
    Occupation:
    Business System Analyst
    Location:
    Nottingham
    Ratings:
    +221 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Code (Text):
    1. 09-Dec-2012 18:01:32 Debug [ DataProviderManager]: SEARCH: Title='Scooby Doo Meets The Boo Brothers', Provider='IMDb+', Version=4.3.9, Number of Results=0
    2. 09-Dec-2012 18:01:32 Debug [ DataProviderManager]: SEARCH: Title='Scooby Doo Abracadabra Doo', Provider='IMDb+', Version=4.3.9, Number of Results=0
    3. 09-Dec-2012 18:01:32 Debug [ DataProviderManager]: SEARCH: Title='Scooby Doos Greatest Mysteries', Provider='IMDb+', Version=4.3.9, Number of Results=0
    4. 09-Dec-2012 18:01:33 Debug [ DataProviderManager]: SEARCH: Title='Scooby Doo And The Goblin King', Provider='themoviedb.org', Version=Internal, Number of Results=1
    Ok I'm not sure exactly how I enable what you need, but imdb+ doesnt seem to be finding matches for search strings which go directly to the movie when entered on the website? How do I enable the scraper debugging?
     
  6. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,172
    Likes Received:
    1,301
    Ratings:
    +1,675 / 2
    I'm wondering if IMDb decided to toss in a lovely geo-IP differentiator in the search results, and detects you are in the UK.

    So yes, unless you know a reliable UK proxy I can use to pretend to be from UK as well, will need your assitance in debugging.

    Keep in mind log files are huge when you enable scraper-debugging inside MovPic, and it has to be a clean SINGLE movie import as the asynchrone nature otherwise makes it a nightmare to figure out.

    To enable scraper-debug mode, explanation at: http://code.google.com/p/imdbplus/wiki/WikiInstallScraper

    And the easiest way for me to fix it, would be if you first move the "'Scooby Doo Meets The Boo Brothers.avi" file OUTSIDE of the MovPic import folder so it gets removed from your database, then enable the above mode, leave MovPic config open, navigate to the LOG folder with Windows Explorer and delete the movingpictures.log file. Wait a few seconds and hit F5 to refresh Windows Explorer, if you see movingpictures.log be created again then delete and wait some more, repeat until after 5-10 secs movingpictures.log does not get created anymore (this gives me a perfect clean log file containing just the problem).

    Then move the "'Scooby Doo Meets The Boo Brothers.avi" file back into the MovPic import folder. Wait till it does its thing (MovPic config Importer Tab should show you a green circle soon that search-node found a match, which then turns into green circle with white checkmark... Since search is failing for you this will then actually be a blue info image that informs you manual interaction is required.

    At that point the log file already contains all I need. So close MovPic config, ZIP up just movingpictures.log file and attach it in here.
     
  7. TheBatfink
    • Premium Supporter

    TheBatfink MP Donator

    Joined:
    June 11, 2007
    Messages:
    1,285
    Likes Received:
    164
    Gender:
    Male
    Occupation:
    Business System Analyst
    Location:
    Nottingham
    Ratings:
    +221 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    As requested :) It sits waiting for manual acceptance of the scraped movie name but its tmdb and not imdb+ still so hopefully that shows what you need.

    Thanks for the help :)
     

    Attached Files:

  8. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,172
    Likes Received:
    1,301
    Ratings:
    +1,675 / 2
    First off, it looks like you have something else monitoring/locking files in that folder, because first thing I see is:

    Code (Text):
    1. 09-Dec-2012 20:58:43  Info [       MovieImporter]: Watcher queued ils.scooby.doo.meets.the.boo.brothers.1987.internal.dvdrip.xvid.avi for processing.
    2. 09-Dec-2012 20:58:44 Debug [  FileInfoExtensions]: Error computing smart hash:  System.IO.IOException: The process cannot access the file '\\SERVER\Data\Movies\Scooby Doo Meets The Boo Brothers (1987)\ils.scooby.doo.meets.the.boo.brothers.1987.internal.dvdrip.xvid.avi' because it is being used by another process.
    3.    at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
    4.    at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy)
    5.    at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share)
    6.    at System.IO.FileInfo.OpenRead()
    7.    at Cornerstone.Extensions.IO.FileInfoExtensions.ComputeSmartHash(FileInfo self)
    8. 09-Dec-2012 20:58:44 Debug [VideoFormatExtension]: Failed Identifier: Path='\\SERVER\Data\Movies\Scooby Doo Meets The Boo Brothers (1987)\ils.scooby.doo.meets.the.boo.brothers.1987.internal.dvdrip.xvid.avi', Format='File'  
    9. 09-Dec-2012 20:58:45 Debug [  FileInfoExtensions]: Error computing smart hash:  System.IO.IOException: The process cannot access the file '\\SERVER\Data\Movies\Scooby Doo Meets The Boo Brothers (1987)\ils.scooby.doo.meets.the.boo.brothers.1987.internal.dvdrip.xvid.avi' because it is being used by another process.
    10.    at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
    11.    at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy)
    12.    at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share)
    13.    at System.IO.FileInfo.OpenRead()
    14.    at Cornerstone.Extensions.IO.FileInfoExtensions.ComputeSmartHash(FileInfo self)
    15.  
    This could be anti-virus scanner, Windows creating thumbnail preview, or uTorrent/etc type of deal, but you might want to look into that, cuz it will cause other issues.

    As for the actual issue, your path has (1987) in it. To assist in the search IMDb+ adds this info which on old IMDb search system helped find the correct match. On the new system this is actually preventing it from finding a match.

    GOOD = http://akas.imdb.com/find?s=tt&q=Scooby Doo Meets The Boo Brothers
    FAIL = http://akas.imdb.com/find?s=tt&q=Scooby Doo Meets The Boo Brothers (1987)

    Will have to look into that, because that will indeed mean a bug otherwise that needs to be fixed. For right now if you remove the year from path it should work for you. Or you can wait till I've really investigated the issue. The whole reason for supplying the year during search is to ensure you get the right movie when multiple releases on same title exists and that still needs to work. Might be till next weekend till I really have time for it, cuz it looks like it might take me many hours to fix this 'correct'.

    So for now supply IMDb tt-ID via NFO or filename, or remove year, and stay tuned for update on IMDb+.

    Thanks for the log, would never have known otherwise.
     
  9. TheBatfink
    • Premium Supporter

    TheBatfink MP Donator

    Joined:
    June 11, 2007
    Messages:
    1,285
    Likes Received:
    164
    Gender:
    Male
    Occupation:
    Business System Analyst
    Location:
    Nottingham
    Ratings:
    +221 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Hmm. My whole naming structure uses the year as thats what the file renamer did from what I remember. I'll manually find them with tt id for now. I noticed the file lock and have no idea whats accessing it. I have no antivirus (its off while I debug some sync issues) and nothing should be accessing it other than MovingPictures.

    Thanks, will try again if you manage to come up with a fix :)
     
  10. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,172
    Likes Received:
    1,301
    Ratings:
    +1,675 / 2
    Ok, was just about to temporary 'fix' IMDb+ by removing year from search system that could possibly introduce new problems and then I noticed something:

    GOOD = http://akas.imdb.com/find?s=tt&q=Scooby-Doo Meets The Boo Brothers (1987)

    So it seems when you provide the year to the search, the title has to an EXACT match, and your file was missing the '-' between Scooby and Doo.

    Let me work on something :)
     
  11. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,172
    Likes Received:
    1,301
    Ratings:
    +1,675 / 2
    Ok, IMDb+ v4.4.0 released, I simple added a second search if title+year yields no results to try it without year. This way it doesn't break existing system and at worst adds a small delay.

    Let me know if it all works out for u now.
     
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!