IMDb+ Plugin 2.1.0.291 with IMDb+ Scraper v4.9.xxx (1 Viewer)

RoChess

Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,433
    1,895
    Okay was able to force it on my development box, private browser window for the win.

    Normal view that IMDb+ works with:

    1622327991496.png

    New view that I have to fix RegEx on:

    1622328024311.png

    I guess IMDb will at random give that view to you, and I've seen it before and IMDb+ still worked, but what I see in the browser and what IMDb+ processes when it executes the <retrieve> node are completely different sometimes.

    Hopefully, it will be an easy fix, and I'll post update momentarily, or it might take me a while.

    The clock starts now :whistle:
     

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,433
    1,895
    Scraper script v4.10.8 released.

    That took quite the effort, and I'm sure I overlooked a few things, or have to clean-up some bugs, but that's for another day.

    Had other plans for today, so any donations are much appreciated for those more fortunate, otherwise at least leave some Likes (y)

     

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,433
    1,895
    I've noticed some mistakes still, but family and F1 race in Azerbaijan is more important to me this weekend, so I'll get to IMDb+ eventually :whistle:
     

    tooker

    Portal Member
    September 27, 2012
    14
    8
    40
    Saint-Petersburg
    Home Country
    Russian Federation Russian Federation
    Hello!
    Recently I have had a problem getting English titles for movies. Didn't notice when it started. Even though it is set to prefer English titles in the IMDB+ options, I get Russian ones. Also for the Serenity movie (second log file) in the "Summary field" it is shown "For test purposes only.", and not the real summary. Here is the log files for two films (as the example).
     

    Attachments

    • movingpictures_log.zip
      489.8 KB

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,433
    1,895
    Thanks @tooker I've been a little lax on fixing some core issues within IMDb+ that IMDb.com created with the new design.

    It happens only on a few movies for me, so those are always difficult to debug when it is random. Your log file hopefully contains everything I need to resolve it, because I need those raw HTML sources included to fix the RegularExpressions.

    Fingers crossed I'll have time this weekend.
     

    fredco

    Portal Pro
    November 13, 2010
    117
    28
    Home Country
    Netherlands Netherlands
    I also have a problem with localization, which is haunting me for quite some time now. As you know, I live in the Netherlands with native language Dutch. I have a large library of movies with which I have different issues. For testing I recently did a full new scan in Moving Pictures of 1.500 plus movies. Almost every movie is picked up by IMDB+. Issue number one is that SOME movies get their Dutch name assiged to them by IMDB+:

    tt0039404 Fun & Fancy Free (1947) --> Bongo de Beer (1947)
    tt0053285 Sleeping Beauty (1959) --> Doornroosje (1959)
    tt0029583 Snow White and the Seven Dwarfs (1937) --> Sneeuwwitje en de zeven dwergen (1937)
    tt0398286 Tangled (2010) --> Rapunzel (2010)
    tt0116583 The Hunchback of Notre Dame (1996) --> De klokkenluider van de Notre Dame (1996)
    tt0133240 Treasure Planet (2002) --> Piratenplaneet (2002)
    tt2948356 Zootopia (2016) --> Zootropolis (2016)
    tt2096673 Inside Out (2015) --> Binnenstebuiten (2015)
    tt0076683 The Sentinel (1977) --> De wachter (1977)
    tt0105121 The People Under the Stairs (1991) --> De mensen onder de trap (1991)
    tt0050083 12 Angry Men (1957) --> De 12 gezworenen (1957)
    tt0031381 Gone with the Wind (1939) --> Gejaagd door de wind (1939)
    tt0053604 The Apartment (1960) --> Het appartement (1960)
    tt0062737 Blackbeard's Ghost (1968) --> Een Spookpiraat als Maat (1968)
    tt2788732 Pete's Dragon (2016) --> Peter en de Draak (2016)
    tt0054357 Swiss Family Robinson (1960) --> De wonderbaarlijke belevenissen van de familie Robinson (1960)
    tt0065482 The Boatniks (1970) --> Laat je niet in de boot nemen (1970)
    tt1964418 Tomorrowland (2015) --> Project T (2015)


    Of these anime movies I even get there JAPANESE counterpart (not ALL of them):

    tt0092067 Castle in the Sky (1986) --> Tenkû no shiro Rapyuta (1986)
    tt0347149 Howl's Moving Castle (2004) --> Hauru no ugoku shiro (2004)
    tt0097814 Kiki's Delivery Service (2014) --> Majo no takkyûbin (as Kiki's Delivery Service) (2014)
    tt0096283 My Neighbor Totoro (1988) --> Tonari no Totoro (1988)
    tt0087544 Nausicaä of the Valley of the Wind (1984) --> Kaze no tani no Naushika (1984)
    tt0104652 Porco Rosso (1992) --> Kurenai no buta (1992)
    tt0119698 Princess Mononoke (1997) --> Mononoke-hime (1997)
    tt0831888 Tekkonkinkreet (2006) --> Tekkon kinkurîto (2006)
    tt2013293 The Wind Rises (2013) --> Kaze tachinu (2013)


    Question is of course: why does this happen and why only with so little movies. Above are only 27 movies out of 1.500 and it is happening for quite some time now. So this issue is not a recent change in IMDB. To be clear: I want ALL my movies to have English titles.
     
    Last edited:

    fredco

    Portal Pro
    November 13, 2010
    117
    28
    Home Country
    Netherlands Netherlands
    Another issue also has got to do with localization, but is different. I have a FEW movies that MUST have a Dutch title, otherwise they simply won't get picked up by IMDB+. If I supply the Dutch title, all goes well:

    De Kleine Zeemeermin II (2000) --> The Little Mermaid II: Return to the Sea (2000)
    Lady en de Vagebond II - Rakker's Avontuur (2001) --> Lady and the Tramp II: Scamp's Adventure (2001)
    De Reis van Chihiro (2001) --> Spirited Away (2001)
    Harry Potter en de gevangene van Azkaban (2004) --> Harry Potter III: The Prisoner of Azkaban (2004)
    Harry Potter en de geheime kamer (2002) --> Harry Potter II: Chamber of Secrets (2002)
    Harry Potter en de halfbloed prins (2009) --> Harry Potter VI: The Half-Blood Prince (2009)
    Harry Potter en de steen der wijzen (2001) --> Harry Potter I: Sorcerer's Stone (2001)
    Harry Potter en de vuurbeker (2005) --> Harry Potter IV: The Goblet of Fire (2005)
    De Hobbit - De Woestenij van Smaug (2013) --> The Hobbit II: The Desolation of Smaug (2013)
    De Hobbit - Een Onverwachte Reis (2012) --> The Hobbit I: An Unexpected Journey (2012)
    De Hobbit - De Slag van Vijf Legers (2014) --> The Hobbit III: The Battle of the Five Armies (2014)
    2001 - Een Zwerftocht in de Ruimte (1968) --> 2001 I: A Space Odyssey (1968)


    Same question: why? And why only this little movies and also for a long time now.
     

    fredco

    Portal Pro
    November 13, 2010
    117
    28
    Home Country
    Netherlands Netherlands
    I also have a lot of 4K movies (mkv-files), that seem to have the same issues, but sometimes with the same movies, sometimes not:

    UHD-Movies that DEMAND a Dutch title:

    Harry Potter en de steen der wijzen (2001).mkv --> Harry Potter I: Sorcerer's Stone (2001)
    Harry Potter en de geheime kamer (2002).mkv --> Harry Potter II: Chamber of Secrets (2002)
    Harry Potter en de gevangene van Azkaban (2004).mkv --> Harry Potter III: The Prisoner of Azkaban (2004)
    Harry Potter en de halfbloed prins (2009).mkv --> Harry Potter VI: The Half-Blood Prince (2009)
    Harry Potter en de vuurbeker (2005).mkv --> Harry Potter IV: The Goblet of Fire (2005)
    2001 Een Zwerftocht in de Ruimte (1968).mkv --> 2001 I: A Space Odyssey (1968)
    De Lego Film (2014).mkv --> The Lego Movie I (2014)
    De Donkere Toren (2017).mkv --> The Dark Tower (2017)
    Monster's Universiteit (2013).mkv --> Monsters, Inc. II: University (2013)
    De Hobbit - De Slag van Vijf Legers (2014).mkv --> The Hobbit III: The Battle of the Five Armies (2014)
    De Hobbit - De Woestenij van Smaug (2013).mkv --> The Hobbit II: The Desolation of Smaug (2013)
    De Hobbit - Een Onverwachte Reis (2012).mkv --> The Hobbit I: An Unexpected Journey (2012)


    UHD-Movies that transfer to Dutch:

    Abominable (2019).mkv --> Everest: De jonge Yeti (2019)
    Moana (2016).mkv --> Vaiana (2016)
    Tangled (2010).mkv --> Rapunzel (2010)
    Zootopia (2016).mkv --> Zootropolis (2016)
    Inside Out (2015).mkv --> Binnenstebuiten (2015)


    Same as before: why?
     

    fredco

    Portal Pro
    November 13, 2010
    117
    28
    Home Country
    Netherlands Netherlands
    Lastly, I came across some other things while scanning my whole library which raises some questions. (Not caused by localization.)

    Assault on Wall Street (2013) --> Bailout: The Age of Greed (2013)
    Why this change in name? I think the original name is Assault on Wall Street.

    Hotel for Dogs (2009) --> Hotel for Dogs (2007)
    I think this movie is from 2009. If so, it should be corrected, otherwise it won't get picked up.

    Kill the Irishman (2011) --> Kill the Irishman (2017)
    Same here: I think 2011 is correct.

    The X-Files (1998) --> The Sex Files (1999)
    Strange conversion.

    I also have some concerts, which always have been difficult for IMDB+, but it is getting much better. I still have problems with the ones below that revert back to TMDB:

    I cannot put a "/" in the filename for AC/DC, so it doesn't get picked up:
    ACDC - Live at Donington (1992) --> AC/DC: Live at Donington (1992) [themoviedb.org]
    ACDC - Live at River Plate (2009) --> AC/DC: Live At River Plate (2009) [themoviedb.org]

    Daryl Hall and John Oates Live at the Troubadour (2008) --> Daryl Hall and John Oates - Live at the Troubadour (2008) [themoviedb.org]
    Muse - Simulation Theory (2019) --> Muse: Simulation Theory (2020) [themoviedb.org]
    Supertramp - Live in Paris '79 (2012) --> Supertramp: Live in Paris ’79 (2012) [themoviedb.org]
     

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,433
    1,895
    Lastly, I came across some other things while scanning my whole library which raises some questions. (Not caused by localization.)

    Assault on Wall Street (2013) --> Bailout: The Age of Greed (2013)
    Why this change in name? I think the original name is Assault on Wall Street.

    Hotel for Dogs (2009) --> Hotel for Dogs (2007)
    I think this movie is from 2009. If so, it should be corrected, otherwise it won't get picked up.

    Kill the Irishman (2011) --> Kill the Irishman (2017)
    Same here: I think 2011 is correct.

    The X-Files (1998) --> The Sex Files (1999)
    Strange conversion.

    I also have some concerts, which always have been difficult for IMDB+, but it is getting much better. I still have problems with the ones below that revert back to TMDB:

    I cannot put a "/" in the filename for AC/DC, so it doesn't get picked up:
    ACDC - Live at Donington (1992) --> AC/DC: Live at Donington (1992) [themoviedb.org]
    ACDC - Live at River Plate (2009) --> AC/DC: Live At River Plate (2009) [themoviedb.org]

    Daryl Hall and John Oates Live at the Troubadour (2008) --> Daryl Hall and John Oates - Live at the Troubadour (2008) [themoviedb.org]
    Muse - Simulation Theory (2019) --> Muse: Simulation Theory (2020) [themoviedb.org]
    Supertramp - Live in Paris '79 (2012) --> Supertramp: Live in Paris ’79 (2012) [themoviedb.org]

    Highly recommend adding the IMDb tt-ID number to the filename, which skips the whole IMDb search (which is just plain terrible, but okayish when nothing else can be used).

    There are many tools that can automate this for you.

    Will have to dig into the search-node again, but it's a pain in the a... and I struggle to find time lately as that would be like 4-6 hours of "fun" staring at HTML results and trial-and-error often to figure out a solution.

    Patience is a virtue though, right? :whistle:
     

    Users who are viewing this thread

    Top Bottom