IMDb+ Scraper (Force English title, Auto-Rename titles to group, and more) v3.1.7 (1 Viewer)

Should this be the default imdb scraper?

  • Yes, I do not want to re-import

    Votes: 19 95.0%
  • No, keep this one seperate

    Votes: 0 0.0%
  • Who cares, I got movies to watch

    Votes: 1 5.0%

  • Total voters
    20
  • Poll closed .

MeMeMe

Portal Pro
August 4, 2010
71
2
Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

Here's an idea for the sortby field.
For groups of movies, like james bond and star trek, just replace the sort field with "set name" + "year", so Star trek (2009) would actually stay the same, but Star Trek II: Wrath of Khan would be "Star Trek (1982)"
This would allow you to continue using roman numerals in the title field if you wanted to.

The best solution would probably be for the Moving Pictures team to add a "MovieSet" field, and allow for sorting on that before movie name.
 

RoChess

Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,434
    1,897
    • Thread starter
    • Moderator
    • #82
    Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

    Here's an idea for the sortby field.
    For groups of movies, like james bond and star trek, just replace the sort field with "set name" + "year", so Star trek (2009) would actually stay the same, but Star Trek II: Wrath of Khan would be "Star Trek (1982)"
    This would allow you to continue using roman numerals in the title field if you wanted to.

    Yes, now that title and sortby adjustments are supported (and they don't have to be the same), that would be possible.

    You could manually edit in the following changes:
    [collapse] <rename id="tt0080761" title="Friday the 13th I: A Long Night at Camp Blood" sortby="Friday the 13th 01" />
    <rename id="tt0082418" title="Friday the 13th II: Part II" sortby="Friday the 13th 02" />
    <rename id="tt0083972" title="Friday the 13th III: Part III" sortby="Friday the 13th 03" />
    <rename id="tt0087298" title="Friday the 13th IV: The Final Chapter" sortby="Friday the 13th 04" />
    <rename id="tt0089173" title="Friday the 13th V: A New Beginning" sortby="Friday the 13th 05" />
    <rename id="tt0091080" title="Friday the 13th VI: Jason Lives" sortby="Friday the 13th 06" />
    <rename id="tt0095179" title="Friday the 13th VII: The New Blood" sortby="Friday the 13th 07" />
    <rename id="tt0097388" title="Friday the 13th VIII: Jason Takes Manhattan" sortby="Friday the 13th 08" />
    <rename id="tt0107254" title="Friday the 13th IX: Jason Goes to Hell - The Final Friday" sortby="Friday the 13th 09" />
    <rename id="tt0211443" title="Friday the 13th X: Jason X" sortby="Friday the 13th 10" />
    <rename id="tt0329101" title="Friday the 13th XI: Freddy vs. Jason" sortby="Friday the 13th 11" />
    <rename id="tt0758746" title="Friday the 13th XII: Friday the 13th (Remake)" sortby="Friday the 13th 12" />

    <rename id="tt0093177" title="Hellraiser I: Hellraiser" sortby="Hellraiser 01" />
    <rename id="tt0095294" title="Hellraiser II: Hellbound" sortby="Hellraiser 02" />
    <rename id="tt0104409" title="Hellraiser III: Hell on Earth" sortby="Hellraiser 03" />
    <rename id="tt0116514" title="Hellraiser IV: Bloodline" sortby="Hellraiser 04" />
    <rename id="tt0229440" title="Hellraiser V: Inferno" sortby="Hellraiser 05" />
    <rename id="tt0274546" title="Hellraiser VI: Hellseeker" sortby="Hellraiser 06" />
    <rename id="tt0337636" title="Hellraiser VII: Deader" sortby="Hellraiser 07" />
    <rename id="tt0354623" title="Hellraiser VIII: Hellworld" sortby="Hellraiser 08" />
    <rename id="tt1716747" title="Hellraiser IX: Revelations" sortby="Hellraiser 09" />

    <rename id="tt0055928" title="James Bond I: Dr. No" sortby="James Bond 01" />
    <rename id="tt0057076" title="James Bond II: From Russia with Love" sortby="James Bond 02" />
    <rename id="tt0058150" title="James Bond III: Goldfinger" sortby="James Bond 03" />
    <rename id="tt0059800" title="James Bond IV: Thunderball" sortby="James Bond 04" />
    <rename id="tt0062512" title="James Bond V: You Only Live Twice" sortby="James Bond 05" />
    <rename id="tt0064757" title="James Bond VI: On Her Majesty's Secret Service" sortby="James Bond 06" />
    <rename id="tt0066995" title="James Bond VII: Diamonds Are Forever" sortby="James Bond 07" />
    <rename id="tt0070328" title="James Bond VIII: Live and Let Die" sortby="James Bond 08" />
    <rename id="tt0071807" title="James Bond IX: The Man with the Golden Gun" sortby="James Bond 09" />
    <rename id="tt0076752" title="James Bond X: The Spy Who Loved Me" sortby="James Bond 10" />
    <rename id="tt0079574" title="James Bond XI: Moonraker" sortby="James Bond 11" />
    <rename id="tt0082398" title="James Bond XII: For Your Eyes Only" sortby="James Bond 12" />
    <rename id="tt0086034" title="James Bond XIII: Octopussy" sortby="James Bond 13" />
    <rename id="tt0090264" title="James Bond XIV: A View to a Kill" sortby="James Bond 14" />
    <rename id="tt0086006" title="James Bond Unofficial: Never Say Never Again" sortby="James Bond 14b" />
    <rename id="tt0093428" title="James Bond XV: The Living Daylights" sortby="James Bond 15" />
    <rename id="tt0097742" title="James Bond XVI: Licence to Kill" sortby="James Bond 16" />
    <rename id="tt0113189" title="James Bond XVII: GoldenEye" sortby="James Bond 17" />
    <rename id="tt0120347" title="James Bond XVIII: Tomorrow Never Dies" sortby="James Bond 18" />
    <rename id="tt0143145" title="James Bond XIX: The World Is Not Enough" sortby="James Bond 19" />
    <rename id="tt0246460" title="James Bond XX: Die Another Day" sortby="James Bond 20" />
    <rename id="tt0381061" title="James Bond XXI: Casino Royale" sortby="James Bond 21" />
    <rename id="tt0830515" title="James Bond XXII: Quantum Of Solace" sortby="James Bond 22" />
    <rename id="tt1074638" title="James Bond XXIII: (Not Yet Released)" sortby="James Bond 23" />

    <rename id="tt0079945" title="Star Trek I: The Motion Picture" sortby="Star Trek 01" />
    <rename id="tt0084726" title="Star Trek II: The Wrath of Khan" sortby="Star Trek 02" />
    <rename id="tt0088170" title="Star Trek III: The Search for Spock" sortby="Star Trek 03" />
    <rename id="tt0092007" title="Star Trek IV: The Voyage Home" sortby="Star Trek 04" />
    <rename id="tt0098382" title="Star Trek V: The Final Frontier" sortby="Star Trek 05" />
    <rename id="tt0102975" title="Star Trek VI: The Undiscovered Country" sortby="Star Trek 06" />
    <rename id="tt0111280" title="Star Trek VII: Generations" sortby="Star Trek 07" />
    <rename id="tt0117731" title="Star Trek VIII: First Contact" sortby="Star Trek 08" />
    <rename id="tt0120844" title="Star Trek IX: Insurrection" sortby="Star Trek 09" />
    <rename id="tt0253754" title="Star Trek X: Nemesis" sortby="Star Trek 10" />
    <rename id="tt0796366" title="Star Trek XI: Star Trek" sortby="Star Trek 11" />
    <rename id="tt1408101" title="Star Trek XII: (Not Yet Released)" sortby="Star Trek 12" />
    [/collapse]

    But I'll wait on a little bit more feedback and other suggestions/fixes before I upload a new revision again.

    This also brings back a subject that will have many different opinions, and that is if the default way should use:

    The Art Of War I
    The Art Of War II: Betrayal
    The Art Of War III: Retribution​

    Or stick with the original imdb title for the first part, as in:

    The Art Of War
    The Art Of War II: Betrayal
    The Art Of War III: Retribution​

    By using a sortby="The Art Of War I" entry on the first movie, it will still get sorted in the correct order, but this would remove the direct visual connection to the group that the Roman numeral 'I' provides. Of course everybody can edit the XML file to their own personal preferences, but by using defaults that most people agree on, it will make it easier for new users, as they do not have to start out by having to modify everything.

    Thoughts?
     

    wonkyd

    Retired Team Member
  • Premium Supporter
  • August 29, 2007
    792
    177
    Home Country
    United Kingdom United Kingdom
    Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

    Here's an idea for the sortby field.
    For groups of movies, like james bond and star trek, just replace the sort field with "set name" + "year", so Star trek (2009) would actually stay the same, but Star Trek II: Wrath of Khan would be "Star Trek (1982)"
    This would allow you to continue using roman numerals in the title field if you wanted to.

    Yes, now that title and sortby adjustments are supported (and they don't have to be the same), that would be possible.

    You could manually edit in the following changes:
    [collapse] <rename id="tt0080761" title="Friday the 13th I: A Long Night at Camp Blood" sortby="Friday the 13th 01" />
    <rename id="tt0082418" title="Friday the 13th II: Part II" sortby="Friday the 13th 02" />
    <rename id="tt0083972" title="Friday the 13th III: Part III" sortby="Friday the 13th 03" />
    <rename id="tt0087298" title="Friday the 13th IV: The Final Chapter" sortby="Friday the 13th 04" />
    <rename id="tt0089173" title="Friday the 13th V: A New Beginning" sortby="Friday the 13th 05" />
    <rename id="tt0091080" title="Friday the 13th VI: Jason Lives" sortby="Friday the 13th 06" />
    <rename id="tt0095179" title="Friday the 13th VII: The New Blood" sortby="Friday the 13th 07" />
    <rename id="tt0097388" title="Friday the 13th VIII: Jason Takes Manhattan" sortby="Friday the 13th 08" />
    <rename id="tt0107254" title="Friday the 13th IX: Jason Goes to Hell - The Final Friday" sortby="Friday the 13th 09" />
    <rename id="tt0211443" title="Friday the 13th X: Jason X" sortby="Friday the 13th 10" />
    <rename id="tt0329101" title="Friday the 13th XI: Freddy vs. Jason" sortby="Friday the 13th 11" />
    <rename id="tt0758746" title="Friday the 13th XII: Friday the 13th (Remake)" sortby="Friday the 13th 12" />

    <rename id="tt0093177" title="Hellraiser I: Hellraiser" sortby="Hellraiser 01" />
    <rename id="tt0095294" title="Hellraiser II: Hellbound" sortby="Hellraiser 02" />
    <rename id="tt0104409" title="Hellraiser III: Hell on Earth" sortby="Hellraiser 03" />
    <rename id="tt0116514" title="Hellraiser IV: Bloodline" sortby="Hellraiser 04" />
    <rename id="tt0229440" title="Hellraiser V: Inferno" sortby="Hellraiser 05" />
    <rename id="tt0274546" title="Hellraiser VI: Hellseeker" sortby="Hellraiser 06" />
    <rename id="tt0337636" title="Hellraiser VII: Deader" sortby="Hellraiser 07" />
    <rename id="tt0354623" title="Hellraiser VIII: Hellworld" sortby="Hellraiser 08" />
    <rename id="tt1716747" title="Hellraiser IX: Revelations" sortby="Hellraiser 09" />

    <rename id="tt0055928" title="James Bond I: Dr. No" sortby="James Bond 01" />
    <rename id="tt0057076" title="James Bond II: From Russia with Love" sortby="James Bond 02" />
    <rename id="tt0058150" title="James Bond III: Goldfinger" sortby="James Bond 03" />
    <rename id="tt0059800" title="James Bond IV: Thunderball" sortby="James Bond 04" />
    <rename id="tt0062512" title="James Bond V: You Only Live Twice" sortby="James Bond 05" />
    <rename id="tt0064757" title="James Bond VI: On Her Majesty's Secret Service" sortby="James Bond 06" />
    <rename id="tt0066995" title="James Bond VII: Diamonds Are Forever" sortby="James Bond 07" />
    <rename id="tt0070328" title="James Bond VIII: Live and Let Die" sortby="James Bond 08" />
    <rename id="tt0071807" title="James Bond IX: The Man with the Golden Gun" sortby="James Bond 09" />
    <rename id="tt0076752" title="James Bond X: The Spy Who Loved Me" sortby="James Bond 10" />
    <rename id="tt0079574" title="James Bond XI: Moonraker" sortby="James Bond 11" />
    <rename id="tt0082398" title="James Bond XII: For Your Eyes Only" sortby="James Bond 12" />
    <rename id="tt0086034" title="James Bond XIII: Octopussy" sortby="James Bond 13" />
    <rename id="tt0090264" title="James Bond XIV: A View to a Kill" sortby="James Bond 14" />
    <rename id="tt0086006" title="James Bond Unofficial: Never Say Never Again" sortby="James Bond 14b" />
    <rename id="tt0093428" title="James Bond XV: The Living Daylights" sortby="James Bond 15" />
    <rename id="tt0097742" title="James Bond XVI: Licence to Kill" sortby="James Bond 16" />
    <rename id="tt0113189" title="James Bond XVII: GoldenEye" sortby="James Bond 17" />
    <rename id="tt0120347" title="James Bond XVIII: Tomorrow Never Dies" sortby="James Bond 18" />
    <rename id="tt0143145" title="James Bond XIX: The World Is Not Enough" sortby="James Bond 19" />
    <rename id="tt0246460" title="James Bond XX: Die Another Day" sortby="James Bond 20" />
    <rename id="tt0381061" title="James Bond XXI: Casino Royale" sortby="James Bond 21" />
    <rename id="tt0830515" title="James Bond XXII: Quantum Of Solace" sortby="James Bond 22" />
    <rename id="tt1074638" title="James Bond XXIII: (Not Yet Released)" sortby="James Bond 23" />

    <rename id="tt0079945" title="Star Trek I: The Motion Picture" sortby="Star Trek 01" />
    <rename id="tt0084726" title="Star Trek II: The Wrath of Khan" sortby="Star Trek 02" />
    <rename id="tt0088170" title="Star Trek III: The Search for Spock" sortby="Star Trek 03" />
    <rename id="tt0092007" title="Star Trek IV: The Voyage Home" sortby="Star Trek 04" />
    <rename id="tt0098382" title="Star Trek V: The Final Frontier" sortby="Star Trek 05" />
    <rename id="tt0102975" title="Star Trek VI: The Undiscovered Country" sortby="Star Trek 06" />
    <rename id="tt0111280" title="Star Trek VII: Generations" sortby="Star Trek 07" />
    <rename id="tt0117731" title="Star Trek VIII: First Contact" sortby="Star Trek 08" />
    <rename id="tt0120844" title="Star Trek IX: Insurrection" sortby="Star Trek 09" />
    <rename id="tt0253754" title="Star Trek X: Nemesis" sortby="Star Trek 10" />
    <rename id="tt0796366" title="Star Trek XI: Star Trek" sortby="Star Trek 11" />
    <rename id="tt1408101" title="Star Trek XII: (Not Yet Released)" sortby="Star Trek 12" />
    [/collapse]

    But I'll wait on a little bit more feedback and other suggestions/fixes before I upload a new revision again.

    This also brings back a subject that will have many different opinions, and that is if the default way should use:

    The Art Of War I
    The Art Of War II: Betrayal
    The Art Of War III: Retribution​

    Or stick with the original imdb title for the first part, as in:

    The Art Of War
    The Art Of War II: Betrayal
    The Art Of War III: Retribution​

    By using a sortby="The Art Of War I" entry on the first movie, it will still get sorted in the correct order, but this would remove the direct visual connection to the group that the Roman numeral 'I' provides. Of course everybody can edit the XML file to their own personal preferences, but by using defaults that most people agree on, it will make it easier for new users, as they do not have to start out by having to modify everything.

    Thoughts?

    I would certainly prefer that the movies kept their original titles in the list view, such as "Casino Royal" but sorted as James Bond 21, or Austin Powers: Goldmember sorted as Austin Powers III
     

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,434
    1,897
    • Thread starter
    • Moderator
    • #84
    Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

    I would certainly prefer that the movies kept their original titles in the list view, such as "Casino Royal" but sorted as James Bond 21, or Austin Powers: Goldmember sorted as Austin Powers III

    That is somewhat easy as well.

    1. Open the "Rename dBase IMDb+ Scraper.xml" file in notepad.
    2. Use CTRL+F to bring up the search dialog
    3. Search on sortby to make sure you do not have any entries other then the two examples in the description. If you have any remove them (or delete the title="...." part).
    4. Then use CTRL+H to bring up the replace dialog
    5. For the "Find what" field use: title=
    6. For the "Replace with" field use: sortby=
    7. Click on 'Replace All'
    8. Close notepad and save your changes.

    This will then not adjust the title, but only the SortBy field, so you get the results you desire.
     

    ninjatobben

    Portal Member
    March 31, 2010
    22
    1
    Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

    Thanks for this!!! The titles were driving me nuts.
    One request: Would it be possible to add an option for using the opposite of the current dual title, such as this: "Foreign title (English title)"? I don't know much about scripting, but it seems like it would not be too hard, all the data is already available?
     

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,434
    1,897
    • Thread starter
    • Moderator
    • #86
    Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

    Thanks for this!!! The titles were driving me nuts.
    One request: Would it be possible to add an option for using the opposite of the current dual title, such as this: "Foreign title (English title)"? I don't know much about scripting, but it seems like it would not be too hard, all the data is already available?

    Yes, that is possible, infact when I added the option for "English title (Foreign title)" I thought to add the support for reverse as well, but then figured since this is an English title scraper that nobody would want to use that way :D

    If you want to change it now, then locate:

    Code:
    <set name="movie.title" value="${title_year[0][2]:htmldecode} (${title_year[0][0]:htmldecode})" />

    inside the scraper source at line 536, and replace it with:

    Code:
    <set name="movie.title" value="${title_year[0][0]:htmldecode} (${title_year[0][2]:htmldecode})" />

    Or you can wait for a few week, and I will release a new version that will have a 'global_options_foreign_first' setting for this. Reason for the delay is because I'm in the process of trying to optimize the code to make the scraper faster, which would benefit more users then adding this change for your scenario. It will get implemented, but until then just make the edit in notepad :)

    PS: My bad, you need to be in scraper-debug-enabled mode to make changes like that after you have already imported the scraper. So be sure to change the "<version major="3" minor="1" point="4" />" part at the top into "<version major="3" minor="1" point="41" />", and modify the date as well to be today. That way you will import v3.1.41 without any issues after you make those changes.
     

    ninjatobben

    Portal Member
    March 31, 2010
    22
    1
    Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

    Thanks, it works perfectly.

    I think the explanation for using metacritics score is reverse of how it actually works.
    <set name="global_options_imdb_metascore" value="false" /> <!-- IMDb score | Metacritics metascore -->
    I have to set this line to false to use IMDb scores, but the example says to set it to true.
     

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,434
    1,897
    • Thread starter
    • Moderator
    • #88
    Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

    Thanks, it works perfectly.

    I think the explanation for using metacritics score is reverse of how it actually works.
    <set name="global_options_imdb_metascore" value="false" /> <!-- IMDb score | Metacritics metascore -->
    I have to set this line to false to use IMDb scores, but the example says to set it to true.

    Nice catch :D

    I've changed it to:

    Code:
    <!-- Metacritics score	| Use IMDb if enabled	-->

    Because it does rely on the value of 'global_options_imdb_score' being set to 'true'.

    Since you are a first time user, was the first post and everything else self-explanatory? The fact that notepad editing is need to get the most out of this scraper makes it a little awkward for most users.
     

    ninjatobben

    Portal Member
    March 31, 2010
    22
    1
    Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

    I didn't have any problems understanding it. I am more competent than average with computers, but I would guess most people using Media Portal is.
     

    zicoz

    MP Donator
  • Premium Supporter
  • September 3, 2006
    896
    63
    Home Country
    Norway Norway
    Re: IMDb+ Scraper (Force English titles, Auto-Rename titles to group, and more) v3.1.

    What does the following line do? Looks like english speaking nations, but can't find any info on what the line actually does.

    <set name="global_options_country_filter" value="us|gb|ie|au|nz" />

    Does it do the same as the

    <set name="global_options_language_filter" value="no|sv|qae|da|en|us"

    But use the country tag instead of language? Do I have to use both, or can I delete one?


    edit:

    Found an "error" in the rename file:

    Remake for Friday the 13th should be renamed to


    Code:
    <rename id="tt0758746" title="Friday the 13th (Remake) I: Friday the 13th" />

    To match the layout for other series such as Halloween and other remakes

    Atm it's:


    Code:
    	<rename id="tt0758746" title="Friday the 13th 12: Friday the 13th (Remake)" />
    While the other remakes I find use (remake) 01

    I've also added these to my own file:

    Code:
    	<rename id="tt0086837" title="2010: The Year We Made Contact" />
    	<rename id="tt1024724" title="Doctor Dolittle IV: Tail to the Chief" />
    	<rename id="tt0081318" title="City of the Living Dead" />
    	<rename id="tt0086135" title="The Raiders of Atlantis" />
    	<rename id="tt0087800" title="A Nightmare on Elm Street 01:" />
    	<rename id="tt0089686" title="A Nightmare on Elm Street 02: Freddy's Revenge"	/>
    	<rename id="tt0093629" title="A Nightmare on Elm Street 03: Dream Warriors"	/>
    	<rename id="tt0095742" title="A Nightmare on Elm Street 04: The Dream Master"	/>
    	<rename id="tt0097981" title="A Nightmare on Elm Street 05: The Dream Child "	/>
    	<rename id="tt0101917" title="A Nightmare on Elm Street 06: Freddy's Dead - The Final Nightmare" />
    	<rename id="tt0111686" title="A Nightmare on Elm Street 07: New Nightmare" /> 
    	<rename id="tt1179056" title="A Nightmare on Elm Street (remake) 01"  /> 
    	<rename id="tt0432373" title="Bachelor Party 1: Vegas" />
    	<rename id="tt0954541" title="Bachelor Party 2: The Last Temptation" />
    	<rename id="tt0093130" title="Gunsmoke I: Return to Dodge"	/>
    	<rename id="tt0099721" title="Gunsmoke II: The Last Apache" />
    	<rename id="tt0104379" title="Gunsmoke III: To the Last Man" /> 
    	<rename id="tt0107062" title="Gunsmoke IV: The Long Ride"  /> 
    	<rename id="tt0109961" title="Gunsmoke V: One Man's Justice" />
     

    Users who are viewing this thread

    Top Bottom