home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
MediaPortal 1 Plugins
Popular Plugins
Moving Pictures
IMDb+ Scraper (Force English title, Auto-Rename titles to group, and more) v3.1.7
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="RoChess" data-source="post: 718831" data-attributes="member: 18896"><p><strong>Re: IMDb+ Scraper (short/long summary, imdb/RT score, US/UK rating, and more)</strong></p><p></p><p></p><p></p><p>There are a few dedicated Danish scrapers based on other website sources that are build and supported by Danish users who know the language. Reason being is that imdb.com is very indifference on what ratings they support. The English speaking markets are well covered, but it gets real iffy on the non-English ones. It would probably be easier for the Danish scraper creator to build an English version of their scraper with Danish ratings then for me to do it the other way around.</p><p></p><p>If however the Danish rating is always a direct conversion of the US or UK rating, then I can add a conversion. For example if a US rated movie with PG always means 'A' for Denmark, and you would be fine with that conversion, then it will be indeed easy for me to add it. But prune American ratings don't always match the rest of the world. So let me know.</p><p></p><p></p><p></p><p>On both movies can you please goto the imdb webpage and copy and paste the HTML sources that you get onto paste2.org website. For example I get <a href="http://paste2.org/p/1268833" target="_blank">Paste2: Next Generation Pastebin - Viewing Paste 1268833</a> when I do that from USA, but you are getting a different result. The key in this case is when you scroll down to line #49, you will see "US". The scraper looks for this and verifies if it is US, UK, CA, AU and NZ as these are all English speaking countries and it will then use the title as-is (as it will be the correct English title). If not, it will jump to the "Also known as: ..." title, which then becomes the "Laisse-moi entrer" title on an already English title page.</p><p></p><p>Unfortunatly I am limited to what imdb.com gives me back, so you will have to help me a little to fix this problem <img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite1" alt=":)" title="Smile :)" loading="lazy" data-shortname=":)" /></p><p></p><p></p><p></p><p>I'll try to come up with a better explanation then, in short, open the scraper XML file in notepad, edit the <id>...</id> part to match the official imdb.com scraper, import the scraper and you will not have to re-import any existing movie. This scraper will then as far as MovingPictures knows become the new imdb.com scraper. However I had to keep this one seperate, because it does a lot more then the default scraper and not everybody might want that (hence the poll). For example the default RottenTomatoes score is a big one.</p><p></p><p>So for a proper database you would have to refresh all your movies, so that they can all get this RT score (unless of course you change all the global_options). So on purpose I did not release a version with the same ID as the official imdb.com scraper, because I want the users of this one to look at all the options and be comfortable to edit the scraper settings in notepad.</p><p></p><p>However what I will do in the next version is make it easier to switch to the official imdb.com ID by adding it in the header under the comments. That way you can copy and paste from within the scraper source to adjust.</p><p></p><p></p><p></p><p>It would really help me (and others) if you could provide me with a list of filenames that didn't scan/match. Perhaps it will be possible for me to improve the scraper, so that this will go better next time. And I run this scraper myself with the changed ID because I did not wanted to loose my watched status and all the adjustments to titles I had already done. As I explained to damaster the next version will make it a little easier to switch. The only problem then is that you have to make those changes everytime a new version comes out (unless you prefer other global_options then the default settings). <s>But I will adjust the explanation on first post as well then when I release next version to fix the problems reported by the other users.</s> -- let me know if my new explanation is less confusing <img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite8" alt=":D" title="Big Grin :D" loading="lazy" data-shortname=":D" /></p><p></p><p></p><p></p><p>Hi Gix, can you please read above to my reply to 'mat123', the same goes for you, I am sure imdb.com has more country codes in English that I need to add, but I will need your help to find them. So please paste2.org me the HTML source on a movie that failed, so I can fix it.</p></blockquote><p></p>
[QUOTE="RoChess, post: 718831, member: 18896"] [b]Re: IMDb+ Scraper (short/long summary, imdb/RT score, US/UK rating, and more)[/b] There are a few dedicated Danish scrapers based on other website sources that are build and supported by Danish users who know the language. Reason being is that imdb.com is very indifference on what ratings they support. The English speaking markets are well covered, but it gets real iffy on the non-English ones. It would probably be easier for the Danish scraper creator to build an English version of their scraper with Danish ratings then for me to do it the other way around. If however the Danish rating is always a direct conversion of the US or UK rating, then I can add a conversion. For example if a US rated movie with PG always means 'A' for Denmark, and you would be fine with that conversion, then it will be indeed easy for me to add it. But prune American ratings don't always match the rest of the world. So let me know. On both movies can you please goto the imdb webpage and copy and paste the HTML sources that you get onto paste2.org website. For example I get [url=http://paste2.org/p/1268833]Paste2: Next Generation Pastebin - Viewing Paste 1268833[/url] when I do that from USA, but you are getting a different result. The key in this case is when you scroll down to line #49, you will see "US". The scraper looks for this and verifies if it is US, UK, CA, AU and NZ as these are all English speaking countries and it will then use the title as-is (as it will be the correct English title). If not, it will jump to the "Also known as: ..." title, which then becomes the "Laisse-moi entrer" title on an already English title page. Unfortunatly I am limited to what imdb.com gives me back, so you will have to help me a little to fix this problem :) I'll try to come up with a better explanation then, in short, open the scraper XML file in notepad, edit the <id>...</id> part to match the official imdb.com scraper, import the scraper and you will not have to re-import any existing movie. This scraper will then as far as MovingPictures knows become the new imdb.com scraper. However I had to keep this one seperate, because it does a lot more then the default scraper and not everybody might want that (hence the poll). For example the default RottenTomatoes score is a big one. So for a proper database you would have to refresh all your movies, so that they can all get this RT score (unless of course you change all the global_options). So on purpose I did not release a version with the same ID as the official imdb.com scraper, because I want the users of this one to look at all the options and be comfortable to edit the scraper settings in notepad. However what I will do in the next version is make it easier to switch to the official imdb.com ID by adding it in the header under the comments. That way you can copy and paste from within the scraper source to adjust. It would really help me (and others) if you could provide me with a list of filenames that didn't scan/match. Perhaps it will be possible for me to improve the scraper, so that this will go better next time. And I run this scraper myself with the changed ID because I did not wanted to loose my watched status and all the adjustments to titles I had already done. As I explained to damaster the next version will make it a little easier to switch. The only problem then is that you have to make those changes everytime a new version comes out (unless you prefer other global_options then the default settings). [s]But I will adjust the explanation on first post as well then when I release next version to fix the problems reported by the other users.[/s] -- let me know if my new explanation is less confusing :D Hi Gix, can you please read above to my reply to 'mat123', the same goes for you, I am sure imdb.com has more country codes in English that I need to add, but I will need your help to find them. So please paste2.org me the HTML source on a movie that failed, so I can fix it. [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
MediaPortal 1 Plugins
Popular Plugins
Moving Pictures
IMDb+ Scraper (Force English title, Auto-Rename titles to group, and more) v3.1.7
Contact us
RSS
Top
Bottom