Polish and Spanish language scraper support (merged) (1 Viewer)

NightOwl69

Portal Member
September 4, 2007
18
2
Re: IMDb+ Scraper - Movie Scraping on Steroids v3.3.9

Thanks this script is great. I modified an old version slightly so when it's configured to use UK ratings it gets Australian ratings as follows.

<if test="${global_options_uk_rating}=true">
<set name="rx_certification">
<![CDATA[
(?:>\s*Australia:|Rated\s*?)(?<movieCertification>(?:C)|(?:G)|(?:pG)|(?:MA)|(?:M)|(?:R)|(?:X))(?:</a>|\s*?for)
]]>
</set>

It would be great if you could extend its capabilities to select a country of choice for the ratings?

I'm just trying to figure out where your new extension installer puts the script at the moment so I can make the same mod to the latest version.
 

pantav

Portal Pro
January 5, 2009
68
5
Home Country
Spain Spain
Re: IMDb+ Scraper - Movie Scraping on Steroids v3.3.9

Hello,

I decide not to wait to Spanish full suport for your scrapper and installed it. First: tanks.

The scrapper is not showing in MovinPictures movie details scrappers list. I searched in the C: unit for all the files named with imdb an I can't not find the scrapper.

Finally I browsed to google code and dowloaded and added the scrapper, but maybe there are an error in the installer. I never used it before this time (and i unistalled and reinstalled three times).

The Imdb+ plugin works. I configured the scrapper (switching to wide skin, because black glass doesn't support the new features).

The log says:

Code:
19/11/2011 18:36:47[MPMain][1][Info] Starting IMDb+ v1.3.0.188
19/11/2011 18:36:47[MPMain][1][Info] Using language es
19/11/2011 18:36:47[MPMain][1][Warning] Cannot find translation file C:\ProgramData\Team MediaPortal\MediaPortal\Language\IMDb+\es.xml. Falling back to English
19/11/2011 18:36:47[MPMain][1][Debug] Loading IMDb+ options from file.
19/11/2011 18:36:47[MPMain][1][Debug] Saving IMDb+ options to file.
19/11/2011 18:36:47[Extension Settings][12][Info] Adding hooks to MPEI Settings
19/11/2011 18:36:47[Extension Settings][12][Warning] Unable to add hooks into MPEI Settings, Extensions plugin not installed or out of date!
19/11/2011 18:36:47[MPMain][1][Debug] Set property "#IMDb.Replacements.Count" to "903" successful
19/11/2011 18:36:47[MPMain][1][Debug] Set property "#IMDb.Replacements.Custom.Count" to "0" successful
19/11/2011 18:36:47[MPMain][1][Debug] Set property "#IMDb.Replacements.Version" to "1.0.6" successful
19/11/2011 18:36:47[MPMain][1][Debug] Set property "#IMDb.Replacements.Published" to "26/10/2011" successful
19/11/2011 18:36:47[MPMain][1][Info] Last script update time: 18/11/2011 20:41:37
19/11/2011 18:36:47[MPMain][1][Info] Plugin initialization complete.
19/11/2011 18:38:25[MPMain][1][Debug] IMDb+ source not installed!
19/11/2011 18:45:46[MPMain][1][Debug] Saving IMDb+ options to file.
19/11/2011 18:45:56[MPMain][1][Debug] IMDb+ source not installed!
19/11/2011 18:46:25[MPMain][1][Debug] Saving IMDb+ options to file.
19/11/2011 18:46:25[MPMain][1][Debug] Saving IMDb+ options to file.
19/11/2011 18:46:25[MPMain][1][Info] Goodbye

I openend and searched for the file also in the installer, but there are no file similar to the scrapper.
 

RoChess

Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,434
    1,897
    Re: IMDb+ Scraper - Movie Scraping on Steroids v3.3.9

    Is there a chance to support polish language?

    I can add support for any other movie website that allows me to get a direct match when I provide it with an IMDb tt-ID. The multi-language support is done at details node only, so imdb.com is used to do the search-node to locate the correct movie, and then the correct IMDb tt-ID is available, which can then be used at other website that supports it.

    So far this includes imdb.de (German), imdb.fr (French), imdb.es (Spanish), imdb.pt (Portugese), imdb.it (Italian), filmtipset.se (Swedish), kvikmyndir.is (Icelandic) and finally moviemeter.nl (Dutch).

    Find me a Polish movie site that gets me to "Avatar" via tt0499549 and I can add support for it.

    Thanks this script is great. I modified an old version slightly so when it's configured to use UK ratings it gets Australian ratings as follows.

    This is one of the enhancements already planned for next version, but because it also required an update to IMDb+ plugin to expose the new scraper-script option, I could not release a new version yet. If you want to use your modifications now, you need to use an SQLite tool to edit the 'scripts' table, because that is where scraper-scripts have always been stored by MovingPictures. The last row should be the current v3.3.9 edition of IMDb+.

    I decide not to wait to Spanish full suport for your scrapper and installed it.

    The IMDb+ plugin downloads and installs the IMDb+ scraper-script and inserts it directly into the MovingPictures database once you start MediaPortal GUI and the plugin is run for the first time. We're trying to expand it so that you can do the download+install of the scraper-script while inside MediaPortal config, but that is easier said then done.

    When you open MovingPictures config, and manually manage the scraper-scripts, what do you all see then? It should look something like:

    FAQ.MovingPictures.1c_Movie.Details.Data.Sources.png

    Look for "IMDb+" in there, if it is grey then use the [+] icon to enable it, and move it up to the top position to ensure that it gets used. If you do not see it, try re-installing the IMDb+ plugin and launch MediaPortal GUI to see if it will then try to install it for you. You should see:

    MePo.IMDb+.1.png

    Which should show v3.3.9 got installed (current version of IMDb+ scraper-script).

    Then you can open IMDb+ plugin and adjust all the options to your liking (such as Spanish for language), and then use the hidden menu option "Force IMDb+" to switch all your existing movies over and use the refresh method to update all your existing movies via the IMDb+ scraper.
     

    pantav

    Portal Pro
    January 5, 2009
    68
    5
    Home Country
    Spain Spain
    Re: IMDb+ Scraper - Movie Scraping on Steroids v3.3.9

    I decide not to wait to Spanish full suport for your scrapper and installed it.

    The IMDb+ plugin downloads and installs the IMDb+ scraper-script and inserts it directly into the MovingPictures database once you start MediaPortal GUI and the plugin is run for the first time. We're trying to expand it so that you can do the download+install of the scraper-script while inside MediaPortal config, but that is easier said then done.

    When you open MovingPictures config, and manually manage the scraper-scripts, what do you all see then? It should look something like:

    FAQ.MovingPictures.1c_Movie.Details.Data.Sources.png

    Look for "IMDb+" in there, if it is grey then use the [+] icon to enable it, and move it up to the top position to ensure that it gets used. If you do not see it, try re-installing the IMDb+ plugin and launch MediaPortal GUI to see if it will then try to install it for you. You should see:

    MePo.IMDb+.1.png

    Which should show v3.3.9 got installed (current version of IMDb+ scraper-script).

    Yes, this is the problem. The first time, I started MP and a similar message (about install the scrapper) showed in the screen (my skin shows only the first part, so I can't read the entire message).
    After this, in MovinPictures there are no IMDB+ entry, nor enabled nor disabled.

    I uninstalled and reinstalled the plugin 3 times (with a computer restart for safety). But now, when I start MP no message appears (and the log is the attached log). And in Moving Picture no IMDB+ entry appears.

    So, I installed manually the script from Google Code (and configured it modifiyng the xml). My problem is resolved, but maybe there are a problem in the plugin (it thinks its installed but no).
     

    ltfearme

    Community Plugin Dev
  • Premium Supporter
  • June 10, 2007
    6,751
    7,196
    Sydney
    Home Country
    Australia Australia
    Re: IMDb+ Scraper - Movie Scraping on Steroids v3.3.9

    Right now, the IMDb+ plugin only installs\upgrades the scraper script when you are in the MediaPortal GUI. In the next version it will also install it during the installation of the MPEI package (but it will only install it if NOT installed as the upgrade over the wire is done in GUI).
     

    Users who are viewing this thread

    Similar threads

    • Sticky
    Your log clearly reports: [2024-03-03 18:26:58,258] [Log ] [MPMain ] [DEBUG] - Main: Wait for TV service requested [2024-03-03 18:26:58,262] [Log ] [MPMain ] [DEBUG] - Main: TV service found. Checking status... [2024-03-03 18:26:58,263] [Log ] [MPMain ] [INFO ] - Main: TV service is in status Running - proceeding...
    Your log clearly reports: [2024-03-03 18:26:58,258] [Log ] [MPMain ] [DEBUG] - Main: Wait for TV service requested...
    MediaPortal 1.33 Release Written by Team-MediaPortal. We have just released MediaPortal 1.33 - Springtime / 20th Anniversary...
    Replies
    7
    Views
    761
    (egg in face) I had to dnld SD plugin mpe1 to re install. trying again Thnx
    (egg in face) I had to dnld SD plugin mpe1 to re install. trying again Thnx
    Pre Releases are provided as a way for the community to test and give feedback on all the exciting things we have lined up for the...
    Replies
    40
    Views
    4K
    You are right, the one on the repository is correct, not sure how I ended up with a different version. See attached the incorrect version I ended up with.
    You are right, the one on the repository is correct, not sure how I ended up with a different version. See attached the incorrect...
    We have just released MediaPortal 1.32 Halloween Thanks to the great work of our new developer Pablik we are now able to present...
    Replies
    33
    Views
    4K
    MP1 MP2 MP2 - V2.5 Trailer plugin DE
    Maybe the wording “plugin” is misleading, because almost every feature in MP2 is basically a plugin. This allows to even exchange core elements easily. Short: Of course it can be also a feature as part of the installer, means integrated for the user.
    Maybe the wording “plugin” is misleading, because almost every feature in MP2 is basically a plugin. This allows to even exchange...
    The question, if MP2 can support trailers came up several times (e.g. here) and was so far always neglected mainly because of the...
    Replies
    14
    Views
    2K
    • Sticky
    MP1 MP2 [News] MediaPortal 2 - 2.5 Release DE
    Will be version 2.5.1 ready quite soon? I read somewhere it will be a bugfix release, no new features are probably not in focus.
    Will be version 2.5.1 ready quite soon? I read somewhere it will be a bugfix release, no new features are probably not in focus.
    We are proud to present MediaPortal 2.5 MediaPortal 2.5 is a full-blown media center software that addresses most common user...
    Replies
    70
    Views
    5K
    Top Bottom