FilmInfo+ - A german movie details scraper with auto grouping | Page 58

Discussion in 'Moving Pictures' started by Merlyn, September 6, 2011.

  1. xadox

    xadox Portal Pro

    Joined:
    August 18, 2005
    Messages:
    220
    Likes Received:
    15
    Ratings:
    +28 / 3
    Home Country:
    Germany Germany
    Wie immer besten Dank für das schnelle Update Merlyn (y)


     
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,153
    Likes Received:
    1,294
    Ratings:
    +1,659 / 2
    What they might be after, is what I did with IMDb+ as well, provide a scraper-script option that only allows certain fields to be updated (votes, popularity, certification and empty fields). It has a small speed benefit as well, but the main reason is to not loose any customisation, such as manual changes to title/etc.

    There is more then likely not going to be a Moving-Pictures for MP2 (hardly a need for it, since majority of function is added to MyVideos). I am however going to be looking at how MyVideos on MP1.5/MP2 handles imports and see if I can adjust IMDb+ to be compatible. Will let you know, so you can use the groundwork for FilmInfo+. My new HTPC is finally done (Win 8.1, MePo 1.5, etc), and is currently running finaly disParity update, so I will be able to have a closer look at the inner workings.

    If I have to rewrite the IMDb+ plugin to make it work, I will look at allowing FilmInfo+ to be part of it, so you will have the power of plugin with auto-scraper updates at your disposal as well. I figured you would fork the IMDb+ plugin by now, but C# is not for everbody and without the help I got for mine it would have never happened for me either.

    This is more Christmas holiday or early next year type of timeline though, it has been a very busy year for me, so need to catch up on some projects around the house and family time as well.
     
    • Like Like x 4
  4. Merlyn

    Merlyn Portal Pro

    Joined:
    July 8, 2011
    Messages:
    250
    Likes Received:
    161
    Ratings:
    +162 / 0
    Home Country:
    Germany Germany
    Show System Specs
    Die HTML Tags im Writersfeld tauchen bei mir nicht auf. Ich konnte das bislang nicht reproduzieren. Verwendet ihr eventuell eine ältere Version des Scrapers?[DOUBLEPOST=1382774131][/DOUBLEPOST]
    Thanks a lot, RoChess! For a Plugin like yours I would actually have to learn C# first, and with other hobbies, work and this strange real life thingy I just dont have the time for that. So I basically have boxed the FilmInfo+ Plugin idea.

    What do you mean by "provide a scraper-script option that only allows certain fields to be updated"? How did you do that?
     
    Last edited: October 26, 2013
  5. Helios61
    • Team MediaPortal

    Helios61 Retired Team Member

    Joined:
    January 30, 2008
    Messages:
    4,587
    Likes Received:
    584
    Gender:
    Male
    Location:
    NRW
    Ratings:
    +897 / 4
    Home Country:
    Germany Germany
    Show System Specs
    Nein, die aktuelle Version!

    Gruß
    Helios
     
  6. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,153
    Likes Received:
    1,294
    Ratings:
    +1,659 / 2
    If you look at IMDb+ source, you will see I have the scraper-script option: "global_options_refresh_all_fields"

    This controls if all fields get updated, or just some. It is a simple a boolean flag (true/false), and then inside the rest of the script I check that value with simple <if test="${global_options_refresh_all_fields}=true"> check to decide if I allow that block of code to be executed. Because I also need to check if the existing value is empty (for a fresh import or when that info gets updated later) and there is no ADN/OR support for scraper-scripts, I came up with the following solution:

    Code (Text):
    1.  <!-- Verify conditional update. There is no AND or OR support, so this will have to do -->
    2.  <if test="${movie.directors}="><set name="update_directors" value="true" /><set name="new_import" value="true" /></if>
    3.  <if test="${global_options_refresh_all_fields}=true"><set name="update_directors" value="true" /></if>
    4.  <if test="${update_directors}=true">..... (do the actual update of "Directors") ....</if>
    The "Directors" info does not exactly change much once you initially scraped this info, same with the remaining crew/title/etc. Fields I always want to update, such as certification (movie ratings do change over time), score+votes, etc, I just skip the check and use the old code as-is.

    The ${new_import} boolean flag is probably not needed for you, but it was needed to fix a bug for IMDb+.

    Keep in mind to document it properly. I made the mistake of making the default value of IMDb+ to not update all the fields (which is what I use myself), but this caused a lot of complaints from users that changed configuration options that should have caused a different title, but then the title field would not update.
     
    • Like Like x 1
  7. Merlyn

    Merlyn Portal Pro

    Joined:
    July 8, 2011
    Messages:
    250
    Likes Received:
    161
    Ratings:
    +162 / 0
    Home Country:
    Germany Germany
    Show System Specs
    Nice workaround.
     
  8. Cyrus1896

    Cyrus1896 Portal Pro

    Joined:
    November 9, 2009
    Messages:
    63
    Likes Received:
    3
    Ratings:
    +4 / 0
    Genau das ist es, was ich in meinem vorherigen Post meinte. Beim erneuten Scannen von bereits hinzugefügten Filmen eben nur gewisse Felder zu updaten.

    Score / Popularity / FSK (eventuell sinnvoll, damit man mal ein drchgängiges System hat, wenn man bereits mit mehreren Scrapern gearbeitet hat.)

    Das wäre wirklich Wahnsinn, wenn das in diesem Scraper funktionieren würde.
     
    • Agree Agree x 1
  9. Merlyn

    Merlyn Portal Pro

    Joined:
    July 8, 2011
    Messages:
    250
    Likes Received:
    161
    Ratings:
    +162 / 0
    Home Country:
    Germany Germany
    Show System Specs
    Ich muss schauen, in wie weit ich das wie von RoChess beschrieben umsetzen kann. Das geht leider nicht mal eben zwischendurch.
    So wie es bei mir zeitlich im Moment aussieht, wird das bis zum neuen Jahr warten müssen.

    Falls sich sonst jemand von euch damit auseinander setzen und den Scraper updaten möchte, nur zu! Ich bin für jede Hilfe dankbar ;)
     
  10. badboyxx

    badboyxx Portal Pro

    Joined:
    June 15, 2012
    Messages:
    663
    Likes Received:
    46
    Gender:
    Male
    Ratings:
    +72 / 9
    Home Country:
    Germany Germany
    Show System Specs
    Kann man das plugin auf die neuen Funktionen von MovPic 1.6 updaten oder ist es ein größerer Aufwand.
    - Collections
    - Plot keywords
    uvm.
     
    Last edited: December 10, 2013
  11. Data45000

    Data45000 Portal Pro

    Joined:
    February 11, 2011
    Messages:
    589
    Likes Received:
    6
    Gender:
    Male
    Occupation:
    Student
    Location:
    Here
    Ratings:
    +14 / 5
    Home Country:
    Germany Germany
    Show System Specs
    In den Filmen von Star Trek III, IV und co gibt es bei den Summarys immer "Quelle: CovertextBlablaba" Sieht nicht schön aus.
    Ebenso bei:
    Wiki auf großer Fahrt

    Weitere Frage, wie kommt es, dass bei der Sprache immer eignartige Sprachen eingetragen sind. Bei Star Trek Deutsch English dann Chinesich oder Schwedisch... ?
     
    Last edited: December 28, 2013
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!