MP2 - V2.1 - 500 movies missing

Discussion in 'Older releases' started by JSchuricht, March 11, 2017.

Thread Status:
Not open for further replies.
  1. JSchuricht
    • Premium Supporter

    JSchuricht MP Donator

    Joined:
    January 13, 2009
    Messages:
    149
    Likes Received:
    12
    Occupation:
    Silicon wafer manufacturing
    Ratings:
    +23 / 0
    Home Country:
    United States of America United States of America
    Show System Specs
    I am working on a system for my father which is win7 standalone with a bunch of individual hard drives and only movies on them. He just pointed out to me that he can't find some movies. There are 2080 listed under browse media but only 1578 under movies. I think this is an ongoing issue, I reported it back in 2015 on my own system and think its still happening but can't really tell with 200TB of stuff unless I am looking for something specific.



    Anyways, his system is standalone and was on the spring release when he noticed the movie Fences missing. I used it as an excuse to upgrade him to pre2.1 with a full new import. The movies all have an imdb.txt file with the tt number and the mod to NfoMovieMetadataExtractorSettings.xml to support that file name. The movie Fences was still missing, moving it to a different drive or renaming it with filebot made no difference.
     
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. HTPCSourcer
    • Team MediaPortal
    • Administrator

    HTPCSourcer MP2 Product Manager

    Joined:
    May 16, 2008
    Messages:
    10,579
    Likes Received:
    1,110
    Gender:
    Male
    Ratings:
    +2,384 / 21
    Home Country:
    Germany Germany
    Show System Specs
    We can't tell for sure what is happening because your logs have been taken at INFO level. Can you please set log level to DEBUG (this can be done from within the GUI), repeat the above and then post new logs?

    Obviously the movie "Fences" is not recognized. The automatic importer (i.e. not taking nfo's into account) is capable of identifying any movie, provided its name is unique. To help overcome ambiguities I am adding the imdb number (tt.....) to the movie file name. It could also be that your nfo file is not working for some reason, so uploading the specific information might also give a hint to us if there is something wrong.
     
  4. JSchuricht
    • Premium Supporter

    JSchuricht MP Donator

    Joined:
    January 13, 2009
    Messages:
    149
    Likes Received:
    12
    Occupation:
    Silicon wafer manufacturing
    Ratings:
    +23 / 0
    Home Country:
    United States of America United States of America
    Show System Specs
    I have been doing a bit of testing and think I have a partial reason for the import failing. I created a blank win7 test system with a fresh unmodified installation of pre2.1 and a remote client because Mediaportal client doesn't like running in a VM. I placed three random movies from my own collection with a mixture of movie.nfo and movie.txt files containing tt numbers. All three movies imported fine. I then copied one of the movies changing the file name and tt number to match my fathers system and just like his system it was only available under browse media. I renamed the file with a different filebot option from fences.mkv to fences 2016.mkv and it works. Digging through the logs it looks like mediaportal is ignoring the movie.txt file and attempting to match off file name which results in fences 2013 and finds too many matches.

    So now the question is how can I force the TT number in a txt or nfo file to be the first option for the importer to look at? A TT number in the file name would be great but fixing 2080 files on his system would just plain suck especially now that I took the time to count the 4683 movies in my collection that only sees 4221 movies.
     
  5. ge2301
    • Team MediaPortal

    ge2301 MP2 Design

    Joined:
    January 11, 2014
    Messages:
    6,107
    Likes Received:
    1,533
    Gender:
    Male
    Occupation:
    Automotive Industry
    Location:
    Stuttgart (But living abroad)
    Ratings:
    +2,308 / 2
    Home Country:
    Germany Germany
    txt files are not supported. I think this is also the case for most other HTPC software. MP2 expects nfo files and I'm using Tiny Media Manager for that.
     
  6. JSchuricht
    • Premium Supporter

    JSchuricht MP Donator

    Joined:
    January 13, 2009
    Messages:
    149
    Likes Received:
    12
    Occupation:
    Silicon wafer manufacturing
    Ratings:
    +23 / 0
    Home Country:
    United States of America United States of America
    Show System Specs
    Are you sure about that, the MediaPortal.Extensions.MetadataExtractors.NfoMetadataExtractors.Settings.NfoMovieMetadataExtractorSettings.xml shows support for .nfo, .xml and .txt extensions.

    Code (Text):
    1. -<Configuration>
    2.  
    3.  
    4. -<Property Name="MovieNfoFileNames">
    5.  
    6.  
    7. -<ArrayOfString xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
    8.  
    9. <string>movie</string>
    10.  
    11. <string>imdb</string>
    12.  
    13. </ArrayOfString>
    14.  
    15. </Property>
    16.  
    17.  
    18. -<Property Name="NfoFileNameExtensions">
    19.  
    20.  
    21. -<ArrayOfString xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
    22.  
    23. <string>.nfo</string>
    24.  
    25. <string>.xml</string>
    26.  
    27. <string>.txt</string>
    28.  
    29. </ArrayOfString>
     
    • Agree Agree x 1
  7. JSchuricht
    • Premium Supporter

    JSchuricht MP Donator

    Joined:
    January 13, 2009
    Messages:
    149
    Likes Received:
    12
    Occupation:
    Silicon wafer manufacturing
    Ratings:
    +23 / 0
    Home Country:
    United States of America United States of America
    Show System Specs
    You may be onto something, I just tried tinymediamanager and the nfo for that works no matter how I name the file or folder and it also works if the nfo is changed to txt. The key seems to be in the formatting of the txt or nfo file. The tinymediamanager format works but just the tt numer or the imdb link in a txt or nfo file isn't working but it used to work. Something changed which explains why it has become more difficult to get movies to import over the last few releases. I will try to hunt down some previous releases to see if I can pinpoint when the change was made unless someone knows off hand.
     
    • Like Like x 1
  8. JSchuricht
    • Premium Supporter

    JSchuricht MP Donator

    Joined:
    January 13, 2009
    Messages:
    149
    Likes Received:
    12
    Occupation:
    Silicon wafer manufacturing
    Ratings:
    +23 / 0
    Home Country:
    United States of America United States of America
    Show System Specs
    Getting closer, I think it was implemented in Jira MP2-505. So sometime after 2.0.0-Summer Release '15 Update 1 something changed.
     
  9. JSchuricht
    • Premium Supporter

    JSchuricht MP Donator

    Joined:
    January 13, 2009
    Messages:
    149
    Likes Received:
    12
    Occupation:
    Silicon wafer manufacturing
    Ratings:
    +23 / 0
    Home Country:
    United States of America United States of America
    Show System Specs
    I haven't had much time to work on this lately but in MediaPortal.Extensions.MetadataExtractors.NfoMetadataExtractors.Settings.NfoMovieMetadataExtractorSettings.xml for the 2.0.0-Summer Release there appears to be a line looking for a pattern (tt\d{7}) to find imdb numbers. Pre 2.1 is missing this line. There may be some other changes needed to make it work but I think this may be the cause of the mass import failures I am seeing on a few systems I have helped people build.
    Code (Text):
    1.   <Property Name="ImdbIdRegex">
    2.     <SerializableRegex>
    3.       <pattern>(tt\d{7})</pattern>
    4.       <options>None</options>
    5.       <timeout>-00:00:00.0010000</timeout>
    6.     </SerializableRegex>
     
  10. JSchuricht
    • Premium Supporter

    JSchuricht MP Donator

    Joined:
    January 13, 2009
    Messages:
    149
    Likes Received:
    12
    Occupation:
    Silicon wafer manufacturing
    Ratings:
    +23 / 0
    Home Country:
    United States of America United States of America
    Show System Specs
    Well there appears to be a significant improvement with adding the lines above. I can see all the movies in the logs finding the tt number. On the downside I can see many movies with a valid tt number that "could not be found or does not represent a movie on TheMovieDb.com". I enabled OMBBAPI.com and Fanart.tv for online sources to use for new media and restarted the import. With a little luck that will find more of the movies but I won't know till tomorrow due to a issue remoteing into the system while its monitor is off.

    So for now, can someone with access please make sure MediaPortal.Extensions.MetadataExtractors.NfoMetadataExtractors.Settings.NfoMovieMetadataExtractorSettings.xml is updated on the next build to include the code in my previous post. I don't know why it got removed in 2.1 but it certainly broke a few things on import. I put a copy of the file in the logs below for an example.
     
  11. henso
    • Team MediaPortal

    henso Development Group

    Joined:
    February 16, 2012
    Messages:
    1,904
    Likes Received:
    451
    Gender:
    Male
    Ratings:
    +688 / 0
    Home Country:
    Denmark Denmark
    As far as I can see it is already included and always has been (since it was introduced).
     
Loading...
Thread Status:
Not open for further replies.

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!