[Finished] Scrapper improvements (1 Viewer)

Lehmden

Retired Team Member
  • Premium Supporter
  • December 17, 2010
    12,553
    3,934
    Lehmden
    Home Country
    Germany Germany
    Hi.
    I like t suggest some improvements to the inbuild scrapper.

    1) Atm the metatags are not really used as they should. They only seems to be used if no online data is found... You can see this on ongoing series when in MKV- Metatags are German title and description, but in DB there are (older) English ones...

    2) The cache should be updated if new data are available on TheTVDB (or similar).

    3) Another thing is if I add a video share and don't select series or movies, the files in this share are scrapped nevertheless. My TV Recordings folder has to be a share so I often got series episodes 2 or 3 times in DB, also I only need the edited and converted one in series share... In my understanding selecting "Video" only by adding a share should do no online scrapping a all..

    4) We need a possibility to adjust naming schemes for the scrapper. E.G. give the user the possibility to use subfolders for seasons. This could be an XML at first, no problem.

    5) Include support for local fanart and .nfo files also...
     

    Lehmden

    Retired Team Member
  • Premium Supporter
  • December 17, 2010
    12,553
    3,934
    Lehmden
    Home Country
    Germany Germany
    Hi.
    Another thing to work on, multiple episodes in a single file (e.G. DVD ISO file) and vice versa single episode in multiple files. How can we handle that the best?
     

    chefkoch

    Retired Team Member
  • Premium Supporter
  • October 5, 2004
    3,129
    1,634
    Dresden / Munich / Maastricht
    Home Country
    Germany Germany
    Hi.
    Another thing to work on, multiple episodes in a single file (e.G. DVD ISO file) and vice versa single episode in multiple files. How can we handle that the best?
    Regarding one media item splitted into multiple files, I made a bug report some time ago, but moved it to feature requests now:
    https://forum.team-mediaportal.com/threads/multi-part-movies-are-not-handled-correctly-yet.108703/

    In general a single file (or structure) containing multiple media items can be
    • DVD and BluRays as a folder structure on HDD
    • DVD and BluRays within a ISO
    • within a single mkv file, i.e.
      • all episodes of a season within a single mkv file (samples)
      • various editions of a movie within a single mkv file (google search)
      • all tracks of an album within one mka file > Audio, might be useful to wrap *.ac3 and *.dts files to get tagging support

    While writing this I realized you only meant the detection similar to what we already support with multiple episodes per file by

    So for DVD & BluRay we could read for a
    • [SampleFileName].iso from
      • [SampleFileName].xml containing matroska tags
      • [SampleFileName].nfo containing XBMC NFO metadata
      • [SampleFileName].txt or [SampleFileName].nfo simply looking for SXXEYY by using regular expressions, similar to the imdb check we have
    • BluRay/DVD folder structure within it's root folder / level
      • *.xml containing matroska tags
      • *.nfo containing XBMC NFO metadata
      • *.txt or *.nfo simply looking for SXXEYY by using regular expressions, similar to the imdb check we have
     

    Lehmden

    Retired Team Member
  • Premium Supporter
  • December 17, 2010
    12,553
    3,934
    Lehmden
    Home Country
    Germany Germany
    Hi.
    what we already support with multiple episodes per file by filename, i.e. S01E02E03 ... mkv tags
    That did not work for me. I have tagged all my MKV with MKVTagger based on TVSeries DB (which is able to handle two episodes in one file at least) and I've named my episodes like SeasonEpisode1Episode2 - Title1 & Title2.ext. Example from "Mako Mermaids" Season 1 Episodes 1 and 2: "S01E01E02 - Ausgestoßen & Gehversuche.mkv"
    This is not recognized as two episodes in MP2. In TVSeries it's properly detected as two episodes in a single file.

    So if you know how such episodes has to be named (and/or tagged) to have them as multiple episodes, I'm very thankful if you can give me a hint. I did not found anything about this in Wiki (Maybe I'm to blind to find it...)
     

    Lehmden

    Retired Team Member
  • Premium Supporter
  • December 17, 2010
    12,553
    3,934
    Lehmden
    Home Country
    Germany Germany
    Hi.
    Dig deeper a bit. In MKV Tags there are two episodes numbers (Part Number 5 and 6) but only one episodes title and description. But as MP2 did not read title and description, that's no big deal..
    Code:
      <Tag>
        <Targets>
          <TargetTypeValue>50</TargetTypeValue>
        </Targets>
        <Simple>
          <Name>PART_NUMBER</Name>
          <String>5</String>
          <TagLanguage>und</TagLanguage>
          <DefaultLanguage>1</DefaultLanguage>
        </Simple>
        <Simple>
          <Name>PART_NUMBER</Name>
          <String>6</String>
          <TagLanguage>und</TagLanguage>
          <DefaultLanguage>1</DefaultLanguage>
        </Simple>
        <Simple>
          <Name>DATE_RELEASED</Name>
          <String>2013-07-27</String>
          <TagLanguage>und</TagLanguage>
          <DefaultLanguage>1</DefaultLanguage>
        </Simple>
        <Simple>
          <Name>TITLE</Name>
          <String>Regenzauber</String>
          <TagLanguage>und</TagLanguage>
          <DefaultLanguage>1</DefaultLanguage>
        </Simple>
        <Simple>
          <Name>SUMMARY</Name>
          <String>Die Wettervorhersage kündigt Sturm und Regen an. Daraus ergeben sich gewisse Probleme für die Meerjungfrauen und Zac. Zac muss es gelingen, sich vor dem Campingausflug mit seinem Vater zu drücken und ruft seinen Freund Cam zu Hilfe. Und Rita rät Lyla, Sirena und Nixie auf Mako Schutz zu suchen. Aber Lyla hat anderes im Sinn. Sie überredet Sirena den Mondring zu nutzen, um den Regen weg zu zaubern – mit ungeahnten Folgen. (Text: KiKA)</String>
          <TagLanguage>und</TagLanguage>
          <DefaultLanguage>1</DefaultLanguage>
        </Simple>
      </Tag>
    I've attached the xml file from MKVTagger. This MKV file (named "S01E05E06 - Regenzauber & Delfinjagt.mkv"is recognised as a single episode (S01E05 "Regenzauber") inside MP2. As for sure I can watch both episodes it's not a big issue but it's far away from perfect...
     

    Attachments

    • S01E05E06 - Regenzauber & Delfinjagt.xml
      4.7 KB

    chefkoch

    Retired Team Member
  • Premium Supporter
  • October 5, 2004
    3,129
    1,634
    Dresden / Munich / Maastricht
    Home Country
    Germany Germany
    I did not tested it explitly lately, but in spring it was not big deal


    But you are right if you are looking for a media item per episode. In MP2 a Series Aspect handles a List of episode indizes and shows them most likely comma separated in GUI.
     

    Lehmden

    Retired Team Member
  • Premium Supporter
  • December 17, 2010
    12,553
    3,934
    Lehmden
    Home Country
    Germany Germany
    Hi.
    Forgot to add a screenshot how the file "S01E05E06 - Regenzauber & Delfinjagt.mkv" is added to MP2 Database:
    Zwischenablage-1.jpg

    You can see it was added as single episode (first episode in file). In this series there are 6 episodes in 3 files. Shown are only half of them...
     

    jehe

    Portal Pro
    February 15, 2011
    694
    216
    57
    Home Country
    Belgium Belgium
    Hi,

    I have a few movies which consist of 2 DVD, how can I ensure that mediaportal 2 sees this as one movie.
    If these movies are tagged properly, is that enough?
     

    MJGraf

    Retired Team Member
  • Premium Supporter
  • January 13, 2006
    2,478
    1,385
    Hi jehe,
    I fear you can't (yet). We still have to implement that but if I remember correctly, there was already a discussion about how to implement that the best way.
    Needs some more time... For now you could maybe try a Playlist - but I know this is not ideal, yet...
    Michael
     

    Lehmden

    Retired Team Member
  • Premium Supporter
  • December 17, 2010
    12,553
    3,934
    Lehmden
    Home Country
    Germany Germany
    Hi.
    Scrapper really is a weak part of MP2 atm. I've tried to import all my movies lately. Nearly 50% has not the correct poster or no poster at all. Movies like "Air Force One", "Crocodile Dundee", "Scary Movie", "The African Queen" or "Beverly Hills Cop" should be recognized, I think. Especially if it's a MKV with IMDB tt number tagged... And the handling of different movies with same name (e.G. "The Jungle Book (1967)" and "The Jungle Book (1994)") is simply not existent. The movie is tagged correctly and the Year and description fits, but posters and backdrops are never correct, not in a single case. Also"nice" are the lots of Chinese, Arabic and Cyrillic posters. If there is such an "exotic" poster, MP2 grabs it with 100% guarantee. My Series I now have more or less in order. But my movies are tons of work, maybe it's impossible at all to get this as I want... It could be sooo easy as all my movies are properly tagged and additional an NFO with all needed metadata and 100% correct posters and backdrops in the same folder. But this isn't used up to now.
    Zwischenablage-2.jpg
    Zwischenablage-3.jpg
    Zwischenablage-4.jpg

    This are only sample of the glitches. There are a lot more.
     

    Users who are viewing this thread

    Top Bottom