Suggestion on fanart folder organization. (1 Viewer)

JSchuricht

Test Group
  • Team MediaPortal
  • January 13, 2009
    238
    44
    Arizona
    United States of America United States of America
    Country flag
    Just a suggestion but perhaps there could be some better organization on the C:\ProgramData\Team MediaPortal\MP2-Server\FanArt folder.

    The reason I bring this up is I just upgraded to 2.2.3 on two client only boxes and one server only box. The clients were quick, the server wasn't horrible but took long enough for me to look around and see it disk bound with a lot of I/O the the fanart directory with 3GB read and 6GB written during the upgrade. The fanart directory has 63,611 folders, performance tends to suffer with that high of number.

    ScreenShot440.jpg

    ScreenShot441.jpg
     

    morpheus_xx

    Lead Dev MP2
  • Team MediaPortal
  • March 24, 2007
    11,553
    7,048
    Germany Germany
    Country flag
    @henso from another log file I found some issue when accessing a non-existant fanart folder:
    Code:
    [2019-12-23 11:18:38,521] [618092 ] [AMQ 'FanArtLibraryManager'] [DEBUG] - FanArtManagement: Scheduling fanart cleanup.
    [2019-12-23 11:18:38,528] [618099 ] [64       ] [WARN ] - FanArtCache: Error reading fanart directory 'C:\ProgramData\Team MediaPortal\MP2-Server\FanArt\'
    System.IO.DirectoryNotFoundException: Could not find a part of the path 'C:\ProgramData\Team MediaPortal\MP2-Server\FanArt'.
       at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
       at System.IO.FileSystemEnumerableIterator`1.CommonInit()
       at System.IO.FileSystemEnumerableIterator`1..ctor(String path, String originalUserPath, String searchPattern, SearchOption searchOption, SearchResultHandler`1 resultHandler, Boolean checkHost)
       at System.IO.DirectoryInfo.EnumerateDirectories()
       at MediaPortal.Common.FanArt.FanArtCache.GetAllFanArtIds()
    [2019-12-23 11:18:38,533] [618104 ] [64       ] [DEBUG] - FanArtManagement: No orphaned fanart found.
    First we should make sure the folder exists.

    Also this method could be slow when there is such a huge number of folders (like the 63k in screenshot above)?
     

    henso

    Development Group
  • Team MediaPortal
  • February 16, 2012
    2,209
    759
    Denmark Denmark
    Country flag
    I found some issue when accessing a non-existant fanart folder:
    AFAIK this code will only be triggered when you delete a media item or a share. During import the folder is created I think, but it might be that if you don't copy to the cache and you don't have online fanart retrieval enabled, that the folder is not created. Or did you delete it manually?
    First we should make sure the folder exists.
    I added code to check for its existence.
    Also this method could be slow when there is such a huge number of folders (like the 63k in screenshot above)?
    My guess would be it should take around a few seconds unless fragmentation, anti-virus etc. is interfering. I added parallelization, so now it should be even faster. I guess the kind of activity seen should only happen if there is a lot of orphaned fanart (triggered by deleting a share?), a fanart import is resumed or if something is interfering with fanart folder access.
     

    JSchuricht

    Test Group
  • Team MediaPortal
  • January 13, 2009
    238
    44
    Arizona
    United States of America United States of America
    Country flag
    @henso, I just mean in general it seems like an excessive amount of folders which contain over 160,000 files. I only have 87 series and 8,242 movies, antivirus has the MP2 folders excluded but it's still a lot of small files and folders for a system to deal with. Maybe it wouldn't make much difference cutting stuff down, I am just throwing an idea out there.
     

    Users who are viewing this thread

    Similar threads
    OP Title Forum Replies Date
    R Suggestions for reliable PCIe DVB-S2 tuner MediaPortal 1 Talk 8
    G Remote control suggestions? MediaPortal 1 Talk 16
    K Suggest me how to install server on Mac Newcomers Forum 2
    horned_reaper [solved] When playing music Fanart does not shuffle Fanart Handler 20
    horned_reaper [solved] No Fanart when playing Fanart Handler 115
    horned_reaper [solved] When playing music Fanart does not appear immediately after downloading Fanart Handler 272
    morpheus_xx [WiP] WIP 2.3 Fanart issues? MediaPortal 2 13
    Rob Hexenmeister [solved] Customising Fanart Handler settings Fanart Handler 3
    franat No funciona ni MepoTools ni DvdArt en castellano Ayuda con MediaPortal 2
    Lehmden [Videos] More filename possibility for MyVideos local fanart. Improvement Suggestions 26
    DHosein MP-TV no longer holding fanart selections My TVSeries 2
    Edwardfc Fanart setup/configuration General 10
    S Immer gleiche Fanart Musik - CD / MP3 2
    Lehmden Additional naming schemes for local fanart Feature Requests 0
    C [solved] RadioTime Plugin 1.5.0.117 and Fanart Handler Fanart Handler 17
    KlausWirn [solved] MePo1 Cover und Fanart in .nfo Datei ablegen Allgemeines Supportforum 8
    fischy667 [Resolved] No fanart for "Who is America?" My TVSeries 15
    azzuro [MP2-753] Fanart for previous item displayed in some cases Archive 3
    R Bug: Video Folders disappear General Support 11
    R Correct setting for recordings on shared folder General 0
    F Picture on folder Feature Requests 9
    N [fixed] [MP2-822] Folder View is not displaying individual media share elements Submit: Bug Reports 4
    J How to save recorded Movies and TV Series to sub-folders? Newcomers Forum 1
    D Ripped movies not importing unless IMDB code is included in folder name General 4
    B resume from within a folder Watch / Listen Media 0

    Similar threads

    Top Bottom