[solved] Moving Picture 97% CPU

caveman

Portal Pro
August 2, 2007
216
18
Country flag


When i run Moving picture as standalon, i get a CPU Usage of about 97%

In the log file i get alot like this one:
01-Apr-2019 19:52:06 Debug [ DataProviderManager]: SEARCH: Title='ALAN CARR - TOOTH FAIRY - BBC E -', Provider='imdb.com', Version=3.0.2, Number of Results=1
01-Apr-2019 19:52:06 Error [ WebGrabber]: Connection failed: URL=http://akas.imdb.com/title//releaseinfo, Status=NotFound, Description=Not Found.
01-Apr-2019 19:52:06 Error [ DBField]: Error parsing DBMovieInfo.Year Property: Input string was not in a correct format.

01-Apr-2019 19:52:09 Info [ MovieImporter]: No exact match for ALAN CARR - TOOTH FAIRY - BBC E - 2012-01-05_1.ts
01-Apr-2019 19:52:09 Error [ WebGrabber]: Connection failed: URL=http://webservice.fanart.tv/v3/movies/tt2091628?api_key=4f26c36ab3d97e3a4a0c1e081710e3a6, Status=NotFound, Description=Not Found.
01-Apr-2019 19:52:09 Error [ WebGrabber]: Connection failed: URL=http://api.themoviedb.org/3/movie/70236/images?api_key=cc25933c4094ca50635f94574491f320, Status=NotFound, Description=Not Found.
01-Apr-2019 19:52:09 Error [ WebGrabber]: Connection failed: URL=http://webservice.fanart.tv/v3/movies/tt1700493?api_key=4f26c36ab3d97e3a4a0c1e081710e3a6, Status=NotFound, Description=Not Found.
01-Apr-2019 19:52:09 Error [ WebGrabber]: Connection failed: URL=http://api.themoviedb.org/3/search/movie?api_key=cc25933c4094ca50635f94574491f320&query=National+Geographic+Diving+The+Labyrinth&page=1&language=da&include_adult=False&year=, Status=429, Description=.

Tried to replace the DB with one 14Days old, dosent seem to change the issue.
Running MePo 1.21
Moving Picture 1.8.2.0
 

RoChess

Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,248
    113
    Country flag
    @caveman, Windows by default will activate "Windows Defender", which sees majority of MediaPortal activity as suspicious and can cause major slow-downs on top of everything else. Excluding the program and data folder, and the MediaPortal process solved it. Ran into it recently again, because Microsoft in their sheer magic decided to erase all my existing exclusion rules when it upgraded to 1809.

    And you need to either edit your Moving-Picture advanced noise filter configuration (very complex Regular Expression) to auto-clean up those bad titles, or manually rename them. Adding NFOs with an IMDb tt-ID reference (or adding it to filename or folder) also solves it, because it bypasses the search system.

    The IMDb+ scraper-script would have been able to find a positive match though on the quick test I ran, as I created a much more aggressive search algorithm with it.
     

    caveman

    Portal Pro
    August 2, 2007
    216
    18
    Country flag
    Never had the sisuen before with defender. But Will check it :)
    Excluded the plugin folder. Will also exclude the data folder

    I thought not being able to find the movies and the issues with the protocols could have caused the problem.

    Still When retriving possible matches 90% CPU usage..
     
    Last edited:

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,248
    113
    Country flag
    @caveman, well it is an extensive multi-threaded process that kicks in, which you can tweak via the advanced settings to limit if needed.

    To really diagnose the issue, you will have to turn on MediaPortal debug logging, and turn on Moving-Pictures scraper-debug, for extremely detailed log entries that will allow much greater insight into the processes occurring.
     

    caveman

    Portal Pro
    August 2, 2007
    216
    18
    Country flag
    Stgupid question.. Where to enable the scraper-debug in moving pictures? If it's in the config ;) i hope it finishes at some pont :)
     

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,248
    113
    Country flag
    MovPic config -> goto importer tab -> click settings icon -> activate debug, it should show a tiny little green icon to confirm

    If it works log files will be huge, like 1MB for a single movie import, but it will contain the vital data to debug what is causing the delay for you by tracing down the timestamp segments that cause a pause. Tends to be network-time-out related, because for example the scraper-script is configured to wait 30 seconds on an answer that it will never get, causing the slowdown you are expecting.
     

    caveman

    Portal Pro
    August 2, 2007
    216
    18
    Country flag
    I can see the "Importer Settings" however no "settings" icon.. I might just be stupid..
    But isent this allready the issue??

    03-Apr-2019 19:41:22 Error [ WebGrabber]: Connection failed: URL=http://api.themoviedb.org/3/movie/23602/images?api_key=cc25933c4094ca50635f94574491f320, Status=NotFound, Description=Not Found.
    03-Apr-2019 19:41:22 Error [ WebGrabber]: Connection failed: URL=http://webservice.fanart.tv/v3/movies/tt0458290?api_key=4f26c36ab3d97e3a4a0c1e081710e3a6, Status=NotFound, Description=Not Found.
    03-Apr-2019 19:41:25 Error [ WebGrabber]: Connection failed: URL=http://api.themoviedb.org/3/movie/23602/images?api_key=cc25933c4094ca50635f94574491f320, Status=NotFound, Description=Not Found.
    03-Apr-2019 19:41:25 Error [ WebGrabber]: Connection failed: URL=http://webservice.fanart.tv/v3/movies/tt0458290?api_key=4f26c36ab3d97e3a4a0c1e081710e3a6, Status=NotFound, Description=Not Found.

    3 Seconds betwen them..

    And i sometimes hate IT..

    03-Apr-2019 20:03:50 Info [ MovingPicturesCore]: Plugin Launched
    03-Apr-2019 20:10:33 Debug [ MovieImporter]: SKIPPED: File='Tank Girl_200745.dvr-ms', Reason='Already being matched'

    So yes 7Min..
    Restarted it..
    CPU Load down to 30
    Scraping.. Peeks now at 97 for short while
    The down to 58

    So whatever i havent changed..
    Fixed it for now..
     

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,248
    113
    Country flag
    When config initially loads it will scrape all the missing images again, and this can cause 100's of threads to kick in, and can take a while before it resolves.

    Ideally you help the community by adding those covers or whatever artwork is missing to their respective sites, or at least add a placeholder image locally. This will then prevent all those "Not Found" errors and keep everything speedy.

    And no, the logs you gave were not enough, because they do not reveal the underlying scraper-engine steps leading up to that.

    • Switch to the importer tab:
      FAQ.MovingPictures.1a_Importer.Settings.png

    • Select radio option, and click on "Movie Details Data Sources" button:
      FAQ.MovingPictures.1b_Manually.Manage.png

    • Select "Enable Debug Mode" from gear icon menu:
      FAQ.MovingPictures.1e_Scraper.Enable.Debug.Mode.png

    • Verify that this icon is active when you go back to drop down menu (select again to disable):
      FAQ.MovingPictures.1f_Scraper.Debug.Enabled.png
     

    caveman

    Portal Pro
    August 2, 2007
    216
    18
    Country flag
    Tanx for showing me that i was blind ..
    Running it now with the debug :)
     

    ltfearme

    Community Plugin Dev
  • Premium Supporter
  • June 10, 2007
    6,658
    113
    Sydney
    Country flag
    Just beware when running in Debug mode performance in the GUI is impacted. Remember to turn this off once you have solved your issue.
     
    Top Bottom