[solved] - Moving Picture 97% CPU

Discussion in 'Moving Pictures' started by caveman, April 1, 2019.

  1. caveman

    caveman Portal Pro

    Joined:
    August 2, 2007
    Messages:
    216
    Likes Received:
    10
    Gender:
    Male
    Ratings:
    +14 / 2
    Home Country:
    Denmark Denmark
    Show System Specs
    When i run Moving picture as standalon, i get a CPU Usage of about 97%

    In the log file i get alot like this one:
    01-Apr-2019 19:52:06 Debug [ DataProviderManager]: SEARCH: Title='ALAN CARR - TOOTH FAIRY - BBC E -', Provider='imdb.com', Version=3.0.2, Number of Results=1
    01-Apr-2019 19:52:06 Error [ WebGrabber]: Connection failed: URL=http://akas.imdb.com/title//releaseinfo, Status=NotFound, Description=Not Found.
    01-Apr-2019 19:52:06 Error [ DBField]: Error parsing DBMovieInfo.Year Property: Input string was not in a correct format.

    01-Apr-2019 19:52:09 Info [ MovieImporter]: No exact match for ALAN CARR - TOOTH FAIRY - BBC E - 2012-01-05_1.ts
    01-Apr-2019 19:52:09 Error [ WebGrabber]: Connection failed: URL=http://webservice.fanart.tv/v3/movies/tt2091628?api_key=4f26c36ab3d97e3a4a0c1e081710e3a6, Status=NotFound, Description=Not Found.
    01-Apr-2019 19:52:09 Error [ WebGrabber]: Connection failed: URL=http://api.themoviedb.org/3/movie/70236/images?api_key=cc25933c4094ca50635f94574491f320, Status=NotFound, Description=Not Found.
    01-Apr-2019 19:52:09 Error [ WebGrabber]: Connection failed: URL=http://webservice.fanart.tv/v3/movies/tt1700493?api_key=4f26c36ab3d97e3a4a0c1e081710e3a6, Status=NotFound, Description=Not Found.
    01-Apr-2019 19:52:09 Error [ WebGrabber]: Connection failed: URL=http://api.themoviedb.org/3/search/...&page=1&language=da&include_adult=False&year=, Status=429, Description=.



    Tried to replace the DB with one 14Days old, dosent seem to change the issue.
    Running MePo 1.21
    Moving Picture 1.8.2.0
     
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,182
    Likes Received:
    1,304
    Ratings:
    +1,683 / 2
    @caveman, Windows by default will activate "Windows Defender", which sees majority of MediaPortal activity as suspicious and can cause major slow-downs on top of everything else. Excluding the program and data folder, and the MediaPortal process solved it. Ran into it recently again, because Microsoft in their sheer magic decided to erase all my existing exclusion rules when it upgraded to 1809.

    And you need to either edit your Moving-Picture advanced noise filter configuration (very complex Regular Expression) to auto-clean up those bad titles, or manually rename them. Adding NFOs with an IMDb tt-ID reference (or adding it to filename or folder) also solves it, because it bypasses the search system.

    The IMDb+ scraper-script would have been able to find a positive match though on the quick test I ran, as I created a much more aggressive search algorithm with it.
     
  4. caveman

    caveman Portal Pro

    Joined:
    August 2, 2007
    Messages:
    216
    Likes Received:
    10
    Gender:
    Male
    Ratings:
    +14 / 2
    Home Country:
    Denmark Denmark
    Show System Specs
    Never had the sisuen before with defender. But Will check it :)
    Excluded the plugin folder. Will also exclude the data folder

    I thought not being able to find the movies and the issues with the protocols could have caused the problem.

    Still When retriving possible matches 90% CPU usage..
     
    Last edited: April 2, 2019
  5. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,182
    Likes Received:
    1,304
    Ratings:
    +1,683 / 2
    @caveman, well it is an extensive multi-threaded process that kicks in, which you can tweak via the advanced settings to limit if needed.

    To really diagnose the issue, you will have to turn on MediaPortal debug logging, and turn on Moving-Pictures scraper-debug, for extremely detailed log entries that will allow much greater insight into the processes occurring.
     
    • Agree Agree x 1
  6. caveman

    caveman Portal Pro

    Joined:
    August 2, 2007
    Messages:
    216
    Likes Received:
    10
    Gender:
    Male
    Ratings:
    +14 / 2
    Home Country:
    Denmark Denmark
    Show System Specs
    Stgupid question.. Where to enable the scraper-debug in moving pictures? If it's in the config ;) i hope it finishes at some pont :)
     
  7. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,182
    Likes Received:
    1,304
    Ratings:
    +1,683 / 2
    MovPic config -> goto importer tab -> click settings icon -> activate debug, it should show a tiny little green icon to confirm

    If it works log files will be huge, like 1MB for a single movie import, but it will contain the vital data to debug what is causing the delay for you by tracing down the timestamp segments that cause a pause. Tends to be network-time-out related, because for example the scraper-script is configured to wait 30 seconds on an answer that it will never get, causing the slowdown you are expecting.
     
  8. caveman

    caveman Portal Pro

    Joined:
    August 2, 2007
    Messages:
    216
    Likes Received:
    10
    Gender:
    Male
    Ratings:
    +14 / 2
    Home Country:
    Denmark Denmark
    Show System Specs
    I can see the "Importer Settings" however no "settings" icon.. I might just be stupid..
    But isent this allready the issue??

    03-Apr-2019 19:41:22 Error [ WebGrabber]: Connection failed: URL=http://api.themoviedb.org/3/movie/23602/images?api_key=cc25933c4094ca50635f94574491f320, Status=NotFound, Description=Not Found.
    03-Apr-2019 19:41:22 Error [ WebGrabber]: Connection failed: URL=http://webservice.fanart.tv/v3/movies/tt0458290?api_key=4f26c36ab3d97e3a4a0c1e081710e3a6, Status=NotFound, Description=Not Found.
    03-Apr-2019 19:41:25 Error [ WebGrabber]: Connection failed: URL=http://api.themoviedb.org/3/movie/23602/images?api_key=cc25933c4094ca50635f94574491f320, Status=NotFound, Description=Not Found.
    03-Apr-2019 19:41:25 Error [ WebGrabber]: Connection failed: URL=http://webservice.fanart.tv/v3/movies/tt0458290?api_key=4f26c36ab3d97e3a4a0c1e081710e3a6, Status=NotFound, Description=Not Found.

    3 Seconds betwen them..

    And i sometimes hate IT..

    03-Apr-2019 20:03:50 Info [ MovingPicturesCore]: Plugin Launched
    03-Apr-2019 20:10:33 Debug [ MovieImporter]: SKIPPED: File='Tank Girl_200745.dvr-ms', Reason='Already being matched'

    So yes 7Min..
    Restarted it..
    CPU Load down to 30
    Scraping.. Peeks now at 97 for short while
    The down to 58

    So whatever i havent changed..
    Fixed it for now..
     
  9. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,182
    Likes Received:
    1,304
    Ratings:
    +1,683 / 2
    When config initially loads it will scrape all the missing images again, and this can cause 100's of threads to kick in, and can take a while before it resolves.

    Ideally you help the community by adding those covers or whatever artwork is missing to their respective sites, or at least add a placeholder image locally. This will then prevent all those "Not Found" errors and keep everything speedy.

    And no, the logs you gave were not enough, because they do not reveal the underlying scraper-engine steps leading up to that.

    • Switch to the importer tab: FAQ.MovingPictures.1a_Importer.Settings.png

    • Select radio option, and click on "Movie Details Data Sources" button: FAQ.MovingPictures.1b_Manually.Manage.png

    • Select "Enable Debug Mode" from gear icon menu: FAQ.MovingPictures.1e_Scraper.Enable.Debug.Mode.png

    • Verify that this icon is active when you go back to drop down menu (select again to disable): FAQ.MovingPictures.1f_Scraper.Debug.Enabled.png
     
  10. caveman

    caveman Portal Pro

    Joined:
    August 2, 2007
    Messages:
    216
    Likes Received:
    10
    Gender:
    Male
    Ratings:
    +14 / 2
    Home Country:
    Denmark Denmark
    Show System Specs
    Tanx for showing me that i was blind ..
    Running it now with the debug :)
     
  11. ltfearme
    • Premium Supporter

    ltfearme Community Plugin Dev

    Joined:
    June 10, 2007
    Messages:
    6,458
    Likes Received:
    4,245
    Gender:
    Male
    Occupation:
    Software Test Engineer
    Location:
    Sydney
    Ratings:
    +5,389 / 0
    Home Country:
    Australia Australia
    Just beware when running in Debug mode performance in the GUI is impacted. Remember to turn this off once you have solved your issue.
     
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!