MP-4212 My Videos internal scrapers rework | Page 2

Discussion in 'Area 51 - Testing Area' started by Deda, September 27, 2013.

  1. elliottmc
    • Team MediaPortal

    elliottmc Retired Team Member

    Joined:
    August 7, 2005
    Messages:
    14,927
    Likes Received:
    4,011
    Gender:
    Male
    Location:
    Cardiff, UK
    Ratings:
    +5,503 / 13
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    @Deda



    Updated to latest version from GIT branch.

    Everything working perfectly except covers not updating when I change them.

    Logs attached. Maybe the added logging will give you a clue.

    This seems to happen 100% on videos I scrape since the new version of the scraper.
     
    • Agree Agree x 1
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. catavolt
    • Team MediaPortal
    • Administrator

    catavolt Design Group Manager

    Joined:
    August 13, 2007
    Messages:
    12,193
    Likes Received:
    4,944
    Gender:
    Male
    Occupation:
    Technical Documentation, Translation
    Location:
    Lanzarote
    Ratings:
    +7,341 / 38
    Home Country:
    Germany Germany
    Show System Specs
    Tried that, too - but unfortunately w/o luck... (and nothing in logs)
     
  4. Deda
    • Team MediaPortal

    Deda Lead Dev MP1 Videos

    Joined:
    March 18, 2009
    Messages:
    2,423
    Likes Received:
    2,098
    Gender:
    Male
    Occupation:
    IT Consultant
    Location:
    Zagreb
    Ratings:
    +2,385 / 1
    Home Country:
    Croatia Croatia
    Show System Specs
    It looks like that logs can't help in this, I check yours and everything is by the book.

    Last thing to help me in this to make me visual debug like this (as you wrote is 100% on new scrape it will be easy):

    1. Do everything as before (Scan movie and open movie info screen)
    2. Before change cover in movie info screen remember the picture and wait 1 min (at least that minute is changed)
    3. Change cover one time and open Windows Explorer (do not exit MP) or what you're using for file browser in Windows
    4. Open MP videos thumb folder (C:\ProgramData\Team MediaPortal\MediaPortal\Thumbs\Videos\Title) and look for cover filename (it will have file name as movie title with suffix {movieId})
    5. Open that image and see if it is different than one after scraping, also check file modification date if it is the same as the time when you change cover.
    6. If it is the same try to change more covers (2 or 3 up) and check again like point 4.
     
    Last edited: October 6, 2013
  5. elliottmc
    • Team MediaPortal

    elliottmc Retired Team Member

    Joined:
    August 7, 2005
    Messages:
    14,927
    Likes Received:
    4,011
    Gender:
    Male
    Location:
    Cardiff, UK
    Ratings:
    +5,503 / 13
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Okay, file is correctly downloaded, but simply not refreshed inside MP.

    The weird thing is, it doesn't happen for every movie. I downloaded data for one, and switched to windows explorer while it was downloading. It didn't download correctly, but after I hit 'refresh' it downloaded twice (!) and then the covers were updated. I suspect there was some weird timing thing going on here.

    It is strange, but if a movie is okay and updates the covers, then it always updates fine. If it isn't, then it doesn't!

    But for me it happens almost all of the time.

    In the following logs, Lord of the Rings is fine. Alien is not. Don't know if you can spot any difference.

    Edit: but after exiting and restarting MP, Lord of the Rings is also not updating.
     
  6. catavolt
    • Team MediaPortal
    • Administrator

    catavolt Design Group Manager

    Joined:
    August 13, 2007
    Messages:
    12,193
    Likes Received:
    4,944
    Gender:
    Male
    Occupation:
    Technical Documentation, Translation
    Location:
    Lanzarote
    Ratings:
    +7,341 / 38
    Home Country:
    Germany Germany
    Show System Specs
    What I found so far:
    1. I generated .nfo files for all movies.
    2. I deleted the Video DB
    3. Via MPConfig -> Videos, I imported all videos with .nfo files
    4. After that, I can change the covers in all videos again.
    Maybe that helps a bit?
     
  7. Wo0zy
    • Team MediaPortal

    Wo0zy Retired Team Member

    Joined:
    April 30, 2008
    Messages:
    394
    Likes Received:
    128
    Gender:
    Male
    Ratings:
    +148 / 0
    Home Country:
    United Kingdom United Kingdom
    This is weird. For me it works nearly all the time. It's just occasionally it gets stuck. Still trying to make it happen again so I can post debug logs :(.

    Wo0zy
     
  8. Deda
    • Team MediaPortal

    Deda Lead Dev MP1 Videos

    Joined:
    March 18, 2009
    Messages:
    2,423
    Likes Received:
    2,098
    Gender:
    Male
    Occupation:
    IT Consultant
    Location:
    Zagreb
    Ratings:
    +2,385 / 1
    Home Country:
    Croatia Croatia
    Show System Specs
    I just can't initiate covers stuck (tried every possible combination including directly corrupting database fields with garbage). Anyway, I changed radically complete internal scripts processing so you can try it in 1.5. from files in 2nd post. Just beware to update all files and scripts (you can fetch them also via update) as old scripts will fail (others like ofdb, kinopoisk you can download by update from config or GUI as I changed on them what was needed).
    Maybe cover change will work, if not debug log will be fine :)
     
    • Like Like x 3
  9. catavolt
    • Team MediaPortal
    • Administrator

    catavolt Design Group Manager

    Joined:
    August 13, 2007
    Messages:
    12,193
    Likes Received:
    4,944
    Gender:
    Male
    Occupation:
    Technical Documentation, Translation
    Location:
    Lanzarote
    Ratings:
    +7,341 / 38
    Home Country:
    Germany Germany
    Show System Specs
    Hi @Deda, just tested the Patch files from 2nd post: MP stucks directly after start (unresponsive an BasicHome) :cry:
     
  10. Deda
    • Team MediaPortal

    Deda Lead Dev MP1 Videos

    Joined:
    March 18, 2009
    Messages:
    2,423
    Likes Received:
    2,098
    Gender:
    Male
    Occupation:
    IT Consultant
    Location:
    Zagreb
    Ratings:
    +2,385 / 1
    Home Country:
    Croatia Croatia
    Show System Specs
    Can't say too much without logs :), but I tested files and there is no problem with MP 1.5 with them.
     
    • Like Like x 1
  11. catavolt
    • Team MediaPortal
    • Administrator

    catavolt Design Group Manager

    Joined:
    August 13, 2007
    Messages:
    12,193
    Likes Received:
    4,944
    Gender:
    Male
    Occupation:
    Technical Documentation, Translation
    Location:
    Lanzarote
    Ratings:
    +7,341 / 38
    Home Country:
    Germany Germany
    Show System Specs
    Oops, forgot the logs - here they are ;)
     
    • Thank You! Thank You! x 1
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!