MPDB.TV french scrapper

Discussion in 'Moving Pictures' started by Recma, October 17, 2016.

  1. Recma

    Recma Portal Member

    Joined:
    May 3, 2007
    Messages:
    35
    Likes Received:
    3
    Ratings:
    +3 / 0
    Home Country:
    France France
    Hello,

    I'm french and I use Moving pictures since many times now. It was configured to work with the french media-passion database with a specifically built scrapper : https://forum.team-mediaportal.com/threads/scripts-fr-pour-movingpicture.73417/



    Things have changed for media-passion (New Team) and a new database has been created : http://mpdb.tv/

    The MPDB.TV team has released the documentation in order to create new API. It is described in french here : http://wiki.media-passion.fr/Aide:API

    I do not have the skills to code this new API, but I can help to translate previous page if someone have some time !

    Thanks for your reply !

    Cordialy.
     
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,182
    Likes Received:
    1,304
    Ratings:
    +1,683 / 2
    @Recma, do they have an IMDb tt-ID lookup system? Then I can re-add full French support back to IMDb+.

    Example of the way IMDb+ does it for the Icelandic language is that I first locate the movie at imdb.com and then I end up with a tt-ID result. I then pass this to the Icelandic movie database system as: http://kvikmyndir.is/xml/movingpictures/?id=0499549 (Avatar = tt0499549) and then I get the Icelandic language bits from there, and supplement them with English info if needed.

    Same for Swedish, and Dutch with the last one using an API system alike to MPDB for which I wrote a proxy.

    If you can find out from MPDB if I can do the same with them, then it'll be easy to add French support to IMDb+ and keep up with their changes easy.
     
    Last edited: October 17, 2016
    • Thank You! Thank You! x 1
  4. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,182
    Likes Received:
    1,304
    Ratings:
    +1,683 / 2
    @Recma, Google Translate probably messed a few things up, but it looks like:

    http://mpdb.tv/api/v1/movies/(APIKEY)/(END-USERNAME)/(SHA1_SUB_KEY)/0499549?language=fr_fr&typeId=imdb&_format=xml

    Would work to get the MPDB results on Avatar (IMDb tt-ID = 0499549) in the French language, but I would need help understanding requirements to obtain an APIKEY as I do not have access to open: http://media-passion.fr/pm/?sa=send;u=3425

    They also require every user that then ends up using the database info to provide their username, and their subscription key (or the APIKEY holders subscription key, as they did not word that well or Google Translate messed up). Thankfully I already wrote a custom API key system for the RottenTomatoes integration, as they started to become annoying as well with their access requirements. That means the IMDb+ options XML file can be manually edited for now to configure those, and I will update the IMDb+ plugin later to allow GUI control over it.

    So everything is possible, and it should take me 15-45 minutes to add it to IMDb+, but I will need assistance in translating the French to get the access keys, and an explanation on usage terms, etc.
     
  5. Recma

    Recma Portal Member

    Joined:
    May 3, 2007
    Messages:
    35
    Likes Received:
    3
    Ratings:
    +3 / 0
    Home Country:
    France France
    Hello RoChess,

    Thanks for your reply and your interest !

    In order to create a new API, you need an API key. This Key must be obtain by the developper of the scraper, so it would be necessary for you to create an account and formulate a demand. If I ask for the key, I will know it and that's not a good approach in terms of security for the scraper... I give you the text in french just below in order to ask for the API key :

    "Bonjour,

    Je suis le développeur de l'application movingpictures de Mediaportal.

    Pour donner suite à une demande sur le forum dédié (https://forum.team-mediaportal.com/threads/mpdb-tv-french-scrapper.135262/), je me permet de vous contacter afin d'obtenir une clef API en vue de l'intégration de votre scraper dans l'application moving pictures.

    En vous remerciant par avance de votre disponibilité.

    Cordialement,

    RoChess"


    In addition, the MPDB.TV wiki precise that a login and password (specific for subscribes users) must be integrated into the API (wich also include the API Key). In order to secure the transfer the login and password must be encrypted with a special "hashcode" :

    - The login is encrypted in base64url ;
    - For the password it is more difficult : It is a combination of a numeric signature of the register login (hash SHA1 of the login) + the API Key + the password of the register account.

    Of course I remain available if needed !

    Thanks.
     
    Last edited: October 18, 2016
    • Like Like x 1
  6. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,182
    Likes Received:
    1,304
    Ratings:
    +1,683 / 2
    Took me a bit to get registered, but thankfully Google Translate came to the rescue.

    Send message, so now we wait.
     
    • Thank You! Thank You! x 1
  7. Recma

    Recma Portal Member

    Joined:
    May 3, 2007
    Messages:
    35
    Likes Received:
    3
    Ratings:
    +3 / 0
    Home Country:
    France France
    Ok, thank you for your involvement !
     
  8. Recma

    Recma Portal Member

    Joined:
    May 3, 2007
    Messages:
    35
    Likes Received:
    3
    Ratings:
    +3 / 0
    Home Country:
    France France
    Hello RoChess,

    Did you had any information since your registration ?

    Thanks !
     
  9. RoChess
    • Premium Supporter

    RoChess Extension Developer

    Joined:
    March 10, 2006
    Messages:
    4,182
    Likes Received:
    1,304
    Ratings:
    +1,683 / 2
    Yes, I've got the API key, but no time available yet to actually code anything up.

    Going to be challenging with everything going on, but will do my best.
     
    • Thank You! Thank You! x 1
  10. Recma

    Recma Portal Member

    Joined:
    May 3, 2007
    Messages:
    35
    Likes Received:
    3
    Ratings:
    +3 / 0
    Home Country:
    France France
    Hello RoChess,

    Good ! (y)

    No stress... I'm patient !:cool:

    Thanks again !
     
  11. Recma

    Recma Portal Member

    Joined:
    May 3, 2007
    Messages:
    35
    Likes Received:
    3
    Ratings:
    +3 / 0
    Home Country:
    France France
    Hello RoChess,

    Did you have some time to spend on the scraper since you got the API Key ?

    Thanks.
     
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!