Update allmusic.com scraper (1 Viewer)

jameson_uk

Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    Allmusic.com have updated their layout again so currently artist and album scraping inside of MP is broken.

    Attached is hopefully a fix which is https://github.com/MediaPortal/MediaPortal-1/tree/BUG_AMG_Scraper

    In C:\Program Files (x86)\Team MediaPortal\MediaPortal
    rename Databases.dll and place the following files from zip into that folder
    • Databases.dll
    • Databases.pdb
    • HTMLAgilityPack.dll
    In C:\Program Files (x86)\Team MediaPortal\MediaPortal\plugins\Windows
    rename WindowPlugins.dll and place the following files from zip into that folder
    • WindowPlugins.dll
    • WindowPlugins.pdb
    You will need to disable other scrapers (MusicInfoHandler) but scraping should then work inside of MP
     

    Attachments

    • AMG.zip
      1.5 MB
    • AMG_v3.zip
      1.5 MB
    • AMG_3a.zip
      1.5 MB
    Last edited:

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom

    styrsven

    Portal Pro
    January 6, 2013
    115
    51
    63
    Home Country
    Sweden Sweden
    Yes, it looks like it is doing what it is supposed to do. I tried to update as much as I could, and it fetched the info correctly. A couple of times it seemed to hang when fetching data, and when I checked the logs I saw some error printouts. I'm attaching the actual logs (didn't run in debug mode).
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    Yes, it looks like it is doing what it is supposed to do. I tried to update as much as I could, and it fetched the info correctly. A couple of times it seemed to hang when fetching data, and when I checked the logs I saw some error printouts. I'm attaching the actual logs (didn't run in debug mode).

    Any chance you can replicate this with debug level logs? I can stop the errors but these indicate cases where the code is not parsing the pages (might be because they are laid out differently or something) but I could really do with knowing which album / artist throw up these errors so I can check them
     

    HomeY

    Test Group
  • Team MediaPortal
  • February 23, 2008
    6,475
    4,645
    49
    ::1
    Home Country
    Netherlands Netherlands
    Seems to work great Mike (y)
    20-26-32.png 20-26-52.png 20-27-38.png 20-28-00.png 20-28-28.png

    But... i have 1 artist that always seems to cause problems :)
    Frédéric Chopin
    [hide]
    Code:
    [2013-08-08 20:27:04,467] [Log	] [MPMain  ] [ERROR] - Exception: System.NullReferenceException: Object reference not set to an instance of an object.
      at MediaPortal.Music.Database.MusicArtistInfo.Parse(String strUrl) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\Databases\Music\InternetLookups\MusicArtistInfo.cs:line 194
      at MediaPortal.GUI.Music.GUIMusicBaseWindow.ShowArtistInfo(String artistName, String albumName) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicBaseWindow.cs:line 1283
      at MediaPortal.GUI.Music.GUIMusicBaseWindow.OnInfo(Int32 iItem) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicBaseWindow.cs:line 1464
      at MediaPortal.GUI.Music.GUIMusicGenres.OnShowContextMenu() in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicGenres.cs:line 723
      at MediaPortal.GUI.Library.GUIWindow.OnAction(Action action)
      at MediaPortal.GUI.Music.GUIMusicBaseWindow.OnAction(Action action) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicBaseWindow.cs:line 493
      at MediaPortal.GUI.Music.GUIMusicGenres.OnAction(Action action) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicGenres.cs:line 336
      at MediaPortal.GUI.Library.GUIWindowManager.OnAction(Action action)
      at MediaPortalApp.OnAction(Action action)  Message: Object reference not set to an instance of an object.  Site  : Boolean Parse(System.String)  Source : Databases  Stack Trace:	 at MediaPortal.Music.Database.MusicArtistInfo.Parse(String strUrl) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\Databases\Music\InternetLookups\MusicArtistInfo.cs:line 194
      at MediaPortal.GUI.Music.GUIMusicBaseWindow.ShowArtistInfo(String artistName, String albumName) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicBaseWindow.cs:line 1283
      at MediaPortal.GUI.Music.GUIMusicBaseWindow.OnInfo(Int32 iItem) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicBaseWindow.cs:line 1464
      at MediaPortal.GUI.Music.GUIMusicGenres.OnShowContextMenu() in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicGenres.cs:line 723
      at MediaPortal.GUI.Library.GUIWindow.OnAction(Action action)
      at MediaPortal.GUI.Music.GUIMusicBaseWindow.OnAction(Action action) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicBaseWindow.cs:line 493
      at MediaPortal.GUI.Music.GUIMusicGenres.OnAction(Action action) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicGenres.cs:line 336
      at MediaPortal.GUI.Library.GUIWindowManager.OnAction(Action action)
      at MediaPortalApp.OnAction(Action action)
    [2013-08-08 20:27:04,471] [Error  ] [MPMain  ] [ERROR] - Exception: Object reference not set to an instance of an object. Databases	at MediaPortal.Music.Database.MusicArtistInfo.Parse(String strUrl) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\Databases\Music\InternetLookups\MusicArtistInfo.cs:line 194
      at MediaPortal.GUI.Music.GUIMusicBaseWindow.ShowArtistInfo(String artistName, String albumName) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicBaseWindow.cs:line 1283
      at MediaPortal.GUI.Music.GUIMusicBaseWindow.OnInfo(Int32 iItem) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicBaseWindow.cs:line 1464
      at MediaPortal.GUI.Music.GUIMusicGenres.OnShowContextMenu() in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicGenres.cs:line 723
      at MediaPortal.GUI.Library.GUIWindow.OnAction(Action action)
      at MediaPortal.GUI.Music.GUIMusicBaseWindow.OnAction(Action action) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicBaseWindow.cs:line 493
      at MediaPortal.GUI.Music.GUIMusicGenres.OnAction(Action action) in C:\Users\james_000\Documents\Code\MediaPortal-1\mediaportal\WindowPlugins\GUIMusic\GUIMusicGenres.cs:line 336
      at MediaPortal.GUI.Library.GUIWindowManager.OnAction(Action action)
      at MediaPortalApp.OnAction(Action action)
    [/hide]

    BTW: Lovin' the moods :D
     
    Last edited:

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    But... i have 1 artist that always seems to cause problems :)
    Frédéric Chopin
    OK this was because he has no discography page. New version in first post which will now check that pages exist before loading them.
    Can you try and break this again please?
     

    Users who are viewing this thread

    Top Bottom