Automated Artist / Album Scraping (1 Viewer)

Status
Not open for further replies.

Mr. V

Portal Pro
September 15, 2007
150
164
Brisbane
Home Country
OK was a little fundamental issue in the code...

Two versions attached. One will create the missing artist / album lists, the standard one will not. I would be interested if the standard one is still really slow for you.

Hopefully this should actually address some of the missing artists / albums.

Logs attached.

Total albums = 680
total artist = 183
 

Attachments

  • missing_albums.txt
    7 KB
  • missing_artists.txt
    679 bytes

Baron of L/S

MP Donator
  • Premium Supporter
  • July 31, 2009
    185
    46
    Gippsland Lakes
    Home Country
    Australia Australia
    OK was a little fundamental issue in the code...

    Two versions attached. One will create the missing artist / album lists, the standard one will not. I would be interested if the standard one is still really slow for you.

    Hopefully this should actually address some of the missing artists / albums.

    My latest logs with this dll, still seems to be having trouble with "and":D
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    OK was a little fundamental issue in the code...

    Two versions attached. One will create the missing artist / album lists, the standard one will not. I would be interested if the standard one is still really slow for you.

    Hopefully this should actually address some of the missing artists / albums.

    Logs attached.

    Total albums = 680
    total artist = 183

    OK most of these look like issues that simply can not be resolved automatically
    eg Poison has three artists all with years active, Iron Maiden has two, Korn has two

    Oddly though a couple should be picked up (and are on my system) eg. Queens of the Stone Age and Rage Against the Machine.

    These both have "the" in which makes me concerned... (which version was this with? are you sure this is the version from post #90?) and I really should add logging to say which version is being used ;)
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    Now slight concerned I posted the wrong version before or there is a bug that I am not seeing.

    I put the artist names from your missing artists file into my database and then let the plugin scrape. I picked up

    Code:
    Booker T. and the Mg's
    Freddie and the Dreamers
    Gerry and the Pacemakers
    Herb Alpert and the Tijuana Brass
    Johnny and the Hurricanes
    Martha and the Vandellas
    Sam the Sham and the Pharaohs
    Cliff Bennett and the Rebel Rousers
    Danny and the Juniors
    B. Bumble and the Stingers
    Johnny Kidd and the Pirates
    Mamas and The Papas, The
    Frankie Lymon and the Teenagers
    Buckethead
    Burn the Priest
    Cowboys & Aliens
    Queens of the Stone Age
    Rage Against the Machine
    Steel Panther
    Chemical Brothers, The
    Koma & Bones
    Wolfmother

    almost all of which have the in the title.... I will upload a new version in a minute. Can you please run again and post logs. If these artists are still missing can you use the DEBUG version (which I will also post) and attach those logs?
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    OK new versions here (this is just to ensure the versions are correct)

    missing - adds the missing artist / album logs
    standard - no logs (just to see if this is quicker than missing)
    DEBUG - just has far more logging
     

    Attachments

    • MusicInfoHandler_missing.zip
      8.1 KB
    • MusicInfoHandler_standard.zip
      7.8 KB
    • MusicInfoHandler_DEBUG.zip
      9 KB

    Baron of L/S

    MP Donator
  • Premium Supporter
  • July 31, 2009
    185
    46
    Gippsland Lakes
    Home Country
    Australia Australia
    Now slight concerned I posted the wrong version before or there is a bug that I am not seeing.

    I put the artist names from your missing artists file into my database and then let the plugin scrape. I picked up

    Code:
    Booker T. and the Mg's
    Freddie and the Dreamers
    Gerry and the Pacemakers
    Herb Alpert and the Tijuana Brass
    Johnny and the Hurricanes
    Martha and the Vandellas
    Sam the Sham and the Pharaohs
    Cliff Bennett and the Rebel Rousers
    Danny and the Juniors
    B. Bumble and the Stingers
    Johnny Kidd and the Pirates
    Mamas and The Papas, The
    Frankie Lymon and the Teenagers
    Buckethead
    Burn the Priest
    Cowboys & Aliens
    Queens of the Stone Age
    Rage Against the Machine
    Steel Panther
    Chemical Brothers, The
    Koma & Bones
    Wolfmother

    almost all of which have the in the title.... I will upload a new version in a minute. Can you please run again and post logs. If these artists are still missing can you use the DEBUG version (which I will also post) and attach those logs?

    Ok I now have all of the above down to Buckethead onwards which aren't mine . Well done!!:)
    logs attached for standard dll
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    Could any kind designer type person create me some icons for this plugin? The default plugin one is pretty crap and my design skills are very bad...

    New (final ?) version will be uploaded tonight. It will allow you to turn on/off logging of missing artists, whether you want to use the whole alternate lookup (slower but gets better results) and you can also add a proxy (more for my debugging really)
     

    emphatic

    Design Group
  • Team MediaPortal
  • August 25, 2006
    3,728
    1,185
    Alingsås
    Home Country
    Sweden Sweden
    Could any kind designer type person create me some icons for this plugin? The default plugin one is pretty crap and my design skills are very bad...

    New (final ?) version will be uploaded tonight. It will allow you to turn on/off logging of missing artists, whether you want to use the whole alternate lookup (slower but gets better results) and you can also add a proxy (more for my debugging really)

    What format/size? Also other ideas you can think of and I can get right on that.
    Emph
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    What format/size? Also other ideas you can think of and I can get right on that.
    Transparent PNG but not sure size matters ;)

    Music plugin icons are 128x128 but one button music in 460x460. As long as they are square all if good :)
    Need active and inactive icons (
    eg, http://sources.team-mediaportal.com.../mediaportal/WindowPlugins/GUIMusic/Music.gif
    http://sources.team-mediaportal.com...rtal/WindowPlugins/GUIMusic/MusicDisabled.gif)

    As I said, my design skills are crap... I would end up with a plain triangle or circle or something as I can draw that in paint :eek:
     

    Pog

    Retired Team Member
  • Premium Supporter
  • September 7, 2009
    401
    315
    Wicklow
    Home Country
    Ireland Ireland
    All coming together nicely.

    Just a reminder in case you missed this before; the YEAR field always contains zero when using the automated plugin, while using the manual gui version this field is filled as expected.

    Also can you make it not do any online checking unless new items have been added to the DB. For me there will always be a fair few artists/albums that will not be found.
     
    Status
    Not open for further replies.

    Users who are viewing this thread

    Top Bottom