Automated Artist / Album Scraping (1 Viewer)

Status
Not open for further replies.

jameson_uk

Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    OK, yet another new version. My quick check seemed to work find with the prefixes stripped (well for The Beatles anyway) are you sure the others are actually able to be identified automatically?

    Anyway this adds the pop filter and also another check so I think this should now pick up bjork and sinead o'connor.
     

    Pog

    Retired Team Member
  • Premium Supporter
  • September 7, 2009
    401
    315
    Wicklow
    Home Country
    Ireland Ireland
    Cool, will check the new version soon.

    I don't even have Sinead in my collection, though it looks like a good sample to get working!
     

    Pog

    Retired Team Member
  • Premium Supporter
  • September 7, 2009
    401
    315
    Wicklow
    Home Country
    Ireland Ireland
    Update:

    Prefixes still not working, looks like they get processed but result not added to the DB.
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    Prefixes still not working, looks like they get processed but result not added to the DB.
    How are you checking this? Are you checking whether they are showing up in MP or actually looking in the database directly? (I think they were being added to database but with the standard name ie. the artist table has Beatles, The but info table was being loaded with The Beatles)

    I have added v6 which now attempts to remove anything in brackets at the end of the string (as a second attempt to match an album)

    I am slightly worried by a couple of things (a) why you are getting those HTTP 500 errors and (b) why your music collection seems very similar to mine :p

    I think (a) might be down to fast machines and fast internet connections so I have added in a throttling mechanism which might slow this down a little but I don't get any of these errors. (b) is probably down to good taste :D
     

    Pog

    Retired Team Member
  • Premium Supporter
  • September 7, 2009
    401
    315
    Wicklow
    Home Country
    Ireland Ireland
    Excellent! prefixes working great, before there was no unable to process message, assumed they were processed but nothing showed in MP.

    Albums with info in brackets not working:

    2011-09-03 13:48:57.910041 [Debug][(30)]: MusicInfoHandler: Album: Processing Album: beatles, the - abbey road (remastered)
    2011-09-03 13:49:10.582766 [Debug][(30)]: MusicInfoHandler: Album: Unable to process album info for: beatles, the - abbey road (remastered)

    I see you got artists ending with a period (R.E.M.) working, great.

    No errors in error.log.

    I am slightly worried by a couple of things (a) why you are getting those HTTP 500 errors and (b) why your music collection seems very similar to mine :p

    I think (a) might be down to fast machines and fast internet connections so I have added in a throttling mechanism which might slow this down a little but I don't get any of these errors. (b) is probably down to good taste :D

    Yeah good taste! :D Wife doesn't always agree with some of my more eclectic stuff but then I let her taint my lovely sounds with the likes of Abba ;)
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    Excellent! prefixes working great, before there was no unable to process message, assumed they were processed but nothing showed in MP.
    Good

    Albums with info in brackets not working:
    Not so good... will check it out

    I see you got artists ending with a period (R.E.M.) working, great.
    Sadly no.... I have actually frigged R.E.M. and AC/DC by looking up the values manually :oops:

    Yeah good taste! :D Wife doesn't always agree with some of my more eclectic stuff but then I let her taint my lovely sounds with the likes of Abba ;)
    lol yeah my misses moans a lot about some of my weirder stuff (that and hundreds of CDs turning up in the post...)
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    2011-09-03 13:48:57.910041 [Debug][(30)]: MusicInfoHandler: Album: Processing Album: beatles, the - abbey road (remastered)
    2011-09-03 13:49:10.582766 [Debug][(30)]: MusicInfoHandler: Album: Unable to process album info for: beatles, the - abbey road (remastered)
    Could you please try the attached?

    I am not sure it will work but either way can you attach the error.log showing Abbey Road ?
     

    Pog

    Retired Team Member
  • Premium Supporter
  • September 7, 2009
    401
    315
    Wicklow
    Home Country
    Ireland Ireland
    Still has problems with brackets

    2011-09-03 20:14:03.115583 [ERROR][(32)]: StrAlbum: abbey road (remastered)
    2011-09-03 20:14:03.115583 [ERROR][(32)]: strStripStackEnding: abbey road (remastered)
    2011-09-03 20:14:03.128584 [ERROR][(32)]: strAlbumRemoveBrackets: \1
    2011-09-03 20:14:03.135584 [ERROR][(32)]: Nothing matched
    2011-09-03 20:14:08.352883 [ERROR][(32)]: StrAlbum: abbey road (remastered)
    2011-09-03 20:14:08.353883 [ERROR][(32)]: strStripStackEnding: abbey road (remastered)
    2011-09-03 20:14:08.378884 [ERROR][(32)]: strAlbumRemoveBrackets: \1
    2011-09-03 20:14:08.393885 [ERROR][(32)]: Nothing matched
     

    jameson_uk

    Retired Team Member
  • Premium Supporter
  • January 27, 2005
    7,258
    2,528
    Birmingham
    Home Country
    United Kingdom United Kingdom
    Doh was programming in the wrong language....

    Could you please try the attached.

    Any idea why it has searched for the album twice? Is it possible one of the tracks has the wrong (or different) album artist or something?
    Edit: is late... this is just searching main albums then compilations
     
    Status
    Not open for further replies.

    Users who are viewing this thread

    Top Bottom