Automated Artist / Album Scraping | Page 10

Discussion in 'Listen Music' started by jameson_uk, August 29, 2011.

Thread Status:
Not open for further replies.
  1. Mr. V

    Mr. V Portal Pro

    Joined:
    September 15, 2007
    Messages:
    150
    Likes Received:
    82
    Location:
    Brisbane
    Ratings:
    +83 / 0
    Home Country:
    Logs attached.

    Total albums = 680
    total artist = 183

     

    Attached Files:

  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. Baron of L/S
    • Premium Supporter

    Baron of L/S MP Donator

    Joined:
    July 31, 2009
    Messages:
    182
    Likes Received:
    38
    Gender:
    Male
    Occupation:
    Retired
    Location:
    Gippsland Lakes
    Ratings:
    +43 / 0
    Home Country:
    Australia Australia
    Show System Specs
    My latest logs with this dll, still seems to be having trouble with "and":D
     
  4. jameson_uk
    • Team MediaPortal

    jameson_uk Retired Team Member

    Joined:
    January 27, 2005
    Messages:
    7,258
    Likes Received:
    2,228
    Gender:
    Male
    Occupation:
    Data Warehousing Consultant
    Location:
    Birmingham
    Ratings:
    +2,403 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    OK most of these look like issues that simply can not be resolved automatically
    eg Poison has three artists all with years active, Iron Maiden has two, Korn has two

    Oddly though a couple should be picked up (and are on my system) eg. Queens of the Stone Age and Rage Against the Machine.

    These both have "the" in which makes me concerned... (which version was this with? are you sure this is the version from post #90?) and I really should add logging to say which version is being used ;)
     
  5. jameson_uk
    • Team MediaPortal

    jameson_uk Retired Team Member

    Joined:
    January 27, 2005
    Messages:
    7,258
    Likes Received:
    2,228
    Gender:
    Male
    Occupation:
    Data Warehousing Consultant
    Location:
    Birmingham
    Ratings:
    +2,403 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Now slight concerned I posted the wrong version before or there is a bug that I am not seeing.

    I put the artist names from your missing artists file into my database and then let the plugin scrape. I picked up

    Code (Text):
    1. Booker T. and the Mg's
    2. Freddie and the Dreamers
    3. Gerry and the Pacemakers
    4. Herb Alpert and the Tijuana Brass
    5. Johnny and the Hurricanes
    6. Martha and the Vandellas
    7. Sam the Sham and the Pharaohs
    8. Cliff Bennett and the Rebel Rousers
    9. Danny and the Juniors
    10. B. Bumble and the Stingers
    11. Johnny Kidd and the Pirates
    12. Mamas and The Papas, The
    13. Frankie Lymon and the Teenagers
    14. Buckethead
    15. Burn the Priest
    16. Cowboys & Aliens
    17. Queens of the Stone Age
    18. Rage Against the Machine
    19. Steel Panther
    20. Chemical Brothers, The
    21. Koma & Bones
    22. Wolfmother
    almost all of which have the in the title.... I will upload a new version in a minute. Can you please run again and post logs. If these artists are still missing can you use the DEBUG version (which I will also post) and attach those logs?
     
  6. jameson_uk
    • Team MediaPortal

    jameson_uk Retired Team Member

    Joined:
    January 27, 2005
    Messages:
    7,258
    Likes Received:
    2,228
    Gender:
    Male
    Occupation:
    Data Warehousing Consultant
    Location:
    Birmingham
    Ratings:
    +2,403 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    OK new versions here (this is just to ensure the versions are correct)

    missing - adds the missing artist / album logs
    standard - no logs (just to see if this is quicker than missing)
    DEBUG - just has far more logging
     

    Attached Files:

  7. Baron of L/S
    • Premium Supporter

    Baron of L/S MP Donator

    Joined:
    July 31, 2009
    Messages:
    182
    Likes Received:
    38
    Gender:
    Male
    Occupation:
    Retired
    Location:
    Gippsland Lakes
    Ratings:
    +43 / 0
    Home Country:
    Australia Australia
    Show System Specs
    Ok I now have all of the above down to Buckethead onwards which aren't mine . Well done!!:)
    logs attached for standard dll
     
  8. jameson_uk
    • Team MediaPortal

    jameson_uk Retired Team Member

    Joined:
    January 27, 2005
    Messages:
    7,258
    Likes Received:
    2,228
    Gender:
    Male
    Occupation:
    Data Warehousing Consultant
    Location:
    Birmingham
    Ratings:
    +2,403 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Could any kind designer type person create me some icons for this plugin? The default plugin one is pretty crap and my design skills are very bad...

    New (final ?) version will be uploaded tonight. It will allow you to turn on/off logging of missing artists, whether you want to use the whole alternate lookup (slower but gets better results) and you can also add a proxy (more for my debugging really)
     
  9. emphatic
    • Team MediaPortal

    emphatic Design Group

    Joined:
    August 25, 2006
    Messages:
    3,583
    Likes Received:
    828
    Gender:
    Male
    Occupation:
    Surface treatment
    Location:
    Alingsås
    Ratings:
    +1,082 / 2
    Home Country:
    Sweden Sweden
    Show System Specs
    What format/size? Also other ideas you can think of and I can get right on that.
    Emph
     
    • Like Like x 1
  10. jameson_uk
    • Team MediaPortal

    jameson_uk Retired Team Member

    Joined:
    January 27, 2005
    Messages:
    7,258
    Likes Received:
    2,228
    Gender:
    Male
    Occupation:
    Data Warehousing Consultant
    Location:
    Birmingham
    Ratings:
    +2,403 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Transparent PNG but not sure size matters ;)

    Music plugin icons are 128x128 but one button music in 460x460. As long as they are square all if good :)
    Need active and inactive icons (
    eg, http://sources.team-mediaportal.com.../mediaportal/WindowPlugins/GUIMusic/Music.gif
    http://sources.team-mediaportal.com...rtal/WindowPlugins/GUIMusic/MusicDisabled.gif)

    As I said, my design skills are crap... I would end up with a plain triangle or circle or something as I can draw that in paint :eek:
     
  11. Pog
    • Team MediaPortal

    Pog Retired Team Member

    Joined:
    September 7, 2009
    Messages:
    401
    Likes Received:
    220
    Location:
    Wicklow
    Ratings:
    +314 / 1
    Home Country:
    Ireland Ireland
    Show System Specs
    All coming together nicely.

    Just a reminder in case you missed this before; the YEAR field always contains zero when using the automated plugin, while using the manual gui version this field is filled as expected.

    Also can you make it not do any online checking unless new items have been added to the DB. For me there will always be a fair few artists/albums that will not be found.
     
    • Like Like x 1
Loading...
Thread Status:
Not open for further replies.

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!