MePo Tools - Download ClearArt/CDArt/ClearLogos, Music Video clips and more! (3 Viewers)

kiwijunglist

Super Moderator
  • Team MediaPortal
  • June 10, 2008
    6,746
    1,751
    New Zealand
    Home Country
    New Zealand New Zealand
    1. You guys are awesome. :)

    2. You should team up and create a new Music Plugin for MePo that presents scraped info instead of id-tags in the GUI (like Moving Pictures and MP TV-Series, but for Music). An optional Backend option could be to overwrite existing id-tags with the scraped data. This would mean that all music info would be consistent and look even better inside MePo.

    Emph

    This already exists it's called tagging software. eg. Tag&Rename / MPTagThat[DOUBLEPOST=1373978965][/DOUBLEPOST]
    How to specify the resulting file name? How to specify the quality? And other parameters of interest to us?

    Code:
    F:\Delphi\MePoTools>youtube-dl.exe CL8rj1w6P18
    [youtube] Setting language
    [youtube] CL8rj1w6P18: Downloading video webpage
    [youtube] CL8rj1w6P18: Downloading video info webpage
    [youtube] CL8rj1w6P18: Extracting video information
    [download] Destination: Cher - Believe-CL8rj1w6P18.mp4
    [download]  17.9% of 63.53MiB at 148.72KiB/s ETA 05:59
     
    ERROR: unable to write data: [Errno 28] No space left on device


    I can work out this part. I will write instructions
     

    ajs

    Development Group
  • Team MediaPortal
  • February 29, 2008
    16,059
    11,141
    Kyiv
    Home Country
    Ukraine Ukraine
    2. You should team up and create a new Music Plugin for MePo that presents scraped info instead of id-tags in the GUI (like Moving Pictures and MP TV-Series, but for Music). An optional Backend option could be to overwrite existing id-tags with the scraped data. This would mean that all music info would be consistent and look even better inside MePo.
    I have no time to study C #, so I can not do it :([DOUBLEPOST=1373979064][/DOUBLEPOST]
    I can work out this part. I will write instructions
    I need to know what parameter has need of me, not only for the normal setting but also for testing
     

    kiwijunglist

    Super Moderator
  • Team MediaPortal
  • June 10, 2008
    6,746
    1,751
    New Zealand
    Home Country
    New Zealand New Zealand
    We are not writing I don't then we need authentication signiture, we only need API key?
    user.getRecommendedArtists

    Get Last.fm artist recommendations for a user
    Params

    page (Optional) : The page number to fetch. Defaults to first page.
    limit (Optional) : The number of results to fetch per page. Defaults to 50.
    api_key (Required) : A Last.fm API key.
    api_sig (Required) : A Last.fm method signature. See authentication for more information.
    sk (Required) : A session key generated by authenticating a user via the authentication protocol.


    I don't know... can we ask @jameson_uk about the API sig / key / authorization

    Hi Jameson

    We want to use the following last.fm API calls

    user.gettoptracks
    user.getlovedtrack
    artist.gettoptracks

    Having trouble with the API Sig + Auth part[DOUBLEPOST=1373979128][/DOUBLEPOST]
    I need to know what parameter has need of me, not only for the normal setting but also for testing

    Yes I can do this part and write out instructions for you.[DOUBLEPOST=1373979220][/DOUBLEPOST]I did this on JIRA not sure if you can see
    Download png - https://forum.team-mediaportal.com/attachments/mepo-tools-music-videos-1-png.133046/
     

    Attachments

    • MePo+Tools+Music+Videos (1).png
      MePo+Tools+Music+Videos (1).png
      54.1 KB
    Last edited:

    kiwijunglist

    Super Moderator
  • Team MediaPortal
  • June 10, 2008
    6,746
    1,751
    New Zealand
    Home Country
    New Zealand New Zealand
    D:\Youtube DL>youtube-dl -help
    Usage: youtube-dl [options] url [url...]

    Options:
    General Options:
    -h, --help print this help text and exit
    --version print program version and exit
    -U, --update update this program to latest version
    -i, --ignore-errors continue on download errors
    --dump-user-agent display the current browser identification
    --user-agent UA specify a custom user agent
    --referer REF specify a custom referer, use if the video access

    is restricted to one domain
    --list-extractors List all supported extractors and the URLs they
    would handle
    --extractor-descriptions Output descriptions of all supported extractors
    --proxy URL Use the specified HTTP/HTTPS proxy
    --no-check-certificate Suppress HTTPS certificate validation.

    Video Selection:
    --playlist-start NUMBER playlist video to start at (default is 1)
    --playlist-end NUMBER playlist video to end at (default is last)
    --match-title REGEX download only matching titles (regex or caseless
    sub-string)
    --reject-title REGEX skip download for matching titles (regex or
    caseless sub-string)
    --max-downloads NUMBER Abort after downloading NUMBER files
    --min-filesize SIZE Do not download any videos smaller than SIZE
    (e.g. 50k or 44.6m)
    --max-filesize SIZE Do not download any videos larger than SIZE (e.g.

    50k or 44.6m)
    --date DATE download only videos uploaded in this date
    --datebefore DATE download only videos uploaded before this date
    --dateafter DATE download only videos uploaded after this date

    Download Options:
    -r, --rate-limit LIMIT maximum download rate (e.g. 50k or 44.6m)
    -R, --retries RETRIES number of retries (default is 10)
    --buffer-size SIZE size of download buffer (e.g. 1024 or 16k)
    (default is 1024)
    --no-resize-buffer do not automatically adjust the buffer size. By
    default, the buffer size is automatically resized

    from an initial value of SIZE.

    Filesystem Options:
    -t, --title use title in file name (default)
    --id use only video ID in file name
    -l, --literal [deprecated] alias of --title
    -A, --auto-number number downloaded files starting from 00000
    -o, --output TEMPLATE output filename template. Use %(title)s to get
    the title, %(uploader)s for the uploader name,
    %(uploader_id)s for the uploader nickname if
    different, %(autonumber)s to get an automatically

    incremented number, %(ext)s for the filename
    extension, %(upload_date)s for the upload date
    (YYYYMMDD), %(extractor)s for the provider
    (youtube, metacafe, etc), %(id)s for the video id

    , %(playlist)s for the playlist the video is in,
    %(playlist_index)s for the position in the
    playlist and %% for a literal percent. Use - to
    output to stdout. Can also be used to download to

    a different directory, for example with -o '/my/d

    ownloads/%(uploader)s/%(title)s-%(id)s.%(ext)s' .

    --autonumber-size NUMBER Specifies the number of digits in %(autonumber)s
    when it is present in output filename template or

    --autonumber option is given
    --restrict-filenames Restrict filenames to only ASCII characters, and
    avoid "&" and spaces in filenames
    -a, --batch-file FILE file containing URLs to download ('-' for stdin)
    -w, --no-overwrites do not overwrite files
    -c, --continue resume partially downloaded files
    --no-continue do not resume partially downloaded files (restart

    from beginning)
    --cookies FILE file to read cookies from and dump cookie jar in
    --no-part do not use .part files
    --no-mtime do not use the Last-modified header to set the
    file modification time
    --write-description write video description to a .description file
    --write-info-json write video metadata to a .info.json file
    --write-thumbnail write thumbnail image to disk

    Verbosity / Simulation Options:
    -q, --quiet activates quiet mode
    -s, --simulate do not download the video and do not write
    anything to disk
    --skip-download do not download the video
    -g, --get-url simulate, quiet but print URL
    -e, --get-title simulate, quiet but print title
    --get-id simulate, quiet but print id
    --get-thumbnail simulate, quiet but print thumbnail URL
    --get-description simulate, quiet but print video description
    --get-filename simulate, quiet but print output filename
    --get-format simulate, quiet but print output format
    --newline output progress bar as new lines
    --no-progress do not print progress bar
    --console-title display progress in console titlebar
    -v, --verbose print various debugging information
    --dump-intermediate-pages print downloaded pages to debug problems(very
    verbose)

    Video Format Options:
    -f, --format FORMAT video format code, specifiy the order of
    preference using slashes: "-f 22/17/18"
    --all-formats download all available video formats
    --prefer-free-formats prefer free video formats unless a specific one
    is requested
    --max-quality FORMAT highest quality format to download
    -F, --list-formats list all available formats (currently youtube
    only)
    --write-sub write subtitle file (currently youtube only)
    --write-auto-sub write automatic subtitle file (currently youtube
    only)
    --only-sub [deprecated] alias of --skip-download
    --all-subs downloads all the available subtitles of the
    video (currently youtube only)
    --list-subs lists all available subtitles for the video
    (currently youtube only)
    --sub-format FORMAT subtitle format [srt/sbv/vtt] (default=srt)
    (currently youtube only)
    --sub-lang LANG language of the subtitles to download (optional)
    use IETF language tags like 'en'

    Authentication Options:
    -u, --username USERNAME account username
    -p, --password PASSWORD account password
    -n, --netrc use .netrc authentication data
    --video-password PASSWORD video password (vimeo only)

    Post-processing Options:
    -x, --extract-audio convert video files to audio-only files (requires

    ffmpeg or avconv and ffprobe or avprobe)
    --audio-format FORMAT "best", "aac", "vorbis", "mp3", "m4a", "opus", or

    "wav"; best by default
    --audio-quality QUALITY ffmpeg/avconv audio quality specification, insert

    a value between 0 (better) and 9 (worse) for VBR
    or a specific bitrate like 128K (default 5)
    --recode-video FORMAT Encode the video to another format if necessary
    (currently supported: mp4|flv|ogg|webm)
    -k, --keep-video keeps the video file on disk after the post-
    processing; the video is erased by default
    --no-post-overwrites do not overwrite post-processed files; the post-
    processed files are overwritten by default

    D:\Youtube DL>

    Code:
    youtube-dl.exe -f <video.format> -o "<file.name.no.extension>%(ext)s" <youtube.url>

    for now use <video.format> = 18
    (18 = 360P MP4 Video)
    I will create list of video.formats for settings later

    Example:
    Code:
    youtube-dl.exe -f 18 -o "c:\testvideo.%(ext)s" http://www.youtube.com/watch?v=llDikI2hTtk

    This will save as c:\testvideo.mp4
     
    Last edited:

    ajs

    Development Group
  • Team MediaPortal
  • February 29, 2008
    16,059
    11,141
    Kyiv
    Home Country
    Ukraine Ukraine
    Yes I can do this part and write out instructions for you.
    Code:
    youtube-dl.exe CL8rj1w6P18 -o "D:\Downloads\Y\Cher - Belive.avi" -f 5
    For testing, I found the settings ...

    I don't know... can we ask @jameson_uk about the API sig / key / authorization
    While this is not necessary, as we get to this stage and will understand that there is, and how.
     

    ajs

    Development Group
  • Team MediaPortal
  • February 29, 2008
    16,059
    11,141
    Kyiv
    Home Country
    Ukraine Ukraine

    kiwijunglist

    Super Moderator
  • Team MediaPortal
  • June 10, 2008
    6,746
    1,751
    New Zealand
    Home Country
    New Zealand New Zealand
    Youtube video extensions: .mp4 / .flv / .webm depending on how the user uploaded + when + what quality is available. File type is unknown.

    We should check for filename.* before and after downloading...

    This is better because, They may already have filename.avi so we don't want to download filename.mp4 or any other music video extension for that file.[DOUBLEPOST=1373981773][/DOUBLEPOST]Settings:

    Button [Choose video format(s)]

    Brings up a small window with a list
    [Check Box] - Extension - Video Resolution (3D) - Audio Bitrate

    eg.
    Code:
    [X]	MP4		  1080P		  192kbps
    [X]	WEBM	  1080P		  192kbps
    [X]	MP4		  720P		  192kbps
    [ ]	MP4		  720P (3D)	  192kbps
    [ ]	WEBM	  720P (3D)	  192kbps
    [X]	WEBM	  720P		  192kbps
    etc...

    For your coding:
    videoformats.txt
    Code:
    This is the order we will use in the plugin
     
    37  : MP4 1080P 192kbps **
    46  : WEBM 1080P 192kbps **
    102 : webm 720P 192kbps (3D Video)
    84  : MP4 720P 152 kbps (3D Video)
    22  : MP4 720P 192kbps **
    45  : webm 720P 192kbps **
    120 : flv 720P 128kbps **
    85  : MP4 520P 152kbps (3D Video)
    44  : webm 480P 128kbps **
    35  : flv  480P 128kbps **
    101 : webm 360P 192kbps (3D Video)
    100 : webm 360P 128kbps (3D Video)
    82  : mp4 360P 96kbps (3D Video)
    43  : webm 360P 128kbps **
    34  : flv  360P 128kbps **
    18  : mp4 360P 96kbps
    83  : MP4 240P 96 kbps (3D Video)
    6  : flv 270P 64kbps
    5  : flv 240P 64 kbps
    36  : 3GP 240P 38 kbps
     
    ** Enabled by default

    Then we use -f 37/46/22/84/45/102/120 ... same order as the list I made. But skip any that are not enabled with checkbox.
     

    Attachments

    • video formats.txt
      907 bytes
    Last edited:

    ajs

    Development Group
  • Team MediaPortal
  • February 29, 2008
    16,059
    11,141
    Kyiv
    Home Country
    Ukraine Ukraine
    "That's one small step for [a] man, one giant leap for mankind." :coffee:

    mp.png [DOUBLEPOST=1373985699]

    [/DOUBLEPOST]
    Settings: Button [Choose video format(s)] Brings up a small window with a list [Check Box] - Extension - Video Resolution (3D) - Audio Bitrate
    Can replace the drop-down list? With the only option?

    Youtube video extensions: .mp4 / .flv / .webm depending on how the user uploaded + when + what quality is available. File type is unknown.
    We are no one bothers to make it AVI. And everything will work as it should.
     
    Last edited:

    ajs

    Development Group
  • Team MediaPortal
  • February 29, 2008
    16,059
    11,141
    Kyiv
    Home Country
    Ukraine Ukraine
    As long as something like this, it is necessary to consider what to do with: \u043b\u044e\u0431

    Code:
    I 16-07-2013 18:14:55.133 Yotube Music (Artists) mode:
    I 16-07-2013 18:14:55.133 - Metod: All
      16-07-2013 18:14:55.136 - Proxy: 10.1.80.80:3128
      16-07-2013 18:14:55.138 - Get Last.FM URLs for eeb1195b-f213-4ce1-b28c-8565211f8e43 Guns N' Roses
      16-07-2013 18:14:55.505  Skip:Paradise City|384|142|http:\/\/www.last.fm\/music\/+noredirect\/Guns+n%E2%80%99+Roses\/_\/Paradise+City
      16-07-2013 18:14:55.506  Skip:November Rain|198|71|http:\/\/www.last.fm\/music\/+noredirect\/Guns+n%E2%80%99+Roses\/_\/November+Rain
      16-07-2013 18:14:55.507  Skip:Welcome To The Jungle|140|62|http:\/\/www.last.fm\/music\/+noredirect\/Guns+n%E2%80%99+Roses\/_\/Welcome+To+The+Jungle
      16-07-2013 18:14:55.508 - Get Last.FM URLs for ebe42a0b-6a6f-4eb6-b436-5c0f351d96f3 Владимир Высоцкий
      16-07-2013 18:14:56.138  Add: \u042f \u043d\u0435 \u043b\u044e\u0431\u043b\u044e|6398|2486|http:\/\/www.last.fm\/music\/%D0%92%D0%BB%D0%B0%D0%B4%D0%B8%D0%BC%D0%B8%D1%80+%D0%92%D1%8B%D1%81%D0%BE%D1%86%D0%BA%D0%B8%D0%B9\/_\/%D0%AF+%D0%BD%D0%B5+%D0%BB%D1%8E%D0%B1%D0%BB%D1%8E
      16-07-2013 18:14:56.143  Skip:\u041f\u0435\u0441\u043d\u044f \u043e \u0434\u0440\u0443\u0433\u0435|2522|1175|http:\/\/www.last.fm\/music\/%D0%92%D0%BB%D0%B0%D0%B4%D0%B8%D0%BC%D0%B8%D1%80+%D0%92%D1%8B%D1%81%D0%BE%D1%86%D0%BA%D0%B8%D0%B9\/_\/%D0%9F%D0%B5%D1%81%D0%BD%D1%8F+%D0%BE+%D0%B4%D1%80%D1%83%D0%B3%D0%B5
      16-07-2013 18:14:56.148  Skip:\u0423\u0442\u0440\u0435\u043d\u043d\u044f\u044f \u0433\u0438\u043c\u043d\u0430\u0441\u0442\u0438\u043a\u0430|2258|1101|http:\/\/www.last.fm\/music\/%D0%92%D0%BB%D0%B0%D0%B4%D0%B8%D0%BC%D0%B8%D1%80+%D0%92%D1%8B%D1%81%D0%BE%D1%86%D0%BA%D0%B8%D0%B9\/_\/%D0%A3%D1%82%D1%80%D0%B5%D0%BD%D0%BD%D1%8F%D1%8F+%D0%B3%D0%B8%D0%BC%D0%BD%D0%B0%D1%81%D1%82%D0%B8%D0%BA%D0%B0
      16-07-2013 18:14:56.156 - Get Last.FM URLs for a3cb23fc-acd3-4ce0-8f36-1e5aa6a18432 U2
      16-07-2013 18:14:56.485  Add: With or Without You|308301|98529|http:\/\/www.last.fm\/music\/U2\/_\/With+or+Without+You
      16-07-2013 18:14:56.485  Add: Beautiful Day|248223|87132|http:\/\/www.last.fm\/music\/U2\/_\/Beautiful+Day
      16-07-2013 18:14:56.485  Add: One|203360|72661|http:\/\/www.last.fm\/music\/U2\/_\/One
      16-07-2013 18:14:56.486 - Get Last.FM URLs for 83a554c5-4fd3-4ec8-9dd5-15989850ea17 Touch & Go
      16-07-2013 18:14:56.774  Add: Tango in Harlem|5603|1863|http:\/\/www.last.fm\/music\/Touch+and+Go\/_\/Tango+in+Harlem
      16-07-2013 18:14:56.775  Skip:Would You...?|3167|1127|http:\/\/www.last.fm\/music\/Touch+and+Go\/_\/Would+You...%3F
      16-07-2013 18:14:56.775  Skip:Straight To Number One|2290|808|http:\/\/www.last.fm\/music\/Touch+and+Go\/_\/Straight+To+Number+One
      16-07-2013 18:14:56.776 - Get Last.FM URLs for 65f4f0c5-ef9e-490c-aee3-909e7ae6b2ab Metallica
      16-07-2013 18:14:57.071  Add: Enter Sandman|358420|109379|http:\/\/www.last.fm\/music\/Metallica\/_\/Enter+Sandman
      16-07-2013 18:14:57.071  Add: Nothing Else Matters|361471|104735|http:\/\/www.last.fm\/music\/Metallica\/_\/Nothing+Else+Matters
      16-07-2013 18:14:57.072  Add: Master of Puppets|288807|89523|http:\/\/www.last.fm\/music\/Metallica\/_\/Master+of+Puppets
      16-07-2013 18:14:57.073 - Get Last.FM URLs for 614e3804-7d34-41ba-857f-811bad7c2b7a Dire Straits
      16-07-2013 18:14:57.325  Add: Sultans of Swing|311451|95618|http:\/\/www.last.fm\/music\/Dire+Straits\/_\/Sultans+of+Swing
      16-07-2013 18:14:57.325  Add: Money for Nothing|190023|66647|http:\/\/www.last.fm\/music\/Dire+Straits\/_\/Money+for+Nothing
      16-07-2013 18:14:57.326  Add: Walk of Life|169636|61452|http:\/\/www.last.fm\/music\/Dire+Straits\/_\/Walk+of+Life
      16-07-2013 18:14:57.327 - Get Last.FM URLs for Metallica & The San Francisco Symphony Orchestra
    E 16-07-2013 18:16:57.697 - HTTP Exception for 25 Metallica & The San Francisco Symphony Orchestra
    I 16-07-2013 18:16:57.706 Download complete. Missing: 0 Download: 0
     

    Users who are viewing this thread

    Top Bottom