home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
Development
Improvement Suggestions
Suggestion to use XBMC's XML scrapers for HTTP scraping
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Gamester17" data-source="post: 234804" data-attributes="member: 10298"><p>I would like to suggest that MediaPortal should start using XBMC's XML scrapers for HTTP media information scraping.</p><p></p><p>XBMC today has a very nice generic API for letting anyone create and/or maintain XML and Perl Compatible Regular Expression (PCRE RegExp) based parsing scrapers without prior programming knowledge, scrapers that scrape HTTP websites for metadata (sites such as IMDb.com, TheTVDB.com, TV.com, AllMusic.com, and many more), metadata for Movies, TV-Shows, Music-Videos, and Music, and XBMC scrapers parse that metadata before entering it into the database library. I think that it would be great if MediaPortal could integrate that same parser API so that it could use XBMC scraper XML files as is, and vice versa, so cross-compatible with both applications, (later even other open source media center, such as maybe MeediOS, will catch on so that they could all share this library/interface and use the same RegEx XML scraper files). </p><p></p><p>This scraper API should in theory only require that you first integrate basic XML parser and PCRE RegEx parser into MediaPortal (which I assume already exist and if so only a hook should be needed), and then you will have to convert XBMC's ScraperParser.cpp from C++ to C# code in order for MediaPortal to use it nativly.</p><p></p><p>You can download the XBMC source code from the SVN, instructions can be found here:</p><p><a href="http://sourceforge.net/projects/xbmc" target="_blank">http://sourceforge.net/projects/xbmc</a></p><p></p><p>The existing scapers can be found in the SVN under "/branches/linuxport/XBMC/system/scrapers/"</p><p>(Please note that IMDb.xml is the best scraper of these to use as a reference).</p><p>Find the C++ source code for XBMC parser in "/branches/linuxport/XBMC/xbmc/utils/ScraperParser.cpp"</p><p></p><p>If you do not have a SVN tool then download vi the web-interface here:</p><p><a href="http://xbmc.svn.sourceforge.net/viewvc/xbmc/trunk/XBMC/system/scrapers/video/" target="_blank">SourceForge.net XBMC SVN Repository - /trunk/XBMC/system/scrapers/video</a></p><p><a href="http://xbmc.svn.sourceforge.net/viewvc/xbmc/trunk/XBMC/system/scrapers/music/" target="_blank">SourceForge.net XBMC SVN Repository - /trunk/XBMC/system/scrapers/music</a></p><p></p><p><a href="http://xbmc.svn.sourceforge.net/viewvc/xbmc/trunk/XBMC/xbmc/utils/ScraperParser.cpp" target="_blank">SourceForge.net XBMC SVN Repository - /trunk/XBMC/xbmc/utils/ScraperParser.cpp</a></p><p></p><p>More about the scraper function can be found in the XBMC wiki:</p><p><a href="http://xbmc.org/wiki/?title=Category:Scraper" target="_blank">Category of wiki articles tagged as "Scraper" related</a></p><p><a href="http://xbmc.org/wiki/?title=Scraper" target="_blank">Scraper.xml structure</a></p><p><a href="http://xbmc.org/wiki/?title=How_To_Write_Media_Info_Scrapers" target="_blank">How To Write Media Info Scrapers for XBMC</a></p><p><a href="http://xbmc.org/wiki/?title=Scrap" target="_blank">Scrap (Scrap.exe for testing of scrapers under Windows)</a></p><p><a href="http://xbmc.org/wiki/?title=How_To_use_Scrapers" target="_blank">How To use Scrapers</a></p><p><a href="http://xbmc.org/wiki/?title=TV_Shows" target="_blank">TV Shows handling in XBMC</a></p><p><a href="http://xbmc.org/wiki/?title=Music_Videos" target="_blank">Music Videos handling in XBMC</a></p><p></p><p></p><p>What do you Team-MediaPortal developers think about this idea?</p><p></p><p>PS! For those unfamiliar with XBMC you will find good overview in the wikipedia article:</p><p><a href="http://en.wikipedia.org/wiki/XBMC" target="_blank">http://en.wikipedia.org/wiki/XBMC</a></p></blockquote><p></p>
[QUOTE="Gamester17, post: 234804, member: 10298"] I would like to suggest that MediaPortal should start using XBMC's XML scrapers for HTTP media information scraping. XBMC today has a very nice generic API for letting anyone create and/or maintain XML and Perl Compatible Regular Expression (PCRE RegExp) based parsing scrapers without prior programming knowledge, scrapers that scrape HTTP websites for metadata (sites such as IMDb.com, TheTVDB.com, TV.com, AllMusic.com, and many more), metadata for Movies, TV-Shows, Music-Videos, and Music, and XBMC scrapers parse that metadata before entering it into the database library. I think that it would be great if MediaPortal could integrate that same parser API so that it could use XBMC scraper XML files as is, and vice versa, so cross-compatible with both applications, (later even other open source media center, such as maybe MeediOS, will catch on so that they could all share this library/interface and use the same RegEx XML scraper files). This scraper API should in theory only require that you first integrate basic XML parser and PCRE RegEx parser into MediaPortal (which I assume already exist and if so only a hook should be needed), and then you will have to convert XBMC's ScraperParser.cpp from C++ to C# code in order for MediaPortal to use it nativly. You can download the XBMC source code from the SVN, instructions can be found here: [url]http://sourceforge.net/projects/xbmc[/url] The existing scapers can be found in the SVN under "/branches/linuxport/XBMC/system/scrapers/" (Please note that IMDb.xml is the best scraper of these to use as a reference). Find the C++ source code for XBMC parser in "/branches/linuxport/XBMC/xbmc/utils/ScraperParser.cpp" If you do not have a SVN tool then download vi the web-interface here: [url=http://xbmc.svn.sourceforge.net/viewvc/xbmc/trunk/XBMC/system/scrapers/video/]SourceForge.net XBMC SVN Repository - /trunk/XBMC/system/scrapers/video[/url] [url=http://xbmc.svn.sourceforge.net/viewvc/xbmc/trunk/XBMC/system/scrapers/music/]SourceForge.net XBMC SVN Repository - /trunk/XBMC/system/scrapers/music[/url] [url=http://xbmc.svn.sourceforge.net/viewvc/xbmc/trunk/XBMC/xbmc/utils/ScraperParser.cpp]SourceForge.net XBMC SVN Repository - /trunk/XBMC/xbmc/utils/ScraperParser.cpp[/url] More about the scraper function can be found in the XBMC wiki: [url=http://xbmc.org/wiki/?title=Category:Scraper]Category of wiki articles tagged as "Scraper" related[/url] [url=http://xbmc.org/wiki/?title=Scraper]Scraper.xml structure[/url] [url=http://xbmc.org/wiki/?title=How_To_Write_Media_Info_Scrapers]How To Write Media Info Scrapers for XBMC[/url] [url=http://xbmc.org/wiki/?title=Scrap]Scrap (Scrap.exe for testing of scrapers under Windows)[/url] [url=http://xbmc.org/wiki/?title=How_To_use_Scrapers]How To use Scrapers[/url] [url=http://xbmc.org/wiki/?title=TV_Shows]TV Shows handling in XBMC[/url] [url=http://xbmc.org/wiki/?title=Music_Videos]Music Videos handling in XBMC[/url] What do you Team-MediaPortal developers think about this idea? PS! For those unfamiliar with XBMC you will find good overview in the wikipedia article: [url]http://en.wikipedia.org/wiki/XBMC[/url] [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
Development
Improvement Suggestions
Suggestion to use XBMC's XML scrapers for HTTP scraping
Contact us
RSS
Top
Bottom