home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
Support
Electronic Program Guide
WebEPG
WebEPG trouble creating grabber for US radio stations
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="benicehavefun" data-source="post: 1222577" data-attributes="member: 149859"><p>I'm attempting to create a WebEPG grabber for US radio stations using DAR.fm as a source. I don't appear to be getting any errors during the grabbing process, but no programs are found for my test station. I suspect the problem is with my template -- but trial and error isn't getting me anywhere, so I'm hoping for some input from someone whose been down this road creating a new grabber.</p><p></p><p>Here's my US\www_dar_fm_com.xml file:</p><p></p><p>[CODE=XML]<?xml version="1.0" encoding="utf-8"?></p><p><Grabber></p><p> <Info language="en" availableDays="7" timezone="Pacific Standard Time" version="2.0" /></p><p> <Channels></p><p> <Channel id="KNOW-FM" siteId="3740" /></p><p> </Channels></p><p> <Listing type="Html"></p><p> <Site url="http://www.dar.fm/user_search.php?search_type=stations&amp;station_id=[ID]&amp;list_type=station_detail" post="" external="false" encoding="" /></p><p> <Html></p><p> <Template name="default" start="&apos;s Schedule" end="Schedule a recording"></p><p> <SectionTemplate tags="TIA"></p><p> <TemplateText> &lt;tr&gt;&lt;td&gt;&lt;img&gt;&lt;/td&gt;&lt;td&gt;&lt;a&gt;&lt;img&gt;&lt;/a&gt;&lt;span&gt;&lt;a&gt;#TITLE&lt;/a&gt;&lt;/span&gt;&lt;/td&gt;&lt;td&gt;#TIME&lt;/td&gt;&lt;/tr&gt;</p><p> </TemplateText></p><p> </SectionTemplate></p><p> </Template></p><p> </Html></p><p> </Listing></p><p></Grabber></p><p>[/CODE]</p><p></p><p>Here's a section of HTML source from DAR.fm that contains the program data I'm trying to extract:</p><p></p><p>[code=CSS]<tr></p><p> <td width="10%" style="text-align:center;"></p><p> <img src='http://s.mp3tunes.com/images/l/p129.gif' style='min-height:30px;max-height:70px;max-width:70px;margin:0 auto;'/> </td><td width="60%"></p><p> <a href="#" title="Record The World Today" class="new_user_talk" format_id="101" showinfo_id="6428" show_title="The World Today" station_id="3740" start_time="2017-05-22 23:00:00"><img src="images/record.png" alt="" width="44" height="22" border="0" class="record" /></a><span></p><p> <a href="#" title="Details" search_t="The World Today" showinfo_id="6428" class="get_details nodec"></p><p> The World Today </a> </span></p><p> </td></p><p> <td width='20%'>11:00pm Pacific</td></p><p><td width='10%'>60 min</td></p><p></p><p></p><p> </tr>[/code]</p><p></p><p>I'm attempting to extract "The World Today" and "11:00pm" from the above snippet.</p><p></p><p>Here's the relevant section of my SetupTV.log file:</p><p></p><p>[code][2017-05-22 13:44:09,906] [Log ] [SetupTv ] [INFO ] - WebEPG Config: Loading Channels</p><p>[2017-05-22 13:44:09,909] [Log ] [SetupTv ] [INFO ] - WebEPG Config: Loading Existing channels.xml</p><p>[2017-05-22 13:44:10,781] [Log ] [SetupTv ] [INFO ] - WebEPG Config: Loading Grabbers</p><p>[2017-05-22 13:44:10,927] [Log ] [SetupTv ] [INFO ] - WebEPG Config: Loading Existing WebEPG.xml</p><p>[2017-05-22 13:44:29,686] [Log ] [WebEPGImporter] [INFO ] - plugin:webepg importing</p><p>[2017-05-22 13:44:29,689] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Using directory C:\ProgramData\Team MediaPortal\MediaPortal TV Server</p><p>[2017-05-22 13:44:29,693] [Log ] [WebEPGImporter] [INFO ] - Writing to tvguide.xml in C:\ProgramData\Team MediaPortal\MediaPortal TV Server\WebEPG</p><p>[2017-05-22 13:44:29,697] [Log ] [WebEPGImporter] [INFO ] - Assembly versions:</p><p>[2017-05-22 13:44:29,701] [Log ] [WebEPGImporter] [INFO ] - WebEPG 1.15.0.0</p><p>[2017-05-22 13:44:29,704] [Log ] [WebEPGImporter] [INFO ] - TvLibrary.Interfaces 1.15.0.0</p><p>[2017-05-22 13:44:29,734] [Log ] [WebEPGImporter] [INFO ] - Loading Config File: C:\ProgramData\Team MediaPortal\MediaPortal TV Server\WebEPG\WebEPG.xml</p><p>[2017-05-22 13:44:29,739] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Loading Channel Config</p><p>[2017-05-22 13:44:29,747] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Getting Channel ID: KNOW-FM</p><p>[2017-05-22 13:44:29,751] [Log ] [WebEPGImporter] [INFO ] - [1 of 1]</p><p>[2017-05-22 13:44:29,756] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Opening US\www_dar_fm_com.xml</p><p>[2017-05-22 13:44:29,760] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Version: 2.0</p><p>[2017-05-22 13:44:29,763] [Log ] [WebEPGImporter] [INFO ] - WebEPG: TimeZone, Local: Central Standard Time</p><p>[2017-05-22 13:44:29,767] [Log ] [WebEPGImporter] [INFO ] - WebEPG: TimeZone, Site : Pacific Standard Time</p><p>[2017-05-22 13:44:29,790] [Log ] [WebEPGImporter] [INFO ] - WebEPG: ChannelId: KNOW-FM</p><p>[2017-05-22 13:44:30,064] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Reading http://www.dar.fm/user_search.php?search_type=stations&station_id=3740&list_type=station_detail POST: - Delay: 500ms</p><p>[2017-05-22 13:45:11,575] [Log ] [WebEPGImporter] [INFO ] - WebEPG: No Listings Found</p><p>[2017-05-22 13:45:11,579] [Log ] [WebEPGImporter] [ERROR] - WebEPG: ChannelId: KNOW-FM grabber error - stopping</p><p>[2017-05-22 13:45:11,599] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Writing Channel: KNOW-FM</p><p>[2017-05-22 13:45:11,611] [Log ] [WebEPGImporter] [INFO ] - HTTP Statistics: Site www.dar.fm : Pages 1 : Bytes 2392391 : Total Time 00:00:41.4713721 : Av. Rate 57.68777 KBps</p><p>[2017-05-22 13:45:11,620] [Log ] [WebEPGImporter] [INFO ] - plugin:webepg import done</p><p>[/code]</p><p></p><p>As you can see in the log there's one line that says "grabber error - stopping", but that's after "No Listings Found". It appears to be scrapping the page based on the "HTTP Statistics".</p><p></p><p>Any input would be appreciated!</p><p></p><p>Scott</p></blockquote><p></p>
[QUOTE="benicehavefun, post: 1222577, member: 149859"] I'm attempting to create a WebEPG grabber for US radio stations using DAR.fm as a source. I don't appear to be getting any errors during the grabbing process, but no programs are found for my test station. I suspect the problem is with my template -- but trial and error isn't getting me anywhere, so I'm hoping for some input from someone whose been down this road creating a new grabber. Here's my US\www_dar_fm_com.xml file: [CODE=XML]<?xml version="1.0" encoding="utf-8"?> <Grabber> <Info language="en" availableDays="7" timezone="Pacific Standard Time" version="2.0" /> <Channels> <Channel id="KNOW-FM" siteId="3740" /> </Channels> <Listing type="Html"> <Site url="http://www.dar.fm/user_search.php?search_type=stations&station_id=[ID]&list_type=station_detail" post="" external="false" encoding="" /> <Html> <Template name="default" start="'s Schedule" end="Schedule a recording"> <SectionTemplate tags="TIA"> <TemplateText> <tr><td><img></td><td><a><img></a><span><a>#TITLE</a></span></td><td>#TIME</td></tr> </TemplateText> </SectionTemplate> </Template> </Html> </Listing> </Grabber> [/CODE] Here's a section of HTML source from DAR.fm that contains the program data I'm trying to extract: [code=CSS]<tr> <td width="10%" style="text-align:center;"> <img src='http://s.mp3tunes.com/images/l/p129.gif' style='min-height:30px;max-height:70px;max-width:70px;margin:0 auto;'/> </td><td width="60%"> <a href="#" title="Record The World Today" class="new_user_talk" format_id="101" showinfo_id="6428" show_title="The World Today" station_id="3740" start_time="2017-05-22 23:00:00"><img src="images/record.png" alt="" width="44" height="22" border="0" class="record" /></a><span> <a href="#" title="Details" search_t="The World Today" showinfo_id="6428" class="get_details nodec"> The World Today </a> </span> </td> <td width='20%'>11:00pm Pacific</td> <td width='10%'>60 min</td> </tr>[/code] I'm attempting to extract "The World Today" and "11:00pm" from the above snippet. Here's the relevant section of my SetupTV.log file: [code][2017-05-22 13:44:09,906] [Log ] [SetupTv ] [INFO ] - WebEPG Config: Loading Channels [2017-05-22 13:44:09,909] [Log ] [SetupTv ] [INFO ] - WebEPG Config: Loading Existing channels.xml [2017-05-22 13:44:10,781] [Log ] [SetupTv ] [INFO ] - WebEPG Config: Loading Grabbers [2017-05-22 13:44:10,927] [Log ] [SetupTv ] [INFO ] - WebEPG Config: Loading Existing WebEPG.xml [2017-05-22 13:44:29,686] [Log ] [WebEPGImporter] [INFO ] - plugin:webepg importing [2017-05-22 13:44:29,689] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Using directory C:\ProgramData\Team MediaPortal\MediaPortal TV Server [2017-05-22 13:44:29,693] [Log ] [WebEPGImporter] [INFO ] - Writing to tvguide.xml in C:\ProgramData\Team MediaPortal\MediaPortal TV Server\WebEPG [2017-05-22 13:44:29,697] [Log ] [WebEPGImporter] [INFO ] - Assembly versions: [2017-05-22 13:44:29,701] [Log ] [WebEPGImporter] [INFO ] - WebEPG 1.15.0.0 [2017-05-22 13:44:29,704] [Log ] [WebEPGImporter] [INFO ] - TvLibrary.Interfaces 1.15.0.0 [2017-05-22 13:44:29,734] [Log ] [WebEPGImporter] [INFO ] - Loading Config File: C:\ProgramData\Team MediaPortal\MediaPortal TV Server\WebEPG\WebEPG.xml [2017-05-22 13:44:29,739] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Loading Channel Config [2017-05-22 13:44:29,747] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Getting Channel ID: KNOW-FM [2017-05-22 13:44:29,751] [Log ] [WebEPGImporter] [INFO ] - [1 of 1] [2017-05-22 13:44:29,756] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Opening US\www_dar_fm_com.xml [2017-05-22 13:44:29,760] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Version: 2.0 [2017-05-22 13:44:29,763] [Log ] [WebEPGImporter] [INFO ] - WebEPG: TimeZone, Local: Central Standard Time [2017-05-22 13:44:29,767] [Log ] [WebEPGImporter] [INFO ] - WebEPG: TimeZone, Site : Pacific Standard Time [2017-05-22 13:44:29,790] [Log ] [WebEPGImporter] [INFO ] - WebEPG: ChannelId: KNOW-FM [2017-05-22 13:44:30,064] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Reading http://www.dar.fm/user_search.php?search_type=stations&station_id=3740&list_type=station_detail POST: - Delay: 500ms [2017-05-22 13:45:11,575] [Log ] [WebEPGImporter] [INFO ] - WebEPG: No Listings Found [2017-05-22 13:45:11,579] [Log ] [WebEPGImporter] [ERROR] - WebEPG: ChannelId: KNOW-FM grabber error - stopping [2017-05-22 13:45:11,599] [Log ] [WebEPGImporter] [INFO ] - WebEPG: Writing Channel: KNOW-FM [2017-05-22 13:45:11,611] [Log ] [WebEPGImporter] [INFO ] - HTTP Statistics: Site www.dar.fm : Pages 1 : Bytes 2392391 : Total Time 00:00:41.4713721 : Av. Rate 57.68777 KBps [2017-05-22 13:45:11,620] [Log ] [WebEPGImporter] [INFO ] - plugin:webepg import done [/code] As you can see in the log there's one line that says "grabber error - stopping", but that's after "No Listings Found". It appears to be scrapping the page based on the "HTTP Statistics". Any input would be appreciated! Scott [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
Support
Electronic Program Guide
WebEPG
WebEPG trouble creating grabber for US radio stations
Contact us
RSS
Top
Bottom