home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
Support
Electronic Program Guide
WebEPG
ziggo.nl grabber - running into webepg limitations
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="benjerry" data-source="post: 627031" data-attributes="member: 57133"><p>Hi,</p><p></p><p>I'm busy with developing grabbers for the Netherlands at moment. I'm preparing a tvgids.upc.nl grabber(147 channels) and an updated <a href="http://www.tvgids.nl" target="_blank">TVGids.nl</a> grabber(104 channels).</p><p></p><p>I also would like to add a grabber for another big dutch cable company: <a href="http://www.ziggo.nl" target="_blank">www.ziggo.nl</a></p><p></p><p>I've done research for their online tvguide (<a href="https://www.ziggo.nl/spotlight/programmagids" target="_blank">https://www.ziggo.nl/spotlight/programmagids</a>) and by using a packet sniffer I've managed to get the hidden structure.</p><p></p><p>It's like follows:</p><p></p><p><Site url="https://www.ziggo.nl/proxy?pipe=programmagids&url=%2Fprogrammagids%2F[YYYY]-[MM]-[DD]T[HOUR]00%3Ftip%3Dtrue%26favoriteProgram%3D%26favoriteGenre%3D%26channelId%3D[ID]&" post="" external="false" encoding="" /></p><p></p><p>start="<ol class="programs">" end="</ol>" tags="ALS"</p><p></p><p>template:</p><p><li class="program" style="left: <#SPIX>px; width: <#EPIX>px;" title="<#PTITLE>" zp-program="<#LINKCODE>"></p><p><a></p><p><span><#START></span></p><p><span><#TITLE></span></p><p></a></p><p></li></p><p></p><p><Sublink url="https://www.ziggo.nl/proxy?pipe=programmagids&url=%2Fprogrammagids%2FprogrammaPopup%2F[LINKCODE]&" post="" external="false" encoding="" /></p><p></p><p>However, I have 2 problems with this structure.</p><p></p><p>1) [HOUR] - does not exists in WebEPG. The site url gives program information for 4 hours only. So for 1 day it needs to be grabed 6 times with some counter: 00, 04, 08, 12, 16, 20</p><p></p><p>2) Sublink url - it's not possible to generate a sublink url using tags/fields from program info.</p><p></p><p>gr,</p><p>Gijs</p><p></p><p></p><p>edit: test run without hour/sublink</p><p></p><p>[CODE]2010-06-09 19:44:46.004648 [WebEPGImporter(7)]: WebEPG: Getting Channel ID: ned3.nl</p><p>2010-06-09 19:44:46.005648 [WebEPGImporter(7)]: [1 of 36]</p><p>2010-06-09 19:44:46.007648 [WebEPGImporter(7)]: WebEPG: Opening NL\4-www_ziggo_nl.xml</p><p>2010-06-09 19:44:46.008648 [WebEPGImporter(7)]: WebEPG: Version: 2.0</p><p>2010-06-09 19:44:46.009648 [WebEPGImporter(7)]: WebEPG: TimeZone, Local: W. Europe Standard Time</p><p>2010-06-09 19:44:46.009648 [WebEPGImporter(7)]: WebEPG: TimeZone, Site : W. Europe Standard Time</p><p>2010-06-09 19:44:46.036650 [WebEPGImporter(7)]: WebEPG: ChannelId: ned3.nl</p><p>2010-06-09 19:44:46.039650 [WebEPGImporter(7)]: WebEPG: Grab Start 7:44 PM 6/9/2010</p><p>2010-06-09 19:44:46.248662 [WebEPGImporter(7)]: WebEPG: Reading https://www.ziggo.nl/proxy?pipe=programmagids&url=%2Fprogrammagids%2F2010-06-09T1200%3Ftip%3Dtrue%26favoriteProgram%3D%26favoriteGenre%3D%26channelId%3D8003& POST: </p><p>2010-06-09 19:44:47.534736 [WebEPGImporter(7)]: HTMLPage: GetInternal encoding: </p><p>2010-06-09 19:44:47.535736 [WebEPGImporter(7)]: WebEPG: Listing Count 14</p><p>2010-06-09 19:44:47.551737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609115000 - De drukke wereld van Richard Scarry (VPRO)</p><p>2010-06-09 19:44:47.552737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.552737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609121000 - Olivia (VPRO)</p><p>2010-06-09 19:44:47.553737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.553737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609122000 - Angelina Ballerina (EO)</p><p>2010-06-09 19:44:47.554737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.555737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609123000 - De wereld van K3 (TROS)</p><p>2010-06-09 19:44:47.555737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.556737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609130000 - De wereld van K3 (TROS)</p><p>2010-06-09 19:44:47.556737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.557737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609132500 - Mijn liefste vriendjes Teigetje en Poeh</p><p>2010-06-09 19:44:47.558737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.560737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609135000 - Het lelijke eendje en ik (KRO)</p><p>2010-06-09 19:44:47.560737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.561737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609141500 - De Smurfen (VARA)</p><p>2010-06-09 19:44:47.562737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.562737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609142500 - De Smurfen (VARA)</p><p>2010-06-09 19:44:47.563737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.563737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609143900 - Z@pp</p><p>2010-06-09 19:44:47.564737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.565737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609144000 - Bernard (KRO)</p><p>2010-06-09 19:44:47.565737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.566737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609144500 - De 3 vrienden en Jerry (NCRV)</p><p>2010-06-09 19:44:47.566737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.567737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609151000 - NOS Jeugdjournaal Verkiezingsuitzending</p><p>2010-06-09 19:44:47.567737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.568737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609160500 - De BZT show (NCRV)</p><p>2010-06-09 19:44:47.569738 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it.</p><p>2010-06-09 19:44:47.569738 [WebEPGImporter(7)]: WebEPG: Program Count (0), Listing Count (14), Discard Count (14)[/CODE]</p></blockquote><p></p>
[QUOTE="benjerry, post: 627031, member: 57133"] Hi, I'm busy with developing grabbers for the Netherlands at moment. I'm preparing a tvgids.upc.nl grabber(147 channels) and an updated [url=http://www.tvgids.nl]TVGids.nl[/url] grabber(104 channels). I also would like to add a grabber for another big dutch cable company: [url]www.ziggo.nl[/url] I've done research for their online tvguide ([url]https://www.ziggo.nl/spotlight/programmagids[/url]) and by using a packet sniffer I've managed to get the hidden structure. It's like follows: <Site url="https://www.ziggo.nl/proxy?pipe=programmagids&url=%2Fprogrammagids%2F[YYYY]-[MM]-[DD]T[HOUR]00%3Ftip%3Dtrue%26favoriteProgram%3D%26favoriteGenre%3D%26channelId%3D[ID]&" post="" external="false" encoding="" /> start="<ol class="programs">" end="</ol>" tags="ALS" template: <li class="program" style="left: <#SPIX>px; width: <#EPIX>px;" title="<#PTITLE>" zp-program="<#LINKCODE>"> <a> <span><#START></span> <span><#TITLE></span> </a> </li> <Sublink url="https://www.ziggo.nl/proxy?pipe=programmagids&url=%2Fprogrammagids%2FprogrammaPopup%2F[LINKCODE]&" post="" external="false" encoding="" /> However, I have 2 problems with this structure. 1) [HOUR] - does not exists in WebEPG. The site url gives program information for 4 hours only. So for 1 day it needs to be grabed 6 times with some counter: 00, 04, 08, 12, 16, 20 2) Sublink url - it's not possible to generate a sublink url using tags/fields from program info. gr, Gijs edit: test run without hour/sublink [CODE]2010-06-09 19:44:46.004648 [WebEPGImporter(7)]: WebEPG: Getting Channel ID: ned3.nl 2010-06-09 19:44:46.005648 [WebEPGImporter(7)]: [1 of 36] 2010-06-09 19:44:46.007648 [WebEPGImporter(7)]: WebEPG: Opening NL\4-www_ziggo_nl.xml 2010-06-09 19:44:46.008648 [WebEPGImporter(7)]: WebEPG: Version: 2.0 2010-06-09 19:44:46.009648 [WebEPGImporter(7)]: WebEPG: TimeZone, Local: W. Europe Standard Time 2010-06-09 19:44:46.009648 [WebEPGImporter(7)]: WebEPG: TimeZone, Site : W. Europe Standard Time 2010-06-09 19:44:46.036650 [WebEPGImporter(7)]: WebEPG: ChannelId: ned3.nl 2010-06-09 19:44:46.039650 [WebEPGImporter(7)]: WebEPG: Grab Start 7:44 PM 6/9/2010 2010-06-09 19:44:46.248662 [WebEPGImporter(7)]: WebEPG: Reading https://www.ziggo.nl/proxy?pipe=programmagids&url=%2Fprogrammagids%2F2010-06-09T1200%3Ftip%3Dtrue%26favoriteProgram%3D%26favoriteGenre%3D%26channelId%3D8003& POST: 2010-06-09 19:44:47.534736 [WebEPGImporter(7)]: HTMLPage: GetInternal encoding: 2010-06-09 19:44:47.535736 [WebEPGImporter(7)]: WebEPG: Listing Count 14 2010-06-09 19:44:47.551737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609115000 - De drukke wereld van Richard Scarry (VPRO) 2010-06-09 19:44:47.552737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.552737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609121000 - Olivia (VPRO) 2010-06-09 19:44:47.553737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.553737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609122000 - Angelina Ballerina (EO) 2010-06-09 19:44:47.554737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.555737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609123000 - De wereld van K3 (TROS) 2010-06-09 19:44:47.555737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.556737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609130000 - De wereld van K3 (TROS) 2010-06-09 19:44:47.556737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.557737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609132500 - Mijn liefste vriendjes Teigetje en Poeh 2010-06-09 19:44:47.558737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.560737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609135000 - Het lelijke eendje en ik (KRO) 2010-06-09 19:44:47.560737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.561737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609141500 - De Smurfen (VARA) 2010-06-09 19:44:47.562737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.562737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609142500 - De Smurfen (VARA) 2010-06-09 19:44:47.563737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.563737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609143900 - Z@pp 2010-06-09 19:44:47.564737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.565737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609144000 - Bernard (KRO) 2010-06-09 19:44:47.565737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.566737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609144500 - De 3 vrienden en Jerry (NCRV) 2010-06-09 19:44:47.566737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.567737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609151000 - NOS Jeugdjournaal Verkiezingsuitzending 2010-06-09 19:44:47.567737 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.568737 [WebEPGImporter(7)]: WebEPG: Guide, Program Info: 20100609160500 - De BZT show (NCRV) 2010-06-09 19:44:47.569738 [WebEPGImporter(7)]: WebEPG: Program starts in the past, ignoring it. 2010-06-09 19:44:47.569738 [WebEPGImporter(7)]: WebEPG: Program Count (0), Listing Count (14), Discard Count (14)[/CODE] [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
Support
Electronic Program Guide
WebEPG
ziggo.nl grabber - running into webepg limitations
Contact us
RSS
Top
Bottom