home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
Support
Electronic Program Guide
WebEPG
[UK] Sky Guide Grabber - Need help
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="yousufza" data-source="post: 834414" data-attributes="member: 118031"><p>Hi All,</p><p>I am new to this forum. I have been trying to get EPG data for some channels that are streamed live from the UK (I am in Canada). The data is only found on Sky Guide. So I have been trying to write a grabber for it but I am running into some problems. Again I am kind of new to this and would greatly appreciate any guidance. </p><p></p><p>Here is a link to the actual Sky Guide: <a href="http://tv.sky.com/tv-guide" target="_blank">Sky Guide TV Listings - Sky</a></p><p>Now you can't see the any epg data by looking at the page source this page. However, I happened to find it using another method.</p><p>Using URL Snooper, I found the url for individual channel data. For example here is the url for Discovery HD (520) for January 22, 2011 (My channels of interest is not Discovery HD, I am just using it as an example)</p><p></p><p>12am-6am <a href="http://tv.sky.com/programme/channel/4003/2012-01-22/0" target="_blank">http://tv.sky.com/programme/channel/4003/2012-01-22/0</a></p><p>6am-12pm <a href="http://tv.sky.com/programme/channel/4003/2012-01-22/1" target="_blank">http://tv.sky.com/programme/channel/4003/2012-01-22/1</a></p><p>12pm-6pm <a href="http://tv.sky.com/programme/channel/4003/2012-01-22/2" target="_blank">http://tv.sky.com/programme/channel/4003/2012-01-22/2</a></p><p>6pm-12am <a href="http://tv.sky.com/programme/channel/4003/2012-01-22/3" target="_blank">http://tv.sky.com/programme/channel/4003/2012-01-22/3</a></p><p></p><p>Here 4003 is the site id for Discovery HD and the 0-3 at the end are pages over which the data is spread out</p><p></p><p>The data for 12am-6am looks like this:</p><p>{"listings":{"4003":[{"d":"Kimberleys: Bear Grylls demonstrates how to survive the harsh Australian outback by showing where to find food, and avoid sunstroke and saltwater crocodiles.","m":[501,3600,3,0,"--"],"rr":"S","s":1327190400,"sid":41500,"t":"Bear Grylls: Born Survivor","url":"http://sky.tv/ps7q4s"},{"d":"President's Challenge: In this extra special episode, Adam and Jamie tackle a viewer request from the highest ranking viewer of all, the US President, Barack Obama.","m":[502,3600,3,1,"--"],"rr":"S","s":1327194000,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btj65x"},{"d":"Walking on Water: In this martial arts special, Jamie and Adam find out if Ninjas can run on water, as they join a Ninjitsu master and try their luck at aquatic agility.","m":[504,3600,3,1,"--"],"rr":"S","s":1327197600,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btjzxn"},{"d":"Adam and Jamie face off with a myth of misdirection and Kari, Grant and Tory go ballistic with two filmic firearms fables.","m":[507,3000,3,1,"--"],"rr":"S","s":1327201200,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btj663"},{"d":"Adam and Jamie test if they can walk on water, and Kari, Grant, and Tory test if common things can be bombproof.","m":[510,3000,3,1,"--"],"rr":"S","s":1327204200,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btjzys"},{"d":"Hindenburg Mystery: Adam and Jamie turn detective to solve one of aviation's biggest puzzles, while Kari and company come face-to-face with nature's natural-born killers.","m":[515,3000,3,0,"--"],"rr":"S","s":1327207200,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btj677"},{"d":"A military jet breaks apart and crashes, a man survives being run over by a tractor trailer, and the safety capsule flies open during a dragboat crash.","m":[518,1800,3,0,"--"],"rr":"S","s":1327210200,"sid":46290,"t":"Destroyed in Seconds","url":"http://sky.tv/btjzzx"},{"d":"Part 1: Explore Mexico's thriving cities and stunning beaches in this look at ancient and modern Mexican culture, from religious festivals to Independence Day celebrations.","m":[523,3600,3,1,"--"],"rr":"S","s":1327212000,"sid":37223,"t":"Discovery Atlas: Mexico Revealed","url":"http://sky.tv/btjz23"}]}}</p><p></p><p>It looks the format for the epg data is as follows</p><p>{"d":"Kimberleys: Bear Grylls demonstrates how to survive the harsh Australian outback by showing where to find food, and avoid sunstroke and saltwater crocodiles.","m":[501,3600,3,0,"--"],"rr":"S","s":1327190400,"sid":41500,"t":"Bear Grylls: Born Survivor","url":"http://sky.tv/ps7q4s"},</p><p></p><p>{"d":"#DESCRIPTION","m":[501,3600,3,0,"--"],"rr":"S","s":#START,"sid":41500,"t":"#TITLE","url":"http://sky.tv/ps7q4s"},</p><p></p><p>Questions:</p><p>1. The data for an each day is spread out over 4 webpages (each providing data for 6 hours). How can I indicate this in the grabber file to ensure that it checks all 4 of them for each day.</p><p></p><p>2. I believe the start time is provided in a unix timestamp. For example "1327190400" from the above indicates a start time of Sunday 22nd January 2012 12:00:00 AM. How do I indicate this in grabber file to so that it converts it to the regular XMLTV start time when it grabs. </p><p></p><p>Below is the grabber file I put together using some of the examples and the wiki. I have attached it as well: </p><p></p><p><?xml version="1.0" encoding="utf-8"?></p><p><Grabber></p><p> <Info availableDays="0" timezone="GMT Standard Time" version="2.1.0" /></p><p> <Channels></p><p> <Channel id="Discovery HD" siteId="" /></p><p> </Channels></p><p> <Listing type="Data"></p><p> <Site url="http://tv.sky.com/programme/channel/4003/[YYYY]-[MM]-[DD]/[LIST_OFFSET]" post="" external="false" encoding="" /></p><p> <Data rowDelimitor="</p><p>" dataDelimitor="~">{"d":"#DESCRIPTION.","m":[499,1800,1,0,"--"],"rr":"R","s":#START,"t":"#TITLE","url":"http://sky.tv/mvwwc7"}</p><p></Data></p><p> </Listing></p><p></Grabber></p><p></p><p>Again I am totally new so my grabber file might be way off. I would really appreciate anyone's help. </p><p></p><p><img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite8" alt=":D" title="Big Grin :D" loading="lazy" data-shortname=":D" /></p></blockquote><p></p>
[QUOTE="yousufza, post: 834414, member: 118031"] Hi All, I am new to this forum. I have been trying to get EPG data for some channels that are streamed live from the UK (I am in Canada). The data is only found on Sky Guide. So I have been trying to write a grabber for it but I am running into some problems. Again I am kind of new to this and would greatly appreciate any guidance. Here is a link to the actual Sky Guide: [url=http://tv.sky.com/tv-guide]Sky Guide TV Listings - Sky[/url] Now you can't see the any epg data by looking at the page source this page. However, I happened to find it using another method. Using URL Snooper, I found the url for individual channel data. For example here is the url for Discovery HD (520) for January 22, 2011 (My channels of interest is not Discovery HD, I am just using it as an example) 12am-6am [url]http://tv.sky.com/programme/channel/4003/2012-01-22/0[/url] 6am-12pm [url]http://tv.sky.com/programme/channel/4003/2012-01-22/1[/url] 12pm-6pm [url]http://tv.sky.com/programme/channel/4003/2012-01-22/2[/url] 6pm-12am [url]http://tv.sky.com/programme/channel/4003/2012-01-22/3[/url] Here 4003 is the site id for Discovery HD and the 0-3 at the end are pages over which the data is spread out The data for 12am-6am looks like this: {"listings":{"4003":[{"d":"Kimberleys: Bear Grylls demonstrates how to survive the harsh Australian outback by showing where to find food, and avoid sunstroke and saltwater crocodiles.","m":[501,3600,3,0,"--"],"rr":"S","s":1327190400,"sid":41500,"t":"Bear Grylls: Born Survivor","url":"http://sky.tv/ps7q4s"},{"d":"President's Challenge: In this extra special episode, Adam and Jamie tackle a viewer request from the highest ranking viewer of all, the US President, Barack Obama.","m":[502,3600,3,1,"--"],"rr":"S","s":1327194000,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btj65x"},{"d":"Walking on Water: In this martial arts special, Jamie and Adam find out if Ninjas can run on water, as they join a Ninjitsu master and try their luck at aquatic agility.","m":[504,3600,3,1,"--"],"rr":"S","s":1327197600,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btjzxn"},{"d":"Adam and Jamie face off with a myth of misdirection and Kari, Grant and Tory go ballistic with two filmic firearms fables.","m":[507,3000,3,1,"--"],"rr":"S","s":1327201200,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btj663"},{"d":"Adam and Jamie test if they can walk on water, and Kari, Grant, and Tory test if common things can be bombproof.","m":[510,3000,3,1,"--"],"rr":"S","s":1327204200,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btjzys"},{"d":"Hindenburg Mystery: Adam and Jamie turn detective to solve one of aviation's biggest puzzles, while Kari and company come face-to-face with nature's natural-born killers.","m":[515,3000,3,0,"--"],"rr":"S","s":1327207200,"sid":58968,"t":"Mythbusters","url":"http://sky.tv/btj677"},{"d":"A military jet breaks apart and crashes, a man survives being run over by a tractor trailer, and the safety capsule flies open during a dragboat crash.","m":[518,1800,3,0,"--"],"rr":"S","s":1327210200,"sid":46290,"t":"Destroyed in Seconds","url":"http://sky.tv/btjzzx"},{"d":"Part 1: Explore Mexico's thriving cities and stunning beaches in this look at ancient and modern Mexican culture, from religious festivals to Independence Day celebrations.","m":[523,3600,3,1,"--"],"rr":"S","s":1327212000,"sid":37223,"t":"Discovery Atlas: Mexico Revealed","url":"http://sky.tv/btjz23"}]}} It looks the format for the epg data is as follows {"d":"Kimberleys: Bear Grylls demonstrates how to survive the harsh Australian outback by showing where to find food, and avoid sunstroke and saltwater crocodiles.","m":[501,3600,3,0,"--"],"rr":"S","s":1327190400,"sid":41500,"t":"Bear Grylls: Born Survivor","url":"http://sky.tv/ps7q4s"}, {"d":"#DESCRIPTION","m":[501,3600,3,0,"--"],"rr":"S","s":#START,"sid":41500,"t":"#TITLE","url":"http://sky.tv/ps7q4s"}, Questions: 1. The data for an each day is spread out over 4 webpages (each providing data for 6 hours). How can I indicate this in the grabber file to ensure that it checks all 4 of them for each day. 2. I believe the start time is provided in a unix timestamp. For example "1327190400" from the above indicates a start time of Sunday 22nd January 2012 12:00:00 AM. How do I indicate this in grabber file to so that it converts it to the regular XMLTV start time when it grabs. Below is the grabber file I put together using some of the examples and the wiki. I have attached it as well: <?xml version="1.0" encoding="utf-8"?> <Grabber> <Info availableDays="0" timezone="GMT Standard Time" version="2.1.0" /> <Channels> <Channel id="Discovery HD" siteId="" /> </Channels> <Listing type="Data"> <Site url="http://tv.sky.com/programme/channel/4003/[YYYY]-[MM]-[DD]/[LIST_OFFSET]" post="" external="false" encoding="" /> <Data rowDelimitor=" " dataDelimitor="~">{"d":"#DESCRIPTION.","m":[499,1800,1,0,"--"],"rr":"R","s":#START,"t":"#TITLE","url":"http://sky.tv/mvwwc7"} </Data> </Listing> </Grabber> Again I am totally new so my grabber file might be way off. I would really appreciate anyone's help. :thx: [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
Support
Electronic Program Guide
WebEPG
[UK] Sky Guide Grabber - Need help
Contact us
RSS
Top
Bottom
