Updated grabber for dagenstv.com in Sweden - Page 3

ronilse · 2008-02-13, 14:14

Hi,
Seems like your selected grabber site has change layout & xtras again, please test this one www_dagenstv_com.

Regards
Roy

Zulan · 2008-02-13, 14:36

My Norwegian friend! You are absolutely right. You fixed it! Thanks alot! :-)

DalaNorth · 2008-02-25, 09:46

Yes, thank you Roy!

There are still some imperfections though, some of the descriptions are HTML codes and even some of the titles are messed up (Top Model on TV3 is the most obvious example, it always says "Top Mo" followed by some HTML code. )

Has DagensTV made their site to complex for our parser?

Regards
DalaNorth

Zulan · 2008-02-25, 13:43

Yes, I can agree that I also have alot of html tags and stuff in the info about the programs.

vuego · 2008-02-25, 17:26

There hasn't been any changes to dagenstv.com but the template was poorly written.

The Top Model error is due to the episode replacement. The grabber is configured to remove any occurrences of "del [#number]" and put it in an episode-num tag, i.e. "del 9" becomes <episode-num>9</episode-num>. The problem is that this is done not only for the Description tag but also Title, including Top Model 9

I've modified the grabber template and made the episode search to leave "del [#number]" in the field. It won't hurt having this information visible as well. I also added a search for "Avsnitt [#number]" which seems to be much more common now.

dazpp · 2008-05-04, 23:51

Quote:

Originally Posted by vuego

There hasn't been any changes to dagenstv.com but the template was poorly written.

The Top Model error is due to the episode replacement. The grabber is configured to remove any occurrences of "del [#number]" and put it in an episode-num tag, i.e. "del 9" becomes <episode-num>9</episode-num>. The problem is that this is done not only for the Description tag but also Title, including Top Model 9

I've modified the grabber template and made the episode search to leave "del [#number]" in the field. It won't hurt having this information visible as well. I also added a search for "Avsnitt [#number]" which seems to be much more common now.

This file seems to be working and gets the info for movies that didn't work before.

Although there is still a problem with getting info from about 2-3am until 6-7am.. There is only "No data available"
It has been since I started using mediaportal 6 months or so ago.
Is this something that can be fixed?

vuego · 2008-05-05, 16:48

If you start grabbing after 00:00 you'll get only "todays" listings which at Dagenstv.com starts at 06:00

If you grabbed more than one day you'll get listings for 00-06am all other days though.

dazpp · 2008-05-05, 17:32

Quote:

Originally Posted by vuego

If you start grabbing after 00:00 you'll get only "todays" listings which at Dagenstv.com starts at 06:00

If you grabbed more than one day you'll get listings for 00-06am all other days though.

Ah. that explains it. I grab ar 03:00 as the load on the server is low and I don't do any harm on it.. Maybe I should grab earlier

entrecour · 2008-05-26, 08:45

A couple of queustions the folks on this thread may be able to help me with ...

1) How easy is it to create these grabbers? - I am missing a few channels from the existing SE grabbers (e.g. Canal Digital sat channels such as History HD, Silver HD) so I was thinking of creating one myself however I have no experience of html code. Would you say that this is only a task for html experts or could I hack an exiisting grabber using common sense?

2) Can any tv page be used for a grabber to scrape the relevant data? I was considering using canaldigital.se as they have a comprehensive tvguide for all their channels. I am not sure if the way the data is presented here is something the grabber could use or access.

I'd appreciate any advice here.

petsa · 2008-05-26, 20:11

Hi entrecour,

1. If you only want to add a channel to an existing grabber it should be easy. You only need to add some stuff at the top where it locates the right page. If you are about to writer a granner from scratch there will be more work needed. It depends on the complexity of the web page you are trying to access etc.

2. In principle any web page can be used as the source for a grabber. In the grabber you search for specific patterns and extract data from the HTML-code based on the template = grabber. Again depending on the complexity of the page it can take more or less time to write such grabber. Another thing to keep in mind is how often the layout of the page will change. If the layout changes frequently you may end up having to fix your grabber ever so often. Using a "standard" grabber that more people use makes more poeple involved in fixing it...

/Peter

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Another updated Telvis grabber (Finland)	pmcguire	WebEPG	1	2007-11-04 06:39
Spanish TDT grabber updated.	pegial	WebEPG	1	2007-10-17 07:56
Updated Grabber for tvtoday.de	milagroso	WebEPG	1	2007-08-02 20:05
Updated grabber for tvtoday.de	Hawkeye	WebEPG	1	2007-05-15 16:53
I have updated the grabber for TVCABO (Portugal)	cleao	WebEPG	7	2007-05-04 10:56

2008-02-13, 14:14	#21 (permalink)
ronilse Portal Tester Join Date: Jul 2005 Posts: 3,126 Thanks: 18 Thanked 84 Times in 70 Posts Country: My System	Hi, Seems like your selected grabber site has change layout & xtras again, please test this one www_dagenstv_com. Regards Roy

2008-02-13, 14:36	#22 (permalink)
Zulan Portal Member Join Date: Jan 2008 Posts: 12 Thanks: 1 Thanked 0 Times in 0 Posts Country:	My Norwegian friend! You are absolutely right. You fixed it! Thanks alot! :-)

2008-02-25, 09:46	#23 (permalink)
DalaNorth Retired Team Member Join Date: Dec 2006 Location: Skellefteå, Sweden Age: 31 Posts: 140 Thanks: 0 Thanked 0 Times in 0 Posts Country: My System	Yes, thank you Roy! There are still some imperfections though, some of the descriptions are HTML codes and even some of the titles are messed up (Top Model on TV3 is the most obvious example, it always says "Top Mo" followed by some HTML code. ) Has DagensTV made their site to complex for our parser? Regards DalaNorth

2008-02-25, 13:43	#24 (permalink)
Zulan Portal Member Join Date: Jan 2008 Posts: 12 Thanks: 1 Thanked 0 Times in 0 Posts Country:	Yes, I can agree that I also have alot of html tags and stuff in the info about the programs.

2008-05-05, 16:48	#27 (permalink)
vuego MP Donator Join Date: Aug 2006 Age: 7 Posts: 294 Thanks: 52 Thanked 11 Times in 11 Posts Country: My System	If you start grabbing after 00:00 you'll get only "todays" listings which at Dagenstv.com starts at 06:00 If you grabbed more than one day you'll get listings for 00-06am all other days though.

2008-05-26, 08:45	#29 (permalink)
entrecour MP Donator Join Date: Sep 2007 Location: Stockholm Posts: 75 Thanks: 4 Thanked 5 Times in 5 Posts Country:	A couple of queustions the folks on this thread may be able to help me with ... 1) How easy is it to create these grabbers? - I am missing a few channels from the existing SE grabbers (e.g. Canal Digital sat channels such as History HD, Silver HD) so I was thinking of creating one myself however I have no experience of html code. Would you say that this is only a task for html experts or could I hack an exiisting grabber using common sense? 2) Can any tv page be used for a grabber to scrape the relevant data? I was considering using canaldigital.se as they have a comprehensive tvguide for all their channels. I am not sure if the way the data is presented here is something the grabber could use or access. I'd appreciate any advice here.

2008-05-26, 20:11	#30 (permalink)
petsa MP Donator Join Date: Jan 2007 Location: Stockholm Posts: 483 Thanks: 5 Thanked 10 Times in 10 Posts Country: My System	Hi entrecour, 1. If you only want to add a channel to an existing grabber it should be easy. You only need to add some stuff at the top where it locates the right page. If you are about to writer a granner from scratch there will be more work needed. It depends on the complexity of the web page you are trying to access etc. 2. In principle any web page can be used as the source for a grabber. In the grabber you search for specific patterns and extract data from the HTML-code based on the template = grabber. Again depending on the complexity of the page it can take more or less time to write such grabber. Another thing to keep in mind is how often the layout of the page will change. If the layout changes frequently you may end up having to fix your grabber ever so often. Using a "standard" grabber that more people use makes more poeple involved in fixing it... /Peter