Updated grabber for dagenstv.com in Sweden (1 Viewer)

[ronilse]

Hi,
Seems like your selected grabber site has change layout & xtras again, please test this one www_dagenstv_com.

Regards
Roy

 

[Zulan]

My Norwegian friend! You are absolutely right. You fixed it! Thanks alot!

 

[DalaNorth]

Yes, thank you Roy!

There are still some imperfections though, some of the descriptions are HTML codes and even some of the titles are messed up (Top Model on TV3 is the most obvious example, it always says "Top Mo" followed by some HTML code. )

Has DagensTV made their site to complex for our parser?

Regards
DalaNorth

 

[Zulan]

Yes, I can agree that I also have alot of html tags and stuff in the info about the programs.

 

[vuego]

There hasn't been any changes to dagenstv.com but the template was poorly written.

The Top Model error is due to the episode replacement. The grabber is configured to remove any occurrences of "del [#number]" and put it in an episode-num tag, i.e. "del 9" becomes <episode-num>9</episode-num>. The problem is that this is done not only for the Description tag but also Title, including Top Model 9

I've modified the grabber template and made the episode search to leave "del [#number]" in the field. It won't hurt having this information visible as well. I also added a search for "Avsnitt [#number]" which seems to be much more common now.

 

[dazpp]

There hasn't been any changes to dagenstv.com but the template was poorly written.

The Top Model error is due to the episode replacement. The grabber is configured to remove any occurrences of "del [#number]" and put it in an episode-num tag, i.e. "del 9" becomes <episode-num>9</episode-num>. The problem is that this is done not only for the Description tag but also Title, including Top Model 9

I've modified the grabber template and made the episode search to leave "del [#number]" in the field. It won't hurt having this information visible as well. I also added a search for "Avsnitt [#number]" which seems to be much more common now.

This file seems to be working and gets the info for movies that didn't work before.

Although there is still a problem with getting info from about 2-3am until 6-7am.. There is only "No data available"
It has been since I started using mediaportal 6 months or so ago.
Is this something that can be fixed?

 

[vuego]

If you start grabbing after 00:00 you'll get only "todays" listings which at Dagenstv.com starts at 06:00
If you grabbed more than one day you'll get listings for 00-06am all other days though.

 

[dazpp]

If you start grabbing after 00:00 you'll get only "todays" listings which at Dagenstv.com starts at 06:00
If you grabbed more than one day you'll get listings for 00-06am all other days though.

Ah. that explains it. I grab ar 03:00 as the load on the server is low and I don't do any harm on it.. Maybe I should grab earlier

 

[entrecour]

A couple of queustions the folks on this thread may be able to help me with ...

1) How easy is it to create these grabbers? - I am missing a few channels from the existing SE grabbers (e.g. Canal Digital sat channels such as History HD, Silver HD) so I was thinking of creating one myself however I have no experience of html code. Would you say that this is only a task for html experts or could I hack an exiisting grabber using common sense?

2) Can any tv page be used for a grabber to scrape the relevant data? I was considering using canaldigital.se as they have a comprehensive tvguide for all their channels. I am not sure if the way the data is presented here is something the grabber could use or access.

I'd appreciate any advice here.

 

[petsa]

Hi entrecour,

1. If you only want to add a channel to an existing grabber it should be easy. You only need to add some stuff at the top where it locates the right page. If you are about to writer a granner from scratch there will be more work needed. It depends on the complexity of the web page you are trying to access etc.

2. In principle any web page can be used as the source for a grabber. In the grabber you search for specific patterns and extract data from the HTML-code based on the template = grabber. Again depending on the complexity of the page it can take more or less time to write such grabber. Another thing to keep in mind is how often the layout of the page will change. If the layout changes frequently you may end up having to fix your grabber ever so often. Using a "standard" grabber that more people use makes more poeple involved in fixing it...

/Peter