WebGrab+Plus a new xmltv grabber (4 Viewers)

WG++Maker

Portal Pro
October 25, 2010
130
112
La Gomera, Canary Islands
Home Country
Spain Spain
This is a great program and it far exceeds my expectations, thanks a lot. I only have one problem, the Turkey grabber seems to have a bug with the dates, it can grab "today" good, leaves a gap for "tomorrow" and starts writing "tomorrow"s data to "next day". So there is 1 day shift, but today is correct. I'm trying to debug but it seems weird to me that today is correct and others not. Could you help me with that?


Hi Hedehede81,

The site lists an early morning show twice (the last on 'today' and the first on 'tomorrow' are the same). That forces the dayjump in the program because the starttime of the second is before the stop time of the first ( if you can still follow me). You can solve this by disabling the stoptime entries in 'digiturk.com.tr.ini'.
Just add a * as first character.
There are two:

*index_stop.scrub {single(separator="+" include=first)|"PEndTime":"\/Date(||)\/"}

and further down:

*index_stop.modify {calculate(format=time)}

This way all stoptimes are the starttime of the next, and by that the start- and stop time of the first are the equal , making it a '0' hour show which will be ignored if you specify a 'minuteskip' in WebGrab++.config.xml like :

<skip>8,1</skip>

WG++Maker ... Jan
 

Hedehede81

Portal Member
February 20, 2011
18
1
44
This is a great program and it far exceeds my expectations, thanks a lot. I only have one problem, the Turkey grabber seems to have a bug with the dates, it can grab "today" good, leaves a gap for "tomorrow" and starts writing "tomorrow"s data to "next day". So there is 1 day shift, but today is correct. I'm trying to debug but it seems weird to me that today is correct and others not. Could you help me with that?

Hi Hedehede81,

The site lists an early morning show twice (the last on 'today' and the first on 'tomorrow' are the same). That forces the dayjump in the program because the starttime of the second is before the stop time of the first ( if you can still follow me). You can solve this by disabling the stoptime entries in 'digiturk.com.tr.ini'.
Just add a * as first character.
There are two:

*index_stop.scrub {single(separator="+" include=first)|"PEndTime":"\/Date(||)\/"}

and further down:

*index_stop.modify {calculate(format=time)}

This way all stoptimes are the starttime of the next, and by that the start- and stop time of the first are the equal , making it a '0' hour show which will be ignored if you specify a 'minuteskip' in WebGrab++.config.xml like :

<skip>8,1</skip>

WG++Maker ... Jan


That did it!! I can't thank you enough, I switched from Webepg to your grabber (because it is compatible with For The Record TV) and you saved me from writing own grabber file and days of work, thank you so much :)
 

zunixnuz

Portal Pro
December 23, 2007
291
97
Home Country
Austria Austria
Hi,
your grabber works great, thanks for your work!
I have only one suggestion for a next version:
It would be great to have an option to start WebGrab+Plus minimized,
e.g. by command line option or by configuration entry in xml file.
At the moment i run WebGrab+Plus via windows task planer and i use a separate batch file for minimizing.
 

shummi

Portal Pro
February 24, 2010
51
2
Home Country
Denmark Denmark
Hi Jan
This doesn't come better.....
I started with the original ontv.ini, and added some elements and adapted it to MediaPortal. INI-file attached if other can find it usefull.
I have used some workaround because i can't get this to work as described at p26 in dokumentation:
title.modify {remove(notnull type=string)|: 'subtitle'} * removes the value of element sub-title in title after the colon : , which is also removed.
This only removes the colon, and not the rest of the string?, i have tried it on episode element with remove and substring to clean the "sæson" info.

Oh. one little thing i haven't solved: the description always ends with ( n ) or ( r ), and i cant find it anywhere on the host page, it is not a big issue, bus i am just curious where it comes from.

If anybody knows what and how to modify Mediaportals skin so it shows Title(da) and Title(en), Actor, production year, multi category, help would be appreciated, i use skin SteamedMP.
 

Attachments

  • WebGrab.zip
    6.5 KB

WG++Maker

Portal Pro
October 25, 2010
130
112
La Gomera, Canary Islands
Home Country
Spain Spain
Thanks for your contribution!

I have used some workaround because i can't get this to work as described at p26 in dokumentation:
title.modify {remove(notnull type=string)|: 'subtitle'} * removes the value of element sub-title in title after the colon : , which is also removed.
This only removes the colon, and not the rest of the string?, i have tried it on episode element with remove and substring to clean the "sæson" info.


That should work. To illustrate try this:

subtitle.modify {remove|'subtitle'} * clear subtitle for this test
subtitle.modify {addstart|This is the subtitle} * give subtitle a value
producer.modify {addstart|test : 'subtitle'} * add a composite string including the subtitle to producer
producer.modify {remove(debug type=string)|: 'subtitle'} * remove a part of the composite string including the subtitle

This will produce the following xmltv:
<sub-title lang="da">This is the subtitle</sub-title>
<producer>test</producer>

I am very interested to know where this didn't work, can yoou giveme an example?

Oh. one little thing i haven't solved: the description always ends with ( n ) or ( r ), and i cant find it anywhere on the host page, it is not a big issue, bus i am just curious where it comes from.


This is added by WG++ to indicate the update mode that produced the programme entry. Can be: ( c ) changed, ( r ) repair/replace ( g ) gab or ( n ) new
I , personally , like to know what produced the programme entry, but some users don't like it. You can get rid of it by adding n to <mode> in the config.

WG++Maker . . . Jan
 

Christoph21x

Portal Pro
January 31, 2009
50
14
Berne
Home Country
Switzerland Switzerland
Dear Jan,

the 1.1. MSI.rar - it contains no MSI but the files of WG.
But by copying it, it does not install a new Exe.. is this correct?

Kind regards - Christoph

PS: Did you think about donations in the meantime? ;) WG++ is definitively worth it, it's working here for a year now... and what about the beer to the MAKER??!!
 

WG++Maker

Portal Pro
October 25, 2010
130
112
La Gomera, Canary Islands
Home Country
Spain Spain
Dear Jan,

the 1.1. MSI.rar - it contains no MSI but the files of WG.
But by copying it, it does not install a new Exe.. is this correct?

Kind regards - Christoph

PS: Did you think about donations in the meantime? ;) WG++ is definitively worth it, it's working here for a year now... and what about the beer to the MAKER??!!

Hi Christoph,

do you refer to http://www.servercare.nl/Docs/WebGrab PlusV1.1.0MSI.rar ? It contains the msi in the deploy folder (with the warning to run install.bat instead if you want to install this version)

Donations ... believe me if I drank all the beer offered to me in the meantime, WG++ would behave :ROFLMAO: a bit different!
But thanks anyhow .. WG++Maker ... Jan
 

Christoph21x

Portal Pro
January 31, 2009
50
14
Berne
Home Country
Switzerland Switzerland
Hi Christoph,

do you refer to http://www.servercare.nl/Docs/WebGrab PlusV1.1.0MSI.rar ? It contains the msi in the deploy folder (with the warning to run install.bat instead if you want to install this version)

Donations ... believe me if I drank all the beer offered to me in the meantime, WG++ would behave :ROFLMAO: a bit different!
But thanks anyhow .. WG++Maker ... Jan

YES... thanks! I'm BLOND... my only excuse, Jan :) that's by the way LIKE having had beers.... :)
 

shummi

Portal Pro
February 24, 2010
51
2
Home Country
Denmark Denmark
Thanks for your contribution!

I have used some workaround because i can't get this to work as described at p26 in dokumentation:
title.modify {remove(notnull type=string)|: 'subtitle'} * removes the value of element sub-title in title after the colon : , which is also removed.
This only removes the colon, and not the rest of the string?, i have tried it on episode element with remove and substring to clean the "sæson" info.


That should work. To illustrate try this:

subtitle.modify {remove|'subtitle'} * clear subtitle for this test
subtitle.modify {addstart|This is the subtitle} * give subtitle a value
producer.modify {addstart|test : 'subtitle'} * add a composite string including the subtitle to producer
producer.modify {remove(debug type=string)|: 'subtitle'} * remove a part of the composite string including the subtitle

This will produce the following xmltv:
<sub-title lang="da">This is the subtitle</sub-title>
<producer>test</producer>

I am very interested to know where this didn't work, can yoou giveme an example?

WG++Maker . . . Jan

Hi Jan
I tried this and it works perfekt, i haven't saved the one i tried, but obvisually I did something wrong,
I could be that i left out the element 'subtitle' because it is the same string i altered, but I can see this only removes the colon.
Sorry for the inconvenience, and again, thanks for a great software and your quick response.

BR Jesper
 

Christoph21x

Portal Pro
January 31, 2009
50
14
Berne
Home Country
Switzerland Switzerland
Hi Jan,

I tried this version including post processing for the first time...
What is obvious is, that you could save a lot of time while post processing, if you would also store which shows (the majority like series and daily soaps, news etc) are NOT found in imdb.com, in the local db - and not search for the same again online.
BUT: only store it for that single run - cleanup these entries when finishing the post processing. This assures, that new entries in imdb are found the next run.
You may store the starting time of the run and leave the entries. In the next run, you compare the starting time and see that these entries need to be updated (if still "no match found" - and maybe update only the new starting time for that entry, otherwise - if found - delete it and update the local DB with it)

Another thing: I endered "imdb.de", which is existing - like your example "imdb.es", but it's only searching imdb.com.. did I misunderstand something?

Kind regards - Christoph
 
Last edited:

Users who are viewing this thread

Top Bottom