WebEPG stopping prematurely (1 Viewer)

vuego

Documentation Group
  • Team MediaPortal
  • August 5, 2006
    1,637
    764
    Göteborg
    Home Country
    Sweden Sweden
    I'm trying to grab some channels which isn't broadcasting every day and this gives some troubles to WebEPG. Naturally there will be days where the grabber finds no listings but the problem is that WebEPG takes it too hard and gives up.

    Code:
    2009-03-01 06:04:03.062799 [Info.][WebEPG-xmltv]: WebEPG: Getting Channel ID: sportextra@canalplus.se
    2009-03-01 06:04:03.063776 [Info.][WebEPG-xmltv]:         [45 of 45]
    2009-03-01 06:04:03.065729 [Info.][WebEPG-xmltv]: WebEPG: ChannelId: sportextra@canalplus.se
    2009-03-01 06:04:03.066705 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-03-01&cha=299 POST: 
    2009-03-01 06:04:03.152637 [Info.][WebEPG-xmltv]: WebEPG: Listing Count 2
    2009-03-01 06:04:03.158496 [Info.][WebEPG-xmltv]: WebEPG: Guide, Program Info: 20090301122500 - Fotboll
    2009-03-01 06:04:03.160449 [Info.][WebEPG-xmltv]: WebEPG: Guide, Program Info: 20090301145500 / 20090301170000 - Fotboll
    2009-03-01 06:04:03.161426 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-03-02&cha=299 POST: 
    2009-03-01 06:04:03.237593 [Info.][WebEPG-xmltv]: WebEPG: No Listings Found
    2009-03-01 06:04:03.239546 [Info.][WebEPG-xmltv]: WebEPG: ChannelId: sportextra@canalplus.se grabber error
    2009-03-01 06:04:03.241499 [Info.][WebEPG-xmltv]: WebEPG: Writing Channel to XMLTV: CANAL+ Sport Extra

    Instead of throwing "grabber error" it should continue to try grabbing the next day since there's actual listings there to be grabbed. Is there anything to be done in the grabber xml or is this something that has to be fixed in source code?
     

    James

    Retired Team Member
  • Premium Supporter
  • May 6, 2005
    1,385
    67
    Switzerland
    Hi Vuego,

    I have added an option to allow WebEPG to continue when such an error is encountered.

    Add the following code to the Info section of the grabber file:

    Code:
    <Info treatErrorAsWarning="true"/>

    This currently effects all channels on a grabber. Do you think having per channel would add more value? Also instead of allowing all errors would a counter be better, to allow only X errors in a row before stopping? Otherwise if there is really a problem we could request 7-14 days getting an error each time.

    /James
     

    vuego

    Documentation Group
  • Team MediaPortal
  • August 5, 2006
    1,637
    764
    Göteborg
    Home Country
    Sweden Sweden
    • Thread starter
    • Moderator
    • #3
    Thanks James

    It should apply to all channels in a grabber since they all potentially have the same issue, because of the website. I'm not sure about the stop after X retries. I'm grabbing 14 days and there could be shows only on the last day. The only thing I know is that it should not fail more than the number of days grabbed per channel :)
     

    vuego

    Documentation Group
  • Team MediaPortal
  • August 5, 2006
    1,637
    764
    Göteborg
    Home Country
    Sweden Sweden
    • Thread starter
    • Moderator
    • #4
    Hi, I'm testing this feature in build 22162 right now and it does indeed continue after a "No Listings Found" however there's one problem. After "No Listings Found" it skips one day.

    See log file. First two days works correctly but then it only grabs even days:
    2009-04-04 01:03:08.296400 [Info.][1]: WebEPG: Starting
    2009-04-04 01:03:08.300306 [Info.][WebEPG-xmltv]: WebEPG: Using directories
    2009-04-04 01:03:08.301282 [Info.][WebEPG-xmltv]: WebEPG - C:\Program Files\Team MediaPortal\MediaPortal
    2009-04-04 01:03:08.302259 [Info.][WebEPG-xmltv]: xmltv - C:\ProgramData\Team MediaPortal\MediaPortal\xmltv\
    2009-04-04 01:03:08.305188 [Info.][WebEPG-xmltv]: Assembly versions:
    2009-04-04 01:03:08.306165 [Info.][WebEPG-xmltv]: WebEPG 3.0.2.22162
    2009-04-04 01:03:08.307141 [Info.][WebEPG-xmltv]: Utils 2.2.6.18612
    2009-04-04 01:03:08.331554 [Info.][WebEPG-xmltv]: Loading Config File: C:\ProgramData\Team MediaPortal\MediaPortal\WebEPG\WebEPG.xml
    2009-04-04 01:03:08.594232 [Info.][WebEPG-xmltv]: WebEPG: Loading Channel Config
    2009-04-04 01:03:08.600091 [Info.][WebEPG-xmltv]: WebEPG: Getting Channel ID: sportextra@canalplus.se
    2009-04-04 01:03:08.601068 [Info.][WebEPG-xmltv]: [1 of 1]
    2009-04-04 01:03:08.605950 [Info.][WebEPG-xmltv]: WebEPG: Opening SE\www_dagenstv_com.xml
    2009-04-04 01:03:08.898900 [Info.][WebEPG-xmltv]: WebEPG: Version: 2.1.0
    2009-04-04 01:03:08.900853 [Info.][WebEPG-xmltv]: WebEPG: TimeZone, Local: W. Europe Standard Time
    2009-04-04 01:03:08.901830 [Info.][WebEPG-xmltv]: WebEPG: TimeZone, Site : W. Europe Standard Time
    2009-04-04 01:03:08.955537 [Info.][WebEPG-xmltv]: WebEPG: ChannelId: sportextra@canalplus.se
    2009-04-04 01:03:09.007292 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-04-04&cha=299 POST:
    2009-04-04 01:03:10.383180 [Info.][WebEPG-xmltv]: WebEPG: Listing Count 1
    2009-04-04 01:03:10.407593 [Info.][WebEPG-xmltv]: WebEPG: Guide, Program Info: 20090404155500 / 20090404180000 - Fotboll
    2009-04-04 01:03:10.414428 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-04-05&cha=299 POST:
    2009-04-04 01:03:11.607711 [Info.][WebEPG-xmltv]: WebEPG: Listing Count 1
    2009-04-04 01:03:11.609664 [Info.][WebEPG-xmltv]: WebEPG: Guide, Program Info: 20090405155500 / 20090405180000 - Fotboll
    2009-04-04 01:03:11.610641 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-04-06&cha=299 POST:
    2009-04-04 01:03:12.705297 [Info.][WebEPG-xmltv]: WebEPG: No Listings Found
    2009-04-04 01:03:12.706274 [Warn.][WebEPG-xmltv]: WebEPG: ChannelId: sportextra@canalplus.se grabber error - continuing
    2009-04-04 01:03:12.708227 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-04-08&cha=299 POST:
    2009-04-04 01:03:13.827296 [Info.][WebEPG-xmltv]: WebEPG: No Listings Found
    2009-04-04 01:03:13.828272 [Warn.][WebEPG-xmltv]: WebEPG: ChannelId: sportextra@canalplus.se grabber error - continuing
    2009-04-04 01:03:13.830225 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-04-10&cha=299 POST:
    2009-04-04 01:03:14.944412 [Info.][WebEPG-xmltv]: WebEPG: No Listings Found
    2009-04-04 01:03:14.946365 [Warn.][WebEPG-xmltv]: WebEPG: ChannelId: sportextra@canalplus.se grabber error - continuing
    2009-04-04 01:03:14.947341 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-04-12&cha=299 POST:
    2009-04-04 01:03:16.061528 [Info.][WebEPG-xmltv]: WebEPG: No Listings Found
    2009-04-04 01:03:16.063481 [Warn.][WebEPG-xmltv]: WebEPG: ChannelId: sportextra@canalplus.se grabber error - continuing
    2009-04-04 01:03:16.065434 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-04-14&cha=299 POST:
    2009-04-04 01:03:17.160090 [Info.][WebEPG-xmltv]: WebEPG: No Listings Found
    2009-04-04 01:03:17.162043 [Warn.][WebEPG-xmltv]: WebEPG: ChannelId: sportextra@canalplus.se grabber error - continuing
    2009-04-04 01:03:17.163996 [Info.][WebEPG-xmltv]: WebEPG: Reading http://www.dagenstv.com/se/chart/?dat=2009-04-16&cha=299 POST:
    2009-04-04 01:03:18.322125 [Info.][WebEPG-xmltv]: WebEPG: No Listings Found
    2009-04-04 01:03:18.324078 [Warn.][WebEPG-xmltv]: WebEPG: ChannelId: sportextra@canalplus.se grabber error - continuing
    2009-04-04 01:03:18.325055 [Info.][WebEPG-xmltv]: WebEPG: Writing Channel to XMLTV: CANAL+ Sport Extra
    2009-04-04 01:03:18.334820 [Info.][WebEPG-xmltv]: HTTP Statistics: Site www.dagenstv.com : Pages 8 : Bytes 413699 : Total Time 00:00:05.2193925 : Av. Rate 79,26191 KBps
    2009-04-04 01:03:18.336773 [Info.][WebEPG-xmltv]: WebEPG: Finished
     

    Users who are viewing this thread

    Top Bottom