WebGrab+Plus a new xmltv grabber (3 Viewers)

Christoph21x

Portal Pro
January 31, 2009
50
14
Berne
Home Country
Switzerland Switzerland
I must admit.. no luck.
I re-analyzed the index and detail pages and found no mistake. I can't reproduce, why few channels populate perfectly, and most of the chans don't.
From what I see, is, that the indexes are created for both types correctly, but details seem not to be loaded. I'm missing enough know-how about internal process of WebGrab+Plus to know when it might abort an entry. Logging function is not suitable to detect this. So it might also be a WG issue, as it seems that it aborts (due to "somewhat") :( .
Sorry, pOpY.
I will now try to adjust the TVSpielfim.ini in order to have the season / episode info in the right format and also in the text, as I use many schedules (within Argus TV), that refer to special seasons or even episodes only - for which the current TVSpielfilm.ini is not suitable, as the season/episode info is not "good enough" (for me).

Greetz - Chris
 

popy

MP Donator
  • Premium Supporter
  • July 3, 2011
    617
    141
    Hey Chris.

    No problem and thx for looking into it. Currently I am grabbing from tvtv, TV info and TV movie. Will see how it goes in the next days...

    Should I'll post the issue in the wg++ forum? Or can you do this because I have no account and not so much knowledge about wg++ and it's INI files.

    pOpY
     

    popy

    MP Donator
  • Premium Supporter
  • July 3, 2011
    617
    141
    ... I have epg from yesterday?

    Does the TV Spielfilm.ini has all the channels and works?

    Can you share your INI?

    Thx
     

    popy

    MP Donator
  • Premium Supporter
  • July 3, 2011
    617
    141
    good news for tvtoday.de-users
    http://www.webgrabplus.com/comment/3367#comment-3367
    this file seems to work :D

    thx a LOT!!!!!!
    This ini fixes the missing epg data on tvtoday.

    channeö ORF1 is grabbing like a champ: ;);););)

    upload_2014-11-29_13-1-3.png
     

    Christoph21x

    Portal Pro
    January 31, 2009
    50
    14
    Berne
    Home Country
    Switzerland Switzerland
    In the meantime I extended & adjusted the TVSpielfilm file accordingly.
    Please read:
    * @Revision 5 - [30/11/2014] Christoph21x
    * THIS REVISION IS DUE TO USER REQUEST AND AN ALPHA and ONLY PARTLY TESTED
    * PLEASE SEE ESPECIALLY README's CONSTRAINTS and RECOMMENDATIONS
    * switch-over to xmltv_ns for episodesystem/episode_num
    * altered reading of season/episode scrubbing acc. to divers site layouts
    * text "(Staffel #s, Folge #e)" is added to description
    * format: "#S.#E.#P" (S = season, E = episode, P = part) - no leading zeros
    * numbers zero-based
    * multi-episodes not supported
    * part number (of a broadcast) not supported

    Dear All
    All of a sudden, TVToday.ini is not working anymore as per 2014-12-02 00:00h
    This is valid for MOST of the channels - but not all.
    I couldn't find the reason and/or difference between the working and non-working channels.

    That brought me to a sudden extenson of the TVSpielfilm.de.ini file due to following reasons:
    1. Users of TVToday.de can very easily change the settings towards using TVSpielfilm.de
    1.1 Edit the file "WebGrab++.config.xml" under "\ProgramData\ServerCare\WebGrab\" simply through
    Search & Replace: Search "tvtoday.de" and replace (all) by "tvspielfilm.de"
    The channels all follow the same calling convention (identifier).
    1.2 All channels available under TVToday.de are also available under TVSpielfilm.de
    2. In order to have a compatibility between the (old) TVSpielfilm.de.in and TVToday.de.ini
    I had to do some changes:
    2.1 Switching the episodenum system to "xmltv_ns" rather than "on_screen" (former Rev.)
    That means - going from the text-based system to the numeric one which can be read
    by numerous software directly & most of the enrichers.
    And it can name the recorded file accordingly (if supported as in Argus TV).
    2.2 Adding the text "(Staffel #s, Folge #e)" to the description at the end of it.
    This can be used by e.g. Argus TV in recording schedules to only schedule explicit
    Seasons and/or episodes

    PLEASE NOTE
    - The .ini is NOT enough tested by now. Please consider it as a draft, an early ALPHA
    - If you have any schedules relying on the "on-screen" episode numbering system, the new version
    can create trouble and make your schedules void.
    This is most unprobable, as I don't know any of the schedulers who can work with on_schreen
    numbering system

    CONSTRAINTS
    - The Website TVSpielfilm.de has - other than TVToday.de - a very slow response time
    - Your grab will take by far longer as with TVToday.de (calculate 3-times upto 5-times the time)
    - Adopt the task scheduler accordingly, start it earlier, adopt your system, if needed
    - Consider to reduce the number of grabbed days drastically, e.g. from 14 to 4 or 5
    - Increase the timeout set withing the WebGrab++ Config file
    "WebGrab++.config.xml" under "\ProgramData\ServerCare\WebGrab\" by:
    <retry time-out="5">5</retry>
    (My original setting was <retry time-out="2">5</retry>
    So I increased the time-out from 2 to 5 seconds each.

    RECOMMENDATION
    - Set the user-agent string to the newest (here: firefox) software version, eg. Firefox 36:
    <user-agent>Mozilla/5.0 (Windows NT 6.3; rv:36.0) Gecko/20100101 Firefox/36.0</user-agent>

    Kind regards from Switzerland & I hope I could assist you -
    Chris alias Christoph21x
    30.11.2014
     

    Attachments

    • 2014-11-30.TVSpielfilm.de.ini.zip
      4 KB

    Christoph21x

    Portal Pro
    January 31, 2009
    50
    14
    Berne
    Home Country
    Switzerland Switzerland
    Yes, and I´m very happy, Jan could solve it.
    I saw it, when I wanted to upload the TVSpielfilm.de.ini... :)
    Am using TVToday, too, the site is (and always was) much faster...
     

    Caminante

    Portal Pro
    April 22, 2009
    50
    3
    Home Country
    Germany Germany
    yes, but something is wrong, postprocessing dont run-

    EDIT: Sorry, my fault. All is ok
     
    Last edited:

    Users who are viewing this thread

    Top Bottom