home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
Support
Electronic Program Guide
xmlTV
WebGrab+Plus a new xmltv grabber
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Quake505" data-source="post: 723489" data-attributes="member: 92046"><p>First I would like to say that I find webgrab very easy to use, and creating my own grab .ini file was quick, I created a grab file for mydigiguide in a couple of hours, and then another couple modifying the output.</p><p></p><p>Here are some things I have discovered when testing the grab file.</p><p></p><p>Issues with webgrab: -</p><p></p><p>1. Scrubbing the TV programs slows down dramatically when a lot of channels are being grabbed.</p><p></p><p>I tested my grab .ini file by selecting all channels (around 650) for 10 days, the scrubbing (not grabbing from the web page) of the program information was very fast for the first channels, the first channel took less then 1 second (337 shows), but slows down with each new channel, when it got to around the 200 channel mark, webgrab took around 2 minutes to scrub 236 shows.</p><p></p><p>It slow down so much that after 9 hours I stopped webgrab, it had done around 400 channels.</p><p></p><p>2. Resources</p><p></p><p>The CPU usage is always 50% when scrubbing, is this normal or is this related to 1?</p><p></p><p></p><p>Issues with the mydigiguide grab file: -</p><p></p><p>3. Need to use a high retry.</p><p></p><p>Mydigiguide blocks access when too many pages are grabbed within a set period of time, I have witnessed the retry count being as high as 14.</p><p></p><p>This could be easily resolved by adding a delay between page grabs.</p><p></p><p>Is there a way to set a delay between page grabs?</p><p></p><p></p><p>Instructions with the grab file attached (not a problem with webgrab): -</p><p></p><p>* Channel list file.</p><p></p><p>The channel list file will not include the last channel in the WebGrab++.config.xml, for this reason I always use BBC1 which has a SiteId of 1.</p><p></p><p>I anticipate that the channel list file creation will fail with a minor change to the web page.</p><p></p><p>* Star rating</p><p></p><p>The star rating is only shown with 3 stars or above.</p><p></p><p>* Star rating</p><p></p><p>I added ‘index_starrating.modify {replace| star rating|}’ this means it can be changed for the desired output.</p><p></p><p>Currently it will just have the number, it can be changed as follows: -</p><p></p><p>index_starrating.modify {replace| star rating|/5}</p><p></p><p>This would output 3/5 if the show star rating was 3.</p><p></p><p>* Program Description</p><p></p><p>The Description has <img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite25" alt="(n)" title="Thumbs Down (n)" loading="lazy" data-shortname="(n)" /> at the end.</p><p></p><p></p><p>Hope you can help with issues 1-3 above.</p><p></p><p></p><p></p><p>Regards,</p><p></p><p>Q505</p></blockquote><p></p>
[QUOTE="Quake505, post: 723489, member: 92046"] First I would like to say that I find webgrab very easy to use, and creating my own grab .ini file was quick, I created a grab file for mydigiguide in a couple of hours, and then another couple modifying the output. Here are some things I have discovered when testing the grab file. Issues with webgrab: - 1. Scrubbing the TV programs slows down dramatically when a lot of channels are being grabbed. I tested my grab .ini file by selecting all channels (around 650) for 10 days, the scrubbing (not grabbing from the web page) of the program information was very fast for the first channels, the first channel took less then 1 second (337 shows), but slows down with each new channel, when it got to around the 200 channel mark, webgrab took around 2 minutes to scrub 236 shows. It slow down so much that after 9 hours I stopped webgrab, it had done around 400 channels. 2. Resources The CPU usage is always 50% when scrubbing, is this normal or is this related to 1? Issues with the mydigiguide grab file: - 3. Need to use a high retry. Mydigiguide blocks access when too many pages are grabbed within a set period of time, I have witnessed the retry count being as high as 14. This could be easily resolved by adding a delay between page grabs. Is there a way to set a delay between page grabs? Instructions with the grab file attached (not a problem with webgrab): - * Channel list file. The channel list file will not include the last channel in the WebGrab++.config.xml, for this reason I always use BBC1 which has a SiteId of 1. I anticipate that the channel list file creation will fail with a minor change to the web page. * Star rating The star rating is only shown with 3 stars or above. * Star rating I added ‘index_starrating.modify {replace| star rating|}’ this means it can be changed for the desired output. Currently it will just have the number, it can be changed as follows: - index_starrating.modify {replace| star rating|/5} This would output 3/5 if the show star rating was 3. * Program Description The Description has (n) at the end. Hope you can help with issues 1-3 above. Regards, Q505 [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
Support
Electronic Program Guide
xmlTV
WebGrab+Plus a new xmltv grabber
Contact us
RSS
Top
Bottom
