DJBlu's Custom Sky Data Grabber for MP1.9 onwards (4 Viewers)

[ears]

Here's a few lines from a log file just produced in TVserver.log as an example. There were no more errors after this.

2015-03-16 21:18:31,195] [Log ] [SetupTv ] [INFO ] - Sky Plugin : Sky Channel and EPG Grabber initialised
[2015-03-16 21:18:31,220] [Log ] [13 ] [INFO ] - Sky Plugin : Huffman Loaded
[2015-03-16 21:18:31,233] [Log ] [13 ] [INFO ] - Sky Plugin : Grabbing Data
[2015-03-16 21:18:31,239] [Log ] [13 ] [INFO ] - Sky Plugin : Grabber set to grab 60 seconds of data
[2015-03-16 21:18:36,590] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:37,760] [Log ] [9 ] [INFO ] - Sky Plugin : Error Parsing BAT
[2015-03-16 21:18:37,779] [Log ] [9 ] [INFO ] - Sky Plugin : Error Parsing BAT
[2015-03-16 21:18:37,785] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,790] [Log ] [9 ] [INFO ] - Sky Plugin : Error Parsing SDT
[2015-03-16 21:18:37,843] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,868] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,901] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,915] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,930] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:45,299] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding Summary, Index was outside the bounds of the array.
[2015-03-16 21:18:45,521] [Log ] [9 ] [INFO ] - Sky Plugin : Got Network Information, 81 transponders
[2015-03-16 21:18:47,596] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:48,756] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:49,890] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:51,042] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:52,230] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:54,513] [Log ] [9 ] [INFO ] - Sky Plugin : Bouquet scan complete.
[2015-03-16 21:18:54,532] [Log ] [9 ] [INFO ] - Sky Plugin : Found 925 channels in 15 bouquets, searching SDT Information
[2015-03-16 21:18:54,552] [Log ] [9 ] [INFO ] - Sky Plugin : Got All SDT Info, 949 Channels found
[2015-03-16 21:18:54,571] [Log ] [9 ] [INFO ] - Sky Plugin : Everything grabbed:- Titles(129666) : Summaries(134305)
[2015-03-16 21:18:54,590] [Log ] [9 ] [INFO ] - Sky Plugin : Everything Grabbed
[2015-03-16 21:18:54,591] [Log ] [9 ] [INFO ] - Stopping Timeshift as Complete was received
[2015-03-16 21:18:54,805] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;
[2015-03-16 21:18:54,807] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;
[2015-03-16 21:18:54,809] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;
[2015-03-16 21:18:54,812] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;
[2015-03-16 21:18:54,814] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;

 

[Jay_UK]

Hi there,

There are known issues with AV software and TS files. It is normally recommended to exclude them

J.

 

[ears]

Yeah I've been working on that - excluded everything I can think of - everything listed on the wiki, plus .ts files, .tsbuffer files, folder locations, processes, services, tsreader.ax, tswriter.ax and a whole load of other stuff. It's better, but it's still shaky. I've tried totally disabling endpoint protection but it doesn't get any better.

I think it's definitely a discontinuity error thing. I can see some in the logs if I leave a channel tuned for long enough. I don't get any when I hand the tuners over to DVBViewer so it must be something I can fix. The signal is good and clean.

At the moment it's not bad enough to tempt me back to DVBViewer but when the grabber starts deleting and recreating channels it really throws everything - have to rebuild favourites etc. I just want an easy life!

 

[icam2]

Here's a few lines from a log file just produced in TVserver.log as an example. There were no more errors after this.

2015-03-16 21:18:31,195] [Log ] [SetupTv ] [INFO ] - Sky Plugin : Sky Channel and EPG Grabber initialised
[2015-03-16 21:18:31,220] [Log ] [13 ] [INFO ] - Sky Plugin : Huffman Loaded
[2015-03-16 21:18:31,233] [Log ] [13 ] [INFO ] - Sky Plugin : Grabbing Data
[2015-03-16 21:18:31,239] [Log ] [13 ] [INFO ] - Sky Plugin : Grabber set to grab 60 seconds of data
[2015-03-16 21:18:36,590] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:37,760] [Log ] [9 ] [INFO ] - Sky Plugin : Error Parsing BAT
[2015-03-16 21:18:37,779] [Log ] [9 ] [INFO ] - Sky Plugin : Error Parsing BAT
[2015-03-16 21:18:37,785] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,790] [Log ] [9 ] [INFO ] - Sky Plugin : Error Parsing SDT
[2015-03-16 21:18:37,843] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,868] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,901] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,915] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:37,930] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding title, Index was outside the bounds of the array.
[2015-03-16 21:18:45,299] [Log ] [9 ] [INFO ] - Sky Plugin : Error decoding Summary, Index was outside the bounds of the array.
[2015-03-16 21:18:45,521] [Log ] [9 ] [INFO ] - Sky Plugin : Got Network Information, 81 transponders
[2015-03-16 21:18:47,596] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:48,756] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:49,890] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:51,042] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:52,230] [Log ] [9 ] [INFO ] - Waiting for Custom data file to reach correct size
[2015-03-16 21:18:54,513] [Log ] [9 ] [INFO ] - Sky Plugin : Bouquet scan complete.
[2015-03-16 21:18:54,532] [Log ] [9 ] [INFO ] - Sky Plugin : Found 925 channels in 15 bouquets, searching SDT Information
[2015-03-16 21:18:54,552] [Log ] [9 ] [INFO ] - Sky Plugin : Got All SDT Info, 949 Channels found
[2015-03-16 21:18:54,571] [Log ] [9 ] [INFO ] - Sky Plugin : Everything grabbed:- Titles(129666) : Summaries(134305)
[2015-03-16 21:18:54,590] [Log ] [9 ] [INFO ] - Sky Plugin : Everything Grabbed
[2015-03-16 21:18:54,591] [Log ] [9 ] [INFO ] - Stopping Timeshift as Complete was received
[2015-03-16 21:18:54,805] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;
[2015-03-16 21:18:54,807] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;
[2015-03-16 21:18:54,809] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;
[2015-03-16 21:18:54,812] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;
[2015-03-16 21:18:54,814] [Log ] [9 ] [DEBUG] - select idGroup, groupName, sortOrder from ChannelGroup where groupName like ?groupName;

Hi ears this error sounds like an issue i was having many moons ago when DJblu first developed this plugin. it turned out to be the write speed of the grabber ts file being written to the hard drive if the drive is slow or busy these error used to occur (very random 1 in 10 trys used to work). The way i resolved this was to setup a ram disk and then use that for my timeshifts ts files and as a result no more errors with the plugin well maybe 1 in 100 used to give the odd error but nothing as bad as what your seeing now. Just try a ram disk you might surprised at the over all results!!

Good Luck

 

[ears]

@icam2 thank you so much! I've put a RAM disk on there (server has 8gb, only uses 2 and I can't really run hyper-v so I was wondering what to do what all that capacity!). First grab was entirely error free. We could be onto something here!

 

[icam2]

@icam2 thank you so much! I've put a RAM disk on there (server has 8gb, only uses 2 and I can't really run hyper-v so I was wondering what to do what all that capacity!). First grab was entirely error free. We could be onto something here!

your very welcome ears glad it helped i was also very frustrated when it happened to me. This issue first appeared way back in the beta builds and DJblu fixed it in version 1.2 then he had a hard drive crash and lost all his sources so all the later builds of this plugin (1.3 and up) are infact build from the original source so as a result all the old bugs reappeared. I've been out of the scene for ages now but glad my old method has helped you out a little. Also using a ram disk does save your hard drive some hard work to!!.

 

[Gizmozo]

Hey guys, I'm using the v1.9.0 version of the custom build. Everything seemed to be working except it has started playing up, none responsive, crashing etc. When i checked my channels i noticed that the grabber is adding duplicate FTA channels... last count it was up to around 20 + for each of the FTA channels. The Sky channels seem to be ok. Im in NZ so wonder if anyone else has seen this. I've had to resort to periodically deleting all the channels and regrabbing to update. I have the grabber set to every four hours. Any ideas ?

 

[ears]

1.11.0 now added to post 1. Very painless - stashed changes in 1.10 modified source, then merged in master, popped stashed changes and that seems to have done it. Haven't upgraded my live yet but MP has the Series Link option and TV Server is adding SQL columns if required, and copying the DLLs across. Looking good.

 

[AndyHandy]

Great work, I am already using the1.9 version with sky grabber, if i upgrade to 1.11 using the zip file on the first post will all my settings be saved, is favourite programme groups, updated logos and edited channel names ? If not is there a way to save these from being modified by the new install? Finally do I just install straight over the top or does it guide me though the upgrade?

Thanks for all your help
Andy

 

[Jay_UK]

Hi there,

They will be saved (the only things think will be lost are modified skins files, etc).

Channels, logos, groups, etc will be kept

J.