DUGG TV guide grabber - Updated [02.06.06] (3 Viewers)

[angusmann]

I'm pleased to say that dugg has been re-worked and de-bugged and version 2.4 is now available for download.

I strongly recommend that all users update to this version.

It is now able to detect and recover from errors far more elegantly, without crashing.

Available for download or update at :
http://dugg.ueuo.com

 

[xclocked]

Do you think you'll be able to add support for TVS? Allthough it's not a popular channel, I'd like to have info for that channel.

 

[Callifo]

If you dont see the data for that channel on ninemsn, then youd have to find the data elsewhere.

 

[angusmann]

I'm happy to look at adding support for "TVS" but I have no idea what it is. I presume it is a local (perhaps community) station ?

If you can elaborate about this I'll look into it.

 

[xclocked]

I think it's a sydney wide station, a new one. It has some good programs, but it sucks not having the guide for it. Here's the channel's website:
http://www.tvs.org.au/

 

[angusmann]

Thanks xclocked - I should not have posted before searching because I found TVS on google within a few seconds.

I emailed them TVS) and got a very positive response from a real person who actually read my email before cut-and-pasting a reply. They offered to email me their guide data in a variety of formats on a weekly basis. Now that's a stark contrast to the commercial networks !

Anyway I'd prefer a method that could be automated and did not require me to manually process it each week, so I will see what other methods are possible.....stay tuned.....

 

[Callifo]

I just noticed this morning Im getting crashes when trying to run DUGG. Not sure how long its been going but I cant be that long as the data hasnt run out yet.

Error comes up as "isEmpty" is not understood.

Error log timestamp Saturday 17/06/06 01:25:08 PM

Runtime error: "isEmpty" not understood

MessageNotUnderstood>>defaultAction
MessageNotUnderstood(Exception)>>activateHandler: <anUndefinedObject> 
MessageNotUnderstood(Exception)>>handle
MessageNotUnderstood(Exception)>>signal
MessageNotUnderstood class>>message: <aMessage> 
UndefinedObject(Object)>>doesNotUnderstand: <aMessage> 
BasicRunProgram(BasicProgram)>>terminateRun: <aMessageNotUnderstood> 
[] in BasicProgram>>errorHandlerBlock
ExceptionHandler>>evaluateResponseBlock: <aBlockClosure> for: <aMessageNotUnderstood> 
[] in ExceptionHandler>>handle:
ProtectedFrameMarker(BlockClosure)>>setUnwind: <aBlockClosure> 
BlockClosure>>invisibleEnsure: <aBlockClosure> 
ExceptionHandler>>handle: <aMessageNotUnderstood> 
ExceptionHandler>>findHandler: <aMessageNotUnderstood> 
MessageNotUnderstood(Exception)>>activateHandler: <anExceptionHandler> 
MessageNotUnderstood(Exception)>>handle
MessageNotUnderstood(Exception)>>signal
MessageNotUnderstood class>>message: <aMessage> 
UndefinedObject(Object)>>doesNotUnderstand: <aMessage> 
BasicVariableManager>>assign: <111> toBe: <anUndefinedObject> 
BasicRunProgram(BasicProgram)>>assign: <111> toBe: <anUndefinedObject> 
BasicVariableAssigner>>value
[] in BasicRunProgram>>begin
ExceptionHandler>>evaluateProtectedBlock: <aBlockClosure> 
[] in ExceptionHandler>>activateDuring:
ProtectedFrameMarker(BlockClosure)>>setUnwind: <aBlockClosure> 
BlockClosure>>invisibleEnsure: <aBlockClosure> 
ExceptionHandler>>activateDuring: <aBlockClosure> 
ExceptionHandler class>>handle: <anError> with: <aBlockClosure> during: <aBlockClosure> 
BlockClosure>>on: <anError> do: <aBlockClosure> 
BasicRunProgram>>begin
BasicRunProgram(BasicProgram)>>run
BasicOnDemandCompiler class>>readTknFile: <aFileStream> callingProgram: <anUndefinedObject> commandLine: <Basic>>start
Message>>perform
NotificationManager>>empty
NotificationManager>>runPendingEvents
NotificationManager>>runEventLoop
Message>>perform
Message>>evaluate
Process>>safelyEvaluate: <aMessage> 
Process>>evaluate: <aMessage>

I tried updating DUGG and cleaning all the data out, but that made no difference.

 

[angusmann]

MSN have applied new and different encryption to their pages.

To complicate things, they are not using the same encryption each time. It keeps changing.

This new development is causing all the current grabbers to fail.

We are working on it but I can't give a timeframe yet because I am still asessing just what they are doing.

 

[petejo]

Perhaps it's time to change the source. Now that Ninemsn own HWW they "own" the guide data and appear to want to protect it. It sucks but that's life here in the land of getting it in the a*** from the Packers and Murdochs.

Perhaps we need DUGG to have 5 or so dedicated 'retrievers' who can then seed it to everyone else ? Special retriever's versions and the others just point to the seeders ?

That way it'll only be 5 hits on the source each day and shouldn't attract too much attention. Maybe even code in delays to the retriever so it stays further under the radar ?

Just some ideas, we'll need to get stealthy if we want to keep getting our xml's !!

Thanks Angusmann for all your work.

 

[Cavalier]

retrieving from Yahoo might be easier/safer?