Problem with XMLTV and TV Database (1 Viewer)

[blackheart42]

TV-Server Version:
MediaPortal Version: 0.2.3.0 RC3
MediaPortal Skin: Blue Two Wide
Windows Version: XP Pro SP2
CPU Type: Athlon XP 2600+
HDD: Maxtor 6Y120L0
Memory: 768MB DDR
Motherboard: Asus A7N8X-LA
Motherboard Chipset: VIA KM400
Motherboard Bios:
Video Card: ATI Radeon 7200
Video Card Driver: 8.252.0.0
Sound Card: On Motherboard
Sound Card AC3: no AC#
Sound Card Driver:
1. TV Card: Hauppauge PVR-250
1. TV Card Type: analog
1. TV Card Driver: 2.0.30.23074
MPEG2 Video Codec: MPV Version ?
MPEG2 Audio Codec: MPA Version ?
Remote: none
TV: LCD monitor
TV - HTPC Connection: VGA

I'm having a rather large problem when the system tries to import the new TVGuide.xml that XMLTV creates. RC2 worked okay, but with RC3 the attempt may succeed or may fail. In either case, the error logs are huge.

I've confirmed the same problem on a second PC. Both were clean installations of RC3.

To reproduce the problem:

1. Run the config tool and remove all programs from the TV database.
2. Run MP.
3. While MP is running, XMLTV runs and collects the current programs from Schedules Direct
4. At this point the error log goes crazy.

The exact result of this problem is somewhat variable. Sometimes the import is ultimately successful, sometimes not. Once I came back to my system to find that MP had consumed all virtual memory and still wanted more!

 

[Paranoid Delusion]

While MP is running, XMLTV runs and collects the current programs from Schedules Direct

Does this happen if MP is not running, only asking because something similar happened a while ago and was fixed, but like anything thats fixed can be broken again.

 

[druden]

TV-Server Version: 0.3 (from 22.10.2007)
MediaPortal Version: 0.2.3.0 RC3 with SVN 16.300
MediaPortal Skin: Xface 1.2 and MPblue (4:3)

Hi, can someone make a quick test to check if this is a generic XMLTV issue (will post logs etc. if this is not a generic issue):

I use XMLTV to get EPG info. XMLTV collects what seems to be perfectly valid information - I can import it to FreeGuide for intance, and all programmes have a nice title/headline + a description.

However, the TV Guide inside MP shows only the title for most programmes. For a few programmes, the description is shown too. If I check the XMLTV file with FreeGuide, complete information on the programme title AND description is shown.

I've attached to screen dumps showing an example.

blackheart42: can't seem to reproduce the problem you have here (got 2 mediaportal computers, both 0.2.3.0 RC3 with recent SVN and recent TV Engine 3 (0.3) :-(

 

[blackheart42]

I don't know why the system insists on merging these messages. In any case, here are my answers to Druden and Paranoid Delusion

TV-Server Version: 0.3 (from 22.10.2007)
MediaPortal Version: 0.2.3.0 RC3 with SVN 16.300
MediaPortal Skin: Xface 1.2 and MPblue (4:3)

Hi, can someone make a quick test to check if this is a generic XMLTV issue (will post logs etc. if this is not a generic issue):

I use XMLTV to get EPG info. XMLTV collects what seems to be perfectly valid information - I can import it to FreeGuide for intance, and all programmes have a nice title/headline + a description.

However, the TV Guide inside MP shows only the title for most programmes. For a few programmes, the description is shown too. If I check the XMLTV file with FreeGuide, complete information on the programme title AND description is shown.

I've attached to screen dumps showing an example.

@blackheart42: can't seem to reproduce the problem you have here (got 2 mediaportal computers, both 0.2.3.0 RC3 with recent SVN and recent TV Engine 3 (0.3) :-(

Hi Druden,

In spite of my problems, I do have full info on the programs - at least, when I can import the data at all. Have you tried looking at the TVdatabaseV21.db3 file with the sqlite database browser? It's in the mediaportal/docs directory. This will confirm that the data is being properly imported into the database.

Blackheart

While MP is running, XMLTV runs and collects the current programs from Schedules Direct

Does this happen if MP is not running, only asking because something similar happened a while ago and was fixed, but like anything thats fixed can be broken again.

When MP isn't running, the scheduled task calls TVGuideScheduler which calls XMLTV. TVGuideScheduler then imports the resulting xml file into the database with no errors. When I later run MP, it reports only 3 errors:

2007-10-23 14:45:04.546875 [ERROR][7]: SQLiteClient: query returned ERROR commit
2007-10-23 14:45:04.546875 [ERROR][7]: SQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
2007-10-23 14:45:04.546875 [ERROR][7]: tvdatabase commit failed exception errQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit

At all times, the database seems much more sluggish than with RC2 or earlier e.g. when sorting channels in the config tool or even when TVGuideScheduler is importing the data as described above (a couple of minutes for a 520K database? I think that before it took maybe 10-20 seconds).

Blackheart

 

[sleepycol]

I'm using RC3 with latest SVN (as of 19/10/07) and the hard drive access is crazy. It was continuosly access the hard drive for 10 mins after I shut media portal. I do not ve a slow machine its got an Intel E6300 with 1gb mem and decent hard drives so not system related.

It looks like its something to do with the TV database? See log extract below. Is there something I can do about the tV database?

2007-10-19 22:17:55.238500 [Info.][19]: SQLiteClient: Closing database:
2007-10-19 22:18:00.238500 [Info.][19]: SQLiteClient: query returned ERROR commit
2007-10-19 22:18:00.238500 [Info.][19]: SQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
2007-10-19 22:18:00.238500 [Info.][19]: tvdatabase commit failed exception errQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
2007-10-19 22:18:00.238500 [Info.][19]: opening tvdatabase
2007-10-19 22:18:00.347875 [Info.][19]: tvdatabase opened
2007-10-19 22:18:00.347875 [Info.][19]: import done
2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database: TVDatabaseV21.db3
2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database: FolderDatabase3.db3
2007-10-19 22:18:00.347875 [Info.][2]: GUITVCropManager: Stopped
2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database:
2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database: MusicDatabaseV10.db3
2007-10-19 22:18:00.363500 [Info.][2]: SQLiteClient: Closing database: ProgramDatabaseV4.db3

 

[Taipan]

TV-Server Version: N/A
MediaPortal Version: 0.2.3.0 RC3 + latest SVN
MediaPortal Skin: BlueTwo wide
Windows Version: Windows XP Prof. SP2
CPU Type: AMD Athlon XP 2700+
HDD: Seagate 200GB ATA100
Memory: 768MB - DDR 333 (PC3200)
Motherboard: Gigabyte 7VM400M-RZ
Motherboard Chipset: VIA KM400
Motherboard Bios:
Video Card: Gigabyte - Radeon 9550
Video Card Driver: ATI Radeon v6.4
Sound Card: On board VIA VT1617
Sound Card AC3: using 5.1 analog outputs
Sound Card Driver: VIA Vinyl Audio v6.50a
1. TV Card: Dvico FusionHDTV DVB-T
1. TV Card Type: DVB-T
1. TV Card Driver: v 3.50.02
2. TV Card: DNTVLive! LP DVB-T
2. TV Card Type: DVB-T
2. TV Card Driver: v 2.0.0.4
3. TV Card:
3. TV Card Type:
3. TV Card Driver:
4. TV Card:
4. TV Card Type:
4. TV Card Driver:
MPEG2 Video Codec: Cyberlink PowerDVD 7
MPEG2 Audio Codec: MPA
Satelite/CableTV Provider: none
HTPC Case: custom built
Cooling: custom built - super quiet
Power Supply: custom built - 200W
Remote: MCE - Australian version
TV: Mitsubishi HC1100 DLP projector
TV - HTPC Connection: D-sub (15 pin)



I have noticed the same error mesages appearing whenever the TVGuide.xml file is imported.

2007-10-27 18:37:56.187500 [Info.][16]: detected new tvguide ->import new tvguide
2007-10-27 18:37:56.687500 [Info.][16]: import done
2007-10-27 18:42:16.031250 [Info.][MPMain]: SQLiteClient: Closing database: 
2007-10-27 18:42:21.078125 [Info.][MPMain]: SQLiteClient: query returned ERROR commit
2007-10-27 18:42:21.078125 [Info.][MPMain]: SQLiteClient:  cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
2007-10-27 18:42:21.078125 [Info.][MPMain]: tvdatabase commit failed exception err:SQLiteClient:  cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit 
2007-10-27 18:42:21.078125 [Info.][MPMain]: opening tvdatabase
2007-10-27 18:42:21.187500 [Info.][MPMain]: tvdatabase opened

This error message has been appearing ever since v0.2.3.0 RC2 SVN 15947 (18/09/2007) and is still there in today's SVN.

However, it does not seem to have any effect on the operation of MediaPortal, for me at least.

 

[druden]

Have you tried looking at the TVdatabaseV21.db3 file with the sqlite database browser? It's in the mediaportal/docs directory. This will confirm that the data is being properly imported into the database.

Thanks a lot for the hint Blackheart, it proved to be very helpful!

I checked the programme "Hammerslag" shown on DR1 on 27.10.2007 begin 14:30 end 15:00.

TVGuide.xml seems ok (first screendump)
TVDatabaseV21 seems ok too (second screendump)
MediaPortal does not show the data (which is a string ~714 characters) (third screendump)

It seems to be a problem with all programmes on all channels after "TV Danmark", because programme information is missing for this channel. I removed the channel "TV Danmark" and then all programme info was displayed Sadly I can't watch TV Danmark now.

I'll consider posting a bug report on this issue if someone could veirfy the behaviour:

If there's a channel in the channel list og TVE3, for which XMLTV does not grab programme guide, all succeeding channels programmes are show without description?

 

[blackheart42]

Hi Druden,

Glad I could be of help.

I haven't looked at TVE3, but have you tried letting the config program rescan & rediscover TV Danmark? If it put that channel at the end of the database there wouldn't be any channels after it and you might not have any problems.

Blackheart

 

[sleepycol]

I have set my tv guide to use the dvb-t stream now and the hard drive access is much lower. However, surely to solve this problem with xmltv guide importing it would be sensible to only allow mp to perform the import at a specified time? There seems to be scheduling for everything else - the downloading etc but MP seems to just analyse and import the tv guide at random times when running. This causes problems with sluggish tv guide browsing.

So why not allow the user to specify a time for tvguide.xml file import to the tvdatabase? This should be allowed to be performed outside mp and scheduled in windows task scheduler.

 

[Taipan]

I have logged a bug report in Mantis for this error.