Problem with XMLTV and TV Database (1 Viewer)

blackheart42

Portal Pro
October 13, 2006
58
1
Canada Canada
TV-Server Version:
MediaPortal Version: 0.2.3.0 RC3
MediaPortal Skin: Blue Two Wide
Windows Version: XP Pro SP2
CPU Type: Athlon XP 2600+
HDD: Maxtor 6Y120L0
Memory: 768MB DDR
Motherboard: Asus A7N8X-LA
Motherboard Chipset: VIA KM400
Motherboard Bios:
Video Card: ATI Radeon 7200
Video Card Driver: 8.252.0.0
Sound Card: On Motherboard
Sound Card AC3: no AC#
Sound Card Driver:
1. TV Card: Hauppauge PVR-250
1. TV Card Type: analog
1. TV Card Driver: 2.0.30.23074
MPEG2 Video Codec: MPV Version ?
MPEG2 Audio Codec: MPA Version ?
Remote: none
TV: LCD monitor
TV - HTPC Connection: VGA

I'm having a rather large problem when the system tries to import the new TVGuide.xml that XMLTV creates. RC2 worked okay, but with RC3 the attempt may succeed or may fail. In either case, the error logs are huge.

I've confirmed the same problem on a second PC. Both were clean installations of RC3.

To reproduce the problem:

1. Run the config tool and remove all programs from the TV database.
2. Run MP.
3. While MP is running, XMLTV runs and collects the current programs from Schedules Direct
4. At this point the error log goes crazy.

The exact result of this problem is somewhat variable. Sometimes the import is ultimately successful, sometimes not. Once I came back to my system to find that MP had consumed all virtual memory and still wanted more!
 

Paranoid Delusion

Moderation Manager
  • Premium Supporter
  • June 13, 2005
    13,062
    2,978
    Cheshire
    United Kingdom United Kingdom
    While MP is running, XMLTV runs and collects the current programs from Schedules Direct
    Does this happen if MP is not running, only asking because something similar happened a while ago and was fixed, but like anything thats fixed can be broken again.
     

    druden

    Portal Pro
    January 2, 2006
    54
    0
    Denmark
    TV-Server Version: 0.3 (from 22.10.2007)
    MediaPortal Version: 0.2.3.0 RC3 with SVN 16.300
    MediaPortal Skin: Xface 1.2 and MPblue (4:3)

    Hi, can someone make a quick test to check if this is a generic XMLTV issue (will post logs etc. if this is not a generic issue):

    I use XMLTV to get EPG info. XMLTV collects what seems to be perfectly valid information - I can import it to FreeGuide for intance, and all programmes have a nice title/headline + a description.

    However, the TV Guide inside MP shows only the title for most programmes. For a few programmes, the description is shown too. If I check the XMLTV file with FreeGuide, complete information on the programme title AND description is shown.

    I've attached to screen dumps showing an example.

    blackheart42: can't seem to reproduce the problem you have here (got 2 mediaportal computers, both 0.2.3.0 RC3 with recent SVN and recent TV Engine 3 (0.3) :-(
     

    Attachments

    blackheart42

    Portal Pro
    October 13, 2006
    58
    1
    Canada Canada
    I don't know why the system insists on merging these messages. In any case, here are my answers to Druden and Paranoid Delusion

    TV-Server Version: 0.3 (from 22.10.2007)
    MediaPortal Version: 0.2.3.0 RC3 with SVN 16.300
    MediaPortal Skin: Xface 1.2 and MPblue (4:3)

    Hi, can someone make a quick test to check if this is a generic XMLTV issue (will post logs etc. if this is not a generic issue):

    I use XMLTV to get EPG info. XMLTV collects what seems to be perfectly valid information - I can import it to FreeGuide for intance, and all programmes have a nice title/headline + a description.

    However, the TV Guide inside MP shows only the title for most programmes. For a few programmes, the description is shown too. If I check the XMLTV file with FreeGuide, complete information on the programme title AND description is shown.

    I've attached to screen dumps showing an example.

    @blackheart42: can't seem to reproduce the problem you have here (got 2 mediaportal computers, both 0.2.3.0 RC3 with recent SVN and recent TV Engine 3 (0.3) :-(

    Hi Druden,

    In spite of my problems, I do have full info on the programs - at least, when I can import the data at all. :) Have you tried looking at the TVdatabaseV21.db3 file with the sqlite database browser? It's in the mediaportal/docs directory. This will confirm that the data is being properly imported into the database.

    Blackheart

    While MP is running, XMLTV runs and collects the current programs from Schedules Direct
    Does this happen if MP is not running, only asking because something similar happened a while ago and was fixed, but like anything thats fixed can be broken again.
    When MP isn't running, the scheduled task calls TVGuideScheduler which calls XMLTV. TVGuideScheduler then imports the resulting xml file into the database with no errors. When I later run MP, it reports only 3 errors:

    2007-10-23 14:45:04.546875 [ERROR][7]: SQLiteClient: query returned ERROR commit
    2007-10-23 14:45:04.546875 [ERROR][7]: SQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
    2007-10-23 14:45:04.546875 [ERROR][7]: tvdatabase commit failed exception err:confused:QLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit

    At all times, the database seems much more sluggish than with RC2 or earlier e.g. when sorting channels in the config tool or even when TVGuideScheduler is importing the data as described above (a couple of minutes for a 520K database? I think that before it took maybe 10-20 seconds).

    Blackheart
     

    sleepycol

    Portal Pro
    June 2, 2006
    536
    39
    United Kingdom United Kingdom
    Country flag
    I'm using RC3 with latest SVN (as of 19/10/07) and the hard drive access is crazy. It was continuosly access the hard drive for 10 mins after I shut media portal. I do not ve a slow machine its got an Intel E6300 with 1gb mem and decent hard drives so not system related.

    It looks like its something to do with the TV database? See log extract below. Is there something I can do about the tV database?

    2007-10-19 22:17:55.238500 [Info.][19]: SQLiteClient: Closing database:
    2007-10-19 22:18:00.238500 [Info.][19]: SQLiteClient: query returned ERROR commit
    2007-10-19 22:18:00.238500 [Info.][19]: SQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
    2007-10-19 22:18:00.238500 [Info.][19]: tvdatabase commit failed exception errQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
    2007-10-19 22:18:00.238500 [Info.][19]: opening tvdatabase
    2007-10-19 22:18:00.347875 [Info.][19]: tvdatabase opened
    2007-10-19 22:18:00.347875 [Info.][19]: import done
    2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database: TVDatabaseV21.db3
    2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database: FolderDatabase3.db3
    2007-10-19 22:18:00.347875 [Info.][2]: GUITVCropManager: Stopped
    2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database:
    2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database: MusicDatabaseV10.db3
    2007-10-19 22:18:00.363500 [Info.][2]: SQLiteClient: Closing database: ProgramDatabaseV4.db3
     

    Taipan

    Retired Team Member
  • Premium Supporter
  • February 23, 2005
    2,075
    44
    Melbourne
    Australia Australia
    Country flag
    TV-Server Version: N/A
    MediaPortal Version: 0.2.3.0 RC3 + latest SVN
    MediaPortal Skin: BlueTwo wide
    Windows Version: Windows XP Prof. SP2
    CPU Type: AMD Athlon XP 2700+
    HDD: Seagate 200GB ATA100
    Memory: 768MB - DDR 333 (PC3200)
    Motherboard: Gigabyte 7VM400M-RZ
    Motherboard Chipset: VIA KM400
    Motherboard Bios:
    Video Card: Gigabyte - Radeon 9550
    Video Card Driver: ATI Radeon v6.4
    Sound Card: On board VIA VT1617
    Sound Card AC3: using 5.1 analog outputs
    Sound Card Driver: VIA Vinyl Audio v6.50a
    1. TV Card: Dvico FusionHDTV DVB-T
    1. TV Card Type: DVB-T
    1. TV Card Driver: v 3.50.02
    2. TV Card: DNTVLive! LP DVB-T
    2. TV Card Type: DVB-T
    2. TV Card Driver: v 2.0.0.4
    3. TV Card:
    3. TV Card Type:
    3. TV Card Driver:
    4. TV Card:
    4. TV Card Type:
    4. TV Card Driver:
    MPEG2 Video Codec: Cyberlink PowerDVD 7
    MPEG2 Audio Codec: MPA
    Satelite/CableTV Provider: none
    HTPC Case: custom built
    Cooling: custom built - super quiet
    Power Supply: custom built - 200W
    Remote: MCE - Australian version
    TV: Mitsubishi HC1100 DLP projector
    TV - HTPC Connection: D-sub (15 pin)



    I have noticed the same error mesages appearing whenever the TVGuide.xml file is imported.


    Code:
    2007-10-27 18:37:56.187500 [Info.][16]: detected new tvguide ->import new tvguide
    2007-10-27 18:37:56.687500 [Info.][16]: import done
    2007-10-27 18:42:16.031250 [Info.][MPMain]: SQLiteClient: Closing database: 
    2007-10-27 18:42:21.078125 [Info.][MPMain]: SQLiteClient: query returned ERROR commit
    2007-10-27 18:42:21.078125 [Info.][MPMain]: SQLiteClient:  cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
    2007-10-27 18:42:21.078125 [Info.][MPMain]: tvdatabase commit failed exception err:SQLiteClient:  cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit 
    2007-10-27 18:42:21.078125 [Info.][MPMain]: opening tvdatabase
    2007-10-27 18:42:21.187500 [Info.][MPMain]: tvdatabase opened
    This error message has been appearing ever since v0.2.3.0 RC2 SVN 15947 (18/09/2007) and is still there in today's SVN.

    However, it does not seem to have any effect on the operation of MediaPortal, for me at least.
     

    druden

    Portal Pro
    January 2, 2006
    54
    0
    Denmark
    Have you tried looking at the TVdatabaseV21.db3 file with the sqlite database browser? It's in the mediaportal/docs directory. This will confirm that the data is being properly imported into the database.
    Thanks a lot for the hint Blackheart, it proved to be very helpful!

    I checked the programme "Hammerslag" shown on DR1 on 27.10.2007 begin 14:30 end 15:00.

    TVGuide.xml seems ok (first screendump)
    TVDatabaseV21 seems ok too (second screendump)
    MediaPortal does not show the data (which is a string ~714 characters) (third screendump)

    It seems to be a problem with all programmes on all channels after "TV Danmark", because programme information is missing for this channel. I removed the channel "TV Danmark" and then all programme info was displayed :) Sadly I can't watch TV Danmark now.

    I'll consider posting a bug report on this issue if someone could veirfy the behaviour:

    If there's a channel in the channel list og TVE3, for which XMLTV does not grab programme guide, all succeeding channels programmes are show without description?
     

    blackheart42

    Portal Pro
    October 13, 2006
    58
    1
    Canada Canada
    Hi Druden,

    Glad I could be of help.

    I haven't looked at TVE3, but have you tried letting the config program rescan & rediscover TV Danmark? If it put that channel at the end of the database there wouldn't be any channels after it and you might not have any problems.

    Blackheart
     

    sleepycol

    Portal Pro
    June 2, 2006
    536
    39
    United Kingdom United Kingdom
    Country flag
    I have set my tv guide to use the dvb-t stream now and the hard drive access is much lower. However, surely to solve this problem with xmltv guide importing it would be sensible to only allow mp to perform the import at a specified time? There seems to be scheduling for everything else - the downloading etc but MP seems to just analyse and import the tv guide at random times when running. This causes problems with sluggish tv guide browsing.

    So why not allow the user to specify a time for tvguide.xml file import to the tvdatabase? This should be allowed to be performed outside mp and scheduled in windows task scheduler.
     

    Users Who Are Viewing This Thread (Users: 0, Guests: 1)

    OP Similar threads Forum Replies Date
    F Problems with new install of MP2 Newcomers Forum 3
    A [solved] DiseqC problems after upgrade to 1.25 General Support 1
    M Problems with VFD Display after standby- Futaba DM140GINK Mini Display 0
    R Connection (api) problems with thetvdb.com General 3
    123vak123 [solved] 5008: The problem with scrolling text in the "listcontrol" in 4K General Support 22
    framug 1.24.0 1.25.0 pre : problem with build ? 1.24 Pre Release 75
    J Problems with 1.24 StreamedMP 19
    Rob Hexenmeister Navigation problems adding menu buttons to EPG General Support 1
    404 [solved] EPG problem after Win10 'upgrade' General Support 1
    framug [EPG] Some problems with DVB EPG Improvement Suggestions 49
    C strange tuner(?) problem TV-Cards 0
    R Problems accessing MySQL database remotely MediaPortal 1 Talk 0
    T [solved] Startup problem General 6
    G Problems with DRR MediaPortal 1 Talk 1
    rsbrux 1.23.0 MPE Manager Problem with LAV Filters Bugreports 2
    S Problem with Remote Control One-for-all Streamer Newcomers Forum 6
    joecrow Default Wide HD Xmas Theme Problem General Support 3
    K Sleep mode problem after formating General Support 2
    P IPTV Channel Problem TV-Server 0
    C Problem playing videos created on IPhone X and Samsung S9 General Support 2
    nominefi Problem scanning channels. General Support 0
    E Swedish subtitles problem General 2
    G Newb trying MP2, trouble with guide data General 5
    G MP1 TV Server "failed to upgrade the database" using MS Sql Server Installation, configuration support 3
    geotwticher [solved] Fatal Error 0x80070643 during MP2 installation General 7
    Top Bottom