Problem with XMLTV and TV Database

Discussion in '0.2.3.0 RC3 and SVN Builds' started by blackheart42, October 23, 2007.

  1. blackheart42

    blackheart42 Portal Pro

    Joined:
    October 13, 2006
    Messages:
    58
    Likes Received:
    1
    Ratings:
    +1 / 0
    Home Country:
    Canada Canada
    TV-Server Version:
    MediaPortal Version: 0.2.3.0 RC3
    MediaPortal Skin: Blue Two Wide
    Windows Version: XP Pro SP2
    CPU Type: Athlon XP 2600+
    HDD: Maxtor 6Y120L0
    Memory: 768MB DDR
    Motherboard: Asus A7N8X-LA
    Motherboard Chipset: VIA KM400
    Motherboard Bios:
    Video Card: ATI Radeon 7200
    Video Card Driver: 8.252.0.0
    Sound Card: On Motherboard
    Sound Card AC3: no AC#
    Sound Card Driver:
    1. TV Card: Hauppauge PVR-250
    1. TV Card Type: analog
    1. TV Card Driver: 2.0.30.23074
    MPEG2 Video Codec: MPV Version ?
    MPEG2 Audio Codec: MPA Version ?
    Remote: none
    TV: LCD monitor
    TV - HTPC Connection: VGA



    I'm having a rather large problem when the system tries to import the new TVGuide.xml that XMLTV creates. RC2 worked okay, but with RC3 the attempt may succeed or may fail. In either case, the error logs are huge.

    I've confirmed the same problem on a second PC. Both were clean installations of RC3.

    To reproduce the problem:

    1. Run the config tool and remove all programs from the TV database.
    2. Run MP.
    3. While MP is running, XMLTV runs and collects the current programs from Schedules Direct
    4. At this point the error log goes crazy.

    The exact result of this problem is somewhat variable. Sometimes the import is ultimately successful, sometimes not. Once I came back to my system to find that MP had consumed all virtual memory and still wanted more!
     
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. Paranoid Delusion
    • Team MediaPortal

    Paranoid Delusion Moderation Manager

    Joined:
    June 13, 2005
    Messages:
    13,062
    Likes Received:
    1,481
    Gender:
    Male
    Occupation:
    Electrical Engineer
    Location:
    Cheshire
    Ratings:
    +1,482 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Does this happen if MP is not running, only asking because something similar happened a while ago and was fixed, but like anything thats fixed can be broken again.
     
  4. druden

    druden Portal Pro

    Joined:
    January 2, 2006
    Messages:
    54
    Likes Received:
    0
    Occupation:
    IT Support Manager
    Location:
    Denmark
    Ratings:
    +0 / 0
    TV-Server Version: 0.3 (from 22.10.2007)
    MediaPortal Version: 0.2.3.0 RC3 with SVN 16.300
    MediaPortal Skin: Xface 1.2 and MPblue (4:3)

    Hi, can someone make a quick test to check if this is a generic XMLTV issue (will post logs etc. if this is not a generic issue):

    I use XMLTV to get EPG info. XMLTV collects what seems to be perfectly valid information - I can import it to FreeGuide for intance, and all programmes have a nice title/headline + a description.

    However, the TV Guide inside MP shows only the title for most programmes. For a few programmes, the description is shown too. If I check the XMLTV file with FreeGuide, complete information on the programme title AND description is shown.

    I've attached to screen dumps showing an example.

    blackheart42: can't seem to reproduce the problem you have here (got 2 mediaportal computers, both 0.2.3.0 RC3 with recent SVN and recent TV Engine 3 (0.3) :-(
     

    Attached Files:

    • tvguide.jpg
      tvguide.jpg
      File size:
      61.1 KB
      Uploaded:
      October 23, 2007
      Views:
      152
    • mediaportal.jpg
      mediaportal.jpg
      File size:
      71 KB
      Uploaded:
      October 23, 2007
      Views:
      163
  5. blackheart42

    blackheart42 Portal Pro

    Joined:
    October 13, 2006
    Messages:
    58
    Likes Received:
    1
    Ratings:
    +1 / 0
    Home Country:
    Canada Canada
    I don't know why the system insists on merging these messages. In any case, here are my answers to Druden and Paranoid Delusion


    Hi Druden,

    In spite of my problems, I do have full info on the programs - at least, when I can import the data at all. :) Have you tried looking at the TVdatabaseV21.db3 file with the sqlite database browser? It's in the mediaportal/docs directory. This will confirm that the data is being properly imported into the database.

    Blackheart

    When MP isn't running, the scheduled task calls TVGuideScheduler which calls XMLTV. TVGuideScheduler then imports the resulting xml file into the database with no errors. When I later run MP, it reports only 3 errors:

    2007-10-23 14:45:04.546875 [ERROR][7]: SQLiteClient: query returned ERROR commit
    2007-10-23 14:45:04.546875 [ERROR][7]: SQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
    2007-10-23 14:45:04.546875 [ERROR][7]: tvdatabase commit failed exception err:confused:QLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit

    At all times, the database seems much more sluggish than with RC2 or earlier e.g. when sorting channels in the config tool or even when TVGuideScheduler is importing the data as described above (a couple of minutes for a 520K database? I think that before it took maybe 10-20 seconds).

    Blackheart
     
  6. sleepycol

    sleepycol Portal Pro

    Joined:
    June 2, 2006
    Messages:
    514
    Likes Received:
    24
    Ratings:
    +33 / 1
    Home Country:
    United Kingdom United Kingdom
    I'm using RC3 with latest SVN (as of 19/10/07) and the hard drive access is crazy. It was continuosly access the hard drive for 10 mins after I shut media portal. I do not ve a slow machine its got an Intel E6300 with 1gb mem and decent hard drives so not system related.

    It looks like its something to do with the TV database? See log extract below. Is there something I can do about the tV database?

    2007-10-19 22:17:55.238500 [Info.][19]: SQLiteClient: Closing database:
    2007-10-19 22:18:00.238500 [Info.][19]: SQLiteClient: query returned ERROR commit
    2007-10-19 22:18:00.238500 [Info.][19]: SQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
    2007-10-19 22:18:00.238500 [Info.][19]: tvdatabase commit failed exception errQLiteClient: cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
    2007-10-19 22:18:00.238500 [Info.][19]: opening tvdatabase
    2007-10-19 22:18:00.347875 [Info.][19]: tvdatabase opened
    2007-10-19 22:18:00.347875 [Info.][19]: import done
    2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database: TVDatabaseV21.db3
    2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database: FolderDatabase3.db3
    2007-10-19 22:18:00.347875 [Info.][2]: GUITVCropManager: Stopped
    2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database:
    2007-10-19 22:18:00.347875 [Info.][2]: SQLiteClient: Closing database: MusicDatabaseV10.db3
    2007-10-19 22:18:00.363500 [Info.][2]: SQLiteClient: Closing database: ProgramDatabaseV4.db3
     
  7. Taipan
    • Team MediaPortal

    Taipan Retired Team Member

    Joined:
    February 23, 2005
    Messages:
    2,075
    Likes Received:
    22
    Gender:
    Male
    Location:
    Melbourne
    Ratings:
    +23 / 0
    Home Country:
    Australia Australia
    Show System Specs
    TV-Server Version: N/A
    MediaPortal Version: 0.2.3.0 RC3 + latest SVN
    MediaPortal Skin: BlueTwo wide
    Windows Version: Windows XP Prof. SP2
    CPU Type: AMD Athlon XP 2700+
    HDD: Seagate 200GB ATA100
    Memory: 768MB - DDR 333 (PC3200)
    Motherboard: Gigabyte 7VM400M-RZ
    Motherboard Chipset: VIA KM400
    Motherboard Bios:
    Video Card: Gigabyte - Radeon 9550
    Video Card Driver: ATI Radeon v6.4
    Sound Card: On board VIA VT1617
    Sound Card AC3: using 5.1 analog outputs
    Sound Card Driver: VIA Vinyl Audio v6.50a
    1. TV Card: Dvico FusionHDTV DVB-T
    1. TV Card Type: DVB-T
    1. TV Card Driver: v 3.50.02
    2. TV Card: DNTVLive! LP DVB-T
    2. TV Card Type: DVB-T
    2. TV Card Driver: v 2.0.0.4
    3. TV Card:
    3. TV Card Type:
    3. TV Card Driver:
    4. TV Card:
    4. TV Card Type:
    4. TV Card Driver:
    MPEG2 Video Codec: Cyberlink PowerDVD 7
    MPEG2 Audio Codec: MPA
    Satelite/CableTV Provider: none
    HTPC Case: custom built
    Cooling: custom built - super quiet
    Power Supply: custom built - 200W
    Remote: MCE - Australian version
    TV: Mitsubishi HC1100 DLP projector
    TV - HTPC Connection: D-sub (15 pin)



    I have noticed the same error mesages appearing whenever the TVGuide.xml file is imported.


    Code (Text):
    1. 2007-10-27 18:37:56.187500 [Info.][16]: detected new tvguide ->import new tvguide
    2. 2007-10-27 18:37:56.687500 [Info.][16]: import done
    3. 2007-10-27 18:42:16.031250 [Info.][MPMain]: SQLiteClient: Closing database:
    4. 2007-10-27 18:42:21.078125 [Info.][MPMain]: SQLiteClient: query returned ERROR commit
    5. 2007-10-27 18:42:21.078125 [Info.][MPMain]: SQLiteClient:  cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
    6. 2007-10-27 18:42:21.078125 [Info.][MPMain]: tvdatabase commit failed exception err:SQLiteClient:  cmd:sqlite3_finalize err:ERROR detailed:cannot commit - no transaction is active query:commit
    7. 2007-10-27 18:42:21.078125 [Info.][MPMain]: opening tvdatabase
    8. 2007-10-27 18:42:21.187500 [Info.][MPMain]: tvdatabase opened
    This error message has been appearing ever since v0.2.3.0 RC2 SVN 15947 (18/09/2007) and is still there in today's SVN.

    However, it does not seem to have any effect on the operation of MediaPortal, for me at least.
     
  8. druden

    druden Portal Pro

    Joined:
    January 2, 2006
    Messages:
    54
    Likes Received:
    0
    Occupation:
    IT Support Manager
    Location:
    Denmark
    Ratings:
    +0 / 0
    Thanks a lot for the hint Blackheart, it proved to be very helpful!

    I checked the programme "Hammerslag" shown on DR1 on 27.10.2007 begin 14:30 end 15:00.

    TVGuide.xml seems ok (first screendump)
    TVDatabaseV21 seems ok too (second screendump)
    MediaPortal does not show the data (which is a string ~714 characters) (third screendump)

    It seems to be a problem with all programmes on all channels after "TV Danmark", because programme information is missing for this channel. I removed the channel "TV Danmark" and then all programme info was displayed :) Sadly I can't watch TV Danmark now.

    I'll consider posting a bug report on this issue if someone could veirfy the behaviour:

    If there's a channel in the channel list og TVE3, for which XMLTV does not grab programme guide, all succeeding channels programmes are show without description?
     
  9. blackheart42

    blackheart42 Portal Pro

    Joined:
    October 13, 2006
    Messages:
    58
    Likes Received:
    1
    Ratings:
    +1 / 0
    Home Country:
    Canada Canada
    Hi Druden,

    Glad I could be of help.

    I haven't looked at TVE3, but have you tried letting the config program rescan & rediscover TV Danmark? If it put that channel at the end of the database there wouldn't be any channels after it and you might not have any problems.

    Blackheart
     
  10. sleepycol

    sleepycol Portal Pro

    Joined:
    June 2, 2006
    Messages:
    514
    Likes Received:
    24
    Ratings:
    +33 / 1
    Home Country:
    United Kingdom United Kingdom
    I have set my tv guide to use the dvb-t stream now and the hard drive access is much lower. However, surely to solve this problem with xmltv guide importing it would be sensible to only allow mp to perform the import at a specified time? There seems to be scheduling for everything else - the downloading etc but MP seems to just analyse and import the tv guide at random times when running. This causes problems with sluggish tv guide browsing.

    So why not allow the user to specify a time for tvguide.xml file import to the tvdatabase? This should be allowed to be performed outside mp and scheduled in windows task scheduler.
     
  11. Taipan
    • Team MediaPortal

    Taipan Retired Team Member

    Joined:
    February 23, 2005
    Messages:
    2,075
    Likes Received:
    22
    Gender:
    Male
    Location:
    Melbourne
    Ratings:
    +23 / 0
    Home Country:
    Australia Australia
    Show System Specs
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!