Can the XmlTv Plugin handle 600+ channels? (1 Viewer)

ChaosMageX

Portal Member
October 23, 2015
10
0
United States of America United States of America
Country flag
I've finally finished mapping all the channels were scanned from my HDHomeRun over-the-air and cable tuners, which amounts to over 600. I forgot to calculate the exact number because not every channel had a matching channel in the tvguide.xml file retrieved from my Schedules Direct subscription, but most of the 649 total channels I have did have a match in the EPG data.

My question is: Can the plugin even handle writing the guide for that many channels?

I'm asking because after I finished mapping, and then saved it and then reloaded/refreshed it to make sure it was saved, and then clicked the Import button under the General tab, the TV Setup application is now unresponsive and has been for nearly an hour now. I'm really worried, because it's even more unresponsive than apps normally are, because it doesn't even have the (Unresponsive) in its title, but it isn't responding to my clicks. I can't even move the window around the screen, as it seems to be stuck in place. Now the close and minimize buttons in the upper right corner are weirdly flickering and I've never seen an application do that before on Windows 10, or any other version of Windows for that matter. It's also running on a rather powerful computer with a NVMe SSD, an AMD Ryzen 1600 CPU, and 16 GB of RAM, so it shouldn't be freezing up like this if it's just a matter of the amount of data to process.

EDIT: Well, it seems to have finally finished, and I can actually click stuff in the TV Setup application and move the window around the screen again. Checking the client application, it appears to have successfully imported the data for all the mapped channels. Still, why would it take that long on a SSD with a 1.5 GB/s linear read speed and a random read speed around 800 MB/s, along with a 6/12 core 3.2 GHz CPU, and 12 GB of the 16 GB of RAM available and ready to use?

Are there logs somewhere that I can check and see why it took so long?
 
Last edited:

HTPCSourcer

MP2 Product Manager
  • Team MediaPortal
  • May 16, 2008
    11,431
    2,334
    Germany Germany
    Country flag
    why would it take that long on a SSD with a 1.5 GB/s linear read speed and a random read speed around 800 MB/s, along with a 6/12 core 3.2 GHz CPU, and 12 GB of the 16 GB of RAM available and ready to use?
    This is not a hardware thing but a limitation of the xmltv plugin, which handles every record (and possibly data field) one after the other. Every single show information is handled separately and a record is written for each single show of your 649 channels for probably 14 days, which will give you approx 649 x 14 x 24 show entries, each with ~five fields = approx 1 mio. fields to be added to the database. For every record the SQL database is opened, the information written into the different fields, etc. The process is not a mass process where all data is written at once. The xmltv plugin that comes with the TV package is probably 10 years old and has not been touched since then.

    There may also be an issue with your import settings. Best would be to have the complete EPG deleted before adding new data. The EPG read process should be visible in the server log.
     

    framug

    Super Moderator
  • Team MediaPortal
  • January 31, 2005
    4,554
    569
    South of France
    France France
    Country flag
    Same as HTPCSourcer wrote, the process of this plugin is not a mass process.
    Depending where you download your xmltv.xml file, some websites propose to have a personal file (you choose what are channels in the .xml).

    An example for french country :

    zz1.png


    It takes 2 minutes an 5 seconds for 4765 programs imported on my system :

    zz2.png


    If you have 218 000 imported programs then, it's 45 times more than I so, it would take more than 90 minutes.

    If you schedule your import when you watch TV (for example 9H00 PM) then, import could be invisible..
     

    Users Who Are Viewing This Thread (Users: 0, Guests: 1)

    OP Similar threads Forum Replies Date
    J Schedules Direct - XmlTV Plugin xmlTV 6
    framug No color in TVGuide when XMLTV without DVB EPG MediaPortal 1 Talk 59
    B xmltv - cannot import tvguide.xml australia Installation, configuration support 0
    geotwticher TV Guide EPG Grabber for Australia 2020 RIP freepg.tv General 4
    P Timeshifting in XMLTV General 2
    JJDoherty 1.22.0 XMLTV not raising the following OnImportEpgPrograms event... 1.22 0
    lacanox XMLTV not writing the tv schedule Electronic Program Guide 3
    A [solved] XmlTv not importing programs General 8
    dcapslock TV Server xmltv IWakeupHandler Bug Television (MyTV frontend and TV-Server) 6
    T No data available using xmltv and mc2xml xmlTV 2
    W XMLTVImport duplicate item error xmlTV 5
    morpheus_xx [WiP] "What's New" plugin for MP2 upgrades MediaPortal 2 5
    da3dsoul [Request] An MVP Plugin example for custom settings in MP2 Plugin Development 2
    da3dsoul MP2 Plugin - Getting Started (Directory Tree and Player) Plugin Development 27
    M Installing Plugins Newcomers Forum 2
    joecrow 1.25.0 Radio Time plugin fails after Resume from Sleep with MP 1.25 Bugreports 4
    P MP2: US user, OTA - can NOT get SchedulesDirect plugin to work on MP1 or MP2 --> how do I get OTA schedule? General 5
    E aktuelle englische Forums Webseite von - Showtime Plugin v3 Plugins & Erweiterungen 4
    mrmojo666 [Tv Server Plugin ]Direct Show Video Control Plugin 0.0.0.1 for Hauppauge PVR cards MediaPortal 1 Plugins 0
    joecrow MultiShortcut Plugin (Uavailable) in DWHD skin General Support 58
    vapourEyes Building TV Plugin General Development (no feature request here!) 49
    Golf4 Nach Windows-Updates läuft TV-Plugin nicht mehr Allgemeines Support- und Diskussionsforum 0
    joecrow How about a Launcher plugin for MP1? MediaPortal 1 6
    D [solved] TVServer Plugin must be missing something. General Development (no feature request here!) 1
    framug Nouveau plugin XmlTvFR pour récupérer le guide télé français Kazer / ZguideTv (WebEPGfr) 11
    Similar threads

























    Top Bottom