Can the XmlTv Plugin handle 600+ channels? (1 Viewer)

ChaosMageX

Portal Member
October 23, 2015
10
0
Home Country
United States of America United States of America
Country flag
I've finally finished mapping all the channels were scanned from my HDHomeRun over-the-air and cable tuners, which amounts to over 600. I forgot to calculate the exact number because not every channel had a matching channel in the tvguide.xml file retrieved from my Schedules Direct subscription, but most of the 649 total channels I have did have a match in the EPG data.

My question is: Can the plugin even handle writing the guide for that many channels?

I'm asking because after I finished mapping, and then saved it and then reloaded/refreshed it to make sure it was saved, and then clicked the Import button under the General tab, the TV Setup application is now unresponsive and has been for nearly an hour now. I'm really worried, because it's even more unresponsive than apps normally are, because it doesn't even have the (Unresponsive) in its title, but it isn't responding to my clicks. I can't even move the window around the screen, as it seems to be stuck in place. Now the close and minimize buttons in the upper right corner are weirdly flickering and I've never seen an application do that before on Windows 10, or any other version of Windows for that matter. It's also running on a rather powerful computer with a NVMe SSD, an AMD Ryzen 1600 CPU, and 16 GB of RAM, so it shouldn't be freezing up like this if it's just a matter of the amount of data to process.

EDIT: Well, it seems to have finally finished, and I can actually click stuff in the TV Setup application and move the window around the screen again. Checking the client application, it appears to have successfully imported the data for all the mapped channels. Still, why would it take that long on a SSD with a 1.5 GB/s linear read speed and a random read speed around 800 MB/s, along with a 6/12 core 3.2 GHz CPU, and 12 GB of the 16 GB of RAM available and ready to use?

Are there logs somewhere that I can check and see why it took so long?
 
Last edited:

HTPCSourcer

Retired Team Member
  • Premium Supporter
  • May 16, 2008
    11,431
    2,334
    Home Country
    Germany Germany
    Country flag
    why would it take that long on a SSD with a 1.5 GB/s linear read speed and a random read speed around 800 MB/s, along with a 6/12 core 3.2 GHz CPU, and 12 GB of the 16 GB of RAM available and ready to use?
    This is not a hardware thing but a limitation of the xmltv plugin, which handles every record (and possibly data field) one after the other. Every single show information is handled separately and a record is written for each single show of your 649 channels for probably 14 days, which will give you approx 649 x 14 x 24 show entries, each with ~five fields = approx 1 mio. fields to be added to the database. For every record the SQL database is opened, the information written into the different fields, etc. The process is not a mass process where all data is written at once. The xmltv plugin that comes with the TV package is probably 10 years old and has not been touched since then.

    There may also be an issue with your import settings. Best would be to have the complete EPG deleted before adding new data. The EPG read process should be visible in the server log.
     

    framug

    Super Moderator
  • Team MediaPortal
  • January 31, 2005
    4,864
    857
    South of France
    Home Country
    France France
    Country flag
    Same as HTPCSourcer wrote, the process of this plugin is not a mass process.
    Depending where you download your xmltv.xml file, some websites propose to have a personal file (you choose what are channels in the .xml).

    An example for french country :

    zz1.png


    It takes 2 minutes an 5 seconds for 4765 programs imported on my system :

    zz2.png


    If you have 218 000 imported programs then, it's 45 times more than I so, it would take more than 90 minutes.

    If you schedule your import when you watch TV (for example 9H00 PM) then, import could be invisible..
     

    Users who are viewing this thread

    Similar threads

    Many people found the Lentoid decoder better optimised than LAV for software decoding. If you want to try it, download it from the link below, run reg.bat as an admin to install it and change the HEVC Video settings in MediaPortal Configuration/Codecs and Renderer...
    Many people found the Lentoid decoder better optimised than LAV for software decoding. If you want to try it, download it from the...
    For some unknown reason I can't play HEVC encoded video with MP1 on my system. I have tried every trick I know, but nothing works...
    Replies
    10
    Views
    599
    Anecdotal testimonies are not helpful. If you guys would like to continue this chat, I'll move this thread to the Café section. The discussion about your issues is taking place here: Installation failing
    Anecdotal testimonies are not helpful. If you guys would like to continue this chat, I'll move this thread to the Café section...
    I have been looking for a replacement to Windows Media Center for a little over a year.No luck. Now, I'm no Microsoft fanboy, but I...
    Replies
    15
    Views
    3K
    Hello Bob, Thanks for the feedback :). Iti is not easy to thoroughly answer such an email in a few minutes and I guess that's why it took us so long to reply. We don't recommend using fast forward. Its performance greatly depends on the hardware/codec combination as well as the connection speed. In your case Wifi is probably an...
    Hello Bob, Thanks for the feedback :). Iti is not easy to thoroughly answer such an email in a few minutes and I guess that's why...
    Trying out MP 2.1 for TV use but encountering problems. I am now using network credentials username and passwords but this made no...
    Replies
    1
    Views
    748
    • Sticky
    And now it works, including remote button on and off. Thanks @azzuro it was me using the wrong version it seems. Attachment in first post might want to be deleted incase other noobs like me make same mistake maybe :)
    And now it works, including remote button on and off. Thanks @azzuro it was me using the wrong version it seems. Attachment in...
    For amblight / Hyperion users made something new that works a bit better with madVR image capture and doesn't use AtmoLight, this...
    Replies
    31
    Views
    7K
    Sorry to hear that you have to go to hospital. I hope that all wil be fine. In fact you have already all the information needed. The database name and the table name are the same than in mySQL for ArgusTV. How can I provide you the Backup file ?
    Sorry to hear that you have to go to hospital. I hope that all wil be fine. In fact you have already all the information needed...
    Hi. I like to introduce our latest tool, called "EPG-Buddy". This program should make EPG grabbing as easy as possible. Up to now a...
    Replies
    445
    Views
    118K
    Top Bottom