How Long To Import EPG (1 Viewer)
- Thread starter EViS
- Start date
My 14 day xml file takes around 3-4 minutes for 47 stations to update, but then a further 10 minutes of processing is done by ForTheRecord on series\new\missed recordings, you can see the serious cpu activity between FTR and MySQL.
- Thread starter
- #3
My data is saved to the MP database as opposed to an xml file. This then takes around 45min to 1 hour to import into the MP TV Guide gui! Obviously the problem only ever occurs when I've wiped all the channels for a new rescan or after a completely fresh restall.
Could the problem be that I shouldn't be writing data to the database? Is an xml file the recommended method? It just seems nice to have this data in the database as opposed to the 'old school' method
.
Could the problem be that I shouldn't be writing data to the database? Is an xml file the recommended method? It just seems nice to have this data in the database as opposed to the 'old school' method
.Eventually the data has to get to the database. If you use an xml file you just add another (unnecessary) step.
The delay is most probably due to slow grabbing, not slow inserting to the database. You can verify this by temporarily switching to xmltv output. If it takes equally long to write the data to xml file, it is obviously an issue with the source sites/grabbers
Note that some grabbers introduce an intentional delay between page requests (because the sites involved ban IPs that make a lot of requests in rapid succession). This delay setting was in some cases not honoured by WebEPG some versions back.
The delay is most probably due to slow grabbing, not slow inserting to the database. You can verify this by temporarily switching to xmltv output. If it takes equally long to write the data to xml file, it is obviously an issue with the source sites/grabbers
Note that some grabbers introduce an intentional delay between page requests (because the sites involved ban IPs that make a lot of requests in rapid succession). This delay setting was in some cases not honoured by WebEPG some versions back.
- August 30, 2011
- 644
- 79
- Home Country
-
United Kingdom
Grabbing takes ages for me. Using MyDigiGuide, I have to use a "delay" of 2000 ms because the default of 1000 ms leaves loads of gaps in the EPG. However, since I have 210 channels and each day is a separate URL, this means each channel takes at least 20 seconds (for 10 days). That's 70 minutes. Surely there must be a way to speed this up? Is the delay broken somehow? Does MyDigiGuide reject frequent HTTP requests? Is there a page at MyDigiGuide that has all information for 10 days rather than going to a separate URL for each day?
There is no way around this. I am not familiar with MyDigiGuide, but obviously (since you have gaps if you lower the delay) it rejects requests from a single IP if they arrive too faster than a preset value. This is commonly used by web sites to stop bots from scraping their content.
Last edited:
Users who are viewing this thread
Similar threads
Update: Problem solved!
The electronic program guides (tvguide.xml) have been successfully transferred to MediaPortal.
The issue stemmed from the corruption of one or both of the mc2xml.dat and/or mc2xml.exe files, for an unknown reason. Consequently, even though the tvguide.xml file appeared to be updated, its content kept being an...
Update: Problem solved!
The electronic program guides (tvguide.xml) have been successfully transferred to MediaPortal.
The issue...
I was having a problem with the EPG on MP2 1.4.1 (although it used to run without any issues for a while). So I installed MP2 1.5...
Isn't there anyone who needs the series episode listings in the EPG?
Perhaps someone could move this post to the English forum.
Isn't there anyone who needs the series episode listings in the EPG?
Perhaps someone could move this post to the English forum.
Since EPG Buddy is no longer working and the 'TV Movie EPG Import ++' plugin is working again, I'm now having trouble completing...
After Tv Movie EPG Import++ is unrepairable, I tried Tv Movie EPG Import. Unfortunately, the import gets stuck here. Does anyone have an idea why this could be, or does it still work for anyone at all?
After Tv Movie EPG Import++ is unrepairable, I tried Tv Movie EPG Import. Unfortunately, the import gets stuck here. Does anyone...
After Tv Movie EPG Import++ is unrepairable, I tried Tv Movie EPG Import. Unfortunately, the import gets stuck here. Does anyone...
Hey CyberSimian you nailed it!
Looks like the secret is:-
After EPG Collector has Run and provided the TVGuide.xml
Open MediaPortal - TV Server Configuration
"Force Import" on the Plugins/Xmltv/General dialogue, (ignore the status)
Go to the Mappings dialogue and Load/Refresh and Save a Group - (It does not appear to matter which...
Hey CyberSimian you nailed it!
Looks like the secret is:-
After EPG Collector has Run and provided the TVGuide.xml
Open...
Hi everyone
I posted in the EPG section a while back concerning MediaPortal EPG using EPG Collector and MediaPortal xmltv plugin...
I used to use the grabber but a few years back it disappeared on FreeSat DVBS. That is when I changed to EPG Collector. The extra benefit is that it collects from the Sky platform so it will give EPG for all the FreeSat channels plus the unencrypted movie channels on the Sky platform. It also allows me to pick the channels dedicated...
I used to use the grabber but a few years back it disappeared on FreeSat DVBS. That is when I changed to EPG Collector. The extra...
Hi everyone, I hope you are all well
My Mum's Mediaportal lost it's marbles thanks to Microsoft update, (even though I had update...