Trouble with Importing (1 Viewer)

[Tesla]

The root cause of my problem turned out to be Microsoft Security Essentials - Real-Time Scanning feature.

 

[Inker]

The root cause of my problem turned out to be Microsoft Security Essentials - Real-Time Scanning feature.

Well, something has to trigger this behavior. At this point I only have one theory (but it's unlikely) and even if it were true the problem lays with MSE. I don't know what we are doing that it doesn't like.

The funny thing is I have it installed too, and of course I have Real Time Scanning on.

The logging error mentioned above is unlikely to be the problem, because as can be seen from the msg being displayed to the user, the error is handled gracefully and the worst that can happen is a log line not being written (it should still be fixed though of course).

 

[Tesla]

The root cause of my problem turned out to be Microsoft Security Essentials - Real-Time Scanning feature.

Well, something has to trigger this behavior. At this point I only have one theory (but it's unlikely) and even if it were true the problem lays with MSE. I don't know what we are doing that it doesn't like.

The funny thing is I have it installed too, and of course I have Real Time Scanning on.

The logging error mentioned above is unlikely to be the problem, because as can be seen from the msg being displayed to the user, the error is handled gracefully and the worst that can happen is a log line not being written (it should still be fixed though of course).

Having the logging turned-up more verbose ... causing it to crash more is a non-issue. With MS-SE on, I think it was a fluke I even made it through processing... ever.

What loggging error? The " can't write to log file"? I thought that was a temporary error because it obviously can write to it because it wrote that line. Again ... a minor problem. I was surprise to see the foreign languages in the log and especially the oriental characters.

To recreate this problem, you might need:
Win-XP Pro 32-bit (SP3) English, fully patched.
MediaPortal 1.1
- mySQL 5.x DB (default)
Streamed-MP v1.2.1.1553
- TV-Series v2.6.0.1157
MS Security Essentials

There is very little else on the machine. The only other background processes are Acronis-10 (no schedule) and RAdmin 2.x.

What do we need before we can file a bug report? I'm surprised to hear you have MS-SE installed... well, not really ... I bet a lot of people do these days. I've never had a problem with it (until now).

Can you ask the developers what is happening when the logo flashes? If that whole routine runs on allowable .Net functions ... well, it might be a Microsoft bug either way.

The way it turned out, I'm happy about 3 things:
1. It wasn't a deeper rooted problem with my install, and isolated only to TV-Series plugin
2. Found the work-around to a least get most of the Series into the DB
3. You are helping me get it fixed permanently.

 

[Inker]

To recreate this problem, you might need:
Win-XP Pro 32-bit (SP3) English, fully patched.
MediaPortal 1.1
- mySQL 5.x DB (default)
Streamed-MP v1.2.1.1553
- TV-Series v2.6.0.1157
MS Security Essentials

There is very little else on the machine. The only other background processes are Acronis-10 (no schedule) and RAdmin 2.x.

Mysql and StreamedMP have nothing to do with your import problems. Tthe plugin doesn't use MySQL and the skin obviously cannot interfere with the import wizard.

What do we need before we can file a bug report? I'm surprised to hear you have MS-SE installed... well, not really ... I bet a lot of people do these days. I've never had a problem with it (until now).

I would really like for at least one other person to confirm this before we add it to the tracker. Or we can narrow it down enough for you alone, but that will be hard.

Can you ask the developers what is happening when the logo flashes? If that whole routine runs on allowable .Net functions ... well, it might be a Microsoft bug either way.

Lol, I am a developer. I don't know what logo-flash you mean though. I also don't know what you mean with your second sentence.

The way it turned out, I'm happy about 3 things:
1. It wasn't a deeper rooted problem with my install, and isolated only to TV-Series plugin
2. Found the work-around to a least get most of the Series into the DB
3. You are helping me get it fixed permanently.

It would probably be better if you hoped on IRC (freenode #mp-tvseries) to discuss this further.

 

[Tesla]

To recreate this problem, you might need:
Win-XP Pro 32-bit (SP3) English, fully patched.
MediaPortal 1.1
- mySQL 5.x DB (default)
Streamed-MP v1.2.1.1553
- TV-Series v2.6.0.1157
MS Security Essentials (XP-32bit version)

There is very little else on the machine. The only other background processes are Acronis-10 (no schedule) and RAdmin 2.x.

Mysql and StreamedMP have nothing to do with your import problems. Tthe plugin doesn't use MySQL and the skin obviously cannot interfere with the import wizard.

I was just trying to fully describe my system. When you said you were running MS-SE but weren't having the problem, I thought it might be because you were running a different version of Windows or something else was different.

What do we need before we can file a bug report? I'm surprised to hear you have MS-SE installed... well, not really ... I bet a lot of people do these days. I've never had a problem with it (until now).

I would really like for at least one other person to confirm this before we add it to the tracker. Or we can narrow it down enough for you alone, but that will be hard.

I wouldn't be running all these new versions if I wasn't building up a new (but still legacy) machine. Maybe no one else will try this on XP?

Can you ask the developers what is happening when the logo flashes? If that whole routine runs on allowable .Net functions ... well, it might be a Microsoft bug either way.

Lol, I am a developer. I don't know what logo-flash you mean though. I also don't know what you mean with your second sentence.

Oh, sorry. Excellent actually So you have never seen the "row-of-TVs logo" quickly flash once, maybe twice during the Processing? I figured you were reading an option or something.

Well, if you are using standard .net functions, and MS-SE is interfering, then I would think there is either a bug in .Net or MS-SE is stopping an action and not reporting it ... sorta like a false positive.

The way it turned out, I'm happy about 3 things:
1. It wasn't a deeper rooted problem with my install, and isolated only to TV-Series plugin
2. Found the work-around to a least get most of the Series into the DB
3. You are helping me get it fixed permanently.

It would probably be better if you hoped on IRC (freenode #mp-tvseries) to discuss this further.

If you think that is best. It's been years since I've used IRC but I'll look for a nice client. Will mIRC work?

 

[Guzzi]

AW: Trouble with Importing

Hi Inker,
there seems no special info in the log, when the importer/update stops - but is it possible, that there was a change to multiple threads (while it was sequential in the past)?
Although I got the implression, that there was always an error from TVDB some seconds before import/update stopped - that might be a hint for checking errorhandling code?
Maybe the timeouthandling has a collision with other parts of the code?

I don't think it's related to certain titles, because it happens not always at the same position...

00000005 - 06.08.2010 14:00:15 - Found 005 episodes online for "Collision"
00000001 - 06.08.2010 14:00:15 - progress received: IdentifyNewEpisodes [347/2188] Collision
00000005 - 06.08.2010 14:00:15 - Retrieving Data from: http://thetvdb.com/api/<apikey>/series/70369/all/de.zip
00000005 - 06.08.2010 14:00:35 - Can't connect to http://thetvdb.com/api/<apikey>/series/70369/all/de.zip : Timeout f├╝r Vorgang ├╝berschritten
00000005 - 06.08.2010 14:00:35 - No episodes could be identified online for Columbo, check that the online database has these episodes
00000001 - 06.08.2010 14:00:35 - progress received: IdentifyNewEpisodes [348/2188] Columbo
00000005 - 06.08.2010 14:00:35 - Retrieving Data from: http://thetvdb.com/api/<apikey>/series/110601/all/de.zip
00000005 - 06.08.2010 14:00:36 - Decompressing Stream...
00000005 - 06.08.2010 14:00:36 - Decompressing Entry: de.xml
[...]
00000005 - 06.08.2010 14:00:38 - Decompressing Stream...
00000001 - 06.08.2010 14:00:41 - Online Parsing Completed in 00:50:33.0080316

 

[Inker]

Re: AW: Trouble with Importing

Well, last I checked, the processing is still very much sequential, much more so than I would like personally, but anyways. So unless you received timeouts with an older version nothing should have really changed. Normally the worst thing that can happen is that metadata for that particular series is not available until the next run (for instance when mp is run). Now its possible that if a timeout happens this exception propagates to the ui thread in a way that it doesn't know how to deal with. That is how I understand your post and I agree.

However, tesla has no such timeouts in his log, this would not have anything to do with the amount of logging going on, and the fact that MSE could cause this is if that was the reason for the timeouts.
My only guess left is that the way we do logging is causing MSE to freak out, which causes the file to be locked, which causes us to wait on it, all the while multiple threads try to do their work blocking on it on hammer on the lock, and that we have a bug that causes a deadlock in such a scenario. We could test this by never releasing our lock on the log file for the entire duration of our run. I will try to find some time/motivation over the next few days. However it would seriously help if someone who can reproduce this were on IRC.

 

[Guzzi]

AW: Trouble with Importing

Hi Inker,
just tried again and got a "stop" somewhere else - it's approx 1 min after a failed read from tvdb - and puts "onlineparsing completed" in the log.
btw - I am talking about the ConfigurationTool, not inside MePo.
Maybe you can check, if there is some timeouthandling around 60s - and some mishandling to finish Onlineparsing - instead of continuing with other series ??
I won't be at home until sunday night - but if I can help, let me know - maybe with a debug version that has some more useful logging?
Thanks,
Guzzi

PS: In older versions, I also sometimes got those errors - but it didn't stop / cancel the update process, just skipped the missing infos..

 

[RoChess]

Edit MSE settings and disable the option "scan in compressed archives", this disables processing of ZIP files.

If this in turn allows you to run import scans without a problem, then the cause is clearly from having a slow system not capable of having MSE lock the ZIP file, unzip it, scan all files, and release the lock for MP-TVSeries to resume before the timeout value passes.

Maybe the timeout value can be increased then, or keep the option disabled to scan ZIP files.

 

[Guzzi]

AW: Trouble with Importing

... this might help Tesla, but on my machine (HTPC) there is no MSE running (and no virusscan at all).
I think, even, if MSE (or something else) causes a timeout, TVseries should not stop, but just skip the unsuccesful reads (as it did in the past).