Not all episodes shown / recognized (1 Viewer)

[gamejester]

Test 1 - 5 are all done using 3 shows with 343 episodes all worked - SVN 312 (latest)
Test 6 - 9 are done using my FULL epsiode list using different SVNs

Results
=====

1. All tests using a small set of shows PASS.
2. Last SNV to work on FULL list is v 506? date 20/10/07 (1.2.9.34660)

why?
====
duno yet, guess I need to do more test! Must be something to do with:

1. Number of shows
2. A badly named show or something in a show name it does not like
3. regEX changes in the way they are compilled.


************************************************************************
Test 1 -5
All tests, just add 3 series (24, bsg, simpsons - each has lots of episodes with all the various different names, etc...)
no mediainfo.dll (to speed testing up)

Test 1
Import settings -
paths added indivually, removable NOT ticket
Online datasync ticked, download data, download thumbs, watch
Parsing expressions: just the default top one ticked
ordered: aired

result:
parsing test: OK, no red, ok in logs
imports : All OK.
Log : names each show, at the end of the line it says 'identified'; but at the bottom of each show section it says
03/05/2008 07:59:27 - "24 - 6x24 - Day 6: 5:00 AM - 6:00 AM" identified
03/05/2008 07:59:27 - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
database : local_espisodes - no negative ID
local_series - all correct ID's

Test 2
Import settings -
paths added indivually, removable NOT ticket
Online datasync ticked, download data, download thumbs, watch, language ENGLISH
Parsing expressions: just the default top one ticked
ordered: aired

result:
parsing test: OK, no red, ok in logs
imports : All OK.
Log : names each show, at the end of the line it says 'identified'; but at the bottom of each show section it says
03/05/2008 07:59:27 - "24 - 6x24 - Day 6: 5:00 AM - 6:00 AM" identified
03/05/2008 07:59:27 - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
database : local_espisodes - no negative ID
local_series - all correct ID's

Test 3
Import settings -
paths added indivually, removable NOT ticket
Online datasync ticked, download data, download thumbs, watch, language ENGLISH, auto choose
Parsing expressions: just the default top one ticked
ordered: aired

result:
parsing test: OK, no red, ok in logs
imports : All OK.
Log : names each show, at the end of the line it says 'identified'; but at the bottom of each show section it says
03/05/2008 07:59:27 - "24 - 6x24 - Day 6: 5:00 AM - 6:00 AM" identified
03/05/2008 07:59:27 - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
database : local_espisodes - no negative ID
local_series - all correct ID's

Test 4
Import settings -
paths added indivually, removable NOT ticket
Online datasync ticked, download data, download thumbs, watch, language ENGLISH, auto choose
Parsing expressions: All ticked
ordered: aired

result:
parsing test: OK, no red, ok in logs
imports : All OK.
Log : names each show, at the end of the line it says 'identified'; but at the bottom of each show section it says
03/05/2008 07:59:27 - "24 - 6x24 - Day 6: 5:00 AM - 6:00 AM" identified
03/05/2008 07:59:27 - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
database : local_espisodes - no negative ID
local_series - all correct ID's

Test 5
Import settings -
paths added indivually, removable TICKED
Online datasync ticked, download data, download thumbs, watch, language ENGLISH, auto choose
Parsing expressions: All ticked
ordered: aired

result:
parsing test: OK, no red, ok in logs
imports : All OK.
Log : names each show, at the end of the line it says 'identified'; but at the bottom of each show section it says
03/05/2008 07:59:27 - "24 - 6x24 - Day 6: 5:00 AM - 6:00 AM" identified
03/05/2008 07:59:27 - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
database : local_espisodes - no negative ID
local_series - all correct ID's

------------------------------------------------------------------------------------------------
Test 6 - FAIL
Import settings -
paths added SERIES folder with all TV, removable TICKED
Online datasync ticked, download data, download thumbs, watch, language ENGLISH, auto choose
Parsing expressions: All ticked
ordered: aired

result:
parsing test: OK, no red, ok in logs
Imports : FAIL - on Details view all Seasons are listed, but NONE (well actually one only Stargate SG-1) have a plus sign to expand a see series.
If I close the configuration GUI and open it back up then the Details view has changed and I now have + to expand each series;
From the bottom up series are complete, but then around Stargate SG-1 each series only has 1 episode.
This is not entirly consistent as couple of series below this also only have 1 episode recognised and some have episodes missing.

Log : All the failing ones read like this
03/05/2008 09:02:01 - Found 33 Episodes for "Eureka", matching them up with local Episodes now
03/05/2008 09:02:01 - "Eureka - 1x1 - Pilot" identified
03/05/2008 09:02:01 - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
database : local_espisodes - LOTS of negative ID's
local_series - all correct ID's

***********************************************************************

Also fails using the v2.0 release - 2.0.765

***********************************************************************

************************************************
Test 7 - FAIL
myTVseries Release version 2.0
************************************************

Test 8 - same fail
SVN - v 261

************************************************

Test 9 - PASS
SVN - v 506? date 20/10/07 (1.2.9.34660)
It worked.
Default Parsing expressions used.
Parsing test reported no RED (except the BG web episodes which I expect to fail and have in the above but not really worth mentioning!)
Log file says that parsing actually failed for all shows named
show - 1x01-02 - title.avi
These are also the only shows not imported into db.

 

[gamejester]

FYI - before anyone posts about speed, it is not a mediainfo issue as I do not have that loaded for these tests.


Yet more testing has narrowed down this bug a bit further.

I have gone back and tested a lot of the old versions, and for a while I thought I had found an old version that works, 245 - 1.2.9.25314 ; all newer versions failed.
but then when I loaded this 245 version on another machine, that also failed.
So it appears that occasionally you will not get the problem for some reason.

I then moved on to finding a senrio that works with the latest SVN, based on the fact that sometimes it will work, but why?

All my shows are stored on various hard drives in my server, and they are all shared into 1 directoty structure using DFS and a win2k3 server.

If I had the root of this folder with the 3000+ shows, the local scan takes ages, like 30 secs per series to identify it, then at the end of all the scans I see the issue with - (minus) numbered local shows in the db and that means series with only the first episode available.

The same is true if I had each folder (of which there are 3 with 1000+ shows in each) to MP indivually and get it to scan all as a new install.


.........but if I add just one folder (first has 1309 episodes) then do an import it zips through taking about 1 second per show to match it. I can then add the second folder, scan, and then add the third and scan. Now all my shows are in teh db properly.


I now believe it is an issue with memory constraints for the data type used in the code (an array of some kind?)

I will start a new thread to report the bug with relevant data so noone needs to waste there time reading this rambling!!

 

[thrawnarn]

anyone has a solution other than adding one folder at the time (which is not working for me). about 30% of my shows only has the first episode in some season (not necessarily the first). Its bugging me out...

EDIT: oops found this thread. Will try it tomorrow...

 

[dir]

A long time ago I tried out TVSeries on my (then) 5000+ episode collection, and had the issue where there was only one episode in each series found. That actually killed me using MP but I'm now back trying it again with RC3.

During my initial imports into TVSeries of my collection, I was having problems with the parsing of my filenaming format:

d:\blah\tv\series name\Season nn\01 - Episode name.avi

I eventually gave up getting any of the 8 default regex / expressions working and went and renamed all (now) 7500 episodes to the format:

d:\blah\tv\series name\Season nn\s01e01 - Episode name.avi

The import works ok for 99% except for:
1. The entire "24" series, and
2. The World Series of Poker 2008 series.

Both of these have episode names that start with a number or the $ sign, and the regex's puke on them. I've moved the entire "24" out of my collection for now.

While all this wasn't working (and we're talking about a week ago), and while I was trying different imports/regexs, including deleting the database completely and starting again several times or just trying different regexs, I was still seeing things like this:

- once I saw almost all my series and episodes listed in black, indicating that it had found them.
- at some later attempt, I only saw one episode per series. Somehow it had forgotten them.
- at some later point, I again saw them all in black.

The main things I was changing during those times were the regex importers. I may have also once had the checkbox unticked for saying that the path was a removable drive. So I assume it was something to do with them.

BUT:
The regex that I use for my shows is at the top of the list, and is the only one ticked. I intentionally untick all the rest because I don't want it trying to use them. However, when I exit and reenter the configuration tool, sometimes (or possibly every time), all 8 expressions are ticked.

So: What I'm surmising is the following:
a) It's a bug to have the regex's go back to being ticked
b) Somehow when an import is done, it's using, or trying to use these other expressions
c) The act of using any but the correct expression is having an effect on things like:

• having only one episode per series in black and the rest grey

• errors I'm seeing in the logs such as:
  
  

  9/11/2008 11:28:01 PM - Warning: Could not add VolumenLabel/IsOnRemovable Property to episode - are you using these as a capture group?

  
  and
  

  9/11/2008 11:31:00 PM - ***************     Get Episodes     ***************
  9/11/2008 11:31:00 PM - Received 1 mirror site(s) from http://www.thetvdb.com
  9/11/2008 11:31:00 PM - Received 1 mirrors from http://www.thetvdb.com
  9/11/2008 11:31:04 PM - Found 210 episodes online for "All in the Family", matching them up with local episodes now
  9/11/2008 11:31:04 PM - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
  9/11/2008 11:31:04 PM - Found 210 Episodes for "All in the Family", matching them up with local Episodes now
  9/11/2008 11:31:04 PM - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)

Attached is a log file that shows thousands of lines of these sorts of errors or warnings. I find it a bit fascinating to go through because there's so many strange things happening, like:

9/11/2008 11:27:49 PM - Found 7116 supported video files
9/11/2008 11:27:49 PM - ***************     Gathering Local Information     ***************
9/11/2008 11:27:49 PM - Starting Local Filename Parsing, processing 7116 files
9/11/2008 11:27:49 PM - Compiling Parsing Expressions
9/11/2008 11:27:49 PM - Compiling Regex...
9/11/2008 11:27:49 PM - Compiled Regex sucessfuly, 8 valid Expressions found
9/11/2008 11:27:49 PM - Warning: Could not add VolumenLabel/IsOnRemovable Property to episode - are you using these as a capture group?

(this last line is repeated about 7000+ times, then:

9/11/2008 11:28:01 PM - Warning: Could not add VolumenLabel/IsOnRemovable Property to episode - are you using these as a capture group?
9/11/2008 11:28:01 PM - ParseLocal finished..
9/11/2008 11:28:23 PM - Adding 26 new file(s) to Database
9/11/2008 11:28:24 PM - 26 local files found that sucessfully parsed and are not already in Database, now adding/upading Database
9/11/2008 11:28:28 PM - Succesfully read Mediainfo for \\Mofo\media\TV\World Series of Poker\Season 2008\S2008E25 - WS.DSR.XviD-AT.avi
9/11/2008 11:28:33 PM - Commit failed on this command: <insert into local_episodes (EpisodeFilename,CompositeID, blah blah 
values( '\\Mofo\media\TV\World Series of Poker\Season 2008\S2008E25 - WS.DSR.XviD-AT.avi', '',0,-1,-1, '',0, '', '',0,624,352, '',
 '', '2757215', 'XVID', '939964', '23.976', '1.773', 'MPA1L3', '112007', '2', '')> (SQLiteClient:  cmd:sqlite3_finalize 
err:CONSTRAINT detailed:column EpisodeFilename is not unique query:insert into local_episodes 
(EpisodeFilename,CompositeID,SeriesID,SeasonIndex,EpisodeIndex,LocalEpisodeName,LocalImportProcessed,AvailableSubtitles,blah 
blah

values( '\\Mofo\media\TV\World Series of Poker\Season 2008\S2008E25 - WS.DSR.XviD-AT.avi', '',0,-1,-1, '',0, '', '',0,624,352, '', 
'', '2757215', 'XVID', '939964', '23.976', '1.773', 'MPA1L3', '112007', '2', '')).

9/11/2008 11:28:34 PM - Switching logical view to All
9/11/2008 11:28:34 PM - new listlevel: Series
9/11/2008 11:28:34 PM - Fanart: resetting to normal
9/11/2008 11:28:34 PM - Begin LoadFacade
9/11/2008 11:28:34 PM - LoadFacade: ListLevel: Series
9/11/2008 11:28:34 PM - new listlevel: Series
9/11/2008 11:28:34 PM - FacadeMode: Switching to LargeIcons
9/11/2008 11:28:38 PM - Succesfully read Mediainfo for \\Mofo\media\TV\World Series of Poker\Season 2008\S2008E26 - WS.DSR.XviD-AT.avi
9/11/2008 11:28:40 PM - LoadFacade: BeginDisplayLoopSeries: 1
9/11/2008 11:28:41 PM - Found and loaded 2 User Formatting Rules
9/11/2008 11:28:41 PM - Cache Initialized
9/11/2008 11:28:41 PM - No LogoRules found!
9/11/2008 11:28:41 PM - Mathparser: Total Result: 10*Round(9*2)/2 = 90
9/11/2008 11:28:44 PM - Succesfully read Mediainfo for \\Mofo\media\TV\World Series of Poker\Season 2008\S2008E28 - Main Event 10K Buy-In No-Limit Holdem Part 16.avi
9/11/2008 11:28:44 PM - Succesfully read MediaInfo for \\Mofo\media\TV\World Series of Poker\Season 2008\S2008E28 - Main Event 10K Buy-In No-Limit Holdem Part 16.avi
9/11/2008 11:28:49 PM - Commit failed on this command: <insert into local_episodes 
(EpisodeFilename,CompositeID,SeriesID,SeasonIndex,EpisodeIndex,LocalEpisodeName,LocalImportProcessed,AvailableSubtitles, blah values( '\\Mofo\media\TV\World Series of
 Poker\Season 2008\S2008E28 - Main Event 10K Buy-In No-Limit Holdem Part 16.avi', 
'',0,-1,-1, '',0, '', '',0,624,352, '', '', '2720804', 'XVID', '946096', '23.976', '1.773', 'MPA1L3', '120447', '2', '')> (SQLiteClient:  
cmd:sqlite3_finalize err:CONSTRAINT detailed:column EpisodeFilename is not unique query:insert into local_episodes 
(EpisodeFilename,CompositeID,SeriesID,SeasonIndex,EpisodeIndex,LocalEpisodeName,LocalImportProcessed,AvailableSubtitles, 
blah values( '\\Mofo\media\TV\World Series of Poker\Season 2008\S2008E28 - Main Event 10K Buy-In No-Limit Holdem Part 
16.avi', '',0,-1,-1, '',0, '', '',0,624,352, '', '', '2720804', 'XVID', '946096', '23.976', '1.773', 'MPA1L3', '120447', '2', '')).

then

9/11/2008 11:31:00 PM - ***************     Get Episodes     ***************
9/11/2008 11:31:00 PM - Received 1 mirror site(s) from http://www.thetvdb.com
9/11/2008 11:31:00 PM - Received 1 mirrors from http://www.thetvdb.com
9/11/2008 11:31:04 PM - Found 210 episodes online for "All in the Family", matching them up with local episodes now
9/11/2008 11:31:04 PM - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
9/11/2008 11:31:04 PM - Found 210 Episodes for "All in the Family", matching them up with local Episodes now

which happens for every series, then:

9/11/2008 11:31:53 PM - ***************     Checking banners for series without any banners     ***************
9/11/2008 11:31:53 PM - Looking for banners on 145 Series
9/11/2008 11:31:53 PM - Downloading banners for "24"
9/11/2008 11:31:53 PM - Cache Initialized
9/11/2008 11:31:54 PM - Downloading banners for "All in the Family"
9/11/2008 11:31:55 PM - Downloading banners for "Allo! Allo!"
9/11/2008 11:31:55 PM - Downloading banners for "24"
9/11/2008 11:31:55 PM - Downloading banners for "24"
9/11/2008 11:31:55 PM - Downloading banners for "24"
9/11/2008 11:31:55 PM - Downloading banners for "24"
9/11/2008 11:31:55 PM - Downloading banners for "24"
9/11/2008 11:31:55 PM - Downloading banners for "24"
9/11/2008 11:31:55 PM - Downloading banners for "24"
9/11/2008 11:31:55 PM - Downloading banners for "30 Rock"

which again is repeated for every series, even though it's already successfully downloaded banners for all my series - this takes 5 minutes, then

9/11/2008 11:35:18 PM - ***************************************************************************
9/11/2008 11:35:18 PM - *******************          Completed          ***************************
9/11/2008 11:35:18 PM - ***************************************************************************
9/11/2008 11:35:18 PM - Online Parsing done
9/11/2008 11:35:18 PM - Begin LoadFacade
9/11/2008 11:35:18 PM - LoadFacade: ListLevel: Series
9/11/2008 11:35:18 PM - new listlevel: Series
9/11/2008 11:35:18 PM - FacadeMode: Switching to LargeIcons
9/11/2008 11:35:18 PM - LoadFacade: BeginDisplayLoopSeries: 112
9/11/2008 11:35:18 PM - **********************************************************************************************************
9/11/2008 11:35:18 PM - ******************* Full Run Starting (LocalScan: False -  UpdateScan: True)   ***************************
9/11/2008 11:35:18 PM - **********************************************************************************************************
9/11/2008 11:35:18 PM - ***************     Identifying Unknown Series Online     ***************
9/11/2008 11:35:19 PM - All Series are already identified.
9/11/2008 11:35:19 PM - ***************     Retrieving Metadata for new Series     ***************
9/11/2008 11:35:19 PM - Nothing to do...
9/11/2008 11:35:19 PM - ***************     Get Episodes     ***************
9/11/2008 11:35:20 PM - Downloading banners for "The Sopranos"
9/11/2008 11:35:21 PM - Found 154 Episodes for "24", matching them up with local Episodes now
9/11/2008 11:35:21 PM - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
9/11/2008 11:35:23 PM - Found 210 Episodes for "All in the Family", matching them up with local Episodes now

This is fascinating - immediately after completing a full scan, it then does an UpdateScan, and repeats most of the same things it's already just done. Except this time, it fails with

9/11/2008 11:35:53 PM - Found 113 Episodes for "Sex And The City", matching them up with local Episodes now
9/11/2008 11:35:53 PM - None of these episodes could be identified (Possible reasons: Wrong filename/OnlineDatabase does not have these episodes)
9/11/2008 11:35:58 PM - ***************************************************************************
9/11/2008 11:35:58 PM - *******************          Completed          ***************************
9/11/2008 11:35:58 PM - ***************************************************************************
9/11/2008 11:35:58 PM - Online Parsing done
9/11/2008 11:35:58 PM - Error preparing Facade... Object reference not set to an instance of an object.
9/11/2008 11:35:58 PM - The 'LoadFacade' function has generated an error: Object reference not set to an instance of an object.
9/11/2008 11:35:58 PM - bgLoadFacade done
9/11/2008 11:35:58 PM - in facadedone

I humbly submit these for study, reflection, and insight!