home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
Area 51 - Testing Area
MP-4212 My Videos internal scrapers rework
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Deda" data-source="post: 1029431" data-attributes="member: 89768"><p><strong>Description of Change</strong></p><p>Currently all internal scrapes which are used by MyVideos are hardcoded and hard to maintain if some changes occur on the Internet scraper source. With this rework they are all moved to a csscript files which can be updated as normal movie scrapers and maintained outside of MP project source. Their public methods are not removed or changed in MP core, so they will work as before with this change.</p><p></p><p><strong>Source code</strong></p><p><a href="https://github.com/MediaPortal/MediaPortal-1/tree/MP1-4212-My_Videos_Internal_Scraper_Fixes" target="_blank">GIT link</a></p><p><a href="https://github.com/MediaPortal/MediaPortal-1/commits/MP1-4212-My_Videos_Internal_Scraper_Fixes" target="_blank">GIT branch commits</a></p><p></p><p><strong>JIRA Issue</strong></p><p><a href="https://issues.team-mediaportal.com/browse/MP1-4212" target="_blank">JIRA link</a></p><p></p><p><strong>Installer/Patch</strong></p><p>Installer - not needed, patched files are given for Mp 1.5.0 Final release</p><p></p><p>Patched files - link for MP 1.5.0 release is in 2nd post (simple copy-paste-replace method with usual warning to backup original files first), link always contain newest version</p><p></p><p><strong>Testing</strong></p><p>1st step</p><p>Install final <a href="http://sourceforge.net/projects/mediaportal/files/MediaPortal%20Setup/MediaPortal%201.5.0/MediaPortal_Setup_1.5.0_Final.zip/download" target="_blank">MP 1.5</a> version and replace files provided from link in post 2 (backup originals).</p><p>Update internal grabbers from MP web site via MP <a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database" target="_blank">MyVideos database configuration</a> or later in <a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/Settings/4_Videos_Settings/Video_Database_Settings" target="_blank">MyVideos Database GUI Settings</a> because they can be changed independently of MP code source.</p><p></p><p>2nd step</p><p>Try <a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Cover_art" target="_blank">covers</a> (all 3 sources one by one), <a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Fanart" target="_blank">fanart</a> and <a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Actor_Details" target="_blank">actor details</a> scrapers from configuration on already existing movie in the database</p><p></p><p>3rd step</p><p>Try 2nd step in MP MyVideos plugin (<a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/14_Using_MediaPortal/1_Videos/0_IMDB_Lookup" target="_blank">scan one movie which is not in the database</a>). Try to change covers with image up/down button.</p><p><a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/14_Using_MediaPortal/1_Videos/0_IMDB_Lookup#Viewing_Cast_Info" target="_blank">Click on cast button and on one actor</a> to see actor details (for this I prefer DefaultWide skin because it contains all properties for actor info screen)</p><p></p><p>4th step</p><p>Manually delete internal grabbers from windows ( default location in Win7 -> C:\ProgramData\Team MediaPortal\MediaPortal\scripts)</p><p>[ATTACH=full]136729[/ATTACH]</p><p>and try to update them in <a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/14_Using_MediaPortal/1_Videos#Database_View_Context_Menu" target="_blank">GUI from MyVideos</a> or <a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/Settings/4_Videos_Settings/Video_Database_Settings" target="_blank">MyVideos database GUI settings</a> and test again 3rd step</p><p></p><p>5th step</p><p>Try again from step 1 <img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite1" alt=":)" title="Smile :)" loading="lazy" data-shortname=":)" /></p><p></p><p><u>Note</u></p><p>For testing fanart you need to install FanartHandler plugin and enable <a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Settings" target="_blank">fanart scraping</a></p><p>or</p><p>you can fool the system <a href="http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Settings" target="_blank">(to enable fanart scraping</a>) and manually create fanart folder in</p><p>C:\ProgramData\Team MediaPortal\MediaPortal\Thumbs\<strong>Skin FanArt\Scraper\movies</strong></p><p>and check if fanart files are there after movie scan</p><p></p><p><strong>Changelog</strong></p><p></p><p><strong>Version 1.</strong></p><p>Source code based on current Master (1.5.0 release).</p><p></p><p><strong>Version 1.1</strong></p><p>Reworked code in cover change method for Movie Info screen (when used spin up/down button for cover change), changed dll file -> WindowPlugins.dll</p><p></p><p><strong>Version 1.2</strong></p><p>Added additional debug log, re-added folder.jpg change on cover change (only for DVD/DB folders)</p><p></p><p><strong>Version 1.3</strong></p><p>Internal scripts are now loaded and compiled only once per session (although updating scripts will reload and recompiled them again - tech limitation), changed files -> all except scripts</p><p></p><p><strong>Version 1.4</strong></p><p>Radically reduced all scripts compiling. Due to change, all scripts need to include new class inheritance so all working movie scripts need slight change as:</p><p>[code]</p><p>internal class Grabber : MarshalByRefObject, IIMDBScriptGrabber</p><p>{</p><p>[/code]</p><p>Movie scripts for MP 1.6+ are now downloaded from new MP Web location for easier maintenance, I copied working ones from old location to a new with change written above and to use new patched files either update scripts from web or copy ones provided in patch archive.</p><p>All files are changed so you need to copy them all to appropriate place.</p></blockquote><p></p>
[QUOTE="Deda, post: 1029431, member: 89768"] [B]Description of Change[/B] Currently all internal scrapes which are used by MyVideos are hardcoded and hard to maintain if some changes occur on the Internet scraper source. With this rework they are all moved to a csscript files which can be updated as normal movie scrapers and maintained outside of MP project source. Their public methods are not removed or changed in MP core, so they will work as before with this change. [B]Source code[/B] [URL='https://github.com/MediaPortal/MediaPortal-1/tree/MP1-4212-My_Videos_Internal_Scraper_Fixes']GIT link[/URL] [URL='https://github.com/MediaPortal/MediaPortal-1/commits/MP1-4212-My_Videos_Internal_Scraper_Fixes']GIT branch commits[/URL] [B]JIRA Issue[/B] [URL='https://issues.team-mediaportal.com/browse/MP1-4212']JIRA link[/URL] [B]Installer/Patch[/B] Installer - not needed, patched files are given for Mp 1.5.0 Final release Patched files - link for MP 1.5.0 release is in 2nd post (simple copy-paste-replace method with usual warning to backup original files first), link always contain newest version [B]Testing[/B] 1st step Install final [URL='http://sourceforge.net/projects/mediaportal/files/MediaPortal%20Setup/MediaPortal%201.5.0/MediaPortal_Setup_1.5.0_Final.zip/download']MP 1.5[/URL] version and replace files provided from link in post 2 (backup originals). Update internal grabbers from MP web site via MP [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database']MyVideos database configuration[/URL] or later in [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/Settings/4_Videos_Settings/Video_Database_Settings']MyVideos Database GUI Settings[/URL] because they can be changed independently of MP code source. 2nd step Try [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Cover_art']covers[/URL] (all 3 sources one by one), [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Fanart']fanart[/URL] and [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Actor_Details']actor details[/URL] scrapers from configuration on already existing movie in the database 3rd step Try 2nd step in MP MyVideos plugin ([URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/14_Using_MediaPortal/1_Videos/0_IMDB_Lookup']scan one movie which is not in the database[/URL]). Try to change covers with image up/down button. [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/14_Using_MediaPortal/1_Videos/0_IMDB_Lookup#Viewing_Cast_Info']Click on cast button and on one actor[/URL] to see actor details (for this I prefer DefaultWide skin because it contains all properties for actor info screen) 4th step Manually delete internal grabbers from windows ( default location in Win7 -> C:\ProgramData\Team MediaPortal\MediaPortal\scripts) [ATTACH=full]136729[/ATTACH] and try to update them in [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/14_Using_MediaPortal/1_Videos#Database_View_Context_Menu']GUI from MyVideos[/URL] or [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/Settings/4_Videos_Settings/Video_Database_Settings']MyVideos database GUI settings[/URL] and test again 3rd step 5th step Try again from step 1 :) [U]Note[/U] For testing fanart you need to install FanartHandler plugin and enable [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Settings']fanart scraping[/URL] or you can fool the system [URL='http://wiki.team-mediaportal.com/1_MEDIAPORTAL_1/141_Configuration/MediaPortal_Configuration/2_Videos/2_Video_Database#Settings'](to enable fanart scraping[/URL]) and manually create fanart folder in C:\ProgramData\Team MediaPortal\MediaPortal\Thumbs\[B]Skin FanArt\Scraper\movies[/B] and check if fanart files are there after movie scan [B]Changelog[/B] [B]Version 1.[/B] Source code based on current Master (1.5.0 release). [B]Version 1.1[/B] Reworked code in cover change method for Movie Info screen (when used spin up/down button for cover change), changed dll file -> WindowPlugins.dll [B]Version 1.2[/B] Added additional debug log, re-added folder.jpg change on cover change (only for DVD/DB folders) [B]Version 1.3[/B] Internal scripts are now loaded and compiled only once per session (although updating scripts will reload and recompiled them again - tech limitation), changed files -> all except scripts [B]Version 1.4[/B] Radically reduced all scripts compiling. Due to change, all scripts need to include new class inheritance so all working movie scripts need slight change as: [code] internal class Grabber : MarshalByRefObject, IIMDBScriptGrabber { [/code] Movie scripts for MP 1.6+ are now downloaded from new MP Web location for easier maintenance, I copied working ones from old location to a new with change written above and to use new patched files either update scripts from web or copy ones provided in patch archive. All files are changed so you need to copy them all to appropriate place. [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
Area 51 - Testing Area
MP-4212 My Videos internal scrapers rework
Contact us
RSS
Top
Bottom
