home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
MediaPortal 1 Plugins
Popular Plugins
Moving Pictures
FilmInfo+ - A german movie details scraper with auto grouping
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="RoChess" data-source="post: 942420" data-attributes="member: 18896"><p>@<a href="https://forum.team-mediaportal.com/members/mustangsgm.105165/" target="_blank">MustangsGM</a> you are welcome, @<a href="https://forum.team-mediaportal.com/members/merlyn.114248/" target="_blank">Merlyn</a> did a nice job by taking my idea on IMDb+ and cater it better to German users. I had plans to add OFDb support to IMDb+, but his work on FilmInfo+ made it easier for me to push that to the side for the time being.</p><p> </p><p>@<a href="https://forum.team-mediaportal.com/members/fischy667.104316/" target="_blank">fischy667</a>, the way I understand it from the FilmInfo+ code, the OFDb system works on a front-end load balancer that sends the request to one of three mirrors. The problem is that not all mirrors are the same. I did a test on "Dark Knight Rises" and found out only one mirror had the correct info. What @<a href="https://forum.team-mediaportal.com/members/merlyn.114248/" target="_blank">Merlyn</a> did was to skip the load balancer and go straight for the mirrors himself in a pre-set order and when no results are found move to the next.</p><p> </p><p>This puts a heavy load on the first mirror he picked, which might have compounded to the problem of the mirror not being able to keep up. This eventually breaks the whole OFDb system. What he should have done is randomize the 3 mirrors in his own script, so he can still check them all in order (the load balancer can for example give you 3x the same one in a row without any results), but that from one movie to the next (or between different users) all the mirrors get a fair load.</p><p> </p><p>Of course that is easier said then done, because scraper-scripts are not exactly designed to do all that type of complex logic. Then again I've pushed IMDb+ into some extreme corners, so maybe I can come up with some type of solution to make it work. If it comes down to it, I can create a script on my own web-server that works around the problem, the same way I did for the Dutch language part of IMDb+.</p><p> </p><p>This all takes time, so please bear with me as I'll try to find an opening in my current hectic schedule to work on it.</p></blockquote><p></p>
[QUOTE="RoChess, post: 942420, member: 18896"] @[URL='https://forum.team-mediaportal.com/members/mustangsgm.105165/']MustangsGM[/URL] you are welcome, @[URL='https://forum.team-mediaportal.com/members/merlyn.114248/']Merlyn[/URL] did a nice job by taking my idea on IMDb+ and cater it better to German users. I had plans to add OFDb support to IMDb+, but his work on FilmInfo+ made it easier for me to push that to the side for the time being. @[URL='https://forum.team-mediaportal.com/members/fischy667.104316/']fischy667[/URL], the way I understand it from the FilmInfo+ code, the OFDb system works on a front-end load balancer that sends the request to one of three mirrors. The problem is that not all mirrors are the same. I did a test on "Dark Knight Rises" and found out only one mirror had the correct info. What @[URL='https://forum.team-mediaportal.com/members/merlyn.114248/']Merlyn[/URL] did was to skip the load balancer and go straight for the mirrors himself in a pre-set order and when no results are found move to the next. This puts a heavy load on the first mirror he picked, which might have compounded to the problem of the mirror not being able to keep up. This eventually breaks the whole OFDb system. What he should have done is randomize the 3 mirrors in his own script, so he can still check them all in order (the load balancer can for example give you 3x the same one in a row without any results), but that from one movie to the next (or between different users) all the mirrors get a fair load. Of course that is easier said then done, because scraper-scripts are not exactly designed to do all that type of complex logic. Then again I've pushed IMDb+ into some extreme corners, so maybe I can come up with some type of solution to make it work. If it comes down to it, I can create a script on my own web-server that works around the problem, the same way I did for the Dutch language part of IMDb+. This all takes time, so please bear with me as I'll try to find an opening in my current hectic schedule to work on it. [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
MediaPortal 1 Plugins
Popular Plugins
Moving Pictures
FilmInfo+ - A german movie details scraper with auto grouping
Contact us
RSS
Top
Bottom
