home
products
contribute
download
documentation
forum
Home
Forums
New posts
Search forums
What's new
New posts
All posts
Latest activity
Members
Registered members
Current visitors
Donate
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Search titles only
By:
Menu
Log in
Register
Navigation
Install the app
Install
More options
Contact us
Close Menu
Forums
MediaPortal 1
MediaPortal 1 Plugins
Popular Plugins
Moving Pictures
Scraper setting retrieve variable to empty
Contact us
RSS
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Merlyn" data-source="post: 944303" data-attributes="member: 114248"><p>I've got some issues with the <retrieve /> node in my scraper. Hopefully someone can help...</p><p> </p><p>So, the code I have is this:</p><p>[CODE]</p><p> <!-- OFDB Details --></p><p> <retrieve name="ofdb_details_page" url="http://www.ofdb.de/film/${movie.ofdb_id},${ofdb_movie_url[0][1]}"/></p><p> <set name="rx_TitelDE"></p><p> <![CDATA[</p><p> (?:<title>OFDb\s-\s)(?<Titel>.*?)\s\((?<Jahr>\d{4})\)(?=</title>)</p><p> ]]></p><p> </set></p><p>[/CODE]</p><p> </p><p>and it results in</p><p>[CODE]16-Dec-2012 15:44:55 Debug [ ScraperNode]: executing retrieve: <retrieve name="ofdb_details_page" url="http://www.ofdb.de/film/${movie.ofdb_id},${ofdb_movie_url[0][1]}" /></p><p>16-Dec-2012 15:44:55 Debug [ ScraperNode]: Retrieving URL: http://www.ofdb.de/film/1067,Beverly-Hills-Cop-II</p><p>16-Dec-2012 15:44:55 Debug [ WebGrabber]: GetResponse: URL=http://www.ofdb.de/film/1067,Beverly-Hills-Cop-II, UserAgent=Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.11 (KHTML, like Gecko) Chrome/23.0.1271.95 Safari/537.11, CookieHeader=ofdb_theme=0; ofdb_ret=view.php%253Fpage%253Dstart, Accept=text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8</p><p>16-Dec-2012 15:44:55 Debug [ ScraperNode]: Assigned variable: urn://scraper/header/www.ofdb.de = ofdb_theme=0; ofdb_ret=view.php%253Fpage%253Dstart</p><p>16-Dec-2012 15:44:55 Debug [ WebGrabber]: GetString: Encoding=</p><p>[COLOR=#ff0000][B]16-Dec-2012 15:44:55 Debug [ ScraperNode]: Assigned variable: ofdb_details_page = [/B][/COLOR]</p><p>16-Dec-2012 15:44:55 Debug [ ScraperNode]: Assigned variable: rx_TitelDE = (?:<title>OFDb\s-\s)(?<Titel>.*?)\s\((?<Jahr>\d{4})\)(?=</title>)</p><p>[/CODE]</p><p> </p><p>So, the problem obviously is the red marked line. The variable is cleared, right after the retrieve is done.</p><p>It should not be there and I cannot figure out where this is coming from.</p><p>The url I try to retrieve exists and I can copy it and open in IE or Firefox without any problem. Does anyone have any idea, what might be the cause?</p><p>No other retrieve in the scraper does this.</p><p>Can anyone help? @<a href="https://forum.team-mediaportal.com/members/fforde.52082/" target="_blank">fforde</a> or @<a href="https://forum.team-mediaportal.com/members/rochess.18896/" target="_blank">RoChess</a> maybe?</p></blockquote><p></p>
[QUOTE="Merlyn, post: 944303, member: 114248"] I've got some issues with the <retrieve /> node in my scraper. Hopefully someone can help... So, the code I have is this: [CODE] <!-- OFDB Details --> <retrieve name="ofdb_details_page" url="http://www.ofdb.de/film/${movie.ofdb_id},${ofdb_movie_url[0][1]}"/> <set name="rx_TitelDE"> <![CDATA[ (?:<title>OFDb\s-\s)(?<Titel>.*?)\s\((?<Jahr>\d{4})\)(?=</title>) ]]> </set> [/CODE] and it results in [CODE]16-Dec-2012 15:44:55 Debug [ ScraperNode]: executing retrieve: <retrieve name="ofdb_details_page" url="http://www.ofdb.de/film/${movie.ofdb_id},${ofdb_movie_url[0][1]}" /> 16-Dec-2012 15:44:55 Debug [ ScraperNode]: Retrieving URL: http://www.ofdb.de/film/1067,Beverly-Hills-Cop-II 16-Dec-2012 15:44:55 Debug [ WebGrabber]: GetResponse: URL=http://www.ofdb.de/film/1067,Beverly-Hills-Cop-II, UserAgent=Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.11 (KHTML, like Gecko) Chrome/23.0.1271.95 Safari/537.11, CookieHeader=ofdb_theme=0; ofdb_ret=view.php%253Fpage%253Dstart, Accept=text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 16-Dec-2012 15:44:55 Debug [ ScraperNode]: Assigned variable: urn://scraper/header/www.ofdb.de = ofdb_theme=0; ofdb_ret=view.php%253Fpage%253Dstart 16-Dec-2012 15:44:55 Debug [ WebGrabber]: GetString: Encoding= [COLOR=#ff0000][B]16-Dec-2012 15:44:55 Debug [ ScraperNode]: Assigned variable: ofdb_details_page = [/B][/COLOR] 16-Dec-2012 15:44:55 Debug [ ScraperNode]: Assigned variable: rx_TitelDE = (?:<title>OFDb\s-\s)(?<Titel>.*?)\s\((?<Jahr>\d{4})\)(?=</title>) [/CODE] So, the problem obviously is the red marked line. The variable is cleared, right after the retrieve is done. It should not be there and I cannot figure out where this is coming from. The url I try to retrieve exists and I can copy it and open in IE or Firefox without any problem. Does anyone have any idea, what might be the cause? No other retrieve in the scraper does this. Can anyone help? @[URL='https://forum.team-mediaportal.com/members/fforde.52082/']fforde[/URL] or @[URL='https://forum.team-mediaportal.com/members/rochess.18896/']RoChess[/URL] maybe? [/QUOTE]
Insert quotes…
Verification
Post reply
Forums
MediaPortal 1
MediaPortal 1 Plugins
Popular Plugins
Moving Pictures
Scraper setting retrieve variable to empty
Contact us
RSS
Top
Bottom