Reply to thread

Message

<blockquote data-quote="mortstar" data-source="post: 535810" data-attributes="member: 66294">If you look at the current imdb scraper script you will see this section:[CODE]&nbsp; &nbsp; &nbsp; &lt;!-- Plot Summary --&gt;&nbsp; &nbsp; &nbsp; &lt;retrieve name='summary_page' url='http://www.imdb.com/title/${movie.site_id}/plotsummary'/&gt;&nbsp; &nbsp; &nbsp; &lt;parse name=&quot;summary&quot; input=&quot;${summary_page}&quot; regex=&quot;${rx_plot}&quot;/&gt;&nbsp; &nbsp; &nbsp; &lt;set name=&quot;summary_clean&quot; value=&quot;${summary[0][0]:striptags}&quot; /&gt;&nbsp; &nbsp; &nbsp; &lt;set name=&quot;movie.summary&quot; value=&quot;${summary_clean:htmldecode}&quot; /&gt;&nbsp; &nbsp; &nbsp; &lt;!-- Plot Summary (if first method fails) --&gt;&nbsp; &nbsp; &nbsp; &lt;if test=&quot;${movie.summary}=&quot;&gt;&nbsp; &nbsp; &nbsp; &nbsp; &lt;parse name=&quot;summary2&quot; input=&quot;${details_page}&quot; regex=&quot;${rx_plot2}&quot;/&gt;&nbsp; &nbsp; &nbsp; &nbsp; &lt;set name=&quot;summary_clean&quot; value=&quot;${summary2[0][0]:striptags}&quot; /&gt;&nbsp; &nbsp; &nbsp; &nbsp; &lt;set name=&quot;movie.summary&quot; value=&quot;${summary_clean:htmldecode}&quot; /&gt;&nbsp; &nbsp; &nbsp; &lt;/if&gt;[/CODE]What is happening here is that the scraper is looking for the long plot from the /plotsummary page at imdb. If this method fails to retrieve the (long) plot it falls back to secondary method, which is to grab the (short) plot from the film's main imdb page.To change this behaviour, you could edit the scraper xml and reimport it into MovingPictures. You could change the code above to this:[CODE]&nbsp; &nbsp; &nbsp; &lt;!-- Do not retrieve long plot&nbsp; &nbsp; &nbsp; &lt;retrieve name='summary_page' url='http://www.imdb.com/title/${movie.site_id}/plotsummary'/&gt;&nbsp; &nbsp; &nbsp; &lt;parse name=&quot;summary&quot; input=&quot;${summary_page}&quot; regex=&quot;${rx_plot}&quot;/&gt;&nbsp; &nbsp; &nbsp; &lt;set name=&quot;summary_clean&quot; value=&quot;${summary[0][0]:striptags}&quot; /&gt;&nbsp; &nbsp; &nbsp; &lt;set name=&quot;movie.summary&quot; value=&quot;${summary_clean:htmldecode}&quot; /&gt; --&gt;&nbsp; &nbsp; &nbsp; &lt;!-- Plot Summary (Retrieve short plot) --&gt;&nbsp; &nbsp; &nbsp; &lt;parse name=&quot;summary2&quot; input=&quot;${details_page}&quot; regex=&quot;${rx_plot2}&quot;/&gt;&nbsp; &nbsp; &nbsp; &lt;set name=&quot;summary_clean&quot; value=&quot;${summary2[0][0]:striptags}&quot; /&gt;&nbsp; &nbsp; &nbsp; &lt;set name=&quot;movie.summary&quot; value=&quot;${summary_clean:htmldecode}&quot; /&gt;&nbsp; &nbsp; &nbsp; &lt;/if&gt;[/CODE]This should now pick up sort plot summary for you.</blockquote>

[QUOTE="mortstar, post: 535810, member: 66294"] If you look at the current imdb scraper script you will see this section: [CODE]  <retrieve name='summary_page' url='http://www.imdb.com/title/${movie.site_id}/plotsummary'/> <parse name="summary" input="${summary_page}" regex="${rx_plot}"/> <set name="summary_clean" value="${summary[0][0]:striptags}" /> <set name="movie.summary" value="${summary_clean:htmldecode}" />  <if test="${movie.summary}="> <parse name="summary2" input="${details_page}" regex="${rx_plot2}"/> <set name="summary_clean" value="${summary2[0][0]:striptags}" /> <set name="movie.summary" value="${summary_clean:htmldecode}" /> </if>[/CODE]What is happening here is that the scraper is looking for the long plot from the /plotsummary page at imdb. If this method fails to retrieve the (long) plot it falls back to secondary method, which is to grab the (short) plot from the film's main imdb page. To change this behaviour, you could edit the scraper xml and reimport it into MovingPictures. You could change the code above to this: [CODE]   <parse name="summary2" input="${details_page}" regex="${rx_plot2}"/> <set name="summary_clean" value="${summary2[0][0]:striptags}" /> <set name="movie.summary" value="${summary_clean:htmldecode}" /> </if>[/CODE] This should now pick up sort plot summary for you. [/QUOTE]

Verification