Short plot gets superflous text (1 Viewer)

[mortstar]

The imdb scraper script falls back to the short plot summary on the main-imdb page (I've slightly edited the function so that the scrapper script only picks up this as I'm not a big fan of the full synopsis which can be full of spoilers). The regex seems to be picking up an html link with the text ". Full summary" at the end of every matched film.

For example Transsiberian (2008) get's the plot "A Trans-Siberian train journey from China to Moscow becomes a thrilling chase of deception and murder when an American couple encounters a mysterious pair of fellow travelers. full summary".

Regex expressions make absolutely no sense to me so unfortunately I couldn't edit the script myself...any help much appreciated

 

[fforde]

If you post your current regex and the block of text you're trying to match against (including some buffer on each side) I will help if I can.

 

[mortstar]

If you post your current regex and the block of text you're trying to match against (including some buffer on each side) I will help if I can.

Regex is -

<set name="rx_plot2">
<![CDATA[
<h5>Plot:</h5>\s+([^|]+)\|\s<a class="[^"]+" href="synopsis">
]]>
</set>

Parsed by -

<parse name="summary2" input="${details_page}" regex="${rx_plot2}"/>
<set name="summary_clean" value="${summary2[0][0]:striptags}" />
<set name="movie.summary" value="${summary_clean:htmldecode}" />

imdb page from example

<div class="info">
<h5>Plot:</h5>
A Trans-Siberian train journey from China to Moscow becomes a thrilling chase of deception and murder when an American couple encounters a mysterious pair of fellow travelers. <a class="tn15more inline" href="/title/tt0800241/plotsummary" onclick="(new Image()).src='/rg/title-tease/plotsummary/images/b.gif?link=/title/tt0800241/plotsummary';">full summary</a> | <a class="tn15more inline" href="synopsis">full synopsis</a>

 

[fforde]

Use this instead for your regex:

<h5>Plot:</h5>\s+(.+?)(?: \| )?<a

 

[mortstar]

Use this instead for your regex:

<h5>Plot:</h5>\s+(.+?)(?: \| )?<a

Thanks very much, I'll report back

Any good links to explain what this (and all other) regex is doing?

 

[fforde]

I use this web based too to edit my regex. Does realtime updating of the results:

RegExr: Online Regular Expression Testing Tool

Other than that I dunno, it just takes practice.

 

[mortstar]

Works perfectly, thanks!

You have the old regex expression in your imdb script, as all I did was swap round the order in which film plots are grabbed, so you'll need the update of expression too.

 

[fforde]

Works perfectly, thanks!

You have the old regex expression in your imdb script, as all I did was swap round the order in which film plots are grabbed, so you'll need the update of expression too.

Yeah I noticed that. It is changed I just have not committed it yet. Thanks for the heads up though and good find. ^^