IMDb Scraper with RottenTomatoes rating (check end of thread for final versions) (2 Viewers)

mortstar

MP Donator
  • Premium Supporter
  • January 30, 2008
    415
    41
    Home Country
    England England
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Okay I increased the version to 1.5.6 which changes the RT scraper to use uk.rottentomatoes instead of www.rottentomatoes.

    I tested it on Surferosa's 3 problem movies and it was returning the proper score. Thanks to RoChess as always.
     

    Attachments

    • IMDb UK+RT v1.5.6.xml
      14.5 KB

    Surferosa

    Portal Pro
    September 2, 2009
    55
    5
    Home Country
    England England
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Yes! It works! :D

    Big thank you to everyone that helped get this fixed. Really appreciated.

    :D
     

    drealit

    Portal Pro
    March 15, 2008
    190
    17
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Okay I increased the version to 1.5.6 which changes the RT scraper to use uk.rottentomatoes instead of www.rottentomatoes.

    I tested it on Surferosa's 3 problem movies and it was returning the proper score. Thanks to RoChess as always.

    And here is the US version which seems to be working fine also:

    • RottenTomatoes Score
    • Short Summary
    • US Certification
     

    Attachments

    • IMDb US+RT v1.5.6.xml
      14.5 KB

    Surferosa

    Portal Pro
    September 2, 2009
    55
    5
    Home Country
    England England
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Having lived with this for a while now- just to say its ace. The imdb ratings doesnt really give you anything beyond popularity for reasons I mentioned at the start. This is the closest rankings Ive come across- when we sit down to watch something and we dont want to watch, we usually go for the highest RT scored unwatched movie from whatever genre / year we're after. Works a treat. So thanks agin.

    There is another thread on short or long summaries. A few suggestions have said both- short on list view, long on detail. We'll Id love this to becuase I dont have any need for the long summaries at all; but hopefully someone could amend this script and use it to grab critics write-ups on a film from RT. Would be ace :)
     

    Knives03

    Portal Pro
    March 6, 2009
    103
    2
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    The score is still not working correctly for me using the 1.5.6 scraper. I just ran "They Live" through the importer and it gave me a score of 3.3, which isn't even close to the Tomatometer score or the IMDB score. The Tomatometer score is 88% and IMDBs rating is a 7.0 so something is clearly not right because I have no idea where it grabbed that score from.
     

    OllieZA

    Portal Member
    July 9, 2010
    6
    2
    Home Country
    South Africa South Africa
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    To confirm, I recommended The Machinist to the significant other, but after importing we ended up with a score of 1.3/10. I assured her the system made a mistake! :oops: Likewise, Lemony Snicket's A Series of Unfortunate Events has a score of 1.5. The scraper should have returned scores of 7.5 and 7 respectively.

    Thank you for your efforts.
     

    mortstar

    MP Donator
  • Premium Supporter
  • January 30, 2008
    415
    41
    Home Country
    England England
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Just having a look at this....I suspect RottenTomatoes have changed their HTML coding because the score is being created from the number of reviews counted. i.e. I've just imported 'The Girl With the Dragon Tattoo' which has an RT score of 88 from 189 counted reviews and the score is getting assigned as 1.9.

    I've attached a log with debug scraping enabled, looks like we'll need RoChess' help again.

    Current regex is
    Code:
    <set name="rx_rotten_rating">
    		<![CDATA[
    		<span class="per[cf]e[nc]t".+?>(\d{1,3}?)</span>
    		]]>
    	  </set>

    and the HTML from the example film I am trying to import is
    Code:
    <div id="tomatometer" class="dialog chromeGreenMain">
      <div class="dialog_content clearfix" rel="v:rating">
      <div class="t"></div>
      <span typeof="v:Review-aggregate">
      <div id="tomatometer_score" style="" rel="v:rating">
      <span class="percent" property="v:average">
      88</span>
      <span property="v:best" content="100"/>
      <sup class="symbol ">%</sup>
      </div>
      <div id="tomatometer_bar">
      <h6>Tomatometer</h6>
      <div id="tomatometer_bar_container">
      <img class="fl" src="http://images.rottentomatoes.com/images/tomatometer/tomatometer_bar_over_left.png" width="6" height="19" alt="Template Image" />
      <img class="fl" src="http://images.rottentomatoes.com/images/tomatometer/tomatometer_bar_over_middle.gif" width="193.0" height="19" alt="Template Image" />    
      </div>
      <p id="tomatometer_bar_help" class="help" title="The Tomatometer measures the percentage of positive reviews from Approved Tomatometer Critics for a certain movie.">How does the Tomatometer work <img id="rater_mob_helpicon" src="http://images.rottentomatoes.com/images/icons/helpGreen_sm_whitebg.gif" alt="Help Icon" /></p>
      </div>
      <div id="tomatometer_certified_fresh" >
      <span class="iconset iconset_rt_lg certifiedfresh_lg hide" title="Certified Fresh"></span>
      </div>
      <div id="tomatometer_data">
      <p>Reviews Counted:<span property="v:count">189</span></p>
      <p id="tomatometer_data_fresh">Fresh:<span>166</span></p>
      <p id="tomatometer_data_rotten">Rotten:<span>23</span></p>
      <p>Average Rating:<span>7.6/10</span></p>
      </div>
     

    RoChess

    Extension Developer
  • Premium Supporter
  • March 10, 2006
    4,434
    1,897
    • Thread starter
    • Moderator
    • #58
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    They indeed changed their HTML code, by adding a lot of useless CR+LF chars, so use:

    Code:
      <set name="rx_rotten_rating">
    	<![CDATA[
    	<span class="per[cf]e[nc]t".+?>.*?(\d{1,3}?)</span>
    	]]>
      </set>

    Enjoy.
     

    Knives03

    Portal Pro
    March 6, 2009
    103
    2
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Thank you very much RoChess, that seems to have fixed the problem! They Live pulled in an 8.8 rating as it should have. Thanks again!
     

    Buzzie

    Portal Pro
    May 10, 2008
    66
    3
    Home Country
    Netherlands Netherlands
    Re: IMDb Scraper with RottenTomatoes rating v1.4.4

    Is this useable in the StreamedMP Skin??

    and can somebody show some screenshots on how it looks??

    thankss
     

    Users who are viewing this thread

    Top Bottom