Calling all scraper gurus... (EMM?) (1 Viewer)

[Psycho Reptile]

A little cry out to the scraper gurus on the forum, but first a little background...

In my stupidity I decided to completely reorganize my movies collection following the thread that suggested seperate folders including files, gfx and NFOs.
What I landed up doing was completely messing everything up
Anyway I saw mention of Ember Media Manager on here and decided to give it a go, it's bloody fantastic (for me anyway), it scrapes all the movies data including backdrops and posters. It's very customisable and has the ability to create NFO files too . I was trying to set up my collection to be XBMC compatible as that seems to be the most widely used standard.

I've landed up with a folder structure that looks like this:

Movie
- movie.ext
- movie.nfo
- movie.srt
- movie.tbn
- movie-fanart.jpg
- folder.jpg

(*.tbn and *.jpg filenames are customizable to a certain degree )

Ok, so now I ran MovPic through my collection again using the updated (1.0.2) XBMC scraper posted on the forum.
I managed to get all my covers and backdrops imported into MovPic without any internet connection.
Basically I can now manage my entire collection through EMM and update and adjust things as I like and re-import the movie into MovPic.... fantastic

So now my question, I've attached a zip containing 23 dummy movies NFO files from EMM, I'd like someone to try and create a scraper that will extract as much information as possible from the NFO and dump it into MovPic.
As I said the XBMC scraper works pretty well, but I reckon it could do with some fine tuning to be fully EMM compliant... so that we could have an entirely new script.

Thanks for reading.

Hope somebody will give it a shot, I gave up after 5 hours

 

[LRFalk01]

Very doable. Do you want outline or plot for your summary?

-LRFalk01

 

[Jocker_Boy]

A little cry out to the scraper gurus on the forum, but first a little background...

In my stupidity I decided to completely reorganize my movies collection following the thread that suggested seperate folders including files, gfx and NFOs.
What I landed up doing was completely messing everything up
Anyway I saw mention of Ember Media Manager on here and decided to give it a go, it's bloody fantastic (for me anyway), it scrapes all the movies data including backdrops and posters. It's very customisable and has the ability to create NFO files too . I was trying to set up my collection to be XBMC compatible as that seems to be the most widely used standard.

I've landed up with a folder structure that looks like this:

Movie
- movie.ext
- movie.nfo
- movie.srt
- movie.tbn
- movie-fanart.jpg
- folder.jpg

(*.tbn and *.jpg filenames are customizable to a certain degree )

Ok, so now I ran MovPic through my collection again using the updated (1.0.2) XBMC scraper posted on the forum.
I managed to get all my covers and backdrops imported into MovPic without any internet connection.
Basically I can now manage my entire collection through EMM and update and adjust things as I like and re-import the movie into MovPic.... fantastic

So now my question, I've attached a zip containing 23 dummy movies NFO files from EMM, I'd like someone to try and create a scraper that will extract as much information as possible from the NFO and dump it into MovPic.
As I said the XBMC scraper works pretty well, but I reckon it could do with some fine tuning to be fully EMM compliant... so that we could have an entirely new script.

Thanks for reading.

Hope somebody will give it a shot, I gave up after 5 hours

I use that same method. The XBMC (1.0.2) Scraper works great. But there is a little problem by doing this. Just using XBMC scraper you don't have information of Language and Writter in MoPi, because EMM when creating *.nfo don't have this fields.
All the rest is 100% perfect and fast to update MoPi without internet connection.

I'm trying to add Writters and Language in *.nfo of EMM, but so far i havn't obtain any response.

 

[Psycho Reptile]

Ahhhh, cheers LRFalk01.... I was hoping you or RoChess might jump on this
I'd vote for Plot as it seems to contain the most info in my 23 test files

FYI, EMM also has the ability to grab trailers and cast pics... maybe that info could be used by MovPics sometime in the future

 

[LRFalk01]

Try the attached out and let me know how it goes.

-LRFalk01

 

[Guzzi]

AW: Re: Calling all scraper gurus... (EMM?)

I use that same method. The XBMC (1.0.2) Scraper works great. But there is a little problem by doing this. Just using XBMC scraper you don't have information of Language and Writter in MoPi, because EMM when creating *.nfo don't have this fields.
All the rest is 100% perfect and fast to update MoPi without internet connection.

I'm trying to add Writters and Language in *.nfo of EMM, but so far i havn't obtain any response.

... I was also trying EMM some weeks ago to get a similar approach - my biggest concern was, that there was no COUNTRY info in the nfo-FIles Ember created, so I dropped that for the moment.
When talking about adding writer and language: Are you in contact with nfnovais about this? Could you please also check, if country info can be added to nfo aithout breaking XBMC compatibility? In that case, this would also be my preferred solution (and i would write an importer for AMCudater for MyFilms ....).
Maybe someone else would be willing to write a script for MePo MyMovies too - so we have a common base for movie infos usable for all movieplugins... with the advantage, that all usercreated specialinfos can be used and do not recreation/editing in all different usage areas ...

@PR: Sorry, it's a bit offtopic to your inital focus ... but I could imagine if you intend to use EMM you're probably also interested in that info!?

 

[Psycho Reptile]

Hi LRFalk01, tested out your scraper and it works perfectly.

Would it be possible to ammend it to scrape the credits in the EMM NFO? These are basically the Writers from what I've looked at on IMDB... You would just need to remove the "See more" on the end of the credits node in some cases, and supply MovPic with the result as writers

As for the language part of it, I don't use it so it doesn't bother me . Guzzi perhaps you could ask at the EMM site, I've only been using EMM for a few days trying to re-organized my messed up collection...

Oh, and I think the idea of creating a similar script for My Videos would be brilliant!

 

[LRFalk01]

We already have a scraper for My Videos. I believe that is the 'local' option in movie details.

Try out the scraper below to see if the writers part is working.

-LRFalk01

 

[Psycho Reptile]

I just ran 600+ movies through the new scraper and only came across one problem... the certification was not being imported, I mnaged to fix it by changing this line:

<parse name="certification" input="${result[0].mpaa}" regex="${rx_certification}"/> to

<parse name="certification" input="${result[0].certification}" regex="${rx_certification}"/>

Writers works fine by the way

 

[LRFalk01]

Thanks for testing, Psycho Reptile. I'll make a ticket to include this in Mov-Pics.

-LRFalk01