[TV] - DJBlu's Custom Data Grabber and plugins Integration into MP

Discussion in 'Improvement Suggestions' started by ay129, January 5, 2014.

  1. ay129

    ay129 Portal Pro

    Joined:
    October 7, 2011
    Messages:
    184
    Likes Received:
    22
    Ratings:
    +29 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Hello

    First of all, many thanks to all at team mediaportal for this fantastic product from my whole family. I think its great that a community can pull together and make this happen. In this spirit I would like to ask the community about integrating what I and many others think is a great plugin into Mediaportal going forward.

    I am one of many users of DJBlu's data grabber patch for sky and other TV networks that pulls down EPG and channel icon data, and also schedules recording of series. This project has been running for at least 3 years and if I'm honest, next to MovingPictures and the tv shows plugin, is the standout feature for MP for me.

    There is a sizeable community using this - there are 266 pages on this thread as of today:
    https://forum.team-mediaportal.com/...r-including-sky-uk-channel-epg-grabber.96767/

    The issue is DJBlu's code has to be distributed as a patched / SVN build of both MP and the TV server each time new versions of MP come out. This obviously puts strain on DJBlu - I dont envy him with having to sort through these issues every time a new version comes out. As I understand it, DJBlu has previously submitted his code patch, but I cant find any more info about what happened next. With MP now on this more rapid development cycle, I cant see why we cant just integrate DJBlu's code into the main trunk?

    I hear that there is a development freeze on the TV Engine, but if we could at least integrate the necessary code into the main MP application, that would be a step forward. Looking further down the tracks, we would also hope that this feature is fully baked into MP2.

    Thanks for reading my long post. And DJBlu, sorry if I am stealing your thunder and speaking for you here, but I hope that if this happens you work will be more widely shared, and easier to maintain.

    Cheers,
    Ay129


     
    • Like Like x 8
    • Agree Agree x 5
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. CrashUK

    CrashUK Portal Pro

    Joined:
    July 24, 2008
    Messages:
    108
    Likes Received:
    3
    Ratings:
    +6 / 0
    This plugin saves so much time. 2 mins and its done. I only use it for freesat.
     
  4. Spragleknas
    • Team MediaPortal
    • Administrator

    Spragleknas Administrator

    Joined:
    December 21, 2005
    Messages:
    9,472
    Likes Received:
    1,385
    Gender:
    Male
    Occupation:
    Occupied
    Location:
    Located
    Ratings:
    +1,892 / 12
    Home Country:
    Norway Norway
    Show System Specs
    @elliottmc - as Release Manager, perhaps you can have your say here? Also calling @DJBlu to this thread.
     
  5. elliottmc
    • Premium Supporter

    elliottmc Retired Team Member

    Joined:
    August 7, 2005
    Messages:
    14,927
    Likes Received:
    4,011
    Gender:
    Male
    Location:
    Cardiff, UK
    Ratings:
    +5,503 / 13
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Could someone add the latest version of the changes to this thread and I will have a look at it - need to see the impact on the TV side and discuss with the relevant team members.
     
  6. elliottmc
    • Premium Supporter

    elliottmc Retired Team Member

    Joined:
    August 7, 2005
    Messages:
    14,927
    Likes Received:
    4,011
    Gender:
    Male
    Location:
    Cardiff, UK
    Ratings:
    +5,503 / 13
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    I have had a quick look at the thread. Fundamentally this seems to be a patch for the TV server.

    Because of major working being done on the TV server, the team has agreed a code-freeze until version 3.5 of the TV server is ready. Therefore I think it is fair to say that we cannot include this fix at the present time.

    Hopefully the changes with TVE3.5 will allow this sort of thing to be done more easily.
     
    • Like Like x 1
  7. Benoire
    • Premium Supporter

    Benoire MP Donator

    Joined:
    March 17, 2012
    Messages:
    679
    Likes Received:
    92
    Gender:
    Male
    Occupation:
    Civil Engineer
    Location:
    Auckland
    Ratings:
    +135 / 0
    Home Country:
    New Zealand New Zealand
    Show System Specs
    mm3152000 is very much aware of the thread and what it does. You'll see my post in the devs section that talks about it and his response.

    I personally support this style of plugin / core for EPG work, but would prefer to see TVE3.5 complete enough for something similar to this to be rolled in without compromising other important features.
     
  8. ay129

    ay129 Portal Pro

    Joined:
    October 7, 2011
    Messages:
    184
    Likes Received:
    22
    Ratings:
    +29 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Thanks for the reply. There is also a patch for the main MP application to make this work - you have to pull down SVN versions of both mediaportal.exe and the tv server. Is is possible to at least have the main MP stuff integrated some how?[DOUBLEPOST=1389213767][/DOUBLEPOST]

    Hey @elliottmc - Thanks for the response and for keeping us all in the loop. I fully understand about version 3.5 of the TV server - and am pretty excited about that. Just wanted to put this back on the radar so that we can take all of this great work forward into TVE3.5 and to MP2 and infinity and beyond.

    When installing this patch we need to pull down SVN versions of both Mediaportal.exe and TVServer. So it seems like the there is some code in the Mediaportal part of that install that can possibly go into the main mediaportal application, removing the need for SVN installs of Mediaportal? This will ease the installation - am sure many users will agree that just applying a patched TV Server is far less painful than having to do a full MP reinstall each time a new version of MP arrives - even though this app is worth it.

    This is especially so as MP is on an accelerated release schedule through to MP2.0. Do you or @mm3152000 have any thoughts about this?
     
    Last edited: January 8, 2014
  9. Sebastiii
    • Team MediaPortal

    Sebastiii Development Group

    Joined:
    November 12, 2007
    Messages:
    16,256
    Likes Received:
    6,211
    Gender:
    Male
    Location:
    France
    Ratings:
    +10,214 / 9
    Home Country:
    France France
    Show System Specs
    Some review about the code (from friend of mine) : (in https://github.com/djblu/Custom-Data-Grabber/blob/master/Custom Data Grabber/CustomDataGrabber.cs)

    Code (Text):
    1. --
    2.         while (!(Filestream.Length > 5000))
    3.         {
    4.             a += 1;
    5.             Thread.Sleep(500);
    6.             if (a > 100)
    7.             {
    8.                 Log.Write("Not Enough Data to process");
    9.                 if (OnComplete != null)
    10.                 {
    11.                     OnComplete(true, "Not Enough Data to process");
    12.                 }
    13.                 return;
    14.             }
    15.         }
    16. --
    1) Better to do something else, is reading the file directly is the only solution ? A better integration should be done for "read from file". TVE should pass that data directly to the EPG plugins
    2) sleeps in a loop...
    3) uses goto
    4) hard coded values

    @DJBlu @mm1352000
     
    Last edited: January 10, 2014
  10. DJBlu

    DJBlu Portal Pro

    Joined:
    August 14, 2007
    Messages:
    1,670
    Likes Received:
    789
    Location:
    Llanelli
    Ratings:
    +894 / 1
    Home Country:
    United Kingdom United Kingdom
    There are better ways yes. This was a quick dirty hack to get to the data as I didn't at the time have the skills required to modify the direct show filter to pass the data I required.

    The easiest method would be to take out all the TSWriter code and convert it to managed code in C#. Take a look at EPGCollector and how they have implemented the direct show filters.

    It connects to the stream and passes it directly to c# which does all the data parsing and such.
     
    • Like Like x 2
  11. TheBatfink
    • Premium Supporter

    TheBatfink MP Donator

    Joined:
    June 11, 2007
    Messages:
    1,285
    Likes Received:
    164
    Gender:
    Male
    Occupation:
    Business System Analyst
    Location:
    Nottingham
    Ratings:
    +221 / 0
    Home Country:
    United Kingdom United Kingdom
    Show System Specs
    Not to diminish the clearly excellent TVE, but this plugin makes MePo a replacement for a Sky box for me. I won't upgrade MePo without DJBlu's version and if he gave up I'd probably go back to the sky box.
    It doesn't need spelling out, if you're in a country that can use this it's THE MePo version to be using.
    MePo is great for advanced tweaking and worldwide support, but you simply can't beat a 3 or 4 click setup - I used to spend hours setting TV up and the EPG was still sketchy most of the time. If his work shouldn't be part of MePo general release I'm not sure what should!

    Did I mention the love I have for this mod? :)

    (PS it needs its own sub forum somewhere too because there are so many people that struggle with TV and EPG that this could solve and its not visible enough!!)
     
    Last edited: January 11, 2014
    • Agree Agree x 3
    • Like Like x 1
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!