MERGING MediaPortal Url Source Splitter & IPTV Filter | Page 57

Discussion in 'General Development (no feature request here!)' started by georgius, August 20, 2013.

  1. georgius
    • Team MediaPortal

    georgius Retired Team Member

    Joined:
    October 31, 2010
    Messages:
    1,376
    Likes Received:
    437
    Gender:
    Male
    Occupation:
    Software Architect
    Location:
    Bratislava
    Ratings:
    +668 / 0
    Home Country:
    Slovakia Slovakia
    Show System Specs
    This is very interesting question, but there is a lot of work. The whole filter data flow must be changed, because YouTube uses two or more separate streams. This means that you need two or more separate demuxers to get data from streams and in current state filter can't do it.


     
    • Like Like x 1
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. georgius
    • Team MediaPortal

    georgius Retired Team Member

    Joined:
    October 31, 2010
    Messages:
    1,376
    Likes Received:
    437
    Gender:
    Male
    Occupation:
    Software Architect
    Location:
    Bratislava
    Ratings:
    +668 / 0
    Home Country:
    Slovakia Slovakia
    Show System Specs
    I find the reason (at least first) why you can't scan with filter. The problem is server response for DESCRIBE request:
    Code (Text):
    1. v=0
    2. o=- 10958477 1 IN 127.0.0.1
    3. s=SatIPServer:1 4
    4. t=0 0
    5. a=control:rtsp://127.0.0.1:555/stream=211
    6. m=video 0 RTP/AVP 33
    7. c=IN IP4 0.0.0.0
    8. b=AS:5000
    9. a=fmtp:33 ver=1.0;src=1;tuner=1,0,1,0,11881,h,dvbs,qpsk,off,0.35,27500,34;
    10. a=inactive
    but it should be (difference is on line 2, missing IP4):
    Code (Text):
    1. v=0
    2. o=- 10958477 1 IN IP4 127.0.0.1
    3. s=SatIPServer:1 4
    4. t=0 0
    5. a=control:rtsp://127.0.0.1:555/stream=211
    6. m=video 0 RTP/AVP 33
    7. c=IN IP4 0.0.0.0
    8. b=AS:5000
    9. a=fmtp:33 ver=1.0;src=1;tuner=1,0,1,0,11881,h,dvbs,qpsk,off,0.35,27500,34;
    10. a=inactive
    Can you try attached filter, if it will work?
     

    Attached Files:

  4. bounguine

    bounguine Portal Pro

    Joined:
    November 7, 2005
    Messages:
    233
    Likes Received:
    15
    Gender:
    Male
    Occupation:
    executive director + project manager
    Location:
    St.Petersburg
    Ratings:
    +15 / 0
    Home Country:
    Russian Federation Russian Federation
    Show System Specs
    Hi!
    No, it doen't work at all.

    Funny thing:
    - in rtsp-link it is Channel 1,
    - in mptvdb.channel table after scanning it is Channel 2,
    - in mptvdb.tuningdetail table it is Channel 3.

    For me it is the definite fault of MP IPTV scanner.

    I took the link:
    rtsp://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,302,301,300,2606,6,360,25,0,1,253,-1&pids=0,16,17,18,20,300,301,302

    In MP:
    serviceId - 3418, but must be 2606 (bold above),
    pmtId - 905, but must be 300 (logically, it cannot be 905 at all from the string "pids=0,16,17,18,20,300,301,302"

    So the MP scanner does a bad job.
    VLC recognizes channels without problem.

    I opened MySQL Workbench and changed serviceId and pmtId to the right values, but not working again with rtsp-link.
    I think, even after manually changing parameters by me MP fails to understand the link with many pids.

    Lucky I am, DVBViewer generates http-link.

    So playing around:

    NOK:
    serviceId - 3418
    pmtId - 905
    rtsp://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,302,301,300,2606,6,360,25,0,1,253,-1&pids=0,16,17,18,20,300,301,302

    NOK:
    serviceId - 2606
    pmtId - 300
    rtsp
    ://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,302,301,300,2606,6,360,25,0,1,253,-1&pids=0,16,17,18,20,300,301,302

    NOK:
    serviceId - 3418
    pmtId - 905
    http://localhost:7522/upnp/channelstream/2407174006218033710%7C%D0%90%D0%B2%D1%82%D0%BE%D0%BF%D0%BB%D1%8E%D1%81.ts

    OK:
    serviceId - 2606
    pmtId - 300
    http
    ://localhost:7522/upnp/channelstream/2407174006218033710%7C%D0%90%D0%B2%D1%82%D0%BE%D0%BF%D0%BB%D1%8E%D1%81.ts

    And some more questions.
    Unlike other programs MP scans http-, rtsp-, etc links unstead of merely copying the link.
    DVB-* scanner locks channels without checking if they are descrambled or not.
    But IPTV scanner seems to try the channel availability (decrypted and FTA channels are locked, others not).
    This must be very dangerous, as for example my tv viewing official cards have CWC counter, and MP IPTV scanning links from DVBViewer (yes, I am to use it as I have 4 diseqcs 1.1) could be treated as a case of CS and my cards will be blocked by providers!

    UPD

    These links are not scanned either:
    rtmp://178.249.242.111:1935/live/tv6
    rtmp://37.187.27.118/live/livestream2
     
    Last edited: May 21, 2016
  5. mm1352000
    • Team MediaPortal

    mm1352000 Development Group

    Joined:
    September 1, 2008
    Messages:
    21,526
    Likes Received:
    4,734
    Ratings:
    +8,200 / 17
    Home Country:
    New Zealand New Zealand
    Hello bounguine

    I think that you are making several assumptions here which may or may not be valid.

    First, is DVBViewer sending the whole transponder/multiplex/TS, or only a single program transport stream (SPTS) containing one channel?
    If DVBViewer only sends an SPTS without fixing the service description table (SDT) then this can explain the problem. It can cause TV Server to think all the channels are present (=> select the wrong service ID, PMT PID, name etc.), but actually they are not.

    Second, what is this "tnr" parameter?
    The rest of the URL looks like a standard SAT>IP URL, but AFAIK "tnr" is not a standard parameter.

    Not possible. "MP" doesn't parse the parts of the URL, so it doesn't even know how many PIDs there are.

    Yes, because it needs to know the service ID and PMT PID.

    If you do a normal IPTV scan:
    http://wiki.team-mediaportal.com/1_...ver_Configuration/02_TV_Servers/6_Scan_DVB-IP

    ...TV Server sets the channel status - FTA or scrambled - based on the stream contents. Zero decrypt requests are sent.
    If DVBViewer is sending decrypt requests each time TV Server scans the URLs then that is not TV Server's fault.
     
  6. georgius
    • Team MediaPortal

    georgius Retired Team Member

    Joined:
    October 31, 2010
    Messages:
    1,376
    Likes Received:
    437
    Gender:
    Male
    Occupation:
    Software Architect
    Location:
    Bratislava
    Ratings:
    +668 / 0
    Home Country:
    Slovakia Slovakia
    Show System Specs
    RTMP links surely don't work, they don't have MPEG2 TS stream. Only MPEG2 TS streams are supported by TV service. Anyway, can you attach logs from not working RTSP link?
     
  7. KayDiefenthal
    • Premium Supporter

    KayDiefenthal MP Donator

    Joined:
    July 18, 2006
    Messages:
    1,174
    Likes Received:
    74
    Occupation:
    Carpenter, Electrican
    Location:
    Germany - Bonn
    Ratings:
    +94 / 0
    Home Country:
    Germany Germany
    tnr is dvbviewer recording Service internal an should help by communication between satip spec and there bda Environment
    i think it stands for tracking Number needed for descrambling ?
     
  8. bounguine

    bounguine Portal Pro

    Joined:
    November 7, 2005
    Messages:
    233
    Likes Received:
    15
    Gender:
    Male
    Occupation:
    executive director + project manager
    Location:
    St.Petersburg
    Ratings:
    +15 / 0
    Home Country:
    Russian Federation Russian Federation
    Show System Specs
    Thank for the answers.
    Unfortunately, I cannot comment upon how DVBViewer works, as I'm not the dev.
    When scanning, MP locks only FTA- or decrypted channels.
    Those, which are not decrypted by DVBViewer (no card available), are not locked.
    Seems that a kind of brutal decrypting checking (I have more than 3k channels in DVBViewer) on the slave server side is made due to MP request, which might be bad for a user.

    Just compare to VLC concept.
    It simply loads the *.m3u from the server and checks the params needed ONLY when watching a particular channel on the client.
    The same thing with DVBLink server.

    As for rtsp- and http-links generated by DVBViewer.
    Both are reproduced correctly by VLC.
    Plus it shows EPG broadcasted by inbuilt DVBViewer rtsp server.
    With MP only http-links are scanned correctly.
    If links of both types are put manualy right to the db without scanning with corect params, MP starts only http-links.

    I will explain why I'm talking about working with db.

    I have 4 hybrid tuners (DVB-T2/C and analogue) and the procedure of manual scanning, mapping and sorting of 190 channels through MP is quite reasonable.
    But these are not the only sources MP works with.
    There are:
    a) 2-tuner Digital Devices Cine S2 + 2-tuner Digital Devices Octopus S2 not working in MP due to diseqc 1.1 problems (4 MP IPTV instances, DVBViewer as slave server),
    b) 4-tuner TBS6205 T2/C not working with MP (4 MP IPTV instances, DVBViewer as slave server),
    c) torrent tv (http://torrent-tv.ru/) - both server and p2p-proxy (7 MP IPTV instances),
    d) http://545-tv.com/?act=tv (5 MP IPTV instances),
    e) list of http- and rtmp-links made by me (5 MP IPTV instances).

    It's obvious that manipulating with more than 5k channels in MP GUI is a kind of mind killing.
    So I made a script working with cron, which:
    - downloads channel lists from all sources,
    - puts channels into intermediate db with an extra field for the correct display name and a status field (put the channel into MP or delete from MP),
    - deletes from MP or adds to MP the channels into tuningdetail table, maps them to IPTV cards, looks for an existing channel in channel table to be mapped to or adds the new one.

    All is working perfectly.
    The script:
    - parses the params (networkId, transportId, serviceId, pmtPid) inside DVBViewer rtsp-links and adds the corresponding http-links (as rtsp is not treated correctly by MP) with free-to-air status into mptvdb,
    - sets networkId, transportId, serviceId to 1 and pmtPid to 100000 for torrent tv channels.

    The problem is with rtmp-links (e) and 545-tv.com (d).
    I don't know which values to use for serviceId and pmtPid (tricks are not working here).
    Only scanning may reveal the correct params.
    But rtmp-links are not scanned at all, 545-tv.com links are scanned partially with MP crashing from time to time (logs are attached).
     
  9. georgius
    • Team MediaPortal

    georgius Retired Team Member

    Joined:
    October 31, 2010
    Messages:
    1,376
    Likes Received:
    437
    Gender:
    Male
    Occupation:
    Software Architect
    Location:
    Bratislava
    Ratings:
    +668 / 0
    Home Country:
    Slovakia Slovakia
    Show System Specs
    I din't see any RTSP url in logs, so I don't know if there is another problem with RTSP or not. Forgot about RTMP links in TV. These links will not work - RTMP has FLV format and TV service needs MPEG2 TS format. For finding correct parameters for 545-tv.com streams you can use MP IPTV filter and url source splitter plugin in TV-Server configuration tool.

    How to:
    1. Test playlist or database URL (click last icon - blue question mark icon). The result should be green tick icon (testing_channel_successful.png in my first post in this thread).
    2. If testing URL is successful, then open MPEG2 Transport Stream parser (m2ts_parser_in_editor.png).
    3. On Stream analysis tab you probably find required information (m2ts_stream_analysis.png).
     
  10. bounguine

    bounguine Portal Pro

    Joined:
    November 7, 2005
    Messages:
    233
    Likes Received:
    15
    Gender:
    Male
    Occupation:
    executive director + project manager
    Location:
    St.Petersburg
    Ratings:
    +15 / 0
    Home Country:
    Russian Federation Russian Federation
    Show System Specs
    1. RTSP-scanning logs are attached.
    Playlist is:
    For both the channels MP finds channel "НАШЕ НОВОЕ КИНО" (channel table) and "DANGE TV" (tuningdetail table).

    I looked at the *.m3u generated by DVBViewer and found an extra-line my parser neglects.
    Probably that's the reason VLC chooses the right channel and extracts EPG from RTSP:
    2. 545-tv.com HOW TO.
    Yes, I read the first page, but I cannot afford clicking on the last icon 792 times.
    Is there any way to automate the process?

    3. RTMP
    Is there any way to implement piping?
    Nix example:
    https://tvheadend.org/projects/tvheadend/wiki/Custom_MPEG-TS_Input

    PS
    Uphh
    Too many problems.
    If I would know how to extract http-/rtsp-links for TV channels from MP and use it as a slave server with another proxy backend for Kodi, it would be easier.
     
  11. mm1352000
    • Team MediaPortal

    mm1352000 Development Group

    Joined:
    September 1, 2008
    Messages:
    21,526
    Likes Received:
    4,734
    Ratings:
    +8,200 / 17
    Home Country:
    New Zealand New Zealand
    From the log files I can see that I was right. DVBViewer is supplying an SPTS without properly cleaning the SDT. Garbage in => garbage out. ;)

    Based on Kay's comment, it seems that the decrypt requests are sent by DVBViewer because you include the "tnr" part in the URL. MP doesn't need or want to decrypt. It only needs to know the service ID and PMT PID...

    MP should be able to do this too if you configure TV Server (DVB EPG) correctly and DVBViewer is supplying the info in a standard way.

    Yeah, not supported - sorry. But do you really have more than 4 satellite positions?

    What do you mean "not working"?
    Assuming tuning paramters are correct DVB-C should work fine. DVB-T2 should also work as long as you don't need multiple PLP support... but I guess you might need that because you're in Russia?

    As above: it's the fault of DVBViewer and the way they are supplying the stream.

    VODServer
     
Loading...

Users Viewing Thread (Users: 0, Guests: 0)

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice
  • About The Project

    The vision of the MediaPortal project is to create a free open source media centre application, which supports all advanced media centre functions, and is accessible to all Windows users.

    In reaching this goal we are working every day to make sure our software is one of the best.

             

  • Support MediaPortal!

    The team works very hard to make sure the community is running the best HTPC-software. We give away MediaPortal for free but hosting and software is not for us.

    Care to support our work with a few bucks? We'd really appreciate it!