MERGING MediaPortal Url Source Splitter & IPTV Filter (10 Viewers)

[georgius]

@georgius any idea if MPEG DASH can be supported eventually?
Since Youtube only supports 1080P and up using DASH would be great if that were added so that OnlineVideos can playback those streams again.

This is very interesting question, but there is a lot of work. The whole filter data flow must be changed, because YouTube uses two or more separate streams. This means that you need two or more separate demuxers to get data from streams and in current state filter can't do it.

 

[georgius]

Hi to everyone.
I need your help.

My config is:
- DVBViewer Recording Service with 4 DVB-C tuners (TBS 6205) and 4 DVB-S tuners (Digital Divices),
- 4 IPTV cards for DVB-C and 4 IPTV cards for DVB-S in MP.
I'm trying to stream to MP from DVBViewer Recording Service using RTSP (port 555).

I made 2 test playlists.
Both are workong in VLC.

DVB-C:

#EXTM3U
#EXTINF:-1,OTB
rtsp://localhost:555/?freq=818&msys=dvbc&sr=6875&specinv=0&mtype=128qam&tnr=0,818000,6875,0,0,4,0,0,702,502,1002,3,0,0,24,0,3,4371,-1&pids=0,16,17,18,20,1002,502,702

DVB-S:

#EXTM3U
#EXTINF:-1,ОТР
rtsp://localhost:555/?src=1&freq=11881&msys=dvbs&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=qpsk&tnr=1,11881,27500,10750,0,0,9,3,52,51,50,901,0,360,25,0,9,253,-1&pids=0,16,17,18,20,50,51,52

I scanned DVB-C with OOTB IPTV > scanning OK > channel name parsed is wrong in DB (not "OTB" ???), watching TV is OK (the channel shown is "OTB").
Then I scanned DVB-S with OOTB IPTV > scanning OK > channel name parsed is wrong in DB, watching TV is NOK (no PMT found).
Unfortunately, I have no logs.

After that I installed the filter, but no scanning is possible at all (logs are attached).
Upon deleting the filter OOTB IPTV scanning is not working anymore.

I find the reason (at least first) why you can't scan with filter. The problem is server response for DESCRIBE request:

v=0
o=- 10958477 1 IN 127.0.0.1
s=SatIPServer:1 4
t=0 0
a=control:rtsp://127.0.0.1:555/stream=211
m=video 0 RTP/AVP 33
c=IN IP4 0.0.0.0
b=AS:5000
a=fmtp:33 ver=1.0;src=1;tuner=1,0,1,0,11881,h,dvbs,qpsk,off,0.35,27500,34;
a=inactive

but it should be (difference is on line 2, missing IP4):

v=0
o=- 10958477 1 IN IP4 127.0.0.1
s=SatIPServer:1 4
t=0 0
a=control:rtsp://127.0.0.1:555/stream=211
m=video 0 RTP/AVP 33
c=IN IP4 0.0.0.0
b=AS:5000
a=fmtp:33 ver=1.0;src=1;tuner=1,0,1,0,11881,h,dvbs,qpsk,off,0.35,27500,34;
a=inactive

Can you try attached filter, if it will work?

 

[bounguine]

Hi!
No, it doen't work at all.

Funny thing:
- in rtsp-link it is Channel 1,
- in mptvdb.channel table after scanning it is Channel 2,
- in mptvdb.tuningdetail table it is Channel 3.

For me it is the definite fault of MP IPTV scanner.

I took the link:
rtsp://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,302,301,300,2606,6,360,25,0,1,253,-1&pids=0,16,17,18,20,300,301,302

In MP:
serviceId - 3418, but must be 2606 (bold above),
pmtId - 905, but must be 300 (logically, it cannot be 905 at all from the string "pids=0,16,17,18,20,300,301,302"

So the MP scanner does a bad job.
VLC recognizes channels without problem.

I opened MySQL Workbench and changed serviceId and pmtId to the right values, but not working again with rtsp-link.
I think, even after manually changing parameters by me MP fails to understand the link with many pids.

Lucky I am, DVBViewer generates http-link.

So playing around:

NOK:
serviceId - 3418
pmtId - 905
rtsp://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,302,301,300,2606,6,360,25,0,1,253,-1&pids=0,16,17,18,20,300,301,302

NOK:
serviceId - 2606
pmtId - 300
rtsp://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,302,301,300,2606,6,360,25,0,1,253,-1&pids=0,16,17,18,20,300,301,302

NOK:
serviceId - 3418
pmtId - 905
http://localhost:7522/upnp/channelstream/2407174006218033710%7C%D0%90%D0%B2%D1%82%D0%BE%D0%BF%D0%BB%D1%8E%D1%81.ts

OK:
serviceId - 2606
pmtId - 300
http://localhost:7522/upnp/channelstream/2407174006218033710%7C%D0%90%D0%B2%D1%82%D0%BE%D0%BF%D0%BB%D1%8E%D1%81.ts

And some more questions.
Unlike other programs MP scans http-, rtsp-, etc links unstead of merely copying the link.
DVB-* scanner locks channels without checking if they are descrambled or not.
But IPTV scanner seems to try the channel availability (decrypted and FTA channels are locked, others not).
This must be very dangerous, as for example my tv viewing official cards have CWC counter, and MP IPTV scanning links from DVBViewer (yes, I am to use it as I have 4 diseqcs 1.1) could be treated as a case of CS and my cards will be blocked by providers!

UPD

These links are not scanned either:
rtmp://178.249.242.111:1935/live/tv6
rtmp://37.187.27.118/live/livestream2

 

[mm1352000]

Hello bounguine

I took the link:
rtsp://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,302,301,300,2606,6,360,25,0,1,253,-1&pids=0,16,17,18,20,300,301,302

In MP:
serviceId - 3418, but must be 2606 (bold above),
pmtId - 905, but must be 300 (logically, it cannot be 905 at all from the string "pids=0,16,17,18,20,300,301,302"

So the MP scanner does a bad job.

I think that you are making several assumptions here which may or may not be valid.

First, is DVBViewer sending the whole transponder/multiplex/TS, or only a single program transport stream (SPTS) containing one channel?
If DVBViewer only sends an SPTS without fixing the service description table (SDT) then this can explain the problem. It can cause TV Server to think all the channels are present (=> select the wrong service ID, PMT PID, name etc.), but actually they are not.

Second, what is this "tnr" parameter?
The rest of the URL looks like a standard SAT>IP URL, but AFAIK "tnr" is not a standard parameter.

I think, even after manually changing parameters by me MP fails to understand the link with many pids.

Not possible. "MP" doesn't parse the parts of the URL, so it doesn't even know how many PIDs there are.

Unlike other programs MP scans http-, rtsp-, etc links unstead of merely copying the link.

Yes, because it needs to know the service ID and PMT PID.

DVB-* scanner locks channels without checking if they are descrambled or not.
But IPTV scanner seems to try the channel availability (decrypted and FTA channels are locked, others not).
This must be very dangerous, as for example my tv viewing official cards have CWC counter, and MP IPTV scanning links from DVBViewer (yes, I am to use it as I have 4 diseqcs 1.1) could be treated as a case of CS and my cards will be blocked by providers!

If you do a normal IPTV scan:
http://wiki.team-mediaportal.com/1_...ver_Configuration/02_TV_Servers/6_Scan_DVB-IP

...TV Server sets the channel status - FTA or scrambled - based on the stream contents. Zero decrypt requests are sent.
If DVBViewer is sending decrypt requests each time TV Server scans the URLs then that is not TV Server's fault.

 

[georgius]

These links are not scanned either:
rtmp://178.249.242.111:1935/live/tv6
rtmp://37.187.27.118/live/livestream2

RTMP links surely don't work, they don't have MPEG2 TS stream. Only MPEG2 TS streams are supported by TV service. Anyway, can you attach logs from not working RTSP link?

 

[KayDiefenthal]

Second, what is this "tnr" parameter?
The rest of the URL looks like a standard SAT>IP URL, but AFAIK "tnr" is not a standard parameter.

tnr is dvbviewer recording Service internal an should help by communication between satip spec and there bda Environment
i think it stands for tracking Number needed for descrambling ?

 

[bounguine]

Thank for the answers.
Unfortunately, I cannot comment upon how DVBViewer works, as I'm not the dev.
When scanning, MP locks only FTA- or decrypted channels.
Those, which are not decrypted by DVBViewer (no card available), are not locked.
Seems that a kind of brutal decrypting checking (I have more than 3k channels in DVBViewer) on the slave server side is made due to MP request, which might be bad for a user.

Just compare to VLC concept.
It simply loads the *.m3u from the server and checks the params needed ONLY when watching a particular channel on the client.
The same thing with DVBLink server.

As for rtsp- and http-links generated by DVBViewer.
Both are reproduced correctly by VLC.
Plus it shows EPG broadcasted by inbuilt DVBViewer rtsp server.
With MP only http-links are scanned correctly.
If links of both types are put manualy right to the db without scanning with corect params, MP starts only http-links.

I will explain why I'm talking about working with db.

I have 4 hybrid tuners (DVB-T2/C and analogue) and the procedure of manual scanning, mapping and sorting of 190 channels through MP is quite reasonable.
But these are not the only sources MP works with.
There are:
a) 2-tuner Digital Devices Cine S2 + 2-tuner Digital Devices Octopus S2 not working in MP due to diseqc 1.1 problems (4 MP IPTV instances, DVBViewer as slave server),
b) 4-tuner TBS6205 T2/C not working with MP (4 MP IPTV instances, DVBViewer as slave server),
c) torrent tv (http://torrent-tv.ru/) - both server and p2p-proxy (7 MP IPTV instances),
d) http://545-tv.com/?act=tv (5 MP IPTV instances),
e) list of http- and rtmp-links made by me (5 MP IPTV instances).

It's obvious that manipulating with more than 5k channels in MP GUI is a kind of mind killing.
So I made a script working with cron, which:
- downloads channel lists from all sources,
- puts channels into intermediate db with an extra field for the correct display name and a status field (put the channel into MP or delete from MP),
- deletes from MP or adds to MP the channels into tuningdetail table, maps them to IPTV cards, looks for an existing channel in channel table to be mapped to or adds the new one.

All is working perfectly.
The script:
- parses the params (networkId, transportId, serviceId, pmtPid) inside DVBViewer rtsp-links and adds the corresponding http-links (as rtsp is not treated correctly by MP) with free-to-air status into mptvdb,
- sets networkId, transportId, serviceId to 1 and pmtPid to 100000 for torrent tv channels.

The problem is with rtmp-links (e) and 545-tv.com (d).
I don't know which values to use for serviceId and pmtPid (tricks are not working here).
Only scanning may reveal the correct params.
But rtmp-links are not scanned at all, 545-tv.com links are scanned partially with MP crashing from time to time (logs are attached).

 

[georgius]

The problem is with rtmp-links (e) and 545-tv.com (d).
I don't know which values to use for serviceId and pmtPid (tricks are not working here).
Only scanning may reveal the correct params.
But rtmp-links are not scanned at all, 545-tv.com links are scanned partially with MP crashing from time to time (logs are attached).

I din't see any RTSP url in logs, so I don't know if there is another problem with RTSP or not. Forgot about RTMP links in TV. These links will not work - RTMP has FLV format and TV service needs MPEG2 TS format. For finding correct parameters for 545-tv.com streams you can use MP IPTV filter and url source splitter plugin in TV-Server configuration tool.

How to:

1. Test playlist or database URL (click last icon - blue question mark icon). The result should be green tick icon (testing_channel_successful.png in my first post in this thread).
2. If testing URL is successful, then open MPEG2 Transport Stream parser (m2ts_parser_in_editor.png).
3. On Stream analysis tab you probably find required information (m2ts_stream_analysis.png).

 

[bounguine]

1. RTSP-scanning logs are attached.
Playlist is:

#EXTM3U
#EXTINF:-1,11727 H - AMEDIA HIT (rus)
rtsp://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,552,551,550,2611,6,360,25,0,1,253,-1&pids=0,16,17,18,20,550,551,552,553
#EXTINF:-1,11727 H - MTV Rocks
rtsp://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,1102,1101,1100,2616,6,360,25,0,1,253,-1&pids=0,16,17,18,20,1100,1101,1102

For both the channels MP finds channel "НАШЕ НОВОЕ КИНО" (channel table) and "DANGE TV" (tuningdetail table).

I looked at the *.m3u generated by DVBViewer and found an extra-line my parser neglects.
Probably that's the reason VLC chooses the right channel and extracts EPG from RTSP:

#EXTINF:-1,11727 H - MTV Rocks
#EXTVLCOPTrogram=2616
rtsp://localhost:555/?src=1&freq=11727&msys=dvbs2&plts=off&fec=34&pol=h&ro=0.35&sr=27500&mtype=8psk&tnr=1,11727,27500,10750,0,0,9,3,1102,1101,1100,2616,6,360,25,0,1,253,-1&pids=0,16,17,18,20,1100,1101,1102

2. 545-tv.com HOW TO.
Yes, I read the first page, but I cannot afford clicking on the last icon 792 times.
Is there any way to automate the process?

3. RTMP
Is there any way to implement piping?
Nix example:

pipe:///usr/bin/ffmpeg -loglevel fatal -i INPUTLINK -vcodec libx264 -acodec aac -strict -2 -mbd rd -copyinkf -flags +ilme+ildct -fflags +genpts
-metadata service_provider=STRING -metadata service_name=STRING -f mpegts -tune zerolatency pipe:1

https://tvheadend.org/projects/tvheadend/wiki/Custom_MPEG-TS_Input

PS
Uphh
Too many problems.
If I would know how to extract http-/rtsp-links for TV channels from MP and use it as a slave server with another proxy backend for Kodi, it would be easier.

 

[mm1352000]

Unfortunately, I cannot comment upon how DVBViewer works, as I'm not the dev.

From the log files I can see that I was right. DVBViewer is supplying an SPTS without properly cleaning the SDT. Garbage in => garbage out.

Those, which are not decrypted by DVBViewer (no card available), are not locked.
Seems that a kind of brutal decrypting checking (I have more than 3k channels in DVBViewer) on the slave server side is made due to MP request, which might be bad for a user.

Based on Kay's comment, it seems that the decrypt requests are sent by DVBViewer because you include the "tnr" part in the URL. MP doesn't need or want to decrypt. It only needs to know the service ID and PMT PID...

Plus it shows EPG broadcasted by inbuilt DVBViewer rtsp server.

MP should be able to do this too if you configure TV Server (DVB EPG) correctly and DVBViewer is supplying the info in a standard way.

due to diseqc 1.1 problems

Yeah, not supported - sorry. But do you really have more than 4 satellite positions?

b) 4-tuner TBS6205 T2/C not working with MP

What do you mean "not working"?
Assuming tuning paramters are correct DVB-C should work fine. DVB-T2 should also work as long as you don't need multiple PLP support... but I guess you might need that because you're in Russia?

For both the channels MP finds channel "НАШЕ НОВОЕ КИНО" (channel table) and "DANGE TV" (tuningdetail table).

As above: it's the fault of DVBViewer and the way they are supplying the stream.

Is there any way to implement piping?

VODServer