[HowTo] Catchup IPTV a.k.a +1 hour TV (in work) ?

Dimitar Maznekov · 2018-03-27T15:18:29+00:00

I'm trying to make catchup for IPTV to have +1, +2 etc hours back timeshift for channels which are not recorded by provider. I've made that setups 1.Mux Sc...

Saen Acro


#sudo ffmpeg -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -y \
-nostdin -hide_banner \
-loglevel quiet \
-fflags +genpts \
-user_agent HLS_CH1_delayer \
-i http://192.168.1.222:9981/stream/channelid/1165510174 \
-vcodec copy -acodec copy -scodec copy \
-hls_flags delete_segments -hls_time 10 -hls_list_size 6 /tmp/1_.m3u8

if process stop remove


-loglevel quiet \

or to show some status put

-loglevel info \

On second terminal

#watch -d ls -al /tmp total 40904 drwxrwxrwt 5 root root 4096 яну 3 21:37 . drwxr-xr-x 22 root root 4096 дек 21 09:11 .. -rw-r--r-- 1 root root 5120368 яну 3 21:35 1_10.ts -rw-r--r-- 1 root root 4714476 яну 3 21:35 1_11.ts -rw-r--r-- 1 root root 3531768 яну 3 21:35 1_12.ts -rw-r--r-- 1 root root 2156172 яну 3 21:35 1_13.ts -rw-r--r-- 1 root root 2658696 яну 3 21:35 1_14.ts -rw-r--r-- 1 root root 2244344 яну 3 21:36 1_15.ts -rw-r--r-- 1 root root 2074956 яну 3 21:36 1_16.ts -rw-r--r-- 1 root root 1951628 яну 3 21:36 1_17.ts -rw-r--r-- 1 root root 2287208 яну 3 21:36 1_18.ts -rw-r--r-- 1 root root 2294728 яну 3 21:36 1_19.ts -rw-r--r-- 1 root root 2306760 яну 3 21:36 1_20.ts -rw-r--r-- 1 root root 3452432 яну 3 21:37 1_21.ts -rw-r--r-- 1 root root 1835068 яну 3 21:37 1_22.ts -rw-r--r-- 1 root root 2546084 яну 3 21:34 1_8.ts -rw-r--r-- 1 root root 2652116 яну 3 21:35 1_9.ts -rw-r--r-- 1 root root 236 яну 3 21:37 1_.m3u8

this work on my PC

Dimitar Maznekov

Should be:


ffmpeg -loglevel fatal -thread_queue_size 512 -i http://127.0.0.1:9981/stream/channelnumber/NUM .....

I think he is missingchannelnumber/NUM where the NUM is number of desired channel.

Not bulletproof with channelnumber instead of channelid but it's way easy for me.

Ouch, that was so obviouse ....I didn't catch the mistake - missing %d in .ts file
Thats works for me



/usr/bin/ffmpeg -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -y -nostdin \
-i http://127.0.0.1:9981/stream/channelnumber/101 \
-vcodec copy -acodec copy -scodec copy \
-f segment -segment_list_type m3u8 -segment_list_flags +live -segment_wrap 60 \
-segment_list /home/lib/catch-up/101+1.m3u8 \
-segment_format mpegts /home/lib/catch-up/ch_101_stream_%d.ts

Dimitar Maznekov

And proper script for 60 segments x60sek:


#!/bin/bash.
/usr/bin/ffmpeg -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -y -nostdin \
-hide_banner -loglevel fatal \
-i http://127.0.0.1:9981/stream/channelnumber/101 \
-vcodec copy -acodec copy -scodec copy \
-f segment -segment_list_type m3u8 -segment_time 60 -segment_list_flags +live -segment_wrap 60 \
-segment_list /home/lib/catch-up/101+1.m3u8 \
-segment_format mpegts /home/lib/catch-up/ch_101_stream_%d.ts

Saen Acro

With experimenting things go to success ;)

instead of%d use%Y%m%d%H%M%S

Dimitar Maznekov

Yeah, but there was another magic with date and %Y%m%d%H%M%S which I'm too lazy to remember... so %d is acceptable for me ;)

deganza 11

Where do I've to put this code?

- in the Networks section as new IPTV-Network?

- in the Muxer-Section?

at the moment I got the following output:

2019-01-04 07:11:10.694 spawn: ffmpeg version 3.4.1 Copyright (c) 2000-2017 the FFmpeg developers
2019-01-04 07:11:10.694 spawn: built with gcc 4.9.3 (crosstool-NG 1.20.0) 20150311 (prerelease)
2019-01-04 07:11:10.694 spawn: configuration: --target-os=linux --cross-prefix=/spksrc/toolchains/syno-x64-6.1/work/x86_64-pc-linux-gnu/bin/x86_64-pc-linux-gnu- --prefix=/var/packages/ffmpeg/target --extra-cflags=-I/spksrc/spk/ffmpeg/work-x64-6.1/install/var/packages/ffmpeg/target/include --extra-ldflags=-L/spksrc/spk/ffmpeg/work-x64-6.1/install/var/packages/ffmpeg/target/lib --extra-libs='-lxml2 -ldl' --pkg-config=/usr/bin/pkg-config --ranlib=/spksrc/toolchains/syno-x64-6.1/work/x86_64-pc-linux-gnu/bin/x86_64-pc-linux-gnu-ranlib --enable-cross-compile --enable-rpath --enable-pic --enable-shared --enable-optimizations --enable-pthreads --enable-gpl --enable-version3 --enable-nonfree --enable-fontconfig --enable-libass --enable-libbluray --enable-avresample --enable-libfdk-aac --enable-libfreetype --enable-libfribidi --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libvo-amrwbenc --enable-l
2019-01-04 07:11:10.694 spawn: libavutil 55. 78.100 / 55. 78.100
2019-01-04 07:11:10.694 spawn: libavcodec 57.107.100 / 57.107.100
2019-01-04 07:11:10.694 spawn: libavformat 57. 83.100 / 57. 83.100
2019-01-04 07:11:10.694 spawn: libavdevice 57. 10.100 / 57. 10.100
2019-01-04 07:11:10.694 spawn: libavfilter 6.107.100 / 6.107.100
2019-01-04 07:11:10.694 spawn: libavresample 3. 7. 0 / 3. 7. 0
2019-01-04 07:11:10.694 spawn: libswscale 4. 8.100 / 4. 8.100
2019-01-04 07:11:10.694 spawn: libswresample 2. 9.100 / 2. 9.100
2019-01-04 07:11:10.694 spawn: libpostproc 54. 7.100 / 54. 7.100
2019-01-04 07:11:10.696 spawn: Trailing options were found on the commandline.
2019-01-04 07:11:10.696 spawn: Hyper fast Audio and Video encoder
2019-01-04 07:11:10.696 spawn: usage: ffmpeg [options] [[infile options] -i infile]... {[outfile options] outfile}...
2019-01-04 07:11:10.696 spawn: Use -h to get full help or, even better, run 'man ffmpeg'

2019-01-04 07:11:10.698 iptv: stdin pipe unexpectedly closed: No data

Dimitar Maznekov

That ffmpeg things are put in .sh script which you must run in autostartup manner.
I thought there was pre- and post-mux way to start it but not so sure....
BTW you miss something cause you dont have input data stream.

Dimitar Maznekov

saen acro wrote:
> With experimenting things go to success ;)
>

> instead of%d use%Y%m%d%H%M%S

Some clarifications:
To use indexing like%Y%m%d%H%M%S you must have option in ffmpeg line-strftime 1 BUT in meaning of goal is UNACCEPTABLE because created .ts chunks are NOT overwriten from newer chunks so you will become very quickly out-of-space.
So it's fine to use%03d and newer files will overwrite older.

Saen Acro

FFMpeg self-clean chunks out of playlist file

#!/bin/bash. #Put your storage location STORAGE=/tmp/catchup-tv rm -rf $STORAGE *.ts /usr/bin/ffmpeg -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -y -nostdin \ -hide_banner -loglevel fatal \ -user_agent CatchUP-delayer_1h_channel-X # show client in TVH -i http://127.0.0.1:9981/stream/channelnumber/101 \ #channel url -vcodec copy -acodec copy -scodec copy \ -f segment -segment_list_type m3u8 -segment_time 60 -segment_list_flags +live -segment_wrap 60 \ -hls_flags delete_segments \ -segment_list $STORAGE/101+1.m3u8 \ -segment_format mpegts $STORAGE/ch_101_stream_%d.ts

need more set for variables

Dimitar Maznekov

Ummm, not actualy:

#!/bin/bash /usr/bin/ffmpeg -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -y -nostdin \ -hide_banner -loglevel fatal \ -i http://127.0.0.1:9981/stream/channelnumber/$1 \ -vcodec copy -acodec copy -scodec copy \ -user_agent CatchUP_1h_channel-$1 \ -f segment -segment_list_type m3u8 -segment_list_flags +live \ -segment_time 60 -segment_wrap 60 \ -segment_list /home/lib/catch-up/$1+1.m3u8 \ -segment_format mpegts /home/lib/catch-up/ch_$1_%d.ts

That's overwrite older .ts chunks. Tested with 60x1s, now I'm testing with 60x60(1h)

And add according service file


/etc/systemd/system/timeshift_Nova.service

[Unit]
Description=Timeshift Nova TV
After=tvheadend.service

[Service]
#Type = forking
ExecStart=/home/lib/catch-up/timeshift_ts.sh 103 &

[Install]
WantedBy=default.target

$ sudo systemctl daemon-reload
$ sudo systemctl enable timeshift_Nova.service # to enable startup exec
$ sudo systemctl start timeshift_Nova.service

Saen Acro

Lets put this as new project in GITHUB ;)

it shod


-hls_flags delete_segments

https://ffmpeg.org/ffmpeg-formats.html#Options-5


hls_delete_threshold size
   Set the number of unreferenced segments to keep on disk before hls_flags delete_segments deletes them. Increase this to allow continue clients to download segments which were recently referenced in the playlist. Default value is 1, meaning segments older than hls_list_size+1 will be deleted.

hls_ts_options options_list
   Set output format options using a :-separated list of key=value parameters. Values containing : special characters must be escaped.

hls_wrap wrap
   This is a deprecated option, you can use hls_list_size and hls_flags delete_segments instead it
   This option is useful to avoid to fill the disk with many segment files, and limits the maximum number of segment files written to disk to wrap.

Dimitar Maznekov

HLS chunks will test later today ;)
Oh you meant it should delete old chunks.... nope, that's separate options in FFMPEG "-f segment" instead of HLS. Anyway will test that way (which is new for me but looks more easier)

Dimitar Maznekov

So dear fellows, thanks to the ideas and help of @sean acro can say - HLS chunks, even the same stream format (MPETS) are much easier and better than segments in FFMPEG. Litle cons are missing direct way to setup file name templates. They're derivatives of playlist name but anyway that's not so important. Just the name of playlist put in mux.
Here you are:


#!/bin/bash.
/usr/bin/ffmpeg -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -y -nostdin \
-hide_banner -loglevel fatal \
-i http://127.0.0.1:9981/stream/channelnumber/$1 \
-vcodec copy -acodec copy -scodec copy \
-fflags +genpts -user_agent HLS_delayer \
-hls_flags delete_segments -hls_time 10 -hls_list_size 360 /home/lib/catch-up/hls_$1_.m3u8

Pros - little faster, little smaller files (IDK why?) much easier to setup.
Recommend to set hsl_time to shorter time intervals. That way will be faster to start mux a.k.a play channel. So here is 360 chunks by 10sek = 1h

Could be more fine tunning pleas feel free to adjust.

The script and the service file could be made the same way as https://tvheadend.org/projects/tvheadend/activity?from=2019-01-04

Now I'm testing full lenght 1h timeshift and after that will update Topic with that workaround.

Thanks again to anyone who helped with ideas, know how and whit push ;)

PS:Just put it here MUX format but need testing


pipe:///usr/bin/ffmpeg -live_start_index -99999 -i /home/lib/catch-up/hls_407_.m3u8 -c copy -f mpegts pipe:1

And choose option "Use A/V library" to "Dont use"

Saen Acro

Missing is

pipe:///usr/bin/ffmpeg \ -live_start_index -99999 \ -i /home/lib/catch-up/hls_407_.m3u8 \ -c copy \ -f mpegts \ -metadata service_provider="Some provider" \ -metadata service_name="Channel +1" \ -loglevel fatal \ pipe:1

this will solveService01 name and provider for tag and spam in log ;)

Dimitar Maznekov

Nice, what can I do w/o cheks from you :D

Saen Acro

There maby more optimisations with can be done.

Any responses are welcome.

Dimitar Maznekov wrote:

> Nice, what can I do w/o cheks from you :D

Ще пиеме по едно безалкохолно :D

In translation:
Will drink one soft drink.

Dimitar Maznekov

Soft drink...you meant beer ?
Just tell me when n where :D

Saen Acro

Dimitar Maznekov wrote:
> Soft drink...you meant beer ?

> Just tell me when n where :D

As was modern before 20y ago "You've Got Mail"

Dimitar Maznekov

Little update to prevent disk space leaking


#!/bin/bash
/usr/bin/ffmpeg -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -y -nostdin \
-hide_banner -loglevel fatal \
-i http://127.0.0.1:9981/stream/channelnumber/$1 \
-vcodec copy -acodec copy -scodec copy -g 60 \
-fflags +genpts -user_agent HLS_delayer -metadata service_provider="TimeShift" -metadata service_name="NovaTV +1" \
-f hls -hls_flags delete_segments -hls_time 10 -hls_list_size 360 -hls_wrap 361 \
-hls_segment_filename /disk2/timeshift/$1_%03d.ts /disk2/timeshift/$1_hls.m3u8

Saen Acro

Dimitar Maznekov wrote:
> Little update to prevent disk space leaking

> [...]

Just to explain to more beginners, that value$1

is used this way


./hls_catchup_stream.sh [channel number]

« Previous Page Next Page »