Automatic cleaning of recordings

Sébastien Aubry · 2012-05-13T23:19:16+00:00

Hello, I am using XBMCBuntu Eden + tvheadend 2.12.99~pulse-6. Quite often, the old recordings are not deleted from my hard disk in order to make some space...

Sébastien Aubry

Hi Mark,
* I check my



~/.hts/tvheadend/dvr/log

directory and the oldest file is from October 12, about 30 days ago. So even when I manually delete the recordings, TvHeadend still deletes the log entries afterwards, which is a good thing!
* About htspdel: I just saw that it imports the tvh Python package.
I guess it refers to "this package" I currently use the "packaged" version of TvHeadend 3.4.27 packaged for XBMCBuntu Frodo (Quantal). Is this Python API installed anywhere? How can I install it? Do I have to extract the source from the Git repository for that?
* I tried your script manually. I did not have ffmpeg installed so I installed it from the Ubuntu repositories:


Unpacking ffmpeg (from .../ffmpeg_6%3a0.8.9-0ubuntu0.12.10.1_i386.deb) ...

Then I got these errors:

spontex@pchc:~/scripts/tvheadend$ ./mk_mkv_tv.pl -f CANAL+-Le-petit-journal.2013-11-09.07-30.mkv
./mk_mkv_tv.pl:18414:comskip 
./mk_mkv_tv.pl:18414:Logging to mk_mkv_tv.log with 1d archive interval
CANAL+-Le-petit-journal.2013-11-09.07-30.mkv not in use .. start encode to CANAL+-Le-petit-journal.2013-11-09.07-30.mkv
ffmpeg version 0.8.9-6:0.8.9-0ubuntu0.12.10.1, Copyright (c) 2000-2013 the Libav developers
  built on Nov  9 2013 19:15:53 with gcc 4.7.2
*** THIS PROGRAM IS DEPRECATED ***
This program is only provided for compatibility and will be removed in a future release. Please use avconv instead.
[matroska,webm @ 0x9b5f720] Unknown/unsupported CodecID S_DVBSUB.
[matroska,webm @ 0x9b5f720] max_analyze_duration reached
[matroska,webm @ 0x9b5f720] Estimating duration from bitrate, this may be inaccurate
Input #0, matroska,webm, from 'CANAL+-Le-petit-journal.2013-11-09.07-30.mkv':
  Metadata:
    title           : Le petit journal
    DATE_BROADCASTED: 2013-11-09 07:30:00
    ORIGINAL_MEDIA_TYPE: TV
    TVCHANNEL       : CANAL+
    SUMMARY         : Yann Barthès et son équipe dévoilent un décryptage décalé et humoristique de la communication des politiques, la vie des médias et des vedettes à travers des interviews et des reportages.
    SUMMARY-fre     : Yann Barthès et son équipe dévoilent un décryptage décalé et humoristique de la communication des politiques, la vie des médias et des vedettes à travers des interviews et des reportages.
  Duration: 00:35:00.68, start: 0.000000, bitrate: 16472 kb/s
    Stream #0.0(eng): Video: mpeg2video (Main), yuv420p, 720x576 [PAR 64:45 DAR 16:9], 15000 kb/s, 25 fps, 25 tbr, 1k tbn, 50 tbc (default)
    Stream #0.1(fre): Audio: mp2, 48000 Hz, stereo, s16, 256 kb/s (default)
    Stream #0.2(eng): Audio: mp2, 48000 Hz, stereo, s16, 256 kb/s (default)
    Stream #0.3(fre): Audio: ac3, 48000 Hz, stereo, s16, 384 kb/s (default)
    Stream #0.4(eng): Audio: ac3, 48000 Hz, stereo, s16, 384 kb/s (default)
    Stream #0.5(qaa): Audio: mp2, 48000 Hz, stereo, s16, 192 kb/s (default)
    Stream #0.6(fre): Subtitle: [0][0][0][0] / 0x0000 (default)
    Stream #0.7(fre): Subtitle: [0][0][0][0] / 0x0000 (default)
    Stream #0.8(fre): Subtitle: [0][0][0][0] / 0x0000 (default)
Unrecognized option 'c:v'
Failed to set value 'libx264' for option 'c:v'

I suspect a version mismatch. Do you use an older version of ffmpeg?
* Another question: After the conversion, does TvHeadend lose the link with its recording files? Are the converted recordings listed under XBMC > Live TV > Recordings?
Thanks!

Mark Kirkpatrick

I use git versions for ffmpeg/xbmc/tvheadend and some others. That is the library but good question I had to copy the lib to /usr/local/lib/py so it would run.

I also had to add the delete command to the library htsp.py from the manual pages sorry forgot about that:
mediacenter tvh # ls
dvb_charset_tables.py htsmsg.py htsmsg.pyc htsp.py htsp.pyc init__.py init__.pyc log.py log.pyc tsreader.py

mediacenter tvh # tail -10 htsp.py

# Enable delete command
def deleteDvrEntry( self, args = {} ):

self.send('deleteDvrEntry', args)

# ############################################################################
# Editor Configuration
#
# vim:sts=2:ts=2:sw=2:et
# ############################################################################
mediacenter tvh # pwd
/usr/local/lib/py/tvh

mediacenter tvh #

Yes the link is lost because the name changes from mpg to mkv that is why I wanted to clean up. The script could easily relocate them but I have the current dirs defined in xbmc as TV type.

They do not show up in recordings because of this name change they show up in TV Shows since I do an auto refresh/update nightly and they are discovered and episode info is downloaded. ( If you can get the right sXXeYY into the name)

Mark Kirkpatrick

FYI I have a very new ffmpeg but the script is using handbrake for some time now the ffmpeg were commented out:

# $enc_opts = '-map 0 -map -0:a:1 -c:v libx264 -s:v:0 640x480 -c:a:0 libfdk_aac -flags +qscale -global_quality 3 -afterburner 1 -ac:0 2 -c:s copy -crf 24';
# $hbret = `/usr/bin/ffmpeg -i "${mfile}" -preset veryslow ${enc_opts} "${mediatitle}"`;
$enc_opts = 'bframes=8:b-adapt=2:direct=auto:me=umh:merange=24:partitions=all:rc-lookahead=60:ref=16:subme=10:trellis=2:psy-rd=1.0,0.2';

$hbret = `/usr/bin/HandBrakeCLI -i ${mfile} -I -v -e x264 -q 24 -w 640 --loose-anamorphic -a 1 -E faac -B 128 -f mkv -N eng -s 1,2 -m -x ${enc_opts} -o "${mediatitle}"`;

( so it is possible that the c:v syntax is no longer valid. handbrake runs the same libx264 but has easier subtitle inclusion )

Sébastien Aubry

Mark Kirkpatrick wrote:

> They do not show up in recordings because of this name change they show up in TV Shows since I do an auto refresh/update nightly and they are discovered and episode info is downloaded. ( If you can get the right sXXeYY into the name)

Hi,
Yes but is it possible to replace the recordings? Cause I do not record only TV shows, also movies and various programs which won't have any metadata if I lose the TvHeadend EPG metadata.
Thanks

Mark Kirkpatrick

As in delete them then add in an new recording record or update an existing recording record ?? I have never looked at the api to see. I am certain you could search and replace the data file with he new filename but I always worried about syncing web server memory with behind the scene file system changes.

I was going to pass the metadata right to the script at one point since ffmpeg can store tags right in the files like iTunes ( atomicparsley ) and you could bundle it all in self-contained. Never got to it. Not hard to do since the meta is available in the call to the script.

Sébastien Aubry

I was just thinking about keeping the same file name. But your script do not produce .mkv files, do they?
Will the tags stored by ffmpeg be retrieved by XBMC? We will still miss some PVR information such as recording date, etc. This is why I would rather only replace the file with a smaller one or update the TVHeadend metadata.

Sébastien Aubry

Mark Kirkpatrick wrote:
> FYI I have a very new ffmpeg but the script is using handbrake for some time now the ffmpeg were commented out:
>
> # $enc_opts = '-map 0 -map -0:a:1 -c:v libx264 -s:v:0 640x480 -c:a:0 libfdk_aac -flags +qscale -global_quality 3 -afterburner 1 -ac:0 2 -c:s copy -crf 24';
> # $hbret = `/usr/bin/ffmpeg -i "${mfile}" -preset veryslow ${enc_opts} "${mediatitle}"`;
> $enc_opts = 'bframes=8:b-adapt=2:direct=auto:me=umh:merange=24:partitions=all:rc-lookahead=60:ref=16:subme=10:trellis=2:psy-rd=1.0,0.2';
> $hbret = `/usr/bin/HandBrakeCLI -i ${mfile} -I -v -e x264 -q 24 -w 640 --loose-anamorphic -a 1 -E faac -B 128 -f mkv -N eng -s 1,2 -m -x ${enc_opts} -o "${mediatitle}"`;
>

> ( so it is possible that the c:v syntax is no longer valid. handbrake runs the same libx264 but has easier subtitle inclusion )

Hi,

What I don't get is that in the script you sent earlier, the ffmpeg lines were not commented out:

	if ( $mfile =~ /\.mkv/ ) # change to Switch to decide if blueray or dvd source
	{ 
	$enc_opts = '-map 0 -map -0:a:1 -c:v libx264 -s:v:0 640x480 -c:a:0 libfdk_aac -flags +qscale -global_quality 3 -afterburner 1 -ac:0 2 -c:s copy -crf 24';
	$hbret = `/usr/bin/ffmpeg -i "${mfile}" -preset veryslow ${enc_opts} "${mediatitle}"`;
	}

Do I get into this block because I tried to convert a .mkv file instead of a .ts one?

Regards

Mark Kirkpatrick

Yes, That is what is happening. All my tvheadend are from an hdhomerun and in ts format. I did say they were not cleaned up :) .

That whole clause is never used in my case and is leftover from an older script that would take makemkv generated blueray copies and compress them.

I looked at it again and that is the case , also comscipt only works on original mpg so another reason I left it as TS. You can delete the entire if statement and just update the one below it to open whatever filetypes you use ( comment out comskip if not ts|mpg )

« Previous Page