unable to stat file ....

bucky2780

I am recovering from a corruption, and finally restored config backups and all is better now.

However I am getting numerous " ERROR dvr: unable to stat file" in my tvheadend log.

Is there some +easy+ way of fixing the leftover entries in dvr/log so it agrees with the recordings folder ?
I would love to get the logs nice and quiet, but it is too much for me to edit dvr/log files individually to edit out the missing files.

I am ok with losing some data... just dont want to lose ALL my recordings.

Many thanks in anticipation....

Any help is of course appreciated.

bucky2780

thanks all for the input.. problem is now cleared up....

here is the py snippet I used to clean things up. Hope it helps someone in the future...

In truth, don't know why there isn't a button that cleans up the dvr log when needed. This has happened to me a few times.... At least I now have a repeateable solution.

thanks again...

import requests
import os
import json

tvh_user="useri"
tvh_pass="pw"
tvh_server="192.168.xx.xx"

#urlTvhead = "http://" + tvh_user + ":" + tvh_pass + "@" + tvh_server + ":9981/api/dvr/entry/grid_finished?limit=10000"
#urlTvhead = "http://" + tvh_server + ":9981/api/dvr/entry/grid_finished?limit=10000"

#use Removed, or Finished to get a decent list of stuff
#in this case... I am seeing 300 removed entries for whcih there is no physical file... and am getting stat errors for these.

urlTvhead = "http://" + tvh_server + ":9981/api/dvr/entry/grid_removed?limit=10000"
urlTvheadRemove = "http://" + tvh_server + ":9981/api/dvr/entry/remove?uuid="
print(urlTvhead)

entries = requests.get(urlTvhead).json()
recs = 0
missingRecs = 0

for entry in entries['entries']:
resFilename="/mnt/nas/data/tvheadend" + entry['filename']
uid=entry['uuid']
recs += 1

if not os.path.isfile(resFilename):
    missingRecs += 1
    print("\n" + "uid:" + uid + "|" +resFilename)
    
    # use this to delete to offending entry using the uid from above....
    #requests.get(urlTvheadRemove + uid)

print ("recs read is : " + str(recs))
print ("missing-deleted recs are : " + str(missingRecs))

Tony Wagner

So you are missing some files and you just need to delete the associated DVR entries from TVHeadend?

You could script that using the API. Fetch a list of all recordings using the API “grid” endpoints, loop through them and test if their filename path exists, and if it doesn’t, send a remove API command.

https://docs.tvheadend.org/documentation/development/json-api/api-description/dvr

bucky2780

Tony Wagner
ok thanks for this...

soounds like a plan... but do you have some utility or script ready done... for this?

I perhaps can throw together a python script for this... but do you have a python lib ready to use ?

many thanks....

Tony Wagner

bucky2780 I've never done it, but it should be pretty easy with Python.

Because it's testing local file paths, you have to run it directly on the TVHeadend server computer or inside the TVHeadend Docker container.

You can update this script with your username and password and run it once to test -- it will print a message for each missing file it encounters. (Change or remove the "/tvheadend/" part of the URLs if your installation does not use that as its http_root.)

If that output looks correct, you can uncomment the last line and then run the script again to actually remove those DVR entries from TVHeadend.

import requests
import os

tvh_user="admin"
tvh_pass="password"

r = requests.get("http://" + tvh_user + ":" + tvh_pass + "@localhost:9981/tvheadend/api/dvr/entry/grid_finished?limit=10000")

for entry in r.json()['entries']:
    if not os.path.isfile(entry['filename']):
        print("missing " + entry['filename'])
        #requests.get("http://" + tvh_user + ":" + tvh_pass + "@localhost:9981/tvheadend/api/dvr/entry/remove?uuid=" + entry['uuid'])

bucky2780

thank you very much indeed...

I will play with this and should be sufficient.

I seem to run into this problem about once a year... so will put this into my toolbox for later use.

thanks again...

bucky2780

further to this... I used a version of this py snippet to examine the data more closely...

The Finished query shows up all fine. Files are there 100%

Turns out the "stat" issue stems from old "removed" recordings, whose log seems to still hang around for some reason. A query for "removed" showed some 300 items for which no file exists in the data folder

I guess I can query the "removed", and delete associated uuid using the remove.

Does that sound like a sound plan ?

davep

bucky2780 Go to Configuration -> Recording -> Digital Video Recording Profiles -> <your profile> and set "Recording Info Retention Period" to "On File Removal". Log files will then be deleted when the recording is deleted (but not if the recording cannot be found, for example if the disk is not mounted).

You may need to clean up your 300 - item backlog separately.