Hi
I have a similar issue as https://tvheadend.org/d/8986-transcode-with-n100i7-8700-via-vaapi-x265 but with slight variations, so I opened a new post. I apologize in advance if I should rather have added to the original one.
My issue is the following:
I run tvh (latest commit) precompiled with vaapi support and all the right libraries inside an LXC container on proxmox. vaapi seems to be setup correctly, as the hardware transcoding steps in when needed and it actually produces an output. But, neither recording, nor live transcoding actually works.
I have right now configured my codec like this:

my streaming profile for now only starts with vp8, vp9 and mpeg2 (gives me the best compatibility on most channels). Also, for now it just copies the audio
Whenever I go to a channel that requires transcoding (with a streaming profile without filtering the protocols), it starts transcoding but I have either one of the following issues:
- Input Video MPEG2, Input Audio MPEG2 -> stuttering output video, no audio . Sometimes the audio catches up after a minute or so
- Input Video MPEG2, Input Audio anything else -> no video, clear audio
- Input Video h.264, Input Audio whatever -> clear video, no audio OR clear video, audio delayed 3-5 seconds, tries to catch up after a minute or so but never actually reaching it
I have built tvheadend myself, it runs ffmpeg 7.1.2 (and all accompanying libraries) with vaapi support, has been built with vaapi support, has the latest library version of libvpl
And I can confirm, that ffmpeg and tvheadend both use transcoding inside the container.
But I cannot get it to run stable through tvheadend. Btw, If I do the transcoding through another app, like Jellyfin, with the same setup, it works fine. So it is definitely something in the tvh chain.
My guess is the mixer at the end, but I would love for some pointers on how I can investigate this issue further down the line.