tvheadend on OpenWRT (Turris Omnia), I am unable to get EPG working

Jonathan Bradshaw

I am running tvheadend on OpenWRT (Turris Omnia) and despite success in the past, I am unable to get EPG working for a new setup.

The setup UI gets the various DVB-T settings correct, I can play the DVB-T stream (VLC and Kodi), and the UK: Freesat OTA grabber is enabled but I don't see any content in the EPG WEB UI Window.

Any pointers would be useful, thanks and all the best Jonathan

Build: ~openwrt8 (2023-11-24T14:52:15+0000)

Model：Turris Omnia
Kernel Version：5.15.135
Architecture：ARMv7 Processor rev 1 (v7l)

Firmware Version：TurrisOS 6.4.4 42374bcee6b51b78848c7031900e908d2d7fe74d

Startup command : tvheadend -d --fileline --debug main,cron,spawn,scanfile,START,settings,config,tbl-eit,epg,epgdb,
epggrab,psip,opentv,pyepg,xmltv --trace main,cron,spawn,START,settings,config,tbl-eit,epg,epgdb,epggrab,psip,opentv,pyepg,xmltv --logfile /tmp/tvheadend.log -B -c /etc

/tvheadend --bindaddr 192.168.2.1 --http_port 9981 --http_root /tvheadend --htsp_port 9982

2024-01-15 13:45:31.495 [ TRACE]:main: (src/main.c:1230) epggrab_init() enter
2024-01-15 13:45:31.495 [ INFO]:epggrab: module eit created
2024-01-15 13:45:31.495 [ INFO]:epggrab: module uk_freesat created
2024-01-15 13:45:31.495 [ INFO]:epggrab: module uk_freeview created
2024-01-15 13:45:31.495 [ INFO]:epggrab: module nz_freeview created
2024-01-15 13:45:31.495 [ INFO]:epggrab: module viasat_baltic created
2024-01-15 13:45:31.495 [ INFO]:epggrab: module Bulsatcom_39E created
2024-01-15 13:45:31.495 [ INFO]:epggrab: module psip created
2024-01-15 13:45:31.502 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:891) dictionary skynz loaded
2024-01-15 13:45:31.502 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:891) dictionary skyit loaded
2024-01-15 13:45:31.503 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:891) dictionary skyeng loaded
2024-01-15 13:45:31.505 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:1040) dictonaries loaded
2024-01-15 13:45:31.505 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:852) genre map skyuk loaded
2024-01-15 13:45:31.505 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:852) genre map skynz loaded
2024-01-15 13:45:31.505 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:852) genre map skyit loaded
2024-01-15 13:45:31.506 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:852) genre map ausat loaded
2024-01-15 13:45:31.506 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:1045) genre maps loaded
2024-01-15 13:45:31.506 [ INFO]:epggrab: module opentv-skyuk created
2024-01-15 13:45:31.506 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "$S ?([0-9]+),? [Ee]p? ?[0-9]+$" 2024-01-15 13:45:31.506 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern ". S ?([0-9]+) [Ee]p? ?[0-9]+" 2024-01-15 13:45:31.506 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern " $S ?[0-9]+,? [Ee]p? ?([0-9]+)$"
2024-01-15 13:45:31.506 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern ". S ?[0-9]+ [Ee]p? ?([0-9]+)"
2024-01-15 13:45:31.506 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "$[Ee]p ?([0-9]+)$" 2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern " $[Ee]p ?([0-9]+)/[0-9]+$"
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "^([0-9]+)/[0-9]+. "
2024-01-15 13:45:31.507 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:1020) provider skyuk loaded
2024-01-15 13:45:31.507 [ INFO]:epggrab: module opentv-skynz created
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "$S ?([0-9]+),? Ep? ?[0-9]+$" 2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern " $S ?[0-9]+,? Ep? ?([0-9]+)$"
2024-01-15 13:45:31.507 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:1020) provider skynz loaded
2024-01-15 13:45:31.507 [ INFO]:epggrab: module opentv-skyit created
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "([0-9]+)'?a? Stagione +Ep\. ?[0-9]+[a-z]?"
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "([0-9]+)'?a? Stagione -? ?Puntata ?[0-9]+"
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "([0-9]+)'?a? Stagione"
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "[0-9]+'?a? Stagione +Ep\. ?([0-9]+)[a-z]?"
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "[0-9]+'?a? Stagione -? ?Puntata ?([0-9]+)"
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "^Ep\. ?([0-9]+)[a-z]?" 2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "^ Puntata ?([0-9]+)"
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern " Ep\. ?([0-9]+) -"
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "[0-9]+'?a? Stagione +Ep\. ?[0-9]+([a-z]?)"
2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "^Ep\. ?[0-9]+([a-z]?)" 2024-01-15 13:45:31.507 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "[0-9]+'?a? Stagione +Ep\. ?[0-9]+[A-Za-z]? -? ?'(([^'](' [^A-Z0-9-])?('[^ '])?)+)'"
2024-01-15 13:45:31.508 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "Ep\. ?[0-9]+[A-Za-z]? -? ?'(([^']*(' [^A-Z0-9-])?('[^ '])?)+)'"
2024-01-15 13:45:31.508 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "[0-9]+'?a? Stagione -? ?'(([^']*(' [^A-Z0-9-])?('[^ '])?)+)'"
2024-01-15 13:45:31.508 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "[0-9]+'?a? Stagione -? ?Puntata ?[0-9]+[A-Za-z]? ""([^"]+) """
2024-01-15 13:45:31.508 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "^(.)- 1\^TV$" 2024-01-15 13:45:31.508 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "^ (.*)$diretta$ $"
2024-01-15 13:45:31.508 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern "^(.)$" 2024-01-15 13:45:31.508 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:1020) provider skyit loaded 2024-01-15 13:45:31.508 [ INFO]:epggrab: module opentv-ausat created 2024-01-15 13:45:31.508 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern " $S ?([0-9]+),? Ep? ?[0-9]+$"
2024-01-15 13:45:31.508 [ TRACE]:opentv: (src/epggrab/module/opentv.c:817) compiled pattern " *$S ?[0-9]+,? Ep? ?([0-9]+)$"
2024-01-15 13:45:31.508 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:1020) provider ausat loaded
2024-01-15 13:45:31.508 [ DEBUG]:opentv: (src/epggrab/module/opentv.c:1050) providers loaded
2024-01-15 13:45:31.543 [ INFO]:epggrab: module pyepg created
2024-01-15 13:45:31.543 [ INFO]:epggrab: module xmltv created
2024-01-15 13:45:31.544 [ DEBUG]:xmltv: (src/epggrab/module/xmltv.c:854) using internal grab search
2024-01-15 13:45:31.546 [ TRACE]:epggrab: (src/epggrab/otamux.c:645) next ota start event in 1800 seconds
2024-01-15 13:45:31.546 [ TRACE]:main: (src/main.c:1230) epggrab_init() leave
2024-01-15 13:53:43.656 [ TRACE]:epggrab: (src/epggrab/otamux.c:645) next ota start event in 377 seconds
2024-01-15 13:53:46.607 [ DEBUG]:settings: (src/settings.c:150) saving to /srv/etc/tvheadend-2/epggrab/config
2024-01-15 14:00:00.000 [ TRACE]:epggrab: (src/epggrab/otamux.c:655) ota start callback
2024-01-15 14:00:00.000 [ TRACE]:epggrab: (src/epggrab/otamux.c:645) next ota start event in 3600 seconds
2024-01-15 15:00:00.000 [ TRACE]:epggrab: (src/epggrab/otamux.c:655) ota start callback
2024-01-15 15:00:00.000 [ TRACE]:epggrab: (src/epggrab/otamux.c:645) next ota start event in 3600 secon

Adrian Smith

Some things to check:

In "Configuration/DVB Inputs/Muxes" is the EPG Module ID for Mux 11426.5H set to "UK: Freesat"? If not, manually set it for this Mux. This is the Freesat home transponder and is the only mux that carries the full 7-day Freesat EPG.

Have you mapped your channels using one of the Freesat bouquets in "Configuration/Channel EPG/Bouquets"? You'll see a load of BSkyB bouquets in here as well but the Freesat ones have a "Source" that begins with "dvb-freesat".

If you're mapping the channels manually, are the LCNs the same as Freesat?

Jonathan Bradshaw

Adrian, thanks for the note. No success just yet.

I hacked Mux 11426.5H and set "UK: Freesat", I can see services on the MUX but no change in the EPG.

I don't see any bouquets with a source that begins with "dvb-freesat", I can see "freescan" and "bskyb"

Any more ideas or pointers welcome, all the best Jonathan

Jonas Lang

Try scanning 11425 H and see what results it yields.

Adrian Smith

You need to play one of the services on 11426.5H from the "Services" tab. Nothing will actually "play" in your chosen player (e.g. VLC) but you should see in the log that the service has been tuned. After a minute or two of playing the service you should also see the bouquets being discovered in the log file.

Saen Acro

About > toggle details
and post details of build you have.

Jonathan Bradshaw

I have muxes up at 11425h, 11426.5 v&h and 11428h also I can see services for FreesatSSU/info/home from each. Running VLC on a service on any MUX does not seem to make any difference. I also have a DVB-T USB device on this box, I can see MUX & services from the DVB-T network and that is not collecting any EPG info either.

Thanks for all of the ideas so far, all the best Jonathan

Jonas Lang

What DVB tuners do you have connected. Have you both DVBS and DVBT connected to the same system.

Have you tried changing the priority of your two EPG grabbers

I understand you have TVH installed on a router. Could you elaborate a little more on your setup.

Jonas Lang

I’ve never used Freesat and Freeview simultaneously. In fact from what I can gather the only difference between both is how they are delivered DVBS v DVBT.

I imagine EPG from both sources are somehow conflicting. If DVBS is your main priority try disabling the Freeview EPG grabber and see what EPG is then available.

If you are UK based also try disabling EIT DVB and PSIP and enabling Open TV Sky UK EPG and see what’s available after a scan of 11426 H and 11178 V.

That Turris Omnia looks mighty damn expensive. Could you confirm from the About tab on the TVH UI what version of TVH you are running.

Saen Acro

@ user#38331
Information is needed, we don't see what you see


About > toggle details

and post details of build you have.

Jonathan Bradshaw

Hi Jonas, thanks for the note.

I updated the priority so that each EPG has its own priority. No change to the EPG tab following a restart.

- 1. EIT DVB
- 2. PSIP
- 5. Freesat

- 6. Freeview

The DVD-T interface is attached to a local USB port, also I have a DVB-S SAT-IP tuner on the LAN (4 ports)

The hardware is a Turris Omnia

Kernel Version：5.15.135
Architecture：ARMv7 Processor rev 1 (v7l)

Firmware Version：TurrisOS 6.4.4 42374bcee6b51b78848c7031900e908d2d7fe74d

tvheadend is Build ~openwrt8 (2023-11-24T14:52:15+0000)

All the best Jonathan

Adrian Smith

Jonas Lang wrote:
> I’ve never used Freesat and Freeview simultaneously. ......
>
> I imagine EPG from both sources are somehow conflicting.

This is not an issue. I ran for years with both Freesat and Freeview tuners on the same system (and their corresponding EPGs). The only problem this can cause (that I am aware of) is if using accurate recording but, in terms of simply populating EPG information for the channels there is no issue at all.

Jonas Lang wrote:
> If you are UK based also try disabling EIT DVB and PSIP and enabling Open TV Sky UK EPG and see what’s available after a scan of 11426 H and 11178 V.
>
Why Open TV Sky UK EPG? There should be no need to do this. Surely this just confuses things even further?

Jonas Lang

Jonathan Bradshaw wrote:
> Hi Jonas, thanks for the note.
>
> I updated the priority so that each EPG has its own priority. No change to the EPG tab following a restart.
>
> - 1. EIT DVB
> - 2. PSIP
> - 5. Freesat
> - 6. Freeview
>
> The DVD-T interface is attached to a local USB port, also I have a DVB-S SAT-IP tuner on the LAN (4 ports)
>
> The hardware is a Turris Omnia
>
> Kernel Version：5.15.135
> Architecture：ARMv7 Processor rev 1 (v7l)
> Firmware Version：TurrisOS 6.4.4 42374bcee6b51b78848c7031900e908d2d7fe74d
>
> tvheadend is Build ~openwrt8 (2023-11-24T14:52:15+0000)
>

> All the best Jonathan

I’m not too familiar with OpenWRT and not sure who is supporting the build. If you haven’t already done so you could ask here for further clarification https://forum.openwrt.org/t/tvheadend-on-openwrt/30967

I’ve made a couple of general suggestions on things you could try so in the absence of any other constructive input here you could try that forum. Maybe @ Adrian Smith has the answers though.

Jonas Lang

Jonas Lang wrote:
> Jonathan Bradshaw wrote:
> > Hi Jonas, thanks for the note.
> >
> > I updated the priority so that each EPG has its own priority. No change to the EPG tab following a restart.
> >
> > - 1. EIT DVB
> > - 2. PSIP
> > - 5. Freesat
> > - 6. Freeview
> >
> > The DVD-T interface is attached to a local USB port, also I have a DVB-S SAT-IP tuner on the LAN (4 ports)
> >
> > The hardware is a Turris Omnia
> >
> > Kernel Version：5.15.135
> > Architecture：ARMv7 Processor rev 1 (v7l)
> > Firmware Version：TurrisOS 6.4.4 42374bcee6b51b78848c7031900e908d2d7fe74d
> >
> > tvheadend is Build ~openwrt8 (2023-11-24T14:52:15+0000)
> >
> > All the best Jonathan
>
> I’m not too familiar with OpenWRT and not sure who is supporting the build. If you haven’t already done so you could ask here for further clarification https://forum.openwrt.org/t/tvheadend-on-openwrt/30967 >

> I’ve made a couple of general suggestions on things you could try so in the absence of any other constructive input here you could try that forum. Maybe @Adrian Smith has the answers though.

Adrian Smith

@Jonathan Bradshaw,

What channels do you have mapped and from what services? How did you map them (I assume any Freesat channels you have mapped manually since you currently don't have the bouquets populated).

A screen shot of the channels tab would be useful.

In terms of the missing bouquets - try "playing" the whole mux for 11426.5H. The same as you did for playing one of the services but playing the mux from the "muxes" tab. This should subscribe to all PIDs and hopefully get the bouquets discovered.

Saen Acro

https://tvheadend.org/attachments/download/9869/Screenshot_20240120_093554.png

Is there something hard to click onToggle details
and paste text from build details here?

Jonathan Bradshaw

Configure arguments:

--target=arm-openwrt-linux-muslgnueabi --host=arm-openwrt-linux-muslgnueabi --build=x86_64-pc-linux-gnu --program-prefix= --program-suffix= --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --libexecdir=/usr/lib --sysconfdir=/etc --datadir=/usr/share --localstatedir=/var --mandir=/usr/man --infodir=/usr/info --disable-avahi --arch=arm --disable-dbus_1 --disable-libav --disable-ffmpeg_static --enable-bundle --disable-uriparser --nowerror=unused-variable

Compiler:
Using C compiler: ccache_cc
Using C flags: -Os -pipe -fno-caller-saves -fno-plt -fhonour-copts -Wno-error=unused-but-set-variable -Wno-error=unused-result -mfloat-abi=hard -fmacro-prefix-map=/home/jmb/Downloads/Turras/build/build/build_dir/target-arm_cortex-a9+vfpv3-d16_musl_eabi/tvheadend-4.2.8=tvheadend-4.2.8 -Wformat -Werror=format-security -DPIC -fpic -fstack-protector-strong -D_FORTIFY_SOURCE=2 -Wl,-z,now -Wl,-z,relro -I/home/jmb/Downloads/Turras/build/build/staging_dir/target-arm_cortex-a9+vfpv3-d16_musl_eabi/usr/lib/libiconv-full/include -I/home/jmb/Downloads/Turras/build/build/staging_dir/target-arm_cortex-a9+vfpv3-d16_musl_eabi/usr/lib/libintl-full/include
Using LD flags: -L/home/jmb/Downloads/Turras/build/build/staging_dir/toolchain-arm_cortex-a9+vfpv3-d16_gcc-8.4.0_musl_eabi/usr/lib -L/home/jmb/Downloads/Turras/build/build/staging_dir/toolchain-arm_cortex-a9+vfpv3-d16_gcc-8.4.0_musl_eabi/lib -DPIC -fpic -specs=/home/jmb/Downloads/Turras/build/build/include/hardened-ld-pie.specs -znow -zrelro -L/home/jmb/Downloads/Turras/build/build/staging_dir/target-arm_cortex-a9+vfpv3-d16_musl_eabi/usr/lib/libiconv-full/lib -Wl,-rpath-link=/home/jmb/Downloads/Turras/build/build/staging_dir/target-arm_cortex-a9+vfpv3-d16_musl_eabi/usr/lib/libiconv-full/lib -L/home/jmb/Downloads/Turras/build/build/staging_dir/target-arm_cortex-a9+vfpv3-d16_musl_eabi/usr/lib/libintl-full/lib -Wl,-rpath-link=/home/jmb/Downloads/Turras/build/build/staging_dir/target-arm_cortex-a9+vfpv3-d16_musl_eabi/usr/lib/libintl-full/lib

Build for arch: arm

Binaries:
Using PYTHON: python
Using GZIP: gzip

Using BZIP2: bzip2

Options:
pie yes
ccdebug no
cwc yes
capmt yes
constcw yes
linuxdvb yes
satip_server yes
satip_client yes
hdhomerun_client yes
hdhomerun_static yes
iptv yes
tsfile yes
dvbscan yes
timeshift yes
trace yes
imagecache yes
avahi no
zlib yes
libav no
ffmpeg_static no
libx264 yes
libx264_static yes
libx265 yes
libx265_static yes
libvpx yes
libvpx_static yes
libtheora yes
libtheora_static yes
libvorbis yes
libvorbis_static yes
libfdkaac yes
libfdkaac_static yes
nvenc no
qsv no
libmfx_static yes
inotify yes
epoll yes
uriparser no
ccache yes
tvhcsa yes
bundle yes
pngquant no
dvbcsa no
dvben50221 no
kqueue no
dbus_1 no
android no
tsdebug no
gtimer_check no
slow_memoryinfo no
libsystemd_daemon no
pcloud_cache yes
W_unused_result yes
strlcat yes
strlcpy yes
fdatasync yes
getloadavg yes
atomic32 yes
atomic64 yes
atomic_time_t yes
bitops64 yes
stime yes
gmtoff yes
recvmmsg yes
sendmmsg yes
libiconv yes
ifnames yes
py_gzip yes
bin_pkg_config yes
bin_xgettext yes
bin_msgmerge yes
bin_gzip yes
bin_bzip2 yes
ssl yes
linuxdvbapi yes
upnp yes
inotify_h yes
inotify_init1 yes
epoll_create1 yes
mpegts yes

mpegts_dvb yes

Packages:
openssl 1.1.1w

zlib 1.2.11

Installation paths:
Prefix: /usr
Binaries: /usr/bin
Libraries: ${prefix}/lib
Data files: /usr/share

Man pages: /usr/man

Jonathan Bradshaw

"playing" the whole mux for 11426.5H gets a black screen (expected) but I can see data arriving on the feed.

2024-01-22 11:21:38.448 [ INFO] mpegts: 11426.5H in DVB-S Network - tuning on SAT>IP DVB-S Tuner #1 (192.168.2.240)

2024-01-22 11:21:38.448 [ INFO] subscription: 02CD: "HTTP" subscribing to mux "11426.5H", weight: 10, adapter: "SAT>IP DVB-S Tuner #1 (192.168.2.240)", network: "DVB-S Network", service: "Raw PID Subscription", hostname="192.168.2.229", client="VLC/3.0.20 LibVLC/3.0.20"

Jonathan Bradshaw

following is a screen grab from the channel tab, I have 1032 channels mapped, the screen grab below is filtered on '11426.5'

Adrian Smith

Jonathan Bradshaw wrote:
> "playing" the whole mux for 11426.5H gets a black screen (expected) but I can see data arriving on the feed.
>

I take it you still don't have the Freeesat bouquets - is that correct? How long did you play the mux for?

Jonathan Bradshaw wrote:
> following is a screen grab from the channel tab, I have 1032 channels mapped, the screen grab below is filtered on '11426.5'

So I can see that you've used one of the BSkyB bouquets to map some of the channels. Unfortunately, the BSkyB bouquet LCNs don't match Freesat (and possibly the services too in some instances). For example, S4C HD is LCN 120 on Freesat, likewise TalkTV HD is LCN 217.

What networks do you have defined? Looks here like you have more than one DVB-S network defined (although I may be mis-interpreting).

What happens if you disable the bouquet and delete all the mapped channels, then manually map S4C HD to LCN 120 and TalkTV HD to 217 and finally Trigger the OTA EPG grabbers in "Configuration", "Channel/EPG", "EPG Grabber"? Does the EPG for these channels then populate?