Bug #5143

Crash on xmltv epg import

Added by Bastian Kleinschmidt 17 days ago. Updated about 21 hours ago.

Status:NewStart date:2018-06-29
Priority:NormalDue date:
Assignee:Adam Sutton% Done:

0%

Category:EPG - Grabbers
Target version:-
Found in version:4.3-1288~g66d6161c5 Affected Versions:

Description

Tvheadend crash in current git when importing an EPG by xmltv import(tv_grap_wg++)

dmesg output :
[91615.530171] tvh:epggrabi29257: segfault at 8f1 ip 000055e2b1d14dd1 sp 00007f27550f2750 error 4 in tvheadend[55e2b1a73000+1b11000]

log:
2018-06-29 06:38:04.630 [ ALERT]:CRASH: Signal: 11 in PRG: /usr/local/bin/tvheadend (4.3-1288~g66d6161c5) [84c58c6932e7892d2618829f3270a4aba0e6a2d0] CWD: /
2018-06-29 06:38:04.630 [ ALERT]:CRASH: Fault address 0x8f1 (Address not mapped)
2018-06-29 06:38:04.630 [ ALERT]:CRASH: Loaded libraries: linux-vdso.so.1 /usr/lib64/libdvbcsa.so.1 /lib64/libssl.so.1.0.0 /lib64/libcrypto.so.1.0.0 /lib64/libz.so.1 /usr/lib64/libpcre2-8.so.0 /usr/lib64/liburiparser.so.1 /usr/lib64/libavahi-common.so.3 /usr/lib64/libavahi-client.so.3 /usr/local/lib64/libva.so.1 /usr/local/lib64/libva-x11.so.1 /usr/local/lib64/libva-drm.so.1 /lib64/libdbus-1.so.3 /lib64/libdl.so.2 /lib64/libpthread.so.0 /lib64/libm.so.6 /lib64/librt.so.1 /usr/lib64/libSDL2-2.0.so.0 /usr/lib64/libvdpau.so.1 /usr/lib64/libX11.so.6 /usr/lib64/libxcb.so.1 /usr/lib64/libxcb-shm.so.0 /usr/lib64/libxcb-xfixes.so.0 /usr/lib64/libxcb-render.so.0 /usr/lib64/libxcb-shape.so.0 /usr/lib64/libstdc++.so.6 /usr/lib64/libnuma.so.1 /usr/lib64/liblzma.so.5 /usr/lib64/libbz2.so.1 /lib64/libc.so.6 /usr/lib64/libXext.so.6 /usr/lib64/libXfixes.so.3 /usr/local/lib64/libdrm.so.2 /lib64/ld-linux-x86-64.so.2 /usr/lib64/libasound.so.2 /usr/lib64/libXau.so.6 /lib64/libgcc_s.so.1 /lib64/libnss_compat.so.2 /lib64/libnsl.so.1 /lib64/libnss_nis.so.2 /lib64
2018-06-29 06:38:04.630 [ ALERT]:CRASH: Register dump [23]: 000000000000ffff00007f61b0115aa435206e65747a7465000000000000000100000000000008f10000000000000000000055d1f1b22f9000007f61b00d761d00007f61b0115aa000007f61705cc540000055d1f20341e000007f61705cc73000007f61705cc52000000000000008f100007f620306b80000007f620306b750000055d1ef24bdd1000000000001020200000000000000330000000000000004000000000000000efffffffe7ffbba1300000000000008f1
2018-06-29 06:38:04.630 [ ALERT]:CRASH: STACKTRACE
2018-06-29 06:38:04.659 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/trap.c:148 0x55d1ef20ecca 0x55d1eefaa000
2018-06-29 06:38:04.693 [ ALERT]:CRASH: ??:0 0x7f620a6d3c10 0x7f620a6c3000
2018-06-29 06:38:04.715 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/epggrab/module/xmltv.c:681 0x55d1ef24bdd1 0x55d1eefaa000
2018-06-29 06:38:04.737 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/epggrab/module.c:388 0x55d1ef246d49 0x55d1eefaa000
2018-06-29 06:38:04.759 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/epggrab.c:84 0x55d1ef1ec848 0x55d1eefaa000
2018-06-29 06:38:04.781 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/wrappers.c:181 0x55d1ef1d4442 0x55d1eefaa000
2018-06-29 06:38:04.816 [ ALERT]:CRASH: ??:0 0x7f620a6cb724 0x7f620a6c3000
2018-06-29 06:38:04.816 [ ALERT]:CRASH: clone+0x6d (/lib64/libc.so.6)

last known working version :
4.3-1249~g3515154b7

log - log (8.48 KB) Bastian Kleinschmidt, 2018-06-29 06:48

gdb.txt Magnifier - gdb (159 KB) Bastian Kleinschmidt, 2018-06-29 06:48

log (120 KB) Bastian Kleinschmidt, 2018-06-29 07:03

gdb.txt Magnifier (159 KB) Bastian Kleinschmidt, 2018-06-29 07:03

History

#1 Updated by Bastian Kleinschmidt 17 days ago

Tvheadend crash in current git when importing an EPG by xmltv import(tv_grap_wg++)

dmesg output :
[91615.530171] tvh:epggrabi29257: segfault at 8f1 ip 000055e2b1d14dd1 sp 00007f27550f2750 error 4 in tvheadend[55e2b1a73000+1b11000]

log:
2018-06-29 06:38:04.630 [ ALERT]:CRASH: Signal: 11 in PRG: /usr/local/bin/tvheadend (4.3-1288~g66d6161c5) [84c58c6932e7892d2618829f3270a4aba0e6a2d0] CWD: /
2018-06-29 06:38:04.630 [ ALERT]:CRASH: Fault address 0x8f1 (Address not mapped)
2018-06-29 06:38:04.630 [ ALERT]:CRASH: Loaded libraries: linux-vdso.so.1 /usr/lib64/libdvbcsa.so.1 /lib64/libssl.so.1.0.0 /lib64/libcrypto.so.1.0.0 /lib64/libz.so.1 /usr/lib64/libpcre2-8.so.0 /usr/lib64/liburiparser.so.1 /usr/lib64/libavahi-common.so.3 /usr/lib64/libavahi-client.so.3 /usr/local/lib64/libva.so.1 /usr/local/lib64/libva-x11.so.1 /usr/local/lib64/libva-drm.so.1 /lib64/libdbus-1.so.3 /lib64/libdl.so.2 /lib64/libpthread.so.0 /lib64/libm.so.6 /lib64/librt.so.1 /usr/lib64/libSDL2-2.0.so.0 /usr/lib64/libvdpau.so.1 /usr/lib64/libX11.so.6 /usr/lib64/libxcb.so.1 /usr/lib64/libxcb-shm.so.0 /usr/lib64/libxcb-xfixes.so.0 /usr/lib64/libxcb-render.so.0 /usr/lib64/libxcb-shape.so.0 /usr/lib64/libstdc++.so.6 /usr/lib64/libnuma.so.1 /usr/lib64/liblzma.so.5 /usr/lib64/libbz2.so.1 /lib64/libc.so.6 /usr/lib64/libXext.so.6 /usr/lib64/libXfixes.so.3 /usr/local/lib64/libdrm.so.2 /lib64/ld-linux-x86-64.so.2 /usr/lib64/libasound.so.2 /usr/lib64/libXau.so.6 /lib64/libgcc_s.so.1 /lib64/libnss_compat.so.2 /lib64/libnsl.so.1 /lib64/libnss_nis.so.2 /lib64
2018-06-29 06:38:04.630 [ ALERT]:CRASH: Register dump [23]: 000000000000ffff00007f61b0115aa435206e65747a7465000000000000000100000000000008f10000000000000000000055d1f1b22f9000007f61b00d761d00007f61b0115aa000007f61705cc540000055d1f20341e000007f61705cc73000007f61705cc52000000000000008f100007f620306b80000007f620306b750000055d1ef24bdd1000000000001020200000000000000330000000000000004000000000000000efffffffe7ffbba1300000000000008f1
2018-06-29 06:38:04.630 [ ALERT]:CRASH: STACKTRACE
2018-06-29 06:38:04.659 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/trap.c:148 0x55d1ef20ecca 0x55d1eefaa000
2018-06-29 06:38:04.693 [ ALERT]:CRASH: ??:0 0x7f620a6d3c10 0x7f620a6c3000
2018-06-29 06:38:04.715 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/epggrab/module/xmltv.c:681 0x55d1ef24bdd1 0x55d1eefaa000
2018-06-29 06:38:04.737 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/epggrab/module.c:388 0x55d1ef246d49 0x55d1eefaa000
2018-06-29 06:38:04.759 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/epggrab.c:84 0x55d1ef1ec848 0x55d1eefaa000
2018-06-29 06:38:04.781 [ ALERT]:CRASH: /apps/tvheadend/tvheadend-master/src/wrappers.c:181 0x55d1ef1d4442 0x55d1eefaa000
2018-06-29 06:38:04.816 [ ALERT]:CRASH: ??:0 0x7f620a6cb724 0x7f620a6c3000
2018-06-29 06:38:04.816 [ ALERT]:CRASH: clone+0x6d (/lib64/libc.so.6)

last known working version :
4.3-1249~g3515154b7

#2 Updated by Nicolas C 17 days ago

I'm getting exactly the same issue:

Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: Signal: 11 in PRG: /opt/tvh-66d6161c/bin/tvheadend (4.3-1288~g66d6161-dirty) [ba3afd4975960042060c583dfd9b9ca769aa3264] CWD: /
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: Fault address 0x941 (Address not mapped)
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: Loaded libraries: linux-vdso.so.1 /lib64/libdvbcsa.so.1 /lib64/libssl.so.10 /lib64/libcrypto.so.10 /lib64/libz.so.1 /lib64/libpcre.so.1 /lib64/libdl.so.2 /lib64/libpthread.so.0 /lib64/libm.so.6 /lib64/librt.so.1 /lib64/libSDL2-2.0.so.0 /lib64/libxcb.so.1 /lib64/libxcb-shm.so.0 /lib64/libxcb-xfixes.so.0 /lib64/libxcb-shape.so.0 /lib64/libasound.so.2 /lib64/libstdc++.so.6 /lib64/libmvec.so.1 /lib64/liblzma.so.5 /lib64/libbz2.so.1 /lib64/libc.so.6 /lib64/libgssapi_krb5.so.2 /lib64/libkrb5.so.3 /lib64/libcom_err.so.2 /lib64/libk5crypto.so.3 /lib64/ld-linux-x86-64.so.2 /lib64/libXau.so.6 /lib64/libgcc_s.so.1 /lib64/libkrb5support.so.0 /lib64/libkeyutils.so.1 /lib64/libresolv.so.2 /lib64/libselinux.so.1 /lib64/libnss_files.so.2 /lib64/libnss_sss.so.2
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: Register dump [23]: 00007fb91c5fd05000007fb91d3f04b400000000fffffff000007fb949dd2f84000000000000000000007fb91d3fc910000000000000094100007fb91d2ed49000007fb91d3f04b000007fb91d3fd4a0000055f8504196f000007fb91d3fd6e00000000000000001000000000000094100007fb93da9a75000007fb93da9a6a0000055f84d9e27c30000000000010206002b0000000000330000000000000004000000000000000efffffffe7ffbba130000000000000941
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: STACKTRACE
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: /root/tvheadend240618/src/trap.c:148 0x55f84d9a505a 0x55f84d79a000
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: ??:0 0x7fb94bd625d0 0x7fb94bd51000
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: /root/tvheadend240618/src/epggrab/module/xmltv.c:680 0x55f84d9e27c3 0x55f84d79a000
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: /root/tvheadend240618/src/epggrab/module.c:388 0x55f84d9dd75d 0x55f84d79a000
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: /root/tvheadend240618/src/epggrab/module.c:570 0x55f84d9ddb4c 0x55f84d79a000
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: /root/tvheadend240618/src/wrappers.c:181 0x55f84d96a431 0x55f84d79a000
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: ??:0 0x7fb94bd5873a 0x7fb94bd51000
Jun 29 18:54:21 hostname.foo tvheadend8734: CRASH: clone+0x3f (/lib64/libc.so.6)

Importing a wg++ xml using netcat

#3 Updated by Nicolas C 16 days ago

It also crashes uses internal grabbers so I'm not sure is wg++ related. Maybe is due to a non utf-8 character trying to be parsed or something (as I'm importing the italian EPG)

#4 Updated by jody gugelhop 13 days ago

Same issue here with me, any epg makes it crash, my specs:

HTS Tvheadend 4.3-1288~g66d6161
Ubuntu 16.04.4 LTS, Linux 4.4.0-128-generic

2018-07-03 11:16:30.922 [ TRACE]:epg: eo [0x7f4caba5bba0, 67233742, 1] putref 1
2018-07-03 11:16:30.922 [ ALERT]:CRASH: Signal: 11 in PRG: /usr/bin/tvheadend (4.3-1288~g66d6161) [eaa2ed22600de3eed86f302f612cd51e011e6414] CWD: /
2018-07-03 11:16:30.922 [ ALERT]:CRASH: Fault address 0x1101 (Address not mapped)
2018-07-03 11:16:30.922 [ ALERT]:CRASH: Loaded libraries: /usr/lib/x86_64-linux-gnu/libdvbcsa.so.1 /lib/x86_64-linux-gnu/libssl.so.1.0.0 /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 /lib/x86_64-linux-gnu/libz.so.1 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0 /usr/lib/x86_64-linux-gnu/liburiparser.so.1 /usr/lib/x86_64-linux-gnu/libavahi-common.so.3 /usr/lib/x86_64-linux-gnu/libavahi-client.so.3 /lib/x86_64-linux-gnu/libdbus-1.so.3 /lib/x86_64-linux-gnu/libdl.so.2 /lib/x86_64-linux-gnu/libpthread.so.0 /lib/x86_64-linux-gnu/libm.so.6 /lib/x86_64-linux-gnu/librt.so.1 /usr/lib/x86_64-linux-gnu/libstdc++.so.6 /lib/x86_64-linux-gnu/libc.so.6 /lib/x86_64-linux-gnu/libsystemd.so.0 /lib64/ld-linux-x86-64.so.2 /lib/x86_64-linux-gnu/libgcc_s.so.1 /lib/x86_64-linux-gnu/libselinux.so.1 /lib/x86_64-linux-gnu/liblzma.so.5 /lib/x86_64-linux-gnu/libgcrypt.so.20 /lib/x86_64-linux-gnu/libpcre.so.3 /lib/x86_64-linux-gnu/libgpg-error.so.0 /lib/x86_64-linux-gnu/libnss_compat.so.2 /lib/x86_64-linux-gnu/libnsl.so.1 /lib/x86_64-linux-gnu/libnss_nis.so.2 /lib/x86_64-linux-g
2018-07-03 11:16:30.922 [ ALERT]:CRASH: Register dump [23]: 0000000000000000000000000000000000007f4cfc411ee0000000000000000100007f4cc49963ed00000000000011010000561f2ed25f4000007f4cab8f9fe000007f4cb3156ec000007f4cc587903000007f4caba5bba000007f4caba5bf2000007f4cc5879010000000000000110100007f4cc31fa68800007f4cc31fa5f00000561f2b3b6d10000000000001020200000000000000330000000000000004000000000000000efffffffe7ffbba130000000000001101
2018-07-03 11:16:30.922 [ ALERT]:CRASH: STACKTRACE
2018-07-03 11:16:31.116 [ ALERT]:CRASH: /project/repo/checkout/src/trap.c:148 0x561f2b3780ed 0x561f2b16a000
2018-07-03 11:16:31.318 [ ALERT]:CRASH: ??:0 0x7f4cfcf31390 0x7f4cfcf20000
2018-07-03 11:16:31.514 [ ALERT]:CRASH: /project/repo/checkout/src/epggrab/module/xmltv.c:681 0x561f2b3b6d10 0x561f2b16a000
2018-07-03 11:16:31.705 [ ALERT]:CRASH: /project/repo/checkout/src/epggrab/module.c:388 0x561f2b3b1b9b 0x561f2b16a000
2018-07-03 11:16:31.902 [ ALERT]:CRASH: /project/repo/checkout/src/epggrab.c:84 0x561f2b354110 0x561f2b16a000
2018-07-03 11:16:32.104 [ ALERT]:CRASH: /project/repo/checkout/src/wrappers.c:181 0x561f2b33acb5 0x561f2b16a000
2018-07-03 11:16:32.305 [ ALERT]:CRASH: ??:0 0x7f4cfcf276ba 0x7f4cfcf20000
2018-07-03 11:16:32.305 [ ALERT]:CRASH: clone+0x6d (/lib/x86_64-linux-gnu/libc.so.6)

#5 Updated by jody gugelhop 13 days ago

I'm also having foreign characters

#6 Updated by jody gugelhop 13 days ago

I just updated my kernel to 4.4.0-130-generic rest still same, atm no crashes

#7 Updated by jody gugelhop 13 days ago

okay nevermind, crashed again, same thing

#8 Updated by jody gugelhop 13 days ago

I think there is def. s.th. to it in my case with UTF8 and symbols e.g. running tv_grab_tr --confgiure also returns:
"Wide character in print at /usr/share/perl5/vendor_perl/XMLTV/Configure.pm line 334, <STDIN> line 2"

#9 Updated by jody gugelhop 13 days ago

[20196.320170] perl10138: segfault at 7fff96b63ff8 ip 00007fec8f0c2a82 sp 00007fff96b63fe0 error 6 in Storable.so[7fec8f0b3000+19000]
[20200.534436] perl10145: segfault at 7ffc66f82ff8 ip 00007f42168d7a8c sp 00007ffc66f83000 error 6 in Storable.so[7f42168c8000+19000]
[20200.807210] perl10153: segfault at 7ffe1ddc5ff8 ip 00007f216f682da3 sp 00007ffe1ddc5fd0 error 6 in Storable.so[7f216f671000+19000]
[20201.175750] perl10164: segfault at 7fff9d8c0ff8 ip 00007f376dc0ad97 sp 00007fff9d8c1000 error 6 in Storable.so[7f376dbff000+19000]
[20203.959066] perl10171: segfault at 7ffda8fbbff8 ip 00000000004982cd sp 00007ffda8fbc000 error 6 in perl[400000+1cf000]
[20204.287012] perl10183: segfault at 7ffe3974aff8 ip 00007fe39c8f7b8f sp 00007ffe3974b000 error 6 in libc-2.23.so[7fe39c876000+1c0000]
[20204.665147] perl10192: segfault at 7ffef9ddafb8 ip 00007f2a433d6bbc sp 00007ffef9ddafb0 error 6 in libc-2.23.so[7f2a43355000+1c0000]
[20204.883090] perl10195: segfault at 7fffe8d60ff8 ip 00007f49da337bbc sp 00007fffe8d60ff0 error 6 in libc-2.23.so[7f49da2b6000+1c0000]
[20205.329751] perl10206: segfault at 7ffc33323ff8 ip 00007f5f7404d146 sp 00007ffc33324000 error 6 in libc-2.23.so[7f5f73fca000+1c0000]
[20205.659535] perl10213: segfault at 7ffcab4fdff0 ip 00007f4773ea22a7 sp 00007ffcab4fdff0 error 6 in libc-2.23.so[7f4773e1f000+1c0000]
[20205.864403] perl10216: segfault at 7fffa05d1f78 ip 00007f728eda7bbc sp 00007fffa05d1f70 error 6 in libc-2.23.so[7f728ed26000+1c0000]
[20206.133861] perl10221: segfault at 7ffda6748ff8 ip 00007ff3624c2b9a sp 00007ffda6749000 error 6 in libc-2.23.so[7ff362441000+1c0000]
[20206.403232] perl10226: segfault at 7fff1d7bfff8 ip 00007fcf20b83b8f sp 00007fff1d7c0000 error 6 in libc-2.23.so[7fcf20b02000+1c0000]
[20206.613523] perl10229: segfault at 7ffc41ce6ff8 ip 00007fb14e0ee2ab sp 00007ffc41ce7000 error 6 in libc-2.23.so[7fb14e06b000+1c0000]
[20206.821331] perl10232: segfault at 7ffc7ef45fc8 ip 00007f280a831bbc sp 00007ffc7ef45fc0 error 6 in libc-2.23.so[7f280a7b0000+1c0000]
[20207.028286] perl10235: segfault at 7ffc582a3ff8 ip 00007fb967f52bbc sp 00007ffc582a3ff0 error 6 in libc-2.23.so[7fb967ed1000+1c0000]
[20207.234247] perl10238: segfault at 7fff723c6ff8 ip 00007ff80908d981 sp 00007fff723c7000 error 6 in ld-2.23.so[7ff80907c000+26000]

#10 Updated by Ludi K. 2 days ago

I wonder whether bug #5154 is not a duplicate of this bug.

I am creating an xmltv file with the tool tv_grab_zz_sdjson_sqlite. After its creation, I do an import by using the tv_grab_file mechanism of tvheadend: it results in a crash of tvheadend.

I am using version 4.4.20180702 (66d6161c56) of tvheadend on a Synology.

#11 Updated by jody gugelhop about 21 hours ago

Ludi K. wrote:

I wonder whether bug #5154 is not a duplicate of this bug.

I am creating an xmltv file with the tool tv_grab_zz_sdjson_sqlite. After its creation, I do an import by using the tv_grab_file mechanism of tvheadend: it results in a crash of tvheadend.

I am using version 4.4.20180702 (66d6161c56) of tvheadend on a Synology.

not sure.
btw in the mean time i setup a second machine that runs 4.3-1252~g595fd174f-dirty and Linux 4.17.5-1-ARCH
I run the same grabbers there as above on my other machine and no trouble at all, works just fine, so could be some stuff in ubuntu (not sure what OS the others running into issues with) that is messing with it.

Also available in: Atom PDF