Bug #333

Problem with teletext subtitles special characters

Added by Hotlobster - almost 7 years ago. Updated 6 months ago.

Status:RejectedStart date:
Priority:NormalDue date:
Assignee:John Törnblom% Done:

50%

Category:PVR / DVR
Target version:-
Found in version:3.2 Affected Versions:3.2, 3.3

Description

Hi

I encounter problem with teletext subtitle display.
Tested using xbmc-pvr or vlc, same behavior.

Special characters like é,è,â are all displayed as # either in live streaming or recording.

The generated mkv file has bad characters too, testing with vlc shows them as #.

Second problem ( perhaps related ) , some lines are not displayed.
When this happens, the previous ttxt line stays on screen until the next line, instead of disapearing.

I've posted 2 samples, the recorded mkv file, and a full raw ts dump of the transponder here:

[http://downloads.hotlobster.fr/files/]

The tested pids for the raw dump are:
video: 160
audio: 48
ttxt: 32 ( page : 888 or 889 )

Thanks.

History

#1 Updated by Hotlobster - almost 7 years ago

Hi

Did you guys had time to grab the 2 samples ? I need to delete them from my server.

Any feedback on that problem ? This is the last step that prevent me replacing vdr by tvheadend.

Best regards.

#2 Updated by Andreas Öman almost 7 years ago

  • Category changed from General to Demultiplex

#3 Updated by John Törnblom over 5 years ago

  • % Done changed from 0 to 50
  • Found in version set to 2.12

The problem with missing lines in the subtitles has been fixed but I don't know about the charset issue. Is there any chance that the raw ts dump is still around somewhere?

#4 Updated by Adam Sutton over 5 years ago

  • Status changed from New to Need feedback
  • Assignee changed from Andreas Öman to John Törnblom
  • Target version deleted (3.0)

#5 Updated by Adam Sutton about 5 years ago

John,

Do we actually know if this is still happening? Does it happen with your own recordings, which presumably have non-ascii in the stream.

Could it be that we're simply not setting the language descriptor in the MKV for subtitle streams? I know we weren't setting the lang for metadata fields, so although it goes through a different path maybe its a similar issue.

Adam

#6 Updated by Adam Sutton about 5 years ago

Ok, I've just checked and we do store the language (at least that's what it looks like in the code, I've not checked a recording yet). So maybe not that (I also double checked 2.12).

But anyhow worth checking if this is actually still and issue as its an old report. Could even be lack of player support for MKV (i.e. not handling the language field, though I might be clutching at straws there).

Adam

#7 Updated by Adam Sutton about 5 years ago

OK, its not the recordings (at least with latest version). It appears to properly include the language fields in the MKV files.

Adam

#8 Updated by Adam Sutton about 5 years ago

John,

If there is no update on this in the next few days, i.e. some TS dumps to check etc.., I suggest closing it.

Adam

#9 Updated by Hotlobster - about 5 years ago

Hi,

I took the time to make some dumps, and document them 2 years ago for this issue, but the file was never downloaded, neither an answer here.

As there were nobody answering on the other side I gave up TvHeadend for VDR/Xbmc combo. It was working well then.
Dump files were deleted few month ago when migrating the server.

I don't use DVB streams anymore, can't help you now, too late sir.

Regards.

#10 Updated by Adam Sutton about 5 years ago

  • Status changed from Need feedback to Invalid

In that case, given that TVH now has new developers and what went before is mostly irrelevant. We shall close.

Adam

#11 Updated by Mario D about 5 years ago

I would reopen this bug: here in Italy I got this bug since early versions of tvheadend. This affects Sky-it channels (encrypted) but also free channels (RAI).
I provides a link to two dumps made using tvheadend (3.2) recordings: one with in mkv format and one with pass-throught options (ts). They are from the same channel (RAI 1 - free) but in different moment (sorry).
I can see wrong chars in xbmc interface (also during live view) and in vlc on the recordings.

http://www.sendspace.com/filegroup/F5K6uuc4nUit%2FfJ8aS%2FDOg

Let me know if you need other infos or if I have to open a new bug report.

Thanks

#12 Updated by Adam Sutton about 5 years ago

  • Category changed from Demultiplex to PVR / DVR
  • Status changed from Invalid to Need feedback
  • Priority changed from High to Normal
  • Found in version changed from 2.12 to 3.2
  • Affected Versions 3.2, 3.3 added

Ok, I will re-open and hopefully John can take a look when he has a chance.

Just to clarify though, is the TS version correct? and the MKV version incorrect?

And are things shown correctly when playing streams live?

Adam

#13 Updated by Mario D about 5 years ago

I'm not able to see the subtitles with VLC on the TS file. I provided it as "original stream" before the muxing of tvheadend. Maybe I'm wrong and I should capture the TS from /dev/adapters.
In the MKV file you can extract the wrong subtitles (I used mkvextract). Some examples of wrong chars in the subtitles:
- 'Bravi ragazzi perchc tua mamma' should be 'Bravi ragazzi perché tua mamma'
- 'mamma ú giovanissima' should be 'mamma è giovanissima'
- 'Questo cos'ú?' should be 'Questo cos'ì?'

I can provide other samples if you tell me how.

#14 Updated by John Törnblom about 5 years ago

It would help a lot if you could provide a complete ts dump, the teletext pid is not listen in the pmt generated by tvheadend when using pass-through recording/streaming.

#15 Updated by Mario D about 5 years ago

Could you kindly explain how to make the dump? dvbstream? dvbsnoop? With which options?

In alternative, if you live in Europe and your disc is on Hotbird you can find free transmissions with italian dvbtxt subtitles on channels RAI 1, RAI 2 or RAI 3 (mux at 10992.16 MHz).

Thanks

#16 Updated by Mario D almost 5 years ago

I would send the requested complete ts dump, but I was not able to find the way to produce it. Could you send more info? I would like such bug fixed for next releases.

#17 Updated by John Törnblom almost 5 years ago

In current master, full mux dumps can be obtained via http.

first, go to Configuration --> TV adapters --> General and set "Full mux reception" to on. Don't forget to save.

Urls can be found in Configuration --> TV adapters --> Multiplexes

#18 Updated by Mario D almost 5 years ago

I've switched my installation to the last git version of tvheadend and now I can provide the full dump of the mux in order to debug the problem with some chars in dvb-txt subs.
I hope the dump is correctly made: the sample comes from channel "RAI 1" on the mux at frequency 10,992,160V on satellite Hotbird 13°.
The dump should be available at the url: https://mega.co.nz/#!RppAxIBb!RcopqASrsntKeV3av1oCDkO1XccCxPOrM43XLJE973I
The text of the subs extracted from the mkv of the channel is available at the url: https://mega.co.nz/#!c0xgjYjS!U17Nv058HuZe7szjRw56LW3z-IZ4io16H5nJ4GIYY7A

Some errors are reported below:
00:00:09,154 --> 00:00:09,154
ú stato fatto
^^^^^^^^^^^
should be "è stato fatto"

00:00:23,722 --> 00:00:23,722
perchc ú uno di quelli che brilla
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
should be "perché è uno di quelli che brilla"

In the dump there are also chars with accent that are correctly reported; for example:
00:00:20,794 --> 00:00:20,794
ingrediente della sua personalitá

I hope it is enough.

#19 Updated by Jaroslav Kysela 6 months ago

  • Status changed from Need feedback to Rejected

Closing 3.x bugs.

Also available in: Atom PDF