[SOLUTION] 7-day OTA EPG via MHEG-5 for DVB-T outside of Auckland NZ

I M

As I understand it, for people outside of Auckland, the stock (DVB-T) EIT-derived EPG doesn't provide anything more than now+next information?

https://tvheadend.org/issues/4198 and https://tvheadend.org/d/8048-epg-issue are a couple of threads that refer to this issue.

With thanks to + permission from the authors of a MythTV solution, I've developed an internal XMLTV grabber module that will collect and parse OTA mheg-5 data in order to produce a 7-day EPG. So far I've only tested it myself with a simple Pi setup, but it seems to work reasonably well and requires just one file to be dropped in place along with a restart of TVH and following minor setup for it to begin working.

Eventually I'll probably publish it somewhere but if it could be of interest and you'd like to trial it I'm happy to pass on the code directly. Just let me know via here.

Pete Hodd

Yes please, I'd be pleased to try it. Please could you also provide instructions on how to install it, targeted to a person with mediocre tech skills please. Thanks, Peter

I M

Gee that was quick!

Installationshould be very straightforward .. happy to discuss and walk you through it, but how to communicate initially?

Not keen on leaving email details in public but I may have sorted something - does 0632 mean anything to you? :)

DeltaMikeCharlie

Ivan, thanks for posting your solution.

Perhaps you could assist me with a project that I’m working on regarding EPG data.

I’m in Sydney, so I get my EPG the straight from EIT. However, I have been doing some work on getting rating labels (‘PG’, etc) to display with TVH.

https://tvheadend.org/d/8368-adding-rating-labels-pg-pg-13-fsk-12-etc-to-tvh

The next step that I am working on is for TVH to be able to automatically detect as many parental rating systems globally and seamlessly fill in the rating label for the user thus avoiding a manual setup step.

If you are willing, could you please post a zipped copy of your log file for the EIT now+next as well as the kind of parental rating data that you get from your HMEG-5 feed?

https://tvheadend.org/d/8381-request-for-help-obtaining-sample-epg-data-from-various-countries

Also, if you have access to the full Auckland EIT EPG then a log of that would also be greatly appreciated.

If you are also willing to share the source code for your module, I could also look at how it could be incorporated with rating labels.

@PeteHodd - I'd be interested in a log file from you too if you are willing.

Pete Hodd

Yes 0632 is my postcode

DeltaMikeCharlie

I M wrote:
> Installationshould be very straightforward .. happy to discuss and walk you through it, but how to communicate initially?
>
You could just communicate via the forum. I'd be happy to eavesdrop on the process if you don't mind.

Pete Hodd

Ok, so how from here?

I M

DMC, happy to help where I can but I'm no guru with this.

Also, I don't have any EIT data at the moment as I'm all mheg-5, and I'm not in Auckland! That said I am parsing the mheg data to extract episode detail from the description text which is then included in the resultant XML import into TVH. This appears to be working well and no doubt something similar could be done to extract the rating detail.

I can zip up a download of the raw stream data, or the XML output as you wish, but I suspect the following sites would be just as helpful:

https://freeviewnz.tv/parental-control/

https://safeviewing.co.nz/classification/

And here's an example of the XML I'm outputting and how the detail is presently in the description field (as broadcast by the provider):


	<programme channel="eden.mheg5" start="20231128123500 +1300" stop="20231128133000 +1300">
		<title>Paramedics: On The Front Line</title>
		<desc>PG-LC The West Midlands Ambulance Service deal with a 19-year-old man who has had a motorbike crash, and an elderly woman showing signs of a stroke but refusing treatment. S3 E2</desc>
		<episode-num system="dd_progid">T90392895</episode-num>
		<episode-num system="onscreen">S3 E2</episode-num>
		<video>
			<present>yes</present>
			<quality>HDTV</quality>
		</video>
		<rating system="Freeview">
			<value>G</value>
		</rating>
	</programme>
	<programme channel="eden.mheg5" start="20231128133000 +1300" stop="20231128142500 +1300">

Having had a quick look at other programmes it would appear that if something like "16-VLC" is displayed in the description text, it's not in the 'rating system' data. I'd need to more closely inspect the raw data before determining it that's an issue with the parsing and XML output, or if it's just not there to start with. Of course the EIT data may be quite different for all I know.

WRT to my source, at this time I've not included rating labels (at least not in a way that TVH understands) as it's not really of concern to me, but you're welcome to a copy if you think it might be useful.

I M

Pete Hodd wrote:

> Ok, so how from here?

I just tried telephoning the number I'd found for you but it's 'no longer in service' .. if you wanted to use that number with some addition/subtraction to give me another number that would probably work? Just let me know if you're including the area code too ;)

I M

Delta Mike Charlie wrote:
> I M wrote:
> > Installationshould be very straightforward .. happy to discuss and walk you through it, but how to communicate initially?
> >

> You could just communicate via the forum. I'd be happy to eavesdrop on the process if you don't mind.

That's no problem, but I need to get the code to Pete for a start.

It will be interesting to see how he goes as I've not had anyone else test it. In theory it's just a matter of dropping it into /bin/, restarting TVH and selecting the new internal XMLTV grabber that should appear. I guess we'll see if I'm being overly optimistic!

DeltaMikeCharlie

I M wrote:
> DMC, happy to help where I can but I'm no guru with this.
>
Thanks very much, any information that you can provide will be helpful.
> Also, I don't have any EIT data at the moment as I'm all mheg-5, and I'm not in Auckland! That said I am parsing the mheg data to extract episode detail from the description text which is then included in the resultant XML import into TVH. This appears to be working well and no doubt something similar could be done to extract the rating detail.
>
> I can zip up a download of the raw stream data, or the XML output as you wish, but I suspect the following sites would be just as helpful:
>

Actually, both would be great.

> <rating system="Freeview">
> <value>G</value>
> </rating>
Would you be willing to change your system name from "Freeview" to "Freeview-NZ" or even "FVLB"? There are multiple regions that use the "Freeview" name.
>

> Having had a quick look at other programmes it would appear that if something like "16-VLC" is displayed in the description text, it's not in the 'rating system' data. I'd need to more closely inspect the raw data before determining it that's an issue with the parsing and XML output, or if it's just not there to start with. Of course the EIT data may be quite different for all I know.

The "16-VLC" just means 'restricted to persons 16 years and over' with 'violence may offend', 'language may offend' and 'content may offend'.

The EIT data has a country code, in your case NZL, and then a number representing the age. The receiver then uses the age to display a label. This is why I was keen to see what the now/next looks like.
>
> WRT to my source, at this time I've not included rating labels (at least not in a way that TVH understands) as it's not really of concern to me, but you're welcome to a copy if you think it might be useful.

Thanks. I do not plan to make any changes, however, I can provide feedback should you wish to incorporate rating labels.

DeltaMikeCharlie

I M wrote:
> That's no problem, but I need to get the code to Pete for a start.
Naturally. Get Pete working first and get back to me when you have the time. No rush.
> It will be interesting to see how he goes as I've not had anyone else test it. In theory it's just a matter of dropping it into /bin/, restarting TVH and selecting the new internal XMLTV grabber that should appear. I guess we'll see if I'm being overly optimistic!
What language did you write your module in?

Pete Hodd

Hmmmm, not sure what phone number is out in the ether for me. It may be related to a previous employer, or a home landline before I went all mobile. Could you provide the first 3 digits of the number, excluding the area or mobile prefix?

Pete Hodd

is the native wood pigeon in the address you've found?

I M

Pete Hodd wrote:

> is the native wood pigeon in the address you've found?

Yes, and 413 to your other question.

Pete Hodd

prefix old telecom for its cdma network
taking fax number
digit 1 add 4
digit 2 subtract 3
digit 3 add 1
digit 4 subtract 2
digit 5 subtract 3
digit 6 add 3

digit 7 subtract 3

you'll find me on whatsapp if you wish to message

I M

Delta Mike Charlie wrote:

> > I can zip up a download of the raw stream data, or the XML output as you wish, but I suspect the following sites would be just as helpful:
> >

> Actually, both would be great.

Ok, both attached now.

> Would you be willing to change your system name from "Freeview" to "Freeview-NZ" or even "FVLB"? There are multiple regions that use the "Freeview" name.

Sure, I really don't mind, it's very easy to change.

> The "16-VLC" just means 'restricted to persons 16 years and over' with 'violence may offend', 'language may offend' and 'content may offend'.

Quite, I was just trying to explain the present behaviour of the code...

> The EIT data has a country code, in your case NZL, and then a number representing the age. The receiver then uses the age to display a label. This is why I was keen to see what the now/next looks like.

It may be that Pete is able to output this for you, if that's what he's using presently. I'm loath to mess with my setup too much while I'm still experimenting with this code. Maybe later if no-one else is able to help.

I M

Delta Mike Charlie wrote:

> What language did you write your module in?

It's in Python.

I M

Pete Hodd wrote:
> prefix old telecom for its cdma network
> taking fax number
> digit 1 add 4
> digit 2 subtract 3
> digit 3 add 1
> digit 4 subtract 2
> digit 5 subtract 3
> digit 6 add 3
> digit 7 subtract 3
>

> you'll find me on whatsapp if you wish to message

Sorry, don't do any social at all. I've tried the resultant but the 'ph system doesn't like it.

FYI I have two possible numbers for the base, first ends in 4, second in 3, have tried [converting] both. I get a negative number for digit 2 and 5 but have just assumed use of the resultant numeral?Not using the area code to start.

Pete Hodd

Seems you've found a different listing.

Based on phone number
+1
-1
+4
-4
+3

-5

Are you ok with my cryptic reference to the 'area' code?