Sky Auto Channel Numbering

Anonymous · 2014-03-04T14:19:03+00:00

So I may have bitten off far more than I can chew here but... I have been experimenting with the idea of region-aware automatic channel numbering for Sky UK...

Simon D

In the web interface, Configuration>Channel/EPG>EPG Grabber ensure "Update Channel Number" is unchecked.

Maz Gup

Thanks for the response.

I failed to mention that all three boxes, update channel number, name, and icon, are unchecked.

I'm not sure if it makes a difference but so is "Skip initial scan" under the networks.

Thanks for the help

Simon D

That's odd, check the file permissions are correct maybe its unable to save the changes.

Maz Gup

Thanks,

As I mentioned much earlier, I am very new to linux. Do you mind giving me a quick walkthrough?

All of my settings and folders are default to the TVheadend 3.9* installation.

It's quite strange because it works perfectly for days, it is only when the PC restarts that it reverts back to the old channels, even if I have deleted them.

The tags remain in the "Channel Tags" tab, but obviously none of the reappearing channels are tagged or numbered properly.

Could it be due to TVheadend not shutting down cleanly before the PC is restarted?

d p

I cant get this script to work, get this when I run it:

malformed JSON string, neither array, object, number, string or atom, at character offset 0 (before "(end of string)") at /usr/share/perl5/JSON.pm line 171.

I am running 3.9.470~g6482d33

I have tried to setup from scratch, here is what I did:

1. Added network
2. Waited for services to be found.
3. 'Map all' to create all channels
4. downloaded autobouqet.pl
5. Edited script (entered IP, usernam & region)
5. Installed perl
6. Installed dvbsnoop

7. Run script

d p

d p wrote:
> Hi
>
> I cant get this script to work, get this when I run it:
>
>

malformed JSON string, neither array, object, number, string or atom, at character offset 0 (before "(end of string)") at /usr/share/perl5/JSON.pm line 171.

>
> I am running 3.9.470~g6482d33
>
> I have tried to setup from scratch, here is what I did:
>
> 1. Added network
> 2. Waited for services to be found.
> 3. 'Map all' to create all channels
> 4. downloaded autobouqet.pl
> 5. Edited script (entered IP, usernam & region)
> 5. Installed perl
> 6. Installed dvbsnoop

> 7. Run script

Ok I got it working. I had the ip address as the ip of the pc, but I changed to localhost and it worked.

Its fantastic, have been waiting for someone to do something like this for ages.

All the channels have been assigned logos, but the logos are not showing up in xbmc. I have tried reset epg database.

Anonymous

Hey guys,

Sorry for lack of activity recently, been up to my neck with another little project :)

I've updated the script so that you can disable importing icons. Just change my $icons_enabled = 1 to 0 in the script.

It also doesn't mess about with the EPG source (not sure why I had it doing this in the first place TBH).

For those people still struggling with a blank output that goes on forever I would recommend running:

sudo dvbsnoop -nph -n 500 0x11

You should see a loads of text whizz past after a few seconds. If this isn't the case then try tuning to a channel in TVH and try again. If there is still no output the problem lies somewhere else and my script can't work without any data!

http://newhaven.uk.to/autobouquets.pl

Anonymous

Simon,

I'll look into the muxes stuff :)

Simon D

Jonathan Kempson wrote:
> Simon,
>

> I'll look into the muxes stuff :)

Nice one :) muxes are grabbed using: dvbsnoop -nph -n 500 0x10

Example snippet:

Transport_stream_ID: 2033 (0x07f1)
Original_network_ID: 2 (0x0002) [= Astra Satellite Network 28,2°E | Société Européenne des Satellites]
reserved_1: 15 (0x0f)

Transport_descriptor_length: 13 (0x000d)

DVB-DescriptorTag: 67 (0x43) [= satellite_delivery_system_descriptor]
descriptor_length: 11 (0x0b)
Frequency: 19088208 (= 12.34350 GHz)
Orbital_position: 642 (= 28.2)
West_East_flag: 1 (0x01) [= EAST]
Polarisation: 0 (0x00) [= linear - horizontal]
Kind: 1 (0x01) [= DVB-S2]
Roll Off Faktor: 0 (0x00) [= Alpha 0.35]
Modulation_type: 1 (0x01) [= QPSK]
Symbol_rate: 2707456 (= 29.5000)

FEC_inner: 3 (0x03) [= 3/4 conv. code rate]

Which clearly ties to the Transport_Stream_ID for services from: dvbsnoop -nph -n 500 x011

------------------------------------------------------------
SECT-Packet: 00000030 PID: 17 (0x0011), Length: 903 (0x0387)
Time received: Mon 2014-04-07 18:52:15.632
------------------------------------------------------------

PID: 17 (0x0011) [= assigned for: DVB Service Description Table (SDT), Bouquet Association Table (BAT)]

Guess table from table id...
SDT-decoding....
Table_ID: 66 (0x42) [= Service Description Table (SDT) - actual transport stream]
section_syntax_indicator: 1 (0x01)
reserved_1: 1 (0x01)
reserved_2: 3 (0x03)
Section_length: 900 (0x0384)
Transport_Stream_ID: 2033 (0x07f1)
reserved_3: 3 (0x03)
Version_number: 17 (0x11)
current_next_indicator: 1 (0x01) [= valid now]
Section_number: 0 (0x00)
Last_Section_number: 1 (0x01)
Original_network_ID: 2 (0x0002) [= Astra Satellite Network 28,2°E | Société Européenne des Satellites]

reserved_4: 255 (0xff)

Service_id: 3826 (0x0ef2) [= --> refers to PMT program_number]
reserved_1: 63 (0x3f)
EIT_schedule_flag: 1 (0x01)
EIT_present_following_flag: 1 (0x01)
Running_status: 4 (0x04) [= running]
Free_CA_mode: 1 (0x01) [= streams [partially] CA controlled]

Descriptors_loop_length: 214 (0x00d6)

DVB-DescriptorTag: 72 (0x48) [= service_descriptor]
descriptor_length: 23 (0x17)
service_type: 25 (0x19) [= advanced codec HD digital television service]
service_provider_name_length: 5 (0x05)
service_provider_name: "BSkyB" -- Charset: Latin alphabet
service_name_length: 15 (0x0f)

Service_name: "Sky Sports 4 HD" -- Charset: Latin alphabet

DVB-DescriptorTag: 73 (0x49) [= country_availibility_descriptor]
descriptor_length: 7 (0x07)
country_availability_flag: 1 (0x01)
reserved: 127 (0x7f)
country_code: GBR

country_code: IRL

DVB-DescriptorTag: 95 (0x5f) [= private_data_specifier_descriptor]
descriptor_length: 4 (0x04)

PrivateDataSpecifier: 2 (0x00000002) [= BskyB 1]

DVB-DescriptorTag: 74 (0x4a) [= linkage_descriptor]
descriptor_length: 49 (0x31)
transport_stream_ID: 2033 (0x07f1)
original_network_ID: 2 (0x0002) [= Astra Satellite Network 28,2°E | Société Européenne des Satellites]
service_ID: 3826 (0x0ef2) [= --> refers to PMT program_number]
linkage_type: 156 (0x9c) [= user defined]
Private Data:
0000: 10 05 ff ff 05 2a e1 10 07 ff ff 05 2a e1 10 06 .....*......*...
0010: ff ff 05 2a e1 10 08 00 32 05 2c e1 10 08 00 22 ...*....2.,...."

0020: 05 2a e1 10 08 00 21 05 2a e1 .*....!.*.

DVB-DescriptorTag: 178 (0xb2) [= User defined]
descriptor_length: 121 (0x79)
Descriptor-data:
0000: 1d 00 f0 2c a5 b9 be ab 8c 21 f2 04 97 34 94 43 ...,.....!...4.C
0010: 0a 97 d6 be 5a 0d f3 1d bf 63 55 de 82 a9 c5 90 ....Z....cU.....
0020: af 35 8e b5 71 83 48 68 37 cc 76 fd 8d 55 fa b8 .5..q.Hh7.v..U..
0030: c1 4b e0 7b e4 2a b8 c2 46 c6 15 88 71 61 67 69 .K.{.*..F...qagi
0040: 6e a9 7a ae 30 24 d5 99 7e ab 8c 14 b4 74 32 53 n.z.0$..~....t2S
0050: b4 35 57 8f db 55 d1 e3 29 4f ea b8 c2 37 09 80 .5W..U..)O...7..
0060: 8e ab 8c 04 03 55 78 fa ae 30 8d 4c a3 a5 b0 40 .....Ux..0.L...@

0070: 47 b7 27 58 a3 d5 5e 3f 6a G.'X..^?j

Service_id: 3827 (0x0ef3) [= --> refers to PMT program_number]
reserved_1: 63 (0x3f)
EIT_schedule_flag: 1 (0x01)
EIT_present_following_flag: 1 (0x01)
Running_status: 4 (0x04) [= running]
Free_CA_mode: 1 (0x01) [= streams [partially] CA controlled]

Descriptors_loop_length: 138 (0x008a)

Service_name: "Sky Sports 4 HD" -- Charset: Latin alphabet

DVB-DescriptorTag: 73 (0x49) [= country_availibility_descriptor]
descriptor_length: 7 (0x07)
country_availability_flag: 1 (0x01)
reserved: 127 (0x7f)
country_code: GBR

country_code: IRL

DVB-DescriptorTag: 95 (0x5f) [= private_data_specifier_descriptor]
descriptor_length: 4 (0x04)

PrivateDataSpecifier: 2 (0x00000002) [= BskyB 1]

DVB-DescriptorTag: 178 (0xb2) [= User defined]
descriptor_length: 96 (0x60)
Descriptor-data:
0000: 1d 00 f0 3a 18 75 9a c3 28 5f 55 c6 11 ba ae 30 ...:.u..(_U....0
0010: 91 8c a5 3f 63 0f 4f 90 fd cc d2 9b a5 15 85 01 ...?c.O.........
0020: 42 28 c2 85 9e cf 67 b3 d9 f7 45 ab bd 3d 59 8c B(....g...E..=Y.
0030: b7 4a 2b 59 e2 b6 88 ac e8 6c 56 8a d1 5b 74 5e .J+Y.....lV..[t^
0040: b2 0b a1 ab 3b 61 7e 55 86 ab 8c 09 32 15 5c 60 ....;a~U....2.\`

0050: d2 95 65 ab 8c 1a 43 71 0e 3d 11 ab 8c 2a fd ea ..e...Cq.=...*..

Service_id: 3853 (0x0f0d) [= --> refers to PMT program_number]
reserved_1: 63 (0x3f)
EIT_schedule_flag: 1 (0x01)
EIT_present_following_flag: 1 (0x01)
Running_status: 4 (0x04) [= running]
Free_CA_mode: 1 (0x01) [= streams [partially] CA controlled]

Descriptors_loop_length: 187 (0x00bb)

Service_name: "Sky Atlantic HD" -- Charset: Latin alphabet

DVB-DescriptorTag: 73 (0x49) [= country_availibility_descriptor]
descriptor_length: 7 (0x07)
country_availability_flag: 1 (0x01)
reserved: 127 (0x7f)
country_code: GBR

country_code: IRL

DVB-DescriptorTag: 95 (0x5f) [= private_data_specifier_descriptor]
descriptor_length: 4 (0x04)

PrivateDataSpecifier: 2 (0x00000002) [= BskyB 1]

DVB-DescriptorTag: 178 (0xb2) [= User defined]
descriptor_length: 145 (0x91)
Descriptor-data:
0000: 1d 01 70 04 c0 47 71 35 25 d9 79 d5 5e 3e e0 72 ..p..Gq5%.y.^>.r
0010: 0c 1a 5f 5a e4 b5 26 94 f4 e0 fa 7f 2c b5 71 83 .._Z..&.....,.q.
0020: 4e ab 8c 1a 37 02 ab 8c 09 35 5c 60 cb a4 69 24 N...7....5\`..i$
0030: c5 d5 c6 14 2f 57 18 29 47 aa e3 03 80 b1 b9 3a ..../W.)G......:
0040: fd 2b e1 63 55 c6 08 41 a0 ee ab 8c 0d e4 97 c2 .+.cU..A........
0050: c6 90 d5 71 84 d6 90 dc 3e ae 30 52 8f 55 c6 10 ...q....>.0R.U..
0060: fa ae 30 69 a2 38 7a 4f 3f aa e3 08 dc 1f fa ae ..0i.8zO?.......
0070: 30 7e d5 71 83 46 ab 8c 21 f5 66 0d 97 9a b8 c1 0~.q.F..!.f.....
0080: a5 79 d5 71 83 e8 6a b8 c1 a3 17 f3 ee da 23 03 .y.q..j.......#.

0090: b5 .

Service_id: 3861 (0x0f15) [= --> refers to PMT program_number]
reserved_1: 63 (0x3f)
EIT_schedule_flag: 1 (0x01)
EIT_present_following_flag: 1 (0x01)
Running_status: 4 (0x04) [= running]
Free_CA_mode: 1 (0x01) [= streams [partially] CA controlled]

Descriptors_loop_length: 162 (0x00a2)

DVB-DescriptorTag: 72 (0x48) [= service_descriptor]
descriptor_length: 15 (0x0f)
service_type: 25 (0x19) [= advanced codec HD digital television service]
service_provider_name_length: 5 (0x05)
service_provider_name: "BSkyB" -- Charset: Latin alphabet
service_name_length: 7 (0x07)

Service_name: "Sky1 HD" -- Charset: Latin alphabet

DVB-DescriptorTag: 73 (0x49) [= country_availibility_descriptor]
descriptor_length: 7 (0x07)
country_availability_flag: 1 (0x01)
reserved: 127 (0x7f)
country_code: GBR

country_code: IRL

DVB-DescriptorTag: 95 (0x5f) [= private_data_specifier_descriptor]
descriptor_length: 4 (0x04)

PrivateDataSpecifier: 2 (0x00000002) [= BskyB 1]

DVB-DescriptorTag: 178 (0xb2) [= User defined]
descriptor_length: 128 (0x80)
Descriptor-data:
0000: 1d 01 70 04 c0 47 59 f5 57 8f a9 f2 90 d5 71 84 ..p..GY.W.....q.
0010: 3e ab 8c 26 35 5c 60 a5 aa e3 08 ed ee de 4d 35 >..&5\`.......M5
0020: 71 82 95 7e ed aa e3 0a 2d 23 49 26 2e ae 30 a1 q..~....-#I&..0.
0030: 7a b8 c1 4a 3c 64 b1 d5 c6 0a 53 4d 57 18 3a d5 z..J<d....SMW.:.
0040: c6 0a 51 e1 e9 68 6a b8 c2 1f 70 f0 6d 57 18 12 ..Q..hj...p.mW..
0050: 6a cc 1b 55 c6 0e 7a ae 89 d5 71 81 c0 6a b8 c0 j..U..z...q..j..
0060: 93 72 75 fa 57 c2 c6 73 1b 55 c6 0f b5 71 82 94 .ru.W..s.U...q..

0070: 78 3e 9f cb 7a 75 5c 60 f7 aa e3 05 2d 55 e3 d5 x>..zu\`....-U..

Service_id: 3865 (0x0f19) [= --> refers to PMT program_number]
reserved_1: 63 (0x3f)
EIT_schedule_flag: 1 (0x01)
EIT_present_following_flag: 1 (0x01)
Running_status: 4 (0x04) [= running]
Free_CA_mode: 1 (0x01) [= streams [partially] CA controlled]

Descriptors_loop_length: 162 (0x00a2)

Service_name: "Sky1 HD" -- Charset: Latin alphabet

DVB-DescriptorTag: 73 (0x49) [= country_availibility_descriptor]
descriptor_length: 7 (0x07)
country_availability_flag: 1 (0x01)
reserved: 127 (0x7f)
country_code: GBR

country_code: IRL

DVB-DescriptorTag: 95 (0x5f) [= private_data_specifier_descriptor]
descriptor_length: 4 (0x04)

PrivateDataSpecifier: 2 (0x00000002) [= BskyB 1]

DVB-DescriptorTag: 178 (0xb2) [= User defined]
descriptor_length: 128 (0x80)
Descriptor-data:
0000: 1d 08 70 04 c0 47 59 f5 57 8f a9 f2 90 d5 71 84 ..p..GY.W.....q.
0010: 3e ab 8c 26 35 5c 60 a5 aa e3 08 ed ee de 4d 35 >..&5\`.......M5
0020: 71 82 95 7e ed aa e3 0a 2d 23 49 26 2e ae 30 a1 q..~....-#I&..0.
0030: 7a b8 c1 4a 3c 64 b1 d5 c6 0a 53 4d 57 18 3a d5 z..J<d....SMW.:.
0040: c6 0a 51 e1 e9 68 6a b8 c2 1f 70 f0 6d 57 18 12 ..Q..hj...p.mW..
0050: 6a cc 1b 55 c6 0e 7a ae 89 d5 71 81 c0 6a b8 c0 j..U..z...q..j..
0060: 93 72 75 fa 57 c2 c6 73 1b 55 c6 0f b5 71 82 94 .ru.W..s.U...q..

0070: 78 3e 9f cb 7a 75 5c 60 f7 aa e3 05 2d 55 e3 d5 x>..zu\`....-U..

CRC: 2309035531 (0x89a1160b)

==========================================================

PS for anyone else interested in this the EPG data is also found with: dvbsnoop -nph -n 500 0x12

Sry for the long post :p

Anonymous

Simon,

If Network Discovery is turned on in TVH, does this not automatically add new muxes?

Simon D

Hi Jonathan,

Yes it does, to be honest i'm not really bothered about it adding additional muxes and the discovery tends to add muxes that aren't needed or dont work. I thought it would be a great option from a new install/clean config perspective where you have nothing configured, if there was an option to run the script and populate everything muxes,services and channels using the opentv data.

Obviously if this was possible it could be run on a schedule to keep everything up to date with out relying on service/mux discovery; currently tvheadend doesn't seem to be updating service changes at all, i'm keeping an eye on king of sat and doing them manually.

Cheers

Rob Rob

Nothing to worry about, you were using a broken build (ones around the 500 mark and after 470 wouldn't detect muxes and were just basically broken all round with respect to scanning).
In terms of automatically updating services when a channel changes frequency, that's something tvheadend has never done and likely never will do for reasons that will become obvious as understanding of how things like that work improves.

tvheadned uses a preset database for muxes that is hopelessly outdated but not the focus of it's function so it's up to end user to sort that out.

Best thing to do IS to use the discovery function but first of all just add a single mux that the Sky EPG is currently on (this hasn't changed for a years) then turn on discovery.

You will be left with a channel line up that is 99.9% correct with current frequencies, plus a few extra abandoned/test channels/dead channels (but immediately obvious which ones they are).

VS, using the built in database and forever finding channels have changed mux and don't work.

Simon D

To be honest the only time i've used the in built Astra 28.2e list was the first time I installed over a year ago, realised it was crap found the reference file and updated it using the 28.2e ini file from king of sat, this is still what I do whenever I decide to start from scratch which is why its appealing to pull all the information from the opentv stream which I assume the sky boxes also do.

I've attached the updated file below incase anyone wants that its from March this year. It goes in this folder: /usr/share/tvheadend/data/dvb-scan/dvb-s

Cheers

Rob Rob

Consider me schooled.
Wasn't aware of this ini, in which case, seems very possible to add something like this and forgive me previous comment. Was hard to know what level you were at.
Some kind person made a script that converts the kingofsat ini to tvheadend's format
https://tvheadend.org/d/1029-ubuntu-tbs-6981-faint-signal-reported-but-a-sky-box-on-the-same-cable-works-fine

Dale Taylor

Glad to see some work on this. For some reason it don't work for me tho :-(


malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "(end of string)") at /usr/share/perl5/vendor_perl/JSON.pm line 171

Maybe I'm using the wrong versions of the stuff needed for this script. any pointers would be grateful.

mpmc

Dale Taylor wrote:
> Glad to see some work on this. For some reason it don't work for me tho :-(
>
>
> [...]

> Maybe I'm using the wrong versions of the stuff needed for this script. any pointers would be grateful.

make sure you have libjson-perl and libwww-perl installed and try again.

Dale Taylor

wrote:
> Dale Taylor wrote:
> > Glad to see some work on this. For some reason it don't work for me tho :-(
> >
> >
> > [...]
> > Maybe I'm using the wrong versions of the stuff needed for this script. any pointers would be grateful.
>
> make sure you have libjson-perl and libwww-perl installed and try again.
Got both of them. Named a little differently on arch but should still do the job.

perl-libwww perl-json

Going to try this on a live cd on unbunta and report back.

Edit: Got it working. Not the live cd thing tho. Redownloaded the script and all is working :D

Thanks Mark Clarkstone for trying to help and Jonathan Kempson for making this amazing script.

I'm a very happy chappy xD

gary tan

anyone have any luck getting this to work with openelec? Perl isnt natively supported on openelec but a person here gave instructions for using activeperl (see link below) but have had no luck in getting it to work with this script.

http://openelec.tv/forum/71-pvr-live-tv/40321-xmltv-adding-a-new-grabber#40481

Baz Cooper

How do you run this script, cant find any instructions.

mpmc

Baz Cooper wrote:

> How do you run this script, cant find any instructions.

From terminal:

perl ./Autobouquet.pl

Obviously you'll need to have edited it to your requirements first & have perl (along with libjson-perl & libwww-perl) installed.

Hope this helps. :)

« Previous Page Next Page »