Project

General

Profile

Bug #5572

Neither UK-Freesat Bouquets NOR 7 day epg appear to be working

Added by cy clic 2 months ago. Updated about 2 months ago.

Status:
Fixed
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
Start date:
2019-03-12
Due date:
% Done:

100%

Estimated time:
Found in version:
4.3-1781~g811fd889e and 4.2.8-17~gd64d8c8 last 8 - 10 weeks or so
Affected Versions:

Description

Neither UK-Freesat Bouquets NOR 7 day epg appear to have been working
for all pi builds for around 8 to 12 weeks.
Unless there is some new trick to trigger them that I do not know?
Freesat home server epg pid not seen.

Both test show same problem on :
pi3bv1.1
Linux h1 4.4.0-1103-raspi2 #111-Ubuntu (xenial)
with tvheadend/xenial,now 4.2.8-17~gd64d8c8~xenial armhf

pi3b+
Linux h0 4.15.0-1031-raspi2 #33-Ubuntu (bionic)
with tvheadend/bionic,now 4.3-1781~g811fd889e~bionic arm64

Testing setup using forced play with scheduled-mux on 11425H
(similar results with other 2 Freesat home transponders...)
Method using various epg enabled on epg-grabber-modules tab

4.3-1781 (Main test config for problem)
Freesat: Status-Pids 0,1,16,17
Freesat (EIT): Status->Pids 0,1,16,17
EIT EPG Grabber: Status->Pids 0,1,16,17 and sometimes ,18
All 3 enabled: Status->Pids 0,1,16,17 and sometimes ,18
Bandwith (kb/s) now always only 200~300 since problem started.
(Note: Previously bandwidth was 10x plus this before problem
- so fast epg not beimg accessed now)
(latest -1781 thankfully does not clog bouquet list with unwanted sky!)

4.2.8-17
Same problem
No Status-Pids column + No Log Pid listed
However bandwidth column behaves in a similar manner

So, I do not see any Freesat "non-standard" home server pid requested??

Associated revisions

Revision 6bfeca6c (diff)
Added by Jaroslav Kysela about 2 months ago

dvbpsi: fix the freesat bouquet update (inverted condition), fixes #5572

Revision 74cdf3f1 (diff)
Added by Jaroslav Kysela about 2 months ago

dvbpsi: fix the freesat bouquet update (inverted condition), fixes #5572

History

#1 Updated by Jaroslav Kysela 2 months ago

Check the MUX (EPG Scan, EPG module id) and EPG grabber module settings (both must have Freesat EPG grabber enabled).

#2 Updated by Deep Thought 2 months ago

In case of doubt: the correct mux is 11425H. If you scan this transponder, an encrypted
channel trp1 will appear. Tuning to that one is a reliable way to start uk freesat epggrab
(if it works).

In the epg grabber modules, there are two modules: "UK Freesat" and "UK freesat EIT".
I have enabled them both, not knowing what is the difference.
If I remember correctly, it is also important that scraper configuration is set to default (not
"uk"). Also epg grabber timeout should be set to a sufficiently low value (120 works reasonably well) otherwise it may take ages before the Uk freesat grabber is even started.

This is from memory: I may be wrong about a few details (with these values it should
work, but perhaps it also works with others)

It took a lot of trials for me to make it work. It is all quite confusing.

#3 Updated by g siviero 2 months ago

I cannot receive 11425H (I'm out of the beam footprint for this transponder), but it seems that I can get 7 day EPG data for many of the channels that I receive from the frequency 11778V. I don't know if this transponder contains data also for the channels you are looking for.

#4 Updated by Mark Clarkstone 2 months ago

g siviero wrote:

I cannot receive 11425H (I'm out of the beam footprint for this transponder), but it seems that I can get 7 day EPG data for many of the channels that I receive from the frequency 11778V. I don't know if this transponder contains data also for the channels you are looking for.

That is the Sky home transponder, it contains the OpenTV data, it can be used for Freesat channels.

#5 Updated by cy clic 2 months ago

Firstly I should add that I use multiple satip tuners for receiving UK-Freesat.

Thank you both for your help.
I also have only got it to work over the years by trying all sorts of combinations.
One could say tried "randomly" because I also have little or
no information as to the "correct" process.

However historically I have eventually (sometimes after days) been successful.
I understand the 3 home transponders to currently be 11425H, 11426V & 11426.5V
and that they transmit the same channels/bouquets/epgs
cursory inspection seems to confirm this. They all have the same 6 services which all play.
I do not see a "trp1" service.

I do not not know the current bouquet/epg pid number but am expecting ~3xxx ?

Config->Muxes->EPGScan offers:
Disable/Enable (auto)/Force (auto)/Manual selection/Auto-Detected
Config->Muxes->EPGmoduleid:
UK:Freesat/UK:Freeview/EIT:EPGGrabber/...+All the other bouquets
Config->Channel/EPG->EPG Grabber Modules offers:
Over the air:EIT EPG Grabber/Over the air:UK:Freesat/Over the air:UK:Freesat(EIT)/... +et al
I have spent days and day try any plausible combination and many implausible combinations and failed.

The one thing I note that may relevant is that there is never a Freesat epg pid ~3xxx requested.
It is understanding that this is a must for the bulk (fast) epg download.
My suggestion that the bouquet/7day-epg is no longer working is
based on no pid requested and that all reasonable combinations of settings have failed.

Putting on my "User Head" ( a la Worsel Gummidge :-) )
I would suggest that simply enabling a "UK-Freesat module" in the tabs, alone
should be all that is required for everything to be appropriately configured and all of Freesat to burst into life.
That UK Freesat module would strictly only need a single option i.e. postcode of desired viewing seat.
Of course, there is no need to remove all the other stuff for those who wish to tinker.
But tinkering should not be needed for normal usage.

I have read somewhere that Jaroslav has said he does not have signal
from the UK beam transponders that UK-Freesat typically uses especially for the home transponders
Perhaps someone might be able to offer ad-hoc access to satip tuners
when required for all this to be looked at?
I would willing offer my own but regrettable I am not endowed with fibre and
my ADSL up-link is worse that derisory.

#6 Updated by Jaroslav Kysela 2 months ago

I debugged freesat last week (I had remote SAT>IP server access) and the only weak point is that you need to tune to 11425H for a while to read bouquets correctly. Then everything was ok, just enable both Freesat EPG grab modules and map the one from the detected bouquet or freesat services to trigger the EPG grab.

The MUX EPG grabber settings should change from auto to auto-detected and EPG grabber module to UK Freeview (without EIT which is the dependent grabber used automatically). That's all. I have not tried other transponders and I agree that the things should be improved (TVH should wait more to get the bouquets and other transponders should be checked, too).

An UK SAT>IP server for the debugging would be helpful, but I don't know when I'll have a time for more debugging (the real work really buries me now).

#7 Updated by Oli Jeal 2 months ago

I'm unable to get any OTA bouquets after a fresh install. Could this be down to commit a3c5e75? I'm not familiar with the code but are Priv and Map always assigned or could Map sometimes be null? If the later then should it be an AND instead of an OR?
https://github.com/tvheadend/tvheadend/commit/a3c5e751b05018a2cb3764627c3a77b4a5d9e7ce#diff-204c1e5944a0e11491aefdf0e6366bb5

#8 Updated by Flole Systems 2 months ago

If you don't have that check and it's null you'll experience a crash. You could try to revert to before that commit was made to make sure it's not causing the issues.

#9 Updated by Oli Jeal 2 months ago

I've reverted https://github.com/tvheadend/tvheadend/commit/726e6e65441a9802b6678b05e5f78d82c8cad5f5 and rebuilt and all my bouquets were found straight away so I think the problem must be there.

#10 Updated by Oli Jeal about 2 months ago

Can this change be updated? I'm hesitant to ask for it to be reverted as it was meant to be fixing another problem. The code in question is
761 if (TAILQ_SAFE_ENTRY(fs, region_link))
762 continue;

#11 Updated by Jaroslav Kysela about 2 months ago

  • Status changed from New to Fixed
  • % Done changed from 0 to 100

#12 Updated by Rob D about 2 months ago

Can anyone confirm this patch works? I can see the BskyB bouquets but no Freesat bouquets or EPG still (Built from master with the commit referenced above included)

#13 Updated by cy clic about 2 months ago

Rob D wrote:

Can anyone confirm this patch works? I can see the BskyB bouquets but no Freesat bouquets or EPG still (Built from master with the commit referenced above included)

Current Cosmic & pi64 with 4.3-1789 arm64 on pi3b+ do find Freesat bouquets & 7day EPG, little or no delay.
Thanks

There has been no update yet to stable - Xenix armhf still at 4.2.8-22 and hence no Freesat Bouquets.

#14 Updated by Jaroslav Kysela about 2 months ago

Pushed to 4.2, too.

#15 Updated by cy clic about 2 months ago

Jaroslav Kysela wrote:

Pushed to 4.2, too.

Thanks
Confirm that that Freesat bouquets now OK on current ubuntu-xenix armhf with stable 4.2.8-23~g74cdf3f on pi2bc1.1 (sd)

Now also confirm that Freesat bouquets OK on raspianstretch armhf 4.3-1789 on pi3b+ (boot+run USB).

Re your previous comment: sometimes a delay before bouquets appear.
This could be because Network->Forcescan rarely completes all muxes on the first attempt after clean install.
With new install i.e. no muxes/services pre-scanned on both stable & unstable Forcescan "stops" (hangs?) with around 35 to 40 muxes remaining.
Multiple manual Forcescan and or or leaving over night usually succeeds and all muxes scanned i.e. none left remaining queued.
At which time there will show about 1100-1200+ services and Freesat bouquets appear.
This is a long standing "feature" and I have mused that it may be connected to a bug or ungraceful handling of SatIp not always being successful in tuning first time.

So for example, upgrading to 4.3-1789 and 4.2.8-23 which were existing installed muxes/services pre-scanned and channels manually mapped then bouquets appear without this delay.

Also available in: Atom PDF