Synology xmltv module and zap2xml help

Nick Craig · 2017-01-03T22:23:27+00:00

I have a synology nas with tvheadend from synocommunity setup and working with my hdhomerun tuner. I cannot wrap my head around how to setup the internal gr...

D R

I use-I -D to get the extra info available on zap2it server. First run takes some time but after that is pretty smooth.

log jam

^^^

I tried your suggestion, and like you said, it took a long time. However, no additional colors showing in the guide. Any other suggestions?

Thanks!

Logjam

K Shea

It takes a long time because it has to request data for ever single show in the listings separately. I really kind of wish people wouldn't do this because I fear if too many do, it will cause them to shut down the service (or some other bad outcome). If you must do it, at least please be responsible and make sure you only request the data once a day, preferably at some totally random time (not ending in :00) in the middle of the night so their servers won't be hammered.

But that said, there is an additional script that you have to run to add in the colors, it simply translates the tags that zap2it uses to the tags that Tvheadend understands. This thread explains the problem, but (at least on the front page) doesn't provide a solution applicable to zap2it users. https://tvheadend.org/d/1494-xmltv-kazer-french-categories?r=26317 I could have sworn that someone wrote a script to do something similar for sap2it users but I can't seem to find it now. I do remember testing it quite some time back and if I recall correctly it caused some problem (maybe corrupting the .xml file so Tvheadend couldn't read it all? I honestly don't remember) but since I abandoned it rather quickly I don't recall the name of it anymore. But anyway, that's the problem.

log jam

K Shea wrote:
> It takes a long time because it has to request data for ever single show in the listings separately. I really kind of wish people wouldn't do this because I fear if too many do, it will cause them to shut down the service (or some other bad outcome). If you must do it, at least please be responsible and make sure you only request the data once a day, preferably at some totally random time (not ending in :00) in the middle of the night so their servers won't be hammered.

Rest assured, I won't be hammering the server. I don't want to jeopardize a good thing! I have set my cron job for the wee small hours of the morning.

As for the additional script, I had read that thread and thought it only applied to French users, but it looks like it could be run in the US as well. Do you think it needs to be modified to run in the US, or is it good to go?

I know enough Linux to be dangerous ;)

Thanks everyone!

Logjam

K Shea

log jam wrote:

> As for the additional script, I had read that thread and thought it only applied to French users, but it looks like it could be run in the US as well. Do you think it needs to be modified to run in the US, or is it good to go?

I think it probably does need to be modified, specifically to translate the tags used by zap2it and passed into the XML file by zap2xml, into the categories that Tvheadend wants to see. It's probably just script that does straight substitution of one word for another. The problem is that the program in that thread was written for use with a French service and therefore probably expects the XML file to contain French language categories.

At the heart of it, it's probably just replacing one tag with another.

I'm like you when it comes to Linux, to me almost everything in Linux seems far more complicated than it should be. I did not read all the pages of that thread, so if you have the time and go through them all, just maybe someone has modified it to work with zap2it-style categories.

But I still can't help thinking there was another script written from the get-go for use with sap2it/zap2xml, I even remember trying it out, but I simply cannot remember the name of it or where I saw it. It was likely either in this forum or the Kodi forum Tvheadend section, but I just don't remember.

EDIT: It MAY have been the Perl script on this page: https://github.com/rocky4546/script.xmltv.tvheadend/tree/master/xmltv - the package it is part of was intended to provide some kind of integration between Kodi and Tvheadend or something, but I never needed it since I already had all the necessary parts installed and working, I just wanted to see if the genre translations script worked. But I do remember that in some way it screwed things up for me, so I stopped using that script. Maybe the problem has been fixed, or maybe you could fix it if you know Perl (I'm guessing you probably don't), but I don't have high hopes that it will work for you as-is (but who knows, you might get lucky).

D R

Anyone got the new zap2xml.pl (1/1/2018) going?

Looks like zap2it website changed, hopefully a new build is on the way.

log jam

There is another thread about the zap2it issues here:

https://tvheadend.org/d/4722-epg-for-na-ota-zap2it?r=30615#message-30615

Not sure if this will work on a Synology however...

D R

Everyone is running ok?

I have the latest zap2xml.pl (2018-01-09) installed but I m getting an error when accessing zap2it. TVGUIDE generates fine thought.

LWP will support https URLs if the LWP::Protocol::https moduleis installed

Any ideas?

log jam

I got epg working on my Syno using the info in the thread I previously linked.

I downloaded both the zap2epg.py and the settings.xml files, and put them in the same place I had the previous zap2xml.pl and zap2xml.sh files.

Read through the thread and make adjustments as necessary to the settings.xml file. Set your zip code, how many days of guide data you want, etc. I followed the instructions step by step and added every channel ID I wanted guide data for in the settings.xml file.

Once I prepared my settings file with the relevant data, I ssh'd into my Synology and ran the following command:
sudo python /volume1/path to/zap2epg.py

This will take a while the first time.

I hope this helps you. I FINALLY have a color epg in Kodi now!

Thank you edit4ever!

D R

log jam wrote:
> I got epg working on my Syno using the info in the thread I previously linked.
>
> I downloaded both the zap2epg.py and the settings.xml files, and put them in the same place I had the previous zap2xml.pl and zap2xml.sh files.
>
> Read through the thread and make adjustments as necessary to the settings.xml file. Set your zip code, how many days of guide data you want, etc. I followed the instructions step by step and added every channel ID I wanted guide data for in the settings.xml file.
>
> Once I prepared my settings file with the relevant data, I ssh'd into my Synology and ran the following command:
> sudo python /volume1/path to/zap2epg.py
> This will take a while the first time.
>
> I hope this helps you. I FINALLY have a color epg in Kodi now!
>

> Thank you edit4ever!

I will give it shot this weekend if time permits. For now I am using tvguide.

Kris Hammond

I just dealt with this issue over the weekend. As far as I can tell, Zap2it has changed their website to use https protocol, which meant a rewrite of the zap2it perl script. It also means the new script is using perl modules that the old one didn't need. Have you tried installing the LWP::Protocol::https Perl module? Let me know if you need help. A couple of things to check:
- Which Perl modules are currently installed
- Which version of Perl you're running
I had trouble installing LWP::Protocol::https because the IO::Socket::SSL prerequisite was failing on testing and wouldn't force install. I fixed it by installing a newer Perl distribution (since the packaged version with my Debian Jessie distro is old). Installing Perlbrew and CPANM make the whole process a lot easier.

D R

Kris Hammond wrote:
> I just dealt with this issue over the weekend. As far as I can tell, Zap2it has changed their website to use https protocol, which meant a rewrite of the zap2it perl script. It also means the new script is using perl modules that the old one didn't need. Have you tried installing the LWP::Protocol::https Perl module? Let me know if you need help. A couple of things to check:
> - Which Perl modules are currently installed
> - Which version of Perl you're running

> I had trouble installing LWP::Protocol::https because the IO::Socket::SSL prerequisite was failing on testing and wouldn't force install. I fixed it by installing a newer Perl distribution (since the packaged version with my Debian Jessie distro is old). Installing Perlbrew and CPANM make the whole process a lot easier.

Synology provides their own Perl package and I can't add any new modules.

K Shea

D R wrote:

> Synology provides their own Perl package and I can't add any new modules.

I'll just throw this out there, you could run the newly released zap2xml script on any Linux or Windows computer on your local network, then move the created xml file to your Synology. If you can ssh into the Synology then you could perhsps use sshfs to move the file. On a Linux machine you'd do it something like this (after using zap2xml to get your listings):

/usr/bin/sshfs synologyuser@ip.address.of.synology:/home/hts/.xmltv /mnt/xmltv
/bin/cp -f tv_grab_file.xmltv /mnt/xmltv

/bin/umount /mnt/xmltv

The three lines would first mount the /home/hts/.xmltv directory on the synology as /mnt/xmltv - for this to work the permissions on /home/hts/.xmltv would probably need to be world readable and writeable - then copy tv_grab_file.xmltv over, and then unmount the directory. You may need to adjust the paths to be correct for your system, and actually you would not even need the paths at the very beginning of the lines if you are running the commands manually, but you would need them if you put the commands in a shell script. This is just to give a general idea of how it could be done; you may need to read up on the use of sshfs, cp, and/or umount to get it all to work. Basically, I know that sshfs is the tool that will let you mount a remote filesystem as if it were local, assuming that you can ssh into the remote system and assuming you have permission to access the directory in question. This is probably old news to true Linux geeks, but it was news to me when I discovered it.

Jim Stolpman

New to this forum. Using the zap2xml.pl and zap2xml.sh scripts with success on a Synology DS718+ but only using TVGuide. Are there any plans to update the Perl script to be able to use the zap2it site?

D R

Jim Stolpman wrote:

> New to this forum. Using the zap2xml.pl and zap2xml.sh scripts with success on a Synology DS718+ but only using TVGuide. Are there any plans to update the Perl script to be able to use the zap2it site?

I hope someone that has more knowledge can tackle the new Perl script.

the problem might be now Perl on our Synology as it does not have all the modules and also cant add any modules.

D R

I ended up running zap2xml on PC at starup or shedule and created a task to move the file daily.

It works for now but it's not as nice as having it all on my Synology.

D R

> Thank you edit4ever!

hi, can you provide more info on how you got it working?
I got both files but it complaints when I run it.


2019/08/05 20:20:35 Kodi settings version is: 2
2019/08/05 20:20:35 Running zap2epg-0.6.3 for zipcode: 95747 and lineup: Local Over the Air Broadcast
2019/08/05 20:20:35 No channel list found - adding all stations!
2019/08/05 20:20:35 Exception: main
Traceback (most recent call last):
  File "/zap2epg.py", line 713, in mainRun
    tvhMatchGet()
  File "/zap2epg.py", line 111, in tvhMatchGet
    response = urllib2.urlopen(channels_url)
  File "/usr/lib/python2.7/urllib2.py", line 154, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python2.7/urllib2.py", line 435, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 473, in error
    return self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 556, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 401: Unauthorized

nick raia

I having trouble setting the correct permissions for tv_grab_file. I have setup TVH on a ubuntu system before. However, upon installing the package on a DS916+ running DSM 6.2.3-25426 there is no user Tvheadend or hts. Over ssh running:


awk -F':' '{ print $1}' /etc/passwd

There is a user sc-tvheadend. But setting the permissions still does not show the EPG Grabber Module.

Can anyone point me in the right direction?

D R

I use WinSCP to make the changes and it works no problem.
I have "root" as Group and owner and 0777 for permission and works well for me.

« Previous Page