XMLTV, Kazer & French categories

Stephane Chauveau · 2013-11-27T15:47:07+00:00

SEE THE REPLY POSTS BELOW FOR AN UPDATED SCRIPT THAT CAN PROCESS ANY INPUT LANGUAGE. The following information are mostly intended for french users of www.k...

thierry castelot

hi,

i will check the last script this evening, maybee i've upload a bad one.

james Bond

@Renato @thierry

thanks both for this ultra fast answer ;-)

I was starting to become mad trying to get the script to work :D

james Bond

mhhh... I have just tried the "old" script and checked it manualy

pi@TVServer:~ $ sudo su
root@TVServer:/home/pi# service tvheadend stop
root@TVServer:/home/pi# su - hts
hts@TVServer:~$ tv_find_grabbers
/usr/bin/tv_grab_combiner|Combine data from several other grabbers
/usr/bin/tv_grab_za|South Africa
/usr/bin/tv_grab_fr_kazer|France (Kazer)
/usr/bin/tv_grab_fr|France
/usr/bin/tv_grab_na_dtv|North America using www.directv.com
/usr/bin/tv_grab_huro|Hungary/Romania
/usr/bin/tv_grab_eu_egon|German speaking area (Egon zappt)
/usr/bin/tv_grab_is|Iceland
/usr/bin/tv_grab_uk_rt|United Kingdom/Republic of Ireland (Radio Times)
/usr/bin/tv_grab_it|Italy
/usr/bin/tv_grab_ch_search|Switzerland (tv.search.ch)
/usr/bin/tv_grab_na_dd|North America (Data Direct)
/usr/bin/tv_grab_no_gfeed|Norway (beta)
/usr/bin/tv_grab_in|India (Whats On)
/usr/bin/tv_grab_fi|Finland (mtv3.fi, telkku.com, telvis.fi, tv.nyt.fi, yle.fi)
/usr/bin/tv_grab_dk_dr|TV Oversigten fra Danmarks Radios
/usr/bin/tv_grab_il|Israel (tv.walla.co.il)
/usr/bin/tv_grab_hr|Croatia
/usr/bin/tv_grab_se_swedb|Sweden (tv.swedb.se)
/usr/bin/tv_grab_ar|Argentina
/usr/bin/tv_grab_uk_bleb|United Kingdom (bleb.org)
/usr/bin/tv_grab_es_laguiatv|Spain (laguiatv.com)
/usr/bin/tv_grab_eu_epgdata|Parts of Europe (commercial) (www.epgdata.com)
/usr/bin/tv_grab_se_tvzon|Sweden (TVZon)
Timeout from: /usr/bin/tv_grab_fr_alacarte --capabilities 2>/dev/null /usr/bin/tv_grab_pt_meo|Portugal (MEO)

hts@TVServer:~$

...and sill no "Alacarte" in grabber modules :(

I can however run the script manualy and it seems to load xlm but it is very slow.

Renato Moscardini

Yes, It seems Alacarte is a lot slower than Kazer. Nevertheless, it works fine and have more than 15 days lefet instaed of only 10 on Kazer.

I am not on pi and I do not find "tv_find_grabber", so I am not able to reproduce your issue.

Nevertheless, the "--capabilities" option is not implemented on this script. There is only --version & --description options. It also was the case on Kazer script.

I suppose that it is not so complicated to implement it if necessary.

You can simply copy and paste the "--description" part and rename "--description" in "--capabilities"

thierry castelot

the old one as bad "echo", that's why it did'nt appears as alacarte.

i think the script is slow because of the number of sed to deal, it takes 10mn on my old ds112j but only 3 on my qnap hs251.

james Bond

Maybe should I clarify my config ;-)
-Raspberry Pi3
-Raspbian OS (Debian jessie) updated to latest version

-Tvheadend compiled from sources onto my RPI3 : HTS Tvheadend 4.1-2236~g817f67e

I think I did get xmltv with a apt-get install xmltv, I can't remember.

I am very very new to Linux world and I am just able to copy/paste commands grabbed on the Web :D

thierry castelot

welcome into the club! i'm also very noob into Linux ;)

These scripts are planned to work with a Synology Nas, maybe is for that why they don't work with your PI3.

I go to see if I find a trick so that it works under Linux.

james Bond

I have found an other thread that talk about the same, but the guy seems to do it an other way.

Maybe could you take a look? : http://www.dkoq.fr/post3268.html

Also http://wiki.xmltv.org/index.php/HowtoUseGrabbers, "tv_find_grabbers" is a standard fonction from xmltv, and all other grabbers as you can see in my previous post are detected correctly.

thierry castelot

ok, i will take a look wednesday, my ubuntu laptop is at my workplace.

thierry castelot

i assume that perl is already installed into your pi3 and have the same path as ubuntu.

move the two tv_grab into usr/bin and category into usr/local/bin, make them executable and restart tvh, you should be able to pick tv_grab_fr_alacarte_2.

Renato Moscardini

Hello Thierry,
Does it work with synology NAS as well ?

I suppose with pearl filter it increase the speed of proceccing.

Note : Yes, much faster :)

thierry castelot

hi Renato,

i think it does, i will try tonight after work and let you know.

Nicolas Rioja

Stephane Chauveau wrote:
> For Nicolas,
>
> The easiest way to log the errors is to redirect the error output stream (number 2) to a file.
>
> For example, you can run the script as follow
>
> /usr/local/bin/category-filter.pl 2> /tmp/category-filter.log
>
> or if you want to APPEND to the log file, use a double >> instead
>
> /usr/local/bin/category-filter.pl 2>> /tmp/category-filter.log
>
> The alternative is to modify the perl script itself.
>
> Add the following line at the beginning of the script to open the log file in append mode:
>
> open(LOG, ">>", "/tmp/category-filter.log") or die "Can't open LOG file: $!";
>
> Then clone the 'print STDERR' line and replace 'STDERR' by 'LOG':
>
> print STDERR "Warning: Unmanaged category: '$a'\n" ;
> print LOG "Warning: Unmanaged category: '$a'\n" ;
>
> If you do not want to repeat the same error hundreds or thousands of times, you can memorize the wrong categories as follow to emit a single error for each.
>
> At the beginning of the script, create an empty map:
>
> my %BAD ;
>
> Then modify the prints to STDERR and LOG as follow
>
> if ( ! exists $BAD{$a} ) {
> print STDERR "Warning: Unmanaged category: '$a'\n" ;
> print LOG "Warning: Unmanaged category: '$a'\n" ;
> # Record in BAD map so next error won't produce a message
> $BAD{$a} = 1 ;

> }

Hi Stephane,

I´m trying to implement your script with the BAD map now because I´m started to get more Unmanaged categories from some time ago since I´ve included more grabbers to fill my .xml file.

The problem is that I´m doing something wrong since I´m recieving this output:

Missing right curly or square bracket at /share/CACHEDEV1_DATA/homes/nico/wg++/categorias/cambia_categorias.pl line 330, at end of line
syntax error at /share/CACHEDEV1_DATA/homes/nico/wg++/categorias/cambia_categorias.pl line 330, at EOF
Execution of /share/CACHEDEV1_DATA/homes/nico/wg++/categorias/cambia_categorias.pl aborted due to compilation errors.

I´ve tried some things but without success. Check the script attached in this post to review it and comment me what is wrong.

Thank you very much

james Bond

thierry castelot wrote:
> i assume that perl is already installed into your pi3 and have the same path as ubuntu.
>

> move the two tv_grab into usr/bin and category into usr/local/bin, make them executable and restart tvh, you should be able to pick tv_grab_fr_alacarte_2.

many thanks : it works!

At least partialy since categories are not all colored inside Kodi.

But at least the grabber is display in Tvheadend interface.

EDIT : IT IS 100% WORKING! and it is maybe 20 time faster than the original script.
that was my fault...
First I was using your zguidetv account :D

Second, I had trash EPG datas preventing the correct mapping of new EPG datas.

thierry castelot

 james Bond

your welcome :)

Renato

works perfect into Synology ds112j and it's much much faster than my previous script.

you just need to update categories.pl to minimize the number of unmanaged categories.

james Bond

thierry castelot wrote:
>

 james Bond
> 
> your welcome :)
> 
>

Renato
>
> works perfect into Synology ds112j and it's much much faster than my previous script.
>

> you just need to update categories.pl to minimize the number of unmanaged categories.

I think your modded script should be posted in its own thread since it is working unlike 98% of the code posted on this thread :D

Renato Moscardini

@Thierry,
Many thanks, I will try it

thierry castelot

i made some corrections on this one.

John Mcenroy

Thank you very much for script. But how to make it case insensetive,

so that "Fin" = "fin" ?

I have found function ucfirst() to make first letter upper case, maybe

this can help here, but I can't understand how to implement it.

Thanks

Stephane Chauveau

The lc() function convert a string to lowercase so replace the while loop at the end of the script with



foreach my $key (keys %REPLACE) {
    $REPLACE{lc($key)} = $REPLACE{$key}  ;
}

while (<>) {
    my $line = $_ ;
    $line =~ s/($PRE)(.*)($POST)/"$1".myfilter(lc("$2"))."$3"/ge ;
    print $line;
}

The purpose of the foreach loop is to clone each entry in %REPLACE with a lowercase key.

In the while loop, lc() is applied to the argument passed to the my filter function.

« Previous Page Next Page »