webgrab+ as epg source

jody gugelhop

I wonder if anyone has managed to use webgrab+ as EPG resource. I have installed webgrab+ yesterday and the linux version finally seems to work properly, it does have quite the selection of EPG data, have a look:
http://webgrabplus.com/epg-channels
I'm unfortunately not technically savvy to get it working myself, but i guess it should be possible somehow. Would be great. have posted also on xbmc forum:
http://forum.xbmc.org/showthread.php?tid=140590&pid=1500705#pid1500705
as well as webgrab+ forum:
http://www.webgrabplus.com/content/using-tveadend
btw if someone has another good EPG source for German and Turkish TV stations (FTA on Astra 19.2 and Turksat) that would work for me as well :P cheers

jody gugelhop

fyi thanks to francis there some movement, see here:
http://www.webgrabplus.com/content/using-tveadend#comment-1193

jody gugelhop

now a little stuck with the whole thing, so it does show up in the drop down menu in tvheadend but does not return any epg data. webgrab+ produces a guide.xml how to tell tvheadend to read out that file?

some info on how the files looks like:

http://webgrabplus.com/node/30

here actually a sample guide.xml that i produced:

http://pastebin.com/chDrNS6T

my WebGrab++config.xml file:

http://pastebin.com/KAthnGZA

WebGrab+ log file (let's disregard for now the missing channels in there):

http://pastebin.com/gfMKuErt

tvheadend log file entries:

http://pastebin.com/ZFLjdL5y

any tips on how to get it working? thank you

jody gugelhop

It's working now :)

Bascially followed instructions for Linux on http://webgrabplus.com/documentation/configuration/howto

make sure you have mono complete in ubuntu and continue:


sudo apt-get install mono-complete
mkdir /home/hts/wg
wget -O /home/hts/wg/WebGrabPlusV1.1.1LINUX.rar http://webgrabplus.com/sites/default/files/download/SW/V1.1.1/WebGrabPlusV1.1.1LINUX.rar
cd /home/hts/wg
unrar x WebGrabPlusV1.1.1LINUX.rar
wget -O /home/hts/wg/patchexe_51.zip http://webgrabplus.com/sites/default/files/download/sw/V1.1.1/upgrade/patchexe_51.zip
unzip patchexe_51.zip
mkdir /home/hts/webgrab
mkdir /home/hts/webgrab/mdb /home/hts/webgrab/rex
cp /home/hts/wg/WebGrab+Plus.exe /home/hts/webgrab
cp /home/hts/wg/WebGrab++.config.xml /home/hts/webgrab
cp -r /home/hts/wg/MDB/* /home/hts/webgrab/mdb
cp -r /home/hts/wg/REX/* /home/hts/webgrab/rex
mv /home/hts/webgrab/WebGrab++.config.xml /home/hts/wg/WebGrab++.config.xml.original 
nano /home/hts/webgrab/WebGrab++.config.xml

paste this content:


<!--?xml version="1.0"?-->
<settings>
   
  <!-- for detailed info about the settings see http://webgrabplus.com/node/30 -->
   
  <filename>/home/hts/webgrab/guide.xml</filename>
  <mode></mode>
  <postprocess grab="y" run="n">mdb</postprocess>
  <logging>on</logging>
  <retry time-out="5">4</retry>
  <timespan>0</timespan>
  <update>f</update>

  <!-- replace the next dummy channel entry with the channels you want -->
  <!-- see http://webgrabplus.com/node/94 for the available sites/channels -->
  <channel site="dummy" site_id="xx" update="i" xmltv_id="Dummy">Dummy</channel>

</settings>

Continue with test file:

wget -O /home/hts/webgrab/dummy.ini http://webgrabplus.com/sites/default/files/download/ini/info/SiteIni.Pack/Misc/dummy.ini mono /home/hts/webgrab/WebGrab+Plus.exe "$(pwd)"

if all goes well you will end up with a file /home/hts/webgrab/guide.xml
Now you need to get the files for the channels of which you want to actually have the EPG, you can download the whole thing here: http://webgrabplus.com/epg-channels currently:

wget -O /home/hts/webgrab/SiteIni.Pack_2013.09.10_133538.zip http://webgrabplus.com/sites/default/files/download/ini/SiteIni.Pack_2013.09.10_133538.zip cd /home/hts/webgrab/ unzip /home/hts/webgrab/SiteIni.Pack_2013.09.10_133538.zip

Check in the .channels.xml file and you will see that there are <channel ...... > entries for every channel on that site. Just copy the channel lines you want, into the WebGrab++.config.xml (see http://webgrabplus.com/documentation/configuration/howto) Also change the "filename" location in "/home/hts/webgrab/WebGrab++.config.xml", mine looke like this:


<!--?xml version="1.0"?-->
<settings>

  <!-- for detailed info about the settings see http://webgrabplus.com/node/30 -->

  <filename>/home/funky1/webgrab/tv_grab_file.xmltv</filename>
  <mode></mode>
  <postprocess grab="y" run="n">mdb</postprocess>
  <logging>on</logging>
  <retry time-out="5">4</retry>
  <timespan>3</timespan>
  <update>f</update>

  <!-- replace the next dummy channel entry with the channels you want -->
  <!-- see http://webgrabplus.com/node/94 for the available sites/channels -->
  <channel update="i" site="dsmart.com.tr" site_id="8181" xmltv_id="ATV HD2">ATV HD</channel>
  <channel update="i" site="dsmart.com.tr" site_id="8162" xmltv_id="TRT 1 HD">TRT 1 HD</channel>
  <channel update="i" site="dsmart.com.tr" site_id="8182" xmltv_id="A HABER HD">A HABER HD</channel>
  <channel update="i" site="dsmart.com.tr" site_id="8161" xmltv_id="TRT HD">TRT HD</channel>
  <channel update="i" site="dsmart.com.tr" site_id="8361" xmltv_id="Show TV2">Show TV</channel>
  <channel update="i" site="dsmart.com.tr" site_id="8301" xmltv_id="Kanal 7">Kanal 7</channel>
  <channel update="i" site="dsmart.com.tr" site_id="9061" xmltv_id="Samanyolu TV Turkiye">Samanyolu TV Turkiye</channel>
  <channel update="i" site="dsmart.com.tr" site_id="9041" xmltv_id="FOX">FOX</channel>
  <channel update="i" site="dsmart.com.tr" site_id="8741" xmltv_id="NTV Turkiye">NTV Turkiye</channel>
  <channel update="i" site="dsmart.com.tr" site_id="8822" xmltv_id="TRT 2">TRT 2</channel>
  <channel update="i" site="dsmart.com.tr" site_id="9022" xmltv_id="HABERTURK">HABERTURK</channel>
  <channel update="i" site="dsmart.com.tr" site_id="9741" xmltv_id="24">24</channel>
  <channel update="i" site="dsmart.com.tr" site_id="8742" xmltv_id="Cnbc-e">Cnbc-e</channel>
  <channel update="i" site="dsmart.com.tr" site_id="8743" xmltv_id="e2">e2</channel>
</settings>

Now let's get the EPG data (probably best to add this command to cron to populate the EPG data in regular intervals):


mono /home/hts/webgrab/WebGrab+Plus.exe "$(pwd)"

Now get tv_grab_file:

sudo wget -O /usr/bin/tv_grab_file https://tv-grab-file.googlecode.com/files/tv_grab_file sudo chmod +x /usr/bin/tv_grab_file

adjust line 7 in /usr/bin/tv_grab_file so it processes the right file

nano /usr/bin/tv_grab_file

in my case/this example, line 7 of '/usr/bin/tv_grab_file' looks like this now:


cat /home/hts/webgrab/tv_grab_file.xmltv

you need to stop and restart tvheadend

sudo service tvheadend stop sudo service tvheadend start

select from drop down menu on tvheadend webinterface

"XMLTV: tv_grab_file"

that's it :)