Before doing any of this, in your browser while viewing you tvh webpage, bottom right there is a small up-arrow, hit it so you can view the log in real time.
Configuration, DVB Inputs, Network.
Mark your network name, hit edit button, view level, advanced.
SAT>IP source number: 1
Hit save.
Configuration, General, SAT>IP Server.
RTSP Port: 554
Number of tuners: 1
All other settings 0.
You MIGHT have to reboot both the sat>ip server and client and in that order for it to be picked up correctly.
Now try scanning for channels and make sure you test just one FTA channel or something simple, when you have that working you can do more and additional networks different tuners decoding or whatever you want to do. But just to get it working and trying to figure out whats wrong try to keep it simple.
I kind of suck at troubleshooting and is *nix illiterate so I really dont know more than this, and in my small experience with the sat>ip server part of tvh I think it needs a bit of work to be considered anywhere near stable.