[mythtvnz] Help getting remaining channels EPG to list data

[Stephen Worthington]

On Fri, 1 Nov 2013 00:19:28 +1300, you wrote:

>Hi everyone
>
>I'm new to the mailing list and also Mythtv. I've managed to follow
>instructions from the archive and have managed to get some listing data (On
>mythweb I can see listings but these may have occurred when I ran
>tv_grab_nz-py manually and specifying the config xml file rather than
>automatically during my initial test). Unfortunately I'm missing others
>such as TV One and TV 2. Running mythfilldatabase I noticed the followng
>message, "No channels are configured to use grabber".
>
>TV3, Four, Prime, C4, Maori TV, and Sommet Sports are correctly listed and
>can be recorded.
>
>Does anyone have any ideas how I can get the other two channels listed?
>
>Information that will help are:
>
>$ mythfilldatabase
>2013-10-31 23:55:14.517532 C  mythfilldatabase version: fixes/0.25
>[v0.25.2-15-g46cab93] www.mythtv.org
>2013-10-31 23:55:14.517550 C  Qt version: compile: 4.8.1, runtime: 4.8.1
>2013-10-31 23:55:14.517553 N  Enabled verbose msgs:  general
>2013-10-31 23:55:14.517571 N  Setting Log Level to LOG_INFO
>2013-10-31 23:55:14.517615 I  Added logging to the console
>2013-10-31 23:55:14.517620 I  Added database logging to table logging
>2013-10-31 23:55:14.517683 N  Setting up SIGHUP handler
>2013-10-31 23:55:14.517755 N  Using runtime prefix = /usr
>2013-10-31 23:55:14.517765 N  Using configuration directory =
>/home/mythtv/.mythtv
>2013-10-31 23:55:14.517874 I  Assumed character encoding: en_NZ.UTF-8
>2013-10-31 23:55:14.518246 N  Empty LocalHostName.
>2013-10-31 23:55:14.518251 I  Using localhost value of
>surf-System-Product-Name
>2013-10-31 23:55:14.553682 N  Setting QT default locale to en_NZ
>2013-10-31 23:55:14.553739 I  Current locale en_NZ
>2013-10-31 23:55:14.553772 E  No locale defaults file for en_NZ, skipping
>2013-10-31 23:55:14.554133 I  Loading en_us translation for module
>mythfrontend
>2013-10-31 23:55:14.555078 I  Current MythTV Schema Version (DBSchemaVer):
>1299
>2013-10-31 23:55:14.555563 I  Updating source #1 (Freeview) with grabber
>tv_grab_nz-py~
>2013-10-31 23:55:14.555712 I  No channels are configured to use grabber.
>2013-10-31 23:55:14.560976 I  Starting IO manager (write)
>2013-10-31 23:55:14.561049 I  Starting IO manager (read)
>2013-10-31 23:55:14.561107 I  Starting process signal handler
>2013-10-31 23:55:14.561165 I  Starting process manager
>2013-10-31 23:55:14.662279 I  Grabber has capabilities: baseline
>manualconfig preferredmethod cache
>2013-10-31 23:55:14.763147 I  Grabber prefers method: allatonce
>2013-10-31 23:55:14.763611 I  XMLTV config file is:
>/home/mythtv/.mythtv/Freeview.xmltv
>2013-10-31 23:55:15.557019 I  IconData: Updating icons for sourceid: 1
>2013-10-31 23:55:15.557433 N  Unknown xmltv channel identifier:
>c4.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.557559 N  Unknown xmltv channel identifier:
>chinese-tv8.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.557684 N  Unknown xmltv channel identifier:
>choice.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.557807 N  Unknown xmltv channel identifier:
>cue.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.557930 N  Unknown xmltv channel identifier:
>firstlight.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.558058 N  Unknown xmltv channel identifier:
>four.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.558181 N  Unknown xmltv channel identifier:
>maori-tv.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.558303 N  Unknown xmltv channel identifier:
>parliament.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.558426 N  Unknown xmltv channel identifier:
>rnz-concert.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.558549 N  Unknown xmltv channel identifier:
>shopping-channel.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.558672 N  Unknown xmltv channel identifier:
>tv33.freeviewnz.tv - Skipping channel.
>2013-10-31 23:55:15.558680 I  Updated programs: 0 Unchanged programs: 0
>2013-10-31 23:55:15.561012 I  Updating source #3 (Satellite) with grabber
>tv_grab_nz-py
>2013-10-31 23:55:15.561157 I  No channels are configured to use grabber.
>2013-10-31 23:55:15.669489 I  Grabber has capabilities: baseline
>manualconfig preferredmethod cache
>2013-10-31 23:55:15.771135 I  Grabber prefers method: allatonce
>2013-10-31 23:55:15.771913 I  XMLTV config file is:
>/home/mythtv/.mythtv/Satellite.xmltv
>2013-10-31 23:55:16.174869 I  IconData: Updating icons for sourceid: 3
>2013-10-31 23:55:16.175685 I  No programs found in data.
>2013-10-31 23:55:16.177263 N  Data fetching complete.
>2013-10-31 23:55:16.177332 I  Adjusting program database end times.
>2013-10-31 23:55:16.193491 I      0 replacements made
>2013-10-31 23:55:16.193497 I  Marking generic episodes.
>2013-10-31 23:55:16.204694 I      Found 0
>2013-10-31 23:55:16.204740 I  Extending non-unique programids with multiple
>parts.
>2013-10-31 23:55:16.208796 I      Found 0
>2013-10-31 23:55:16.208817 I  Marking repeats.
>2013-10-31 23:55:16.218967 I      Found 0
>2013-10-31 23:55:16.218977 I  Unmarking new episode rebroadcast repeats.
>2013-10-31 23:55:16.219667 I      Found 0
>2013-10-31 23:55:16.308599 I  Marking episode first showings.
>2013-10-31 23:55:16.693539 I      Found 1800
>2013-10-31 23:55:16.693546 I  Marking episode last showings.
>2013-10-31 23:55:17.076161 I      Found 1800
>2013-10-31 23:55:17.077032 I
>===============================================================
>| Attempting to contact the master backend for rescheduling.  |
>| If the master is not running, rescheduling will happen when |
>| the master backend is restarted.                            |
>===============================================================
>2013-10-31 23:55:17.079505 I  MythCoreContext: Connecting to backend
>server: 127.0.0.1:6543 (try 1 of 1)
>2013-10-31 23:55:17.080483 I  Using protocol version 72
>2013-10-31 23:55:17.081746 N  mythfilldatabase run complete.
>2013-10-31 23:55:17.166105 I  DataDirect: Deleting temporary files
>
>-----------------------
>
>$ locate Freeview.xmltv
>/home/mythtv/.mythtv/Freeview.xmltv
>/home/surf/.mythtv/Freeview.xmltv
>
>-----------------------
>
>Contents of Freeview.xmltv is:
>
>channel!basefm.freeviewnz.tv
>channel=c4.freeviewnz.tv
>channel!canterbury-tv.freeviewnz.tv
>channel!channel-north-tv.freeviewnz.tv
>channel=chinese-tv8.freeviewnz.tv
>channel=choice.freeviewnz.tv
>channel=cue.freeviewnz.tv
>channel!dunedin-tv.freeviewnz.tv
>channel=firstlight.freeviewnz.tv
>channel=four.freeviewnz.tv
>channel!info-rotorua.freeviewnz.tv
>channel=maori-tv.freeviewnz.tv
>channel=parliament.freeviewnz.tv
>channel=prime.freeviewnz.tv
>channel=rnz-concert.freeviewnz.tv
>channel!rnz-national.freeviewnz.tv
>channel=sommet-sports.freeviewnz.tv
>channel!tv-hawkes-bay.freeviewnz.tv
>channel!tv-rotorua.freeviewnz.tv
>channel=shopping-channel.freeviewnz.tv
>channel!trackside.freeviewnz.tv
>channel=tv1.freeviewnz.tv
>channel!tv-rotorua.freeviewnz.tv
>channel=tv2.freeviewnz.tv
>channel!tv2-plus1.freeviewnz.tv
>channel!tv2-plus1.freeviewnz.tv
>channel!tv3.freeviewnz.tv
>channel=tv33.freeviewnz.tv
>channel!tv3-plus1.freeviewnz.tv
>channel!tv9.freeviewnz.tv
>channel=tv-central.freeviewnz.tv
>channel=tvnz7.freeviewnz.tv
>channel!tv1-plus1.freeviewnz.tv
>channel!tvsn-shopping-channel.freeviewnz.tv
>channel=u.freeviewnz.tv
>
>-----------------------
>
>   - I use tv_grab_nz-py version 0.2.7 and Mythbuntu 12.04
>   - I can successfully perform a channel scan from the backend
>   - I'm based in Palmerston North
>
>Please let me know.
>
>Siamac

All the corresponding xmltvid values must match for EPG to work.  The
xmltvid in the downloaded EPG data must match an xmltvid in your XMLTV
config file that has an = and both those xmltvid values must match the
xmltvid value specified for a MythTV channel.  It looks like that last
step may be your problem.

To compare your xmltvid values against the EPG data, you can get a
full list of all the xmltvid values in the downloaded EPG by doing
something like this from a bash prompt:

cd ~
mkdir temp
cd temp
wget http://nzepg.org/freeview.xml.gz
gzip -d freeview.xml.gz
grep "channel id" freeview.xml | sed "s/\t<channel id=/channel=/g" |
sed 's/"//g' | sed "s/>//g"

(The last grep line is all one long command on one line)

This is what I get when I do that:

channel=basefm.freeviewnz.tv
channel=c4.freeviewnz.tv
channel=canterbury-tv.freeviewnz.tv
channel=channel-north-tv.freeviewnz.tv
channel=chinese-tv8.freeviewnz.tv
channel=choice.freeviewnz.tv
channel=cue.freeviewnz.tv
channel=dunedin-tv.freeviewnz.tv
channel=firstlight.freeviewnz.tv
channel=four.freeviewnz.tv
channel=info-rotorua.freeviewnz.tv
channel=maori-tv.freeviewnz.tv
channel=parliament.freeviewnz.tv
channel=prime.freeviewnz.tv
channel=rnz-concert.freeviewnz.tv
channel=rnz-national.freeviewnz.tv
channel=sommet-sports.freeviewnz.tv
channel=tv-hawkes-bay.freeviewnz.tv
channel=tv-rotorua.freeviewnz.tv
channel=shopping-channel.freeviewnz.tv
channel=trackside.freeviewnz.tv
channel=tv1.freeviewnz.tv
channel=tv-rotorua.freeviewnz.tv
channel=tv2.freeviewnz.tv
channel=tv2-plus1.freeviewnz.tv
channel=tv2-plus1.freeviewnz.tv
channel=tv3.freeviewnz.tv
channel=tv33.freeviewnz.tv
channel=tv3-plus1.freeviewnz.tv
channel=tv9.freeviewnz.tv
channel=tv-central.freeviewnz.tv
channel=tvnz7.freeviewnz.tv
channel=tv1-plus1.freeviewnz.tv
channel=tvsn-shopping-channel.freeviewnz.tv
channel=u.freeviewnz.tv


So those are all the valid xmltvid values which everything else must
match.

Since you are also in Palmerston North like me, here is a copy of my
current XMLTV config file with all the valid channels from Wharite
from the last time I scanned the multiplexes:

channel=tv1.freeviewnz.tv
channel=tv2.freeviewnz.tv
channel=tv3.freeviewnz.tv
channel=four.freeviewnz.tv
channel=maori-tv.freeviewnz.tv
channel=tv1-plus1.freeviewnz.tv
channel=tv2-plus1.freeviewnz.tv
channel=tv3-plus1.freeviewnz.tv
channel=c4.freeviewnz.tv
channel=prime.freeviewnz.tv
channel=trackside.freeviewnz.tv
channel=choice.freeviewnz.tv
channel=shopping-channel.freeviewnz.tv
channel=parliament.freeviewnz.tv
channel!cue.freeviewnz.tv
channel!te-reo.freeviewnz.tv
channel!shine.freeviewnz.tv
channel=firstlight.freeviewnz.tv
channel=sommet-sports.freeviewnz.tv
channel=tvsn-shopping-channel.freeviewnz.tv
channel=ctv8.freeviewnz.tv
channel=tv9.freeviewnz.tv
channel=tv33.freeviewnz.tv
channel=rnz-national.freeviewnz.tv
channel=rnz-concert.freeviewnz.tv
channel=basefm.freeviewnz.tv
channel!georgefm.freeviewnz.tv
channel!tvnz7.freeviewnz.tv

Note that TVNZ 7 has been off the air for a long time now and should
be set to ! (or deleted) in your XMLTV config file, despite it still
turning up as a channel (with no EPG data) in the downloaded EPG.  But
that will not be causing any trouble.

Once you are sure your XMLTV config file has all the correct values,
run mythtv-setup and check all the xmltvid values for the channels
against the XMLTV config file.