[mythtvnz] nzepg freeview.xml truncated

[Nick Rout]

On Sun, Oct 7, 2012 at 6:24 PM, Paul Kendall <pkendall64 at gmail.com> wrote:
> On Sun, Oct 7, 2012 at 6:02 PM, Curtis Walker <sultanoswing at gmail.com> wrote:
>> On 7 October 2012 17:59, Nick Rout <nick.rout at gmail.com> wrote:
>>> On Sun, Oct 7, 2012 at 5:55 PM, Curtis Walker <sultanoswing at gmail.com> wrote:
>>>> On 7 October 2012 17:38, Stephen Worthington <stephen_agent at jsw.gen.nz> wrote:
>>>>> On Sun, 7 Oct 2012 16:29:29 +1300, you wrote:
>>>>>
>>>>>>On Sun, Oct 7, 2012 at 3:49 PM, Paul Kendall <pkendall64 at gmail.com> wrote:
>>>>>>> I have noticed today that the EPG from nzepg.org is truncated.
>>>>>>> The gzipped file is gzipped ok, but the original file is truncated and doesn't
>>>>>>> process properly by mythfilldatabase.
>>>>>>>
>>>>>>> So, there may be a problem with the script that generated the xml or it may
>>>>>>> just be a one-off and be fixed tomorrow.
>>>>>>>
>>>>>>> Just letting you know.
>>>>>>
>>>>>>Mine updated via a mythfilldatabase auto run at 2.30 this morning and
>>>>>>reports success with 7 days data. When did you download the file?
>>>>>
>>>>> Mine runs at 15:10 and failed:
>>>>>
>>>>> wget of Freeview EPG completed OK
>>>>> -:32581.9: Premature end of data in tag desc line 32581
>>>>>                 <desc>
>>>>>                       ^
>>>>> -:32581.9: Premature end of data in tag programme line 32579
>>>>>                 <desc>
>>>>>                       ^
>>>>> -:32581.9: Premature end of data in tag tv line 3
>>>>>                 <desc>
>>>>>                       ^
>>>>>
>>>>> and:
>>>>>
>>>>> 2012-10-07 15:11:11.857994 I  Updating source #1 (FreeviewHD) with
>>>>> grabber tv_grab_nz_FreeviewHD-py
>>>>> 2012-10-07 15:11:11.858428 I  Found 25 channels for source 1 which use
>>>>> grabber
>>>>> 2012-10-07 15:11:11.961462 I  Grabber has capabilities: baseline
>>>>> manualconfig preferredmethod cache
>>>>> 2012-10-07 15:11:12.111861 I  Grabber prefers method: allatonce
>>>>> 2012-10-07 15:11:12.112772 I  XMLTV config file is:
>>>>> /home/stephen/.mythtv/FreeviewHD.xmltv
>>>>> 2012-10-07 15:11:12.563964 E  FillData: xmltv returned error code 1
>>>>> 2012-10-07 15:11:12.564528 E  Error in 1:1: unexpected end of file
>>>>>
>>>>> _______________________________________________
>>>>> mythtvnz mailing list
>>>>> mythtvnz at lists.linuxnut.co.nz
>>>>> http://lists.ourshack.com/mailman/listinfo/mythtvnz
>>>>> Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/
>>>>
>>>> Thank goodness - I thought it was just me!
>>>>
>>>> Running mythfilldatabase in a terminal, I get (with nz_tv-grab.py
>>>> setup and working until yesterday):
>>>>
>>>> FillData: XMLTV grabber returned error code 1
>>>> 2012-10-07 17:51:40.021977 E  Error in 1:1: unexpected end of file
>>>> 2012-10-07 17:51:40.022065 I  IconData: Updating icons for sourceid: 3
>>>> 2012-10-07 17:51:40.022960 C  Received Real-time signal 0: Code -6,
>>>> PID 4945, UID 1000, Value 0xffffffff8118b1ec
>>>> 2012-10-07 17:51:40.023008 I  No programs found in data.
>>>> 2012-10-07 17:51:40.024242 E  Failed to fetch some program info
>>>>
>>>> Running the py script manually, I get:
>>>>
>>>> tv_grab_nz-py --configure --config-file ~/.mythtv/FreeviewHD.xmltv
>>>> INFO - Downloading data from nzepg.org...
>>>> INFO - Done
>>>> INFO - Parsing channel data...
>>>> Traceback (most recent call last):
>>>>   File "/usr/bin/tv_grab_nz-py", line 210, in <module>
>>>>     doc = ElementTree.parse(StringIO(text)).getroot()
>>>>   File "<string>", line 62, in parse
>>>>   File "<string>", line 38, in parse
>>>> ElementTree.ParseError: no element found: line 32581, column 8
>>>>
>>>
>>> All fine here, just downloaded the freeview.xml.gz file and it unzips
>>> and seems to contain all relevant data.
>>>
>>> Also as a double check ran mythfilldatabase on the backend and it
>>> completed fine.
>>>
>>> _______________________________________________
>>> mythtvnz mailing list
>>> mythtvnz at lists.linuxnut.co.nz
>>> http://lists.ourshack.com/mailman/listinfo/mythtvnz
>>> Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/
>>
>> Curse you, Nick! :)
>>
>> _______________________________________________
>> mythtvnz mailing list
>> mythtvnz at lists.linuxnut.co.nz
>> http://lists.ourshack.com/mailman/listinfo/mythtvnz
>> Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/
>
> I just ran it now 18:23 and it fails.
> try wget http://nzepg.org/freeview.xml.gz
> zcat freeview.xml.gz | tail
> and you'll see it's truncated.

I stand corrected, mine stops here:

<programme channel="tv1.freeviewnz.tv" start="20121014041000 +1300"
stop="20121014043000 +1300">
		<title>Winning Venezuela</title>
		<desc>

The freeview.xml.gz file is 181871 bytes long.

And my mythweb status page tells me (despite the manual run of
mythfilldatabase seeming to finish without error) that the last run
ended in error 1.

I suspect the person whose system generates of the downloadable data
file will fix it soon. You all have data for a while yet, panic when
it gets down to 1 or 2 days :)