Historic data discrepancies

daj · **Posted:** Fri Sep 11, 2009 9:55 pm

The Historic data is mostly inaccurate for me.

The front screen of current readings is spot on except for rain for this year, which is showing zero. Should be 459mm. The rainfall figure should have been fully calculated as the station has been running since before 2009.

Most of the data on the right panel is wrong sadly.
Some of the times seem to repeat..Today and Yesterdays highest windgust were at the exact same time (which I guess is possible). Several Highs and Lows show a time of 1:06 (including zero figures as I have had no rain today or yesterday)

I attach an example of the right panel, marked up

All good stuff -- that's what beta testing is all about

Attachment:

TempExample.png

Attachment:

PressExample.png

steve · **Posted:** Fri Sep 11, 2009 10:08 pm

For historical data, some of the highs and lows will be different because it's only going by what's in the monthly data logs, so daily highs and lows that are in dayfile.txt but not in the monthly log won't be taken into account. That doesn't really account for that high temp though, you would expect a temp close to 28.9 to be in the log. Could you have a look in the editor and see what's in there around that time?

steve · **Posted:** Fri Sep 11, 2009 10:10 pm

It looks as though it's not looking back further than August.

daj · **Posted:** Fri Sep 11, 2009 10:24 pm

Ah ha, there is a massive gap in my data looking at it in the Editor

03/09/2008 --> 19/09/2008 19:00

next entry is 11 months later .. 14/08/2009 10:38

That would explain why many of the figures are wrong onscreen as they are not in the DB. Somehow it was not all imported

steve · **Posted:** Fri Sep 11, 2009 10:31 pm

I suspect you were getting errors inserting the data into the database. That slows it down a lot, and probably explains why it took so long to import. I should really produce a log of the import process...

Bruiser · **Posted:** Fri Sep 11, 2009 10:35 pm

I have those discrepencies also. For whatever reason, when I imprt the data, iget an"Importing" box but the progress bar never appears.....Just a constant importing is all that displays..

risiss · **Posted:** Fri Sep 11, 2009 11:41 pm

time error

as i took the screenshot,it was 19:41 hrs here in quebec

steve · **Posted:** Fri Sep 11, 2009 11:48 pm

risiss wrote:

time error

as i took the screenshot,it was 19:41 hrs here in quebec

Ah - looks like it's displaying UTC. I thought I'd converted all the times...

steve · **Posted:** Fri Sep 11, 2009 11:51 pm

Yes, I'm definitely converting the time, otherwise it would be wrong for me anyway, as we're currently UTC+1.

Do you have the timezone set correctly on your PC?

risiss · **Posted:** Fri Sep 11, 2009 11:57 pm

yepp,its done and its set at gmt -05:00

steve · **Posted:** Sat Sep 12, 2009 12:02 am

risiss wrote:

yepp,its done and its set at gmt -05:00

It must be an error processing the data from the database...

bruce45 · **Posted:** Sat Sep 12, 2009 5:40 pm

Bruiser wrote:

I have those discrepencies also. For whatever reason, when I imprt the data, iget an"Importing" box but the progress bar never appears.....Just a constant importing is all that displays..

i get the same problem. when i check with the data editor i am missing date from 01/01/2009 till 31/8/2009. is there any way of forcing it to load or importing it by editing the file.

daj · **Posted:** Sat Sep 12, 2009 5:45 pm

I'm sure Steve will come along with a fix so we do not need to force the data in. I checked the SQL tables themselves, and they are also missing the data (I knew they would be but just in case...)

steve · **Posted:** Sat Sep 12, 2009 6:48 pm

The inserting of the data into the database is failing after the first few entries, claming a duplicate key - I use date and time as the primary key, so I know that's not true. There's clearly something funny going on that wasn't happening before when I was testing importing the data, but I don't know what it is. I have pretty much decided to revert to SQLite for the database, so I think I will stop trying to understand this, do the necessary changes to go back to SQLite, and do the import using raw SQL which is much quicker, and more importantly, works.

	It is currently Fri May 24, 2013 11:57 am
Please click here before posting. Help me to help you!
Useful Links: Cumulus FAQ • Enhancement requests • Wiki (documentation)
Please put your approximate location into your profile
Add your web site to the Cumulus user map
Vantage Pro2 users with firmware 3.00 should upgrade to fw 3.12 and Cumulus 1.9.4
Latest Cumulus release v1.9.3 (build 1059) - Feb 09 2013 Latest Cumulus beta v1.9.4 build 1077 - May 23 2013 --> Latest Cumulus Realtime v1.0.0.5 - Sep 05 2009

Sandaysoft

Historic data discrepancies

Who is online