Data catchup?

daj · **Posted:** Fri Sep 11, 2009 8:35 pm

Can you confirm...if I run Cumulus 2 for a while, then close it down and start up v1, will v1 catchup on all the data it missied?

steve · **Posted:** Fri Sep 11, 2009 8:40 pm

Yes, neither of them do anything to the station that would affect the other one when it starts up, so it would just be the same as if you hadn't been running it for a while.

daj · **Posted:** Fri Sep 11, 2009 8:50 pm

great

Installing it now -- reboot for Installer 4.5 needed. SQL 2008 Express installing, but it's in no rush to do it!

I had just opened a beer when I thought I would check the forum, and there it was...Cumulus 2

steve · **Posted:** Fri Sep 11, 2009 9:01 pm

Yes, SQL Server takes a while to install. I was originally using SQLite, but there were some performance issues with the way it integrates with .NET and the Telerik data grid, possibly down to the way I was using it, so I decided to give Microsoft's freebie a try. Eventually it may be possible to give the user a completely free choice over which DBMS to use.

daj · **Posted:** Fri Sep 11, 2009 9:04 pm

Importing a years worth of data. @ 80% just now

(Why do I feel the need to give a running commentary?!)

Express is a beefy product in itself, but I can see why you would go for it. As you say, long term maybe a choice of DBMS or at least ask if they already have a MS SQL server to use (but that is for the future)

daj · **Posted:** Fri Sep 11, 2009 9:05 pm

Now replaying history records by the looks of it

daj · **Posted:** Fri Sep 11, 2009 9:09 pm

Woo Hoooo

Attachment:

Cumulus2-DAJ.png

steve · **Posted:** Fri Sep 11, 2009 9:12 pm

daj wrote:

Importing a years worth of data. @ 80% just now

I did have that running faster, in 'raw' SQL, but I've now gone for the 'type safe' approach, which is a bit slower. I can revert to SQL if it's felt that it takes too long.

How long did it take to import your data?

steve · **Posted:** Fri Sep 11, 2009 9:15 pm

Excellent! I notice some of the fields aren't quite wide enough on your system - I'll fix that.

daj · **Posted:** Fri Sep 11, 2009 9:28 pm

steve wrote:

daj wrote:

How long did it take to import your data?

About 8 minutes

Not sure how many rows it has created -- Using the Editor window is very slow. Paging up and down takes maybe 4 seconds to move each page. I notice that records at the top are missing a lot of data (highest Temp outside, Lowest outside, etc.) but are in the data at the end. Maybe this info was not logged in last years release?

Paging up and down in the editor seems to consume huge amounts of memory. Cumulus currently running at 314Mb and it increases as you move up and down the editor.

I will start comparing front screen data between the two and report back

Nice job so far

steve · **Posted:** Fri Sep 11, 2009 9:38 pm

daj wrote:

About 8 minutes

Oh dear. The original code took 20 seconds to import three years worth.

Quote:

Not sure how many rows it has created -- Using the Editor window is very slow. Paging up and down takes maybe 4 seconds to move each page.

Yes, this has been the thing that has taken up most of time in the last week or so, trying to get that to work better. Telerik say they are going to improve the grid performance in their next release, but I think I will also have to think of a way to improve too; maybe by subsetting the data that is displayed.

Quote:

I notice that records at the top are missing a lot of data (highest Temp outside, Lowest outside, etc.) but are in the data at the end. Maybe this info was not logged in last years release?

Yes, many of the fields weren't stored back then, and even the latest version of Cumulus 1 doesn't store anywhere near the set that Cumulus 2 does.

Quote:

Paging up and down in the editor seems to consume huge amounts of memory. Cumulus currently running at 314Mb and it increases as you move up and down the editor.

Yes... I was hoping this was just the way the garbage collection works, as I have 8 GB of RAM. I'd hoped it would use less if less was available. How much RAM do you have? I think I'll have to get back to Telerik about this.

Quote:

Nice job so far

Thanks

daj · **Posted:** Fri Sep 11, 2009 9:48 pm

steve wrote:

Yes... I was hoping this was just the way the garbage collection works, as I have 8 GB of RAM. I'd hoped it would use less if less was available. How much RAM do you have? I think I'll have to get back to Telerik about this.

2Gb

steve · **Posted:** Fri Sep 11, 2009 9:56 pm

daj wrote:

2Gb

So I suppose it could just be grabbing it because it's there. I guess it's not really a problem until it starts affecting the rest of your system...

daj · **Posted:** Fri Sep 11, 2009 10:04 pm

I don't run anything else on that PC, but I will keep an eye on it

Super-T · **Posted:** Sat Sep 12, 2009 2:44 am

Cumulus2 install hung up initially because it needed the online download component to get the windows installer & SQL. Not a problem though, I just installed the web component manually and stopped and restarted the install and all was well.
Import data was 3.5 minutes for just over a years worth.
I'll be running C2 intermittently as I need to update websites from C1
Certainly looks good so far.

	It is currently Wed May 22, 2013 8:36 pm
Please click here before posting. Help me to help you!
Useful Links: Cumulus FAQ • Enhancement requests • Wiki (documentation)
Please put your approximate location into your profile
Add your web site to the Cumulus user map
Vantage Pro2 users with firmware 3.00 should upgrade to fw 3.12 and Cumulus 1.9.4
Latest Cumulus release v1.9.3 (build 1059) - Feb 09 2013 Latest Cumulus beta v1.9.4 build 1076 - May 12 2013 --> Latest Cumulus Realtime v1.0.0.5 - Sep 05 2009

Sandaysoft

Data catchup?

Who is online