Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4018) - 28 March 2024

Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Question regarding custom processed csv logging

Discussion specific to Davis weather stations
Post Reply
sho23
Posts: 2
Joined: Thu 30 Jun 2016 4:06 pm
Weather Station: Davis VP2
Operating System: Windows 7
Location: Merced

Question regarding custom processed csv logging

Post by sho23 »

Hi again, I posted this question on Wx forum and was redirected here.

So our hardware setup is the following:

Davis Vantage Pro 2 Cabled with the solar sensors, day aspirated fan, and the IP logger. We're using a virtual desktop for the software location and it is on all the time.

Based on my reading here that the cable may be prone to disturbance, we also replaced the cable between the ISS and Console with one that is much more robust. Since then, we ran Weatherlink for logging and generating a local htm that we then push out to public (nothing setup via ftp or wu or cwop).

Since then the database have had some hic-ups and while we managed to solve it, it was not acceptable. We wanted to run VVP but our IT department would not have it. We finally took the jump and are now running Cumulus, with custom csv generated for our logging purposes.

Questions:

1. Can we create an appending webtag processor for the day using the realtime interval?
I've utilized the webtags to generate a custom report out, but it is not a logger, it simply replace the values. I've looked at realtime.txt and the daily and alltime, but those are not the tags we wanted, and there are no headers for them. Optimally, I want Cumulus to generate the custom report I've specified (with headers) and log it, appends to it everytime there's a new data at specified time frame, then when the day is over, backs it up in the same way it does to the other txt files.

We currently have 49 tags that we care about, and that number may change at anytime. The reason why we need headers is that we want to feed the csv generated to a database, and it utilizes the header to identify what to put where.

2. Is there an issue if I put the davis logger interval at 15 minutes, and Cumulus at 1 minute? I can see varying time interval if I close cumulus for 15 mins or longer, then it'll attempt to backfill data using the logger, and thus having an oddly spaced graph. Besides that, anything more crucial that I'm missing?

I understand that there are a lot of rage with the Davis IP logger, and if I was to redo the station, I'd definitely have gone to the serial one. Still, I have to live with it for now. I've heard from the local NWS guys that on a few of their sites, they simply skip the davis console altogether and utilize a 3rd party controller/logger. If this keeps failing I may have to search for something like that as well.
User avatar
steve
Cumulus Author
Posts: 26702
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Question regarding custom processed csv logging

Post by steve »

There isn't a facility in Cumulus for creating a custom log file, just custom 'snapshot' files. So you would have to write something yourself to do the appending - or perhaps adapt one of the existing third-party scripts (have a search on the forum and/or wiki for 'realtime log', for example).

Cumulus MX has a facility for updating a MySQL database of your own format each time it writes a log file entry. That may or may not be of any use to you.

The problem you will hit if you set the Davis logger to 15 minutes and Cumulus to 1 minute, is the one described the FAQ - http://wiki.sandaysoft.com/a/FAQ#Cumulu ... t_start_up
Steve
sho23
Posts: 2
Joined: Thu 30 Jun 2016 4:06 pm
Weather Station: Davis VP2
Operating System: Windows 7
Location: Merced

Re: Question regarding custom processed csv logging

Post by sho23 »

Woah it's the creator. Can i have a signature please? :clap: :mrgreen: :D

Okay, thank you for confirming my suspicion. I looked around the readme and help files and wasn't really finding anything on it. I'll take a look at Cumulus MX and see what else I can come up with.
Post Reply