Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4017) - 17 March 2024

Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Spike Removal - Outdoor Temp

Post Reply
dids04
Posts: 12
Joined: Sat 25 Feb 2012 12:01 am
Weather Station: Lacrosse ws2306
Operating System: Windows 7
Location: Melbourne
Contact:

Spike Removal - Outdoor Temp

Post by dids04 »

Hi There.

Had a spike in my readings overnight yet cumulus still recorded this even though I had the spike setting to 15C


Heavyweather stats as follows:

7/3/12 2.00am 16.7c
7/3/12 2.20am 16.5c
7/3/12 2.40am -7.0c
7/3/12 3.00am 15.9c
7/3/12 3.20am 15.8c

My understanding was the spike reading would not be counted if it fell outside my spike range (i.e 15c)

Given it dropped 23.5c, why has this not worked ??

I presume it has nothing to do with the positive/negative temperate and somehow assumed a drop of only 9.5c (16.5 - 7.0)


Any help appreciated.
User avatar
steve
Cumulus Author
Posts: 26702
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Spike Removal - Outdoor Temp

Post by steve »

The most likely explanation would be that it didn't change 'suddenly', i.e. in one step. If you zip up the diags folder and attach it, I'll see if I can see anything.
Steve
Matt.j5b
Posts: 512
Joined: Mon 28 Nov 2011 2:13 am
Weather Station: Davis VP2/ WLL with DFARS
Operating System: RPi Raspbian (Buster)
Location: Ferny Grove, Brisbane, Australia
Contact:

Re: Spike Removal - Outdoor Temp

Post by Matt.j5b »

I do sometimes get spikes, but the spike removal does work with when you download from the logger as I found out the hard way here: https://cumulus.hosiene.co.uk/viewtopic.php?f=15&t=6846 . Did you download from the logger, you gave the figures from the logger (heavyweather history file). I understand it only works on live data.
Regards, Matt of Brisbane, Australia
Ferny Grove Weather
Image
User avatar
steve
Cumulus Author
Posts: 26702
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Spike Removal - Outdoor Temp

Post by steve »

Matt.j5b wrote:I understand it only works on live data.
This is true, as I've mentioned many times in the past in the forum. But the help doesn't make this clear; I'll correct that.

One of the reasons that spike removal doesn't operate on logger data is that it's not practical to apply the same spike removal values to data that is several minutes apart (up to an hour for some people). Historically, the spike removal was for Fine Offset stations only, and data from the logger doesn't seem to suffer from the same corruption that live data does.
Steve
User avatar
mcrossley
Posts: 12689
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Spike Removal - Outdoor Temp

Post by mcrossley »

steve wrote:... and data from the logger doesn't seem to suffer from the same corruption that live data does.
Well if it is only logging 1 in 25 readings say for a 20 minute log interval, the chances of logging a duff value are reduced by the same factor.
Matt.j5b
Posts: 512
Joined: Mon 28 Nov 2011 2:13 am
Weather Station: Davis VP2/ WLL with DFARS
Operating System: RPi Raspbian (Buster)
Location: Ferny Grove, Brisbane, Australia
Contact:

Re: Spike Removal - Outdoor Temp

Post by Matt.j5b »

steve wrote:data from the logger doesn't seem to suffer from the same corruption that live data does.
I run off the logger at 5 minute interval a lot of the time and don't get many spikes because there is less chance of it happening rather than when its running live. I am happy with that, and what you say makes sense.

I just wondering whether dids04 got it from the logger because logger figures from heavy weather were quoted in the first post.
Regards, Matt of Brisbane, Australia
Ferny Grove Weather
Image
dids04
Posts: 12
Joined: Sat 25 Feb 2012 12:01 am
Weather Station: Lacrosse ws2306
Operating System: Windows 7
Location: Melbourne
Contact:

Re: Spike Removal - Outdoor Temp

Post by dids04 »

Thanks for the responses all

Steve, I have attached a copy of the Diags folder but as you suggested, data was obtained from the logger.

I don't run live but rather on a 20 minute setting, which I would have thought would make spikes quite rare.

This is the 2nd low temp spike I've had since setting up a few weeks ago.


Thanks
You do not have the required permissions to view the files attached to this post.
User avatar
steve
Cumulus Author
Posts: 26702
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Spike Removal - Outdoor Temp

Post by steve »

dids04 wrote:data was obtained from the logger.
Yes, so as explained, the spike removal facility doesn't apply. Maybe one day Cumulus will have more sophisticated erroneous data removal that also works for logger data.
Steve
User avatar
yv1hx
Posts: 223
Joined: Mon 05 Apr 2010 10:40 pm
Weather Station: No station yet ...
Operating System: Win XP Professional
Location: Some point in the Earth

Re: Spike Removal - Outdoor Temp

Post by yv1hx »

steve wrote:
dids04 wrote:data was obtained from the logger.
Yes, so as explained, the spike removal facility doesn't apply. Maybe one day Cumulus will have more sophisticated erroneous data removal that also works for logger data.
I hope so :)

Some days ago, while I was in a job travel my Weather Desktop hang out for several days, When I return to home and reactivated the PC, Cumulus effectively downloads the data logger data, but plagued with the well-know spikes, ruining my data ...uggg... :evil: By the way, my data logger is preset for 1 minute readings... :bash:
Marco
Post Reply