Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4018) - 28 March 2024

Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Build 3020 stopped uploading at midnight two nights running

Topics about the Beta trials up to Build 3043, the last build by Cumulus's founder Steve Loft. It was by this time way out of Beta but Steve wanted to keep it that way until he made a decision on his and Cumulus's future.

Moderator: mcrossley

Locked
User avatar
jpsc
Posts: 179
Joined: Tue 23 Aug 2011 6:06 pm
Weather Station: Davis Vantage Vue, belfryboy USB
Operating System: Raspbian Bullseye
Location: Wye valley, Herefordshire, UK
Contact:

Build 3020 stopped uploading at midnight two nights running

Post by jpsc »

It didn't stop logging but stopped updating all services as you can see here http://www.findu.com/cgi-bin/wxpage.cgi ... ic&last=48

I'm attaching MXDiags and you can see the "Updating CWOP" lines stop before midnight. It would be useful to have a diag for all of the services.

The first time I didn't notice until 9am, the second time I saw soon after it had stopped and tried to kick it off again by disabling and re-enabling CWOP but that didn't work. A restart of CMX worked on both occasions.
You do not have the required permissions to view the files attached to this post.
John Cooper

Cumulus 3 on RPi3 with SSD

http://weather.mountpleasanthouse.uk

Image
courtil
Posts: 124
Joined: Thu 16 Jan 2014 1:31 pm
Weather Station: Vantage PRO2
Operating System: Windows 11
Location: France
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by courtil »

Hello,

Same problem with me ...

More ftp loading 11:55 p.m. to the site and Wunderground, CWOP ......

No warning displayed in MXDIAG

Thank you for your information

Best Regards

Michel said Courtil
OS : Windows 11 Familial
Station Météo : Vantage PRO2
Cumulus MX 3.14.2 b3169
CumulusUtils
http://meteo621.free.fr/
User avatar
steve
Cumulus Author
Posts: 26702
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by steve »

jpsc wrote:It would be useful to have a diag for all of the services.
You can turn on extra logging to the MXdiags files by adding "Logging=1" to the [Station] section of Cumulus.ini. If you do that, it may give some clues as to what's happening. I may have to add some more logging.

Did the ftp uploads to your web site stop at the same time? It may be that it's getting network problems (there are a few errors that I can see) and perhaps it leaves connections open and runs out. I know that there is an issue with ftp hanging on to connections (you're getting errors from the ftp server about too many connections) which I need to look at when I get the time. Do you know if there is something which can monitor the number of sockets that it's using?

It's odd that it happened at midnight, twice. The timer which controls all of the uploads (those which are 'synchronised' to the clock minute, i.e. the interval is a factor of 60) is the same as the one which updates the log files, so it's not that the timer has somehow stopped.
Steve
User avatar
jpsc
Posts: 179
Joined: Tue 23 Aug 2011 6:06 pm
Weather Station: Davis Vantage Vue, belfryboy USB
Operating System: Raspbian Bullseye
Location: Wye valley, Herefordshire, UK
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by jpsc »

Yes, ftp uploads did stop, and also processing of extra files. My isp's ftp server is very pernickety and does not allow more than four connections. Since I have another site running Cumulus 1 also uploading this can lead to being locked out.
John Cooper

Cumulus 3 on RPi3 with SSD

http://weather.mountpleasanthouse.uk

Image
User avatar
jpsc
Posts: 179
Joined: Tue 23 Aug 2011 6:06 pm
Weather Station: Davis Vantage Vue, belfryboy USB
Operating System: Raspbian Bullseye
Location: Wye valley, Herefordshire, UK
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by jpsc »

Stopped again, but this time with more logging
You do not have the required permissions to view the files attached to this post.
John Cooper

Cumulus 3 on RPi3 with SSD

http://weather.mountpleasanthouse.uk

Image
courtil
Posts: 124
Joined: Thu 16 Jan 2014 1:31 pm
Weather Station: Vantage PRO2
Operating System: Windows 11
Location: France
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by courtil »

Hello everyone,

Transmission ftp stop at 11:55 p.m.

APRS / CWOP link is maintained

The software continues to run and save data locally.

Best Regards

Michel
You do not have the required permissions to view the files attached to this post.
OS : Windows 11 Familial
Station Météo : Vantage PRO2
Cumulus MX 3.14.2 b3169
CumulusUtils
http://meteo621.free.fr/
User avatar
steve
Cumulus Author
Posts: 26702
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by steve »

jpsc wrote:Stopped again, but this time with more logging
This is going to have to be a process of elimination, because I have no idea what the cause could be, or why it's only affecting you (or possibly two of you).

Do you have any 'external programs' configured?

Is it successfully creating the daily backup files? Does your backup/daily directory exist, and if so, what is in it? Anything unusual about it - permissions etc? What directories are in your backup directory?
Steve
User avatar
steve
Cumulus Author
Posts: 26702
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by steve »

courtil wrote:APRS / CWOP link is maintained
Your CWOP uploads aren't affected because of the interval you're using.

You have errors in your data due to running with ini files from Cumulus 1 without changing the commas to decimal points:

2015-02-23 00:00:00.377 Creating NOAA monthly report for dimanche 22 février 2015
Error at line 397 of dayfile.txt: La valeur était trop grande ou trop petite pour un Int32.
Please edit the file to correct the error

Do you have Cumulus configured to upload the NOAA report automatically?

Is it creating the daily backup files correctly?
Steve
User avatar
jpsc
Posts: 179
Joined: Tue 23 Aug 2011 6:06 pm
Weather Station: Davis Vantage Vue, belfryboy USB
Operating System: Raspbian Bullseye
Location: Wye valley, Herefordshire, UK
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by jpsc »

Do you have any 'external programs' configured?
No
Is it successfully creating the daily backup files? Does your backup/daily directory exist, and if so, what is in it? Anything unusual about it - permissions etc? What directories are in your backup directory?
A very good question. Since I copied the backup directory directly from a (non Cumulus) backup of the previous running setup, before it ate its SD card it might well have a different provenance. I can't check now but I'll get to it before midnight.
John Cooper

Cumulus 3 on RPi3 with SSD

http://weather.mountpleasanthouse.uk

Image
User avatar
jpsc
Posts: 179
Joined: Tue 23 Aug 2011 6:06 pm
Weather Station: Davis Vantage Vue, belfryboy USB
Operating System: Raspbian Bullseye
Location: Wye valley, Herefordshire, UK
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by jpsc »

Is it creating the daily backup files correctly?
No, it's writing them OK

Code: Select all

pi@raspberrypi ~ $ ls -hls /mnt/thumb/CMX/backup
total 28K
4.0K drwxr-xr-x 2 root root 4.0K Feb 19 22:45 20150219224557
4.0K drwxr-xr-x 2 root root 4.0K Feb 20 18:33 20150220183300
4.0K drwxr-xr-x 2 root root 4.0K Feb 20 22:16 20150220221620
4.0K drwxr-xr-x 2 root root 4.0K Feb 21 09:05 20150221090557
4.0K drwxr-xr-x 2 root root 4.0K Feb 22 00:13 20150222001335
4.0K drwxr-xr-x 2 root root 4.0K Feb 22 10:00 20150222100037
4.0K drwxr-xr-x 2 root root 4.0K Feb 23 00:47 20150223004707
although the directory is owned by pi

Code: Select all

pi@raspberrypi ~ $ ls -hls /mnt/thumb/CMX
total 5.5M
4.0K -rwxr-xr-x 1 pi pi  645 Feb 19 22:45 acknowledgements.txt
 36K -rwxr-xr-x 1 pi pi  35K Feb 19 22:45 Alchemy.dll
4.0K drwxr-xr-x 9 pi pi 4.0K Feb 23 00:47 backup
 20K -rwxrwxrwx 1 pi pi  20K Feb 23 00:46 Cumulus.ini
but I would think that would be the same for everything
John Cooper

Cumulus 3 on RPi3 with SSD

http://weather.mountpleasanthouse.uk

Image
User avatar
steve
Cumulus Author
Posts: 26702
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by steve »

Those are the start up backup folders. There should be a folder in the backup folder called 'daily', which where the daily backup folders go. The lack of the daily folder will cause the system routines to fail silently and terminate the periodic actions at that point. If you recreate the folder things should start working again. I have changed the code to check for the existence of the folder in case it has been deleted accidentally, and not attempt the daily backup.
Steve
User avatar
jpsc
Posts: 179
Joined: Tue 23 Aug 2011 6:06 pm
Weather Station: Davis Vantage Vue, belfryboy USB
Operating System: Raspbian Bullseye
Location: Wye valley, Herefordshire, UK
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by jpsc »

Ah, I missed daily - because I had excluded backup from my backup to PC strategy due to errors caused.

Sorry to cause a false alarm.
John Cooper

Cumulus 3 on RPi3 with SSD

http://weather.mountpleasanthouse.uk

Image
courtil
Posts: 124
Joined: Thu 16 Jan 2014 1:31 pm
Weather Station: Vantage PRO2
Operating System: Windows 11
Location: France
Contact:

Re: Build 3020 stopped uploading at midnight two nights runn

Post by courtil »

Hello everyone,

Downloading to external sites operate, no stop at Midnight !!!

Missing in Backup. the daily repertoire.

Loading the file NOAA is good !!

Error in file: dayfile.txt

Thank you to Laurent and Steve for their information.

Best Regards

Michel said Courtil
OS : Windows 11 Familial
Station Météo : Vantage PRO2
Cumulus MX 3.14.2 b3169
CumulusUtils
http://meteo621.free.fr/
Locked