Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4018) - 28 March 2024

Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Timeouts after Linux upgrades

Topics about the Beta trials up to Build 3043, the last build by Cumulus's founder Steve Loft. It was by this time way out of Beta but Steve wanted to keep it that way until he made a decision on his and Cumulus's future.

Moderator: mcrossley

Locked
freddie
Posts: 2435
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Timeouts after Linux upgrades

Post by freddie »

I have just upgraded from Ubuntu 16.04 to 17.04. I am now seeing loads of timeouts and issues with HTTP transfers. Excerpt from MXDiags file:

Code: Select all

2017-05-22 14:00:00.226 http://api.weathercloud.net/v01/set?wid=7307801638b50821&key=<key>&tempin=203&temp=191&chill=191&dew=121&heat=191&humin=55&hum=64&wspd=4&wspdhi=63&wspdavg=27&wdir=202&wdiravg=202&bar=10131&rain=0&rainrate=0&time=1400&date=20170522&type=291&ver=3.0.0
2017-05-22 14:00:00.227 http://www.pwsweather.com/pwsupdate/pwsupdate.php?ID=ICHURCHS19&PASSWORD=****************&dateutc=2017-05-22+14%3A00%3A00&winddir=202&windspeedmph=6.0&windgustmph=14.0&humidity=64&tempf=66.3&rainin=0.00&dailyrainin=0.00&baromin=29.919&dewptf=53.8&softwaretype=Cumulus%20v3.0.0&action=updateraw
2017-05-22 14:00:00.227 http://wow.metoffice.gov.uk/automaticreading?siteid=237a8f1b-47d3-e611-9400-0003ff5991ab&siteAuthenticationKey=******&dateutc=2017-05-22+14%3A00%3A00&winddir=202&windspeedmph=6.0&windgustmph=14.0&humidity=64&tempf=66.3&rainin=0.00&dailyrainin=0.00&baromin=29.919&dewptf=53.8&softwaretype=Cumulus%20v3.0.0&action=updateraw
2017-05-22 14:00:00.256 Starting Twitter update
2017-05-22 14:00:00.271 Using twitter.txt file
2017-05-22 14:00:00.272 Updating Twitter: 1400 UTC: Wind SSW 5.2 kts. Temp 19.1 C, Dew pt 12.1 C. Bar 1013.07 hPa, Falling slowly. Rain last hour 0.0 mm #ukweather
2017-05-22 14:00:00.291 WeatherCloud update: An error occurred while sending the request.
2017-05-22 14:00:00.293 PWS update: An error occurred while sending the request.
2017-05-22 14:00:00.574 WOW Response: 429: The custom error module does not recognize this error.
2017-05-22 14:00:01.286 Status returned: (866654885017776128)[FishpoolFarm Weather]FishpoolFarm Weather, 1400 UTC: Wind SSW 5.2 kts. Temp 19.1 C, Dew pt 12.1 C. Bar 1013.07 hPa, Falling slowly. Rain last hour 0.0 mm #ukweather, 22/05/2017 14:00:00
2017-05-22 14:00:14.956 Updating CWOP
2017-05-22 14:00:17.179 Error uploading web/today.htm to /var/www/weather/today.htm : Timed out trying to connect!
2017-05-22 14:00:27.140 Sending BARREAD
2017-05-22 14:00:27.441 0A-0D-4F-4B-0A-0D-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
2017-05-22 14:00:27.943 Sending command LPS 2 1 - pass 1
2017-05-22 14:00:28.444 Wait for ACK
2017-05-22 14:00:28.444 Sending command LPS 2 1 - pass 2
2017-05-22 14:00:28.945 Wait for ACK
2017-05-22 14:00:28.945 ACK received
2017-05-22 14:00:28.945 Loop2: 4C-4F-4F-EC-01-FF-7F-DB-74-AD-02-37-98-02-08-FF-F6-00-3D-00-1F-00-0C-00-CA-00-FF-7F-FF-7F-35-00-FF-3F-FF-42-00-42-00-FF-00-00-00-FF-FF-7F-00-00-FF-FF-00-00-00-00-00-00-00-00-00-00-02-00-00-17-00-E5-70-E5-70-E2-74-FF-05-08-15-06-0C-13-03-37-04-00-00-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-0A-0D-C4-F4
2017-05-22 14:00:28.946 10-min gust from loop2: 10.4
2017-05-22 14:00:29.046 Sending command LOOP 20 - pass 1
2017-05-22 14:00:29.547 Wait for ACK
2017-05-22 14:00:29.547 ACK received
2017-05-22 14:00:34.328 Error uploading web/record.htm to /var/www/weather/record.htm : Timed out trying to connect!
2017-05-22 14:00:51.180 Error uploading web/gauges.htm to /var/www/weather/gauges.htm : Timed out trying to connect!
Any ideas?
Freddie
Image
User avatar
steve
Cumulus Author
Posts: 26701
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Timeouts after Linux upgrades

Post by steve »

As it's affecting both http and ftp, the issue is apparently at a lower level, so it's unlikely you'll get any useful information out of Cumulus. I think you'll have to look for answers in Ubuntu. Googling suggests there have been a number of internet related issues with 17.04, DNS lookups in particular.
Steve
freddie
Posts: 2435
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: Timeouts after Linux upgrades

Post by freddie »

Okay thank you Steve. I will get Googling!
Freddie
Image
freddie
Posts: 2435
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: Timeouts after Linux upgrades

Post by freddie »

As it's affecting both http and ftp, the issue is apparently at a lower level
I have resolved the DNS lookup problems which were contributing to about 50% of the timeouts. From your quote above, I am assuming that Cumulus doesn't set a connection timeout value? If it doesn't then I am assuming that the value is obtained from the .net framework implementation. If this is the case then I will search for this. Could you please confirm either way whether Cumulus sets a timeout?
Freddie
Image
User avatar
steve
Cumulus Author
Posts: 26701
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Timeouts after Linux upgrades

Post by steve »

Can't look at the moment, but pretty sure there's no way for Cumulus to set the connect timeout period.
Steve
freddie
Posts: 2435
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: Timeouts after Linux upgrades

Post by freddie »

freddie wrote:
As it's affecting both http and ftp, the issue is apparently at a lower level
I have resolved the DNS lookup problems which were contributing to about 50% of the timeouts.
I should say what I did, for completeness. I upgraded Ubuntu linux from 16.04 to 17.04. You do this by first upgrading to 16.10, then upgrading to 17.04. The 16.10 to 17.04 upgrade changed the local DNS resolver from dnsmasq (which I have been using for years) to systemd-resolved (which is relatively new and is a bit quirky still). This was a notified change (I missed the notification - probably buried in all the other changes, and I probably wouldn't have appreciated the implications just from reading that the change was going to occur). All I did was to re-install dnsmasq and disable systemd-resolved. That sorted out the HTTP errors, which were affecting uploads to WOW, PWS, Weather Underground and Twitter - most noticeably with Twitter which saw very few successful uploads, whereas the other services didn't suffer too much.
The FTP errors I was seeing were related to me having passive FTP set in MX. My FTP server didn't really like this, but happened to start complaining for some reason at the same time as the Linux upgrade. I just assumed the two were connected. After much head scratching I finally realised they were unrelated, and resolved the problem by changing Cumulus.ini to use active FTP.
Freddie
Image
Locked