If you use Cumulus, please donate Image

Please read this post before posting

Latest Cumulus release v1.9.4 (build 1099) - Nov 28 2014
Latest Cumulus MX release - v3.0.0 build 3043 Jan 20 2017. See this post for download

Timeouts after Linux upgrades

Discussion of version 3 of Cumulus, which runs on Windows, Linux, and OS X. All Cumulus MX queries in here, please.
freddie
Posts: 261
Joined: Wed Jun 08, 2011 11:19 am
Weather Station: Davis Vantage Pro 2
Operating System: GNU/Linux (Ubuntu 17.04)
Location: Hyssington, Powys, UK
Contact:

Timeouts after Linux upgrades

Postby freddie » Mon May 22, 2017 2:24 pm

I have just upgraded from Ubuntu 16.04 to 17.04. I am now seeing loads of timeouts and issues with HTTP transfers. Excerpt from MXDiags file:

Code: Select all

2017-05-22 14:00:00.226 http://api.weathercloud.net/v01/set?wid=7307801638b50821&key=<key>&tempin=203&temp=191&chill=191&dew=121&heat=191&humin=55&hum=64&wspd=4&wspdhi=63&wspdavg=27&wdir=202&wdiravg=202&bar=10131&rain=0&rainrate=0&time=1400&date=20170522&type=291&ver=3.0.0
2017-05-22 14:00:00.227 http://www.pwsweather.com/pwsupdate/pwsupdate.php?ID=ICHURCHS19&PASSWORD=****************&dateutc=2017-05-22+14%3A00%3A00&winddir=202&windspeedmph=6.0&windgustmph=14.0&humidity=64&tempf=66.3&rainin=0.00&dailyrainin=0.00&baromin=29.919&dewptf=53.8&softwaretype=Cumulus%20v3.0.0&action=updateraw
2017-05-22 14:00:00.227 http://wow.metoffice.gov.uk/automaticreading?siteid=237a8f1b-47d3-e611-9400-0003ff5991ab&siteAuthenticationKey=******&dateutc=2017-05-22+14%3A00%3A00&winddir=202&windspeedmph=6.0&windgustmph=14.0&humidity=64&tempf=66.3&rainin=0.00&dailyrainin=0.00&baromin=29.919&dewptf=53.8&softwaretype=Cumulus%20v3.0.0&action=updateraw
2017-05-22 14:00:00.256 Starting Twitter update
2017-05-22 14:00:00.271 Using twitter.txt file
2017-05-22 14:00:00.272 Updating Twitter: 1400 UTC: Wind SSW 5.2 kts. Temp 19.1 C, Dew pt 12.1 C. Bar 1013.07 hPa, Falling slowly. Rain last hour 0.0 mm #ukweather
2017-05-22 14:00:00.291 WeatherCloud update: An error occurred while sending the request.
2017-05-22 14:00:00.293 PWS update: An error occurred while sending the request.
2017-05-22 14:00:00.574 WOW Response: 429: The custom error module does not recognize this error.
2017-05-22 14:00:01.286 Status returned: (866654885017776128)[FishpoolFarm Weather]FishpoolFarm Weather, 1400 UTC: Wind SSW 5.2 kts. Temp 19.1 C, Dew pt 12.1 C. Bar 1013.07 hPa, Falling slowly. Rain last hour 0.0 mm #ukweather, 22/05/2017 14:00:00
2017-05-22 14:00:14.956 Updating CWOP
2017-05-22 14:00:17.179 Error uploading web/today.htm to /var/www/weather/today.htm : Timed out trying to connect!
2017-05-22 14:00:27.140 Sending BARREAD
2017-05-22 14:00:27.441 0A-0D-4F-4B-0A-0D-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
2017-05-22 14:00:27.943 Sending command LPS 2 1 - pass 1
2017-05-22 14:00:28.444 Wait for ACK
2017-05-22 14:00:28.444 Sending command LPS 2 1 - pass 2
2017-05-22 14:00:28.945 Wait for ACK
2017-05-22 14:00:28.945 ACK received
2017-05-22 14:00:28.945 Loop2: 4C-4F-4F-EC-01-FF-7F-DB-74-AD-02-37-98-02-08-FF-F6-00-3D-00-1F-00-0C-00-CA-00-FF-7F-FF-7F-35-00-FF-3F-FF-42-00-42-00-FF-00-00-00-FF-FF-7F-00-00-FF-FF-00-00-00-00-00-00-00-00-00-00-02-00-00-17-00-E5-70-E5-70-E2-74-FF-05-08-15-06-0C-13-03-37-04-00-00-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-0A-0D-C4-F4
2017-05-22 14:00:28.946 10-min gust from loop2: 10.4
2017-05-22 14:00:29.046 Sending command LOOP 20 - pass 1
2017-05-22 14:00:29.547 Wait for ACK
2017-05-22 14:00:29.547 ACK received
2017-05-22 14:00:34.328 Error uploading web/record.htm to /var/www/weather/record.htm : Timed out trying to connect!
2017-05-22 14:00:51.180 Error uploading web/gauges.htm to /var/www/weather/gauges.htm : Timed out trying to connect!

Any ideas?
Freddie
Image

User avatar
steve
Cumulus Author
Posts: 26141
Joined: Mon Jun 02, 2008 6:49 pm
Weather Station: None
Operating System: None
Location: On tour in France
Contact:

Re: Timeouts after Linux upgrades

Postby steve » Mon May 22, 2017 2:49 pm

As it's affecting both http and ftp, the issue is apparently at a lower level, so it's unlikely you'll get any useful information out of Cumulus. I think you'll have to look for answers in Ubuntu. Googling suggests there have been a number of internet related issues with 17.04, DNS lookups in particular.
Steve
-----
Hosting available for Cumulus web sites. See http://sandaysoft.com/forum/viewtopic.php?f=2&t=11876

Like Cumulus and want to support it? Please donate! Image

freddie
Posts: 261
Joined: Wed Jun 08, 2011 11:19 am
Weather Station: Davis Vantage Pro 2
Operating System: GNU/Linux (Ubuntu 17.04)
Location: Hyssington, Powys, UK
Contact:

Re: Timeouts after Linux upgrades

Postby freddie » Mon May 22, 2017 3:21 pm

Okay thank you Steve. I will get Googling!
Freddie
Image

freddie
Posts: 261
Joined: Wed Jun 08, 2011 11:19 am
Weather Station: Davis Vantage Pro 2
Operating System: GNU/Linux (Ubuntu 17.04)
Location: Hyssington, Powys, UK
Contact:

Re: Timeouts after Linux upgrades

Postby freddie » Mon May 29, 2017 9:36 am

As it's affecting both http and ftp, the issue is apparently at a lower level
I have resolved the DNS lookup problems which were contributing to about 50% of the timeouts. From your quote above, I am assuming that Cumulus doesn't set a connection timeout value? If it doesn't then I am assuming that the value is obtained from the .net framework implementation. If this is the case then I will search for this. Could you please confirm either way whether Cumulus sets a timeout?
Freddie
Image

User avatar
steve
Cumulus Author
Posts: 26141
Joined: Mon Jun 02, 2008 6:49 pm
Weather Station: None
Operating System: None
Location: On tour in France
Contact:

Re: Timeouts after Linux upgrades

Postby steve » Mon May 29, 2017 3:49 pm

Can't look at the moment, but pretty sure there's no way for Cumulus to set the connect timeout period.
Steve
-----
Hosting available for Cumulus web sites. See http://sandaysoft.com/forum/viewtopic.php?f=2&t=11876

Like Cumulus and want to support it? Please donate! Image

freddie
Posts: 261
Joined: Wed Jun 08, 2011 11:19 am
Weather Station: Davis Vantage Pro 2
Operating System: GNU/Linux (Ubuntu 17.04)
Location: Hyssington, Powys, UK
Contact:

Re: Timeouts after Linux upgrades

Postby freddie » Mon Jun 26, 2017 6:04 pm

freddie wrote:
As it's affecting both http and ftp, the issue is apparently at a lower level
I have resolved the DNS lookup problems which were contributing to about 50% of the timeouts.
I should say what I did, for completeness. I upgraded Ubuntu linux from 16.04 to 17.04. You do this by first upgrading to 16.10, then upgrading to 17.04. The 16.10 to 17.04 upgrade changed the local DNS resolver from dnsmasq (which I have been using for years) to systemd-resolved (which is relatively new and is a bit quirky still). This was a notified change (I missed the notification - probably buried in all the other changes, and I probably wouldn't have appreciated the implications just from reading that the change was going to occur). All I did was to re-install dnsmasq and disable systemd-resolved. That sorted out the HTTP errors, which were affecting uploads to WOW, PWS, Weather Underground and Twitter - most noticeably with Twitter which saw very few successful uploads, whereas the other services didn't suffer too much.
The FTP errors I was seeing were related to me having passive FTP set in MX. My FTP server didn't really like this, but happened to start complaining for some reason at the same time as the Linux upgrade. I just assumed the two were connected. After much head scratching I finally realised they were unrelated, and resolved the problem by changing Cumulus.ini to use active FTP.
Freddie
Image


Return to “Cumulus MX”

Who is online

Users browsing this forum: No registered users and 3 guests