Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4021) - 04 May 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Cumulus RealTime Data Grabber - Tool

Discussion and support for 3rd-party (non-Sandaysoft) tools for Cumulus
Post Reply
User avatar
geoffp
Posts: 322
Joined: Tue 28 Jun 2011 2:06 pm
Weather Station: Oregon Scientific WMR 200
Operating System: Windows 7
Location: Harwich, Essex
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by geoffp »

Your latest version is working fine with me Mark, no problem with the timers, I am set to grab the data every 15 secs :D :D
Regards,

Geoff

WOW Site No. 147808
User avatar
Super-T
Posts: 890
Joined: Tue 09 Sep 2008 3:37 am
Weather Station: wh-1081
Operating System: Weather Laptop - Windows 10 Pro
Location: Auckland, New Zealand
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Super-T »

I'll check out the 15sec tomorrow and watch to see when the realtime info updates. Could be local problem but I can't see where at present.
The joys of programming huh? :-)
User avatar
Solorize
Posts: 497
Joined: Tue 01 Feb 2011 8:22 am
Weather Station: WH1081
Operating System: Win 10, XP, Xubuntu, Linux Mint
Location: Wokingham, Berkshire, UK
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Solorize »

Geoffp,

Thanks for letting me know it works.


Terry,

If the problem happened when other people ran the program too, then
I would expect there to be a problem with my code, but as it runs ok
for me and the other people who have tried running it, there must be
some other factor that is causing the problem.

But I have no idea what LOL.

One thing I was thinging of was, could it be that the place where your
realtime.txt file is located may have a time limit set that kicks in if you try and access
the same data over and over again at short intervals, and it thinks the server is getting
attacked so, stops access to it for 5 minutes?
Last edited by Solorize on Fri 09 Mar 2012 6:29 pm, edited 1 time in total.
Cumulus Real Time Data Grabber
http://bit.ly/WjBh5z

Wokingham Berkshire - weather station
http://www.wokinghamweather.co.uk

CGM UKScene Radio (pi)
http://cgmuksceneradio-pi.noip.me/

Image
User avatar
steve
Cumulus Author
Posts: 26701
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by steve »

Solorize wrote:there must be some other factor that is causing the problem.
Something being cached somewhere with a TTL of 5 minutes?
Steve
User avatar
Solorize
Posts: 497
Joined: Tue 01 Feb 2011 8:22 am
Weather Station: WH1081
Operating System: Win 10, XP, Xubuntu, Linux Mint
Location: Wokingham, Berkshire, UK
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Solorize »

Hi Steve,

Thanks for you input, that seems like that is what could be what is happening.

But... one thing that is confusing is that Terry's is also running a widget that
does not seem to suffer with the same problem and with my limited knowledge
I would have thought would also be affected?
Cumulus Real Time Data Grabber
http://bit.ly/WjBh5z

Wokingham Berkshire - weather station
http://www.wokinghamweather.co.uk

CGM UKScene Radio (pi)
http://cgmuksceneradio-pi.noip.me/

Image
User avatar
steve
Cumulus Author
Posts: 26701
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by steve »

Solorize wrote:But... one thing that is confusing is that Terry's is also running a widget that
does not seem to suffer with the same problem and with my limited knowledge
I would have thought would also be affected?
I guess it might depend on exactly how your code and the widget's code read the data.
Steve
User avatar
mcrossley
Posts: 12813
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by mcrossley »

I always put a 'cache buster' on the end of the URL when fetching realtime.txt in javascript, I just append the date in milliseconds, like...

http://x.y.x/realtime.txt?12344578900000
User avatar
Super-T
Posts: 890
Joined: Tue 09 Sep 2008 3:37 am
Weather Station: wh-1081
Operating System: Weather Laptop - Windows 10 Pro
Location: Auckland, New Zealand
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Super-T »

Just to add to the confusion. Running the Grabber this morning and I got changes, starting at 9:54 then 9:58, 10:04, 10:08, 10:14.
Turning off the Gadget had no effect.
You do not have the required permissions to view the files attached to this post.
User avatar
Solorize
Posts: 497
Joined: Tue 01 Feb 2011 8:22 am
Weather Station: WH1081
Operating System: Win 10, XP, Xubuntu, Linux Mint
Location: Wokingham, Berkshire, UK
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Solorize »

LOL Terry that is confusing :roll:
That does show it's updating at an interval of 5 minutes instead of 15 seconds.

I will have another good look through my code tomorrow with fresh eyes
to see if I can find anything out of place, that may be causing a problem.

I have just finished a new version which I will post up in a couple of minutes.
If you could use this version and see if it miraculously sorts out anything ;)

Thanks.
Last edited by Solorize on Fri 09 Mar 2012 11:13 pm, edited 1 time in total.
Cumulus Real Time Data Grabber
http://bit.ly/WjBh5z

Wokingham Berkshire - weather station
http://www.wokinghamweather.co.uk

CGM UKScene Radio (pi)
http://cgmuksceneradio-pi.noip.me/

Image
User avatar
Solorize
Posts: 497
Joined: Tue 01 Feb 2011 8:22 am
Weather Station: WH1081
Operating System: Win 10, XP, Xubuntu, Linux Mint
Location: Wokingham, Berkshire, UK
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Solorize »

A new release of Grabber for you all :)


Download version 1.1.4 : http://www.wokinghamweather.co.uk/downl ... DGv114.zip


New in this version:

1.1.4 - (09-03-12)

1. Added "Current Chance of Rain Possibility" to [Rain] tab. Code looks at Temperature, Dewpoint & Humidity
and then predicts whether there is a chance of it raining.

2. Cosmetic tweaks to give a bit more space between values and their units to prevent
clashes between them.

I would be interested to hear how the "Rain Prediction" fairs against your current weather conditions.
i.e. when it is raining, does the rain prediction show that there is a chance of rain or not.
and when it is not raining or has stopped raining for a while does it state no chance of rain.

As I may have to re-tweak how it calculates the chance of rain if it is well out.
Cumulus Real Time Data Grabber
http://bit.ly/WjBh5z

Wokingham Berkshire - weather station
http://www.wokinghamweather.co.uk

CGM UKScene Radio (pi)
http://cgmuksceneradio-pi.noip.me/

Image
User avatar
Super-T
Posts: 890
Joined: Tue 09 Sep 2008 3:37 am
Weather Station: wh-1081
Operating System: Weather Laptop - Windows 10 Pro
Location: Auckland, New Zealand
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Super-T »

Also tried on a clean install windows 7 drive and same result.
Just testing new version now and looking for the included miracle :-)

No change to my problem in new version. Miracle never appeared.

Tried grabbing the realtime.txt on the local network from the weather laptop with same results. Tried running your programme on the laptop with the local realtime.txt and same problem.

Checked the updating of the website realtime.txt and it is definitely updating every minute.
User avatar
Solorize
Posts: 497
Joined: Tue 01 Feb 2011 8:22 am
Weather Station: WH1081
Operating System: Win 10, XP, Xubuntu, Linux Mint
Location: Wokingham, Berkshire, UK
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Solorize »

Hi Terry,

Thanks for the info. I will have a look through my code again this afternoon,
as am currently cutting a new flowerbed in my back garden, and as the soil
is mostly clay, its taking me ages LOL.

If I find anything I will let you know.
Cumulus Real Time Data Grabber
http://bit.ly/WjBh5z

Wokingham Berkshire - weather station
http://www.wokinghamweather.co.uk

CGM UKScene Radio (pi)
http://cgmuksceneradio-pi.noip.me/

Image
User avatar
mcrossley
Posts: 12813
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by mcrossley »

Solorize wrote: If I find anything I will let you know.
What, like a Roman horde! :lol:
User avatar
Solorize
Posts: 497
Joined: Tue 01 Feb 2011 8:22 am
Weather Station: WH1081
Operating System: Win 10, XP, Xubuntu, Linux Mint
Location: Wokingham, Berkshire, UK
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Solorize »

Terry,

I have looked through my code again and I still can't find anything that would
make it behave that way :?

I have taken mcrossley's advice and added a rough "CacheBuster" to the
URL by adding the current time to it, (FYI I did not convert the time to milliseconds, so I
hope it still works as it should LOL).

I have uploaded a test version which you can get below, can you tell me if this
works for you or if you still get the same problem, thanks.

Test version 1.1.5: http://www.wokinghamweather.co.uk/downl ... erTest.zip

I would be happy to hear from other people who can run this test version ok too, just so I know all
is still working as it should be.

Mark
Cumulus Real Time Data Grabber
http://bit.ly/WjBh5z

Wokingham Berkshire - weather station
http://www.wokinghamweather.co.uk

CGM UKScene Radio (pi)
http://cgmuksceneradio-pi.noip.me/

Image
User avatar
Solorize
Posts: 497
Joined: Tue 01 Feb 2011 8:22 am
Weather Station: WH1081
Operating System: Win 10, XP, Xubuntu, Linux Mint
Location: Wokingham, Berkshire, UK
Contact:

Re: Cumulus RealTime Data Grabber - Tool

Post by Solorize »

mcrossley wrote:
Solorize wrote: If I find anything I will let you know.
What, like a Roman horde! :lol:
Mark, unfortunatly I didn't discover any Roman coins, or artifacts, just a load of
tree roots and more clay LOL
Cumulus Real Time Data Grabber
http://bit.ly/WjBh5z

Wokingham Berkshire - weather station
http://www.wokinghamweather.co.uk

CGM UKScene Radio (pi)
http://cgmuksceneradio-pi.noip.me/

Image
Post Reply