How can I access historical data?
-
This question is for a Windy employee:
How much data space is needed to hold historical data? What is the size of the database need to be to hold all historical data? Couple of Terrabytes? Petabytes?
Their are very effective and cheap cloud storage solutions like Azure, AWS and Google. For example for 10 TB of hot data storage, it would typically cost around $300/month.
Since I'm sure you get 10's of thousands of visitors each month, Windy could run a donation drive like Wikipedia does so that it can collect money to spend on Storage and hosting of this beautiful webapp! This would be much better than implementing ugly advertising banners on the site to generate revenue to pay for storage.
I'm sure there are many people here that would donate and would get their universities and/or workplace to donate so that they can have access to this data.
-
Rain ACCUMULATION for at least the past DAY.
This is one huge requirement that only seems like "history", and that is just trying to discover how much rain I got, even for the past few hours. We just had a huge front move through, and I had spread fertilizer out, and need to know if I should or should not add more water. I don't know how to figure that out, if that data is even available, easily. But, accumulated rain or snow matters more than what the wind was, even an hour ago. Our forecast was for ~.75" - 1.0". Now that the front just passed, the only choice is to see what the NEXT 12 hours are. Even though it is past us, the accum. button seems to show some of the past and is showing .5", which seems likely accurate. Even if that is not showing the past, it would be great to say what that accum. button is, or is not.-- Other than that, you guys have the best UI I've ever seen! It is simply amazing. Everyone has to eat though, and you've got to be fed by someone. Seems to me this project is no different. Donations might work as well. Take a look at the best (IMO) internet radio station, funded purely by donations at RadioParadise.com -- So it CAN be done, and very profitably if you are good enough. And, I think you are. You had the absolute best tools for understanding the past huge Florida hurricanes, and I used it extensively.
-
@DaaBoss said in How can I access historical data?:
Rain ACCUMULATION for at least the past DAY.
This is one huge requirement that only seems like "history", and that is just trying to discover how much rain I got, even for the past few hours. We just had a huge front move through, and I had spread fertilizer out, and need to know if I should or should not add more water.You know that rain or other parameters shown on Windy are forecasts but not observations. To know the right amount of rain you have got in your fields better to use rain gauge. Otherwise in case of convective rain you should be very disappointed.
-
Such data does not really exist. At best you could use your local met office's logged rainfall observation stats. That historical information will exist and you can probably access it with one mouse-click from your toolbar once you find a link to it.
I get it locally with daily totals for the past three days, but it contains a link to monthly, seasonal and annual logs also. To access to them all I have to do is double-click on the radar's data icon at my radar site, and it gives the current logged data for the past three days in 30 minute blocks.
http://www.bom.gov.au/products/IDR733.loop.shtml#skip
Which gives you this:
3-day data:
http://www.bom.gov.au/products/IDQ60801/IDQ60801.94294.shtmlWhich page contains another link to all the data for the prior months and years at the same and/or surrounding area's logged sites:
http://www.bom.gov.au/climate/dwo/IDCJDW4128.latest.shtml
But rainfall is highly variable and what falls in the met office's gauge may not show up on your fields. But if you compare surrounding site totals you can tell how widespread or localized a rainfall event was and the implied average for your farm's area.
So check your national weather service website for links to the logged data for your local area.
But your best bet is to simplify all this by buying a capable digital weather station for your farm (and claim it as a business expense for tax deduction purposes). Such can auto-log rainfall data into a file internally that you can then download and look at in graphical form using the software that comes with the weather station.
-
You can find a nearby PWS and see if the log data to the CWOP Network which than that data ends up in different networks like Meseowest , NWS, and even here in Windy... Lots of Applications use this data source...
IE My station:
https://www.wrh.noaa.gov/mesowest/getobext.php?wfo=mtr&sid=E2972&num=48I also log data personaly on my site:
Trends over minutes and hour: https://www.txweather.org/wxStartReports.php
Trends over years: https://www.txweather.org/wxtrends.phpI hope you find somebody near you that does the same!
Good luck!
-
QUITE an amazing number of detailed responses, so thanks.
I found that clicking on the clock in the UI while using the "Rain Accumulation" button, it states as you said, 'a forecast of what the rain accumulatION will be for the next 12, 24, etc. hours/days', (and NOT the rain "accumulatED").
However, when just clicking on the clock while using the more common "Rain, Thunder" button, it says that it will show at least some history: "Rain/snow accumulation in the last 3 hours." Of course, it is only updated every 12 hours at around 4:30 PM, in the middle of our most likely rain period, so it isn't extremely helpful. But, it was showing me some of what I wanted yesterday at that time, right after most of the rain was over.
It seems that if ECWMF has that past history, it is possible that they could make it available for the past 12 hours, instead of just 3 hours, and then present the last 12 or 24 hours of rainfall. That would accomplish most of what I'd be looking for -- a rough estimate of past rainfall.
I have been using a PWS that is about a mile from me from WU, which does an OK estimate. And I agree that I really should put out a gauge, but correct placement away from walls is difficult but vital.
I'm thinking it would be cool to put an unobtrusive gauge on one the side of my mailbox, which is about as is isolated away from obstructions as you can get. Then just check/dump it when getting the mail.
-
@ivo Perfectly understandable. And I'm circumnavigating the Chesapeake Eastern Shore in June and could use historical data. Any time you're ready I would pay for access to 10 year averages or a sliding history.
-
@jimmyray1972
that is hilarious, there is massive difference between a flash stick that can stop working in 10 min time as apposed to infrastructure quality data. To create the corporate or redundant hardware to store terabytes of data is massively costly when you start looking at redundancy. -
Hi how can I get 2019.01.01 2019.06.01 data.
Please reply my email amartuvshin@esb.mn
Thank you -
@Amartuvshin not possible
-
Historical data would be very useful indeed! Especially for winds.
-
i am also looking to get access to historical data.... this feature would be very useful for my research but also for PPL instresseted in climate science!
has there been any updated in this regard?
-
@hasanmas Hi, we still do not offer historical data.
-
+1 vote for historical data
-
+1 for this request.
-
1+ vote for historical data, please!
Andrei -
+1 another person requesting historical data here for ocean passage planning purposes. You guys could literally create your own annual PILOT CHARTS so we don't have to use those archaic 2002 versions that NOAA NGA publishes. There's a whole lot of potential in this and all it takes is....servers? Easy. Let's do this!
-
As a fisheries oceanographer I would really appreciate the ability to access archived information on oceanic conditions (SST, Currents, etc.) over the past years that Windy has been providing these data! This information is a major asset to scientific inquiries!
-
@Korina
Olá. Fiz a assinatura do sistema de vocês e preciso ter acesso aos dados históricos registrados. Vi em fóruns antigos que não há sistema de registro, mas isso foi há muito tempo e acredito que, sob a demanda recorrente, vocês já tenham mudado o sistema para atender aos assinantes. Podem me dar um parecer do caso? -
@VITPLANRS Hello, thank you for subscribing! However, we don't offer any historical data at the moment.
