5,838
edits
EasyWeather Format: Difference between revisions
From Cumulus Wiki
Jump to navigationJump to search
m
no edit summary
m (→Transferring past observations from EasyWeather.dat to Cumulus: update for EasyWeather v8.0 from Fine Offset) |
mNo edit summary |
||
| (11 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
THIS PAGE HAS NOT BEEN UPDATED FOR MX, but MX can handle these comma separated files. | |||
Anybody willing to bring this page up to date? | |||
=Fine Offset Weather Stations= | =Fine Offset Weather Stations= | ||
| Line 89: | Line 91: | ||
Fine Offset weather stations, without solar or UV measurements, store all the observations in easyweather.dat when the EasyWeather software version 6.x is running. The file format for this has been described in detail [http://www.jim-easterbrook.me.uk/weather/ew/ here]. (You can view ''easyweather.dat'' like any text file either using a text file editor like Notepad or by using a database file viewer). A typical record is "5099, 2013-04-26 07:17:08, 2013-04-26 05:19:21, 15, 42, 18.1, 99, 6.5, 6.4, 6.5, 1004.0, 1014.4, 0.3, 1, 1.0, 1, 14, NW, 2531, 759.3, 0.3, 1.5, 2.7, 3.0, 22.2, 60.9, 0, 0, 0, 0, 0, 0, 0, 0, 007FC0, 0F 2A B5 00 63 41 00 38 27 03 0A 00 0E E3 09 00 , " | Fine Offset weather stations, without solar or UV measurements, store all the observations in easyweather.dat when the EasyWeather software version 6.x is running. The file format for this has been described in detail [http://www.jim-easterbrook.me.uk/weather/ew/ here]. (You can view ''easyweather.dat'' like any text file either using a text file editor like Notepad or by using a database file viewer). A typical record is "5099, 2013-04-26 07:17:08, 2013-04-26 05:19:21, 15, 42, 18.1, 99, 6.5, 6.4, 6.5, 1004.0, 1014.4, 0.3, 1, 1.0, 1, 14, NW, 2531, 759.3, 0.3, 1.5, 2.7, 3.0, 22.2, 60.9, 0, 0, 0, 0, 0, 0, 0, 0, 007FC0, 0F 2A B5 00 63 41 00 38 27 03 0A 00 0E E3 09 00 , " | ||
[ | [https://cumulus.hosiene.co.uk/viewtopic.php?f=13&t=9294 This topic] suggests that weather stations using smartweather software create a file that can be read using the technique in [[EasyWeather_Format#Usage_of_easyweather.dat_fields_for_Cumulus_input_of_latest_record:| Usage of Easyweather.dat fields section below]]. | ||
==EasyWeatherPlus.dat== | ==EasyWeatherPlus.dat== | ||
Fine Offset weather stations that record Solar and UV measurements output to EasyWeatherPlus.dat file when Easyweather software version 6.x is running. This has the same fields as easyweather.dat, plus two extra fields for Solar and UV data at the end. | Fine Offset weather stations that record Solar and UV measurements output to EasyWeatherPlus.dat file when Easyweather software version 6.x is running. This has the same fields as easyweather.dat, plus two extra fields for Solar and UV data (see field list at the end of this page). | ||
Cumulus 1.9.4 beta build 1071 is first build that for ''''easyweather.dat'''' input method will ''Read UV and Lux values from easyweatherplus.dat'' file if [[Cumulus. | Cumulus 1.9.4 beta build 1071 is first build that for ''''easyweather.dat'''' input method will ''Read UV and Lux values from easyweatherplus.dat'' file if [[Cumulus.ini_(Cumulus_1)#Introduced_for_problems_with_Fine_Offset_family:|''''Extra Sensors'''']] selected in ''Settings'' frame on '''Station Settings''' screen. | ||
Here is an example of an EasyWeatherPlus.dat record: | Here is an example of an EasyWeatherPlus.dat record: | ||
"8363, 2013-04-26 15:21:32, 2013-04-26 00:25:07, 5, 60, 20.6, 67, 15.2, 9.1, 12.6, 1010.3, 1018.7, 3.1, 2, 4.1, 3, 0, N, 20, 19666.8, 0.0, 0.0, 0.0, 6.3, 352.2, 352.2, 0.0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0054C0, 2420, 05 3C CE 00 43 98 00 77 27 1F 29 00 00 14 00 00 00 00 00 00 , " | "8363, 2013-04-26 15:21:32, 2013-04-26 00:25:07, 5, 60, 20.6, 67, 15.2, 9.1, 12.6, 1010.3, 1018.7, 3.1, 2, 4.1, 3, 0, N, 20, 19666.8, 0.0, 0.0, 0.0, 6.3, 352.2, 352.2, 0.0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0054C0, 2420, 05 3C CE 00 43 98 00 77 27 1F 29 00 00 14 00 00 00 00 00 00 , " | ||
| Line 108: | Line 110: | ||
#Click '''Export''' button below the separator, complete the 'Save as ...' for a ''text'' file, and wait a couple of minutes (depending on size of file). | #Click '''Export''' button below the separator, complete the 'Save as ...' for a ''text'' file, and wait a couple of minutes (depending on size of file). | ||
#Open resulting file in a text editor and see hints in [[Monthly log files]] on how to convert between formats. | #Open resulting file in a text editor and see hints in [[Monthly log files]] on how to convert between formats. | ||
#For [[dayfile.txt]], you can create missing data from the newly created monthly log files, but you still may wish to insert breaks at rollover time in your raw EasyWeather table, possibly adding calculation of | #For [[dayfile.txt]], you can create missing data from the newly created monthly log files, but you still may wish to insert breaks at rollover time in your raw EasyWeather table, possibly adding calculation of maxima or minima to such meteorological day groups, so you can scan though each day to check what has been created in dayfile.txt and edit as required. | ||
If you were archiving your Easyweather.dat files, you may need to repeat the whole above process for futher source files, until you have the whole period you want. When Sfws did this process, he tried to merge the exported files before creating the Cumulus logs, but dealing with 2 full years of frequent pre-Cumulus observations meant he had a massive spreadsheet with almost a million cells, and it made separation into day by day or month by month for feeding into the Cumulus logs more difficult. | If you were archiving your Easyweather.dat files, you may need to repeat the whole above process for futher source files, until you have the whole period you want. When Sfws did this process, he tried to merge the exported files before creating the Cumulus logs, but dealing with 2 full years of frequent pre-Cumulus observations meant he had a massive spreadsheet with almost a million cells, and it made separation into day by day or month by month for feeding into the Cumulus logs more difficult. | ||
The instructions above were written for importing past information created by EasyWeather software version 6.x. If you were previously using the later EasyWeather software version 8.z; follow step 1 above, then select the required dates, then click the option button to ' | The instructions above were written for importing past information created by EasyWeather software version 6.x. If you were previously using the later EasyWeather software version 8.z; follow step 1 above, then select the required dates, then click the option button to 'Export as CSV'. Once you have created that file continue as step 5 above. | ||
==Station configuration screen: Using 'EasyWeather.dat' file as current station type== | ==Station configuration screen: Using 'EasyWeather.dat' file as current station type== | ||
| Line 122: | Line 124: | ||
==Usage of easyweather.dat fields for Cumulus input of latest record:== | ==Usage of easyweather.dat fields for Cumulus input of latest record:== | ||
People with non Fine Offset stations may wish to create data in this format for input to Cumulus. | People with non Fine Offset stations may wish to create data in this format for input to Cumulus running continuously, only the last record on the file is ever read, checking its time-stamp differs from the last one read. | ||
See the forum ( | See the forum (https://cumulus.hosiene.co.uk/viewtopic.php?f=4&t=4344) for more details. | ||
Here's the format of the initial part of an 'easyweather.dat' file record, with the fields Cumulus uses in bold. The separator between each field can either be a space or a comma, both are treated the same (hence date and time are regarded as separate fields even though they are separated by a space in real EasyWeather file). Note that EasyWeather always uses full stops for decimals. There are more fields after the ones shown (see example records shown above for the two .dat formats; and http://www.jim-easterbrook.me.uk/weather/ew/). | *Note when reading easyweather.dat (or equivalent formatted input), Cumulus will read the station originated date and time fields, and Cumulus checks that they have changed before using new data from the file. | ||
*To get Cumulus to read the file, configure a station type of "Easyweather (using .dat file)", and supply the full path to your file (it can have any name you wish), and the interval at which it is to be read. | |||
*Note that Cumulus only reads the last line in the file, and that this method is only suitable for 'live' data, i.e. you cannot close Cumulus down and expect it to catch up again later. | |||
*This method of using Cumulus is available on an "as is" basis; if it works for you, fine, but strictly speaking it is unsupported. | |||
Here's the format of the initial part of an 'easyweather.dat' file record, with the fields Cumulus uses in bold. The separator between each field can either be a space or a comma, both are treated the same (hence date and time are regarded as separate fields even though they are separated by a space in real EasyWeather file whilst in the real file other fields are separated by commas). Note that EasyWeather always uses full stops for decimals. There are more fields after the ones shown (see example records shown above for the two .dat formats; and http://www.jim-easterbrook.me.uk/weather/ew/). | |||
*0 - Record no | *0 - Record no | ||
*1 - Transfer date | *1 - Transfer date | ||
*2 - Transfer time | *2 - Transfer time | ||
*'''3 - Reading date''' | *'''3 - Reading date''' (yyyy-mm-dd) | ||
*'''4 - Reading time''' | *'''4 - Reading time''' (hh:mm:ss) | ||
'''NOTE: Cumulus only checks the 'reading time' to identify whether there is a new reading, the computer time is used when Cumulus processes the record. See [https://cumulus.hosiene.co.uk/viewtopic.php?f=27&t=14563 this forum topic].''' | |||
*5 - Interval | *5 - Interval | ||
*'''6 - Indoor Hum''' | *'''6 - Indoor Hum''' (Must be integer) | ||
*'''7 - Indoor Temp''' | *'''7 - Indoor Temp''' | ||
*'''8 - Outdoor Hum''' | *'''8 - Outdoor Hum''' (Must be integer) | ||
*'''9 - Outdoor Temp''' | *'''9 - Outdoor Temp''' | ||
*'''10 - dew point''' | *'''10 - dew point''' | ||
| Line 143: | Line 150: | ||
*'''14 - wind average''' | *'''14 - wind average''' | ||
*15 - wind average bft | *15 - wind average bft | ||
*'''16 - wind gust''' | *'''16 - wind gust''' (Used for 'latest') | ||
*17 - wind gust bft | *17 - wind gust bft | ||
*18 - wind direction number | *18 - wind direction number | ||
| Line 150: | Line 157: | ||
*21 - rain total | *21 - rain total | ||
*22 - rain since last reading | *22 - rain since last reading | ||
*'''23 - rain in last hour''' (used as rain rate) | *'''23 - rain in last hour''' (used as Cumulus rain rate, i.e. a rain amount for a period of one hour is the rate in units of amount per hour) | ||
*24 - rain last 24 hours | *24 - rain last 24 hours | ||
*25 - rain last 7 days | *25 - rain last 7 days | ||
*26 - rain last 30 days | *26 - rain last 30 days | ||
*'''27 - rain last year''' ( | *'''27 - rain last year''' (Used as Cumulus rain counter which can be any ever-increasing counter, but it needs to be in the same units as 23 - rain in last hour). The longer this counter continues before resetting to zero, the better for Cumulus. | ||
''For easyweatherplus.dat only:'' | ''For easyweatherplus.dat only:'' | ||
