5,838
edits
Monthly log files: Difference between revisions
m
→Correcting any logged data problems
| Line 33: | Line 33: | ||
==Correcting any logged data problems== | ==Correcting any logged data problems== | ||
Some Weather stations may occasionally supply corrupted or rogue values to Cumulus. Cumulus provides via '''Configuration''' menu ''Calibration'' screen the ability to screen out spikes in data picked up from your weather station. See Cumulus help screen if you decide to use that to cope with future spikes. Some rogue values may be obviously invalid (e.g. a zero pressure), others (e.g. wind shake on a tipping bucket rain gauge on a fine day) may be within the accepted all-time range (so cannot be prevented by spike settings), but you know the value is not right for that particular time. Frequently, the graphical views ('''View''' menu, ''Graphs'' or ''Select-A-Graph'' screens) are the best way to spot many rogue values and to help you guess by interpolation a more reasonable value. You may choose to edit the rogue value into a reasonable value, or to delete that particular entire row in the monthly log. As explained above once the log is corrected, new highs and lows in other logs are easily rectified. The screen ''within Cumulus'' for viewing the monthly log does not allow editing of values. | |||
=== Manipulation in Cumulus Toolbox === | === Manipulation in Cumulus Toolbox === | ||
[[File:ToolBoxFileEditorScreen.jpg | right]] | [[File:ToolBoxFileEditorScreen.jpg | right]] | ||
The add-on [[Toolbox#Current_feature_list| Cumulus Toolbox]] contains a '''file editor''' that can manipulate monthly log files using a display rather like this screen (in this figure it is actually dayfile.txt that is being edited. | The add-on [[Toolbox#Current_feature_list| Cumulus Toolbox]] contains a '''file editor''' that can manipulate monthly log files using a display rather like this screen (in this figure it is actually dayfile.txt that is being edited). | ||
===Manipulation outside Cumulus=== | ===Manipulation outside Cumulus=== | ||
| Line 47: | Line 47: | ||
Edit the original file using an editor that treats all fields as text [either any text editor, a Comma Separated Value editor, or a spreadsheet program that can be instructed ''not'' to recognise special field (like date) types]. | Edit the original file using an editor that treats all fields as text [either any text editor, a Comma Separated Value editor, or a spreadsheet program that can be instructed ''not'' to recognise special field (like date) types]. | ||
'''Rules''' -- Each line must contain the fields in correct sequence (since new versions/builds can add to number of fields, Cumulus will accept lines of various lengths without the more recent fields at the end). Nulls ',,' are not allowed in the | '''Rules''' -- Each line must contain the fields in correct sequence (since new versions/builds can add to number of fields, Cumulus will accept lines of various lengths without the more recent fields at the end). Nulls (',,' if your field separator is a comma, ';;' if your field separator is a semicolon) are not allowed in the row, so if you do not know the value for a particular field within the row, then type in a zero, -999, or -999.9 (check the format and range of numbers allowed for particular fields). | ||
'''Important''': | '''Important''': | ||
* The date format uses two digits for the year and should be treated as text. Do not edit this file using software (e.g. Excel) with default of recognising formats, as it is likely to change the dates to have four figure years, and then Cumulus will no longer be able to use the file. | * The date format uses two digits for the year and should be treated as text. Do not edit this file using software (e.g. Excel) with default of recognising formats, as it is likely to change the dates to have four figure years, and then Cumulus will no longer be able to use the log file. | ||
* Times in these files are in the form ''hh:mm'' using the 24 hour clock and local time (system time). | * Times in these files are in the form ''hh:mm'' using the 24 hour clock and local time (system time). | ||
* Note that the fields related to solar data will only contain valid data if your station has the appropriate sensor(s). | * Note that the fields related to solar data will only contain valid data if your station has the appropriate sensor(s). | ||
| Line 58: | Line 58: | ||
See [[FAQ#I.E2.80.99ve_just_installed_Cumulus.2C_and_it_didn.E2.80.99t_download_all_the_old_data_from_my_weather_station|FAQ: I've just installed Cumulus and it didn't download all the old data from my weather station]] | See [[FAQ#I.E2.80.99ve_just_installed_Cumulus.2C_and_it_didn.E2.80.99t_download_all_the_old_data_from_my_weather_station|FAQ: I've just installed Cumulus and it didn't download all the old data from my weather station]] | ||
Given that monthly log files are used as input for '''updating the all-time, | Given that monthly log files are used as input for '''updating the all-time, month-by-month alltime (from version 1.9.3), and this year record extremes''', for '''creating missing dayfile.txt entries''', and for '''creating NOAA style reports''', you may have some observations from your weather station recorded manually or electronically for a period before you first starting using Cumulus and want to create new monthly logs to feed into Cumulus. | ||
'''Here are some issues to consider.''' There are some postings in the Support Forum about importing past data. Essentially match the fields listed in [[Monthly_log_files#List_of_fields_in_the_file|Monthly log files: List of fields in the file]] below with the fields you have available in your source. | '''Here are some issues to consider.''' There are some postings in the Support Forum about importing past data. Essentially match the fields listed in [[Monthly_log_files#List_of_fields_in_the_file|Monthly log files: List of fields in the file]] below with the fields you have available in your source. | ||