5,838
edits
Monthly log files: Difference between revisions
m
→Correcting any data problems: Added italic note re create missing to end
m (→Correcting any data problems: Added italic note re create missing to end) |
|||
| Line 7: | Line 7: | ||
* update the [[Alltime.ini]] by choosing ''all time records'' from the '''Edit''' menu. This is a text editor, and works best when at full screen. Click the ''Help'' button for detailed instructions. | * update the [[Alltime.ini]] by choosing ''all time records'' from the '''Edit''' menu. This is a text editor, and works best when at full screen. Click the ''Help'' button for detailed instructions. | ||
* (if the monthly log relates to the current year) update the [[year.ini]] by choosing ''This year's records'' from the '''Edit''' menu. This is a text editor, and works best when at full screen. Click the ''Help'' button for detailed instructions. | * (if the monthly log relates to the current year) update the [[year.ini]] by choosing ''This year's records'' from the '''Edit''' menu. This is a text editor, and works best when at full screen. Click the ''Help'' button for detailed instructions. | ||
* (from version 1.9.3) update the [[monthlyalltime.ini]] by choosing ''all time records'' from the '''Edit''' menu. This is a text editor, and works best when at full screen. Click the ''Help'' button for detailed instructions. | * (from version 1.9.3) update the [[monthlyalltime.ini]] by choosing ''all time records'' from the '''Edit''' menu. This is a text editor, and works best when at full screen. Click the ''Help'' button for detailed instructions. | ||
* create the relevant monthly and/or annual NOAA style report by choosing ''NOAA Monthly Report'' or ''NOAA Annual Report'' from the '''View''' menu, then select the required period using the selectors, click the ''Update Display'' button to see various statistics calculated from processing the monthly log files, and finally press ''Save'' button to store the new or amended report. (Note: You can generate a NOAA report for a period without a monthly log, if data for that period is present on [[dayfile.txt]]. Generation of complete NOAA reports requires information in dayfile.txt, and the monthly logs for period in question). | * create the relevant monthly and/or annual NOAA style report by choosing ''NOAA Monthly Report'' or ''NOAA Annual Report'' from the '''View''' menu, then select the required period using the selectors, click the ''Update Display'' button to see various statistics calculated from processing the monthly log files, and finally press ''Save'' button to store the new or amended report. (Note: You can generate a NOAA report for a period without a monthly log, if data for that period is present on [[dayfile.txt]]. Generation of complete NOAA reports requires information in dayfile.txt, and the monthly logs for period in question). | ||
* use ''create missing'' button in the [[dayfile.txt]] selection in the '''Edit''' menu; This is a text editor, and works best when at full screen. Cumulus will then look through all monthly log files and create records for any ''missing dates'' in the dayfile. (It creates a file in the Cumulus folder called dayfileeditlog.txt which contains the entries it created). Click the ''Help'' button for more information. | |||
===Editing within Cumulus=== | ===Editing within Cumulus=== | ||
| Line 19: | Line 19: | ||
Tip -- take a copy of the file before you work on it outside Cumulus (perhaps call it <Month><Year>log.csv). | Tip -- take a copy of the file before you work on it outside Cumulus (perhaps call it <Month><Year>log.csv). | ||
Edit the file using an editor that treats all fields as text (a text editor or a spreadsheet program that can be instructed ''not'' to recognise special field (like date) types). | Edit the file using an editor that treats all fields as text (a text editor or a spreadsheet program that can be instructed ''not'' to recognise special field (like date) types). | ||
Each line must contain the fields in correct sequence (i.e. nulls ',,' are not allowed in the line, but since new builds add to number of fields, Cumulus can accept lines without the more recent fields at the end). | Each line must contain the fields in correct sequence (i.e. nulls ',,' are not allowed in the line, but since new builds add to number of fields, Cumulus can accept lines without the more recent fields at the end). | ||
| Line 27: | Line 27: | ||
Times in these files are in the form hh:mm using the 24 hour clock and local time (system time). Note that the fields related to solar data will only contain valid data if your station has the appropriate sensor(s). | Times in these files are in the form hh:mm using the 24 hour clock and local time (system time). Note that the fields related to solar data will only contain valid data if your station has the appropriate sensor(s). | ||
Apart from bearings (stored as integers), most value fields are in format x.y using your system decimal notation. See [[Monthly_log_files#Example_lines_from_the_file|Monthly log files: Example lines from the file]]. | Apart from bearings (stored as integers), most value fields are in format x.y using your system decimal notation. See [[Monthly_log_files#Example_lines_from_the_file|Monthly log files: Example lines from the file]]. | ||
===Importing pre-Cumulus data=== | ===Importing pre-Cumulus data=== | ||
Given that monthly log files are used as input for '''updating the all-time, all-monthly (from version 1.9.3), and this year record extremes''', for '''creating missing dayfile.txt entries''', and for '''creating NOAA style reports''', you may have some information for a period before you first starting using Cumulus that you want to include. | Given that monthly log files are used as input for '''updating the all-time, all-monthly (from version 1.9.3), and this year record extremes''', for '''creating missing dayfile.txt entries''', and for '''creating NOAA style reports''', you may have some information for a period before you first starting using Cumulus that you want to include. | ||
| Line 40: | Line 41: | ||
If you do need to edit the start date, you can edit the ''StartDate='' line in cumulus.ini with Cumulus stopped, but back up everything first! | If you do need to edit the start date, you can edit the ''StartDate='' line in cumulus.ini with Cumulus stopped, but back up everything first! | ||
===Using Monthly logs to deal with shorter (or incomplete) dayfile.txt records=== | |||
'''NOTE if dates are present in monthly log and dayfile.txt but not all fields for that date exist in dayfile.txt (e.g. records created by earlier version of Cumulus:''' ''One method is (not near rollover time) to (1) take a copy of dayfile.txt, (2) delete any days with partial information (e.g. from Cumulus versions that created fewer fields), (3) use ''create missing'' in the [[dayfile.txt]] selection in the '''Edit''' menu option of Cumulus (note whilst datafile.txt normally calculates all parameters like minimums and maximums from very frequent samples of your weather station, the resolution of create missing is limited to the interval between logging records in the monthly log), (4) rename the new dayfile.txt as dayfile(generated).txt and create a new dayfile.txt and (5) use a text editor to merge the required fields from the new dayfile(generated).txt with all other fields from reading only the copy of the original file. (This method preserves the original so you can experiment with different merges and do some cross-checking).'' | |||
==List of fields in the file== | ==List of fields in the file== | ||