Cumulus Wiki

Cumulusmx.db: Difference between revisions

Page Discussion

Cumulusmx.db (view source)

Revision as of 10:14, 2 November 2022

5,669 bytes removed ,  2 November 2022
m
Protected "Cumulusmx.db": Edit warring ([Edit=Allow only administrators] (indefinite) [Move=Allow only administrators] (indefinite)) [cascading]
(Created page with "This page is the new ''Cumulusmx.db'' page. This page and subpages hold a complete rewrite of the ''Webtags'' related pages. The information that was on this old ''Cumulusmx....")
 
m (Protected "Cumulusmx.db": Edit warring ([Edit=Allow only administrators] (indefinite) [Move=Allow only administrators] (indefinite)) [cascading])
 
(10 intermediate revisions by the same user not shown)
This page is the new ''Cumulusmx.db'' page. This page and subpages hold a complete rewrite of the ''Webtags'' related pages.
 
The information that was on this old ''Cumulusmx.db'' page has been moved to [[Cumulusmx.db_(preserving_history)|Cumulusmx.db (preserving history)]]. You are advised to use that page until this page is ready and this message has been removed. If any questions or remarks please send a PM to [https://cumulus.hosiene.co.uk/memberlist.php?mode=viewprofile&u=9016 HansR] on the forum. Do not use the ''discussion'' tab unless accompanied by a PM: there is no automated signal to HansR if you use that page.
 
This page and its subpages will document the Cumulusmx.db from the point of view of the CumulusMX software and not the Cumulus 1 legacy software. Cumulus 1 is no longer maintained and will eventually disappear. If you are still using it, please refer to the original [[Cumulusmx.db_(preserving_history)|Cumulusmx.db (preserving history)]] page where @sfws has tried to give both packages equal value. That effort is no longer maintained in this ''Webtags'' page. We hope you will understand this approach.
 
Please do not edit this page while it is being worked on i.e. while this message is still here.
 
<hr/>
 
[[Category:Cumulus MX]][[Category:Cumulus Files]]
 
= Introduction =
 
In CumulusMX version 3, this database contains the Recent History. The SqlCache and the sqlite_sequence tables are not for normal usage. It is an SQLite datebase only to be maintained by CumulusMX. When removed it will be rebuilt. The database is stored in the data directory so its relative path is '''data/cumulusmx.db''' (case dependent on Linux).
It is an SQLite datebase only to be maintained by CumulusMX. When removed it will be rebuilt.
The database is stored in the data directory so its relative path is '''data/cumulusmx.db''' (case dependent on Linux).
 
A good tool to inspect this database is [https://sqlitebrowser.org/ DB Browser for SQLite] (external site). Editing the databasedefault tables takes you to unsupported territory but it might be educational to inspect.
 
'''Note''': The CumulusMX [[Weather Diary]] also uses a SQLite database stored in [[diary.db|data/diary.db]].
 
= The Recent History Data Table =
= Database Tables included =
 
The following table lists the tables found in this database, indicating which release added the table, and where further details can be found.
 
 
{| border="1" class="wikitable"
|-
! style="width:80px" | Table name
! style="width:120px" | How MX updates
! style="width:80px" | Introduced
! style="width:450px" | Description
! style="width:220px" | Editor within MX
! style="width:120px" | Further details
|-
| RecentData
| Updated once a minute when MX is running
| MX beta 3.0.0
* Database of this name with this table originally in RAM
* In 3.12.0 (beta build 3134) table moved to external file
| The update.txt for CumulusMX at release 3.12.0 (beta build 3134) states "Change: Cumulus MX now uses a persistent database to store the recent 1 minute data
- This means that charts, recent web tags, and internal calculations for trends and periodic values will be more accurate after a restart
- If Cumulus MX is offline for a prolonged period, data for that offline period will obviously still be at the station logging interval resolution".
| No editor for Cumulus user
| [[Recent history]] and [[#RecentData table]]
|-
| SqlCache
| Updated when certain conditions are met and SQL is queued
| MX 3.21.0
| The update.txt for CumulusMX at release 3.21.0 states "New - Failed MySQL commands can now be individually edited/deleted
 
Changed - Failed MySQL commands are now stored in the SQLite database to persist across Cumulus runs"
 
| Edit or purge the failed MySQL command queue using '''Utils menu''' -->> ''PurgeMySQL''
| [[MySqlConnect]] and [[#SqlCache table]]
|-
| StandardData
| At time of writing, the current MX release does not use this table
| MX beta 3.0.0
(always in file)
| In [https://cumulus.hosiene.co.uk/viewtopic.php?p=123594#p123594 this forum post] Steve Loft describes this table as being for a possible future enhancement. It is believed this is the table that Steve had developed in Cumulus 2, as a replacement for the [[Monthly_log_files]].
| At time of writing, the current MX release does not use this table
| [[#StandardData table]]
|-
| sqlite_sequence
| Developer has not stated when updated
| MX 3.21.0
| Developer has not supplied a description
| Not known
| [[#sqlite_sequence table]]
|}
 
== RecentData table ==
 
This table has the following columns:
! style="width:280px" | Properties
! style="width:450px" | Description
! style="width:120px" | Example column value
|-
| 0
| Primary Key, can never be NULL, No Default Value,
| Dates and times for the last 7 days, at whatever interval available (at logging interval for historic archive data, at one minute intervals while MX is running)
| 2021-07-31 19:44:00
|-
| 1
| Not NULL, No Default Value
| The average wind speed (see [[Wind_measurement#Weather_Stations_and_Cumulus]] for links) calculated at the stated time, if necessary converted to units requested
| 2.2593056529
|-
| 2
| Not NULL, No Default Value
| The spot gust speed recorded at the stated time, if necessary converted to units requested
| 6.99691241605804
|-
| 3
| Not NULL, No Default Value
| The spot latest wind speed recorded at the stated time, if necessary converted to units requested
| 3.15989597323001
|-
| 4
| Not NULL, No Default Value
| The wind bearing (0 =calm), (1 to 360 = number of degrees)
| 315
|-
| 5
| Not NULL, No Default Value
| The average wind bearing over the defined period
| 270
|-
| 6
| Not NULL, No Default Value
| The measured [[Temperature_(and_humidity)_measurement|outside air temperature]], if necessary converted to units requested
| 17.0
|-
| 7
| Not NULL, No Default Value
| The [[wind chill]], either calculated by MX, or supplied by weather station. (Note: strictly only valid for low temperatures and significant wind speeds)
| (In the example used here, temperature in previous column was too high for wind chill, so the value was set to agree with 'OutsideTemp' column instead)
|-
| 8
| Not NULL, No Default Value
| The [[Temperature_(and_humidity)_measurement#Cumulus_Calculated_Parameters|dew point]], either calculated by MX, or supplied by weather station, for the stated time.
| 11.9134549845367
|-
| 9
| Not NULL, No Default Value
| The USA [[Heat index]] as calculated by Cumulus for the stated time (if the temperature is high enough)
| (In the example used here, temperature in 'OutsideTemp' column was too low for heat index, so the value was set to agree with 'OutsideTemp' column instead)
|-
| 10
| Humidity
| float (1 decimal place)
| Not NULL, No Default Value
| The [[Temperature_(and_humidity)_measurement|Relative Humidity]] reported by the station at the stated time
| 72.0
|-
| 11
| Not NULL, No Default Value
| The sea level pressure at the stated time, either as reported by the station or calculated by Cumulus from the absolute pressure reported by the station, if necessary converted to units requested
| 996.400024414062
|-
| 12
| Not NULL, No Default Value
| The rainfall for today so far, calculated by Cumulus from the rain counter (column 15) now minus the rain counter at start of day, if necessary converted to units requested
| 4.5
|-
| 13
| Not NULL, No Default Value
| Solar radiation value reported by station at stated time
| 200
|-
| 14
| Not NULL, No Default Value
| The Ultra Violet Index reported by station at stated time
| 3.0
|-
| 15
| Not NULL, No Default Value
| The rain counter is used by Cumulus for all rainfall outputs, this is its value at stated time
| 550.4
|-
| 16
| Not NULL, No Default Value
| The [[Feels Like]] temperature calculated by MX at stated time
| 17.0782773978147
|-
| 17
| Not NULL, No Default Value
| The Canadian [[Humidex|Humidity Index]], calculated by Cumulus at the stated time
| 19.1775362738161
|-
| 18
| Not NULL, No Default Value
| The [[Apparent temperature]], calculated by MX at the stated time
| 16.8864476063546
|-
| 19
| Not NULL, No Default Value
| The indoor temperature directly as reported by station at stated time
| 120.89999961853
|-
| 20
| Not NULL, No Default Value
| The indoor relative humidity directly as reported by station at stated time
| 61
|-
| 21
| Not NULL, No Default Value
| The calculated maximum value for solar radiation at stated time
| 1026
|-
| 22
| Not NULL, No Default Value
| Air Quality expressed in terms of particulate matter of 2.5 μm, or less, (?? Rolling 24 hours average ??)
| 1.5
|-
| 23
| Not NULL, No Default Value
| Air Quality expressed in terms of particulate matter of 10 μm, or less, (?? Rolling 24 hours average ??)
| 1.7
|-
| 24
| Not NULL, No Default Value
| The [[FAQ#How_is_my_rain_rate_calculated.3F|rainfall rate]] calculated for the stated time
| 303.2
|}
 
See [[Recent history|'''Recent history''' page]] for more details.
 
== SqlCache table= =
 
This table is fully managed by CumulusMX. You are not supposed to edit contents, you can view to quench your curiosity.
There is a MX setting ('''Settings''' -->> ''MySQL settings'' -->> '''General Options''' -->> Buffer commands on failure) that when enabled allows failed commands to be stored here.
 
There is a MX setting ('''Settings'''=>''MySQL settings''=>'''General Options'''=>tick Buffer commands on failure) that when enabled allows failed commands to be stored here. The buffer is lost when CumulusMX is restarted.
 
This table holds a list of MySQL commands that are in the queue for '''[[MySqlConnect]]''' to run again.
* DivisionByZero (certain mathematical operations cannot be handled)
The table has two fields:
 
{| border="1" class="wikitable"
Here is the relevant create table instruction, so this tells you the 2 fields in the table as Mark Crossley created it:
|-
 
! style="width:10px" | Column number #
CREATE TABLE "SqlCache"(
! style="width:80px" | Column name
"key" integer primary key autoincrement not null,
! style="width:80px" | Column type
"statement" varchar)
! style="width:280px" | Properties
 
! style="width:450px" | Description
The table contents are simple to explain, each time a new command is stored it is assigned a new number (that is automatically incremented from last number used) and the command itself is stored in a variable text length entry.
|-
 
| 0
 
| key
==StandardData table==
| integer
 
| Primary Key, Not NULL, No Default Value,
At time of writing this documentation, the latest MX release does not use this table, and it has zero rows. A [https://cumulus.hosiene.co.uk/viewtopic.php?p=113475#p113475 forum post by Steve Loft] about a database based logging proposal for Cumulus 3 (MX) confirms the original purpose was to improve the ability to [[Correcting Extremes|Correct Extremes Records]] by storing the most frequent and accurate extremes possible.
| An autoincrement integer for every SQL statement entered in the cache
 
|-
While that does not specifically explain this table, his choice of [[Standard log files|table name]] suggests he was planning to either replace, or duplicate, the use of text files for logging data. It appears he was actually thinking about implementing [[Monthly_log_files#Enhancement never implemented]] from his inclusion of "Lo" and "Hi" values in the column list.
|-
 
| 1
The only alternative theory is Steve Loft actually thought he could improve on the [[Recent history]] functionality, by storing the highest and lowest readings read from weather station in-between the one minute resolution.
| statement
 
| varchar
Here is the relevant create table instruction, so this tells you the 17 fields in the table as Steve created it (these have never been changed):
| Not NULL, No Default Value,
 
| Contains the actual SQL statement that failed
CREATE TABLE "StandardData"(
|-
"Timestamp" datetime primary key not null ,
|}
"Interval" integer ,
"OutTemp" float ,
"LoOutTemp" float ,
"HiOutTemp" float ,
"DewPoint" float ,
"LoDewPoint" float ,
"HiDewPoint" float ,
"WindChill" float ,
"LoWindChill" float ,
"HiWindChill" float ,
"InTemp" float ,
"LoInTemp" float ,
"HiInTemp" float ,
"Pressure" float ,
"LoPressure" float ,
"HiPressure" float )
 
 
 
 
==sqlite_sequence table==
 
Here is the relevant create table instruction, so this tells you the 2 fields in the table as Mark Crossley created it:
 
= SQLite Sequence =
CREATE TABLE sqlite_sequence (`name` TEXT, `seq` TEXT)
No relevant information on this table is known
Retrieved from "https://www.cumuluswiki.org/a/Special:MobileDiff/10794...10994"