Webtags/Parameters: Difference between revisions

From Cumulus Wiki
Jump to navigationJump to search
Line 188: Line 188:


Best method probably is to migrate to CumulusMX. Then first check your log on Webtag error and then look at your website or reports - wherever you use your Webtags - and check your date/time formats. Then modify where you think it is required.
Best method probably is to migrate to CumulusMX. Then first check your log on Webtag error and then look at your website or reports - wherever you use your Webtags - and check your date/time formats. Then modify where you think it is required.
=Some Extra Information=
Having covered the basics of both date and time modifiers above, it is time to talk about incorporating other information in an output modifying date/time format specification.
Basically, we can include literal characters, and we can include HyperText Manipulation Language tags, in our specifiers.
Finally, there will be a section on migrating from the legacy Cumulus to MX and how to modify the web tags in your templates to keep them working.
==Including literals in format parameters==
[[#Use of spaces]] explained how double quotes were needed for date/time output specifiers containing spaces. It briefly talked about including literals, and we will expand on that now.
Consequently, you cannot include double quote characters in any other position (see [[Php_webtags#Web_tag_Complications| here for work-around]]).
You should put anything that is additional, to the defined format modifier specification below, into single quotation marks to prevent it being interpreted as a date or time format modifier.  In MX, such single quotation marks should include the spaces round the additional literal text.
#For example, the word "on" contains the character "n", which for Cumulus versions 1.9.1 to 1.9.4 will be interpreted as a time format modifier unless you put it into single quotation marks. Example of valid Cumulus 1 syntax: <#TtempH format="'at' hh: mm 'on' dd / mm / yyyy">.
#You can include HTML tags (but they cannot have any attributes because both single and double quote characters have defined meanings) and special characters as quoted text within the 'format' parameter.<br>  Example of valid syntax: <#TapptempH format="'at 'h:nn'&nbsp;'am/pm '&lt;small&gt;on' d/m/yyyy'&lt;/small&gt;'">.
#* See next sub-section for more information on incorporating HTML if you are using MX.
[[File:Badge vMx.png]]Note for MX - you can use single quotation marks round spaces and text (e.g. ' on '), but you can also use '\' as escape character (e.g. for 'on' use '''\o\n''').  However for '''at''' the only alternative is '''\a't''''  because the character t has another meaning and escape followed by a "t" i.e. "\t" becomes a tab!
{| class="wikitable" border="1"
|-
!style="width:150px" | {{Version badge 1}}Delphi Specifier for Cumulus 1.9.x
!style="width:150px" | [[File:Badge vMx.png]]Mono/.NET Specifier for Cumulus MX
!style="width:600px" | Displays
!style="width:600px" | Example
|-
|'xy'
|'xy' or ''\x\y''
|Characters enclosed in single quotation marks are displayed as such, and do not affect formatting.
[[File:Badge vMx.png]]In MX each character to be displayed as it was typed can be prefixed by a backslash. Also remember that any spaces in a MX modifier might need to be within single quotes as space is also used to change what a modifier represents. I told you MX modifiers were more complicated!
|Hyphens are added in this PHP language example  '<#LastDataReadT format=yyyy>'.'-'.'<#LastDataReadT format=MM>'.'-'.'<#LastDataReadT format="dd">'
|}
== Using HTML tags within format parameters (available in MX only) ==
'''Example using a class to change the look of part of the output'''
<pre><#TapptempH format="dd'&nbsp;'MMM'&nbsp;'yyyy'<span class=\'xx\'> at 'HH:mm'</span>'"></pre>
the output from this will look like ''04&nbsp;Dec&nbsp;2018<span class='xx'> at 10:12</span>''
'''Note where the quotes are, and where you need to use '\' escape characters'''.
'''Example using HTML tags'''
<pre><#RecentTS d=2 format="h:mm'&nbsp;'tt'<small>on' d/M/yyyy'</small>'"></pre>
This puts the date in a smaller font than the time
== Migrating from legacy Cumulus 1 to MX==
If you have created any legacy cumulus template files, then in each template, you will need to do some editing. Everywhere a web tag appears with an output modifiers that is used to specify a date and/or time format, has to be edited before that template will work for MX.
Here are the main reasons:
* the reserved characters are different in C1 and MX (affecting use of literals like "on" and "at" that appear in many English time-stamps)
* the Delphi in legacy Cumulus is case insensitive, so for example "H" and "h" have the same meaning
* MX is case sensitive, and symbols mostly have different meanings when one symbol is used to when that symbol is used with others, so for example "H" and "h" have different meanings, and if not used with other symbols will need to be preceded with a "%" to have same meaning as they have in combination with other symbols
* In the legacy cumulus, a symbol like "d" has the same meaning for any tag
* MX is inconsistent, a symbol like "d" changes its meaning depending on the tag it is used with (e.g. the script conditional ''''<#metdateyesterday format=d>' == '<#yesterday format=d)>''''  will never be equal as the LHS returns a full date and the right hand side returns day of month only)
* the symbols used for representing such modifiers as minutes, month, am/pm, are different between C1 and MX.
* MX introduces the concept of escaping characters (a '''\''' placed before a character can be either a control sequence or an instruction to display the character)
* In the legacy Cumulus, a space is a gap between characters
* In MX, a space must be within a literal, as a space before a symbol has the same effect as "%", (it changes the interpretation of a modifier character).
'''Confused even more now?''' I'm not surprised, but maybe some examples will help.
=== Examples ===
*Examples related to case selection
*#[[File:badge v1.png]] In Delphi, "nn" means "minutes" for Cumulus 1, [[File:Badge vMx.png]]but "minutes" is "mm" for .NET or MONO in Cumulus MX.
*# The hour in 24-hour format with leading zero, in non case sensitive Delphi (Cumulus 1) 'HH' or 'hh' would be treated as same, but in .NET or MONO it must be "HH" (Cumulus MX).
*# The hour in 24-hour format without leading zero, in non case sensitive Delphi (Cumulus 1) 'H' or 'h' would be treated as same, but in .NET or MONO it must be "%H" (Cumulus MX).
*# For 12-hour specifiers, please see the table, as this is far more complicated.
*[[File:Badge vMx.png]]You might be put off by references within .NET and MONO (Cumulus MX) to single/standard characters and custom modifiers, the following 3 examples may add clarity:
*#For example, ''<#MonthTempHD format="d">'' is a single character format modifier, therefore the 'd' acts as a standard modifier, and causes for a date of 22 July 2014 for the highest temperature in the month to be returned in the standard short date format e.g. '22/07/2014' (exact contents for any one date vary by locale).
*#Similarly, ''<#MonthTempHD format="M">'' is a single character format modifier and therefore the 'M' acts as a standard modifier and causes the date for the highest temperature in the month to be returned in the standard day and month format e.g. '22 July' (exact contents for any one date vary by locale).
*#Whilst ''<#metdate format="d M">'' is not a single character format modifier and therefore both the 'd' and the 'M' are interpreted as custom modifiers and cause the current date to be returned as a digit(s) for the day and a digit(s) month (in a without leading zeroes format) e.g. '6 7' would be returned for 6 July.
*#Alternatively,  ''<#MonthTempHD format="%d">'' is NOT a single character format modifier, therefore the 'd' acts as a custom modifier, and causes a date of 22 July 2014 for the highest temperature in the month to be returned as the day of the month only '22' in all locales.
*#Similarly, ''<#MonthTempHD format="%M">'' is NOT a single character format modifier and therefore the 'M' acts as a custom modifier and causes the same date for the highest temperature in the month to be returned as the month number '7'.
In both Cumulus 1 and MX if you want a space character within your output, the output specifiers must be enclosed in double quotes. If that space character is next to a non modifier (e.g. around word "at") then the single quote needing to surround the at should be widened to include the spaces in MX, but Cumulus 1 does not care if single quotes excluded spaces. However, with MX, single quotes enclose multiple characters, but there is an alternative way to deal with some single verbatim characters to cover next.
So let us compare these two alternative ways that MONO and .NET  escape any characters that are not being used as format specifiers.
* In [[File:badge v1.png]]Delphi you can put the 'verbatim' characters inside single quotes (Cumulus 1); this is often used to (in English) include words like ' on ' and ' at ' in the formatted output.
*in [[File:Badge vMx.png]].NET or MONO you can still use single quotes (as mentioned above extended to include adjacent spaces),
** but alternatively you can escape each verbatim character with a backslash as prefix (Cumulus MX).
* You may need to use both single quotes and back slashes in some format specifiers, depending whether the characters you want to include can be interpreted as control characters (yes, backslash is also used to escape control characters, so backslash will NOT work for some characters such as those in "on" and "at" [\n will produce new line not the letter n, \t will produce a tab not the letter t]), consequently for some characters you must use the literal approach to include them in your format.
== Past history for this page==
This page is a complete redesign of how to present information that was previously on the [[Webtags]] page, so look there for past content by selecting "history" tab.
Trying to make the old design made for the original Cumulus software, work for MX which is now very different, made the old page unwieldy.
== Forum reference ==
Steve Loft published a table showing comparison between output date modifiers for Cumulus 1 and MX at [https://cumulus.hosiene.co.uk/viewtopic.php?f=39&t=17888 Cumulus MX forum].  The table there was based on the table that appeared in this Wiki when only the original Cumulus existed, so it was designed to help people migrate to his MX beta, it was not intended as a definitive list of what modifiers were available for MX (Steve instructed people to look them up on some Microsoft sites).
The subsequent comments in the forum suggested his layout got people confused. Most of that confusion came in two circumstances:
*When someone wanted to use one date or time modifier on its own
*When someone who had been using Cumulus 1 swapped to MX and wanted to replace a combination of output modifier characters that was not explicitly shown in his table.
That all comes from the fact that when a MX modifier consists of a single character it can mean something different to when it appears with other characters. 
In Cumulus 1, "m" or "M" had two meanings depending whether it was combined with "H" or "h" (when it represented minutes), or on its own or with any other code (when it represented month). But for Cumulus 1, there is no other case where it matters what context a modifier is put in by the use of other modifiers, and no other modifier takes more than one meaning.
In MX it is much more complicated, to take a few examples "D", "H", "M" represent different items on their own to what they represent when combined with other characters.  That other character can be as simple as using a space or a "%" to modify the meaning of the character.
Looking at the tables, now included above, you can see "G" is used on its own because it represents a full date-time specifier. "D" is similarly used on its own represents the long date format. If we only want the day of month number we must use "%d" to avoid the meaning of short date format that "d" on its own represents.
If we want the typical Cumulus date-stamp of day of month number and month, then we have two choices, because both "d M" and "M" will work. This illustrates how "M" has a different meaning on its own and with another modifier.
Hopefully, the way that information is now presented on this page makes any use of parameters for web tags much easier now.

Revision as of 08:26, 4 October 2022

This page is the new Webtags Parameters page. This page is part of a complete rewrite of the Webtags page. As long as this message exists please refer to Webtags/Parameters (preserving history).

This page is Work in Progress until this message is deleted.

If any questions or remarks please send a PM to HansR on the forum. Do not use the discussion tab unless accompanied by a PM: there is no automated signal to HansR if you use that page.

This page and its subpages will document the Webtags from the point of view of the CumulusMX software and not the Cumulus 1 legacy software. Cumulus 1 is no longer maintained and will eventually disappear. If you are still using it, please refer to the original Webtags page where @sfws has tried to give both packages equal value. That effort is no longer maintained in this page. We hope you will understand this approach.

Please do not edit this page while it is being worked on i.e. while this message is still here.


Introduction

Using a Webtag is described on the Webtag page. Only the GET API interface can't use parameters. All the other possibilities use the general Webtag format:

 <#tag_name [optional input selection parameters] [optional output modification parameters]>

In the following the input and output parameters are described.

  1. An input parameter is used where the same tag name can represent a value for a number of different past time instants e.g. temperature for several days or several hours ago. Each of those past time instants is represented by a different value for the input parameter. So a combination of a tag name and input modification parameter lets CumulusMX select the value you want to see. Whether a particular tag name can use input modification parameters will be shown in the Full list of Webtags.
  2. An output parameter is used when a particular tag name can be fed through a process that alters how the output is shown:
    • Tag names representing integer values cannot have their output format modified
    • Tag names representing floats or doubles can have modifications :
      1. modification of the number of decimal places shown after processing
      2. modification of the decimal separator (comma or point)
    • Tag names representing time intervals, clock times, dates or representing both time/date for an extreme record may have the format changed

Case sensitivity

The tag_name in the general format above is case sensitive, so please type the tag name exactly as shown in lists of tag names. The local list is a useful reference here.

The optional input modification parameters always use lower case, so please type them exactly as shown in the section below.

The content of optional output parameters are case sensitive and also dependent on what other output formatters are being used if any, so please read the sections on output parameters and study the examples in the tables carefully.

Tag names and Parameters available

Input modification Parameters

The following Webtags (can) use input modification parameters:

  1. Tag names listed in the table at Recent History (see also Recent history page)
    • Produces one value for each minute in last 7 days
    • d : specifies number of days ago
    • h : specifies number of hours ago
    • m : specifies number of minutes ago
    • You can use any combination of the three parameters
    • All values supplied for parameters must be whole numbers
    • If you don't supply any parameters, the result is an illegal web tag for CumulusMX
  2. Tag names listed in the table at monthly all-time extreme records
    • Produces the extreme record values (and corresponding time-stamps) for any particular month in all years
    • Optional input parameter is mon=N where N is the index of the month (1 is January, and so on, to 12 is December)
    • If you don't supply an input parameter (or supply an invalid value like zero) the current month will be used
    • You can use both an input parameter and an output parameter for any tag name, separate these with a space
    • NOTE: If you use <#RecentRainToday d=2> remember that rainfall accumulates during a day, so "d=2" returns an estimate of the rain between rollover 2 days ago and the same time as now 48 hours ago, it does not return the total rainfall 2 days ago!
  3. The Webtags Only <#SunshineHoursMonth> and Only <#SunshineHoursYear>
    • Produces values available for current month/year, and for a past month/year.
    • Omit input modification parameter to get value for current month/year. Alternatively include one of the following options:
      1. r=-ww (note minus sign and up to 2 digits) representing that number of months/years ago
      2. Monthly tags also take: m=N y=nnnn (N can be 1 to 12, nnnn is 4 digit year), these parameters specify exact month required
      3. Yearly tags also take: y=nnnn, this parameter specifies exact year required

Examples for Recent History

  1. <#RecentOutsideTemp m=1> will give the temperature one minute ago, <#RecentOutsideTemp h=1> will give the temperature one hour ago (as will <#RecentOutsideTemp m=60>)
  2. <#RecentOutsideTemp d=1> will give the temperature one day ago.
  3. <#RecentOutsideTemp d=1 h=1 m=1> will give the temperature one day, one hour and one minute ago.

NOTE: Some Cumulus users say that using <#RecentOutsideTemp d=1 m=1> is more reliable at getting the temperature (or whatever tag name you have quoted) at a similar time the day before, the extra minute apparently gives better results when you might not be using Cumulus all the time, or your weather station might have some drift on when it supplies readings. See which works best for you. REMARK HansR for review: This seems a strange explanation to me. It seems more having something to do with updating the Recent History database while being queried as the processes in CMX most likely are independent.

Examples for Monthly Records

  1. <#ByMonthDewPointH mon=3> is highest monthly dew point for month of March considering all years, and <#ByMonthDewPointHT mon=3> is the related time and date.
  2. <#ByMonthTempH mon=3> gives highest temperature in any March, <#ByMonthTempHT mon=3> gives the date and time for that highest temperature

NOTE: Use without an input parameter in "MySQLConnect", "MQTT", or a template file, and then you don't need to rewrite the instruction when current month changes. NOTE: If processed at rollover, the current month will change on first day of a month, and so not relate to month that has just finished.

Examples Solar

  1. Monthly examples
    • <#SunshineHoursMonth> gives total sunshine hours since 1 minute past midnight at start of current month
    • <#SunshineHoursMonth y=2021 m=1> for the January 2021 total
    • <#SunshineHoursMonth r=-1> for last month's total
    • <#SunshineHoursMonth r=-12> for same month as current month, but one year ago
  2. Yearly examples
    • <#SunshineHoursYear> gives total sunshine hours since 1 minute past midnight on New Year's Day
    • <#SunshineHoursYear y=2019> for the total for 2019
    • <#SunshineHoursYear r=-2> total for the year before last (if current year is 2021, that returns total for 2019 as previous example)

(And of course you need a solar sensor for this)

Output modification parameters

The output format for numbers and dates is ruled by the international settings (Windows) or locale settings (Linux). These settings are hereafter named the locale or locale settings. So if you want to have other formats for numbers and dates than you are seeing in your website or your reports, than your first step should be to check and possibly reconsider your locale. Beside that you must know that javascript does not handle a comma as decimal seperator. So if you wish to see a comma as decimal separator you probably must take some special precautions.

Each tag name falls into one of these 3 types:

  1. Some tag names have a fixed output format (so they ignore any output format parameters, although obviously better not to specify any)
  2. Some tag names always need an output format specifier
  3. The majority of tag names have a default output if there is no output format modifier, but accept either one or two output format parameters, allowing you to change what they output.

Numbers

Changing the decimal separator

CumulusMX never uses a comma for separating off thousands, and there is no way to make it output numbers above 999 with a space or comma to separate out thousands.

If the tag name represents a real number with integer and decimal parts, then Cumulus by default will output that number using whatever your locale defines as the separator character (decimal comma or decimal point). The legacy Cumulus 1 provided a few derivatives where a prefix of "RC" before tag name as in <#RCtag_name> could force the output to use a decimal point (regardless of locale), that option remains available in CumulusMX for backward compatibility.

The current possibilities are:

Parameter Explanation Example
rc=n This is the default, so does not need to be specified. The output from the web tag will use either decimal comma or decimal point as specified by the locale in which MX is running

For more information about how the computer determines whether decimal commas is your default, see #Locale section later.

Both <#tempYH> and <#tempYH rc=n> will return yesterday's highest temperature using what is specified by locale to separate integer and decimal parts
rc=y the attribute rc takes the value 'y' to replace any commas defined by the locale with full stops to separate integer and decimal parts of the output value. <#tempYH rc=y> will return yesterday's highest temperature as integer part then full stop then decimal part, regardless of local

Controlling the decimal places

If the tag name represents a real number (with both integer and decimal parts) then there are a number of ways to control the number of decimal places:

  • dp=i rounds output to number of decimal places specified by "i"
  • tc=y truncates output, display as integer, no rounding, simply ignoring all decimal places

If the tag name gives an output that is defined as text, or as an integer, then none of these can be used.

[Remove this after review?? HansR] Weather stations report values as integers. Cumulus converts these to the user's desired units, and that processing can add decimal places, as it may involve division by a factor of 10, or multiplication by a conversion factor. Obviously, the sensor has a particular accuracy, and this conversion process can introduce additional errors, as can the storing in binary, Cumulus generally (not in every case) stores to a precision that would generally give about 24 significant figures when expressed in base 10.

The handling of each tag name is coded individually, so there are no simple rules for defining the default number of decimal points that will be shown by default. In general, Cumulus does consider the units chosen for outputs. As Cumulus has been developed, people have commented that these defaults do not reflect the precision of their instrumentation (weather stations used with Cumulus tend not to have the accuracy of those used by meteorologists, or are not re-calibrated as often). [END Remove this after review?? HansR]

From release 3.12.0, you can set the default number of decimal places to output for all derivatives of temperature, pressure, etc. by advanced settings. Those settings can force output as integers, in which case the parameter for controlling number of decimal places have no effect.

Note: Truncation by MX converts real numbers to integers. There is no option to truncate to one decimal place, Airports are expected to report air field level (QFE), and sea level (QNH), pressures truncated to one decimal place rather than rounded.

Multiple Output Format Modifier parameters for times and dates

In general all date/time tags will accept format strings with some exceptions. CumulusMX just passes the format string to the datetime formatter, it does not do any of its own formatting and thereore the Microsoft page are the only valid reference:

  1. Standard date and time format strings
  2. Custom date and time format strings

The user is advised to study those pages, relate to what he wants and experiment before getting to the forum and ask questions.

There are some tag names (e.g. moon rise) that relate to an event that does not happen each Earth day, so those tags have to be able to report "--:--". Equally, many of the tag names that describe extreme records for this month/year/all-time are not defined until the respective period reaches its second day, so again those tags may output hyphens. When hyphens are output, output modifiers have no effect.

To give you an idea what these modifiers are about let's start with a simple example. Suppose you want date/time in ISO 8601 format:

  1. This means, something like 2019-02-28 06:59:05.
  2. Take the tag name (from tables on the Full list of Webtags page)
  3. Simply modify the web tag as shown here <#tag_name format="yyyy-MM-dd HH:mm:ss"> where tag_name is set from step 1, but all the rest is typed as shown.
  4. To explain each element in that format value, look in links above.

NOTE: The character % used in the format strings defines the following character as a custom format specifier. E.g. <#date format=%h> produces the hour while <#date format=h> produces an error because the 'h' as single standard format character does not exist.

NOTE: The character \ used in format strings takes the next character as a literal in the output string. E.g. <#date format="%h \h"> produces '10 h'.

NOTE: Any other character is copied to the result string unchanged. E.g. <#date format="Some text %h \h"> produces 'So16e aexa 10 h' and <#date format="So\m\e \tex\t %h \h"> produces 'Some text 10 h'.

Locales

The default format for webtags reporting date and/or time is dependent on the locale you are using.

The effect of some output format modifiers is also dependent on locale.

For CumulusMX date and time formats within Windows Operating System, you must use the Control Panel. Go to "Clock and Region" screen, choose "Change date, time or number formats", choose "Language preferences" because it is only there that you can adjust all the defaults used by .NET.

For CumulusMX running on most operating systems (other than Microsoft Windows), type locale to see the default locale that will be adopted by CumulusMX. It will, by default, take locale setting through Mono. When you start CumulusMX, you can ask it to use a different locale to that picked up by Mono, by adding the parameter "-lang locale-code", see examples at MX_on_Linux#Parameters. For example, the Australian English language with UTF-8 encoding locale is defined as: en_AU.UTF-8. The available locales on your computer in Linux are listed by locale -a.

For permanently changing the locale used by your system, the instructions vary considerably according to the kernel used in your operating system, so you need to look up the instructions for yourself. However, if you have a graphical user interface, such as the full Raspberry Pi Operating System provides, you might have a configuration command in terminal mode and a configuration app accessed (within Preferences) from the "Raspberry" key on the official keyboard. For the Raspberry Pi, please read Raspberry Pi computer page for more details.

Time zones

All web tag outputs are in local time, except <#timeUTC>.

In most MX releases, you can use a script to convert a time to UTC. This is not the place to tell you how to write the script, but taking time of highest pressure today as an example, you would use <#TpressTH format=Hh:mm> and <#TpressTH format=zzz>, the first gives hours and minutes in your local time, and the second gives the offset that needs to be applied to that time to convert it to UTC.

Time resolution

Seconds are supported but may be rounded down or up to 00 (e.g. <#LastDataReadT> supports seconds, but <#LastRainTip> is reported rounded back to previous minute and <#TrrateTM> is reported rounded forward to the next minute. It is up to the user to format what he wants and adjust that format.

Conversion from legacy Cumulus to CumulusMX

You have to change, at least check, all date/time formatting for Webtags you use when moving from the legacy Cumulus 1 to CumulusMX.

Best method probably is to migrate to CumulusMX. Then first check your log on Webtag error and then look at your website or reports - wherever you use your Webtags - and check your date/time formats. Then modify where you think it is required.