Lyon:Wattmetre: Difference between revisions

From Grid5000
Jump to navigation Jump to search
Line 14: Line 14:


The "raw" data collected by wattmetres, including the 50 measurements made each second, is stored in CSV files and available from Grid5000 to download at: http://wattmetre.lyon.grid5000.fr/data
The "raw" data collected by wattmetres, including the 50 measurements made each second, is stored in CSV files and available from Grid5000 to download at: http://wattmetre.lyon.grid5000.fr/data
For each wattmetre, a new file is recorded at the beginning of every hour (files from past hours are kept compressed). The file name format is "power.csv.<YYYY-MM-DD>T<HH>", where <YYYY-MM-DD> is the date of the recording and <HH> the hour when it begun.


Here is the meaning of columns in the CSV files:
Here is the meaning of columns in the CSV files:

Revision as of 16:15, 30 August 2018

From September 2018, electrical power consumption of every nodes at Lyon is monitored by new "wattmetres" devices, enhancing old wattmetres previously available.

For each plug supplying electrical power to Lyon nodes, wattmetres perform up to 50 measurments of the power consumption each second.

Accessing monitoring data

Warning.png Warning

Subject to change! API and URLs to access monitoring data are likely to change in the future.

From Kwapi

Wattmetre data is available using Kwapi. For instance, see Energy monitoring tutorial for more information about Kwapi usage. There is no changes in data stored in Kwapi compared to the old wattmetres: it still stores the average power consumption each second for every Lyon's nodes

Getting access to raw values

The "raw" data collected by wattmetres, including the 50 measurements made each second, is stored in CSV files and available from Grid5000 to download at: http://wattmetre.lyon.grid5000.fr/data

For each wattmetre, a new file is recorded at the beginning of every hour (files from past hours are kept compressed). The file name format is "power.csv.<YYYY-MM-DD>T<HH>", where <YYYY-MM-DD> is the date of the recording and <HH> the hour when it begun.

Here is the meaning of columns in the CSV files:

  • 1st and 2nd columns: Debugging information (these columns will be removed in the future)
  • 3rd column: Timestamp when the measure was performed (as number of seconds and nano-seconds since 00:00:00 1970-01-01 UTC).
  • 4th column: Must be "OK" if the measure has correctly been performed, other it should be discarded
  • From 5th column to the last: Electrical power consumed for each wattmetre's port. The 5th column shows value for port number 0, the 6th for port number 1, etc. Sometimes the value may be missing for a particular port. It means that wattmetre was not able to compute it correctly.

The mapping between wattmetres' ports and Grid'5000 nodes is available in the Reference API. For instance, nodes connected to "wattmetre1" are described at:

https://api.grid5000.fr/stable/sites/lyon/pdus/wattmetre1?pretty

under "ports" section, and wattmetre and port number connected to "nova-1" node is available at:

https://api.grid5000.fr/stable/sites/lyon/clusters/nova/nodes/nova-1

under "sensors/power/via/pdu" section.

Getting "live" values directly from wattmetres

Live energy monitoring previously provided by "old" wattmetres remains available at URL http://wattmetre.lyon.grid5000.fr/GetWatts-json.php

It still provides for each node the average electrical power consumed during the latest second of measurements.

Getting access to old wattmetre data

Raw monitoring data stored on old wattmetre server is archived and accessible under /grid5000/wattmetre-archives at from Lyon site.