Lyon:Wattmetre: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
 
(7 intermediate revisions by 3 users not shown)
Line 1: Line 1:
From September 2018, electrical power consumption of every nodes at Lyon is monitored by new "wattmetres" devices, enhancing old wattmetres previously available.
{{Portal|User}}
From September 2018, electrical power consumption of all nodes in Lyon (except Nova cluster) is monitored by new "wattmetre" devices from [http://www.omegawatt.fr/ Omegawatt], enhancing old wattmetres previously available.


For each plug supplying electrical power to Lyon nodes, wattmetres perform up to 50 measurments of the power consumption each second.
For each plug supplying electrical power to Lyon nodes, the wattmetre devices perform up to 50 measurements of the power consumption per second.


== Accessing monitoring data ==
Their usage is described in the [[Energy_consumption_monitoring_tutorial#On_Lyon_site_and_Grenoble.27s_yeti_cluster|Energy_consumption_monitoring_tutorial]].


{{Warning| text=Subject to change! API and URLs to access monitoring data are likely to change in the future.}}
Monitoring data from the old wattmetre server is archived and accessible under /grid5000/wattmetre-archives directory of Lyon site.


=== From Kwapi ===
The mapping between wattmetre ports and monitored hosts is described in the reference API. However, some information are not present yet:
 
* Wattmetre 3, port 25 & 26: hercule cluster (the 4 nodes share 2 PSU)
Wattmetre data is available using Kwapi. For instance, see [[Energy_consumption_monitoring_tutorial#Using_Kwapi for more information|Energy monitoring tutorial]] for more information about Kwapi usage. There is no changes in data stored in Kwapi compared to the old wattmetres: it still stores the average power consumption each second for every Lyon's nodes
* Wattmetre 3, port 28: "force10" network switch
 
* Wattmetre 3, port 29 & 30: wattmetre monitoring server
=== Getting access to raw values ===
* Wattmetre 1, port 34 : Infiniband switch ("swib")
 
* Wattmetre 1, port 36 & 37 : gw.lyon router
The "raw" data collected by wattmetres, including the 50 measurements made each second, is stored in CSV files and available from Grid5000 to download at: http://wattmetre.lyon.grid5000.fr/data
* Wattmetre 1, port 39 : sagittaire switch ("swsag")
 
* Wattmetre 1, port 42 : albireo-a first PSU
For each wattmetre, a new file is recorded at the beginning of every hour (files from past hours are kept compressed). The file name format is "power.csv.<YYYY-MM-DD>T<HH>", where <YYYY-MM-DD> is the date of the recording and <HH> the hour when it begun.
* Wattmetre 1, port 42 : albireo-b first PSU
 
* Wattmetre 1, port 42 : alcor first PSU
Here is the meaning of columns in the CSV files:
* 1st and 2nd columns: Debugging information (these columns will be removed in the future)
* 3rd column: Timestamp when the measure was performed (as number of seconds and nano-seconds since 00:00:00 1970-01-01 UTC).
* 4th column: Must be "OK" if the measure has correctly been performed, other it should be discarded
* From 5th column to the last: Electrical power consumed for each wattmetre's port. The 5th column shows value for port number 0, the 6th for port number 1, etc. Sometimes the value may be missing for a particular port. It means that wattmetre was not able to compute it correctly.
 
The mapping between wattmetres' ports and Grid'5000 nodes is available in the Reference API. For instance, nodes connected to "wattmetre1" are described at:
 
https://api.grid5000.fr/stable/sites/lyon/pdus/wattmetre1
 
under "ports" section, and wattmetre and port number connected to "nova-1" node is available at:
 
https://api.grid5000.fr/stable/sites/lyon/clusters/nova/nodes/nova-1
 
under "sensors/power/via/pdu" section.
 
A python sample code is available [https://gitlab.inria.fr/delamare/wattmetre-read/raw/master/tools/getwatt.py here] to help getting these power values.
 
=== Getting "live" values directly from wattmetres ===
 
Live energy monitoring previously provided by "old" wattmetres remains available at URL http://wattmetre.lyon.grid5000.fr/GetWatts-json.php
 
It still provides for each node the average electrical power consumed during the latest second of measurements.
 
=== Getting access to old wattmetre data ===
 
Raw monitoring data stored on old wattmetre server is archived and accessible under /grid5000/wattmetre-archives directory from Lyon site.

Latest revision as of 15:19, 18 January 2021

From September 2018, electrical power consumption of all nodes in Lyon (except Nova cluster) is monitored by new "wattmetre" devices from Omegawatt, enhancing old wattmetres previously available.

For each plug supplying electrical power to Lyon nodes, the wattmetre devices perform up to 50 measurements of the power consumption per second.

Their usage is described in the Energy_consumption_monitoring_tutorial.

Monitoring data from the old wattmetre server is archived and accessible under /grid5000/wattmetre-archives directory of Lyon site.

The mapping between wattmetre ports and monitored hosts is described in the reference API. However, some information are not present yet:

  • Wattmetre 3, port 25 & 26: hercule cluster (the 4 nodes share 2 PSU)
  • Wattmetre 3, port 28: "force10" network switch
  • Wattmetre 3, port 29 & 30: wattmetre monitoring server
  • Wattmetre 1, port 34 : Infiniband switch ("swib")
  • Wattmetre 1, port 36 & 37 : gw.lyon router
  • Wattmetre 1, port 39 : sagittaire switch ("swsag")
  • Wattmetre 1, port 42 : albireo-a first PSU
  • Wattmetre 1, port 42 : albireo-b first PSU
  • Wattmetre 1, port 42 : alcor first PSU
Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Lyon:Wattmetre&oldid=89996"