Execo On G5K: Difference between revisions
Lpouilloux (talk | contribs) mNo edit summary |
No edit summary |
||
(14 intermediate revisions by 5 users not shown) | |||
Line 14: | Line 14: | ||
suited for quick and easy creation of reproducible experiments on | suited for quick and easy creation of reproducible experiments on | ||
distributed hosts. It is a huge improvement over using shell script | distributed hosts. It is a huge improvement over using shell script | ||
for experiment development. You can have a look at the [[File:Execo_G5K.pdf|presentation]]. | for experiment development. | ||
You can have a look at the following presentation: | |||
[[File:Execo_G5K.pdf|presentation]]. | |||
It offers: | It offers: | ||
* Asynchronous control of local and remote commands. | * Asynchronous control of local and remote commands. | ||
* Efficient and scalable execution (transparent usage of [[TakTuk]]). | * Efficient and scalable execution (transparent usage of [[Using TakTuk|TakTuk]]). | ||
* Interaction with Grid'5000 resources (planning, submission, deployment, API). | * Interaction with Grid'5000 resources (planning, submission, deployment, API). | ||
* Tools for rapid development of reproducible experiments. | * Tools for rapid development of reproducible experiments. | ||
Line 29: | Line 33: | ||
Connect on a frontend and use easy_install: | Connect on a frontend and use easy_install: | ||
{{Term|location=frontend|cmd=<code class="command">easy_install</code> --user execo}} | {{Term|location=frontend|cmd=<code class="command">easy_install</code> --user execo}} | ||
Optionaly create a file name ''.execo.conf.py'' in your home directory if you need some specific | |||
[https://mimbert.gitlabpages.inria.fr/execo/execo_g5k.html#execo-g5k-configuration configuration] | |||
[ | |||
==Usage== | ==Usage== | ||
===Process management=== | ===Process management=== | ||
To learn how to manage local and ssh process, have a look at [ | To learn how to manage local and ssh process, have a look at [https://mimbert.gitlabpages.inria.fr/execo/userguide.html#processes Process examples] | ||
===Working with G5K=== | ===Working with G5K=== | ||
To know how to interact with Grid'5000 infrastrucure (jobs, deployment, planning, API), | To know how to interact with Grid'5000 infrastrucure (jobs, deployment, planning, API), see the [https://mimbert.gitlabpages.inria.fr/execo/userguide.html#execo-g5k execo g5k section] of the user guide. | ||
===Automating experiments=== | ===Automating experiments=== | ||
Execo offers an engine that allows to automatize experiments. An example measuring TCP congestion on Grid'5000 can be found [ | Execo offers an engine that allows to automatize experiments. An example measuring TCP congestion on Grid'5000 can be found [https://mimbert.gitlabpages.inria.fr/execo/userguide.html#using-execo-engine-for-experiment-development here] | ||
==Documentation== | ==Documentation== | ||
A complete user guide is available [ | A complete user guide is available [https://mimbert.gitlabpages.inria.fr/execo/userguide.html here]. | ||
You may also want to have a look at [ | You may also want to have a look at [https://mimbert.gitlabpages.inria.fr/execo/apidoc.html API reference]. | ||
A grid5000 tutorial is available: [[Execo Practical Session]] |
Latest revision as of 12:18, 28 September 2021
Execo offers a Python API to manage processes execution. It is well suited for quick and easy creation of reproducible experiments on distributed hosts. It is a huge improvement over using shell script for experiment development. You can have a look at the following presentation: It offers:
|
Installation
Connect on a frontend and use easy_install:
Optionaly create a file name .execo.conf.py in your home directory if you need some specific configuration
Usage
Process management
To learn how to manage local and ssh process, have a look at Process examples
Working with G5K
To know how to interact with Grid'5000 infrastrucure (jobs, deployment, planning, API), see the execo g5k section of the user guide.
Automating experiments
Execo offers an engine that allows to automatize experiments. An example measuring TCP congestion on Grid'5000 can be found here
Documentation
A complete user guide is available here. You may also want to have a look at API reference. A grid5000 tutorial is available: Execo Practical Session