Hemera: Difference between revisions

From Grid5000
Jump to navigation Jump to search
 
(11 intermediate revisions by 2 users not shown)
Line 10: Line 10:


Publications around Grid'5000 are available as a [http://hal.inria.fr/GRID5000/fr/ HAL collection].
Publications around Grid'5000 are available as a [http://hal.inria.fr/GRID5000/fr/ HAL collection].
== Scientific Challenges ==
Scientific challenges concentrate effort of some partners on well defined issues, such as
a particular experiment on Grid’5000. Scientific challenges are expected to be bound
in time. However, a scientific challenge may contain several sub-challenges, typically
representing various steps toward the ultimate challenges.
[[Hemera:SC|List of scientifc challenges]]
== Working Groups ==
Working groups aims to animate a part of the community around scientific themes
[[Hemera:WG|List of working groups]].
==Tools==
Some [[Hemera:Tools|tools ]] have been developped during the Hemera initiative to ease making experiments on Grid'5000.
They are related to experiment workflow engines, experiment planification, virtualization, monitoring, storage, and network topology.


== News ==
== News ==
* 2014, December 17: Final project evaluation
* 2014, December 3 : V. Villebonnet (Hemera Phd student between IRIT and Avalon teams) and L. Lefevre present "Towards Generalizing "Big.Little" for Energy Proportional HPC and Cloud Infrastructures" during [ http://www.swinflow.org/confs/susc2014/ Sustaincom 2014 conference]
* 2014, December 3 : V. Villebonnet (Hemera Phd student between IRIT and Avalon teams) and L. Lefevre present "Towards Generalizing "Big.Little" for Energy Proportional HPC and Cloud Infrastructures" during [ http://www.swinflow.org/confs/susc2014/ Sustaincom 2014 conference]
* 2014, October 8 : B. Cornea (Hemera Postdoc between Myriads and Avalon teams) presents [http://www.ieee-cloudnet.org/program.html "Studying the energy consumption of data transfers in Clouds: the Ecofen" approach] in IEEE CloudNet2014 Conference (Luxembourg)
* 2014, October 8 : B. Cornea (Hemera Postdoc between Myriads and Avalon teams) presents [http://www.ieee-cloudnet.org/program.html "Studying the energy consumption of data transfers in Clouds: the Ecofen" approach] in IEEE CloudNet2014 Conference (Luxembourg)
Line 36: Line 57:
* 2011, April 1st: Creation of a new scientific challenge: [[Hemera:SC:Orchestration|Orchestrating Experiments on the gLite Production Grid Middleware]].
* 2011, April 1st: Creation of a new scientific challenge: [[Hemera:SC:Orchestration|Orchestrating Experiments on the gLite Production Grid Middleware]].
* 2010 October 5th: The [[kickoff meeting]] was hold in Paris.
* 2010 October 5th: The [[kickoff meeting]] was hold in Paris.
== Scientific Challenges ==
Scientific challenges concentrate effort of some partners on well defined issues, such as
a particular experiment on Grid’5000. Scientific challenges are expected to be bound
in time. However, a scientific challenge may contain several sub-challenges, typically
representing various steps toward the ultimate challenges.
=== Active scientific challenges ===
* ''System''
** '''[[Hemera:SC:Energy|Energy Profiling of Large Scale Applications]]''' -- Laurent Lefèvre (AVALON), Jean-Marc Pierson (IRIT),  Jean-Marc Menaud (ASCOLA)
** '''[[Hemera:SC:P2P-Ch|Robustness of Large Systems in Presence of High Churn]]''' -- Pierre Sens (REGAL), Jean-Marc Vincent (MESCAL)
* ''Programming Paradigm''
** '''[[Hemera:SC:COPs|Large Scale Computing for Combinatorial Optimization Problems]]''' -- Bilel Derbel (DOLPHIN), Nouredine Melab (DOLPHIN)
** '''[[Hemera:SC:MapRed|Scalable Distributed Processing Using the MapReduce Paradigm]]''' -- Gabriel Antoniu (KERDATA), Gilles Fedak (GRAAL)
* ''Domain Specific''
** '''[[Hemera:SC:Electro|Thinking GRID for Electromagnetic Simulation of Oversized Structures]]''' --  Hervé Aubert (MINC-LAAS), Thierry Monteil (MRS-LAAS), Patricia Stolf (ASTRE-IRIT)
* ''Virtualization''
** '''[[Hemera:SC:Virtualization|Large Scale Management of Virtual Machines]]''' -- Adrien Lèbre (ASCOLA)
=== Completed challenges===
* ''Network''
** '''[[Hemera:SC:Traffic|Traffic Awareness]]''' -- Paulo Gonçalves (RESO), K. Avrachenkov (MAESTRO)
* ''System''
** '''[[Hemera:SC:Orchestration|Orchestrating Experiments on the gLite Production Grid Middleware]]''' -- Lucas Nussbaum (ALGORILLE), Frédéric Suter (CC IN2P3).
* ''Programming Paradigm''
** '''[[ Hemera:SC:L2C exp |Low Level Component Model Enabling Performance Portability of HPC Applications]]''' -- Christian Perez (Avalon)
* ''Domain Specific''
** '''[[Hemera:SC:Hydro|Multi-parametric Intensive Stochastic Simulations for Hydrogeology]]''' --  Jocelyne Erhel (SAGE)
<!-- [[Hemera:SC_Matrix|Matrix]] of participation in scientific challenges. -->
<!-- DO NOT REMOVE:  <span style="color:red;">'''*NEW*'''</span> -->
== Working Groups ==
Working groups aims to animate a part of the community around scientific themes
The current list of working groups with their leaders is:
* '''[[Hemera:WG:Computing|Transparent, safe and efficient large scale computing]]''' -- Stéphane Genaud (ICPS), Fabrice Huet (OASIS)
* '''[[Hemera:WG:Green|Energy Efficient Large Scale Experimental Distributed Systems]]''' -- Laurent Lefèvre (AVALON), Jean-Marc Menaud (ASCOLA)
* '''[[Hemera:WG:Virtualization|Bring Grids Power to Internet-Users thanks to Virtualization Technologies]]''' -- Adrien Lèbre (ASCOLA), Yvon Jégou (MYRIADS)
* '''[[Hemera:WG:Scheduling|Efficient exploitation of highly heterogeneous and hierarchical large-scale systems]]''' Olivier Beaumont (CEPAGE), Fré́dé́ric Vivien (GRAAL)
* '''[[Hemera:WG:Data|Efficient management of very large volumes of information for data-intensive applications]]''' -- Gabriel Antoniu (KERDATA), Jean-Marc Pierson (ASTRE)
* '''[[Hemera:WG:Methodology|Completing challenging experiments on Grid’5000]]''' -- Lucas Nussbaum (ALGORILLE), Olivier Richard (MESCAL)
* '''[[Hemera:WG:Simulators|Modeling Large Scale Systems and Validating their Simulators]]''' -- Martin Quinson (ALGORILLE), Arnaud Legrand (MESCAL)
* '''[[Hemera:WG:Metrology|Network metrology and traffic characterization]]''' -- Paulo Gonçalves (RESO), Konstantin Avrachenkov (MAESTRO)
[[Hemera::WG_Matrix|Matrix]] of participation in working groups.


== Members ==
== Members ==
Line 95: Line 67:
* ASCOLA - Aspect and composition languages
* ASCOLA - Aspect and composition languages
* AVALON - Algorithms and Software Architectures for Distributed and HPC Platforms
* AVALON - Algorithms and Software Architectures for Distributed and HPC Platforms
* CEDAR -  Constraint Event-Driven Automated Reasoning
* CC-IN2P3 - Equipe de recherche du Centre de Calcul de l'IN2P3
* CC-IN2P3 - Equipe de recherche du Centre de Calcul de l'IN2P3
* CEPAGE - Chercher et Essaimer dans les Plates-formes A Grande Echelle
* CEPAGE - Chercher et Essaimer dans les Plates-formes A Grande Echelle
Line 114: Line 87:
* SEPIA - Distributed Systems, from Architecture to Middleware (formerly ASTRE team)  
* SEPIA - Distributed Systems, from Architecture to Middleware (formerly ASTRE team)  
* ZENITH - Scientific Data Management
* ZENITH - Scientific Data Management
==Tools==
Here we present the tools which have been developped by Hemera people to ease large scale experiments on Grid'5000.
===Experimental engines===
===Experiment planification===
A new module has been added to [https://execo.gforge.inria.fr Execo] to directly access to the OAR database and retrieve the planning of the various ressources available on the Grid'5000 sites. This module can be used in a Python experimental script (see [http://execo.gforge.inria.fr/doc/latest-stable/userguide.html#check-cpu-performance-settings-of-each-grid5000-clusters Execo planning example]).
For non-Python user, a command line tool has been used and is installed on any Grid'5000 frontend: [[Funk]]. It ease a lot multi-site experiment planification.
===Virtualization===
===Monitoring===
===Storage===
===Network topology===

Latest revision as of 10:47, 8 December 2014


Overview

Héméra is a INRIA large scale initiative , started in 2010, that aims at demonstrating ambitious up-scaling techniques for large scale distributed computing by carrying out several dimensioning experiments on the Grid’5000 infrastructure, at animating the scientific community around Grid’5000 and at enlarging the Grid’5000 community by helping newcomers to make use of Grid’5000. It is not restricted to INRIA teams.

Publications around Grid'5000 are available as a HAL collection.

Scientific Challenges

Scientific challenges concentrate effort of some partners on well defined issues, such as a particular experiment on Grid’5000. Scientific challenges are expected to be bound in time. However, a scientific challenge may contain several sub-challenges, typically representing various steps toward the ultimate challenges.

List of scientifc challenges

Working Groups

Working groups aims to animate a part of the community around scientific themes

List of working groups.

Tools

Some tools have been developped during the Hemera initiative to ease making experiments on Grid'5000. They are related to experiment workflow engines, experiment planification, virtualization, monitoring, storage, and network topology.

News

Members

The current list of teams participating to Héméra is:

  • ACADIE - Assistance à la Certification d’Applications DIstribuées et Embarquées
  • ALGORILLE - Algorithms for the Grid
  • APO - Algorithmes Parallèles et Optimisation
  • ASAP - As Scalable As Possible: foundations of large scale dynamic distributed systems
  • ASCOLA - Aspect and composition languages
  • AVALON - Algorithms and Software Architectures for Distributed and HPC Platforms
  • CEDAR - Constraint Event-Driven Automated Reasoning
  • CC-IN2P3 - Equipe de recherche du Centre de Calcul de l'IN2P3
  • CEPAGE - Chercher et Essaimer dans les Plates-formes A Grande Echelle
  • DOLPHIN - Parallel Cooperative Multi-criteria Optimization
  • GRAAL - Algorithms and Scheduling for Distributed Heterogeneous Platforms.
  • GRAND-LARGE - Global parallel and distributed computing
  • ICPS - Scientific Parallel Computing and Imaging
  • KERDATA - Scalable Storage for Clouds and Beyond
  • OASIS - Active objects, semantics, Internet and security.
  • MAESTRO - Models for the performance analysis and the control of networks
  • MESCAL - Middleware efficiently scalable
  • MINC - MIcro et Nanosystèmes pour les Communications sans fils
  • MRS – Modélisation et contrôle des Réseaux et Signaux
  • MYRIADS - Design and Implementation of Autonomous Distributed Systems
  • REGAL - Large-Scale Distributed Systems and Applications
  • RESO - Protocols and Software for Very High-Performance Network
  • RUNTIME - Efficient runtime systems for parallel architectures
  • SAGE - Simulations and Algorithms on Grids for Environment
  • SEPIA - Distributed Systems, from Architecture to Middleware (formerly ASTRE team)
  • ZENITH - Scientific Data Management
Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Hemera&oldid=52247"