Back to Table of contents

Primeur weekly 2018-10-29

Exascale supercomputing

Mind Commerce releases findings from Exascale computing market research ...

China launches third prototype exascale computer ...

Quantum computing

Quantum Technologies Flagship kicks off with first 20 projects ...

Quantum Xchange selects Zayo Group for dark fiber to deploy first quantum network in the United States ...

Shielded quantum bits ...

Quantum network to test unhackable communications ...

Artificial intelligence controls quantum computers ...

Focus on Europe

TETRAMAX launches the largest pan-European technology brokerage network on customized low-energy computing ...

Maestro Consortium addresses the ubiquitous problems of data movement in data-intensive applications and workflows ...

Hardware

Cray and Stradigi AI partner to crack the code on enterprise AI implementation ...

Mellanox ships more than 2.1 million Ethernet adapters in the first three quarters of 2018 ...

Mellanox delivers five consecutive quarters of record results ...

DDN shatters SPEC SFS 2014 benchmark records ...

Lawrence Livermore unveils NNSA's Sierra, world's third fastest supercomputer ...

AI acceleration with NEC's new vector computer ...

Trisymbiotic IP, a small start-up, announces U.S. Patent 10,020,436 which surpasses in facilities efficiency the fastest supercomputers from the U.S. and China ...

Applications

Department of Energy to issue upcoming solicitation for High Performance Computing Initiative ...

Shaheen sets subsurface mapping world record ...

Unprecedented insight into the sun's fusion reactor ...

Dr. David E. Shaw selected to receive 2018 IEEE-CS Seymour Cray Computer Engineering Award ...

HPC-AI Advisory Council and Stanford High Performance Computing Center announce 9th Annual Stanford Conference, February 2019 ...

The Cloud

IBM to acquire Red Hat, completely changing the Cloud landscape and becoming world's first hybrid Cloud provider ...

Altair and Oracle offer faster high-performance computing in the Cloud ...

Oracle Cloud gives easy access to partner solutions ...

NetApp Data Fabric enables businesses to drive competitive advantage with AI ...

EuroFlash

Gauss Centre for Supercomputing supports team deFAUlt at SC18 Student Cluster Competition ...

Maestro Consortium addresses the ubiquitous problems of data movement in data-intensive applications and workflows

25 Oct 2018 A Coruna - Appentra, the French Alternative Energies and Atomic Energy Commission (CEA), Cray, the Swiss National Supercomputing Centre (CSCS) operated by ETH Zurich, the European Centre for Medium-Range Weather Forecasts (ECMWF), Jülich Supercomputing Centre and Seagate Technologies have formed a new consortium that will address the ubiquitous problems of data movement in data-intensive applications and workflows. The "Maestro" consortium will be supported by a three-year grant from the European Commission's H2020 Future Enabling Technologies for HPC (FETHPC) programme, to build a data- and memory-aware middleware framework for data-intensive computing.

The Maestro project has been set up to tackle one of the most important and difficult problems in HPC, namely the orchestration of data across multiple levels of the memory and storage hardware as well as the software stack. Although data movement is now recognized as the primary obstacle to performance efficiency, much of the software stack is not well suited to optimizing data movement, and was instead designed in an age where optimizing arithmetic operations was the priority. The Maestro project aims to capture the data- and memory-aware aspects of applications and the software stack into a new middleware layer which will perform basic data movement and optimisation on behalf of the application, also making use of modern memory systems.

Prof. Dirk Pleiter, Coordinator of the Maestro project, stated: "The Maestro project will provide a unique opportunity to challenge traditional approaches for handling data objects and data movements in complex HPC applications and workflows, which will be key for efficient exploitation of future exascale level supercomputers."

Maestro will build a data-aware and memory-aware middleware framework that addresses ubiquitous problems of data movement in complex memory hierarchies and at many levels of the HPC software stack. The Maestro consortium consists of 7 expert partners, each bringing specialist knowledge and expertise to the technical challenge. Forschungszentrum Juelich will provide overall coordination and leadership of the project, as well as being responsible for one example use-case. Cray will provide technical coordination and will lead the core middleware design efforts.

ECMWF will provide their production and research numerical weather prediction workflows as an example use-case to drive the direction of the project, and will co-design many aspects of the middleware. Seagate Technologies will develop an Object storage back-end to the middleware and interface Maestro to it. CEA will develop an in-situ framework based on the Maestro middleware. Appentra Solutions will enhance their Parallelware software for data awareness to support the Maestro middleware. CSCS operated by ETH Zurich will develop a dynamic provisioning system targeting data-intensive applications.
Source: Maestro

Back to Table of contents

Primeur weekly 2018-10-29

Exascale supercomputing

Mind Commerce releases findings from Exascale computing market research ...

China launches third prototype exascale computer ...

Quantum computing

Quantum Technologies Flagship kicks off with first 20 projects ...

Quantum Xchange selects Zayo Group for dark fiber to deploy first quantum network in the United States ...

Shielded quantum bits ...

Quantum network to test unhackable communications ...

Artificial intelligence controls quantum computers ...

Focus on Europe

TETRAMAX launches the largest pan-European technology brokerage network on customized low-energy computing ...

Maestro Consortium addresses the ubiquitous problems of data movement in data-intensive applications and workflows ...

Hardware

Cray and Stradigi AI partner to crack the code on enterprise AI implementation ...

Mellanox ships more than 2.1 million Ethernet adapters in the first three quarters of 2018 ...

Mellanox delivers five consecutive quarters of record results ...

DDN shatters SPEC SFS 2014 benchmark records ...

Lawrence Livermore unveils NNSA's Sierra, world's third fastest supercomputer ...

AI acceleration with NEC's new vector computer ...

Trisymbiotic IP, a small start-up, announces U.S. Patent 10,020,436 which surpasses in facilities efficiency the fastest supercomputers from the U.S. and China ...

Applications

Department of Energy to issue upcoming solicitation for High Performance Computing Initiative ...

Shaheen sets subsurface mapping world record ...

Unprecedented insight into the sun's fusion reactor ...

Dr. David E. Shaw selected to receive 2018 IEEE-CS Seymour Cray Computer Engineering Award ...

HPC-AI Advisory Council and Stanford High Performance Computing Center announce 9th Annual Stanford Conference, February 2019 ...

The Cloud

IBM to acquire Red Hat, completely changing the Cloud landscape and becoming world's first hybrid Cloud provider ...

Altair and Oracle offer faster high-performance computing in the Cloud ...

Oracle Cloud gives easy access to partner solutions ...

NetApp Data Fabric enables businesses to drive competitive advantage with AI ...

EuroFlash

Gauss Centre for Supercomputing supports team deFAUlt at SC18 Student Cluster Competition ...