Back to Table of contents

Primeur weekly 2019-10-28

Special

NEXTGenIO project to deliver brand new system with revolutionary memory for better performance and dissolving I/O bottlenecks ...

Weather forecasts will be improved with exascale systems - Tiago Quintino from ECMWF explains how NextGenIO project contributes ...

Quantum computing

The race to commercially-viable quantum computing is a marathon, not a sprint ...

Forschungszentrum Jülich contributed to Google's demonstration of quantum supremacy ...

Quantum supremacy milestone harnesses ORNL Summit supercomputer ...

Google and NASA achieve quantum supremacy ...

D-Wave announces first European Leap quantum Cloud site ...

Focus on Europe

New UKRI Director for e-Infrastructure appointed ...

e-IRG issues Call for Participation to second Open Workshop in 2019 under Finnish EU Presidency ...

Successful integration of EOSC catalogue services in the e-Infrastructure Knowledge Base ...

First Cray Shasta system in Europe will be the UK's most powerful supercomputer ...

New Cray supercomputer brings advanced AI capabilities to the High-Performance Computing Center Stuttgart ...

Tachyum's Slovakia R&D Center expands its workforce: Reversing Brain Drain to Brain Gain ...

Hardware

Cadence announces first-to-market NVMe 1.4 verification IP for high-performance computing ...

Ericsson and NVIDIA collaborate to accelerate virtualized 5G radio access networks with GPUs ...

New NVIDIA EGX Edge Supercomputing Platform accelerates AI, IoT, 5G at the Edge ...

Red Hat and NVIDIA team to bring high-performance, software-defined 5G RAN to telecom industry ...

Hyperion Research growth spurs search for new hires ...

Fujitsu, SMU, and A*STAR launch Digital Platform Experimentation Project using quantum-inspired computing and Deep Learning technology ...

Supermicro servers support breakthrough NVIDIA EGX platform delivering AI processing and management from the data centre to the edge ...

Aldec at DVCon Europe: Demonstrating a hybrid co-verification platform for ASIC/SoC projects and automated FPGA partitioning software ...

Applications

Indiana University professor receives high performance computing award ...

World's fastest supercomputer processes huge data rates in preparation for mega-telescope project ...

HiDALGO: Merging HPC and high-performance data analytics to address global challenges ...

HLRS recognized three users of its Hazel Hen supercomputer for their scientific excellence and innovative applications in parallel computing ...

Collaboration with HLRS helps Südwestrundfunk develop music recommendation software ...

American Chemical Society graduate students benefit from SDSC support ...

Fujitsu develops technology to automatically adjust computing accuracy to accelerate AI processing by 10 fold ...

The Cloud

NVIDIA with Microsoft announces technology collaboration for era of intelligent edge ...

Weather forecasts will be improved with exascale systems - Tiago Quintino from ECMWF explains how NextGenIO project contributes


28 Oct 2019 Edinburgh - At the 75th HPC User Forum in Edinburgh, Tiago Quintino from the European Centre of Medium-Range Weather Forcasts (ECMWF) explained that the NextGenIO project brought better weather forecasts one step closer by demonstrating a new type of storage called NVRAM that sits between computer memory and disk memory and can be used to process the large amounts of data needed in a weather forecast.

Tiago Quintino explained in his presentation that ECMWF runs several simulation models that run weather forecasts on their supercomputer. Simulations are run every day, so there is a time critical component. The quality of the model can be improved by doing calculations on smaller "grids". Currently the smallest grid is 9 km by 9km. To get better weather predictions the grid size must be reduced. Also the number of different related simulations, called ensembles, should be increased. This leads to much more data that needs to be processed. If you do not want to increase the predication time, you need a faster computer, hence ECMWF's look into exascale supercomputing.

Currently, getting data in and out of the computer's processors fast enough is a bottleneck. This is called the I/O issue. Disks are slow. Flash disks are faster than rotating disks, but still slow compared to memory speed. A typical next generation forecast on a 1,25 km grid containing a 50 times increase of ensemble size, would lead to about 3,6 petabyte of data to be handled. This would need an exascale computer to process.

This is where the NEXTGenIO project comes in. NEXTGenIO produced a prototype HPC system based on Intel 3D XPoint technology. ECMWF's task in the project was to explore the interaction within the I/O server layer and to test and assess the system scalability. NEXTGenIO was a co-design project, so ECMWF also brought in application expertise and interacted with hardware, middleware and software developers.

The experiments using NVRAM on the NEXTGenIO system are very promising. It removed the bottleneck from reading and writing to the parallel file system on disk. And for realistic experiments, it is not even used up to its full speed: it could handle more data.

The current NEXTGenIO prototype which is located at EPCC in Edinburgh contains 16 nodes. A system containing 213 of these nodes would be able to handle the full 1,25 km forecast. So, from an I/O point of view, NEXTGenIO showed it is ready for exascale. ECMWF expects to run these models by 2035, by then the technology will be further improved and cheaper than today.

But using this type of NVRAM could also open up new applications.

Watch the full presentation of Tiago Quintino:

Ad Emmen

Back to Table of contents

Primeur weekly 2019-10-28

Special

NEXTGenIO project to deliver brand new system with revolutionary memory for better performance and dissolving I/O bottlenecks ...

Weather forecasts will be improved with exascale systems - Tiago Quintino from ECMWF explains how NextGenIO project contributes ...

Quantum computing

The race to commercially-viable quantum computing is a marathon, not a sprint ...

Forschungszentrum Jülich contributed to Google's demonstration of quantum supremacy ...

Quantum supremacy milestone harnesses ORNL Summit supercomputer ...

Google and NASA achieve quantum supremacy ...

D-Wave announces first European Leap quantum Cloud site ...

Focus on Europe

New UKRI Director for e-Infrastructure appointed ...

e-IRG issues Call for Participation to second Open Workshop in 2019 under Finnish EU Presidency ...

Successful integration of EOSC catalogue services in the e-Infrastructure Knowledge Base ...

First Cray Shasta system in Europe will be the UK's most powerful supercomputer ...

New Cray supercomputer brings advanced AI capabilities to the High-Performance Computing Center Stuttgart ...

Tachyum's Slovakia R&D Center expands its workforce: Reversing Brain Drain to Brain Gain ...

Hardware

Cadence announces first-to-market NVMe 1.4 verification IP for high-performance computing ...

Ericsson and NVIDIA collaborate to accelerate virtualized 5G radio access networks with GPUs ...

New NVIDIA EGX Edge Supercomputing Platform accelerates AI, IoT, 5G at the Edge ...

Red Hat and NVIDIA team to bring high-performance, software-defined 5G RAN to telecom industry ...

Hyperion Research growth spurs search for new hires ...

Fujitsu, SMU, and A*STAR launch Digital Platform Experimentation Project using quantum-inspired computing and Deep Learning technology ...

Supermicro servers support breakthrough NVIDIA EGX platform delivering AI processing and management from the data centre to the edge ...

Aldec at DVCon Europe: Demonstrating a hybrid co-verification platform for ASIC/SoC projects and automated FPGA partitioning software ...

Applications

Indiana University professor receives high performance computing award ...

World's fastest supercomputer processes huge data rates in preparation for mega-telescope project ...

HiDALGO: Merging HPC and high-performance data analytics to address global challenges ...

HLRS recognized three users of its Hazel Hen supercomputer for their scientific excellence and innovative applications in parallel computing ...

Collaboration with HLRS helps Südwestrundfunk develop music recommendation software ...

American Chemical Society graduate students benefit from SDSC support ...

Fujitsu develops technology to automatically adjust computing accuracy to accelerate AI processing by 10 fold ...

The Cloud

NVIDIA with Microsoft announces technology collaboration for era of intelligent edge ...