Back to Table of contents

Primeur live 2019-11-21

Exascale

NCI a founding member of Intel-Lenovo Project Everyscale  ...

Focus on Europe

ADVA and PSNC showcase 1200G channel transmission at SC19 ...

200 Gigabit HDR InfiniBand to accelerate Eni supercomputing platform, to become world's most powerful industrial supercomputer ...

IT4Innovations National Supercomputing Center, a EuroHPC supercomputing site, selected Mellanox 200G HDR InfiniBand to accelerate their new research infrastructure ...

Barcelona Supercomputing Center takes one of top spots in the IO500's "10-Node Challenge" at SC19 ...

Middleware

Univa announces advanced workload management for NVIDIA GPUs on Arm-based systems ...

Bright Computing makes award winning Bright Cluster Manager software free for clusters up to 8 nodes ...

NVIDIA launches Magnum IO software suite to help eliminate data bottlenecks for data scientists and AI, HPC researchers ...

Hardware

San Diego Supercomputer Center supersizes advanced storage with Qumulo for its data-intensive infrastructure ...

Liqid and Western Digital collaborate to deliver fully managed NVMe-oF open composable platform for shared accelerated storage ...

Liqid showcases software disaggregation for converged servers ...

TYAN showcases HPC, AI and storage server platforms featuring 2nd Gen Intel Xeon Scalable processors at SC19 ...

Beijing Meteorological Service selects 200 Gigabit HDR InfiniBand to accelerate new supercomputing platform ...

TMGcore unveils groundbreaking data centre platform at Supercomputing 2019 ...

Argonne National Laboratory deploys Cerebras CS-1, the world's fastest Artificial Intelligence computer ...

KAUST installs Cray CS-Storm 500NX supercomputer to drive strategic AI initiative ...

NVIDIA and tech leaders team to build GPU-accelerated Arm servers for new era of diverse HPC architectures ...

Penguin Computing to deliver Magma supercomputer, one of the first Intel Xeon Platinum 9200 Series processor-based servers for AI and HPC ...

Penguin Computing upgrades Corona with latest AMD Radeon Instinct GPU technology for enhanced ML and AI capabilities ...

San Diego Supercomputer Center selects Dell Technologies to power "Expanse" system ...

Supermicro collaborates with Intel to deliver large scale distributed training AI systems ...

Inspur showcases new liquid cooling HPC system with natural circulation evaporative cooling technology at SC19 ...

HDR InfiniBand selected by Meteo France to accelerate two new large scale supercomputers ...

Pavilion to provide NVMe-Over-Fabrics storage for SCinet'19 high performance computing (HPC) simulations ...

Applications

Registration for ASC20 Student Supercomputer Challenge ...

TOP500

CSC's Puhti ranked 232 on the latest supercomputer TOP500 list  ...

NCI supercomputer climbs TOP500 rankings  ...

The Cloud

2019 demand for Rescale-managed Cloud HPC exceeds all previous years combined ...

The Kinetica Active Analytics Platform and RAPIDS now available on Oracle Cloud Infrastructure to accelerate predictive data analytics performance ...

NVIDIA announces scalable GPU-accelerated supercomputer in the Microsoft Azure Cloud ...

Company news

ScaleMP to showcase SMP supremacy and composable computing innovations at SC19 ...

Qumulo demonstrates unified file storage at SC'19 that reduces administrative burden while consolidating HPC workloads ...

Dell Technologies introduces new solutions to advance high performance computing and AI innovation  ...

Supermicro delivers industry-leading portfolio of advanced HPC systems at SC19 ...

WekaIO unveils WIN, a global partner programme ...

NVIDIA launches Magnum IO software suite to help eliminate data bottlenecks for data scientists and AI, HPC researchers


18 Nov 2019 Denver - NVIDIA has introduced NVIDIA Magnum IO, a suite of software to help data scientists and AI and high performance computing researchers process massive amounts of data in minutes, rather than hours. Optimized to eliminate storage and input/output bottlenecks, Magnum IO delivers up to 20x faster data processing for multi-server, multi-GPU computing nodes when working with massive datasets to carry out complex financial analysis, climate modelling and other HPC workloads.

NVIDIA has developed Magnum IO in close collaboration with industry leaders in networking and storage, including DataDirect Networks, Excelero, IBM, Mellanox and WekaIO.

"Processing large amounts of collected or simulated data is at the heart of data-driven sciences like AI", stated Jensen Huang, founder and CEO of NVIDIA. "As the scale and velocity of data grow exponentially, processing it has become one of data centres' great challenges and costs."

"Extreme compute needs extreme I/O. Magnum IO delivers this by bringing NVIDIA GPU acceleration, which has revolutionized computing, to I/O and storage. Now, AI researchers and data scientists can stop waiting on data and focus on doing their life's work", he stated.

At the heart of Magnum IO is GPUDirect, which provides a path for data to bypass CPUs and travel on "open highways" offered by GPUs, storage and networking devices. Compatible with a wide range of communications interconnects and APIs - including NVIDIA NVLink and NCCL, as well as OpenMPI and UCX - GPUDirect is composed of peer-to-peer and RDMA elements.

Its newest element is GPUDirect Storage, which enables researchers to bypass CPUs when accessing storage and quickly access data files for simulation, analysis or visualization.

NVIDIA Magnum IO software is available now, with the exception of GPUDirect Storage, which is currently available to select early-access customers. Broader release of GPUDirect Storage is planned for the first half of 2020.

"Modern HPC and AI research relies upon an incredible amount of data, often more than a petabyte in scale, which requires a new level of technology leadership to best handle the challenge. DDN, by taking advantage of NVIDIA's Magnum IO suite of software along with our parallel EXA5-enabled storage architecture, is paving the way to a new direct data path which makes petabyte-scale data stores directly accessible to the GPU at high bandwidth, an approach that was not previously possible", stated Sven Oehme, chief research officer, DDN.

"The amount of data that leading HPC and AI researchers now need to access continues to grow by leaps and bounds, making I/O a complex challenge for many to manage. IBM Spectrum Scale is designed to address the needs of any organization looking to accelerate AI and run data-intensive workloads. The use of IBM Spectrum Scale and NVIDIA GPU acceleration can help customers alleviate I/O bottlenecks and get the insights needed from their data faster", stated Sam Werner, vice president of storage offering management, IBM.

"Leading HPC and AI researchers choose Mellanox to provide them with the most advanced technology to move and process immense amounts of data as efficiently and quickly as possible. We have been working together with NVIDIA to ensure Magnum IO works seamlessly with Mellanox's state-of-the-art InfiniBand and Ethernet interconnect solutions and to enable our mutual customers to overcome data bottlenecks altogether and advance their science, research and product development activities", stated Dror Goldenberg, senior vice president of software architecture, Mellanox Technologies.

Source: NVIDIA

Back to Table of contents

Primeur live 2019-11-21

Exascale

NCI a founding member of Intel-Lenovo Project Everyscale  ...

Focus on Europe

ADVA and PSNC showcase 1200G channel transmission at SC19 ...

200 Gigabit HDR InfiniBand to accelerate Eni supercomputing platform, to become world's most powerful industrial supercomputer ...

IT4Innovations National Supercomputing Center, a EuroHPC supercomputing site, selected Mellanox 200G HDR InfiniBand to accelerate their new research infrastructure ...

Barcelona Supercomputing Center takes one of top spots in the IO500's "10-Node Challenge" at SC19 ...

Middleware

Univa announces advanced workload management for NVIDIA GPUs on Arm-based systems ...

Bright Computing makes award winning Bright Cluster Manager software free for clusters up to 8 nodes ...

NVIDIA launches Magnum IO software suite to help eliminate data bottlenecks for data scientists and AI, HPC researchers ...

Hardware

San Diego Supercomputer Center supersizes advanced storage with Qumulo for its data-intensive infrastructure ...

Liqid and Western Digital collaborate to deliver fully managed NVMe-oF open composable platform for shared accelerated storage ...

Liqid showcases software disaggregation for converged servers ...

TYAN showcases HPC, AI and storage server platforms featuring 2nd Gen Intel Xeon Scalable processors at SC19 ...

Beijing Meteorological Service selects 200 Gigabit HDR InfiniBand to accelerate new supercomputing platform ...

TMGcore unveils groundbreaking data centre platform at Supercomputing 2019 ...

Argonne National Laboratory deploys Cerebras CS-1, the world's fastest Artificial Intelligence computer ...

KAUST installs Cray CS-Storm 500NX supercomputer to drive strategic AI initiative ...

NVIDIA and tech leaders team to build GPU-accelerated Arm servers for new era of diverse HPC architectures ...

Penguin Computing to deliver Magma supercomputer, one of the first Intel Xeon Platinum 9200 Series processor-based servers for AI and HPC ...

Penguin Computing upgrades Corona with latest AMD Radeon Instinct GPU technology for enhanced ML and AI capabilities ...

San Diego Supercomputer Center selects Dell Technologies to power "Expanse" system ...

Supermicro collaborates with Intel to deliver large scale distributed training AI systems ...

Inspur showcases new liquid cooling HPC system with natural circulation evaporative cooling technology at SC19 ...

HDR InfiniBand selected by Meteo France to accelerate two new large scale supercomputers ...

Pavilion to provide NVMe-Over-Fabrics storage for SCinet'19 high performance computing (HPC) simulations ...

Applications

Registration for ASC20 Student Supercomputer Challenge ...

TOP500

CSC's Puhti ranked 232 on the latest supercomputer TOP500 list  ...

NCI supercomputer climbs TOP500 rankings  ...

The Cloud

2019 demand for Rescale-managed Cloud HPC exceeds all previous years combined ...

The Kinetica Active Analytics Platform and RAPIDS now available on Oracle Cloud Infrastructure to accelerate predictive data analytics performance ...

NVIDIA announces scalable GPU-accelerated supercomputer in the Microsoft Azure Cloud ...

Company news

ScaleMP to showcase SMP supremacy and composable computing innovations at SC19 ...

Qumulo demonstrates unified file storage at SC'19 that reduces administrative burden while consolidating HPC workloads ...

Dell Technologies introduces new solutions to advance high performance computing and AI innovation  ...

Supermicro delivers industry-leading portfolio of advanced HPC systems at SC19 ...

WekaIO unveils WIN, a global partner programme ...