Back to Table of contents

Primeur weekly 2019-03-04

Focus

Belgium to contribute 5 million euro to Finnish led pre-exascale EuroHPC consortium ...

Crowd computing

Crowd computing network delves into protein structure and seeks new disease therapies ...

Quantum computing

Bosch and QuSoft start quantum computing collaboration ...

Faster method to read quantum memory ...

'Immunizing' quantum bits so that they can grow up ...

D-Wave previews next-generation quantum computing platform ...

Intel drives development of quantum cryoprober with Bluefors and Afore to accelerate quantum computing ...

Researchers move closer to practical photonic quantum computing ...

Focus on Europe

ISC 2019 keynotes will reflect challenges and opportunities ahead ...

Middleware

Western Digital uses Univa HPC Cloud solutions on Amazon Web Services to build million core cluster, improving business competitive advantage ...

Univa offers new support services to Open Source Grid Engine users ...

Hardware

Analytics market leaders DDN Storage and SQream partnering to deliver accelerated business decisions ...

Panasas announces new growth investment and additions to its Board of Directors ...

Fujitsu launches industry's first 600G hyperscale optical transport solution, empowering tomorrow's high-speed networks ...

VAST Data unveils its universal storage architecture to bring an end to the enterprise HDD and storage tiering era ...

Global High Performance Computing (HPC) Market 2019-2024 by Component, Infrastructure, Services, Price Band, HPC Applications, and Deployment Type ...

Applications

Stampede2 and Maverick systems at TACC help power visualization of Arctic Ocean data ...

University at Buffalo names Abani Patra to lead Center for Computational Research ...

Supercomputing enables sound prediction model for controlling noise ...

The Cloud

Mellanox propels JD Cloud to new levels of performance and efficiency ...

National Science Foundation funds second round for OSC's Open OnDemand ...

Western Digital uses Univa HPC Cloud solutions on Amazon Web Services to build million core cluster, improving business competitive advantage


Credit: Amazon Web Services
25 Feb 2019 Chicago - Univa, an innovator in enterprise-grade workload management and optimization solutions for on-premises and hybrid Cloud high-performance computing (HPC), has successfully demonstrated extreme scale HPC by working with Amazon Web Services (AWS) customer, Western Digital, a data infrastructure company, using Univa's highly-scalable cluster management and scheduling solutions, Navops Launch and Univa Grid Engine. The purpose of this collaborative project was to build a Cloud-scale HPC cluster on AWS to simulate key elements of upcoming designs for their next-generation hard disk drives (HDD).

Continuing its legacy of product innovation, Western Digital turned to the Cloud to determine how virtually unlimited scale could allow them to solve R&D and engineering challenges faster. With this in mind, they teamed up with Univa and AWS to evaluate the impact of running their electro-magnetic engineering simulations on a massive HPC cluster built on AWS using Amazon Elastic Compute Cloud (Amazon EC2) Spot Instances. The goal was to complete the job in the smallest amount of time and at the lowest cost.

As part of this record-setting collaborative effort, Western Digital ran approximately 2.5 million simulation tasks on a Spot-based cluster of a little over one million vCPUs to determine optimal device characteristics that would help improve product quality, performance, reliability and durability for next-generation HDDs. That said, this project required complex multi-physics simulations that needed enough capacity to run deeper simulations for increasingly complex product designs. To put this in perspective, running 2.5 million tasks of this kind in an on-premises environment would take 20 days to complete.

"Storage technology is amazingly complex, and we're constantly pushing the limits of physics and engineering to deliver next-generation capacities and technical innovation", stated Steve Phillpott, CIO of Western Digital. "This successful collaboration with Univa and AWS shows the extreme scale, power and agility of Cloud-based HPC to help us run complex simulations for future storage architecture analysis and materials science explorations. Using AWS to easily shrink simulation time from 20 days to 8 hours allows Western Digital R&D teams to explore new designs and innovations at a pace un-imaginable just a short time ago."

The electro-magnetic simulations combined with the features of AWS Spot Fleet included roughly 40,000 Spot instances and more than one million vCPUs. With AWS, Univa's highly-scalable cluster management and scheduling capabilities of Navops Launch and Univa Grid Engine were also used to coordinate cluster management and workload execution across the wide capacity of our infrastructure and keep the cluster fully utilized even under such a very high workload. The result was an extraordinary 60x reduction in simulation time - from 20 days to 8 hours.

"We are honoured to have participated in such a unique project alongside Western Digital, who is a storage infrastructure leader", stated Gary Tyreman, President and CEO of Univa. "Univa works with hundreds of enterprise organisations who are often challenged with migrating HPC applications to the Cloud, as this can typically be considerably more expensive than on-premises if not properly managed. Our Navops Launch solution gives HPC administrators the ability to control which applications are placed in the Cloud, while also being able to control and monitor HPC Cloud consumption and spend. I am proud of the work that the Univa team did alongside AWS, as we successfully demonstrated extreme scale HPC Cloud."
Source: Univa

Back to Table of contents

Primeur weekly 2019-03-04

Focus

Belgium to contribute 5 million euro to Finnish led pre-exascale EuroHPC consortium ...

Crowd computing

Crowd computing network delves into protein structure and seeks new disease therapies ...

Quantum computing

Bosch and QuSoft start quantum computing collaboration ...

Faster method to read quantum memory ...

'Immunizing' quantum bits so that they can grow up ...

D-Wave previews next-generation quantum computing platform ...

Intel drives development of quantum cryoprober with Bluefors and Afore to accelerate quantum computing ...

Researchers move closer to practical photonic quantum computing ...

Focus on Europe

ISC 2019 keynotes will reflect challenges and opportunities ahead ...

Middleware

Western Digital uses Univa HPC Cloud solutions on Amazon Web Services to build million core cluster, improving business competitive advantage ...

Univa offers new support services to Open Source Grid Engine users ...

Hardware

Analytics market leaders DDN Storage and SQream partnering to deliver accelerated business decisions ...

Panasas announces new growth investment and additions to its Board of Directors ...

Fujitsu launches industry's first 600G hyperscale optical transport solution, empowering tomorrow's high-speed networks ...

VAST Data unveils its universal storage architecture to bring an end to the enterprise HDD and storage tiering era ...

Global High Performance Computing (HPC) Market 2019-2024 by Component, Infrastructure, Services, Price Band, HPC Applications, and Deployment Type ...

Applications

Stampede2 and Maverick systems at TACC help power visualization of Arctic Ocean data ...

University at Buffalo names Abani Patra to lead Center for Computational Research ...

Supercomputing enables sound prediction model for controlling noise ...

The Cloud

Mellanox propels JD Cloud to new levels of performance and efficiency ...

National Science Foundation funds second round for OSC's Open OnDemand ...