Back to Table of contents

Primeur weekly 2019-07-15

Quantum computing

Quantum chemistry on quantum computers ...

Quantum computing: Forschungszentrum Jülich and Google announce research partnership ...

The best of both worlds: how to solve real problems on modern quantum computers ...

Rigetti Computing acquires QxBranch to expand full-stack capabilities ...

Focus on Europe

Pioneer satellites launched ...

Inauguration of the Minho Advanced Computing Centre - MACC - in Portugal ...

e-InfraCentral reports on successful EOSC community event in Tallinn ...

ISC High Performance announces David Keyes as 2020 Programme Chair ...

GCS Centres converge on Frankfurt for ISC19 ...

Gauss Centre for Supercomputing to open 22nd call for large-scale projects ...

Middleware

Argonne team breaks record for Globus Data Movement ...

Hardware

Verne Global joins NVIDIA DGX-Ready Data Center Programme as HPC & AI colocation partner ...

NSF funds Bridges-2 supercomputer at Pittsburgh Supercomputing Center ...

Mellanox Capital extends storage ecosystem with investments in CNEX Labs and Pliops ...

Ohio Supercomputer Center staff leading programmes at PEARC19 conference ...

Tachyum closes $25 million Series A round ...

Vantage Data Centers joins NVIDIA DGX-Ready Data Center Colocation Programme ...

World-class research centre opens in Palo Alto ...

Intel's Pohoiki Beach, a 64-chip neuromorphic system, delivers breakthrough results in research tests ...

Applications

SDSC's Comet supercomputer used to model graphene-water interaction ...

US Naval Research Laboratory 'connects the dots' for quantum networks ...

Deep learning-powered 'DeepEC' helps accurately understand enzyme functions ...

Targeting new treatments for concussions by transforming brain pathology ...

NERSC's Cori system reveals integral role of gluons in proton pressure distribution ...

CMU scientists use XSEDE-allocated resources to simulate improved battery components ...

AI Excellence in Europe: 50 million euro to bring world-class researchers together ...

The Cloud

IBM closes landmark acquisition of Red Hat for $34 billion and defines open, hybrid Cloud future ...

USFlash

Intel unveils new tools in its advanced chip packaging toolbox ...

Argonne team breaks record for Globus Data Movement

8 Jul 2019 Chicago - Globus, a research data management service, has achieved the largest single file transfer in its history: a team led by Argonne National Laboratory scientists moved 2,9 petabytes of data as part of a research project involving three of the largest cosmological simulations to date.

"Storage is in general a very large problem in our community - the Universe is just very big, so our work can often generate a lot of data", explained Katrin Heitmann, Argonne physicist and computational scientist and an Oak Ridge National Laboratory Leadership Computing Facility (OLCF) Early Science user. "Using Globus to easily move the data around between different storage solutions and institutions for analysis is essential."

The data in question was stored on the Summit supercomputer at OLCF, currently the world's fastest supercomputer according to the TOP500 list published June 18, 2019. Globus was used to move the files from disk to tape, a key use case for researchers.

"Due to its uniqueness, the data is very precious and the analysis will take time", stated Dr. Heitmann. "The first step after the simulations were finished was to make a back-up copy of the data to HPSS, so we can move the data back and forth between disk and tape and thus carry out the analysis in steps. We use Globus for this work due to its speed, reliability, and ease of use."

"With exascale imminent, AI on the rise, HPC systems proliferating, and research teams more distributed than ever, fast, secure, reliable data movement and management are now more important than ever", stated Ian Foster, Globus co-founder and director of Argonne's Data Science and Learning Division. "We tend to take these functions for granted, and yet modern collaborative research would not be possible without them."

"Globus has underpinned groundbreaking research for decades. We could not be prouder of our role in helping scientists do their world-changing work, and we're happy to see projects like this one continue to push the boundaries of what Globus can achieve. Congratulations to Dr. Heitmann and team."

When it comes to data transfer performance, "the most important part is reliability", stated Dr. Heitmann. "It is basically impossible for me as a user to check the very large amounts of data upon arrival after a transfer has finished. The analysis of the data often uses a subset of the data, so it would take quite a while until bad data would be discovered and at that point we might not have the data anymore at the source. So the reliability aspects of Globus are key."

"Of course, speed is also important. If the transfers were very slow, given the amount of data we transfer, we would have had a problem. So it's good to be able to rely on Globus for fast data movement as well. We are also grateful to Oak Ridge for access to Summit and for their excellent set-up of data transfer nodes enabling the use of Globus for HPSS transfers. This work would not have been possible otherwise."

For details about this project's use of Globus, you can read the Q&A blog with Dr. Heitmann.
Source: Globus

Back to Table of contents

Primeur weekly 2019-07-15

Quantum computing

Quantum chemistry on quantum computers ...

Quantum computing: Forschungszentrum Jülich and Google announce research partnership ...

The best of both worlds: how to solve real problems on modern quantum computers ...

Rigetti Computing acquires QxBranch to expand full-stack capabilities ...

Focus on Europe

Pioneer satellites launched ...

Inauguration of the Minho Advanced Computing Centre - MACC - in Portugal ...

e-InfraCentral reports on successful EOSC community event in Tallinn ...

ISC High Performance announces David Keyes as 2020 Programme Chair ...

GCS Centres converge on Frankfurt for ISC19 ...

Gauss Centre for Supercomputing to open 22nd call for large-scale projects ...

Middleware

Argonne team breaks record for Globus Data Movement ...

Hardware

Verne Global joins NVIDIA DGX-Ready Data Center Programme as HPC & AI colocation partner ...

NSF funds Bridges-2 supercomputer at Pittsburgh Supercomputing Center ...

Mellanox Capital extends storage ecosystem with investments in CNEX Labs and Pliops ...

Ohio Supercomputer Center staff leading programmes at PEARC19 conference ...

Tachyum closes $25 million Series A round ...

Vantage Data Centers joins NVIDIA DGX-Ready Data Center Colocation Programme ...

World-class research centre opens in Palo Alto ...

Intel's Pohoiki Beach, a 64-chip neuromorphic system, delivers breakthrough results in research tests ...

Applications

SDSC's Comet supercomputer used to model graphene-water interaction ...

US Naval Research Laboratory 'connects the dots' for quantum networks ...

Deep learning-powered 'DeepEC' helps accurately understand enzyme functions ...

Targeting new treatments for concussions by transforming brain pathology ...

NERSC's Cori system reveals integral role of gluons in proton pressure distribution ...

CMU scientists use XSEDE-allocated resources to simulate improved battery components ...

AI Excellence in Europe: 50 million euro to bring world-class researchers together ...

The Cloud

IBM closes landmark acquisition of Red Hat for $34 billion and defines open, hybrid Cloud future ...

USFlash

Intel unveils new tools in its advanced chip packaging toolbox ...