Back to Table of contents

Primeur weekly 2019-03-18

Focus

e-Infrastructures and HPC Knowledge Base gets a new look ...

Quantum computing

Physicists 'reverse time' using quantum computer ...

ASC X9 publishes white paper and technical report on quantum computing risks; new quantum standard effort announced ...

Focus on Europe

ARCHER2 92 million euro supercomputer set to boost UK capability ...

Slovak Government provides capital infusion of 15 million euro to Tachyum ...

Director eScience Center takes on new challenge ...

e-IRG issues Call for Participation to first Open Workshop in 2019 under Romanian EU Presidency ...

Middleware

WekaIO strengthens oil and gas industry presence with new Houston office ...

Hardware

Excelero awarded another patent for heightened NVMe storage efficiency ...

Submer launches SmartPodX, the world's first green OCP and hyperscale-ready Immersion Cooling solution ...

Handling trillions of supercomputer files just got simpler ...

Arm, Cadence and Xilinx introduce first Arm Neoverse system development platform for next-generation Cloud-to-Edge infrastructure, implemented on TSMC 7nm process technology ...

Applications

Promising diagnostics for detecting latent tuberculosis revealed ...

38 Illinois research groups awarded time on Blue Waters leadership supercomputer ...

Nicholas Nystrom named PSC Chief Scientist ...

Physicists use supercomputers to solve 50-year-old beta decay puzzle ...

New method opens the way for cutting tools with longer lifetime ...

Artificial intelligence speeds up ...

UC San Diego study points to virus-related acceleration in some cancers ...

The Cloud

Mellanox introduces breakthrough NVMe SNAP technology to simplify composable storage ...

Wiwynn showcases immersion cooling solutions at OCP Global Summit 2019 ...

Handling trillions of supercomputer files just got simpler


Gary Grider, left, and Brad Settlemyer discuss the new Los Alamos and Carnegie Mellon software product, DeltaFS, released to the software distribution site GitHub.
14 Mar 2019 Los Alamos - A new distributed file system for high-performance computing being distributed via the software collaboration site GitHub provides unprecedented performance for creating, updating and managing extreme numbers of files.

"We designed DeltaFS to enable the creation of trillions of files", stated Brad Settlemyer, a Los Alamos computer scientist and project leader. Los Alamos National Laboratory and Carnegie Mellon University jointly developed Delta FS. "Such a tool aids researchers in solving classical problems in high-performance computing, such as particle trajectory tracking or vortex detection."

DeltaFS builds a file system that appears to the user just like any other file system, doesn't require specialized hardware, and is exactly tailored to assisting the scientist in new discoveries when using a high-performance computing platform.

"One of the foremost challenges, and primary goals of DeltaFS, was scaling across thousands of servers without requiring a portion of them be dedicated to the file system", stated George Amvrosiadis, assistant research professor at Carnegie Mellon University and a co-author on the project. "This frees administrators from having to decide how to allocate resources for the file system, which will become a necessity when exascale machines become a reality."

The file system brings about two important changes in high-performance computing. First, DeltaFS enables new strategies for designing the supercomputers themselves, dramatically changing the cost of creating and managing files. In addition, DeltaFS radically improves the performance of highly selective queries, dramatically reducing time to scientific discovery.

DeltaFS is a transient, software-defined service that allows data to be accessed from a handful up to hundreds of thousands of computers based on the user’s performance requirements.

"The storage techniques used in DeltaFS are applicable in many scientific domains, but we believe that by alleviating the metadata bottleneck we have really shown a way for designing and procuring much more efficient HPC storage systems", Brad Settlemyer stated.

DeltaFS is available via GitHub .

Source: Los Alamos National Laboratory

Back to Table of contents

Primeur weekly 2019-03-18

Focus

e-Infrastructures and HPC Knowledge Base gets a new look ...

Quantum computing

Physicists 'reverse time' using quantum computer ...

ASC X9 publishes white paper and technical report on quantum computing risks; new quantum standard effort announced ...

Focus on Europe

ARCHER2 92 million euro supercomputer set to boost UK capability ...

Slovak Government provides capital infusion of 15 million euro to Tachyum ...

Director eScience Center takes on new challenge ...

e-IRG issues Call for Participation to first Open Workshop in 2019 under Romanian EU Presidency ...

Middleware

WekaIO strengthens oil and gas industry presence with new Houston office ...

Hardware

Excelero awarded another patent for heightened NVMe storage efficiency ...

Submer launches SmartPodX, the world's first green OCP and hyperscale-ready Immersion Cooling solution ...

Handling trillions of supercomputer files just got simpler ...

Arm, Cadence and Xilinx introduce first Arm Neoverse system development platform for next-generation Cloud-to-Edge infrastructure, implemented on TSMC 7nm process technology ...

Applications

Promising diagnostics for detecting latent tuberculosis revealed ...

38 Illinois research groups awarded time on Blue Waters leadership supercomputer ...

Nicholas Nystrom named PSC Chief Scientist ...

Physicists use supercomputers to solve 50-year-old beta decay puzzle ...

New method opens the way for cutting tools with longer lifetime ...

Artificial intelligence speeds up ...

UC San Diego study points to virus-related acceleration in some cancers ...

The Cloud

Mellanox introduces breakthrough NVMe SNAP technology to simplify composable storage ...

Wiwynn showcases immersion cooling solutions at OCP Global Summit 2019 ...