Back to Table of contents

Primeur weekly 2020-08-10

Focus

HPC markets show temporary negative COVID-19 ripple effect but will be back on track after crisis fades, says Intersect360 Research analyst Addison Snell ...

EPCC led EIDF will train 100.000 citizens over the next decade to take part in the Edinburgh International Data Facility powered by HPE ...

Exascale supercomputing

Jülich Supercomputing Centre to introduce new AI project AlphaNumerics Zero ...

GE Research uses Summit supercomputer for groundbreaking study on wind power ...

US Department of Energy to provide $57,5 million for science computing teams ...

Quantum computing

Solving materials problems with a quantum computer ...

International quantum research to take a leap forward ...

Northern Arizona University partners in $26 million NSF initiative to establish new Center for Quantum Networks ...

Focus on Europe

Atos partners with University of Oxford on largest AI supercomputer in the UK ...

JURECA data-centric module to replace JURECA Cluster ...

Open source for a global 'energiewende' ...

Skoltech supercomputer helps scientists reveal most influential parameters for crop ...

Middleware

NCCS debuts centralized storage with curated Earth science datasets ...

Hardware

Nanyang Technological University Singapore scientists build ultra-high-speed Terahertz wireless chip ...

Flash Memory Summit partners with TechTarget to extend digital reach ...

Tachyum shows Prodigy running existing x86, ARM, and RISC-V software ...

Panasas launches the new PanFS with dynamic data acceleration technology to support diverse and changing workflows in HPC and AI ...

Todd Younkin appointed President and CEO of Semiconductor Research Corporation (SRC) ...

CENIC extends 400G capabilities to coastal path between Los Angeles and Sunnyvale ...

Applications

A computational framework for solving linear inverse problems takes a parallel computing approach ...

Unequal neutron-star mergers create unique 'bang' in simulations ...

BSC researchers study mobility in Spain during the COVID-19 pandemic period using data from the Facebook and Google apps ...

Study identifies top reasons for sewer line failure ...

New spin-off created by BSC researchers to accelerate the development of new chemicals ...

Argonne researchers use Theta for real-time analysis of COVID-19 proteins ...

ALCC programme awards ALCF computing time to 24 projects ...

ALCC programme awards nearly 6 million Summit node hours across 31 projects ...

Comet supercomputer used to simulate environmental changes in Chesapeake Bay ...

Piotr Roztocki wins 2020 Paul Baran Young Scholar Award for his innovative work ...

Sustainable chemistry at the quantum level ...

Tiniest secrets of integrated circuits revealed with new imaging technique ...

Computing COVID-19's potential cure and treatments in Australia ...

National Science Foundation funds five new XSEDE-allocated systems ...

NCCS debuts centralized storage with curated Earth science datasets


The Centralized Storage System extends across several hardware racks and currently holds 10 petabytes of curated Earth science datasets. Photo by Laura Carriere, NCCS.
5 Aug 2020 Greenbelt - Now available to all NASA Center for Climate Simulation (NCCS) computing platforms is a new resource hosting notable Earth science datasets. NCCS users can access the Centralized Storage System (CSS) from the Discover supercomputer, the ADAPT Science Cloud, the DataPortal, and a new GPU cluster focused on Artificial Intelligence (AI) and Machine Learning (ML) applications that will be available on August 10, 2020. As of July 2020, CSS holds 10 petabytes of curated datasets from NASA, other agencies, and national and international research programmes.

"NCCS previously provided long-term storage on tape media, which resulted in data that was difficult for users to discover and integrate into compute workflows", stated Bennett Samowich, NCCS CSS Lead. "By holding curated data products that are archived at other locations, CSS allows fast access to datasets in support of scientific research."

"In particular, AI and Machine Learning workflows can take advantage of the availability of these datasets", Bennett Samowich noted. "CSS is the best location for final data products that can become input to other projects."

CSS-hosted datasets span a range of types and sources, including:

  • Satellite observations, e.g., Landsat, MODIS, and NGA.
  • Airborne observations, e.g., IceBridge.
  • NASA and ensemble climate reanalyses, e.g., MERRA-2 and CREATE-IP.
  • Climate projections, e.g., CMIP5.

The path "/css" provides access to all of the CSS data, which is stored using IBM's Spectrum Scale General Parallel File System (GPFS). High-speed internal InfiniBand and 40 Gigabit Ethernet networks connect CSS to the NCCS compute and Data Services environments.

While CSS is available as read-only, its 15-petabyte capacity - growing to 30 petabytes later this summer - will allow NCCS users to make their own data available to other users. Besides Earth science data, NCCS is open to hosting users' astrophysics datasets in the future. NCCS encourages users to share their data by requesting CSS access and moving their final data products to CSS. Data must fall under an active Data Management Plan; you can contact the NCCS User Services Group to get help setting up a plan.

In addition to CSS, "NCCS will continue to provide local storage on both Discover and ADAPT for intermediate datasets", Bennett Samowich said. "This local storage will continue to support workflows that require fast I/O during computation as well as analysis of research results."

Source: NASA Center for Climate Simulation - NCCS

Back to Table of contents

Primeur weekly 2020-08-10

Focus

HPC markets show temporary negative COVID-19 ripple effect but will be back on track after crisis fades, says Intersect360 Research analyst Addison Snell ...

EPCC led EIDF will train 100.000 citizens over the next decade to take part in the Edinburgh International Data Facility powered by HPE ...

Exascale supercomputing

Jülich Supercomputing Centre to introduce new AI project AlphaNumerics Zero ...

GE Research uses Summit supercomputer for groundbreaking study on wind power ...

US Department of Energy to provide $57,5 million for science computing teams ...

Quantum computing

Solving materials problems with a quantum computer ...

International quantum research to take a leap forward ...

Northern Arizona University partners in $26 million NSF initiative to establish new Center for Quantum Networks ...

Focus on Europe

Atos partners with University of Oxford on largest AI supercomputer in the UK ...

JURECA data-centric module to replace JURECA Cluster ...

Open source for a global 'energiewende' ...

Skoltech supercomputer helps scientists reveal most influential parameters for crop ...

Middleware

NCCS debuts centralized storage with curated Earth science datasets ...

Hardware

Nanyang Technological University Singapore scientists build ultra-high-speed Terahertz wireless chip ...

Flash Memory Summit partners with TechTarget to extend digital reach ...

Tachyum shows Prodigy running existing x86, ARM, and RISC-V software ...

Panasas launches the new PanFS with dynamic data acceleration technology to support diverse and changing workflows in HPC and AI ...

Todd Younkin appointed President and CEO of Semiconductor Research Corporation (SRC) ...

CENIC extends 400G capabilities to coastal path between Los Angeles and Sunnyvale ...

Applications

A computational framework for solving linear inverse problems takes a parallel computing approach ...

Unequal neutron-star mergers create unique 'bang' in simulations ...

BSC researchers study mobility in Spain during the COVID-19 pandemic period using data from the Facebook and Google apps ...

Study identifies top reasons for sewer line failure ...

New spin-off created by BSC researchers to accelerate the development of new chemicals ...

Argonne researchers use Theta for real-time analysis of COVID-19 proteins ...

ALCC programme awards ALCF computing time to 24 projects ...

ALCC programme awards nearly 6 million Summit node hours across 31 projects ...

Comet supercomputer used to simulate environmental changes in Chesapeake Bay ...

Piotr Roztocki wins 2020 Paul Baran Young Scholar Award for his innovative work ...

Sustainable chemistry at the quantum level ...

Tiniest secrets of integrated circuits revealed with new imaging technique ...

Computing COVID-19's potential cure and treatments in Australia ...

National Science Foundation funds five new XSEDE-allocated systems ...