Back to Table of contents

Primeur weekly 2017-09-18

Special

2017 - Another year on the Road to Exascale: The state of exascale progress today ...

Focus

ETP4HPC plays instrumental role in development of European exascale programme ...

Atos/Bull to provide customers with mix of processor architectures and new BXI interconnect ...

Quantum computing

IBM pioneers new approach to simulate chemistry with quantum computing ...

The dark side of quantum computers ...

Toward unbreakable encrypted messages ...

First on-chip nanoscale optical quantum memory developed ...

Focus on Europe

HPC Advisory Council and ISC Group announce the 2018 Student Cluster Competition ...

Digital Infrastructures for Research 2017 to announce Call for Abstracts ...

HPC alliance GW4 shortlisted for Times Higher Education award ...

New GPU power for machine learning and HPC at CSC Finland ...

Mexico launches HPC initiative for Energy Research and Development supported by BSC ...

Middleware

PGI 17.7 compilers for heterogeneous supercomputing now available ...

Hardware

Supermicro launches petabyte scale 1U server and JBOF ...

Packet partners with Arm to accelerate adoption of Armv8-A for data centre workloads ...

Xilinx, Arm, Cadence, and TSMC announce world's first CCIX silicon demonstration vehicle in 7nm process technology ...

Applications

Supercomputing power to study brain function ...

Julia joins Petaflop Club ...

BSC participates in eTRANSAFE, a project for new drug safety assessment and integrative data analysis research ...

NERSC supercomputers help Berkeley Lab scientists map key DNA protein complex ...

Study clarifies how neural nets think when processing language ...

Modelling a city's minuscule changes ...

The Cloud

Oracle joins the Cloud Native Computing Foundation ...

Dell EMC and IBM to offer VMware solutions on the IBM Cloud ...

VMware speeds customer time to value for SDDC and multi-Cloud management with new vRealize suite 2017 ...

Julia joins Petaflop Club


12 Sep 2017 Berkeley - Julia has joined the rarefied ranks of computing languages that have achieved peak performance exceeding one petaflop per second - the so-called "Petaflop Club".

The Julia application that achieved this milestone is called Celeste. It was developed by a team of astronomers, physicists, computer engineers and statisticians from UC Berkeley, Lawrence Berkeley National Laboratory, National Energy Research Scientific Computing Center (NERSC), Intel, Julia Computing and the Julia Lab at MIT.

Celeste uses the Sloan Digital Sky Survey (SDSS), a dataset of astronomical images from the Apache Point Observatory in New Mexico that includes every visible object from over 35% of the sky - hundreds of millions of stars and galaxies. Light from the most distant of these galaxies has been traveling for billions of years and lets us see how the universe appeared in the distant past.

Since SDSS data collection began in 1998, the process of cataloging these stars and galaxies was painstaking and laborious.

So the Celeste team developed a new parallel computing method to process the entire SDSS dataset. Celeste is written entirely in Julia, and the Celeste team loaded an aggregate of 178 terabytes of image data to produce the most accurate catalogue of 188 million astronomical objects in just 14.6 minutes with state-of-the-art point and uncertainty estimates.

Celeste achieved peak performance of 1.54 petaflops using 1.3 million threads on 9,300 Knights Landing (KNL) nodes of the Cori supercomputer at NERSC - a performance improvement of 1,000x in single-threaded execution.

The Celeste research team is already looking to new challenges. For example, the Large Synoptic Survey Telescope (LSST), scheduled to begin operation in 2019, is 14 times larger than the Apache Point telescope and will produce 15 terabytes of images every night. This means that every few days, the LSST will produce more visual data than the Apache Point telescope has produced in 20 years. With Julia and the Cori supercomputer, the Celeste team can analyze and catalog every object in those nightly images in as little as 5 minutes.

The Celeste team is also working to:

  • Further increase the precision of point and uncertainty estimates
  • Identify ever-fainter points of light near the detection limit
  • Improve the quality of native code for high performance computing

The Celeste project is a shining example of:

  • High performance computing applied to real-world problems
  • Cross-institutional collaboration including researchers from UC Berkeley, Lawrence Berkeley National Laboratory, National Energy Research Scientific Computing Center (NERSC), Intel, Julia Computing and the Julia Lab at MIT
  • Cross-departmental collaboration including astronomy, physics, computer science, engineering and mathematics
  • Julia, the fastest modern open source high performance programming language for scientific computing
  • Parallel and multithreading supercomputing capabilities
  • Public support for basic and applied scientific research
Source: Julia Computing

Back to Table of contents

Primeur weekly 2017-09-18

Special

2017 - Another year on the Road to Exascale: The state of exascale progress today ...

Focus

ETP4HPC plays instrumental role in development of European exascale programme ...

Atos/Bull to provide customers with mix of processor architectures and new BXI interconnect ...

Quantum computing

IBM pioneers new approach to simulate chemistry with quantum computing ...

The dark side of quantum computers ...

Toward unbreakable encrypted messages ...

First on-chip nanoscale optical quantum memory developed ...

Focus on Europe

HPC Advisory Council and ISC Group announce the 2018 Student Cluster Competition ...

Digital Infrastructures for Research 2017 to announce Call for Abstracts ...

HPC alliance GW4 shortlisted for Times Higher Education award ...

New GPU power for machine learning and HPC at CSC Finland ...

Mexico launches HPC initiative for Energy Research and Development supported by BSC ...

Middleware

PGI 17.7 compilers for heterogeneous supercomputing now available ...

Hardware

Supermicro launches petabyte scale 1U server and JBOF ...

Packet partners with Arm to accelerate adoption of Armv8-A for data centre workloads ...

Xilinx, Arm, Cadence, and TSMC announce world's first CCIX silicon demonstration vehicle in 7nm process technology ...

Applications

Supercomputing power to study brain function ...

Julia joins Petaflop Club ...

BSC participates in eTRANSAFE, a project for new drug safety assessment and integrative data analysis research ...

NERSC supercomputers help Berkeley Lab scientists map key DNA protein complex ...

Study clarifies how neural nets think when processing language ...

Modelling a city's minuscule changes ...

The Cloud

Oracle joins the Cloud Native Computing Foundation ...

Dell EMC and IBM to offer VMware solutions on the IBM Cloud ...

VMware speeds customer time to value for SDDC and multi-Cloud management with new vRealize suite 2017 ...