Back to Table of contents

Primeur weekly 2016-12-12

Crowd computing

New TN-Grid platform is hosting gene@home ...

Quantum computing

Further improvement of qubit lifetime for quantum computers ...

Focus on Europe

Cray works with Microsoft and CSCS to reach new performance milestone for deep learning at scale ...

PHENOMEN project to lay the foundations for a new age of information processing ...

Research into the theoretical bases of future wireless communications ...

Mont-Blanc project Event ARM: On the road to HPC ...

Middleware

Allinea webinar targets I/O optimization ...

Hardware

Mellanox's EDR 100Gb/s InfiniBand accelerates the largest National Institute of Health supercomputer ...

Mellanox announces record breaking performance enabling stateful packet processing at 400Gb/s with the NPS-400 network processor ...

Atos achieves SAP HANA certification for its bullion server operating up to 16TB of data ...

NVIDIA delivers AI supercomputer to Berkeley ...

New tender for the SURFnet8 service layer published ...

High performance graphene photodetectors set speed record ...

Applications

Scientists take 'blue-action' to help society cope with the impacts of Arctic climate changes ...

Eight new eScience projects to start in 2017 ...

University of Wyoming Faculty supercomputer use deadline is December 23, 2016 ...

Collaborating on Big Data to unravel disease processes ...

Weather the storm: Improving Great Lakes modelling ...

What to do with the data? ...

Big Data approach to water quality applied at shale drilling sites ...

The Cloud

Amazon Web Services Cloud now available to customers from data centres in Canada ...

Cray works with Microsoft and CSCS to reach new performance milestone for deep learning at scale

7 Dec 2016 Seattle, Barcelona - At the 2016 Neural Information Processing Systems (NIPS) Conference in Barcelona, Spain, Cray Inc. has issued the results of a deep learning collaboration between Cray, Microsoft, and the Swiss National Supercomputing Centre (CSCS) that expands the horizons of running deep learning algorithms at scale using the power of Cray supercomputers.

Running larger deep learning models is a path to new scientific possibilities, but conventional systems and architectures limit the problems that can be addressed, as models take too long to train. Cray worked with Microsoft and CSCS, a world-class scientific computing centre, to leverage their decades of high performance computing expertise to profoundly scale the Microsoft Cognitive Toolkit - formerly CNTK - on a Cray XC50 supercomputer at CSCS nicknamed "Piz Daint".

By accelerating the training process, instead of waiting weeks or months for results, data scientists can obtain results within hours or even minutes. With the introduction of supercomputing architectures and technologies to deep learning frameworks, customers now have the ability to solve a whole new class of problems, such as moving from image recognition to video recognition, and from simple speech recognition to natural language processing with context.

Deep learning problems share algorithmic similarities with applications traditionally run on a massively parallel supercomputer. By optimizing inter-node communication using the Cray XC Aries network and a high performance MPI library, each training job can leverage significantly more compute resources - reducing the time required to train an individual model.

"Cray's proficiency in performance analysis and profiling, combined with the unique architecture of the XC systems, allowed us to bring deep learning problems to our Piz Daint system and scale them in a way that nobody else has", stated Prof. Dr. Thomas C. Schulthess, director of the Swiss National Supercomputing Centre (CSCS). "What is most exciting is that our researchers and scientists will now be able to use our existing Cray XC supercomputer to take on a new class of deep learning problems that were previously infeasible."

"Applying a supercomputing approach to optimize deep learning workloads represents a powerful breakthrough for training and evaluating deep learning algorithms at scale", stated Dr. Xuedong Huang, distinguished engineer, Microsoft AI and Research. "Our collaboration with Cray and CSCS has demonstrated how the Microsoft Cognitive Toolkit can be used to push the boundaries of deep learning."

A team of experts from Cray, Microsoft, and CSCS have scaled the Microsoft Cognitive Toolkit to more than 1,000 NVIDIA Tesla P100 GPU accelerators on the Cray XC50 supercomputer at CSCS. The result of this deep learning collaboration opens the door for researchers to run larger, more complex, and multi-layered deep learning workloads at scale, harnessing the performance of a Cray supercomputer.

To simplify the building and deploying of deep learning environments in supercomputing, Cray is supporting its Cray XC customers with deep learning toolkits, such as the Microsoft Cognitive Toolkit, that allow customers to run deep learning applications at their fullest potential - at scale on a Cray supercomputer. Fusing high performance computing capability with deep learning is another step forward in Cray's vision of the convergence of supercomputing and Big Data.

"Only Cray can bring the combination of supercomputing technologies, supercomputing best practices, and expertise in performance optimization to scale deep learning problems", stated Dr. Mark S. Staveley, Cray's director of deep learning and machine learning. "We are working to unlock possibilities around new approaches and model sizes, turning the dreams and theories of scientists into something real that they can explore. Our collaboration with Microsoft and CSCS is a game changer for what can be accomplished using deep learning."

Source: Cray

Back to Table of contents

Primeur weekly 2016-12-12

Crowd computing

New TN-Grid platform is hosting gene@home ...

Quantum computing

Further improvement of qubit lifetime for quantum computers ...

Focus on Europe

Cray works with Microsoft and CSCS to reach new performance milestone for deep learning at scale ...

PHENOMEN project to lay the foundations for a new age of information processing ...

Research into the theoretical bases of future wireless communications ...

Mont-Blanc project Event ARM: On the road to HPC ...

Middleware

Allinea webinar targets I/O optimization ...

Hardware

Mellanox's EDR 100Gb/s InfiniBand accelerates the largest National Institute of Health supercomputer ...

Mellanox announces record breaking performance enabling stateful packet processing at 400Gb/s with the NPS-400 network processor ...

Atos achieves SAP HANA certification for its bullion server operating up to 16TB of data ...

NVIDIA delivers AI supercomputer to Berkeley ...

New tender for the SURFnet8 service layer published ...

High performance graphene photodetectors set speed record ...

Applications

Scientists take 'blue-action' to help society cope with the impacts of Arctic climate changes ...

Eight new eScience projects to start in 2017 ...

University of Wyoming Faculty supercomputer use deadline is December 23, 2016 ...

Collaborating on Big Data to unravel disease processes ...

Weather the storm: Improving Great Lakes modelling ...

What to do with the data? ...

Big Data approach to water quality applied at shale drilling sites ...

The Cloud

Amazon Web Services Cloud now available to customers from data centres in Canada ...