Back to Table of contents

Primeur weekly 2017-11-13

Focus

Despite EuroHPC programme Europe losing ground in the TOP500 of the world's fastest supercomputers ...

Quantum computing

IBM announces advances to IBM quantum systems and ecosystem ...

Quantum computing on the move ...

Focus on Europe

Asetek announces Acer as new data centre OEM partner ...

It is time to clarify who funds what research in Europe, says Science Europe ...

European Commission officially releases European Open Science Cloud Declaration ...

The complete ISC 2018 contributed programme is now open for submission ...

PRACE to hold Summer of HPC 2017 Awards Ceremony at IT4Innovations ...

Atos revolutionizes enterprise AI with next generation servers ...

First modular supercomputer worldwide starts operation at the Research Center Jülich ...

Middleware

University of North Texas implements Bright Computing technology for efficient cluster management ...

Inspur launches ON5263M5, the world's first OCP-accepted compute node based on Intel Xeon Scalable processor family ...

Hardware

Oklahoma State University selects Advanced Clustering to build new HPC cluster ...

Cybermedia Center, Osaka University adopts Asetek liquid cooling for new computer system OCTOPUS ...

Solarflare showcases software defined Ethernet NICS for servers running on Qualcomm Centriq 2400 Arm-based processors ...

CoolIT Systems launches Rack DCLC AHx10 Heat Exchange Module ...

DDN partners with Hewlett Packard Enterprise to deliver unmatched HPC storage solutions ...

CoolIT Systems launches rack DCLC AHx2 Heat Exchange Module ...

DDN's massively scalable storage empowers Pawsey Supercomputing Centre to speed scientific discoveries that reveal the secrets of the universe ...

Fujitsu receives order for supercomputer system from the Institute of Fluid Science at Tohoku University ...

Fujitsu launches new PRIMEQUEST series and boosts processing performance by up to 50% ...

Cavium ThunderX2 motherboard specification for Microsoft's project Olympus contributed to the Open Compute Project ...

University of Michigan partners with Cavium on Big Data computing platform for University of Michigan researchers ...

Mellanox announces Innova-2 FPGA-based programmable adapter family to power next generation of Cloud, security, Big Data and Deep Learning platforms ...

Mellanox announces availability of world-leading Spectrum-based SN2010 data centre Ethernet switch system for storage and hyperconverged infrastructures ...

Mellanox interconnect solutions boost Qualcomm Arm-based data centre platforms with Mellanox ConnectX-5 ...

Mellanox announces world's most scalable switch platforms based on HDR 200G InfiniBand quantum switch technology ...

Atos to leverage Mellanox HDR InfiniBand for unmatched application performance and scalability ...

Mellanox InfiniBand to accelerate Japan's fastest supercomputer for Artificial Intelligence applications ...

Mellanox announces first major production deployment of Linux kernel-based Open Ethernet switch ...

LRZ puts into operation CoolMUC-3, a highly energy-efficient many-core cluster ...

WekaIO partners with Hewlett Packard Enterprise to develop all-flash storage for HPC and AI ...

CoolIT Systems showcases newest data centre liquid cooling innovations for OEM and enterprise customers at SC17 ...

Cray adds Arm-based ThunderX2 processors ito its Cray XC50 supercomputer ...

New Cray storage solutions address key customer needs for improved productivity and unparalleled data access ...

Supermicro unveils new HPC solutions at SC17 ...

Supermicro showcases industry's most advanced and optimized NVIDIA GPU systems at SC17 ...

NASA selects Supermicro to expand advanced computing and data analytics used to study the Earth, solar system and universe ...

Applications

New Cray Artificial Intelligence initiatives to advance Deep Learning for science and enterprise ...

Cosmos code helps probe space oddities ...

Research could 'untangle' vexing problem in computer-simulation technology ...

'Perfectly frustrated' metal provides possible path to superconductivity ...

DARPA awards Georgia Tech energy-efficient high-performance computing contract ...

Scientists create cosmic sounds of Voyager 1 ...

Need entangled atoms? Get 'Em FAST! with NIST's new patent-pending method ...

TOP500

China pulls ahead of U.S. in latest TOP500 list of the worlds' fastest supercomputers ...

TACC tech to shine at SC17 ...

The Cloud

Qualcomm Datacenter Technologies announces commercial shipment of Qualcomm Centriq 2400, the world's first 10nm server processor and highest performance Arm-based server processor family ever designed ...

LRZ puts into operation CoolMUC-3, a highly energy-efficient many-core cluster

CoolMUC-3 node. Courtesy of Megaware.12 Nov 2017 Garching - The Leibniz Supercomputing Centre (LRZ) of the Bavarian Academy of Sciences and Humanities puts into operation CoolMUC-3. The HPC cluster is based on Intel's many-core architecture and is particularly characterised by the innovative energy-efficiency technologies it features, e.g. the warm-water cooled Omni-Path switches. The system was developed and delivered by MEGWARE, a Chemnitz-based HPC solution provider who successfully concluded the European procurement process.

LRZ's procurement targets for the new cluster system were:

  • To deploy state-of-the art high-temperature water-cooling technologies for a system operation that avoids heat transfer to the ambient air of the computer room.
  • To supply a system to its users that is suited for processing highly vectorizable and thread-parallel applications, and
  • To provide improved scalability across node boundaries for strong scaling.

The system's baseline installation consists of 148 computational many-core Intel "Knight's Landing" nodes (Intel Xeon Phi 7210-F hosts) connected to each other via an Intel Omni-Path high performance network in fat tree topology. The theoretical peak performance is 400 TFlop/s and the LINPACK performance of the complete system is 255 TFlop/s. A standard Intel Xeon login node is available for development work and job submission.

"CoolMUC-3 is the result of an established partnership between LRZ and Megware. Similar to the delivery of the first CoolMUC in 2011 we have managed to raise the bar for energy efficiency in HPC once more by developing new, innovative technologies", concluded Axel Auweter, CTO at Megware.

CoolMUC-3 comprises of three warm-water cooled racks, using an inlet temperature of at least 40°C. A very high fraction of waste heat deposition into water is achieved by deployment of liquid-cooled power supplies, Omni-Path switches and thermal isolation of the racks to suppress radiative losses. In addition, the liquid cooled racks operate entirely without fans. A complementary rack for air-cooled components - e.g. management servers - uses less than 3% of the systems total power budget. With 4.96 GFlops/Watt - according to the strict Green500 level-3 measurement methodology - CooLMUC-3 is one of the most efficient x86 systems worldwide.

"LRZ has a long-standing history in energy-efficient, warm-water cooled HPC systems. In the long run, we want to get rid of inefficient air-cooling completely. With CoolMUC-3 we take an important step into this direction", stated Prof. Dr. Dieter Kranzlmüller, Chairman of the Board of Directors at LRZ.

CoolMUC-3 is particularly suitable for parallel applications that minimize memory consumption by hybrid programming, e.g. with MPI and OpenMP and then take advantage of the vector units after optimizing the data location. For codes that require use of the distributed memory paradigm with small message sizes, the integration of the Omni-Path network interface on the chip set of the computational node can bring a significant performance advantage over a PCI-attached network card. The actually observable memory bandwidth of the high bandwidth memory yields approximately 450 GB/s per node.

Being an Intel Parallel Computing Centre (IPCC), LRZ has acquired extensive knowledge in recent years in optimising scientific codes to this new type of architecture and will provide corresponding support to its customers. CoolMUC-3 is accessible for researchers of the Ludwig-Maximilians-Universität Munich (LMU) and the Technical University of Munich (TUM) as well as for researchers from universities across Bavaria.

Source: Leibniz Supercomputing Centre - LRZ

Back to Table of contents

Primeur weekly 2017-11-13

Focus

Despite EuroHPC programme Europe losing ground in the TOP500 of the world's fastest supercomputers ...

Quantum computing

IBM announces advances to IBM quantum systems and ecosystem ...

Quantum computing on the move ...

Focus on Europe

Asetek announces Acer as new data centre OEM partner ...

It is time to clarify who funds what research in Europe, says Science Europe ...

European Commission officially releases European Open Science Cloud Declaration ...

The complete ISC 2018 contributed programme is now open for submission ...

PRACE to hold Summer of HPC 2017 Awards Ceremony at IT4Innovations ...

Atos revolutionizes enterprise AI with next generation servers ...

First modular supercomputer worldwide starts operation at the Research Center Jülich ...

Middleware

University of North Texas implements Bright Computing technology for efficient cluster management ...

Inspur launches ON5263M5, the world's first OCP-accepted compute node based on Intel Xeon Scalable processor family ...

Hardware

Oklahoma State University selects Advanced Clustering to build new HPC cluster ...

Cybermedia Center, Osaka University adopts Asetek liquid cooling for new computer system OCTOPUS ...

Solarflare showcases software defined Ethernet NICS for servers running on Qualcomm Centriq 2400 Arm-based processors ...

CoolIT Systems launches Rack DCLC AHx10 Heat Exchange Module ...

DDN partners with Hewlett Packard Enterprise to deliver unmatched HPC storage solutions ...

CoolIT Systems launches rack DCLC AHx2 Heat Exchange Module ...

DDN's massively scalable storage empowers Pawsey Supercomputing Centre to speed scientific discoveries that reveal the secrets of the universe ...

Fujitsu receives order for supercomputer system from the Institute of Fluid Science at Tohoku University ...

Fujitsu launches new PRIMEQUEST series and boosts processing performance by up to 50% ...

Cavium ThunderX2 motherboard specification for Microsoft's project Olympus contributed to the Open Compute Project ...

University of Michigan partners with Cavium on Big Data computing platform for University of Michigan researchers ...

Mellanox announces Innova-2 FPGA-based programmable adapter family to power next generation of Cloud, security, Big Data and Deep Learning platforms ...

Mellanox announces availability of world-leading Spectrum-based SN2010 data centre Ethernet switch system for storage and hyperconverged infrastructures ...

Mellanox interconnect solutions boost Qualcomm Arm-based data centre platforms with Mellanox ConnectX-5 ...

Mellanox announces world's most scalable switch platforms based on HDR 200G InfiniBand quantum switch technology ...

Atos to leverage Mellanox HDR InfiniBand for unmatched application performance and scalability ...

Mellanox InfiniBand to accelerate Japan's fastest supercomputer for Artificial Intelligence applications ...

Mellanox announces first major production deployment of Linux kernel-based Open Ethernet switch ...

LRZ puts into operation CoolMUC-3, a highly energy-efficient many-core cluster ...

WekaIO partners with Hewlett Packard Enterprise to develop all-flash storage for HPC and AI ...

CoolIT Systems showcases newest data centre liquid cooling innovations for OEM and enterprise customers at SC17 ...

Cray adds Arm-based ThunderX2 processors ito its Cray XC50 supercomputer ...

New Cray storage solutions address key customer needs for improved productivity and unparalleled data access ...

Supermicro unveils new HPC solutions at SC17 ...

Supermicro showcases industry's most advanced and optimized NVIDIA GPU systems at SC17 ...

NASA selects Supermicro to expand advanced computing and data analytics used to study the Earth, solar system and universe ...

Applications

New Cray Artificial Intelligence initiatives to advance Deep Learning for science and enterprise ...

Cosmos code helps probe space oddities ...

Research could 'untangle' vexing problem in computer-simulation technology ...

'Perfectly frustrated' metal provides possible path to superconductivity ...

DARPA awards Georgia Tech energy-efficient high-performance computing contract ...

Scientists create cosmic sounds of Voyager 1 ...

Need entangled atoms? Get 'Em FAST! with NIST's new patent-pending method ...

TOP500

China pulls ahead of U.S. in latest TOP500 list of the worlds' fastest supercomputers ...

TACC tech to shine at SC17 ...

The Cloud

Qualcomm Datacenter Technologies announces commercial shipment of Qualcomm Centriq 2400, the world's first 10nm server processor and highest performance Arm-based server processor family ever designed ...