Back to Table of contents

Primeur weekly 2013-11-25

Special

Xyratex announces ClusterStor 9000 ...

Univa Corporation and Penguin Computing announce reseller agreement ...

SysFera-DS Version 4.0 for HPC management improves remote visualization and extends Cloud support ...

Supermicro debuts powerful 4U 8x GPU SuperServer optimized for the new NVIDIA Tesla K40 GPU accelerator ...

NVIDIA launches world's fastest accelerator for supercomputing and Big Data analytics ...

Numascale shared memory cluster set to unlock massive data sets and ease HPC programming at University of Oslo and throughout Europe ...

HP drives clients to TOP500 list of fastest supercomputers ...

IBM ranked no. 1 on the Graph500 supercomputing list ...

University of Reims Romeo supercomputer ranked 5th of the Green500 list ...

SGI supports new NVIDIA Tesla K40 GPU accelerators delivering 10x performance ...

Mellanox Connect-IB FDR InfiniBand adapters with NVIDIA GPUDirect RDMA technology provide superior GPU-based cluster performance ...

Adaptive Computing introduces Moab Task Manager to increase efficiency of short computing jobs ...

DataDirect Networks Web Object Scaler to provide a multi-PB storage Cloud to enable collaborative data sharing across Florida research universities ...

KALRAY announces world's first hyper-scalable 1000+ cores MIMD processor architecture for next generation exaflop supercomputers ...

IBM and NVIDIA to supercharge corporate data centre applications and next-generation supercomputers ...

Research institutions push the boundaries of supercomputing with Dell ...

Scientists "burst" supercomputing record with bubble collapse simulation ...

UK Atomic Weapons Establishment advances science-based programme with SGI supercomputers ...

Argonne and RIKEN sign MOU in support of petascale computing ...

Penguin Computing updates densest GPU compute solution with NVIDIA Tesla K40 GPU accelerators ...

International networks to aid global research collaborations in climate, bioinformatics and computer science ...

Convey Computer to OEM Dell servers to accelerate data intensive applications for data centres ...

Mellanox Connect-IB FDR InfiniBand adapters accelerate Purdue University's supercomputer to petascale-class performance ...

Penguin Computing announces world's densest X86 supercomputers that leverage OCP designs ...

The Cloud

Altair announces general availability of Display Manager ...

Cloud Software Programme published a definitive guide to success in the Cloud ...

Desktop Grids

New BOINC installer includes VirtualBox ...

EuroFlash

Open Knowledge promotes fast, creative innovation across sectors ...

Cray awarded $30 million contract to expand the Cray XC30 supercomputer at the High Performance Computing Center of University of Stuttgart ...

CSC deploys an energy-efficient Bull supercomputer ...

Scientists from Forschungszentrum Juelich announce the successful installation of a first Blue Gene Active Storage system worldwide ...

Launch of E-Biothon, a networked platform for the acceleration and advancement of bioinformatics research ...

Database consulting company MonetDB Solutions for Big Data newest spin-off CWI ...

Altair raises the bar for secure HPC workload management ...

USFlash

The University of Tsukuba in Japan puts Cray CS300 cluster supercomputer into production ...

SGI and Extreme Networks partner to bring high performance Big Data and Hadoop solutions ...

Cray adds NVIDIA Tesla K40 GPU accelerators to its complete line of supercomputing systems ...

Cray introduces framework for Hadoop enabling the Cray XC30 supercomputer for scientific Big Data ...

INCITE grants awarded to 59 computational research projects ...

TotalView provides open early access of massive scale debugging ...

Cray introduces framework for Hadoop enabling the Cray XC30 supercomputer for scientific Big Data

18 Nov 2013 Seattle - Cray Inc. has introduced a new "Big Data" framework that gives Cray customers the ability to more easily implement and run Apache Hadoop on their Cray XC30 supercomputers. Fusing the benefits of supercomputing and Big Data, the Cray Framework for Hadoop package improves the overall efficiency and performance for Cray XC30 customers deploying Hadoop in Scientific Big Data environments.

The Cray Framework for Hadoop package includes documented best practices and performance enhancements designed to optimize Hadoop for the Cray XC30 line of supercomputers. Built with an emphasis on Scientific Big Data usage, the framework provides enhanced support for data sets found in scientific and engineering applications, as well as improved support for multi-purpose environments, where organisations are looking to align their scientific, compute and data-intensive workloads. This enables users to gain the utility of the Java-based MapReduce Hadoop programming model on the Cray XC30 system, complementing the proven, HPC-optimized languages and tools of the Cray Programming Environment.

"We are seeing increased interest from organizations that are ready to leverage Hadoop for analytics in scientific environments, but what those organizations are finding is that Hadoop does not meet all of their needs for scientific use cases", stated Bill Blake, senior vice president and CTO of Cray. "They find Hadoop isn't optimized for the large hierarchical file formats and I/O libraries needed by scientific applications that run close to the parallel file systems, or leverage the types of fast interconnects and tightly integrated systems deployed on supercomputers for performance and scalability. And they find it difficult to share infrastructure or manage complex work flows than span both scientific compute and analytics workloads, and being able to integrate math models with data models in a single high-performance environment. With the Cray Framework for Hadoop, we're helping organizations harness the openness and power of Hadoop, while better leveraging the investments and progress they've made in scientific computing."

Based on early customer response, the initial release of the Cray Framework for Hadoop and an optimized Cray Performance Pack for Hadoop will be available as free downloads and include validated and documented best practices for Apache Hadoop configurations. This performance pack includes Lustre-Aware Shuffle to optimize Hadoop performance on the Cray XC30 supercomputer. Further performance enhancements to the performance pack, which will include a native Lustre file system library and a plug-in to further accelerate Hadoop performance using the Aries system interconnect, will be available in the first half of 2014.

The launch of Cray Framework for Hadoop further expands Cray's portfolio of offerings for the rapidly growing Big Data market. Cray's complementary array of Big Data solutions includes fast data and data movement capabilities with Cray Sonexion storage systems, a tiered storage and archiving solution with Cray Tiered Adaptive Storage, data discovery using the YarcData uRiKA appliance, Cray Cluster Supercomputers for Hadoop, and now a growing framework of enhancements and optimizations for running Hadoop workloads on Cray CX30 supercomputers.
Source: Cray

Back to Table of contents

Primeur weekly 2013-11-25

Special

Xyratex announces ClusterStor 9000 ...

Univa Corporation and Penguin Computing announce reseller agreement ...

SysFera-DS Version 4.0 for HPC management improves remote visualization and extends Cloud support ...

Supermicro debuts powerful 4U 8x GPU SuperServer optimized for the new NVIDIA Tesla K40 GPU accelerator ...

NVIDIA launches world's fastest accelerator for supercomputing and Big Data analytics ...

Numascale shared memory cluster set to unlock massive data sets and ease HPC programming at University of Oslo and throughout Europe ...

HP drives clients to TOP500 list of fastest supercomputers ...

IBM ranked no. 1 on the Graph500 supercomputing list ...

University of Reims Romeo supercomputer ranked 5th of the Green500 list ...

SGI supports new NVIDIA Tesla K40 GPU accelerators delivering 10x performance ...

Mellanox Connect-IB FDR InfiniBand adapters with NVIDIA GPUDirect RDMA technology provide superior GPU-based cluster performance ...

Adaptive Computing introduces Moab Task Manager to increase efficiency of short computing jobs ...

DataDirect Networks Web Object Scaler to provide a multi-PB storage Cloud to enable collaborative data sharing across Florida research universities ...

KALRAY announces world's first hyper-scalable 1000+ cores MIMD processor architecture for next generation exaflop supercomputers ...

IBM and NVIDIA to supercharge corporate data centre applications and next-generation supercomputers ...

Research institutions push the boundaries of supercomputing with Dell ...

Scientists "burst" supercomputing record with bubble collapse simulation ...

UK Atomic Weapons Establishment advances science-based programme with SGI supercomputers ...

Argonne and RIKEN sign MOU in support of petascale computing ...

Penguin Computing updates densest GPU compute solution with NVIDIA Tesla K40 GPU accelerators ...

International networks to aid global research collaborations in climate, bioinformatics and computer science ...

Convey Computer to OEM Dell servers to accelerate data intensive applications for data centres ...

Mellanox Connect-IB FDR InfiniBand adapters accelerate Purdue University's supercomputer to petascale-class performance ...

Penguin Computing announces world's densest X86 supercomputers that leverage OCP designs ...

The Cloud

Altair announces general availability of Display Manager ...

Cloud Software Programme published a definitive guide to success in the Cloud ...

Desktop Grids

New BOINC installer includes VirtualBox ...

EuroFlash

Open Knowledge promotes fast, creative innovation across sectors ...

Cray awarded $30 million contract to expand the Cray XC30 supercomputer at the High Performance Computing Center of University of Stuttgart ...

CSC deploys an energy-efficient Bull supercomputer ...

Scientists from Forschungszentrum Juelich announce the successful installation of a first Blue Gene Active Storage system worldwide ...

Launch of E-Biothon, a networked platform for the acceleration and advancement of bioinformatics research ...

Database consulting company MonetDB Solutions for Big Data newest spin-off CWI ...

Altair raises the bar for secure HPC workload management ...

USFlash

The University of Tsukuba in Japan puts Cray CS300 cluster supercomputer into production ...

SGI and Extreme Networks partner to bring high performance Big Data and Hadoop solutions ...

Cray adds NVIDIA Tesla K40 GPU accelerators to its complete line of supercomputing systems ...

Cray introduces framework for Hadoop enabling the Cray XC30 supercomputer for scientific Big Data ...

INCITE grants awarded to 59 computational research projects ...

TotalView provides open early access of massive scale debugging ...