Back to Table of contents

Primeur weekly 2016-11-21

Exascale supercomputing

Brookhaven Lab to lead and partner on DOE exascale computing projects ...

Quantum computing

World's fastest quantum simulator operating at the atomic level ...

Tracking the flow of quantum information ...

Tyndall technology lights the way for quantum computing ...

New attacks on location-based quantum cryptography ...

Focus on Europe

Fall 2016 edition of the e-IRG newsletter available ...

Fujitsu in joint intercontinental data centre coordination field trial using cold data storage ...

Asetek announces first installation using InRackCDU technology ...

Middleware

Altair PBS Cloud is Altair's latest technology to further HPC appliance solutions ...

Intel HPC Orchestrator to include PBS Pro for workload management ...

Altair expands the availability of PBS Professional ...

Adaptive Computing launches new Reporting & Analytics solution ...

Adaptive Computing opens up platform of products ...

Adaptive Computing improves ease-of-use & cost efficiency in Moab HPC Suite 9.1 release ...

Hardware

PGI accelerator compilers for POWER architecture enable easy on-ramp to GPU acceleration with POWER8 and NIVIDA NVLink ...

Liquid silicon: Computer chips could bridge the gap between computation and storage ...

Cray expands customer base for Cray Urika-GX system and previews upcoming software release ...

Fujitsu develops analysis technology to improve communication performance of virtual networks ...

Applications

NVIDIA teams with National Cancer Institute, U.S. Department of Energy to create AI platform for accelerating cancer research ...

Supercomputer simulations help develop new approach to fight antibiotic resistance ...

Earlham Institute receives supercomputing award for wheat research ...

Chinese research team that employs high performance computing to understand weather patterns wins 2016 ACM Gordon Bell Prize ...

Cray systems power deep learning in supercomputing at scale ...

IBM and Topcoder bring Watson to more than one million developers ...

IBM Watson Health and Broad Institute launch major research initiative to study why cancers become drug resistant ...

Julia for Astronomy: Parallel computing with Julia on NERSC supercomputer increases speed of image analysis 225x ...

Julia Computing and IBM present Julia for Deep Learning at SC16 ...

TOP500

Jefferson Lab's newest cluster makes TOP500 list of fastest supercomputers ...

Hewlett Packard Enterprise/SGI Cheyenne and Pleiades systems named on TOP500 list ...

The Cloud

Fujitsu and SUSE expand strategic alliance to develop and support open source products ...

IBM closes acquisition of Sanovi Technologies ...

Tencent Cloud joins IBM and Mellanox to break data sorting world records ...

Fujitsu in joint intercontinental data centre coordination field trial using cold data storage

21 Nov 2016 Osaka, Tokyo, San Francisco - Osaka University, Scality Inc., and Fujitsu Limited are jointly executing a cold data storage-focused field trial of intercontinental data centre coordination, together with partners in Japan and Europe. Based on a consortium for collaboration between academia and industry established in April 2016, the field trial will be conducted from November 2016 through to December 2017, and carried out between the data centres in Osaka University's Cybermedia Center and the data centres owned by Paris-based AntemetA.

In this field trial, the partners will build and test the effectiveness of a storage platform coordinated across remote locations, which offers improvements in throughput, disaster resilience, and lower costs by eliminating redundancy within individual data centres. This is done by duplicating data that is not updated very often, known as "cold data", in data centres on each continent, and applying a data sharing technology from Scality called conflict-free replicated data type (CRDT), which is used in distributed computing environments.

Currently, in order to coordinate data between data centres, two methods are used: one in which coordination is done through synchronous communications over short distances where data transfer delays are small, and another is to make backups through asynchronous communication over long distances. When using synchronous communication over short distances, there is a high probability that multiple data centres might be simultaneously affected by large-scale disasters. When asynchronous communication is used over long distances, there are large delays in transmitting data between data centres, so the only option was standby redundancy coordination for back-ups or disaster recovery.

At the same time, against the backdrop of changes such as the spread of technologies like AI and the IoT, data which is generally not updated, called cold data, has taken up more than half of all data, primarily in the form of image and video data, and there is an increasing demand for ways to accumulate new data and share it between multiple locations. In order to achieve data centre coordination between multiple locations, however, there have been issues in achieving data synchronization between data centres, and in improving response speed when reading the data.

In this trial, the participants will develop the "Geo Replication" system to realize the layering and data redundancy, which had only been achieved between data centres in close proximity or within a stand-alone data centre, at long distances such as between continents. By layering and storing not only continually updated "hot" data and infrequently updated "warm" data, but also "cold" data, which is seldom updated, across multiple types of storage devices, long-term storage functionality, lowered costs, and increased responsiveness and overall throughput can be achieved across the system as a whole.

The companies participating in this consortium will advance the development of the Geo Replication system, and the field trial will be carried out, aiming for commercialization, with partners in Europe, using data that is actually in use in Osaka University's data centres.

Academic and industrial consortium participants implementing this trial are:

  • Acutus Software Inc.
  • Chuo Electronics Co. Ltd.
  • Commissariat à l'énergie atomique et aux énergies alternatives
  • Engineering Ingegneria Informatica S.p.A.
  • FESTIVAL Project
  • French Institute for Research in Computer Science and Automation
  • Fujitsu Limited
  • Institut Pasteur
  • Osaka University
  • Panasonic Corporation
  • Raritan Japan Inc.
  • Scality Inc.
  • Yahoo Japan Corporation

Osaka University is responsible for controlling data layering between cold storage and the Scality Ring storage software, which is used to manage massive volumes of data; for the technology for determining hot and cold data; and for building the Osaka site in the Osaka University Cybermedia Center.

Scality is responsible for data replication between storage functionality through Scality Ring and remote sites; for providing Scality Ring; developing and providing replication functionality for this operational trial; and building the site in France. The data centers are owned by AntemetA outside Paris.

Fujitsu is responsible for managing the whole project, for implementing hot and cold storage, and for a high-speed search system for archive data; for providing hardware such as the Fujitsu Storage Eternus DA700, a form of cold data storage, high performance servers like Fujitsu Server Primegy RX2530, and high functionality switches; and for building the Fujitsu Intelligent Data Service SmartContentsManager high-speed archive data search system.

By the end of March 2017, the three organisations will confirm the basic operation of the system, and publish a paper on the research results from this trial during fiscal 2017. In addition, from April 2017 through December 2017, together with joint field trial partners in Japan and Europe, they will perform a usage trial for specific applications, with a variety of data types.

Based on the trial's research results, the three organisations will each aim to develop cold data storage services, a storage platform coordinated between remote locations, and other practical technologies.

Source: Fujitsu

Back to Table of contents

Primeur weekly 2016-11-21

Exascale supercomputing

Brookhaven Lab to lead and partner on DOE exascale computing projects ...

Quantum computing

World's fastest quantum simulator operating at the atomic level ...

Tracking the flow of quantum information ...

Tyndall technology lights the way for quantum computing ...

New attacks on location-based quantum cryptography ...

Focus on Europe

Fall 2016 edition of the e-IRG newsletter available ...

Fujitsu in joint intercontinental data centre coordination field trial using cold data storage ...

Asetek announces first installation using InRackCDU technology ...

Middleware

Altair PBS Cloud is Altair's latest technology to further HPC appliance solutions ...

Intel HPC Orchestrator to include PBS Pro for workload management ...

Altair expands the availability of PBS Professional ...

Adaptive Computing launches new Reporting & Analytics solution ...

Adaptive Computing opens up platform of products ...

Adaptive Computing improves ease-of-use & cost efficiency in Moab HPC Suite 9.1 release ...

Hardware

PGI accelerator compilers for POWER architecture enable easy on-ramp to GPU acceleration with POWER8 and NIVIDA NVLink ...

Liquid silicon: Computer chips could bridge the gap between computation and storage ...

Cray expands customer base for Cray Urika-GX system and previews upcoming software release ...

Fujitsu develops analysis technology to improve communication performance of virtual networks ...

Applications

NVIDIA teams with National Cancer Institute, U.S. Department of Energy to create AI platform for accelerating cancer research ...

Supercomputer simulations help develop new approach to fight antibiotic resistance ...

Earlham Institute receives supercomputing award for wheat research ...

Chinese research team that employs high performance computing to understand weather patterns wins 2016 ACM Gordon Bell Prize ...

Cray systems power deep learning in supercomputing at scale ...

IBM and Topcoder bring Watson to more than one million developers ...

IBM Watson Health and Broad Institute launch major research initiative to study why cancers become drug resistant ...

Julia for Astronomy: Parallel computing with Julia on NERSC supercomputer increases speed of image analysis 225x ...

Julia Computing and IBM present Julia for Deep Learning at SC16 ...

TOP500

Jefferson Lab's newest cluster makes TOP500 list of fastest supercomputers ...

Hewlett Packard Enterprise/SGI Cheyenne and Pleiades systems named on TOP500 list ...

The Cloud

Fujitsu and SUSE expand strategic alliance to develop and support open source products ...

IBM closes acquisition of Sanovi Technologies ...

Tencent Cloud joins IBM and Mellanox to break data sorting world records ...