Back to Table of contents

Primeur weekly 2017-04-24

Focus

The Global Network Architecture consortium is a strong believer in good collaboration, sharing capacity and costs for transatlantic network connectivity ...

North Atlantic Network Collaboration Building Foundation for Global Network Architecture ...

Focus on Europe

British Met Office faces big challenges with Big Data ...

Netherlands Organisation for Scientific Research enables researchers to meet with SURF ...

RDA Europe-ENVRI Summer School on Data Management and Data Science ...

PRACE 14th Call for Proposals shows the magnitude of PRACE 2 ...

Prof. Dr. Michael M. Resch named new chairman of GCS Board of Directors ...

Hardware

Canada's most powerful academic supercomputer launched at Simon Fraser University ...

Pattern discovery over pattern recognition: A new way for computers to see ...

Mellanox 25Gb/s Ethernet adapters chosen by major ODMs to enable next generation hyperscale data centres ...

Mellanox announces new executive appointments ...

New HPC cluster installed at Clarkson University ...

Harnessing heat to power computers ...

Launch of new research line on network measurements and analytics ...

DataDirect Networks to demonstrate converged appliance that accelerates immersive and traditional content creation and global distribution ...

Rescale announces ScaleX Labs with Intel Xeon Phi processors and Intel Omni-Path architecture ...

Applications

Royal Canadian Institute for Science recognizes IBM's commitment to STEM ...

WorldFlix announces new data protection technology that even a supercomputer won't be able to break ...

Call for Applications opened for DATA2PERSON - Big Data and Health ...

IBM machine vision technology advances early detection of diabetic eye disease using deep learning ...

Predictive power ...

Dutch eScience Center organises Scientific Visualization event and Fifth National eScience Symposium ...

OCF supporting scientific research at the Atomic Weapons Establishment ...

A good night's sleep thanks to new machine learning algorithm ...

The Cloud

Oracle brings Oracle's flagship databases and developer tools to the Docker Store ...

IBM to deliver Docker Enterprise Edition for Linux on IBM systems ...

British Met Office faces big challenges with Big Data


21 Apr 2017 Exeter - The Met Office is facing new and increasing challenges because of the huge volume of data that it manages and produces. Alex Longden, who leads the team responsible for data provision for the data re-use community and private weather sectors, examines the situation.

The 335 million observations of data the Met Office stores every day require huge computational capability. The new supercomputer provides the processing power needed to manipulate the data in a timely and effective way. The complex numerical models developed by the scientists and meteorologists in turn create enormous data outputs, used for climate and weather prediction and by data users throughout the world to make weather outlooks more accurate than ever before.

The Met Office recognises that increases in observational and forecast data volumes have implications across both the public and private weather sectors. To understand this better, the Met Office recently partnered with the Open Data Institute, to carry out a review on 'The state of weather data infrastructure'.

The review is encouraging discussion on how the global weather data infrastructure can be sustainable, and continue to deliver value to society, as well as looking at the need for continuing investment in technical infrastructure and supercomputing resources. It also looks at the role of global, regional and national meteorological services in collecting observations and generating forecasts.

In addition, the review highlights the technology creating new data and in turn generating new, Big Data challenges. Supercomputing is enabling new and improved weather models which are harnessing a variety of sources of weather observations from ground, air, sea and space based monitoring and sensors. These trends exist within a wider landscape of innovation and changing consumer expectations where instant and real-time access to data is increasingly essential.

The Met Office is striving towards making the data more openly accessible and useful to realise the social economic benefits brought by the new supercomputer, which delivers ever increasing accuracy yet exponential increases in data volumes that makes this more challenging.

Source: Met Office

Back to Table of contents

Primeur weekly 2017-04-24

Focus

The Global Network Architecture consortium is a strong believer in good collaboration, sharing capacity and costs for transatlantic network connectivity ...

North Atlantic Network Collaboration Building Foundation for Global Network Architecture ...

Focus on Europe

British Met Office faces big challenges with Big Data ...

Netherlands Organisation for Scientific Research enables researchers to meet with SURF ...

RDA Europe-ENVRI Summer School on Data Management and Data Science ...

PRACE 14th Call for Proposals shows the magnitude of PRACE 2 ...

Prof. Dr. Michael M. Resch named new chairman of GCS Board of Directors ...

Hardware

Canada's most powerful academic supercomputer launched at Simon Fraser University ...

Pattern discovery over pattern recognition: A new way for computers to see ...

Mellanox 25Gb/s Ethernet adapters chosen by major ODMs to enable next generation hyperscale data centres ...

Mellanox announces new executive appointments ...

New HPC cluster installed at Clarkson University ...

Harnessing heat to power computers ...

Launch of new research line on network measurements and analytics ...

DataDirect Networks to demonstrate converged appliance that accelerates immersive and traditional content creation and global distribution ...

Rescale announces ScaleX Labs with Intel Xeon Phi processors and Intel Omni-Path architecture ...

Applications

Royal Canadian Institute for Science recognizes IBM's commitment to STEM ...

WorldFlix announces new data protection technology that even a supercomputer won't be able to break ...

Call for Applications opened for DATA2PERSON - Big Data and Health ...

IBM machine vision technology advances early detection of diabetic eye disease using deep learning ...

Predictive power ...

Dutch eScience Center organises Scientific Visualization event and Fifth National eScience Symposium ...

OCF supporting scientific research at the Atomic Weapons Establishment ...

A good night's sleep thanks to new machine learning algorithm ...

The Cloud

Oracle brings Oracle's flagship databases and developer tools to the Docker Store ...

IBM to deliver Docker Enterprise Edition for Linux on IBM systems ...