Back to Table of contents

Primeur weekly 2014-04-28

Exascale supercomputing

MONTBLANC scaling new heights of computing performance ...

The Cloud

HP extends mission-critical enterprise environments ...

UTSA hosts Open BigCloud Symposium and OCP Workshop May 7-8 ...

IBM provides SoftLayer ecosystem partners with new resources for generating Cloud revenue ...

Desktop Grids

Parabon launches crowdsourcing initiative to tackle Alzheimer's Disease with computing capacity donated by concerned citizens ...

SETI.Germany to organize BOINC Pentathlon ...

New BOINC server VM image available ...

EuroFlash

Tower International selects Altair's Compute Manager ...

Forschungszentrum Jülich Joins the OpenPOWER Foundation ...

CSC leads a Nordic project on sensitive data ...

CSC joins Intel Parallel Computing Center programme ...

Earthquake simulation tops 1 quadrillion flops ...

Master in High Performance Computing (MHPC) programme at ICTP and the International School for Advanced Studies (SISSA) ...

Catherine Rivière, PRACE Council Chair, speaks at ICRI 2014 on the way forward for PRACE and HPC in Europe ...

PRACE Spring School: Researchers from all over the world come to school in Austria ...

USFlash

Third Person, first rate projection: TDC delivers tech and crew to ground-breaking Australian movie production for TEDx Sydney ...

OpenPOWER Foundation unveils first innovations and roadmap ...

NCAR & CU join Intel Parallel Computing Centers programme ...

AltaSim Technologies wins DOE grant for additive manufacturing ...

Georgia Tech researchers use NSF XSEDE supercomputers to understand and predict how black holes swallow stars ...

NEC selects Chelsio adapters for Vector Supercomputer ...

IBM Watson Group invests in Fluid to transform the consumer shopping experience ...

HP introduces next-generation enterprise array for mission-critical workloads ...

Big data poses great challenges and opportunities for databases ...

IBM tackles Big Data challenges with Open Server Innovation Model ...

Big data poses great challenges and opportunities for databases

20 Apr 2014 Beijing - Advances in the technology frontier have resulted in major disruptions and transformations in the massive data processing infrastructures. For the past three decades, classical database management systems, data warehousing and data analysis technologies have been well recognized as effective tools for data management and analysis. More recently, data from different sources and in different format are being collected at unprecedented scale. This gives rise to the so-called 3V characteristics of the Big Data: volume, velocity and variety. Classical approaches of data warehousing and data analysis are no longer viable to deal with both the scale of data and the sophisticated analysis. This challenge has been labeled as the 'Big Data' problem. In principle, while earlier DBMSs focused on modelling operational characteristics of enterprises, Big Data systems are now expected to model vast amounts of heterogeneous and complex data.

Although the massive data pose many challenges and invalidate earlier designs, they provide many great opportunities, and most of all, instead of making decisions based on small sets of data or calibration, decisions can now be made based on the data itself. Various Big Data applications have emerged, such as Social networking, Enterprise data management, Scientific applications, Mobile computing, Scalable and elastic data management, Scalable data analytics, etc.

Meanwhile, many distributed data processing frameworks/systems have been proposed to deal with Big Data problem. MapReduce is the most successful distributed computing platform whose fundamental idea is to simplify the parallel processing, and has been widely applied. MapReduce systems are good at complex analytics and extract-transform-load tasks at large scale, however it also suffers from its reduced functionality. There also exist many other distributed data processing systems that go beyond the MapReduce framework. These systems have been designed to address various problems not well handled by MapReduce, e.g., Dremel for Interactive analysis, GraphLab for Graph analysis, STORM for stream processing, Spark for memory computing.

The Big Data presents us the challenges and opportunities in designing new data processing systems for managing and processing the massive data. The potential research topics in this field lie in all phases of data management pipeline that includes data acquisition, data integration, data modelling, query processing, data analysis, etc. Besides, the Big Data also brings great challenges and opportunities to other computer science disciplines such as system architecture, storage system, system software and software engineering.

More information is available in the article, titled "Big Data: the driver for innovation in databases" which appears in theNational Science Review, Volume 1, Issue 1, Pp. 27-30 - doi:10.1093/nsr/nwt020.

The abstract is available at http://nsr.oxfordjournals.org/content/1/1/27.extract

Source: Science China Press

Back to Table of contents

Primeur weekly 2014-04-28

Exascale supercomputing

MONTBLANC scaling new heights of computing performance ...

The Cloud

HP extends mission-critical enterprise environments ...

UTSA hosts Open BigCloud Symposium and OCP Workshop May 7-8 ...

IBM provides SoftLayer ecosystem partners with new resources for generating Cloud revenue ...

Desktop Grids

Parabon launches crowdsourcing initiative to tackle Alzheimer's Disease with computing capacity donated by concerned citizens ...

SETI.Germany to organize BOINC Pentathlon ...

New BOINC server VM image available ...

EuroFlash

Tower International selects Altair's Compute Manager ...

Forschungszentrum Jülich Joins the OpenPOWER Foundation ...

CSC leads a Nordic project on sensitive data ...

CSC joins Intel Parallel Computing Center programme ...

Earthquake simulation tops 1 quadrillion flops ...

Master in High Performance Computing (MHPC) programme at ICTP and the International School for Advanced Studies (SISSA) ...

Catherine Rivière, PRACE Council Chair, speaks at ICRI 2014 on the way forward for PRACE and HPC in Europe ...

PRACE Spring School: Researchers from all over the world come to school in Austria ...

USFlash

Third Person, first rate projection: TDC delivers tech and crew to ground-breaking Australian movie production for TEDx Sydney ...

OpenPOWER Foundation unveils first innovations and roadmap ...

NCAR & CU join Intel Parallel Computing Centers programme ...

AltaSim Technologies wins DOE grant for additive manufacturing ...

Georgia Tech researchers use NSF XSEDE supercomputers to understand and predict how black holes swallow stars ...

NEC selects Chelsio adapters for Vector Supercomputer ...

IBM Watson Group invests in Fluid to transform the consumer shopping experience ...

HP introduces next-generation enterprise array for mission-critical workloads ...

Big data poses great challenges and opportunities for databases ...

IBM tackles Big Data challenges with Open Server Innovation Model ...