The "Big Data" Grid will connect the exhibition booths of DataDirect Networks (DDN), Karlsruhe Institute of Technology and RENCI/North Carolina to the Texas Advanced Computing Center (TACC) in Austin, Texas; RENCI (Renaissance Computing Institute) in Chapel Hill, North Carolina; and the Karlsruhe Institute of Technology in Karlsruhe, Germany. The data Grid will be built with DDN's Web Object Scaler (WOS), a hyperscale geo-distributed Cloud storage system, and will use the Integrated Rule-Oriented Data System (iRODS), a data software system that manages large, complex data sets by applying management policies to control the execution of all data access and manipulation operations.
WOS is an extremely fast and easy-to-deploy object-oriented Cloud storage system that can scale to unprecedented levels while still being managed as a single entity. It addresses the needs of organisations that have petabytes of data, which need to be archived and shared between multiple data centres.
The Data Intensive Cyber Environments (DICE) research groups at the University of North Carolina at Chapel Hill and the University of California at San Diego develop iRODS, with support from a U.S. National Science Foundation grant. The iRODS@RENCI research group also supports iRODS development. iRODS is the core data management software being deployed by the DataNet Federation Consortium, an NSF-funded project to prototype a national data management infrastructure with six science and engineering disciplines.
Combining the super fast and scalable WOS with iRODS results in a Grid in which data is easily shared, managed and stored in persistent archives, according to Reagan Moore, head of the DICE group at UNC-Chapel Hill and RENCI chief scientist for data Grids.
"This international data Grid demonstrates how researchers can participate in collaborative research while analyzing massive data collections", Reagan Moore stated. "An iRODS-based WOS infrastructure greatly minimizes the effort required to manage and distribute large scientific data sets and make them available for such research."
Reagan Moore and DDN Chief Scientist Dave Fellinger will provide an overview of the WOS-iRODS data Grid and a second international data Grid connecting Kings College London to RENCI, KEK in Tokyo, Japan; Academia Sinica in Taiwan; and IN2P3 in France. Their talk takes place at 3:30 p.m. Tuesday, November 15, in the RENCI booth. At 2:30 p.m. Tuesday, also in the RENCI booth, Reagan Moore will highlight iRODS and some of the research organisations using iRODS, including NASA, the National Optical Astronomy Observatory, the Australian Research Collaboration Service, and the Texas Digital Libraries.