As one of the largest facilities in the world devoted to providing computational resources and expertise for basic scientific research, more than 5,000 scientists work on up to 700 projects encompassing a wide range of disciplines, including climate modelling, solar energy, fusion science, astrophysics, bio-informatics and more.
With scientific data growing rapidly, the organisation recognizes the importance of having centralized "scratch" storage architecture. By selecting a unified scratch file system, NERSC was able to build to the precise levels of performance and capacity required while optimizing the cost of configuration at every step.
This continues NERSC's strategy to move away from distributed storage "islands" in favour of "global" storage.
Furthermore, by embedding file systems in the storage controller, DDN's converged infrastructure approach enabled further optimization by removing latency and a significant number of network connections and servers. As a result, NERSC was able to meet performance and capacity requirements at 30 percent lower cost of storage than implementing local storage and file systems for each compute platform. Moreover, the facility saved hundreds of thousands of dollars in infrastructure costs by eliminating the need for additional servers, cabling, network switches and adapters.
NERSC, along with other leading research facilities in the U.S., including the Texas Advanced Computing Center (TACC) and Oak Ridge National Laboratory, is a pioneer in adopting site-wide file systems to enable cost savings, faster application burst performance, work flow efficiencies and a much simpler approach to deploying HPC resources.
With DDN storage, NERSC now can ensure that both high-bandwidth and highly transactional applications perform at optimum levels as the total bandwidth of any one storage system is now the aggregate performance of all of the site-wide storage deployed.
DDN's in-storage processing capabilities, which embed the file system inside the controller, enable NERSC to achieve maximum performance for its compute investments while minimizing storage investment costs.
NERSC has also been able to achieve industry-leading performance of 80 GBps with the fewest number of systems, which also has resulted in reduced administrative overhead and lower data centre costs.
Additionally, the ability to write temporary data to a central repository for further analysis has enabled NERSC to reduce its local "scratch" storage costs by more than 50 percent.
Jason Hick, Group Leader, Storage Systems, NERSC, stated: "DataDirect Networks was early in the game to revolutionize consolidating file system servers with centralized storage, they have an advanced storage architecture. It was exciting to hear how DDN provides both virtualized server and high-availability storage resources in a consolidated platform. It was clear DDN is a technology leader that continues to push the envelope on the latest technologies of the day. It was an awesome experience to work with DDN's engineers and we are elated with the outcome. Both organisations are better for it as together we have deployed the right model and the right technology to support our user's needs."