SDSC is a managed services provider (MSP) for the scientific community in government, academia, and business. As a research unit at the University of California, San Diego, SDSC uses its on-prem supercomputers to run advanced computation and all aspects of Big Data storage and analysis, including data integration, performance modelling, data mining, and predictive analytics.
The Center is a member of XSEDE - eXtreme Science and Engineering Discovery Environment, a single virtual system that enables researchers to interactively share computing resources, data collections, and advanced research tools.
The Center's data-intensive gateways and client technology stacks must support high-performance and high-capacity data storage for massive amounts of Big Data - much of it unstructured. Although the Center's supercomputers easily handle computing tasks, the neuroscience storage systems lacked massive scale-out capacity and the storage features necessary to support Big Data, fast access, and advanced analytics.
"Our storage requirements for data projects are growing from tens of terabytes to hundreds of terabytes", stated Amit Majumdar, Ph.D., director of data enabled scientific computing at SDSC. "Large data transfer and storage, high-speed access, sharing, search functionalities - all of these are becoming more and more important for our projects."
To successfully meet its MSP client requirements, SDSC selected Qumulo's file storage solution because of its ability to provide an optimal balance of performance, capacity, scalability, durability, and advanced functionality.
"We'd been searching for a reliable, resilient, cost effective solution for our customers with large-scale data needs", stated Michael Norman, director, SDSC. "In times past, we traded staff time for purchased solutions to meet tolerable price points. We were elated to partner with Qumulo and find we didn't have to spend years building a DIY solution."
"Qumulo has been incredibly easy for SDSC to manage", stated Brian Balderston, director of infrastructure, SDSC. "Instead of having to focus our manpower and resources on managing a number of inefficient storage systems, we are able to allocate and focus our engineering time to work on securing highly impactful and well-funded grants from the National Science Foundation, National Institutes of Health, and other funding agencies. That is a big win for the Center."
Qumulo's file storage delivers extreme low latency and high throughput performance to meet the demands of today's HPC workloads in the data centre and in the Cloud. Qumulo's file storage efficiently manages mixed IO performance for billions of small and large files at petabyte scale to accelerate productivity and real-time analytics and to eliminate data blindness for research organisations, helping to save time and money.