Mellanox is a supplier of performance interconnect for high performance GPU clusters used for Deep Learning workloads. WekaIO Matrix software coupled with ConnectX-series InfiniBand and Ethernet adapters enable performance improvements to data hungry workloads without customers needing to modify existing networks.
WekaIO has developed an optimized zero-copy network software stack based on PCIe virtualization and Data Plane Development Kit (DPDK) technologies providing a 10x boost in packet processing for low latency, high throughput applications utilizing Mellanox ConnectX Ethernet and InfiniBand networking technologies.
"The combination of WekaIO software and Mellanox Ethernet and InfiniBand adapters provides our mutual customers with a high-performance file system solution that can address a broad range of applications", stated Dror Goldenberg, vice president of architecture at Mellanox. "The WekaIO team has demonstrated performance improvements of 100 times compared to other file system options, leveraging the Mellanox interconnect technology and acceleration engines."
The San Diego Supercomputer Center (SDSC) at the University of California San Diego is currently evaluating WekaIO's high-performance storage technologies as part of its Advanced Technology Lab for use in the life sciences as well as other domains. The software is being evaluated on the Triton Shared Computing Cluster (TSCC), a "condo computing" programme established in 2013 that has grown in popularity among campus-based researchers and external users. TSCC includes 30 labs/groups with more than 200 researcher-owned compute nodes.
"We are exploring the use of WekaIO technologies over InfiniBand to address the challenges of data analytics at extreme scale in the life sciences, particle physics, geosciences, and other fields", stated SDSC Director Michael Norman. "That process is still ongoing but to-date weve already achieved some promising results."
"New compute intensive applications are generating diverse workloads that require a fundamental shift in the way storage systems are built to deliver on-demand performance at massive scale", stated Liran Zvibel, co-founder and Chief Technology Officer at WekaIO. "The WekaIO Matrix solution now supports a broad portfolio of Mellanox Ethernet and InfiniBand platforms, providing businesses with HPC class performance and cloudlike scalability, without the need for network gateways."
A combined solution from WekaIO and Mellanox delivers all-flash performance and cloud scalability and economics.
Liran Zvibel will be presenting "Storage Strategies for AI Workloads", at the Supercomputing '17 conference, on November 16, at 2:00 p.m., in the Mellanox booth #653.