University of Florida tames big science data growth with DDN

SANTA CLARA, USA: Providing more than 400 world-class services to a wide range of life science researchers, the University of Florida's Interdisciplinary Center for Biotechnology Research (ICBR) has selected DataDirect Networks (DDN) high-performance storage as the foundation for a converged infrastructure designed to accommodate ever-increasing life sciences and bioinformatics workloads.

As one of the Nation's top cross-disciplinary life sciences academic research facilities, ICBR's data load explodes with every new high-speed device investment including next generation sequencers and Cryo-electron microscopy (cryo-EM) instruments, which are capable of generating TB of data per day, said a press release.

To tame its Big Data growth within the constraints of limited data center space and funding and a lean administrative team, ICBR turned to DDN's unique, appliance-based approach to converged infrastructure which allowed them to reduce their storage and application server footprint by 350 percent. This converged approach gives ICBR a simple, secure, shared model to use as building blocks to scale up or out to meet future research requirements.

Aaron Gardner, Cyberinfrastructure Section Director for the Interdisciplinary Center for Biotechnology Research said, "Our goal was to develop storage building blocks that would enable us to assemble any kind of storage researchers may need in a simple and secure shared-storage model."

"We now have the opportunity to build an authoritative, immutable data warehouse that provides a safe harbor in the middle of the 'Wild Wild West' of scientific research. Based on that, as well as the ability to increase performance with smaller footprint, fewer hardware costs, lower management overhead and latency makes me confident we are headed in the right direction," added Gardner.

According to release, using DDN Storage Fusion Architecture high-performance storage engine with In-Storage Processing converged compute capabilities and DDN's GRIDScaler parallel file system, ICBR was able to deploy an adaptive and customizable architecture for storing, managing and analyzing large collections of distributed data totaling billions of files and petabytes of storage across tens of federated data grids.

"We were able to take advantage of DDN's embedded platform to take in iRODS with distributed storage, which hasn't been done before. We have the benefit of pairing the two in a way that's easy to manage," said Gardner.

"The combination of fast performance with low latency means that accessing and aligning storage resources don't distract from the science. We can scale to a few thousand files a second with a couple hundred simultaneous read/write transactions easily."

Now, since researchers can access as little or as much data as they choose, internal and external ICBR researchers, as well as partner institutions, can focus on scientific advances such as innovation in antibody development and production, rather than on IT infrastructure, the release said.

With DDN solutions, life sciences organizations worldwide continue to document meaningful performance increases, and up to 75 per cent faster genomics pipeline throughput than traditional storage platforms.