Harnessing the power of big data is not without challenges. The same massive volumes of structured and unstructured data that create these opportunities for innovation can confound attempts to cost-effectively contain it, let alone extract value from it, opine DeBono from Red Hat
To be able to fully exploit the opportunities of big data, companies must be able to access and use all of their data without ad-hoc interventions. Unlike conventional storage devices, a big data storage platform must bridge these legacy storage silos, rather than simply add yet another storage solution to the mix.
4. Provide global accessibility of data
Before big data, figuring out how to improve data access for globally-distributed users presented a significant challenge to IT organizations. Now, the data itself has become globally distributed, transforming the IT challenge into one of making it readily available to users and applications across the global enterprise.
A centralized approach to data management is no longer workable in the age of big data. Data volumes are too large, WAN bandwidth is too limited, and the consequences of a single point of failure are too costly. A big data storage platform must be able to manage data that is distributed across the global enterprise as a single, unified pool.
5. Protect and maintain the availability of data
Conventional storage systems have historically relied on hardware redundancy and external backups to reduce failures and increase data availability. The sheer size and decentralized nature of big data renders a hardware or backup-dependent strategy too cost-prohibitive and inflexible to implement.
Rather than seeking to protect against failure through the use of proprietary, enterprise-grade hardware, a big data storage platform must assume that hardware failure is inevitable and offer data availability and integrity through intelligent software.
Big data holds great promise for the modern enterprise. Yet it comes with a unique set of requirements that place it well beyond the reach of traditional NAS and SAN storage systems. A data storage platform designed with the realities of big data in mind is critical for companies. Without taking steps to transition to a robust and capable data storage platform, efforts to extract value from big data will no doubt be hindered by technical and logistical challenges.