Advertisment

7 top big data trends

author-image
Sonal Desai
New Update
Deepak Ghodke tableau e

Deepak Ghodke

Advertisment

The innovation wave across industries touching big data is far from over. As a company we are also interested in innovative technologies and the value they provide to customers. These are the seven big data trends that stand out.

1.   Big data is cloud ready:

The cloud is everywhere, and we will continue to see adoption at extreme volumes. And big data is driving a lot of cloud growth; revenues of the top 50 public cloud providers shot up 47 percent in Q42013 to $6.2 b according to Technology Business Research.  Amazon Redshift and Google Big Query are growing dramatically. Database players like Teradata are also jumping in the game.

2.    ETL gets personal:

It has been suggested that 80 percent of an analyst’s time is spent on data prep, while only 20 percent is spent looking for insights. Enter the personal data cleansing tools focused on the analyst. Tools like Trifacta, Alteryx, Paxata and Informatica Rev are making data preparation easier to use with less technology and infrastructure required to support it.

Advertisment

3.    SQL or NoSQL?

Some may think that the jury is still deliberating, but NoSQL is making a mark in the industry. Companies like MarkLogic, Casandra, Couchbase, and MongoDB are bringing new innovation to the SQL database market and are doing quite well with large production implementations in surprising places.

4.    Hadoop is the new normal in data storage:

Whether you are of the belief that Hadoop will take over current database architecture, or there will be a mix of Hadoop and other styles of databases, one thing is clear, Hadoop is now a part of the big data architecture in many companies. The legacy data storage vendors have incorporated Hadoop into their architecture in one way or another. Some classical database providers have embraced the market leading Hadoop players like Teradata, SAP and HP. Others, like IBM, have built their own flavor of Hadoop. Spark and Impala continue to mature, putting more pressure on the traditional stack. In any case, Hadoop looks like it is here to stay and is synonymous with big data architectures.

5.    You will start trying to fish in the data lake:

The concept of a big data lake, a large body of data that exists in a natural or unrefined state, is in early stages.  This idea answers some fundamental questions around how to effectively store, manage and use the massive amounts of incoming data. Cutting edge companies like Google and Facebook have developed useful ways to leverage the data lake, but these should be considered early adopters.

Advertisment

As it is, the data lake is still in a nascent concept, and we should expect to see advances in managing and securing the big data lake this year. And as Gartner points out, the data lake requires a new kind of management to be effective.

6.    The big data ecosystem is beginning to change form:

When new ways of doing things emerge, they create a new ecosystem.  The same holds true for big data. We have new ways to add content, store and clean data, bring in social media, analyze machine data, and visualize it.

Over the next year, we will see some surprising changes in the current ecosystem. Specifically, we will see MPP (Massively Parallel Processing) databases play a different and less prominent role.

Advertisment

7.    IOT (Internet of Things) will continue to grow:

It will drive new data solutions. Your Ford Fusion sends 250 GB of data back to Ford, which in turn lets you know that something is wrong with your car. Sounds like fantasy? But hardware and semi-conductor companies are betting on it. Companies like Ford, GE, and Rolls Royce jet engines are just a few examples of companies investing in IoT. In 2015, we will see a greater use from manufacturers. Some technology companies like Cisco will create solutions around the concept to help manage the massive amounts of data.

In the near future companies will continue to see the evolution of this environment. Organizations have already started down the path of embracing big data to improve revenues, control costs, and find new versions that drive business.

He is the country manager India, Tableau Software

big-data hadoop experts