The rise of big data in 2017: Here are the top emerging trends

We saw the rise of big data in 2017 and the trend will continue to gain speed. Accessing and preserving big data is now a common practice at almost all organizations and I see following trends emerging from data-driven ones.[caption id="attachment_4245529" align="alignleft" width="380"] Representational image. Reuters.[/caption]No Data SilosThe most important asset, Data, is not in silos anymore. A plethora of systems of records now feed into big data lakes which then make it available to anyone within the organisation with right credentials and use case. Thanks to hundreds of connectors made available by companies, such as Talend and Spark, new datasets can be added in hours instead of days and weeks.Utilize Legacy & Future-ReadyMost organisations are not in a rush to replace legacy (transaction) systems but they are building new parallel systems which are future ready and can utilize data from legacy systems.These new systems are taking processor-intensive tasks away from legacy system and in the process helping them make more efficient.The new systems are adding intelligence to the data by mining and deep learning with tools such as Google TensorFlow, R, and Python, etc.Micro Subscription ModelsNew systems are beginning to create micro product/service offerings for each customer in real-time and a micro-subscription pricing to go along with it, for example a travel insurance policy provided to a customer at the time of boarding a plane and applicable only for the duration of the flight.Real-time processing at scale is made possible by Kafka, Cassandra, etc. with Python and Google TensorFlow models executing on new data.AI Powered Self-Service & Problem Resolution· More organizations are using artificial intelligence to help a customer find answers to their product, billing or technical question.· Deeper integration with Apple Siri, Amazon Echo, and Google Home will accelerate this trend and soon we will be able to buy and sell products or services and locate, and resolve problems with just our voice.The author is VP, Head of Data & Cognitive Analytics at Mphasis.