Understanding Hindsight, Insight and Forsight Data To Large-Scale Distributed Data Intelligence (Algorithms) Machine: A Scale-Out Review

Volume 4 Issue 3 September - November 2017

Review Paper

Understanding Hindsight, Insight and Forsight Data To Large-Scale Distributed Data Intelligence (Algorithms) Machine: A Scale-Out Review

Sabibullah Mohamed Hanifa*

*Associate Professor & Dean, PG and Research Department of Computer Science, SCAS, Pudukkottai, Tamilnadu, India.

Hanifa, S. M. (2017). Understanding Hindsight, Insight and Forsight Data To Large-Scale Distributed Data Intelligence (Algorithms) Machine: A Scale-Out Review. i-manager’s Journal on Pattern Recognition, 4(3), 32-43. https://doi.org/10.26634/jpr.4.3.13888

Abstract

This review attempts to comprehend the insights and foresights into the grasping power of data science, data quality, data process, data pre-process, big data, big data process and analysis, analytics, BD (Big Data) and analytics lifecycle, file storage, platforms/technologies supported, Hadoop concepts, eco-system components, and design principles. Principle and philosophy behind computations are also explained through flow diagram. Various analytics based on its solutions, cluster computing based platforms like Apache Spark (its architecture – core, other components, and utilities), MLlib package – Machine Learning (ML) methods/ tasks and detailed supported algorithms are exclusively elucidated, to understand the concepts of these pinpoints. The explored comprehensive contents would definitely be useful and provide core understanding knowledge in the large scale ML dependent algorithms process, suitable to build the relevant application solutions (may be predictions/ classifications/ segmentations/ recommendations) via Apache – Spark environment.