Big Data from Scratch: Building a 4-nodes Hadoop cluster and use of the Map-Reduce Simple Skyline Algorithm (MR-SSA) based on the R Language (Big Data & MR-SSA) - Softcover

Leliopoulos, Panagiotis

Softcover

ISBN 10: 1973130254 ISBN 13: 9781973130253

Publisher: Independently published, 2017

Synopsis

Big Data has been entered into our lives for real. During this book, we make an introduction and analysis on the Big Data. Thus we study the Big Data theory, giving some definitions what Big Data is. Also, we continue analyzing the types of Data and we study the goals of Big Data and see some analyzing techniques. Furthermore, we study some descriptions of previous architectures and systems of cluster computing, like Oscar, Rocks, OpenMosix, and also the root of Map-Reduce, the MPI. Finally, we make a brief reference to the use of Map-Reduce and an introduction to Hadoop framework. In the other part of this book, we study the performance of a Computer Cluster, developing a Simple Skyline Algorithm (MR-SSA). Moreover, the actual algorithm is designed to run parallel in distributed systems, with the method of Map-Reduce. Specifically, the experimental part of the book consists of a Computer Cluster with four nodes. The development of the algorithm is based on the method of Μap-Reduce and implemented within the R language. The fundamental architectural design is including three basic functions like the random range generator, the classification of the dataset in ascending order by column, and at last the calculation of the skyline points. Finally, our application has been tested locally on a computer by using Virtual Machines, which are based on the Cloudera platform.

About this title

About the Author

Panagiotis Leliopoulos is holding a Bachelor Degree in Electronic Engineering and three Master Degrees (M.Sc.): On ICT with direction on the Network-Oriented Information Systems and Cloud Computing from the University of Piraeus, on Business Analytics from the Athens University of Economics and Business and on Data Science from the National Centre for Scientific Research "Demokritos", and the University of the Peloponnese.

Hence, he has experience in the Hadoop framework and Map-Reduce processes and he is developing Map-Reduce Skyline Algorithms for Research. Furthermore, he has published articles on e-Commerce, about "The Evolution of Business to Consumer (B2C) E-Commerce" (posted in dblp), and on Education, about "The Use of Big Data in Education" in international conferences and journals.

At the end, he has work experience as Consultant and Technical Project Manager on ICT applications, in the Public and Private sector and Telecommunication Companies.

Edition details

• Publisher: Independently published
• Publication date: 2017
• Language: English
• ISBN 10: 1973130254
• ISBN 13: 9781973130253
• Binding: Paperback
• Number of pages: 94