Comparative Study of Open Source Processing Frameworks for Analysis of Big Data

Sanisha Chandel

Abstract


Multiple terabytes of data is being generated every moment nowadays by various devices. Merely collecting data is worthless if not utilized for better decision making. Big Data Analytics provide the value to data and helps in improving decision making. Various data processing frameworks are available, open source as well as enterprise based, which can process data in batches as well as in real time. This paper provides an overview and comparative study of such open source frameworks highlighting their main features. The aim of the paper is to give better insight of open source frameworks and help researchers find the best framework for their application.

Keywords


Big Data; Data analytics; Big Data Analytics; Hadoop; Spark; Flink; Samza; Storm

Full Text:

PDF

References


https://www.forbes.com/sites/bernardmarr/2015/09/30/big-data-20-mind-boggling-facts-everyone-must-read/.

https://www.google.co.in/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwivrZ3v74PUAhVFvY8KHV79CfcQjRwIBw&url=http%3A%2F%2Faoife.dbsdataprojects.com%2Ftag%2Fdata-evolution%2F&psig=AFQjCNGcm2LLGV0rVu-sQxbWig3REz7vUA&ust=1495555178940947

Amir Gandomi, MurtazaHaider,”Beyond the hype: big data concepts, methods, and analytics”,International Journal of Information Management, Volume 35, Issue 2, April 2015

Justin Ellingwood,“Hadoop, Storm, Samza, Spark and Flink: Big Data Frameworks Compared”,https://www.digitalocean.com/community/tutorials/hadoopstormsamzasparkandflinkbigdataframeworkscompared.

YashikaVerma,SumitHooda,” A review paper on Big Data and Hadoop”,IJSRD - International Journal for Scientific Research & Development| vol. 3, Issue 02, | ISSN (online): 2321-0613, 2015

Samiddha Mukherjee, Ravi Shaw, “Big Data – Concepts, Applications, Challenges and Future Scope”, International Journal of Advanced Research in Computer and Communication Engineering vol. 5, Issue 2, February 2016.

Nada Elgendy and Ahmed Elragal,”Big data analytics: A literature review paper”,https://www.researchgate.net/publication/264555968, 2014

T. Giri Babu, Dr. G. Anjan Babu,” A Survey on Data Science Technologies & Big Data Analytics”, International Journal of Advanced Research in Computer Science and Software Engineering, vol. 6, Issue 2, February 2016

R.A.Fadnavis, SamrudhiTabhane,”Big Data Processing Using Hadoop”,International Journal of Computer Science and Information Technologies, vol. 6, 2015)

Ms. Vibhavari Chavan, Prof. Rajesh. N. Phursule,” Survey Paper on Big Data”, International Journal of Computer Science and Information Technologies, vol. 5, 2014

V. Srilakshmi, V.Lakshmi Chetana, T.P.Ann Thabitha,” A Study on Big Data Technologies”, International Journal of Innovative Research in Computer and Communication Engineering, vol. 4, Issue 6, June 2016

Abdul GhaffarShoro& Tariq Rahim Soomro, “Big Data Analysis: Ap Spark Perspective”, Global Journal of Computer Science and Technology: C Software & Data Engineering vol. 15, Issue 1, Version 1.0, 2015

AnkushVerma, Ashik Husain Mansuri, Dr. Neelesh Jain, “A Review on Big Data Environment on Different Frameworks, Techniques and Tools”, International Journal of Core Engineering & Management (IJCEM), vol. 3, Issue 3, June 2016

Zhigao Zheng, Ping Wang, Jing Liu, Shengli Sun,”Real-Time Big Data Processing Framework: Challenges and Solutions”, Applied Mathematics & Information Sciences an International Journal, November 2015

http://www.navint.com/images/Big.Data.pdf, March 2012

https://image.slidesharecdn.com/bigdata-140128092341-phpapp02/95/big-data-6-638.jpg?cb=1390901096

http://www.kdnuggets.com/2016/03/topbigdataprocessingframeworks.html

https://samza.apache.org/learn/documentation/0.11/introduction/background.html

https://tsicilian.wordpress.com/2015/02/16/streamingbigdatastormsparkandsamza/




DOI: https://doi.org/10.26483/ijarcs.v8i5.3862

Refbacks

  • There are currently no refbacks.


Bookmark and Share


Copyright (c) 2017 International Journal of Advanced Research in Computer Science