Comparative Study of Open Source Processing Frameworks for Analysis of Big Data

Article Sidebar

PDF
Published: Jun 22, 2017
DOI: https://doi.org/10.26483/ijarcs.v8i5.3862
Keywords:
Big Data, Data analytics, Big Data Analytics, Hadoop, Spark, Flink, Samza, Storm

Main Article Content

Sanisha Chandel
Himachal Pradesh University
http://orcid.org/0000-0002-7384-4867

Abstract

Multiple terabytes of data is being generated every moment nowadays by various devices. Merely collecting data is worthless if not utilized for better decision making. Big Data Analytics provide the value to data and helps in improving decision making. Various data processing frameworks are available, open source as well as enterprise based, which can process data in batches as well as in real time. This paper provides an overview and comparative study of such open source frameworks highlighting their main features. The aim of the paper is to give better insight of open source frameworks and help researchers find the best framework for their application.

Downloads

Download data is not yet available.

Article Details

Issue
Vol. 8 No. 5 (2017): May-June 2017
Section
Articles

COPYRIGHT

Submission of a manuscript implies: that the work described has not been published before, that it is not under consideration for publication elsewhere; that if and when the manuscript is accepted for publication, the authors agree to automatic transfer of the copyright to the publisher.

Authors who publish with this journal agree to the following terms:

  • Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
  • Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  • Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work
  • The journal allows the author(s) to retain publishing rights without restrictions.
  • The journal allows the author(s) to hold the copyright without restrictions.
Author Biography

Sanisha Chandel, Himachal Pradesh University

Department of Computer Science

References

https://www.forbes.com/sites/bernardmarr/2015/09/30/big-data-20-mind-boggling-facts-everyone-must-read/.

https://www.google.co.in/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwivrZ3v74PUAhVFvY8KHV79CfcQjRwIBw&url=http%3A%2F%2Faoife.dbsdataprojects.com%2Ftag%2Fdata-evolution%2F&psig=AFQjCNGcm2LLGV0rVu-sQxbWig3REz7vUA&ust=1495555178940947

Amir Gandomi, MurtazaHaider,â€Beyond the hype: big data concepts, methods, and analyticsâ€,International Journal of Information Management, Volume 35, Issue 2, April 2015

Justin Ellingwood,“Hadoop, Storm, Samza, Spark and Flink: Big Data Frameworks Comparedâ€,https://www.digitalocean.com/community/tutorials/hadoopstormsamzasparkandflinkbigdataframeworkscompared.

YashikaVerma,SumitHooda,†A review paper on Big Data and Hadoopâ€,IJSRD - International Journal for Scientific Research & Development| vol. 3, Issue 02, | ISSN (online): 2321-0613, 2015

Samiddha Mukherjee, Ravi Shaw, “Big Data – Concepts, Applications, Challenges and Future Scopeâ€, International Journal of Advanced Research in Computer and Communication Engineering vol. 5, Issue 2, February 2016.

Nada Elgendy and Ahmed Elragal,â€Big data analytics: A literature review paperâ€,https://www.researchgate.net/publication/264555968, 2014

T. Giri Babu, Dr. G. Anjan Babu,†A Survey on Data Science Technologies & Big Data Analyticsâ€, International Journal of Advanced Research in Computer Science and Software Engineering, vol. 6, Issue 2, February 2016

R.A.Fadnavis, SamrudhiTabhane,â€Big Data Processing Using Hadoopâ€,International Journal of Computer Science and Information Technologies, vol. 6, 2015)

Ms. Vibhavari Chavan, Prof. Rajesh. N. Phursule,†Survey Paper on Big Dataâ€, International Journal of Computer Science and Information Technologies, vol. 5, 2014

V. Srilakshmi, V.Lakshmi Chetana, T.P.Ann Thabitha,†A Study on Big Data Technologiesâ€, International Journal of Innovative Research in Computer and Communication Engineering, vol. 4, Issue 6, June 2016

Abdul GhaffarShoro& Tariq Rahim Soomro, “Big Data Analysis: Ap Spark Perspectiveâ€, Global Journal of Computer Science and Technology: C Software & Data Engineering vol. 15, Issue 1, Version 1.0, 2015

AnkushVerma, Ashik Husain Mansuri, Dr. Neelesh Jain, “A Review on Big Data Environment on Different Frameworks, Techniques and Toolsâ€, International Journal of Core Engineering & Management (IJCEM), vol. 3, Issue 3, June 2016

Zhigao Zheng, Ping Wang, Jing Liu, Shengli Sun,â€Real-Time Big Data Processing Framework: Challenges and Solutionsâ€, Applied Mathematics & Information Sciences an International Journal, November 2015

http://www.navint.com/images/Big.Data.pdf, March 2012

https://image.slidesharecdn.com/bigdata-140128092341-phpapp02/95/big-data-6-638.jpg?cb=1390901096

http://www.kdnuggets.com/2016/03/topbigdataprocessingframeworks.html

https://samza.apache.org/learn/documentation/0.11/introduction/background.html

https://tsicilian.wordpress.com/2015/02/16/streamingbigdatastormsparkandsamza/