IJRTI
International Journal for Research Trends and Innovation
International Peer Reviewed & Refereed Journals, Open Access Journal
ISSN Approved Journal No: 2456-3315 | Impact factor: 8.14 | ESTD Year: 2016
Scholarly open access journals, Peer-reviewed, and Refereed Journals, Impact factor 8.14 (Calculate by google scholar and Semantic Scholar | AI-Powered Research Tool) , Multidisciplinary, Monthly, Indexing in all major database & Metadata, Citation Generator, Digital Object Identifier(DOI)

Call For Paper

For Authors

Forms / Download

Published Issue Details

Editorial Board

Other IMP Links

Facts & Figure

Impact Factor : 8.14

Issue per Year : 12

Volume Published : 11

Issue Published : 118

Article Submitted : 21604

Article Published : 8531

Total Authors : 22438

Total Reviewer : 805

Total Countries : 159

Indexing Partner

Licence

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Published Paper Details
Paper Title: Enhancing Data Processing Efficiency Using Apache Spark: Techniques and Optimization Strategies
Authors Name: Srinivasa Rao Nelluri
Download E-Certificate: Download
Author Reg. ID:
IJRTI_207192
Published Paper Id: IJRTI2209130
Published In: Volume 7 Issue 9, September-2022
DOI: https://doi.org/10.56975/ijrti.v7i9.207192
Abstract: The study analyzes the optimization techniques in Apache Spark using a secondary qualitative methodology. The research outlines three main themes: performance bottlenecks, optimization strategies, and practicability. This can help to identify the challenges as well as their strategies for improving the efficiency of Spark. Results indicate the existence of inefficiencies based on poor memory management, skew, as well as poor tuning. Combined optimization techniques Adaptive query execution, Caching, and dynamic resource allocation, make a significant impact on scalability and processing speed. The combination of all these methods allowed the study to fill the gaps in the literature and present a comprehensive outlook on the comprehensive sustainable ability to improve the work of Spark. The results provide useful information to data engineers and analytics students.
Keywords: Apache Spark, Performance Optimization, Big Data Analytics, Distributed Computing, Resource Management, Scalability, Execution Efficiency
Cite Article: "Enhancing Data Processing Efficiency Using Apache Spark: Techniques and Optimization Strategies", International Journal for Research Trends and Innovation (www.ijrti.org), ISSN:2455-2631, Vol.7, Issue 9, page no.940-944, September-2022, Available :http://www.ijrti.org/papers/IJRTI2209130.pdf
Downloads: 000267
ISSN: 2456-3315 | IMPACT FACTOR: 8.14 Calculated By Google Scholar| ESTD YEAR: 2016
An International Scholarly Open Access Journal, Peer-Reviewed, Refereed Journal Impact Factor 8.14 Calculate by Google Scholar and Semantic Scholar | AI-Powered Research Tool, Multidisciplinary, Monthly, Multilanguage Journal Indexing in All Major Database & Metadata, Citation Generator
Publication Details: Published Paper ID: IJRTI2209130
Registration ID:207192
Published In: Volume 7 Issue 9, September-2022
DOI (Digital Object Identifier): https://doi.org/10.56975/ijrti.v7i9.207192
Page No: 940-944
Country: -, -, India
Research Area: Engineering
Publisher : IJ Publication
Published Paper URL : https://www.ijrti.org/viewpaperforall?paper=IJRTI2209130
Published Paper PDF: https://www.ijrti.org/papers/IJRTI2209130
Share Article:

Click Here to Download This Article

Article Preview
Click Here to Download This Article

Major Indexing from www.ijrti.org
Google Scholar ResearcherID Thomson Reuters Mendeley : reference manager Academia.edu
arXiv.org : cornell university library Research Gate CiteSeerX DOAJ : Directory of Open Access Journals
DRJI Index Copernicus International Scribd DocStoc

ISSN Details

ISSN: 2456-3315
Impact Factor: 8.14 and ISSN APPROVED, Journal Starting Year (ESTD) : 2016

DOI (A digital object identifier)


Providing A digital object identifier by DOI.ONE
How to Get DOI?

Conference

Open Access License Policy

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License

Creative Commons License This material is Open Knowledge This material is Open Data This material is Open Content

Important Details

Join RMS/Earn 300

IJRTI

WhatsApp
Click Here

Indexing Partner