Job Description
Job Summary
Looking for a Senior Developer with strong experience in Spark Scala and Big Data technologies to design, develop, and optimize scalable data processing solutions. The role involves building Spark-based data pipelines, handling large datasets, and working within the Hadoop ecosystem.
Must-Have Skill
Spark Scala
Hadoop (HDFS, Hive, YARN, MapReduce, Sqoop)
Spark SQL
Hive & SQL Query Optimization
UNIX & Shell Scripting
Batch & Streaming Data Processing
Debugging and Performance Tuning of Spark Applications
Autosys and Gradle
Key Responsibilities:-
Develop Scala/Spark jobs for data transformation and aggregation.
Design and implement scalable data processing pipelines.
Optimize Spark jobs and SQL queries for large-scale data processing.
Create unit tests and technical documentation.
Collaborate with SMEs and stakeholders in an Agile environment.
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.