Experience
6 - 11 yrs
Job Location
Chennai, India
Vacancy
1
Designation
Spark Scala Developer
Job Type
ONSITE
Job Description
Job Summary:
We are looking for a talented and experienced Scala/Spark Developer to join our data engineering team. In this role, you will be responsible for building and maintaining scalable data pipelines and applications using the Apache Spark ecosystem. Your work will be crucial for processing and analyzing large datasets to extract valuable business insights. This is an excellent opportunity for a developer who is passionate about big data and distributed computing.
Key Responsibilities :
Design, develop, and maintain high-performance data processing applications using Scala and Apache Spark. Build robust and scalable ETL pipelines for ingesting, transforming, and loading data from various sources into data warehouses or data lakes. Optimize Spark applications for performance, resource utilization, and cost efficiency. Work with big data technologies like Hadoop, Hive, and Kafka. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions. Write clean, maintainable, and well-tested code, adhering to best practices. Troubleshoot and resolve complex issues related to data processing and infrastructure.
Required Qualifications:
Bachelors degree in Computer Science, Engineering, or related field. 5+ years of experience in software development, with a strong focus on Scala and Apache Spark. Deep understanding of Spark architecture (RDDs, DataFrames, Datasets) and optimization techniques. Experience with distributed computing concepts and big data ecosystems. Strong proficiency in SQL and data manipulation. Experience with version control systems (Git).
Preferred Qualifications:
Experience with cloud platforms like AWS (EMR, S3), Azure, or GCP. Experience with real-time data processing technologies like Apache Flink or Kafka Streams. Experience with data orchestration tools like Apache Airflow. Contributions to open-source Spark projects.
Key Competencies:
Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Passion for data engineering and big data technologies. Attention to detail and commitment to quality. Self-starter with a continuous learning mindset.
Key Responsibilities :
Required Qualifications:
Preferred Qualifications:
Key Competencies:
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.