Scala + Spark Data Engineer

The IT Mind
Posted on

Experience
6 - 11 yrs
Job Location
Bengaluru, India
Vacancy
1
Designation
Spark Scala Developer
Job Type
Not specified

Job Description

Languages: Scala, Java
  • Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie
  • Big Data Processing: Hadoop, Kafka, Spark Spark Structured Streaming.
  • Experience on SOLID DRY principles with Good Software Architecture Design implementation
experience
  • Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data
Structures Algorithms)
  • Proficient in developing automated frameworks for unit integration testing.
  • Experience with Docker and Helm and related container technologies.
  • Proficient in deploying and managing Spark workloads on Kubernetes clusters.
  • Experience in evaluation and implementation of Data Validation Data Quality
  • Devops experience in Jenkins, Maven, Github, Github actions, CI/CD
  • Skillset: Scala + Spark + Airflow + Docker/Kubernetes
  • Experience: 6 12 years
  • CTC: Open
Mandatory skills: (Scala + Spark + Airflow + Docker/Kubernetes) Data Engineer Scala Coding Exp Spark Airflow Docker Kubernetes Yarn/Oozie Devops
 

No Referrers Available

There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.