Experience
2 - 5 yrs
Job Location
Hyderabad, India
Vacancy
1
Designation
Spark Scala Developer
Job Type
Not specified
Job Description
Educational Requirements
Bachelor of Engineering
Service Line
Data Analytics Unit
Responsibilities
- Data Engineering Development: Design, develop, and maintain scalable batch/stream data pipelines using Spark with Scala and Python.
- Performance Reliability: Tune Spark jobs (partitioning, caching, shuffles, memory/executor settings) to improve performance and cost efficiency.
- Troubleshoot production issues, perform root-cause analysis, and implement preventive fixes.
- Ensure reliability through robust logging, monitoring hooks, and failure-handling strategies.
- Collaboration Delivery: Work with stakeholders to refine requirements and deliver well-documented, production-ready solutions.
- Conduct code reviews, enforce best practices, and mentor team members on Spark/Scala/Python patterns.
- Contribute to CI/CD-friendly development practices including testing, version control, and release readiness.
Additional Responsibilities:
- Bachelors degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
- 59 years of experience in data engineering or backend development with strong hands-on delivery ownership.
- Strong proficiency in Python and Apache Spark for large-scale data processing.
- Solid experience with Scala for Spark-based development and production-grade implementations.
- Working knowledge of Hive and SQL-based data querying/processing concepts.
Technical and Professional Requirements:
Technology->Analytics - Packages->Python - Big Data,Technology->Big Data - Data Processing->Spark,Technology->Big Data - Data Processing->Scala
Preferred Skills:
- Technology->Analytics - Packages->Python - Big Data
- Technology->Java->Apache->Scala
- Technology->Big Data - Data Processing->Spark
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.