Experience
10 - 12 yrs
Job Location
Pune, India
Vacancy
1
Designation
Lead Data Engineer
Job Type
ONSITE
Job Description
Databricks Lead Delivery & Engineering1
Lead hands-on Databricks delivery , ensuring adherence to CoE standards and best practices.
Key Responsibilities - Lead Databricks engineering teams
- Build and optimize Spark & Delta Lake pipelines
- Implement Databricks Jobs, Workflows, CI/CD
- Optimize performance and DBU usage
- Contribute to Databricks accelerators and standards
- Design and implement end-to-end data platforms using Databricks Lakehouse
- Lead development of:
- Data ingestion (batch & streaming)
- Delta Lake data modeling (Bronze/Silver/Gold)
- Scalable ETL/ELT pipelines
-
- Optimize Spark workloads for performance and cost
- Ensure reliability, scalability, and observability of data pipelines
- 10 12 years in data engineering
- 3 5 years hands-on Databricks experience
- Deep expertise in Databricks, Apache Spark, Delta Lake
- Strong hands-on experience with PySpark / Spark SQL (core, SQL, streaming)
- Experience designing Lakehouse architectures
- Strong understanding of data modeling, data quality, and lineage
- Databricks platform features
- Cloud-native data engineering
- Performance tuning & troubleshooting
Certifications (Preferred)
- Databricks Data Engineer Associate and Professional
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.