Experience
10 - 12 yrs
Job Location
Central Remote, Remote
Vacancy
1
Designation
Data Science Engineer
Job Type
ONSITE
Job Description
We are seeking a highly experienced Senior Databricks Data Engineer to design, build, and optimize our data lakehouse environment. You will leverage your 10+ years of expertise to develop complex data pipelines, ensure data quality, and drive innovation using Databricks and Apache Spark.
Responsibilities:
- Design and implement scalable and robust data pipelines using Databricks and Apache Spark.
- Architect and optimize data lakehouse solutions for performance and reliability.
- Develop and maintain complex ETL/ELT processes for large-scale data ingestion and transformation.
- Write and optimize high-performance SQL and Spark code for data processing and analysis.
- Implement data quality checks, data validation, and data governance practices.
- Troubleshoot and resolve complex data processing issues and performance bottlenecks.
- Collaborate with data scientists, analysts, and other engineering teams to deliver data-driven solutions.
- Provide technical leadership and mentorship to junior engineers.
Required Skills:
- 10+ years of experience in data engineering and big data processing.
- Expert-level proficiency in Databricks and Apache Spark.
- Strong programming skills in Python and SQL.
- Deep understanding of data warehousing, data lake, and data lakehouse concepts.
- Extensive experience in designing and implementing complex ETL/ELT processes.
- Experience with cloud platforms (Azure, AWS, GCP).
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.