Azure Databricks Data Engineer (L3)

Job Description Databricks Data Engineer (L3)

Position: Databricks Data Engineer (L3)
Experience: 5 8 Years
Qualification: BE / B.Tech (Mandatory)
Notice Period: Immediate Joiners Preferred
Interview Process:

We are seeking an experienced Databricks Data Engineer with strong expertise in building scalable data pipelines, data warehousing, and cloud-based data platforms. The ideal candidate should have hands-on experience with Databricks, Apache Spark, SQL, and modern data engineering practices. Candidates from reputed product companies, consulting firms, or large enterprise organizations will be preferred.

• Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.

• Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.

• Develop data transformation workflows using PySpark and SQL.

• Work closely with business stakeholders, data scientists, and analytics teams to deliver high-quality data solutions.

• Implement data quality, governance, and security best practices.

• Optimize Databricks jobs for performance, scalability, and cost efficiency.

• Integrate data from multiple sources including databases, APIs, cloud storage, and enterprise applications.

• Monitor, troubleshoot, and support production data pipelines.

• Participate in architecture discussions and contribute to data platform modernization initiatives.

• Databricks

• Apache Spark

• PySpark

• SQL

• Data Engineering

• ETL / ELT Development

• Data Warehousing Concepts

• Python

• Azure Databricks / AWS Databricks

• Delta Lake

• Azure Data Factory (ADF)

• Azure Data Lake Storage (ADLS)

• AWS S3

• Airflow

• Kafka

• CI/CD Pipelines

• Git

• 5 8 years of relevant Data Engineering experience.

• Strong hands-on expertise with Databricks and Spark ecosystem.

• Experience working on cloud-based data platforms (Azure/AWS).

• Good understanding of data modeling, data lakes, and data warehouse architectures.

• Strong problem-solving and analytical skills.

• Excellent communication and stakeholder management abilities.

• BE/B.Tech degree from a recognized university is mandatory.

• Immediate joiners or candidates who can join at the earliest will be given preference.

• Experience with Delta Lake architecture.

• Exposure to real-time data processing frameworks.

• Experience in performance tuning and query optimization.

• Knowledge of DevOps and DataOps practices.

• Databricks or Cloud certifications.