Azure Databricks Data Engineer (L3)

Job Description Databricks Data Engineer (L3)

Position: Databricks Data Engineer (L3)
Location: Kolkata (Work from Office / Hybrid as per business requirement)
Experience: 5 8 Years
Qualification: BE / B.Tech (Mandatory)
Notice Period: Immediate Joiners Preferred
Interview Process:

Job Summary

We are seeking an experienced Databricks Data Engineer with strong expertise in building scalable data pipelines, data warehousing, and cloud-based data platforms. The ideal candidate should have hands-on experience with Databricks, Apache Spark, SQL, and modern data engineering practices. Candidates from reputed product companies, consulting firms, or large enterprise organizations will be preferred.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
• Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.
• Develop data transformation workflows using PySpark and SQL.
• Work closely with business stakeholders, data scientists, and analytics teams to deliver high-quality data solutions.
• Implement data quality, governance, and security best practices.
• Optimize Databricks jobs for performance, scalability, and cost efficiency.
• Integrate data from multiple sources including databases, APIs, cloud storage, and enterprise applications.
• Monitor, troubleshoot, and support production data pipelines.
• Participate in architecture discussions and contribute to data platform modernization initiatives.

Required Skills Mandatory Skills

• Databricks
• Apache Spark
• PySpark
• SQL
• Data Engineering
• ETL / ELT Development
• Data Warehousing Concepts
• Python

Preferred Skills

• Azure Databricks / AWS Databricks
• Delta Lake
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• AWS S3
• Airflow
• Kafka
• CI/CD Pipelines
• Git

Desired Candidate Profile

• 5 8 years of relevant Data Engineering experience.
• Strong hands-on expertise with Databricks and Spark ecosystem.
• Experience working on cloud-based data platforms (Azure/AWS).
• Good understanding of data modeling, data lakes, and data warehouse architectures.
• Strong problem-solving and analytical skills.
• Excellent communication and stakeholder management abilities.
• BE/B.Tech degree from a recognized university is mandatory.
• Immediate joiners or candidates who can join at the earliest will be given preference.

Good to Have

• Experience with Delta Lake architecture.
• Exposure to real-time data processing frameworks.
• Experience in performance tuning and query optimization.
• Knowledge of DevOps and DataOps practices.
• Databricks or Cloud certifications.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.