Azure Databricks Data Engineer (L3)

Position: Azure Databricks Data Engineer (L3)
Experience: 5 8 Years
Qualification: BE / B.Tech (Mandatory)
Location: Bangalore, Pune, Chennai, Kolkata, Gurugram
Employment Type: Full-Time
CTC: Up to 23.5 LPA

• Azure Databricks
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• PySpark
• Spark SQL
• Azure Synapse Analytics
• SQL
• Python
• ETL/ELT Development
• Delta Lake
• Data Warehousing Concepts

We are looking for a skilled Azure Databricks Data Engineer to design, build, and optimize large-scale data processing solutions on the Microsoft Azure platform. The ideal candidate should have strong experience in Azure Databricks, data engineering, and big data technologies.

• Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure services.
• Build ETL/ELT solutions using PySpark, Spark SQL, Python, and Azure Data Factory.
• Develop and optimize data transformation workflows for structured and unstructured data.
• Implement and manage Delta Lake architecture for reliable and high-performance data processing.
• Work with Azure Data Lake Storage (ADLS) for data ingestion and storage.
• Create and optimize data models and reporting layers using Azure Synapse Analytics.
• Monitor, troubleshoot, and enhance data pipeline performance and reliability.
• Collaborate with business stakeholders, analysts, and data scientists to deliver data-driven solutions.
• Ensure data quality, security, governance, and compliance standards.

• 5 8 years of experience in Data Engineering.
• Strong hands-on experience with Azure Databricks and PySpark.
• Expertise in Azure Data Factory (ADF), ADLS, and Azure Synapse.
• Strong programming skills in Python and SQL.
• Experience with Spark optimization, partitioning, and performance tuning.
• Good understanding of Delta Lake, data warehousing, and data modeling concepts.
• Experience working with large-scale data processing and cloud-native architectures.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder management skills.

• Microsoft Azure Data Engineer Associate Certification.
• Experience with CI/CD pipelines and Azure DevOps.
• Knowledge of streaming technologies and real-time data processing.
• Exposure to Kubernetes, Docker, or cloud-native deployment practices.
• Experience with Power BI integration is an added advantage.