Azure Data Engineer

Job Title: Azure Data Engineer ADF, Databricks, PySpark & Microsoft Fabric

Experience: 5+ Years

Employment Type: Full-Time

About the Role

Avenoir is hiring an experienced Azure Data Engineer to design, build, and optimize enterprise-grade data pipelines and lakehouse solutions on the Microsoft Azure stack. You'll work on high-impact client engagements spanning Azure Data Factory, Databricks (PySpark), Synapse, and increasingly, Microsoft Fabric building reliable, scalable data platforms that power analytics and reporting for global clients.

If you have strong hands-on experience in ADF pipeline design, PySpark development on Databricks, and solid SQL fundamentals, and you're looking to work on modern lakehouse and Fabric-based architectures, we'd love to hear from you.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF)
• Develop and optimize large-scale data transformations using Azure Databricks (PySpark)
• Build and manage data warehousing and analytics solutions on Azure Synapse Analytics
• Architect and manage data lake storage using Azure Data Lake Storage (ADLS Gen2)
• Write and optimize complex SQL / T-SQL queries, stored procedures, and performance tuning
• Design idempotent, self-healing, production-grade data pipelines following ETL/ELT and data warehousing best practices
• Collaborate with cross-functional teams to translate business requirements into robust data solutions
• Ensure data pipeline reliability, monitoring, and timely delivery of data to downstream systems

Must-Have Skills

• Azure Data Factory (ADF) pipeline design & orchestration
• Azure Databricks PySpark, performance tuning at scale
• Azure Synapse Analytics
• Azure Data Lake Storage (ADLS Gen2)
• SQL / T-SQL query optimization, stored procedures
• Python & PySpark
• Strong grounding in ETL/ELT pipeline design and data warehousing concepts

Good to Have

• Microsoft Fabric (Lakehouse, medallion Bronze/Silver/Gold architecture, PySpark notebooks)
• Power BI (DAX, Row-Level Security, report deployment & refresh)
• Azure DevOps / CI-CD for data pipelines
• Key Vault, Managed Identity, Azure AD, Azure CLI, PowerShell
• Delta Lake / Lakehouse architecture
• Unix scripting, job schedulers (e.g. Ctrl-M)

Why Join Avenoir?

Work on cutting-edge Azure, AI, MuleSoft, and cloud engagements with a team of 50+ certified experts Exposure to modern lakehouse and Microsoft Fabric architectures ahead of the market curve Fast-paced, outcome-driven culture delivering measurable results for enterprise clients