Azure Data Engineer

Role & responsibilities

• Design, build, and maintain scalable data pipelines using Azure Data Factory (ADF).
• Lead migration projects from SSIS to ADF, ensuring performance, reliability, and cost efficiency.
• Implement CI/CD pipelines using tools such as Jenkins, GitHub Actions, or Bamboo.
• Develop and manage infrastructure using Terraform (IaC).
• Write and maintain PowerShell scripts for automation and operational tasks.
• Collaborate with cross-functional teams to integrate data solutions with business applications.
• Develop and optimize code in Python or C# for data processing and transformation.
• Ensure best practices in security, monitoring, and performance tuning across Azure environments.

Preferred candidate profile

• Strong hands-on experience with Microsoft Azure services, particularly Azure Data Factory.
• Proven track record of migrating ETL solutions from SSIS to ADF.
• Solid understanding of CI/CD tools (Jenkins, GitHub Actions, Bamboo).
• Proficiency in Terraform for infrastructure automation.
• Intermediate-level PowerShell scripting skills.
• Development experience with Python or C#.
• Strong problem-solving skills and ability to work in agile, fast-paced environments.