Azure Data Engineer with Microsoft Fabric Experience

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, load data from various sources into Azure storage solutions.
• Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable architectures that meet business needs.
• Develop high-quality code in Python using Pandas, NumPy, Matplotlib libraries for data manipulation and analysis.
• Troubleshoot issues related to ADF workflows, SQL queries, and other technical aspects of the project.

Job Requirements :

• 5-15 years of experience in Data Engineering with expertise in Microsoft Azure platform.
• Strong understanding of Big Data concepts such as Hadoop Distributed File System (HDFS), Spark Core/Scala programming language.
• Proficiency in working with Azure services including Blob Storage, Cosmos DB, Data Bricks etc.