Roles and Responsibility

Design and implement data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Storage solutions.
Develop and maintain large-scale data architectures on Azure, ensuring scalability, reliability, and performance.
Collaborate with cross-functional teams to identify business requirements and design data solutions that meet those needs.
Implement data quality checks and validation processes to ensure accuracy and integrity of the data.
Optimize data processing workflows to improve efficiency and reduce costs.
Troubleshoot issues related to data pipeline failures or errors, working closely with development teams to resolve problems quickly.

Job Requirements

Strong understanding of big data technologies such as Hadoop, Spark, and NoSQL databases.
Experience with data warehousing concepts, including star schema design and ETL processes.
Proficiency in programming languages such as Python, Java, or C#.
Knowledge of cloud-based platforms such as AWS or GCP is a plus.
Excellent problem-solving skills, with the ability to analyze complex issues and develop creative solutions.
Strong communication skills, with the ability to collaborate effectively with technical and non-technical stakeholders.

Skills: Databricks / Pyspark Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

Azure Data Engineer

Job Description

No Referrers Available