Job Description
Required Qualifications
Bachelors degree in computer science, Engineering, Information Systems, or related field
Hands-on data engineering experience, with Azure Databricks and Azure Data Lake
Proficiency in PySpark, SQL, and ETL/ELT pipeline design
Demonstrated experience building granular data quality checks and integrating governance logic into pipelines
Working knowledge of Microsoft Purview for metadata management, lineage capture, and classification
Experience with Azure Data Factory or equivalent orchestration tools
Understanding of data modeling, metadata structures, and data cataloging concepts
Strong debugging, performance tuning, and problem-solving skills
Ability to document pipeline logic and collaborate with cross-functional teams
Hands-on experience with Microsoft Fabric or Azure Synapse/Data Factory
Strong experience with Fivetran or similar ELT tools
Experience handling high-volume datasets (hundreds of millions of records)
Proficiency in SQL, Python, and data modeling concepts
Strong understanding of Medallion architecture