Job Description
Senior Data Engineer Python & Azure
Experience: 6–12 Years
Location: Pune | Hyderabad | Bangalore | Indore
Job Description
We are looking for a Senior Data Engineer with strong expertise in Core Python and Azure Data Engineering to design and build scalable data ingestion solutions. The ideal candidate should have hands-on experience developing production-grade Python applications using Object-Oriented Programming (OOP) principles and working with Azure data services.
Key Responsibilities
- Design and develop scalable Python applications for data ingestion using class-based, object-oriented architecture.
- Build and maintain robust, modular, and fault-tolerant data ingestion pipelines.
- Consume and integrate data from REST APIs, databases, and other external data sources.
- Develop and optimize data processing workflows using Azure Data Factory (ADF) and Azure Databricks.
- Write efficient SQL queries for data extraction, transformation, and validation.
- Collaborate with cross-functional teams to enhance data products and ingestion services.
- Follow coding best practices, version control, and Agile development methodologies.
Must-Have Skills
- 6+ years of experience in Data Engineering
- Strong hands-on experience in Core Python
- Good understanding of Object-Oriented Programming (OOP) (Classes, Inheritance, Polymorphism, Encapsulation, Abstraction)
- Hands-on experience with Azure Data Factory (ADF)
- Hands-on experience with Azure Databricks
- Strong SQL skills
- Experience building data ingestion pipelines
- Experience consuming REST APIs using Python
- Knowledge of Azure Data Lake Storage (ADLS) and Azure SQL
- Experience with Git/GitHub
Good-to-Have Skills
- PySpark
- Azure DevOps
- Agile/Scrum
- XBRL/iXBRL
- Dependency Injection and modular Python application architecture
Key Skills
Python, Core Python, Data Engineering, Azure Data Factory (ADF), Azure Databricks, SQL, Data Ingestion, ETL, REST API, Object-Oriented Programming (OOP), ADLS, Azure SQL, PySpark, Data Pipelines, Git, GitHub
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.