Experience
5 - 10 yrs
Salary (CTC)
₹6.2L - ₹9L
Job Location
Bengaluru, India
Vacancy
1
Designation
Data Engineer
Job Type
Not specified
Job Description
Hiring for Data Engineer - Kolkata, Pune, Mumbai, Bangalore
Data Engineer Design and develop ETL processes based on functional and non-functional requirements in Databricks| python PySpark within Azure platform.
Understand the full end to end development activities from design to go live for ETL development in Azure platform.
Recommend and execute improvements.
Execute and provide support during testing cycles and post-production deployment| engage in peer code reviews.
Apply automation and innovation on new and on-going data platforms that aligned to business strategies.
Document component design for developers and for broader communication.
Understand and adopt an Agile (SCRUM like) software development mindset.
Follow established processes standards| business technology architecture for development| release management and deployment process.
Design| develop and implement reporting platforms and complex ETL frameworks that meet business requirements.
Provide data analysis and requirements within enterprise platform.
Develop| maintain knowledge of data available from upstream sources and data within various platforms.
Essential Skills: Must-have skills Azure Databricks| Azure Data Factory Python Spark Pyspark Shell ScriptSynapse5 years of experience in ETL Data area with minimum of 3 years of development experience in above technologies (PySPark| ADB| ADF) is must SQL| Working experience with data modeling| relational modeling and dimensional modeling| Data Warehousing| ETL General knowledge about file formats (e.g. XML| CSV| JSON)| databases (e.g. MS SQL| Oracle) and different type of connectivity is also very useful.Data files movement via mailbox Source-code version in gpromotion tools| e.g. Git Jenkins Good communication skill| team player
",Data Engineer Design and develop ETL processes based on functional and non-functional requirements in Databricks| python PySpark within Azure platform.
Understand the full end to end development activities from design to go live for ETL development in Azure platform.
Recommend and execute improvements.
Execute and provide support during testing cycles and post-production deployment| engage in peer code reviews.
Apply automation and innovation on new and on-going data platforms that aligned to business strategies.
Document component design for developers and for broader communication.
Understand and adopt an Agile (SCRUM like) software development mindset.
Follow established processes standards| business technology architecture for development| release management and deployment process.
Design| develop and implement reporting platforms and complex ETL frameworks that meet business requirements.
Provide data analysis and requirements within enterprise platform.
Develop| maintain knowledge of data available from upstream sources and data within various platforms.
Essential Skills: Must-have skills Azure Databricks| Azure Data Factory Python Spark Pyspark Shell ScriptSynapse5 years of experience in ETL Data area with minimum of 3 years of development experience in above technologies (PySPark| ADB| ADF) is must SQL| Working experience with data modeling| relational modeling and dimensional modeling| Data Warehousing| ETL General knowledge about file formats (e.g. XML| CSV| JSON)| databases (e.g. MS SQL| Oracle) and different type of connectivity is also very useful.Data files movement via mailbox Source-code version in gpromotion tools| e.g. Git Jenkins Good communication skill| team player
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.