Experience
4 - 7 yrs
Salary (CTC)
₹16L - ₹23.3L
Job Location
Bengaluru, India
Vacancy
1
Designation
Senior Data Engineer
Job Type
Not specified
Job Description
Responsible for developing, optimize, and maintaining business intelligence and data warehouse systems, ensuring secure, efficient data storage and retrieval, enabling self-service data exploration, and supporting stakeholders with insightful reporting and analysis.
Experience on any BI tool like Power BI (Good to have).
Cloud migration experience (Good to have)
Cloud and Data Engineering certification (Good to have)
Working in an Agile environment
Grade - T5
What your main responsibilities are:
Accountabilities:
Data Pipeline - Develop and maintain scalable data pipelines and builds out new API integrations to
support continuing increases in data volume and complexity
Data Integration - Connect offline and online data to continuously improve overall understanding of
customer behavior and journeys for personalization. Data pre-processing including collecting, parsing,
managing, analyzing and visualizing large sets of data
Data Quality Management - Cleanse the data and improve data quality and readiness for analysis.
Drive standards, define and implement/improve data governance strategies and enforce best practices
to scale data analysis across platforms
Data Transformation - Processes data by cleansing data and transforming them to proper storage
structure for the purpose of querying and analysis using ETL and ELT process
Data Enablement - Ensure data is accessible and useable to wider enterprise to enable a deeper and
more timely understanding of operation.
Qualifications & Specifications:
Masters /Bachelor s degree in Engineering /Computer Science/ Math/ Statistics or equivalent.
Strong programming skills in Python/Pyspark/SAS.
Proven experience with large data sets and related technologies Hadoop, Hive, Distributed
computing systems, Spark optimization.
Experience on cloud platforms (preferably Azure) and its services Azure Data Factory (ADF), ADLS
Storage, Azure DevOps. Hands-on experience on Databricks, Delta Lake, Workflows.
Should have knowledge of DevOps process and tools like Docker, CI/CD, Kubernetes, Terraform,
Octopus.
Hands-on experience with SQL and data modeling to support the organizations data storage and
analysis needs.
Data Pipeline - Develop and maintain scalable data pipelines and builds out new API integrations to
support continuing increases in data volume and complexity
Data Integration - Connect offline and online data to continuously improve overall understanding of
customer behavior and journeys for personalization. Data pre-processing including collecting, parsing,
managing, analyzing and visualizing large sets of data
Data Quality Management - Cleanse the data and improve data quality and readiness for analysis.
Drive standards, define and implement/improve data governance strategies and enforce best practices
to scale data analysis across platforms
Data Transformation - Processes data by cleansing data and transforming them to proper storage
structure for the purpose of querying and analysis using ETL and ELT process
Data Enablement - Ensure data is accessible and useable to wider enterprise to enable a deeper and
more timely understanding of operation.
Qualifications & Specifications:
Masters /Bachelor s degree in Engineering /Computer Science/ Math/ Statistics or equivalent.
Strong programming skills in Python/Pyspark/SAS.
Proven experience with large data sets and related technologies Hadoop, Hive, Distributed
computing systems, Spark optimization.
Experience on cloud platforms (preferably Azure) and its services Azure Data Factory (ADF), ADLS
Storage, Azure DevOps. Hands-on experience on Databricks, Delta Lake, Workflows.
Should have knowledge of DevOps process and tools like Docker, CI/CD, Kubernetes, Terraform,
Octopus.
Hands-on experience with SQL and data modeling to support the organizations data storage and
analysis needs.
Proficiency in enterprise data pipeline and ETL tools such as Ab Initio, Informatica, DataStage, or equivalent technologies
Experience on any BI tool like Power BI (Good to have).
Cloud migration experience (Good to have)
Cloud and Data Engineering certification (Good to have)
Working in an Agile environment
4-7 years of relevant work experience needed.
Experience with stakeholder management will be an added advantage.
What we are looking for
Education: Bachelors degree or equivalent in Computer Science, MIS, Mathematics, Statistics, or similar discipline. Masters degree or PhD preferred.
Knowledge, Skills and Abilities
Fluency in English
Analytical Skills
Accuracy & Attention to Detail
Numerical Skills
Planning & Organizing Skills
Presentation Skills
Data Modeling and Database Design
ETL (Extract, Transform, Load) Skills
Programming Skills
Knowledge, Skills and Abilities
Fluency in English
Analytical Skills
Accuracy & Attention to Detail
Numerical Skills
Planning & Organizing Skills
Presentation Skills
Data Modeling and Database Design
ETL (Extract, Transform, Load) Skills
Programming Skills
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.