Experience
5 - 7 yrs
Job Location
Chennai, India
Vacancy
1
Designation
Senior Data Engineer
Job Type
Not specified
Job Description
Company Overview
Group/Division
Job Description/Preferred Qualifications
SAP Data Ingestion & Integration
- Design and implement robust ingestion patterns from SAP source systems (S/4HANA/ECC/BW/HANA) and other cloud source systems into Snowflake using enterprise-approved integration tools.
- Build and maintain incremental loads (CDC) , batch pipelines, and near-real-time ingestion where needed.
- Understand SAP functional domains and data structures (e.g., FI/CO, MM, SD, PP ) to map business requirements to data models.
Snowflake Data Engineering & Modeling
- Develop and optimize ELT/ETL pipelines leveraging Snowflake capabilities (e.g., Snowpipe, Streams & Tasks, Dynamic Tables where applicable).
- Create and maintain curated dimensional and/or data vault models , conformed dimensions, and reusable fact tables for cross-functional analytics.
- Implement data quality checks , reconciliation controls (source-to-target), and exception handling for SAP extracts.
Performance, Cost, and Reliability Optimization
- Tune queries and pipelines for performance using clustering strategies, caching awareness, pruning, warehouse sizing, and workload separation.
- Monitor and manage Snowflake consumption and performance; recommend cost controls (warehouse scheduling, auto-suspend/auto-resume, resource monitors).
Data Governance & Security
- Apply security best practices: RBAC , masking policies, row access policies, and secure data sharing patterns as needed.
- Partner with governance teams to maintain metadata, lineage, glossary alignment, and compliance standards.
Collaboration & Delivery
- Collaborate with BI developers, analysts, and business stakeholders to translate requirements into scalable datasets.
- Contribute to Agile ceremonies and deliver iterative improvements with high engineering standards.
- Document pipelines, models, SLAs, and operational runbooks; participate in on-call/production support rotations as required.
Required Qualifications
- 5 7 years of experience in data engineering, with hands-on development in Snowflake .
- Strong experience integrating SAP data into analytics platforms or data warehouses.
- Strong SQL skills (advanced joins, window functions, query optimization); experience with performance tuning in cloud warehouses.
- Experience building production-grade pipelines using one or more of:
- Orchestration: Informatica , ADF, dbt orchestration, or similar
- Transformation: dbt , stored procedures, Snowflake SQL scripting, or equivalent
- Proficiency in Python (or comparable language) for automation, data processing, and pipeline utilities.
- Understanding of data modeling concepts (dimensional modeling, normalization, data vault basics).
- Experience with CI/CD practices (Git, code reviews, deployment pipelines) and environment management (dev/test/prod).
Preferred / Nice to Have
- Palantir Foundry experience (pipeline development, curated datasets, permissions/lineage) and Ontology experience (Objects/relationships).
- Familiarity with SAP S/4HANA data models and performance concepts (e.g., CDS views, HANA calculation views).
- Experience with BI/visualization tools ( Power BI, Tableau, Looker ) and building datasets optimized for reporting/semantic layers.
Minimum Qualifications
Doctorate (Academic) Degree and 0 years related work experience; Masters Level Degree and related work experience of 3 years; Bachelors Level Degree and related work experience of 5 years
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.
