We are looking for a Senior Data Engineer to join our data engineering team and lead the design and implementation of scalable, high-performance data solutions. The ideal candidate will have extensive...

We are looking for a Senior Data Engineer to join our data engineering team and lead the design and implementation of scalable, high-performance data solutions. The ideal candidate will have extensive experience with Python, Databricks, AWS platforms, and strong hands-on skills Docker. You will play a key role in integrating data with client s vendors, specifically Flat File exchange for now, but new vendors will be API integrations.

Key Responsibilities

Design and implement scalable ETL/ELT pipelines using Databricks and Apache Spark.
Develop, maintain, and optimise SQL and PL/SQL scripts for data extraction, transformation, and loading from Oracle and other relational databases.
Write robust, reusable, and optimised Python and Shell scripts for data automation and workflow orchestration.
Manage data ingestion and integration processes across structured and unstructured sources.
Deploy and manage code using GitHub for version control and collaboration.
Monitor, troubleshoot, and improve performance of data pipelines and jobs.

Required Skills & Experience

6+ years of experience in data engineering with large-scale data systems.
Strong proficiency in Databricks, Python, AWS S3 buckets, and Docker
Solid experience with SQL, PL/SQL.
Advanced programming in Python for data transformation and automation.
Hands-on experience with GitHub for code versioning, branching, and collaboration.
Familiar with data quality frameworks and best practices in data architecture.
Lake house architecture implementation experience

Senior Data Engineer

Job Description

No Referrers Available