Data Platform Support Engineer

We are seeking a skilled and proactive Data Platform Support Engineer with 3 to 5 years of experience to join our team. This role is critical in ensuring the smooth operation, maintenance, and enhancement of our data infrastructure and workflows. The ideal candidate will have hands-on experience with Airflow, Redshift, EMR, Python, SQL, and AWS, and will be responsible for monitoring, troubleshooting, and optimizing the data ecosystem.The ideal candidate should have prior experience working in the Banking/Financial Services (BFSI) domain, with exposure to banking data platforms, applications, or financial data workflows.

Key Responsibilities:

• Monitor and support data workflows built using Apache Airflow, including troubleshooting DAG failures and performance issues.
• Troubleshoot and resolve issues in AWS EMR clusters and Redshift data warehouse environments.
• Write and optimize SQL queries.
• Develop and maintain Python scripts for automation and housekeeping.
• Perform hands-on troubleshooting across the data ecosystem infrastructure, including compute, storage, and orchestration layers.
• Implement and maintain monitoring and alerting systems for data infrastructure such as Redshift, EMR, and Airflow using AWS cloud watch.
• Collaborate with engineers from cross teams to ensure platform availability.
• Participate in on-call rotations and provide timely support for production issues.
• Document processes, configurations, and troubleshooting steps for knowledge sharing.

Required Skills & Qualifications:

• 3-5 years of experience in data engineering or data platform support roles.
• Strong proficiency in Python and SQL.
• Hands-on experience with Apache Airflow, including DAG development and debugging.
• Experience with Amazon Redshift, AWS EMR, and other AWS services (e.g., S3, Lambda, CloudWatch).
• 3-5 years of experience in the Banking/Financial Services (BFSI) domain, preferably supporting data platforms, data engineering, or production data environments.
• Proven experience in platform monitoring and hands-on troubleshooting in cloud-based data environments.
• Excellent problem-solving and communication skills.
• Ability to work independently and collaboratively in a fast-paced environment.
• Experience with CI/CD tools and practices.
• Familiarity with version control systems like Git.

Preferred Qualifications:

• Familiarity with terraform.
• Exposure to big data technologies such as Spark or Hive.
• Keywords Apache Airflow, AWS, Amazon Redshift, AWS EMR, AWS CloudWatch, Data Engineering, Data Pipeline Support