Architect

Job Summary

Seeking a senior AWS Data Engineer with 7 to 10 years of experience.

Key Responsibilities

As a Senior AWS Data Engineer, you will be responsible for leveraging a strong skillset in various AWS data technologies and practices, including:

• Claude code: A required skill; training completion is expected.

Core AWS Data Engineering - Required

Strong experience building pipelines using:

• AWS Glue or Lambda PySpark or Python for batch and micro-batch processing
• Medallion architecture implementation - Bronze or Silver or Gold layers
• Amazon S3 data lake design for raw, curated, and certified zones
• Amazon Athena for analytical querying and cost-aware access patterns
• Apache Iceberg table design, partitioning, and maintenance
• Snapshot management and time travel usage in Iceberg
• Amazon Redshift for high concurrency and analytical workloads
• Amazon RDS - approved engines for operational and serving data stores

Pipeline Orchestration and Eventing - Required

• Workflow orchestration using AWS Step Functions
• Event-driven ingestion using Amazon EventBridge
• AWS Lambda for lightweight processing and control plane logic
• AWS Fargate and approved container platforms for scalable execution
• Coordination of batch, micro-batch, and event-driven pipelines
• Error handling, retries, and compensating actions
• State management for long-running and multi-stage workflows

Data Reliability and Operational Readiness - Required

• Design of idempotent, restartable pipelines
• Backfill and reprocessing strategies
• Definition and monitoring of pipeline SLAs or SLOs
• Integration with enterprise monitoring and alerting tools

Cost and Performance Engineering - Strongly Preferred

• Athena or RDS or Redshift query optimization and cost management
• Glue job sizing, tuning, and cost controls
• Lambda execution optimization (memory, duration, invocation patterns)
• Cost-efficient use of Fargate and containerized workloads
• S3 storage optimization across Bronze or Silver or Gold layers
• Awareness of end-to-end AWS cost tradeoffs across storage, compute, and orchestration

Qualifications

• AWS Certification preferred.