Cloud Platform Engineer

Key Responsibilities -

Platform Engineering & Development

• Design, implement, and maintain cloud-native data platforms (e.g., AWS, Azure).
• Develop and optimize data pipelines for ingestion, transformation, and processing of structured, semi-structured, and unstructured data.
• Build reusable frameworks and automation for data workflows, monitoring, and scaling.
• Ensure data storage and compute solutions are optimized for performance, security, and cost efficiency.
• Integrate cloud data services with enterprise applications, APIs, and third-party tools.

Data Management & Governance

• Implement data quality, lineage, and cataloging solutions across the data platform.
• Enforce governance, security, and compliance standards (e.g., GDPR, HIPAA, SOC2).
• Work with architects and security teams to implement role-based access, encryption, and audit controls.
• Support metadata management, data discoverability, and enterprise-wide data democratization.

Operations & Reliability

• Manage the operational health of the cloud data platform, including monitoring, alerting, and troubleshooting.
• Establish CI/CD pipelines for data services and platform components.
• Implement disaster recovery, backup, and failover strategies.
• Continuously optimize platform performance, cost, and scalability.

Collaboration & Innovation

• Partner with data scientists, BI teams, and application developers to enable advanced analytics and AI/ML workloads.
• Evaluate emerging cloud data services and recommend adoption based on enterprise needs.
• Provide technical expertise in designing cloud-based data architectures and solutions.
• Mentor junior engineers and contribute to best practices in cloud engineering and data development.

Education & Experience -

• Bachelors degree in Computer Science, Data Engineering, or related field (Masters preferred).
• 10+ years of experience in data engineering, cloud engineering, or platform engineering with 15+ years of total work experience, including Azure environments.
• 5+ years of leadership experience managing Platform Engineering, DevOps, Infrastructure, or Operations Teams.
• Proven experience managing enterprise-scale cloud data platforms, specifically:
• Snowflake
• Databricks
• Other Data Platform services
• Strong experience leading ITIL service management functions, including Incident, Problem, Change, and Service Request Management.
• Experience building and presenting executive operational dashboards and service reviews.
• Proven track record of driving platform reliability, operational transformation, and automation initiatives.
• Experience managing globally distributed teams and complex enterprise environments.
• Hands-on experience with major cloud provider Azure and Cloud Data Services.
• Experience with big data and data processing frameworks (e.g., Spark, Databricks, Flink).
• Expertise in building data pipelines with tools like Apache Airflow, dbt, Kafka, or similar.

Skills & Competencies -

• In-depth knowledge and experience with Snowflake, Databricks, or similar cloud data platforms.
• Extensive knowledge and real hands-on experience on Github terraform pipelines and objects deployment management.
• Extensive knowledge and real hands-on experience of AI/ML data pipelines and feature engineering.
• Exposure to regulated environments (financial services, healthcare, etc.).
• Proficiency in terraform, SQL and one or more programming languages (Python, Java, or Scala).
• Deep understanding of cloud-native data services (e.g., AWS Redshift, Glue, S3, Athena; Azure Synapse, Data Factory; GCP BigQuery, Dataflow).
• Familiarity with containerization and orchestration (Docker, Kubernetes).
• Experience with infrastructure-as-code (Terraform, CloudFormation, Pulumi).
• Knowledge of FinOps principles for cost-efficient data platform design.
• Strong problem-solving, communication, and cross-functional collaboration skills.
• Excellent communication, mentorship, and ability to influence cross-functional teams.