Lead DevOps Engineer

Key Responsibilities

• Streaming Architecture & Messaging: Lead the design and administration of enterprise Apache Kafka clusters, manage KStreams applications, and oversee the migration from ZooKeeper to KRaft.
• API & Microservices Leadership: Architect and optimize high-performance REST microservices using Scala and the AKKA framework, routed securely via Kong API Gateway.
• Compute & Workload Management: Manage and tune distributed compute workloads, including Apache Spark streaming jobs (CPE, TPAS, OFDMA) and containerized applications on Kubernetes (Anthos/Rancher) and RedHat Linux VMs.
• Data Store Optimization: Oversee data modeling, caching strategies, and performance tuning for Apache Ignite (in-memory telemetry), Apache Cassandra (metric history/inventory), and MySQL routing tables.
• CI/CD & Automation: Drive end-to-end deployment automation and Infrastructure as Code using Ansible, Jenkins, and Bitbucket.
• Technical Mentorship: Guide and mentor junior engineers, establish coding standards, and ensure architectural best practices across the team.

Required Skills & Qualifications

• Core Engineering: 8+ years of software engineering experience with a strong focus on distributed systems, data streaming, and high-concurrency environments.
• Streaming & Big Data: Expert-level knowledge of Apache Kafka, Kafka Streams, RocksDB, and Apache Spark.
• Programming Languages: Deep proficiency in Scala and the AKKA framework for microservices development.
• Data Stores: Extensive experience with NoSQL and distributed databases, specifically Apache Cassandra and Apache Ignite, along with relational databases (MySQL).
• Infrastructure & Cloud: Strong hands-on experience with Kubernetes (Anthos/Rancher), Docker, and Linux server administration (RedHat).
• DevOps & Automation: Proven track record of designing CI/CD pipelines using Jenkins and end-to-end deployment automation via Ansible.