Experience
1 - 4 yrs
Job Location
Mumbai, India
Vacancy
1
Designation
Quality Engineer
Job Type
Not specified
Job Description
Req ID: phone_number
We are currently seeking a Quality Engineer to join our team in Remote, Karnataka (IN-KA), India (IN).
Responsibilities - Lead the discovery (Current state) and Documentation that will produce 5 deliverables:
- Enterprise Testing Strategy
- QE Handbook
- Automation Handbook
- Perf Engineering Handbook
- Test Enablers
- Evaluate and maintain the testing strategies, approaches, tools and frameworks used by the teams.
- Design, develop and execute test automation frameworks and test automation suites.
- Provide regular quality and status reports.
- Participate in project-wide reviews of requirements, system architecture and detailed design documents.
- Act as key point of contact for other Quality Engineers across multiple teams.
- Identify and resolve issues that arise when integrating the application software with other software components.
- Mentor and guide other Quality Engineers on the QA Process, the testing strategy, tools and frameworks being used and assist them in growing their careers.
- Conduct regular performance reviews and conduct interviews.
- Develop testing strategies for AI-generated outputs: structured extraction accuracy measurement, confidence score calibration validation, and regression testing across model or prompt changes
- Design test harnesses for non-deterministic LLM outputs define acceptable output schemas, boundary conditions, and automated assertion patterns that account for natural response variation
- Build integration test suites for the RAG pipeline: retrieval precision/recall measurement, embedding drift detection, and few-shot example quality validation
- Author contract tests for all external integration adapters to detect upstream API changes before they reach production; experience with consumer-driven contract testing patterns (e.g., Pact) a plus
- Design and execute performance tests against LLM inference endpoints to validate throughput, latency SLAs, and GPU utilization under concurrent engineer load
- Develop test cases for human-in-the-loop workflow paths: review queue routing logic, SME correction capture, override persistence, and RAG index update verification
- Experience testing event-driven or workflow-orchestrated systems (Temporal.io, Azure Durable Functions) a plus
- Experience using agentic AI tools for test generation (co-pilot-assisted test authoring, AI-generated test data) in daily QE workflows is a plus
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.