Experience
5 - 10 yrs
Job Location
Bengaluru, India
Vacancy
1
Designation
AI Engineer
Job Type
Not specified
Job Description
We are hiring an AI Quality Engineer to ensure the quality and reliability of AI-powered products. The role requires strong expertise in QA, development, and process automation, covering manual testing, automated testing, and AI model evaluation. Roles and Responsibilities:
- Design & execute manual test cases (functional, API, edge cases)
- Build and maintain automation frameworks (UI, API, data layers)
- Develop scripts/tools for process automation and test efficiency
- Evaluate AI/LLM outputs (accuracy, hallucination, drift, latency, cost)
- Run regression testing and ensure release readiness
- Log, track, and independently verify defects
- Support UAT and collaborate with product & engineering teams
- 5+ years in QA / SDET / Automation roles
- 1+ years of experience working with AI/LLM-based products is mandatory
- Strong development experience (Python or TypeScript preferred)
- Hands-on experience in test automation (UI, API, data validation)
- Experience in process automation/scripting/workflow optimization
- Strong SQL skills
- Experience with CI/CD pipelines
- Exposure to AI evaluation, datasets, and model testing
- Experience in retail/e-commerce domain
- Exposure to RAG, vector databases, or AI pipelines
- Performance or security testing experience