Experience
2 - 5 yrs
Salary (CTC)
₹5.6L - ₹8L
Job Location
Bengaluru, India
Vacancy
1
Designation
Test Engineer
Job Type
ONSITE
Job Description
Role Overview
We are looking for a QA Engineer to join our AI platform team. The role focuses on validating Model Context Protocol (MCP) servers, AI-powered workflows, and API integrations. The ideal candidate should have strong API testing skills, a good understanding of Large Language Models (LLMs), prompt engineering concepts, and experience validating AI-based applications.
The candidate will work closely with developers and AI engineers to ensure the correctness of MCP tool execution, API responses, prompt behaviour, and overall system reliability.
Engineering | India | 1-3 Yrs
Where Your Expertise Meets Our Future - Strong understanding of Software Testing Life Cycle (STLC) and Agile methodologies.
- Hands-on experience in REST API testing.
- Strong knowledge of HTTP methods, REST APIs, JSON, authentication mechanisms, and API debugging.
- Experience using Postman or similar API testing tools.
- Good understanding of test case design techniques and test coverage.
- Basic understanding of AI concepts, especially Large Language Models (LLMs).
- Familiarity with Prompt Engineering concepts and prompt validation.
- Knowledge of Git and defect tracking tools such as Jira.
- Basic scripting knowledge in Python or Java for testing purposes.
- Understanding of MCP Server architecture and AI agent workflows.
- Experience validating AI model outputs and prompt quality.
- Familiarity with JSON Schema validation and structured data validation.
- Exposure to API automation frameworks.
- Knowledge of CI/CD tools such as Jenkins or GitHub Actions.
- Basic understanding of cloud platforms such as AWS or Azure.
- Understanding of networking fundamentals, system architecture, and operating systems.
- Familiarity with AI-assisted development tools (e.g., ChatGPT, GitHub Copilot, Claude, Gemini).
- Experience testing AI agents or Agentic AI systems.
- Understanding of Retrieval-Augmented Generation (RAG), embeddings, and vector databases.
- Experience validating tool-calling workflows, function calling, or AI orchestration frameworks.
- Knowledge of OAuth, authentication flows, and API security testing.
- Exposure to automation frameworks such as Playwright or Selenium.
- Design, execute, and maintain test cases for MCP server functionalities.
- Validate MCP tool discovery, tool selection, parameter passing, and response handling.
- Perform API testing using tools like Postman or using Python frameworks.
- Validate AI/LLM workflows, including prompt-response accuracy and business logic.
- Verify tool invocation, parameter validation, response validation, and error handling.
- Perform functional, regression, integration, and end-to-end testing.
- Debug API failures using logs, request/response payloads, and network traces.
- Create and maintain test data, test plans, and defect reports.
- Collaborate with developers, AI engineers, and product teams during feature development.
- Participate in sprint planning, reviews, and Agile ceremonies.
- Contribute towards automation wherever applicable.
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.