QA Tester - AI Application

;

• ;Prepare test strategy, test scenarios, test cases, test data, and test execution reports for the Application.

• ;Validate end-to-end operator workflows across dashboard, exception workspace, context inspection, learning console, and local client state behavior.

• ;Test operator actions such as acknowledge, resolve, escalate, annotate, re-evaluate, and case state transitions.

• ;Validate transactional request/response APIs and live event-stream behavior for real-time updates.

• ;Test exception arrival, agent progress updates, queue health metrics, and re-evaluation events.

• ;Validate EDI/X12 parsing, exception normalization, and mapping to the internal exception model.

• ;Test deterministic exception handling through L1 reference data lookups and L2 policy-based routing.

• ;Validate L3 agentic resolution workflows, including bounded tool execution and fallback behavior.

• ;Test resolution tools such as drug lookup, pricing check, serial verification, DEA check, and document lookup.

• ;Verify Graph RAG and Document RAG results for relevance, accuracy, grounding, source traceability, and response consistency.

• ;Validate context retrieval from context graph, reference data, decision; trace store, policies, documentation, and regulatory guidance.

• ;Test decision trace generation for both deterministic and agentic decisions.

• ;Validate auditability, explainability, trace completeness, and decision lineage.

• ;Test feedback capture from operator resolutions and learning-loop workflows.

• ;Validate pattern mining outputs, candidate rule generation, routing optimization results, validation of sandbox results, and promotion of gate approvals.

• ;Perform regression testing after model, prompt, rule, routing, ingestion, retrieval, or external-source changes.

• ;Validate Unity Catalog permissions, data governance, access controls, and restricted data visibility.

• ;Conduct negative testing, boundary testing, failure scenario testing, retry testing, idempotency testing, and security validation support.

• ;Validate observability metrics such as queue health, exception volume, agent latency, retrieval quality, provider errors, token usage, ingestion lag, and decision trace completeness.

• ;Log defects with clear reproduction steps, expected results, actual results, screenshots/logs, test data references, and severity.

• ;Collaborate with developers, DevOps/MLOps, architects, business users, and operators for defect triage and release readiness.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.