Own the quality bar for the AI layer and its integration with the existing LCA Creator Tool. Two dimensions to the role: classical functional / regression testing of the .NET application (the existing tool cannot regress) and AI-output validation testing that SOC code suggestions, wage levels, and the prevailing-wage waterfall behave correctly across thousands of historical cases.

Experience Required

4 7 years of QA experience, including at least 2 years of test automation and at least 1 year testing AI / LLM-powered features (or strong demonstrable interest with eval framework experience).

Key Responsibilities

Build and maintain the regression test suite for the existing LCA Creator Tool surfaces being touched guarantee zero regression to form population, VisaTrax sync, FLAG submission, and Notice of Filing generation.
Build the AI-output validation harness using historical cases from the LCA Creator Tool (thousands of records available) measure SOC code accuracy, wage level accuracy, and waterfall correctness against the human-approved ground truth.
Run the formal pilot validation: 10 20 historical cases through the AI layer end-to-end, document accuracy and edge cases for sign-off.
Test the three intake modes (Generic Form, Bulk Spreadsheet, Client-Specific Template) including malformed file uploads and large batch (400+ row) ingestion.
Test the wage waterfall edge cases DOL only, DOL + TW fallback, manual review queue routing, multi-worksite cases, home-based addresses.
Validate the audit log captures every required field (rationale, wage source, flags, approver, timestamp) and is attorney-readable.
Validate guardrails the LLM never produces a wage figure; PII/PHI is never sent to external endpoints; cost caps are enforced.
Coordinate UAT with US case managers; capture feedback and convert to tickets.

Must-Have Skills

Test automation Playwright or Selenium for E2E, Postman / REST Assured / Pytest for API.
SQL fluency for data-driven test setup and result verification.
Working knowledge of LLM behavior non-determinism, prompt drift, hallucination patterns and how to build evals that handle them.
Bug triage discipline; comfortable working in a milestone-based, sign-off-gated delivery model.
CI integration of test suites (Azure DevOps Pipelines).

Good to Have

Experience testing legal, healthcare, or other regulated SaaS.
Performance / load testing experience (k6, JMeter) the bulk mode needs validation at scale.
File-format edge-case testing encoding, BOM, malformed XLSX, password-protected PDFs.
Familiarity with LLM eval frameworks (Promptfoo, Ragas, custom harnesses).

Perks Benefits

Health Accident Insurance
Paid Leaves and Sick Leaves
Education sponsorship / Certification Reimbursement
Free Training Platforms
Gym membership
EPF, Gratuity.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

QA Test Engineer

Job Description

No Referrers Available