Coverage gap & traceability check
The problem
Nobody can quickly answer: 'Which acceptance criteria have no tests?'
Workflow
- Requirementsstories + AC
- Test casesrepository
- Embed & matchAC ↔ cases
- LLM verifyreally covered?
- Gap reportuntested AC
Real-world example
Release 4.2 has 120 acceptance criteria. Matching finds 9 with no or weak tests, including 'Refund must be blocked after 30 days' — only the happy path was tested.
Starter prompt
For each acceptance criterion, decide if the linked test cases fully cover it, partially cover it, or don't cover it. Explain partial coverage in one line. Return CSV: ac_id, status, reason.
Tools
Jira/Xray/TestRail export, embeddings, LLM-as-judge
Human check
Spot-check 'covered' labels — semantic match is not proof of coverage.
Measure success
% AC with verified coverage; gaps closed before release.