VigilQA Docs
Post-run Agent

CoverageGap

Cross-references your Knowledge Base scenarios against the active test suite to identify untested scenarios and report coverage percentages per domain.

Trigger

CoverageGap runs automatically after every test run completes. It operates on the full project KB and test suite, not just the tests that ran in the current run.

What CoverageGap measures

CoverageGap counts KB scenarios that have an approved, active test script in the test suite. A scenario is considered "covered" if:

  • At least one test script exists with the matching scenario ID
  • The script is in the active state (approved, not archived)

A scenario is considered "uncovered" if:

  • No test script exists for the scenario ID
  • The only existing script is pending approval or archived

Coverage report

CoverageGap produces a coverage report accessible from the run results under the Coverage tab and from the dashboard's coverage widget:

  • Overall coverage % — covered scenarios ÷ total scenarios across all domains
  • Per-domain coverage % — breakdown by domain, sorted by lowest coverage first
  • Uncovered scenario list — each uncovered scenario ID with its title and priority
  • Generation offer — for each uncovered scenario (or domain), a one-click prompt to trigger the generation pipeline

Priority weighting

CoverageGap highlights uncovered scenarios with priority: high at the top of the report. High-priority uncovered scenarios also appear in the dashboard's attention feed to prompt action.

Coverage is a lagging indicator — it only tracks whether a script exists, not whether the scenario is adequately tested. Use CoverageGap as a signal to grow your KB and run generation for new domains, not as a quality measure for existing tests.

Acting on coverage gaps

When CoverageGap identifies uncovered scenarios, you can:

  1. Click Generate Scripts in the coverage report to trigger the generation pipeline for the uncovered scenarios
  2. The pipeline runs DocGen → DocReview → ScriptGen → ScriptReview for only the uncovered scenario IDs
  3. New scripts land in Approvals for your review
  4. After approval, coverage % updates automatically in the next run's CoverageGap report