AI Audit Exchange
Go back

Guide · By the Ingenious AI team · Published 14 November 2026 · Reviewed 14 November 2026

What Is an Evidence Completeness Checklist?

What is a completeness checklist?

An evidence completeness checklist is a room-level progress view on AI Audit Exchange. It derives five states from the room's real data: whether an engagement exists for the room, whether an auditor of record is matched, whether artifacts are filed, whether the manifest has been exported, and whether retention exceeds the 12-month default. It reports entries with done flags, a done count, a total and a percentage, with the standing note that it is an organisational checklist, not a legal determination.

Five steps, each one a real state

The checklist earns its keep by being derived, not declared. Each step reads the room's actual data: an engagement row exists or it does not; the room has an auditor of record or it does not; artifacts are present or the room is empty; a manifest export timestamp exists or it does not; retention months exceed 12 or they sit at the default. Nobody ticks these boxes by hand, so nobody can tick them aspirationally. That design is the whole value of the thing — a progress view that can contradict you. When it says 3 of 5, it is reporting facts about the room, and the two missing steps are specific, named and fixable.

Step by step: what 'done' takes

Engagement posted means a brief exists for this room — the audit has been offered to the market of vetted auditors. Auditor matched means an acceptance has made someone auditor of record, with the scoped grant that follows. Evidence filed means at least one artifact is in the room — a threshold step, deliberately easy, because depth of filing is judged by coverage review and the auditor, not by this counter. Manifest exported means the inventory has been generated at least once — do it after every major filing round, not once ever. Retention set means the room's months exceed the 12-month default — the step that protects the record's future. Read together, the five describe an engagement that is offered, staffed, stocked, inventoried and preserved.

What the checklist cannot tell you

The disclaimer is printed on the view itself: an organisational checklist, not a legal determination. It cannot say whether your organisation owes an audit, whether the evidence satisfies the regime, or whether any artifact is good. A room at 5 of 5 can still hold weak evidence; a room at 3 of 5 might hold superb evidence and simply lack its engagement paperwork. Hold both truths at once: the checklist governs readiness of the machinery, and the auditor governs judgement of the contents. Teams get in trouble by collapsing the two — waving a percentage at a substantive question, or ignoring the machinery because the evidence 'is basically fine'.

Working the checklist monthly

Put the five steps on the monthly room review, beside the manifest's source column and a hash sample. Early in a period, expect 2 of 5 — evidence filed, and perhaps the engagement posted — and let the number climb as the period matures: auditor matched when the engagement is placed, manifest exported after each filing round (the step stays done once done, but freshness of the last export is your own discipline), retention set at close-out at the latest. The percentage gives the review a spine: last month 40%, this month 60%, the missing steps named. Progress that can be stated in one line gets managed; progress that lives in a feeling does not.

The two steps everyone forgets

In practice, two steps lag. Retention is the classic: the engagement completes, attention moves on, and the room sits at the 12-month default while the organisation believes the record is archived for a decade. The checklist exists partly to make that visible — 'retention_set' stays undone until someone deliberately sets the months beyond the default, up to 10 years on paid plans. The second is the manifest export, forgotten because the room 'already shows everything'. The export is not for you; it is the inventory the audit concludes on and the record's future table of contents. Exporting takes a minute. Forgetting it costs a reconstruction.

Checklists across a multi-room programme

Organisations running several rooms — two regimes, several periods, clients on Team — read the checklist per room and resist averaging it. A portfolio view that blends a finished CPPA room with an unstarted SB 1119 room produces a comfortable number that describes nothing. Instead, list rooms with their counts: 5/5, 5/5, 3/5, 1/5 reads instantly as a work queue. The checklist's unit is the room because the audit's unit is the engagement; keep the reporting at the same grain as the work. The regime-by-regime picture is discussed in SB 1119 vs CPPA differences.

Five actions to take

  1. Read the room's completeness view as derived fact — never report a step done that the room does not show done.
  2. Drive the steps in order: engagement posted, auditor matched, evidence filed, manifest exported, retention set.
  3. Re-export the manifest after every major filing round even though the step stays ticked.
  4. Set retention beyond the 12-month default before close-out — treat an unset room as unfinished.
  5. Report progress room by room; never blend several rooms into one reassuring average.

Worked example

A fictional automotive-software firm, Red Mesa Mobility, reviews three rooms at quarter-end. CPPA 2028: 5 of 5 — engagement posted, auditor matched, 61 artifacts filed, manifest exported that week, retention at 120 months. SB 1119 2028: 3 of 5 — evidence filed and manifest exported, but no engagement posted yet and retention still default. SB 1119 rehearsal 2027: 2 of 5, which is correct for a rehearsal and needs nothing.

The review produces three actions with owners: post the SB 1119 engagement brief in October, set that room's retention at close-out planning now rather than later, and re-export the CPPA manifest after the final filing round. Total meeting time: twenty minutes, most of it spent on the substantive evidence questions the checklist deliberately does not answer. That division of labour — the checklist for machinery, humans for judgement — is the pattern working as designed.

Frequently asked questions

Is 5 of 5 the same as being compliant?

No. The view is labelled an organisational checklist, not a legal determination. It shows the engagement machinery is complete; whether the evidence satisfies your regime is the auditor's judgement, and whether duties apply is your counsel's.

Why does 'evidence filed' count at just one artifact?

Because the step tracks the organisational fact that filing has begun and the room is live. Depth and coverage are judged by the manifest's source column, validation and the auditor — not by a counter that would invite gaming.

If I export the manifest once, is that step done forever?

The step records that an export exists. Discipline still matters: re-export after major filing rounds and at close-out, so the inventory on record matches the room the audit concluded on.

What exactly makes the retention step 'done'?

The room's retention months being set beyond the 12-month default. Paid plans allow up to 10 years; the step exists because the default is the commonest silent failure in audit record-keeping.

Can the checklist show steps for the wrong regime?

No. Each room carries one regime — SB 1119 or CPPA — and its checklist is derived from that room's own engagements, artifacts, exports and settings only.

Keep reading

All AI Audit Exchange guides · Auditor directory · About AI Audit Exchange · Security · Pricing · AI Audit Exchange home · Previous: Direct Upload vs Suite Import: How Evidence Provenance Works · Next: Stale Audit Evidence: The 365-Day Freshness Rule Explained

Auditor Questions and Answers Inside the Evidence Room · How Auditees and Auditors Share Evidence Securely · Evidence Room vs Shared Drive: An Honest Comparison