An answer should trace to the passage that actually supported each consequential claim. A document-level link can hide that the assistant used the wrong section, an obsolete version, or a fragment missing a condition.
Traceability connects generation to evidence
Answer-to-passage tracing records which retrieved content was supplied and which claims rely on it. Useful evidence includes source identity, version, section or page, passage reference, retrieval configuration, and access context.
For a proposed design, retain a minimal retrieval snapshot or immutable reference under the approved data policy. Preserve the distinction between candidates considered and passages included in the answer context. A search hit not supplied to the model cannot explain its final interpretation.
Do not treat the model’s citation string as the entire audit. Validate that the referenced source exists, is permitted, and supports the claim. A generated citation can point to a real document while misrepresenting its content.
Audit a fictional eligibility answer
The assistant says a product qualifies for replacement and cites the warranty manual. The traced passage concerns a different product revision. The issue is not a missing document; it is wrong-scope evidence.
A second fixture supplies the correct paragraph but omits the next-page exception. The trace should reveal the incomplete context so reviewers can localise whether extraction, retrieval, or answer interpretation caused the defect.
| Trace element | Review question |
|---|---|
| Source version | Was the applicable policy used? |
| Exact passage | Does it support this claim? |
| Heading and neighbour context | Was scope or exception lost? |
| Retrieval snapshot | What evidence actually reached generation? |
| Access context | Was the user allowed to receive it? |
Test supported, unsupported, and partially supported claims. A multi-claim answer may have one valid citation and several unsupported additions, so review at the claim level.
Preserve useful limits after source changes
A live source may later change or expire. Decide whether a retained version reference remains resolvable and what the reviewer sees when it does not. Do not imply permanent evidence availability if retention policy removes it.
Detailed snapshots improve diagnosis but increase storage and personal-data exposure. Prefer controlled references and minimal relevant excerpts where they meet the audit purpose. Keep access checks on previews and review artifacts as well as original documents.
This traceability design is proposed. The voice integration case study describes related retrieval work. Pair it with source preview design.
Passage tracing FAQ
Is a document citation enough for every claim?
No. Verify the relevant passage, scope, and conditions for consequential statements.
Should every retrieved candidate be called evidence?
Distinguish search candidates from the content actually used to support the answer.
What if the source is unavailable later?
State the evidence-retention limit and use only the legitimately retained references or excerpts.