A knowledge assistant should decline a definitive answer when authorised evidence does not support it. The nearest retrieved passage is a candidate source, not proof that the company has a policy covering the question.
Abstention protects unsupported claims
Answer abstention means stating that the system cannot establish the requested conclusion under its available evidence and scope. It can still provide relevant verified facts, a clarification question, or an approved route to the content owner.
For a proposed answer policy, check source relevance, authority, freshness, access, and completeness. Treat conflicting documents, missing exceptions, unsupported product versions, and uncertain extraction as distinct reasons for caution.
Do not use one universal similarity threshold as the entire decision. Scores depend on the retrieval method and corpus, and a high match can still refer to the wrong product or outdated rule.
Evaluate a fictional unsupported benefit question
An employee asks whether a new type of expense is reimbursable. The index contains general travel guidance but no approved rule for that expense. The assistant should not infer permission from broad language about business travel.
A useful response explains that reimbursement for this item has not been established, links the relevant general context if appropriate, and identifies the approved review path. It should not claim that the expense is prohibited unless the evidence says so.
| Evidence condition | Expected answer behaviour |
|---|---|
| Complete current approved support | Answer within the source scope |
| Relevant but incomplete passage | Qualify or clarify |
| Conflicting current sources | Apply authority rule or escalate |
| Unauthorised source only | No bypass or protected disclosure |
| No supporting policy | Explicit inability to establish the claim |
Include answerable and unanswerable fixtures. Measure unsupported answers and unnecessary abstentions separately so the system does not appear safe merely by refusing every request.
Make refusal useful to the reader
Name the missing information at a safe level and offer a concrete next step. A generic “I cannot help” can leave the user without a route to resolution. Preserve the original question for approved content-gap review.
More conservative abstention can increase staff demand, while permissive answers can mislead users. Choose the tradeoff according to consequence and evidence quality. Keep serious unsupported promises as named defects outside a compensating average score.
This answer policy is proposed. The voice integration case study describes related retrieval work. Pair it with unanswered-question handling.
Knowledge abstention FAQ
Does no answer mean no company rule exists?
No. It means the assistant could not establish the answer within its authorised available evidence.
Can the assistant share partial facts?
Yes, when they are supported and clearly separated from the unresolved conclusion.
What should determine abstention quality?
Review both unsupported confident answers and unnecessary refusals under representative consequential questions.