Runs did not include a step the owner said they should
What you're seeing
A finding like:
2 of 41 ended runs of Knowledge bot since 2026-11-07 did not include a call to search_kb. [email protected] declared on 2026-11-07 that its runs should. 39 did.
It is an Expected step missing finding, medium severity.
What it means
The agent's owner declared that its runs should include a call to a tool. Provantix counted the ended runs since then, and some had no record of that call. A call that failed is not counted as missing.
It cannot tell why. The agent may have skipped the step, the step may not have been traced, or the run may not have needed it. The finding names all three and picks none.
What to do
- Open an example run from the finding and look at what the agent did instead. Check whether the step was needed for that task.
- If it was needed, find why the agent skipped it: a prompt change, a different tool choice, a new model or version, a configuration change. Compare with a run that included it.
- If it is not traced, the tool ran but left no record. Trace it, or the finding will keep counting those runs.
- If the run did not need it, the declaration is too broad. End it and declare a narrower one.
- The finding closes by itself when no recent ended run is missing the step. Resolve it with the cause if you want it on the record.
What this does not do
It does not stop an agent, require the step, or judge the answer. It counts runs. See Expected steps.