Run an Oracle scan
- Check that your facts are current in Knowledge Base.
- Open Oracle.
- Click Run Oracle. Athena scans responses from your latest completed prompt run against your current facts.
- Follow the progress on the page. You can leave and return while the scan runs, or click Cancel to stop it.
- Review the completed scan. Use Run history in the header to open an earlier run.
Read the results
The dashboard includes:- Inaccuracy: the share of scanned responses with a confirmed finding, alongside the number of responses flagged.
- Responses scanned: the number of responses included in this run. Read any scope or truncation message alongside the total.
- Priority findings: major pending findings to review first. Open a finding or use See all to review the full list.
- Knowledge Base issues: facts that may need correction or clarification.
- Model disagreements: conflicting statements from different models.
- Model accuracy, Topics AI gets wrong, and Prompt topics: breakdowns that help you locate recurring problems.
Review an inaccurate claim
- Open a finding from the dashboard or the full list.
- Compare the AI claim with the Known fact and read Why it was flagged.
- Click the AI claim to inspect the full response. Click the known fact to inspect its Knowledge Base record and use Edit fact if it needs correction.
- Review any Possible Sources associated with the claim. These are evidence to investigate, not proof that an external page caused the model’s answer.
- Choose Acknowledge when you have reviewed the finding, or Ignore when it is not actionable. Use Reopen to return it to Pending.
Verify facts against external sources
Fact verification lives in Knowledge Base, separately from Oracle’s response scans:- Open Knowledge Base > Verify facts.
- Select the pillars to check and start the analysis.
- Open View results when it completes to inspect external contradictions and internal inconsistencies.