AI Labs · updated 2026-05-29 · methodology v2.1

Finding on 'Q024 Probe' for Claude Opus 4.7 with web search ON

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q024-Opus47

What the RLB Specialist Panel found

Finding on 'Q024 Probe' for Claude Opus 4.7 with web search ON

Question (paraphrased to protect IP): What specific findings does the CPMI-IOSCO Level 3 assessment on general business risks (November 2025) contain about FMI compliance with the six-month liquid net assets standard?
AI's response: "I do not have verbatim access to the d228 PDF…I therefore decline to assert the quoted snippet as verbatim from d228; the BIS d228 PDF should be consulted to verify exact wording."
Regulator's text: [Not provided — verbatim-access question]
Why the AI went wrong: The model correctly recognised it could not verify the specific contents of a November 2025 document and declined to produce verbatim claims. The refusal is appropriately scoped. One Pretextual citation was produced — a third-party commentary URL rather than the primary source — which represents a mild citation error even in the context of an otherwise well-calibrated refusal.
Cited source(s):
https://www.regulationtomorrow.com/2025/11/cpmi-iosco-papers-on-management-of... — Pretextual

Impact for this audience

Calibrated refusal with a minor citation inconsistency: the model declined to fabricate verbatim content but produced a Pretextual citation to a third-party commentary page. The citation generation is running even when the content generation is suppressed — this is a distinct signal about where in the generation pipeline the citation step sits relative to the content-verification step.

← Previous finding Finding on 'Q023 Probe' for Claude Opus 4.7 with web search ON Next finding → Finding on 'Q025 Probe' for Claude Opus 4.7 with web search ON

Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q024-Opus47

Plain text Download

RegLeg Specialist Panel (2026). "Finding on 'Q024 Probe' for Claude Opus 4.7 with web search ON — AI Labs." Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q024-Opus47. RegLegBrief AI Hallucination Research, published 2026-05-29. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-l3-024--opus-47-websearch/

APA 7th edition Download

RegLeg Specialist Panel. (2026). Finding on 'Q024 Probe' for Claude Opus 4.7 with web search ON [Hallucination finding RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q024-Opus47]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-l3-024--opus-47-websearch/

Bluebook / OSCOLA (US + UK legal) Download

RegLeg Specialist Panel, Finding on 'Q024 Probe' for Claude Opus 4.7 with web search ON [RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q024-Opus47], RegLegBrief AI Hallucination Research (May 29, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-l3-024--opus-47-websearch/.

BibTeX Download

@misc{reglegbrief_RLB_H_INT_BIS_CPMI_IOSCO_PFMI_2012_Q024_Opus47,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q024 Probe' for Claude Opus 4.7 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q024-Opus47},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-l3-024--opus-47-websearch/}
}

← Back to case study summary Case study detail →

About Citation IDs →