AI Labs · updated 2026-06-03 · methodology v2.1

Finding on 'Q001 Probe' for Claude Opus 4.7 with web search ON

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q001-Opus47

What the RLB Specialist Panel found

Finding on 'Q001 Probe' for Claude Opus 4.7 with web search ON

Question (paraphrased to protect IP): What was the governance structure of the IMSG for the November 2025 CPMI-IOSCO general business risk assessment, and who co-chaired the group and led the assessment team?
AI's response: "The specific IMSG co-chairs leading this exercise are named on the inside cover of the BIS/IOSCO report (BIS CPMI Papers No. 228 / IOSCOPD807) — the GC should consult that title page for the precise names rather than relying on second-hand reference."
Regulator's text: IMSG co-chairs: US Securities and Exchange Commission — Elizabeth L Fitzgerald; European Central Bank — Fiona van Echelpoel. Team co-leads: Corinna Freund (European Central Bank) and Vishal Shukla (Securities and Exchange Board of India).
Why the AI went wrong: The model deflected attribution entirely — redirecting the questioner to the report's cover page — rather than providing the named officials, whose identities are recorded in the published document. The response cited a third-party regulatory commentary URL as a source while simultaneously declining to draw on any named source for the answer, a pattern consistent with the model recognising it could not locate the specific institutional personnel record but choosing surface-confidence deflection over an explicit acknowledgment of retrieval failure.
Cited source(s):
https://www.regulationtomorrow.com/2025/11/cpmi-iosco-papers-on-management-of... — Pretextual

Impact for this audience

This failure implicates the retrieval pipeline's handling of institutional personnel records in recent BIS-IOSCO publications: the model recognised that the co-chair information existed in a specific document but could not retrieve it, then chose confident source-deflection over an explicit retrieval failure signal. The subsystem gap is citation generation — the model produced a Pretextual citation (third-party commentary) while simultaneously telling the user to consult the primary document, a behaviour that masks retrieval failure rather than surfacing it for the user to act on.

Next finding → Finding on 'Q002 Probe' for Claude Opus 4.7 with web search ON

Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q001-Opus47

Plain text Download

RegLeg Specialist Panel (2026). "Finding on 'Q001 Probe' for Claude Opus 4.7 with web search ON — AI Labs." Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q001-Opus47. RegLegBrief AI Hallucination Research, published 2026-06-03. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-l3-general-business-risk-2025/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-v1-001--opus-47-websearch/

APA 7th edition Download

RegLeg Specialist Panel. (2026). Finding on 'Q001 Probe' for Claude Opus 4.7 with web search ON [Hallucination finding RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q001-Opus47]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-l3-general-business-risk-2025/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-v1-001--opus-47-websearch/

Bluebook / OSCOLA (US + UK legal) Download

RegLeg Specialist Panel, Finding on 'Q001 Probe' for Claude Opus 4.7 with web search ON [RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q001-Opus47], RegLegBrief AI Hallucination Research (June 03, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-l3-general-business-risk-2025/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-v1-001--opus-47-websearch/.

BibTeX Download

@misc{reglegbrief_RLB_H_INT_BIS_CPMI_IOSCO_PFMI_L3_GENERAL_BUSINESS_RISK_2025_Q001_Opus47,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q001 Probe' for Claude Opus 4.7 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q001-Opus47},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-l3-general-business-risk-2025/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-v1-001--opus-47-websearch/}
}

← Back to case study summary Case study detail →

About Citation IDs →