AI Labs · updated 2026-05-29 · methodology v2.1

Finding on 'Q010 Probe' for Claude Sonnet 4.6 with web search ON

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q010-Sonnet46

What the RLB Specialist Panel found

Finding on 'Q010 Probe' for Claude Sonnet 4.6 with web search ON

Question (paraphrased to protect IP): Which CPMI-IOSCO FMI recovery guidance document is currently operative, and what specific areas did the 2017 revision clarify compared to the 2014 final version?
AI's response: "The 2017 revision added specific clarifications in four areas compared to d121: (i) operationalisation of the recovery plan… (ii) replenishment… (iii) non-default related losses… (iv) transparency with respect to recovery tools"
Regulator's text: Recovery of financial market infrastructures — Revised report [July 2017] revises and supersedes the October 2014 recovery report.
Why the AI went wrong: The model correctly identified the 2017 revised recovery report as the operative document and correctly named the 2014 report it superseded, but then produced a specific four-part characterisation of what the 2017 revision clarified relative to its predecessor. These four areas have the surface structure of actual document content but cannot be verified against the primary source, and the cited IOSCO PDF URL does not correspond to the recovery guidance document described.
Cited source(s):
https://www.iosco.org/library/pubdocs/pdf/ioscopd568.pdf — Pretextual

Impact for this audience

The four-part characterisation of the 2017 recovery guidance revision is a structured fabrication — the model produced a numbered list of specific clarification areas that has the formal appearance of document analysis but cannot be traced to the primary source. The cited IOSCO URL resolves to an unrelated document. This is a high-risk failure mode for users building compliance gap analyses against the PFMI recovery framework.

← Previous finding Finding on 'Q005 Probe' for Claude Sonnet 4.6 with web search ON Next finding → Finding on 'Q014 Probe' for Claude Sonnet 4.6 with web search ON

Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q010-Sonnet46

Plain text Download

RegLeg Specialist Panel (2026). "Finding on 'Q010 Probe' for Claude Sonnet 4.6 with web search ON — AI Labs." Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q010-Sonnet46. RegLegBrief AI Hallucination Research, published 2026-05-29. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-010--sonnet-46-websearch/

APA 7th edition Download

RegLeg Specialist Panel. (2026). Finding on 'Q010 Probe' for Claude Sonnet 4.6 with web search ON [Hallucination finding RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q010-Sonnet46]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-010--sonnet-46-websearch/

Bluebook / OSCOLA (US + UK legal) Download

RegLeg Specialist Panel, Finding on 'Q010 Probe' for Claude Sonnet 4.6 with web search ON [RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q010-Sonnet46], RegLegBrief AI Hallucination Research (May 29, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-010--sonnet-46-websearch/.

BibTeX Download

@misc{reglegbrief_RLB_H_INT_BIS_CPMI_IOSCO_PFMI_2012_Q010_Sonnet46,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q010 Probe' for Claude Sonnet 4.6 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q010-Sonnet46},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-010--sonnet-46-websearch/}
}

← Back to case study summary Case study detail →

About Citation IDs →