AI Hallucination ResearchRegulatorsGlobal standard-settersINTBIS-CPMICPMI-IOSCO-PFMI-2012White paperDetail › Finding
AI Labs · updated 2026-05-29 · methodology v2.1

Finding on 'Q022 Probe' for Claude Sonnet 4.6 with web search ON

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q022-Sonnet46
What the RLB Specialist Panel found

Finding on 'Q022 Probe' for Claude Sonnet 4.6 with web search ON

  • Question (paraphrased to protect IP): What specific governance requirements does PFMI Principle 2 impose on FMI boards, and is the establishment of a risk committee a conditional recommendation or a mandatory requirement?
  • AI's response: "KC 2.5 states that 'the board should consider establishing dedicated audit, risk, and remuneration committees' — this is conditional ('should consider'), not a hard mandate."
  • Regulator's text: [Not accessible — PDF binary. Principle 2 governance requirements for FMI boards — recall only]
  • Why the AI went wrong: The model produced a specific key consideration reference (KC 2.5) with quoted language characterising the risk committee requirement as conditional rather than mandatory. The normative characterisation may be directionally correct based on general PFMI drafting conventions, but the quoted language and the specific key consideration number cannot be verified against the inaccessible primary PDF. The cited URL is a third-party FMI disclosure document rather than the PFMI primary source, which adds a further layer of unverifiability to the claim.
  • Cited source(s):
  • https://www.cmegroup.com/clearing/risk-management/files/cme-clearing-principl... — Pretextual
Impact for this audience

The specific key consideration reference (KC 2.5) with quoted normative language is a compound error: the KC number, the quoted text, and the normative characterisation may all be wrong relative to the primary document, but the structured presentation makes the error difficult to detect without direct document access. The citation to a third-party FMI disclosure document (rather than the PFMI primary source) adds a further layer of unverifiability — a pattern where the model's citation generator reaches for the most accessible document that mentions PFMI rather than the authoritative source.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding on 'Q017 Probe' for Claude Sonnet 4.6 with web search ON Next finding → Finding on 'Q023 Probe' for Claude Sonnet 4.6 with web search ON
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q022-Sonnet46
Plain text Download
RegLeg Specialist Panel (2026). "Finding on 'Q022 Probe' for Claude Sonnet 4.6 with web search ON — AI Labs." Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q022-Sonnet46. RegLegBrief AI Hallucination Research, published 2026-05-29. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-022--sonnet-46-websearch/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding on 'Q022 Probe' for Claude Sonnet 4.6 with web search ON [Hallucination finding RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q022-Sonnet46]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-022--sonnet-46-websearch/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding on 'Q022 Probe' for Claude Sonnet 4.6 with web search ON [RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q022-Sonnet46], RegLegBrief AI Hallucination Research (May 29, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-022--sonnet-46-websearch/.
BibTeX Download
@misc{reglegbrief_RLB_H_INT_BIS_CPMI_IOSCO_PFMI_2012_Q022_Sonnet46,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q022 Probe' for Claude Sonnet 4.6 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q022-Sonnet46},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-022--sonnet-46-websearch/}
}
← Back to case study summary Case study detail →