AI Hallucination Research › Regulators › Global standard-setters › INT › BIS-CPMI › CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026 › White paper › Detail › Finding
AI Labs · updated 2026-06-03 · methodology v2.1

Finding on 'Q005 Probe' for Claude Sonnet 4.6 with web search ON

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005-Sonnet46
What the RLB Specialist Panel found

Finding on 'Q005 Probe' for Claude Sonnet 4.6 with web search ON

  • Question (paraphrased to protect IP): What information are CCPs expected to publicly disclose about their margin model override framework under the CPMI-IOSCO 2026 consultation, and does the guidance frame this as a requirement or a recommendation?
  • AI's response: "CCPs must publicly disclose relevant information on their margin model override framework."
  • Regulator's text: CCPs should publicly disclose relevant information on their override framework.
  • Why the AI went wrong: The model reproduced the correct subject matter — CCP override-framework disclosure — but upgraded the normative weight from the regulator's "should" to "must", converting a recommendation into an obligation. The cited source is a third-party law-firm summary that likely paraphrased the consultation in more decisive language; the model carried that paraphrase through without correcting for the deontic downgrade relative to the primary text. The error is not in the content domain — it is in the model's failure to preserve the modal register of a consultation document, where "should" and "must" are not interchangeable.
  • Cited source(s):
  • https://www.regulationtomorrow.com/2026/05/cpmi-iosco-consult-on-updated-guid... — Pretextual
Impact for this audience

This error implicates two subsystems simultaneously: the retrieval ranker's weighting of third-party secondary sources over the regulator's primary text for normative queries, and the model's calibration on deontic precision for consultation-class documents. The training corpus does not appear to carry a strong signal distinguishing 'should' in a consultation from 'must' in a final rule — the model resolved the ambiguity by defaulting to the stronger obligation register, which is the systematically wrong direction for consultation documents.

The Pretextual citation to a law-firm summary rather than the BIS primary text indicates the retrieval pipeline did not prioritise the authoritative source, and the model did not correct for the secondary source's editorial register change.

References — raw findings (per AI model)
This finding also affects
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005-Sonnet46
Plain text Download 
RegLeg Specialist Panel (2026). "Finding on 'Q005 Probe' for Claude Sonnet 4.6 with web search ON — AI Labs." Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005-Sonnet46. RegLegBrief AI Hallucination Research, published 2026-06-03. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005--sonnet-46-websearch/
APA 7th edition Download 
RegLeg Specialist Panel. (2026). Finding on 'Q005 Probe' for Claude Sonnet 4.6 with web search ON [Hallucination finding RLB-H-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005-Sonnet46]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005--sonnet-46-websearch/
Bluebook / OSCOLA (US + UK legal) Download 
RegLeg Specialist Panel, Finding on 'Q005 Probe' for Claude Sonnet 4.6 with web search ON [RLB-H-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005-Sonnet46], RegLegBrief AI Hallucination Research (June 03, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005--sonnet-46-websearch/.
BibTeX Download 
@misc{reglegbrief_RLB_H_INT_BIS_CPMI_IOSCO_INITIAL_MARGIN_DISCLOSURE_CONSULT_2026_Q005_Sonnet46,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q005 Probe' for Claude Sonnet 4.6 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005-Sonnet46},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005--sonnet-46-websearch/}
}
← Back to case study summary Case study detail →
About Citation IDs →