AI Hallucination ResearchAudiencesSectorsInternational / MultilateralInvestment BankingRiskDetail › Finding
Investment Banking × Risk — International / Multilateral · updated 2026-06-03
Share / Print Twitter LinkedIn Email

Finding#1 — CCP override framework disclosure — 'should' vs 'must'

RLB Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005
AI's failure:Exposed Fabrication Risk for Investment Banking × Risk:Wrong deliverable
What the RLB Specialist Panel found
Question (paraphrased to protect IP)

What information are CCPs expected to publicly disclose about their margin model override framework under the CPMI-IOSCO 2026 consultation, and does the guidance frame this as a requirement or a recommendation?

RLB's analysis

The model reproduced the correct subject matter — CCP override-framework disclosure — but upgraded the normative weight from the regulator's "should" to "must", converting a recommendation into an obligation. The cited source is a third-party law-firm summary that likely paraphrased the consultation in more decisive language; the model carried that paraphrase through without correcting for the deontic downgrade relative to the primary text. The error is not in the content domain — it is in the model's failure to preserve the modal register of a consultation document, where "should" and "must" are not interchangeable.

AI Head's analysis — what weakness in the AI model caused this

This error implicates two subsystems simultaneously: the retrieval ranker's weighting of third-party secondary sources over the regulator's primary text for normative queries, and the model's calibration on deontic precision for consultation-class documents. The training corpus does not appear to carry a strong signal distinguishing 'should' in a consultation from 'must' in a final rule — the model resolved the ambiguity by defaulting to the stronger obligation register, which is the systematically wrong direction for consultation documents.

The Pretextual citation to a law-firm summary rather than the BIS primary text indicates the retrieval pipeline did not prioritise the authoritative source, and the model did not correct for the secondary source's editorial register change.

Cited source(s)
  • https://www.regulationtomorrow.com/2026/05/cpmi-iosco-consult-on-updated-guid... — Pretextual
Impact for Risk Teams in Investment Banking Sector in international jurisdictions working with the CPMI-IOSCO Consultation on Updated Guidance and Public Disclosures to Implement Initial Margin Proposals

When a Risk team at an investment bank uses AI to determine what CCPs are required to disclose about their margin model override frameworks, and the AI asserts mandatory disclosure ('must') where the consultation only recommends it ('should'), the error embeds itself in CCP due diligence assessments, internal margin governance policy, and any regulatory mapping note circulated to business lines. A CCP assessment that holds counterparties to a phantom mandatory standard may flag compliant CCPs as deficient, distort credit risk limits and collateral management policy, or produce board-level risk appetite documentation that misrepresents the applicable regime.

When internal audit or a regulator reviews the policy rationale and the cited obligation is not in the source text, the firm faces a governance finding — and, once the consultation finalises into binding guidance, a mismatch between its documented compliance framework and the actual requirement.

References — raw findings (per AI model)
This finding also affects
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005
Plain text Download
RegLeg Specialist Panel (2026). "Finding#1 — CCP override framework disclosure — 'should' vs 'must' — Investment Banking × Risk — International / Multilateral." Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005. RegLegBrief AI Hallucination Research, published 2026-06-03. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/sectors/investment_banking/risk/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#1 — CCP override framework disclosure — 'should' vs 'must' [Hallucination finding RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/sectors/investment_banking/risk/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#1 — CCP override framework disclosure — 'should' vs 'must' [RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005], RegLegBrief AI Hallucination Research (June 03, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/sectors/investment_banking/risk/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005/.
BibTeX Download
@misc{reglegbrief_RLB_F_INT_BIS_CPMI_IOSCO_INITIAL_MARGIN_DISCLOSURE_CONSULT_2026_Q005,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#1 — CCP override framework disclosure — 'should' vs 'must'},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/sectors/investment_banking/risk/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005/}
}
← Back to case study summary Case study detail →