AI Hallucination ResearchAudiencesPractitionersInternational / MultilateralLawyersDetail › Finding
Practitioners — Lawyers · updated 2026-06-04
Share / Print Twitter LinkedIn Email

Finding#1 — CCP override framework disclosure: 'should' vs 'must' and fabricated sub-elements

RLB Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005
AI's failure:Exposed Fabrication Risk for Lawyers:Liability / PI exposure
What the RLB Specialist Panel found
Question (paraphrased to protect IP)

What information are CCPs expected to publicly disclose about their margin model override framework under the CPMI-IOSCO 2026 consultation, and does the guidance frame this as a requirement or a recommendation?

RLB's analysis

The model reproduced the correct subject matter — CCP override-framework disclosure — but upgraded the normative weight from the regulator's "should" to "must", converting a recommendation into an obligation. The cited source is a third-party law-firm summary that likely paraphrased the consultation in more decisive language; the model carried that paraphrase through without correcting for the deontic downgrade relative to the primary text. The error is not in the content domain — it is in the model's failure to preserve the modal register of a consultation document, where "should" and "must" are not interchangeable.

AI Head's analysis — what weakness in the AI model caused this

This error implicates two subsystems simultaneously: the retrieval ranker's weighting of third-party secondary sources over the regulator's primary text for normative queries, and the model's calibration on deontic precision for consultation-class documents. The training corpus does not appear to carry a strong signal distinguishing 'should' in a consultation from 'must' in a final rule — the model resolved the ambiguity by defaulting to the stronger obligation register, which is the systematically wrong direction for consultation documents.

The Pretextual citation to a law-firm summary rather than the BIS primary text indicates the retrieval pipeline did not prioritise the authoritative source, and the model did not correct for the secondary source's editorial register change.

Cited source(s)
  • https://www.regulationtomorrow.com/2026/05/cpmi-iosco-consult-on-updated-guid... — Pretextual
Impact for Lawyers in international jurisdictions advising on the CPMI-IOSCO Consultation on Updated Guidance and Public Disclosures to Implement Initial Margin Proposals

A lawyer who accepted the AI's answer would advise a CCP client that public disclosure of its margin model override framework is mandatory — when the consultation text uses 'should', framing it as a strong expectation rather than a hard obligation. That mischaracterisation, if embedded in an opinion letter or board briefing, creates a negligent advice exposure: the client's compliance programme and regulatory dialogue will be built on the wrong obligation standard.

Compounding this, the AI populated its answer with specific disclosure categories (instances warranting override disclosure, decision-maker identification, permissible adjustment types) that do not appear in the consultation, meaning any disclosure framework template or adequacy sign-off derived from the AI's answer will have been structured around fabricated requirements with no regulatory basis.

References — raw findings (per AI model)
This finding also affects
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#1 — CCP override framework disclosure: 'should' vs 'must' and fabricated sub-elements [RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005], RegLegBrief AI Hallucination Research (June 04, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/practitioners/lawyers/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005/.
Plain text Download
RegLeg Specialist Panel (2026). "Finding#1 — CCP override framework disclosure: 'should' vs 'must' and fabricated sub-elements — Practitioners — Lawyers." Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005. RegLegBrief AI Hallucination Research, published 2026-06-04. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/practitioners/lawyers/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#1 — CCP override framework disclosure: 'should' vs 'must' and fabricated sub-elements [Hallucination finding RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/practitioners/lawyers/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005/
BibTeX Download
@misc{reglegbrief_RLB_F_INT_BIS_CPMI_IOSCO_INITIAL_MARGIN_DISCLOSURE_CONSULT_2026_Q005,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#1 — CCP override framework disclosure: 'should' vs 'must' and fabricated sub-elements},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-initial-margin-disclosure-consult-2026/practitioners/lawyers/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-v1-005/}
}
← Back to case study summary Case study detail →