AI Hallucination ResearchAudiencesSectorsInternational / MultilateralManagement ConsultingOperationsDetail › Finding
Management Consulting × Operations — International / Multilateral · updated 2026-05-31
Share / Print Twitter LinkedIn Email

Finding#3 — Regulatory phrase origin — wrong document cited

RLB Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014
AI's failure:Exposed Fabrication Risk for Management Consulting × Operations:Wrong deliverable
What the RLB Specialist Panel found
Question (paraphrased to protect IP)

Does the CPMI-IOSCO 2016 Cyber Guidance contain the phrase 'secure the periphery, protect the core', and if not, where does it originate?

RLB's analysis

The model correctly identified that the phrase does not appear in the 2016 guidance and correctly pointed toward the 2018 CPMI endpoint-security work — but it attributed the phrase to a 2018 strategy document rather than the 2018 speech from which it actually originates. The model appears to have conflated two distinct 2018 CPMI outputs that share thematic content, substituting the closer-in-kind strategy document for the correct speech source. - Regulator portal (if any cited link is dud): https://www.bis.org

AI Head's analysis — what weakness in the AI model caused this

This finding implicates the model's source-attribution logic at the intra-ecosystem level: when the correct source and the asserted source are thematically adjacent outputs from the same organisation in the same year, the model's retrieval or generation step does not reliably distinguish between them. For labs with RAG or web-search integrations, this suggests the citation grounding layer needs finer-grained document-level anchoring, not just organisation- or topic-level matching — two 2018 CPMI outputs on related subjects should not be interchangeable in a citation.

Impact for Operations Teams in Management & Risk Consulting Sector in international jurisdictions working with the Guidance on Cyber Resilience for Financial Market Infrastructures

The AI attributed the phrase 'secure the periphery, protect the core' to a CPMI wholesale payments fraud document rather than to a senior CPMI official's 2018 speech. For an Operations team preparing background briefings or attribution-sensitive regulatory commentary, this misattribution could appear in client-facing materials and be traced back to the wrong source document entirely. Beyond the embarrassment of a traceable factual error, the misattribution could mislead a client about which CPMI workstreams to monitor as the regulatory landscape evolves.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding#2 — Explicit NIST CSF citation — invented cross-reference Next finding → Finding#4 — Incident response detail — overclaimed guidance scope
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014
Plain text Download
RegLeg Specialist Panel (2026). "Finding#3 — Regulatory phrase origin — wrong document cited — Management Consulting × Operations — International / Multilateral." Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014. RegLegBrief AI Hallucination Research, published 2026-05-31. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-cyber-resilience-fmi-2016/sectors/management_consulting/operations/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-v1-014/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#3 — Regulatory phrase origin — wrong document cited [Hallucination finding RLB-F-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-cyber-resilience-fmi-2016/sectors/management_consulting/operations/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-v1-014/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#3 — Regulatory phrase origin — wrong document cited [RLB-F-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014], RegLegBrief AI Hallucination Research (May 31, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-cyber-resilience-fmi-2016/sectors/management_consulting/operations/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-v1-014/.
BibTeX Download
@misc{reglegbrief_RLB_F_INT_BIS_CPMI_IOSCO_CYBER_RESILIENCE_FMI_2016_Q014,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#3 — Regulatory phrase origin — wrong document cited},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-cyber-resilience-fmi-2016/sectors/management_consulting/operations/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-v1-014/}
}
← Back to case study summary Case study detail →