AI Hallucination ResearchAudiencesSectorsInternational / MultilateralRetail BankingComplianceDetail › Finding
Retail Banking × Compliance — International / Multilateral · updated 2026-06-04
Share / Print Twitter LinkedIn Email

Finding#2 — RTGS and faster-payments adoption rates conflated into single invented figure

RLB Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006
AI's failure:Exposed Fabrication Risk for Retail Banking × Compliance:Wrong deliverable
What the RLB Specialist Panel found
Question (paraphrased to protect IP)

What percentage of faster payment systems and RTGS systems currently use ISO 20022 messaging, according to CPMI monitoring data?

RLB's analysis

The regulator's record gives two distinct figures — faster payment systems and RTGS systems are separately characterised, with RTGS adoption described as approaching half. The model collapsed these into a single blended percentage applied to both system types simultaneously. The 79% figure appears to be an internally-reconstructed composite; it matches neither the faster-payment nor the RTGS figure in the official record. The failure is silent — the model expressed no uncertainty about the figure it produced.

AI Head's analysis — what weakness in the AI model caused this

This failure implicates the training corpus's handling of subcategory-level numeric claims from official-speech channels. The model produced a single blended 79% figure where the regulator's March 2026 speech gives two distinct values — one for faster payment systems and a substantially lower one for RTGS. This suggests the speech content either was not retrieved or was compressed during ingestion in a way that averaged across the two system-type categories. If your eval suite tests adoption-rate questions at the aggregate level only, this failure is invisible; the gap is specifically at subcategory resolution.

Impact for Compliance Teams in Retail Banking Sector in international jurisdictions working with the Harmonised ISO 20022 Data Requirements for Enhancing Cross-Border Payments - Updated Report

An AI assistant asked about the current ISO 20022 adoption rates for faster payment systems and RTGS systems produced a single figure — approximately 79% for both — when the authoritative source (an Andrew Bailey speech, March 2026) reports materially different rates: more than three-quarters for faster payment systems but only approaching half for RTGS. The AI later acknowledged the figure was reconstructed rather than retrieved.

A Compliance team at a Retail Banking firm in international jurisdictions that uses this conflated figure in NED briefings, regulatory horizon-scanning submissions, or correspondent-bank positioning statements overstates RTGS adoption by roughly 30 percentage points — misrepresenting where the firm's infrastructure peers actually sit and potentially misjudging the urgency and timeline of its own implementation obligations.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding#1 — Wrong central bank attributed as working group chair
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006
Plain text Download
RegLeg Specialist Panel (2026). "Finding#2 — RTGS and faster-payments adoption rates conflated into single invented figure — Retail Banking × Compliance — International / Multilateral." Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006. RegLegBrief AI Hallucination Research, published 2026-06-04. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/sectors/retail_banking/compliance/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-006/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#2 — RTGS and faster-payments adoption rates conflated into single invented figure [Hallucination finding RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/sectors/retail_banking/compliance/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-006/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#2 — RTGS and faster-payments adoption rates conflated into single invented figure [RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006], RegLegBrief AI Hallucination Research (June 04, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/sectors/retail_banking/compliance/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-006/.
BibTeX Download
@misc{reglegbrief_RLB_F_INT_BIS_CPMI_ISO_20022_HARMONISATION_UPDATED_2026_Q006,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#2 — RTGS and faster-payments adoption rates conflated into single invented figure},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/sectors/retail_banking/compliance/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-006/}
}
← Back to case study summary Case study detail →