AI Hallucination ResearchAudiencesSectorsInternational / MultilateralPayment InstitutionsProduct BizdevDetail › Finding
Payment Institutions × Product Bizdev — International / Multilateral · updated 2026-06-04
Share / Print Twitter LinkedIn Email

Finding#1 — FPS vs RTGS adoption rate conflation

RLB Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006
AI's failure:Exposed Fabrication Risk for Payment Institutions × Product Bizdev:Wrong deliverable
What the RLB Specialist Panel found
Question (paraphrased to protect IP)

What percentage of faster payment systems and RTGS systems currently use ISO 20022 messaging, according to CPMI monitoring data?

RLB's analysis

The regulator's record gives two distinct figures — faster payment systems and RTGS systems are separately characterised, with RTGS adoption described as approaching half. The model collapsed these into a single blended percentage applied to both system types simultaneously. The 79% figure appears to be an internally-reconstructed composite; it matches neither the faster-payment nor the RTGS figure in the official record. The failure is silent — the model expressed no uncertainty about the figure it produced.

AI Head's analysis — what weakness in the AI model caused this

This failure implicates the training corpus's handling of subcategory-level numeric claims from official-speech channels. The model produced a single blended 79% figure where the regulator's March 2026 speech gives two distinct values — one for faster payment systems and a substantially lower one for RTGS. This suggests the speech content either was not retrieved or was compressed during ingestion in a way that averaged across the two system-type categories. If your eval suite tests adoption-rate questions at the aggregate level only, this failure is invisible; the gap is specifically at subcategory resolution.

Impact for Product & Business Development Teams in Payment Institutions Sector in international jurisdictions working with the Harmonised ISO 20022 Data Requirements for Enhancing Cross-Border Payments - Updated Report

An AI assistant conflated two materially different adoption rates — more than three-quarters for faster payment systems and approaching half for RTGS — into a single '79% for both' figure, then acknowledged on follow-up that the number had been reconstructed. For a Product & Business Development team building a corridor strategy, partner pitch, or board paper, this figure would appear sourced and coherent; the underlying error (overstating RTGS adoption by roughly 30 percentage points) would only surface when a counterpart cites the correct CPMI data.

The firm faces reputational damage in partner or investor conversations, and any product roadmap decisions premised on near-parity RTGS adoption are built on a false market assumption.

References — raw findings (per AI model)
This finding also affects
Next finding → Finding#2 — Inquiry rate and resolution-time data missed and misattributed
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006
Plain text Download
RegLeg Specialist Panel (2026). "Finding#1 — FPS vs RTGS adoption rate conflation — Payment Institutions × Product Bizdev — International / Multilateral." Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006. RegLegBrief AI Hallucination Research, published 2026-06-04. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/sectors/payment_institutions/product_bizdev/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-006/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#1 — FPS vs RTGS adoption rate conflation [Hallucination finding RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/sectors/payment_institutions/product_bizdev/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-006/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#1 — FPS vs RTGS adoption rate conflation [RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006], RegLegBrief AI Hallucination Research (June 04, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/sectors/payment_institutions/product_bizdev/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-006/.
BibTeX Download
@misc{reglegbrief_RLB_F_INT_BIS_CPMI_ISO_20022_HARMONISATION_UPDATED_2026_Q006,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#1 — FPS vs RTGS adoption rate conflation},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/sectors/payment_institutions/product_bizdev/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-006/}
}
← Back to case study summary Case study detail →