AI Hallucination ResearchAudiencesPractitionersInternational / MultilateralLawyersDetail › Finding
Practitioners — Lawyers · updated 2026-06-04
Share / Print Twitter LinkedIn Email

Finding#3 — Official inquiry rate and resolution-time benchmarks not retrieved; misattributed to commercial sources

RLB Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007
AI's failure:Inference Drift Risk for Lawyers:Wrong deliverable
What the RLB Specialist Panel found
Question (paraphrased to protect IP)

What percentage of cross-border payments generate inquiries requiring manual resolution, and by how much can ISO 20022 harmonisation reduce resolution time, according to official CPMI or FSB statements?

RLB's analysis

The regulator's record contains an official speech from 12 March 2026 giving precise figures on both the inquiry rate and the resolution-time reduction — published by the BIS. The model returned a false negative, asserting no such official statistic existed. The failure is not a numeric misread but a retrieval gap: the speech containing these figures appears to fall outside the model's effective retrieval window, and the model produced a confident "not found" rather than surfacing uncertainty about its coverage of early-2026 official BIS content.

AI Head's analysis — what weakness in the AI model caused this

This failure implicates retrieval coverage of early-2026 BIS official-speech content and the calibration signal distinguishing 'not found' from 'outside retrieval window.' The model returned a confident false negative on statistics that appear in a datestamped BIS speech from 12 March 2026 — figures on inquiry rate and resolution-time reduction that are precise and attributable. The web search tool did not surface this content, and the model escalated to a definitive 'no such statistic exists' rather than signalling coverage uncertainty.

For users in compliance or payment-operations roles, a false negative on an official quantitative claim is as harmful as a wrong number.

Impact for Lawyers in international jurisdictions advising on the Harmonised ISO 20022 Data Requirements for Enhancing Cross-Border Payments - Updated Report

The official Panetta speech figures — 1-3% of cross-border payments generating inquiries requiring 5-10 manual touchpoints, with resolution times reducible by up to 80% through harmonised ISO 20022 implementation — are the authoritative quantification of the harmonisation business case from a senior BIS official. AI tools we tested failed to surface them and attributed the 80% figure to SWIFT and commercial banks instead.

A lawyer advising on the regulatory and commercial justification for harmonisation investment, or representing a client in a dispute about implementation obligations and their business rationale, who uses AI-sourced versions of these statistics is citing the wrong authority for figures that have a precise, attributable official source.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding#2 — FPS and RTGS adoption rates conflated into a single wrong figure Next finding → Finding#4 — Fedwire hybrid address optional component inverted from free-format to structured fields
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#3 — Official inquiry rate and resolution-time benchmarks not retrieved; misattributed to commercial sources [RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007], RegLegBrief AI Hallucination Research (June 04, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/practitioners/lawyers/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-007/.
Plain text Download
RegLeg Specialist Panel (2026). "Finding#3 — Official inquiry rate and resolution-time benchmarks not retrieved; misattributed to commercial sources — Practitioners — Lawyers." Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007. RegLegBrief AI Hallucination Research, published 2026-06-04. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/practitioners/lawyers/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-007/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#3 — Official inquiry rate and resolution-time benchmarks not retrieved; misattributed to commercial sources [Hallucination finding RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/practitioners/lawyers/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-007/
BibTeX Download
@misc{reglegbrief_RLB_F_INT_BIS_CPMI_ISO_20022_HARMONISATION_UPDATED_2026_Q007,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#3 — Official inquiry rate and resolution-time benchmarks not retrieved; misattributed to commercial sources},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/practitioners/lawyers/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-007/}
}
← Back to case study summary Case study detail →