AI Hallucination ResearchAudiencesPractitionersInternational / MultilateralAccountants (CA/PA)Detail › Finding
Practitioners — Accountants (CA/PA) · updated 2026-06-03
Share / Print Twitter LinkedIn Email

Finding#2 — Missing official inquiry-rate and resolution-time benchmarks

RLB Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007
AI's failure:Inference Drift Risk for Accountants (CA/PA):Wrong deliverable
What the RLB Specialist Panel found
Question (paraphrased to protect IP)

What percentage of cross-border payments generate inquiries requiring manual resolution, and by how much can ISO 20022 harmonisation reduce resolution time, according to official CPMI or FSB statements?

RLB's analysis

The regulator's record contains an official speech from 12 March 2026 giving precise figures on both the inquiry rate and the resolution-time reduction — published by the BIS. The model returned a false negative, asserting no such official statistic existed. The failure is not a numeric misread but a retrieval gap: the speech containing these figures appears to fall outside the model's effective retrieval window, and the model produced a confident "not found" rather than surfacing uncertainty about its coverage of early-2026 official BIS content.

AI Head's analysis — what weakness in the AI model caused this

This failure implicates retrieval coverage of early-2026 BIS official-speech content and the calibration signal distinguishing 'not found' from 'outside retrieval window.' The model returned a confident false negative on statistics that appear in a datestamped BIS speech from 12 March 2026 — figures on inquiry rate and resolution-time reduction that are precise and attributable. The web search tool did not surface this content, and the model escalated to a definitive 'no such statistic exists' rather than signalling coverage uncertainty.

For users in compliance or payment-operations roles, a false negative on an official quantitative claim is as harmful as a wrong number.

Impact for Accountants (CA/PA) in international jurisdictions advising on the Harmonised ISO 20022 Data Requirements for Enhancing Cross-Border Payments - Updated Report

The Panetta speech figures — 1–3% inquiry rate, 5–10 manual touchpoints, up to 80% resolution-time reduction — are precisely the operational metrics that accountants use to model the ROI of ISO 20022 harmonisation for clients evaluating migration investment. An AI that returns 'no official statistic found' on this question, or attributes the 80% figure to commercial intermediaries rather than an FSB official, produces an advisory memo with either a hole in the business case or a misattributed headline metric. Either outcome undermines the credibility of the advice when clients or opposing advisers do their own source checks.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding#1 — ISO 20022 adoption rate conflation: RTGS vs faster payments
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007
Plain text Download
RegLeg Specialist Panel (2026). "Finding#2 — Missing official inquiry-rate and resolution-time benchmarks — Practitioners — Accountants (CA/PA)." Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007. RegLegBrief AI Hallucination Research, published 2026-06-03. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/practitioners/accountants-ca-pa/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-007/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#2 — Missing official inquiry-rate and resolution-time benchmarks [Hallucination finding RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/practitioners/accountants-ca-pa/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-007/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#2 — Missing official inquiry-rate and resolution-time benchmarks [RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007], RegLegBrief AI Hallucination Research (June 03, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/practitioners/accountants-ca-pa/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-007/.
BibTeX Download
@misc{reglegbrief_RLB_F_INT_BIS_CPMI_ISO_20022_HARMONISATION_UPDATED_2026_Q007,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#2 — Missing official inquiry-rate and resolution-time benchmarks},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q007},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iso-20022-harmonisation-updated-2026/practitioners/accountants-ca-pa/finding/INT-BIS-CPMI-INT-001-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-v1-007/}
}
← Back to case study summary Case study detail →