AI Hallucination Research › Regulators › Global standard-setters › INT › BIS-CPMI › CPMI-API-HARMONISATION-CROSS-BORDER-2024 › White paper › Detail › Finding
AI Labs · updated 2026-06-04 · methodology v2.1

Finding on 'Q007 Probe' for Claude Opus 4.7 with web search ON

RLB Citation ID: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Opus47
What the RLB Specialist Panel found

Finding on 'Q007 Probe' for Claude Opus 4.7 with web search ON

  • Question (paraphrased to protect IP): An advisor to a South African financial institution needs to know which central banks are actively involved in piloting or implementing specific API harmonisation recommendations, and whether any central bank is specifically named as partnering with CPMI on the payment pre-validation API recommendation.
  • AI's response: "it is plausible that SARB is engaged with the d224 implementation track, but I cannot point to a public CPMI statement naming SARB as the specific partner on the pre-validation API recommendation."
  • Regulator's text: CPMI Brief No. 9 (November 2025): "The CPMI, in collaboration with the South African Reserve Bank (SARB), has been advancing the API recommendation on payment pre-validation by conducting interviews with market stakeholders."
  • Why the AI went wrong: The model hedged toward the correct institution but could not confirm the explicit CPMI-SARB named partnership — a partnership announced in a November 2025 brief that appears to fall outside the retrieval pipeline's effective indexing. To fill the gap, the model cited a fabricated Bank of England URL as supporting evidence, producing a hallucinated citation in place of the accessible regulator record.
  • Cited source(s):
  • https://www.bankofengland.co.za/news/2024/december/the-boe-welcomes-api-panel... — Fabricated
Impact for this audience

The fabricated Bank of England URL generated to fill the citation gap is the key signal: the model's citation-generation subsystem produced a plausible-looking but non-existent URL rather than returning 'no source found.' This points to a citation-generation pipeline that is not gated on verified retrieval — it will produce a URL-shaped output regardless of whether a real URL was retrieved.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding on 'Q005 Probe' for Claude Opus 4.7 with web search ON Next finding → Finding on 'Q008 Probe' for Claude Opus 4.7 with web search ON
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Opus47
Plain text Download 
RegLeg Specialist Panel (2026). "Finding on 'Q007 Probe' for Claude Opus 4.7 with web search ON — AI Labs." Citation ID: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Opus47. RegLegBrief AI Hallucination Research, published 2026-06-04. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-api-harmonisation-cross-border-2024/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-API-HARMONISATION-CROSS-BORDER-2024-v1-007--opus-47-websearch/
APA 7th edition Download 
RegLeg Specialist Panel. (2026). Finding on 'Q007 Probe' for Claude Opus 4.7 with web search ON [Hallucination finding RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Opus47]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-api-harmonisation-cross-border-2024/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-API-HARMONISATION-CROSS-BORDER-2024-v1-007--opus-47-websearch/
Bluebook / OSCOLA (US + UK legal) Download 
RegLeg Specialist Panel, Finding on 'Q007 Probe' for Claude Opus 4.7 with web search ON [RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Opus47], RegLegBrief AI Hallucination Research (June 04, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-api-harmonisation-cross-border-2024/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-API-HARMONISATION-CROSS-BORDER-2024-v1-007--opus-47-websearch/.
BibTeX Download 
@misc{reglegbrief_RLB_H_INT_BIS_CPMI_API_HARMONISATION_CROSS_BORDER_2024_Q007_Opus47,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q007 Probe' for Claude Opus 4.7 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Opus47},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-api-harmonisation-cross-border-2024/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-API-HARMONISATION-CROSS-BORDER-2024-v1-007--opus-47-websearch/}
}
← Back to case study summary Case study detail →
About Citation IDs →