AI Hallucination Research › Regulators › Global standard-setters › INT › UNTC › BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023 › White paper › Detail › Finding
AI Labs · updated 2026-05-31 · methodology v2.1

Finding on 'Q003 Probe' for Claude Sonnet 4.6 with web search ON

RLB Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Sonnet46
What the RLB Specialist Panel found

Finding on 'Q003 Probe' for Claude Sonnet 4.6 with web search ON

  • Question (paraphrased to protect IP): Does the BBNJ Agreement apply to marine genetic resources collected before the agreement entered into force, or does it operate prospectively only?
  • AI's response: "the benefit-sharing obligations apply to the utilisation of marine genetic resources...collected or generated from areas beyond national jurisdiction at any time before entry into force — not just after...a Party may opt out of this retroactive application"
  • Regulator's text: Article 10(1) states that the MGR and digital sequence information provisions apply only to resources collected and generated after the entry into force of the Agreement for each Party; most parties formally declared this non-retroactivity exception.
  • Why the AI went wrong: The model inverted the Agreement's default rule and also inverted the opt-out structure. The Agreement is prospective by default, with parties able to declare retroactive application if they choose. The model described the opposite: retroactive as default, with an opt-out. This is the same fundamental error observed in Claude Opus 4.7 with web search on the same question, which strongly suggests both models are drawing on commentary describing an earlier draft regime rather than the final adopted text.
  • Cited source(s):
  • https://www.insideeulifesciences.com/2026/03/03/navigating-the-new-un-high-se... — Pretextual
Impact for this audience

This finding, alongside the Opus 4.7 retroactivity finding, strongly suggests a shared training-data origin: both models inverted the same rule in the same direction. The implication for your team is that the error is not a model-specific calibration problem — it is a corpus-level issue that will persist across model versions until the training data for this instrument is corrected. Targeted correction pairs anchored to the final adopted Article 10(1) text are likely the most efficient fix.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding on 'Q002 Probe' for Claude Sonnet 4.6 with web search ON Next finding → Finding on 'Q004 Probe' for Claude Sonnet 4.6 with web search ON
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Sonnet46
Plain text Download 
RegLeg Specialist Panel (2026). "Finding on 'Q003 Probe' for Claude Sonnet 4.6 with web search ON — AI Labs." Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Sonnet46. RegLegBrief AI Hallucination Research, published 2026-05-31. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--sonnet-46-websearch/
APA 7th edition Download 
RegLeg Specialist Panel. (2026). Finding on 'Q003 Probe' for Claude Sonnet 4.6 with web search ON [Hallucination finding RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Sonnet46]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--sonnet-46-websearch/
Bluebook / OSCOLA (US + UK legal) Download 
RegLeg Specialist Panel, Finding on 'Q003 Probe' for Claude Sonnet 4.6 with web search ON [RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Sonnet46], RegLegBrief AI Hallucination Research (May 31, 2026), https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--sonnet-46-websearch/.
BibTeX Download 
@misc{reglegbrief_RLB_H_INT_UNTC_BBNJ_HIGH_SEAS_BIODIVERSITY_AGREEMENT_2023_Q003_Sonnet46,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q003 Probe' for Claude Sonnet 4.6 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Sonnet46},
  url       = {https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--sonnet-46-websearch/}
}
← Back to case study summary Case study detail →
About Citation IDs →