AI Hallucination Research › Regulators › Global standard-setters › INT › UNTC › BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023 › White paper › Detail › Finding
AI Labs · updated 2026-05-31 · methodology v2.1

Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON

RLB Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47
What the RLB Specialist Panel found

Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON

  • Question (paraphrased to protect IP): Does the BBNJ Agreement apply to samples of marine genetic resources collected from the high seas before the agreement entered into force?
  • AI's response: "Article 10(1) extends the MGR/benefit-sharing rules to the utilization of marine genetic resources and digital sequence information of ABNJ collected or generated before the Agreement's entry into force, unless a Party makes a written exception"
  • Regulator's text: Article 10(1) provides that the MGR and digital sequence information provisions apply only to resources collected and generated after the entry into force of the Agreement for each Party.
  • Why the AI went wrong: The model stated the opposite of the Agreement's default rule. The Agreement is prospective by design — it covers only post-entry-into-force collections — but the model described a retroactive regime with an opt-out, which inverts both the default and the opt-out structure. This appears to reflect the model reconstructing from commentary on earlier drafts of the text, where the retroactivity question was actively contested, rather than reading the final adopted provision.
  • Cited source(s):
  • https://www.globalpolicywatch.com/2026/03/navigating-the-new-un-high-seas-tre... — Pretextual
Impact for this audience

This finding implicates the training data layer: the model appears to have learned the retroactivity rule from pre-adoption negotiating commentary that described an earlier draft rather than the final adopted text. The retrieval step did not correct this because the cited secondary source itself may contain the same error. Both training corpus curation and retrieval-source ranking need to weight post-adoption primary text over pre-adoption commentary for recently adopted instruments.

References — raw findings (per AI model)
This finding also affects
Next finding → Finding on 'Q005 Probe' for Claude Opus 4.7 with web search ON
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47
Plain text Download 
RegLeg Specialist Panel (2026). "Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON — AI Labs." Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47. RegLegBrief AI Hallucination Research, published 2026-05-31. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--opus-47-websearch/
APA 7th edition Download 
RegLeg Specialist Panel. (2026). Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON [Hallucination finding RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--opus-47-websearch/
Bluebook / OSCOLA (US + UK legal) Download 
RegLeg Specialist Panel, Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON [RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47], RegLegBrief AI Hallucination Research (May 31, 2026), https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--opus-47-websearch/.
BibTeX Download 
@misc{reglegbrief_RLB_H_INT_UNTC_BBNJ_HIGH_SEAS_BIODIVERSITY_AGREEMENT_2023_Q003_Opus47,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47},
  url       = {https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--opus-47-websearch/}
}
← Back to case study summary Case study detail →
About Citation IDs →