AI Hallucination ResearchAudiencesSectorsInternational / MultilateralBiotechnologyComplianceDetail › Finding
Biotechnology × Compliance — International / Multilateral · updated 2026-05-31
Share / Print Twitter LinkedIn Email

Finding#1 — Retroactivity default inverted — legacy collections wrongly in scope

RLB Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003
AI's failure:Exposed Fabrication Risk for Biotechnology × Compliance:Regulatory enforcement
What the RLB Specialist Panel found
For Claude Opus 4.7 (web search on)
Question (paraphrased to protect IP)

Does the BBNJ Agreement apply to samples of marine genetic resources collected from the high seas before the agreement entered into force?

RLB's analysis

The model stated the opposite of the Agreement's default rule. The Agreement is prospective by design — it covers only post-entry-into-force collections — but the model described a retroactive regime with an opt-out, which inverts both the default and the opt-out structure. This appears to reflect the model reconstructing from commentary on earlier drafts of the text, where the retroactivity question was actively contested, rather than reading the final adopted provision.

AI Head's analysis — what weakness in the AI model caused this

This finding implicates the training data layer: the model appears to have learned the retroactivity rule from pre-adoption negotiating commentary that described an earlier draft rather than the final adopted text. The retrieval step did not correct this because the cited secondary source itself may contain the same error. Both training corpus curation and retrieval-source ranking need to weight post-adoption primary text over pre-adoption commentary for recently adopted instruments.

Cited source(s)
  • https://www.globalpolicywatch.com/2026/03/navigating-the-new-un-high-seas-tre... — Pretextual
For Claude Sonnet 4.6 (web search on)
Question (paraphrased to protect IP)

Does the BBNJ Agreement apply to marine genetic resources collected before the agreement entered into force, or does it operate prospectively only?

RLB's analysis

The model inverted the Agreement's default rule and also inverted the opt-out structure. The Agreement is prospective by default, with parties able to declare retroactive application if they choose. The model described the opposite: retroactive as default, with an opt-out. This is the same fundamental error observed in Claude Opus 4.7 with web search on the same question, which strongly suggests both models are drawing on commentary describing an earlier draft regime rather than the final adopted text.

AI Head's analysis — what weakness in the AI model caused this

This finding, alongside the Opus 4.7 retroactivity finding, strongly suggests a shared training-data origin: both models inverted the same rule in the same direction. The implication for your team is that the error is not a model-specific calibration problem — it is a corpus-level issue that will persist across model versions until the training data for this instrument is corrected. Targeted correction pairs anchored to the final adopted Article 10(1) text are likely the most efficient fix.

Cited source(s)
  • https://www.insideeulifesciences.com/2026/03/03/navigating-the-new-un-high-se... — Pretextual
Impact for Compliance Teams in Biotechnology Sector in international jurisdictions working with the BBNJ High Seas Biodiversity Agreement

A compliance team relying on this AI response would conclude that the firm's existing collections of high-seas marine genetic resources — obtained before the Agreement entered into force — are presumptively subject to benefit-sharing obligations, with the firm bearing the burden of invoking a written exception to escape them. This is the opposite of the Agreement's actual position.

The firm could initiate costly and unnecessary remediation of legacy collections, impose unwarranted obligations on ongoing research programmes, or misstate its legal position in due diligence disclosures, licensing negotiations, or regulatory filings — any of which could attract scrutiny from national implementing authorities or treaty-body monitoring mechanisms.

References — raw findings (per AI model)
This finding also affects
Next finding → Finding#2 — DSI benefit-sharing article number fabricated
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003
Plain text Download
RegLeg Specialist Panel (2026). "Finding#1 — Retroactivity default inverted — legacy collections wrongly in scope — Biotechnology × Compliance — International / Multilateral." Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003. RegLegBrief AI Hallucination Research, published 2026-05-31. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/sectors/biotechnology/compliance/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#1 — Retroactivity default inverted — legacy collections wrongly in scope [Hallucination finding RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/sectors/biotechnology/compliance/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#1 — Retroactivity default inverted — legacy collections wrongly in scope [RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003], RegLegBrief AI Hallucination Research (May 31, 2026), https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/sectors/biotechnology/compliance/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/.
BibTeX Download
@misc{reglegbrief_RLB_F_INT_UNTC_BBNJ_HIGH_SEAS_BIODIVERSITY_AGREEMENT_2023_Q003,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#1 — Retroactivity default inverted — legacy collections wrongly in scope},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003},
  url       = {https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/sectors/biotechnology/compliance/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/}
}
← Back to case study summary Case study detail →