AI Hallucination ResearchAudiencesSectorsInternational / MultilateralPharmaceuticalsLegalDetail › Finding
Pharmaceuticals × Legal — International / Multilateral · updated 2026-05-31
Share / Print Twitter LinkedIn Email

Finding#1 — Retroactivity of MGR benefit-sharing obligations

RLB Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003
AI's failure:Exposed Fabrication Risk for Pharmaceuticals × Legal:Wrong deliverable
What the RLB Specialist Panel found
For Claude Opus 4.7 (web search on)
Question (paraphrased to protect IP)

Does the BBNJ Agreement apply to samples of marine genetic resources collected from the high seas before the agreement entered into force?

RLB's analysis

The model stated the opposite of the Agreement's default rule. The Agreement is prospective by design — it covers only post-entry-into-force collections — but the model described a retroactive regime with an opt-out, which inverts both the default and the opt-out structure. This appears to reflect the model reconstructing from commentary on earlier drafts of the text, where the retroactivity question was actively contested, rather than reading the final adopted provision.

AI Head's analysis — what weakness in the AI model caused this

This finding implicates the training data layer: the model appears to have learned the retroactivity rule from pre-adoption negotiating commentary that described an earlier draft rather than the final adopted text. The retrieval step did not correct this because the cited secondary source itself may contain the same error. Both training corpus curation and retrieval-source ranking need to weight post-adoption primary text over pre-adoption commentary for recently adopted instruments.

Cited source(s)
  • https://www.globalpolicywatch.com/2026/03/navigating-the-new-un-high-seas-tre... — Pretextual
For Claude Sonnet 4.6 (web search on)
Question (paraphrased to protect IP)

Does the BBNJ Agreement apply to marine genetic resources collected before the agreement entered into force, or does it operate prospectively only?

RLB's analysis

The model inverted the Agreement's default rule and also inverted the opt-out structure. The Agreement is prospective by default, with parties able to declare retroactive application if they choose. The model described the opposite: retroactive as default, with an opt-out. This is the same fundamental error observed in Claude Opus 4.7 with web search on the same question, which strongly suggests both models are drawing on commentary describing an earlier draft regime rather than the final adopted text.

AI Head's analysis — what weakness in the AI model caused this

This finding, alongside the Opus 4.7 retroactivity finding, strongly suggests a shared training-data origin: both models inverted the same rule in the same direction. The implication for your team is that the error is not a model-specific calibration problem — it is a corpus-level issue that will persist across model versions until the training data for this instrument is corrected. Targeted correction pairs anchored to the final adopted Article 10(1) text are likely the most efficient fix.

Cited source(s)
  • https://www.insideeulifesciences.com/2026/03/03/navigating-the-new-un-high-se... — Pretextual
Impact for Legal Teams in Pharmaceuticals Sector in international jurisdictions working with the BBNJ High Seas Biodiversity Agreement

AI tools tested on this question inverted the treaty's non-retroactivity rule, asserting that marine genetic resource benefit-sharing obligations apply by default to collections made before the agreement's entry into force — the opposite of what Article 10(1) states. For a Legal team advising a Pharmaceuticals firm on legacy biobank holdings or existing data licences covering high-seas material, this error directly determines whether a substantial portfolio of pre-agreement assets is treated as subject to new financial and reporting obligations.

A firm that relies on this incorrect advice may undertake unnecessary benefit-sharing negotiations and restructure supplier contracts at significant cost; conversely, if the firm later discovers the error and seeks correction, it faces remediation spend, reputational risk with treaty-body counterparties, and potential contractual disputes with partners who contracted on the basis of the misdirected legal advice. The UN Treaty Collection is the authoritative source for the treaty text; national implementing legislation, once enacted, will further define enforcement exposure.

References — raw findings (per AI model)
This finding also affects
Next finding → Finding#2 — DSI benefit-sharing article citation
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003
Plain text Download
RegLeg Specialist Panel (2026). "Finding#1 — Retroactivity of MGR benefit-sharing obligations — Pharmaceuticals × Legal — International / Multilateral." Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003. RegLegBrief AI Hallucination Research, published 2026-05-31. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/sectors/pharmaceuticals/legal/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#1 — Retroactivity of MGR benefit-sharing obligations [Hallucination finding RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/sectors/pharmaceuticals/legal/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#1 — Retroactivity of MGR benefit-sharing obligations [RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003], RegLegBrief AI Hallucination Research (May 31, 2026), https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/sectors/pharmaceuticals/legal/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/.
BibTeX Download
@misc{reglegbrief_RLB_F_INT_UNTC_BBNJ_HIGH_SEAS_BIODIVERSITY_AGREEMENT_2023_Q003,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#1 — Retroactivity of MGR benefit-sharing obligations},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003},
  url       = {https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/sectors/pharmaceuticals/legal/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/}
}
← Back to case study summary Case study detail →