AI Hallucination ResearchAudiencesPractitionersInternational / MultilateralLawyersDetail › Finding
Practitioners — Lawyers · updated 2026-06-04
Share / Print Twitter LinkedIn Email

Finding#4 — COP ABMT authority provision misattributed

RLB Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005
AI's failure:Misstated Rule Risk for Lawyers:Liability / PI exposure
What the RLB Specialist Panel found
Question (paraphrased to protect IP)

Can the BBNJ Agreement's Conference of the Parties declare a marine protected area in an international shipping lane in a way that restricts vessel transit rights?

RLB's analysis

The model located the non-undermining obligation in Article 8 when it appears in Article 22(2). The substantive content of the obligation was broadly correct, but incorrect article attribution is a material error for legal practitioners who need to cite treaty provisions precisely or who will build contractual or compliance frameworks around specific articles.

AI Head's analysis — what weakness in the AI model caused this

This finding implicates article-level provision mapping in the training data. The model correctly identified the obligation but misattributed it to Article 8 rather than Article 22(2). Structured extraction of article-by-article provision maps — rather than topical summaries — would prevent this class of error. It also reflects over-reliance on a secondary ABA source rather than the treaty text for the citation.

Cited source(s)
  • https://www.americanbar.org/groups/environment_energy_resources/resources/new... — Pretextual
Impact for Lawyers in international jurisdictions advising on the BBNJ High Seas Biodiversity Agreement

A lawyer advising on the legal limits of Conference of the Parties authority to designate marine protected areas in international shipping lanes — a question directly relevant to clients in shipping, energy, or marine infrastructure — received an answer anchored to the wrong article. The non-undermining principle applicable to COP decisions on area-based management tools is located in Article 22(2), the provision specifically governing those decisions; the AI cited Article 8, the general UNCLOS-relationship clause.

This misattribution would produce a legal opinion that fails to engage with the targeted provision and could misrepresent the scope of COP authority to a client assessing transit-right exposure.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding#3 — DSI benefit-sharing article misidentified
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#4 — COP ABMT authority provision misattributed [RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005], RegLegBrief AI Hallucination Research (June 04, 2026), https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/practitioners/lawyers/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-005/.
Plain text Download
RegLeg Specialist Panel (2026). "Finding#4 — COP ABMT authority provision misattributed — Practitioners — Lawyers." Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005. RegLegBrief AI Hallucination Research, published 2026-06-04. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/practitioners/lawyers/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-005/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#4 — COP ABMT authority provision misattributed [Hallucination finding RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/practitioners/lawyers/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-005/
BibTeX Download
@misc{reglegbrief_RLB_F_INT_UNTC_BBNJ_HIGH_SEAS_BIODIVERSITY_AGREEMENT_2023_Q005,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#4 — COP ABMT authority provision misattributed},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005},
  url       = {https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/practitioners/lawyers/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-005/}
}
← Back to case study summary Case study detail →