AI Hallucination ResearchAudiencesPractitionersUnited StatesLawyersDetail › Finding
Practitioners — Lawyers · updated 2026-06-04
Share / Print Twitter LinkedIn Email

Finding#2 — Weekly reporting obligation: inversion of 3-month sunset rule

RLB Citation ID: RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006
AI's failure:Exposed Fabrication Risk for Lawyers:Liability / PI exposure
What the RLB Specialist Panel found
For Claude Opus 4.7 (web search on)
Question (paraphrased to protect IP)

An FCM that began accepting bitcoin, ether, and USDC as customer margin collateral in January 2026 under the CFTC digital asset pilot program wants to know what changes at the end of the initial three-month onboarding phase — specifically which obligations cease and which continue, and whether the weekly digital asset holdings reporting requirement and incident-reporting condition sunset or persist beyond the initial phase.

RLB's analysis

The model correctly identified that some initial-phase conditions sunset but incorrectly extended the sunset to the weekly reporting requirement, which the regulator explicitly preserved as a continuing obligation. The failure pattern is consistent with structural inference from the phased framework — the model appears to have generalised "initial-phase conditions" to cover all cadence-based requirements, rather than reading the regulator's specific enumeration of what does and does not lapse.

AI Head's analysis — what weakness in the AI model caused this

This finding implicates the model's handling of phased obligation structures where partial sunset language is present. The model correctly identified some sunset conditions but over-generalised the sunset to a continuing obligation — a pattern that suggests the training-data representation of this instrument came primarily from third-party summaries that flatten the obligation lifecycle rather than from the regulator's specific enumeration. Web search was active and did not correct the error, indicating the retrieval stack did not surface the primary text's carve-out language.

For Claude Sonnet 4.6 (web search on)
Question (paraphrased to protect IP)

An FCM began accepting bitcoin, ether, and USDC as customer margin collateral in January 2026 under the CFTC's digital asset pilot. At the end of the initial three-month phase, does the weekly obligation to report total digital asset holdings in each customer account class cease or continue, and which other initial-phase conditions do sunset at that point?

RLB's analysis

The model fabricated a source — "March 2026 CFTC Staff FAQs" — to support an answer that is directly contradicted by the regulator's text, and presented the termination as a precisely-worded procedural rule. This is the more severe failure form: not merely an inference from the instrument's structure, but a confabulated authority cited to give the wrong answer the appearance of documentary grounding.

AI Head's analysis — what weakness in the AI model caused this

This is the most severe finding in this paper: the model fabricated a specific source document — 'March 2026 CFTC Staff FAQs' — to support an answer directly contradicted by the regulator's text, and presented the termination as a precisely-worded procedural rule. This implicates the calibration signal for named-source citations: the model committed to a document title and date without apparent retrieval basis rather than flagging uncertainty. It also implicates the training-data representation of the amendment cycle — the model's confident wrong answer suggests it is reconstructing from a plausible structural template, not retrieving the governing text.

Impact for Lawyers in the United States advising on the CFTC Digital Asset Collateral No-Action Relief and Tokenized Asset Staff Guidance (Market Participants Division, December 2025)

AI tools tested on this question directly inverted the operative rule: they stated that weekly digital asset holdings reporting ceases at the end of the three-month onboarding phase when the staff letter states the opposite. A compliance memo based on that output would cause an FCM to stop filing required weekly reports, creating an ongoing CFTC reporting violation from the moment the programme enters its post-onboarding phase.

For the lawyer who delivered the advice, the PI exposure is compounded by the fact that the AI's framing — that the weekly cadence was conditioned on the initial phase — is structurally plausible and would survive a fast internal review without a line-by-line check against the staff letter's enumerated conditions.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding#1 — Payment stablecoin eligibility: missing OCC 1183 cross-reference Next finding → Finding#3 — Multi-DCO haircut tiebreaker: highest-accepted-rate rule omitted
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#2 — Weekly reporting obligation: inversion of 3-month sunset rule [RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006], RegLegBrief AI Hallucination Research (June 04, 2026), https://reglegbrief.com/regulators/j3/us/cftc/digital-asset-collateral-tokenized-assets-staff-guidance-2025/practitioners/lawyers/finding/US-CFTC-US-001-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-v1-006/.
Plain text Download
RegLeg Specialist Panel (2026). "Finding#2 — Weekly reporting obligation: inversion of 3-month sunset rule — Practitioners — Lawyers." Citation ID: RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006. RegLegBrief AI Hallucination Research, published 2026-06-04. https://reglegbrief.com/regulators/j3/us/cftc/digital-asset-collateral-tokenized-assets-staff-guidance-2025/practitioners/lawyers/finding/US-CFTC-US-001-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-v1-006/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#2 — Weekly reporting obligation: inversion of 3-month sunset rule [Hallucination finding RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j3/us/cftc/digital-asset-collateral-tokenized-assets-staff-guidance-2025/practitioners/lawyers/finding/US-CFTC-US-001-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-v1-006/
BibTeX Download
@misc{reglegbrief_RLB_F_US_CFTC_DIGITAL_ASSET_COLLATERAL_TOKENIZED_ASSETS_STAFF_GUIDANCE_2025_Q006,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#2 — Weekly reporting obligation: inversion of 3-month sunset rule},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006},
  url       = {https://reglegbrief.com/regulators/j3/us/cftc/digital-asset-collateral-tokenized-assets-staff-guidance-2025/practitioners/lawyers/finding/US-CFTC-US-001-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-v1-006/}
}
← Back to case study summary Case study detail →