AI Hallucination ResearchAudiencesPractitionersUnited StatesStockbrokers / Trading RepsDetail › Finding
Practitioners — Stockbrokers / Trading Reps · updated 2026-06-03
Share / Print Twitter LinkedIn Email

Finding#2 — Weekly reporting obligation inverted at phase transition

RLB Citation ID: RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006
AI's failure:Exposed Fabrication Risk for Stockbrokers / Trading Reps:Regulatory enforcement
What the RLB Specialist Panel found
For Claude Opus 4.7 (web search on)
Question (paraphrased to protect IP)

An FCM that began accepting bitcoin, ether, and USDC as customer margin collateral in January 2026 under the CFTC digital asset pilot program wants to know what changes at the end of the initial three-month onboarding phase — specifically which obligations cease and which continue, and whether the weekly digital asset holdings reporting requirement and incident-reporting condition sunset or persist beyond the initial phase.

RLB's analysis

The model correctly identified that some initial-phase conditions sunset but incorrectly extended the sunset to the weekly reporting requirement, which the regulator explicitly preserved as a continuing obligation. The failure pattern is consistent with structural inference from the phased framework — the model appears to have generalised "initial-phase conditions" to cover all cadence-based requirements, rather than reading the regulator's specific enumeration of what does and does not lapse.

AI Head's analysis — what weakness in the AI model caused this

This finding implicates the model's handling of phased obligation structures where partial sunset language is present. The model correctly identified some sunset conditions but over-generalised the sunset to a continuing obligation — a pattern that suggests the training-data representation of this instrument came primarily from third-party summaries that flatten the obligation lifecycle rather than from the regulator's specific enumeration. Web search was active and did not correct the error, indicating the retrieval stack did not surface the primary text's carve-out language.

For Claude Sonnet 4.6 (web search on)
Question (paraphrased to protect IP)

An FCM began accepting bitcoin, ether, and USDC as customer margin collateral in January 2026 under the CFTC's digital asset pilot. At the end of the initial three-month phase, does the weekly obligation to report total digital asset holdings in each customer account class cease or continue, and which other initial-phase conditions do sunset at that point?

RLB's analysis

The model fabricated a source — "March 2026 CFTC Staff FAQs" — to support an answer that is directly contradicted by the regulator's text, and presented the termination as a precisely-worded procedural rule. This is the more severe failure form: not merely an inference from the instrument's structure, but a confabulated authority cited to give the wrong answer the appearance of documentary grounding.

AI Head's analysis — what weakness in the AI model caused this

This is the most severe finding in this paper: the model fabricated a specific source document — 'March 2026 CFTC Staff FAQs' — to support an answer directly contradicted by the regulator's text, and presented the termination as a precisely-worded procedural rule. This implicates the calibration signal for named-source citations: the model committed to a document title and date without apparent retrieval basis rather than flagging uncertainty. It also implicates the training-data representation of the amendment cycle — the model's confident wrong answer suggests it is reconstructing from a plausible structural template, not retrieving the governing text.

Impact for Stockbrokers / Trading Reps in the United States advising on the CFTC Digital Asset Collateral No-Action Relief and Tokenized Asset Staff Guidance (Market Participants Division, December 2025)

This is the highest-consequence finding in the set for day-to-day practice: AI tools confidently inverted both material conditions in the pilot's phase transition, stating that weekly digital asset reporting ceases after three months and that incident-reporting continues — the exact opposite of what the letter says. An FCM that structures its compliance calendar around an AI-generated transition memo and drops the weekly reporting obligation at month three is running an ongoing reporting gap with no paper trail showing it was an intentional decision.

When the error is challenged, AI admitted it conflated the enumerated conditions rather than reading them individually — a failure mode that a practitioner who trusted the first answer never had reason to probe.

References — raw findings (per AI model)
This finding also affects
← Previous finding Finding#1 — OCC cross-reference omitted from stablecoin eligibility Next finding → Finding#3 — Multi-DCO haircut hierarchy collapsed to 20% floor
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006
Plain text Download
RegLeg Specialist Panel (2026). "Finding#2 — Weekly reporting obligation inverted at phase transition — Practitioners — Stockbrokers / Trading Reps." Citation ID: RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006. RegLegBrief AI Hallucination Research, published 2026-06-03. https://reglegbrief.com/regulators/j3/us/cftc/digital-asset-collateral-tokenized-assets-staff-guidance-2025/practitioners/stockbrokers-trading-reps/finding/US-CFTC-US-001-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-v1-006/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#2 — Weekly reporting obligation inverted at phase transition [Hallucination finding RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j3/us/cftc/digital-asset-collateral-tokenized-assets-staff-guidance-2025/practitioners/stockbrokers-trading-reps/finding/US-CFTC-US-001-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-v1-006/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#2 — Weekly reporting obligation inverted at phase transition [RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006], RegLegBrief AI Hallucination Research (June 03, 2026), https://reglegbrief.com/regulators/j3/us/cftc/digital-asset-collateral-tokenized-assets-staff-guidance-2025/practitioners/stockbrokers-trading-reps/finding/US-CFTC-US-001-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-v1-006/.
BibTeX Download
@misc{reglegbrief_RLB_F_US_CFTC_DIGITAL_ASSET_COLLATERAL_TOKENIZED_ASSETS_STAFF_GUIDANCE_2025_Q006,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#2 — Weekly reporting obligation inverted at phase transition},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-US-CFTC-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-Q006},
  url       = {https://reglegbrief.com/regulators/j3/us/cftc/digital-asset-collateral-tokenized-assets-staff-guidance-2025/practitioners/stockbrokers-trading-reps/finding/US-CFTC-US-001-DIGITAL-ASSET-COLLATERAL-TOKENIZED-ASSETS-STAFF-GUIDANCE-2025-v1-006/}
}
← Back to case study summary Case study detail →