AI Hallucination ResearchAudiencesSectorsUnited StatesInvestment BankingRiskDetail › Finding
Investment Banking × Risk — United States · updated 2026-06-04
Share / Print Twitter LinkedIn Email

Finding#1 — Tiered concentration limits for government MMFs and Treasury ETFs

RLB Citation ID: RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001
AI's failure:Exposed Fabrication Risk for Investment Banking × Risk:Regulatory enforcement
What the RLB Specialist Panel found
For Claude Opus 4.7 (web search on)
Question (paraphrased to protect IP)

What are the updated concentration limits that apply to government money market funds and Treasury ETFs under the 2024 Regulation 1.25 amendments, including any tiered or size-based thresholds based on fund and management company asset sizes?

RLB's analysis

The model answered as if the final rule preserved the uniform-threshold structure of prior Regulation 1.25 and rejected size-based differentiation — a description that fits early-stage rulemaking commentary but not the final amended text. The rule introduces an explicit two-condition tier keyed to fund AUM and management company AUM; the model's response overwrites this with a generalised prior-version schema and presents the overwrite as a confirmed regulatory outcome.

AI Head's analysis — what weakness in the AI model caused this

This finding implicates the training corpus's representation of the final rule text relative to pre-final secondary commentary. The model asserted that the final rule rejected size-based tiering — a claim that reflects early rulemaking commentary, not the published final rule. The retrieval pipeline failed to surface the primary rule text at sufficient specificity to override the trained-schema prior, suggesting the Federal Register notice is underweighted relative to secondary sources in retrieval ranking for this query type.

For Claude Sonnet 4.6 (web search on)
Question (paraphrased to protect IP)

A Chief Risk Officer preparing an FCM investment policy statement asked for the updated concentration limits applying to government money market funds and Treasury ETFs under the 2024 Regulation 1.25 amendments, including any size-based or tiered thresholds.

RLB's analysis

The model explicitly denied the existence of a size-based tier while simultaneously using tier-like vocabulary in its own response structure ("Tier 1 — Per Instrument"), an internal contradiction that suggests the model assembled its answer from schema rather than retrieved rule text. The rule's tier is conditioned on fund AUM and management-company AUM — not FCM total assets — which may explain the mismatch: the model appears to have pattern-matched on "size-based tier" as an FCM-size question and answered on that basis, missing the fund-and-manager-side conditions the rule actually imposes.

AI Head's analysis — what weakness in the AI model caused this

The convergence with Claude Opus 4.7 on the same concentration-tier question makes this finding structurally significant: two different model architectures, same configuration, same wrong schema, same explicit denial of the tier's existence. The internal contradiction in the response — denying a size-based tier while using tier-like vocabulary — suggests the model assembled its answer from a regulatory schema template rather than retrieved primary text. This points to a retrieval-ranking issue shared across model families: the Federal Register final rule text is not being surfaced at sufficient authority weight to override the trained prior on this query.

Impact for Risk Teams in Investment Banking Sector in the United States working with the Amendments to Regulation 1.25 — Permissible Investments of Customer Funds by Futures Commission Merchants and Derivatives Clearing Organizations

AI tools tested on this question flatly asserted that concentration limits under the 2024 amendments apply uniformly — no size-based tier, flat 10% per-fund cap — and explicitly denied the rule establishes any differentiation based on fund or management company assets. The actual rule permits a 50% ceiling for government money market funds and qualified ETFs where the fund holds ≥$1B in assets and the management company manages ≥$25B, layered alongside the issuer-based caps.

A Risk team that codes this wrong limit into its segregated fund investment policy — or into the monitoring logic that flags concentration breaches — either unnecessarily constrains permissible investment flexibility for qualifying large funds, or applies the higher ceiling to funds that do not qualify, creating a direct Part 1.25 violation. The CFTC's examination of FCM segregation records routinely includes concentration limit verification, and a policy that cannot map cleanly to the tiered structure in the 2024 rule text will generate findings that are costly to remediate and difficult to characterise as inadvertent given the rule's specificity.

References — raw findings (per AI model)
This finding also affects
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001
Plain text Download
RegLeg Specialist Panel (2026). "Finding#1 — Tiered concentration limits for government MMFs and Treasury ETFs — Investment Banking × Risk — United States." Citation ID: RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001. RegLegBrief AI Hallucination Research, published 2026-06-04. https://reglegbrief.com/regulators/j3/us/cftc/fcm-dco-customer-funds-investments-reg-1-25-2024/sectors/investment_banking/risk/finding/US-CFTC-US-001-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-v1-001/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#1 — Tiered concentration limits for government MMFs and Treasury ETFs [Hallucination finding RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j3/us/cftc/fcm-dco-customer-funds-investments-reg-1-25-2024/sectors/investment_banking/risk/finding/US-CFTC-US-001-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-v1-001/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#1 — Tiered concentration limits for government MMFs and Treasury ETFs [RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001], RegLegBrief AI Hallucination Research (June 04, 2026), https://reglegbrief.com/regulators/j3/us/cftc/fcm-dco-customer-funds-investments-reg-1-25-2024/sectors/investment_banking/risk/finding/US-CFTC-US-001-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-v1-001/.
BibTeX Download
@misc{reglegbrief_RLB_F_US_CFTC_FCM_DCO_CUSTOMER_FUNDS_INVESTMENTS_REG_1_25_2024_Q001,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#1 — Tiered concentration limits for government MMFs and Treasury ETFs},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001},
  url       = {https://reglegbrief.com/regulators/j3/us/cftc/fcm-dco-customer-funds-investments-reg-1-25-2024/sectors/investment_banking/risk/finding/US-CFTC-US-001-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-v1-001/}
}
← Back to case study summary Case study detail →