AI Hallucination ResearchAudiencesSectorsUnited StatesInvestment BankingComplianceDetail › Finding
Investment Banking × Compliance — United States · updated 2026-06-04
Share / Print Twitter LinkedIn Email

Finding#1 — Tiered concentration limits for large government MMFs and Treasury ETFs

RLB Citation ID: RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001
AI's failure:Exposed Fabrication Risk for Investment Banking × Compliance:Regulatory enforcement
What the RLB Specialist Panel found
For Claude Opus 4.7 (web search on)
Question (paraphrased to protect IP)

What are the updated concentration limits that apply to government money market funds and Treasury ETFs under the 2024 Regulation 1.25 amendments, including any tiered or size-based thresholds based on fund and management company asset sizes?

RLB's analysis

The model answered as if the final rule preserved the uniform-threshold structure of prior Regulation 1.25 and rejected size-based differentiation — a description that fits early-stage rulemaking commentary but not the final amended text. The rule introduces an explicit two-condition tier keyed to fund AUM and management company AUM; the model's response overwrites this with a generalised prior-version schema and presents the overwrite as a confirmed regulatory outcome.

AI Head's analysis — what weakness in the AI model caused this

This finding implicates the training corpus's representation of the final rule text relative to pre-final secondary commentary. The model asserted that the final rule rejected size-based tiering — a claim that reflects early rulemaking commentary, not the published final rule. The retrieval pipeline failed to surface the primary rule text at sufficient specificity to override the trained-schema prior, suggesting the Federal Register notice is underweighted relative to secondary sources in retrieval ranking for this query type.

For Claude Sonnet 4.6 (web search on)
Question (paraphrased to protect IP)

A Chief Risk Officer preparing an FCM investment policy statement asked for the updated concentration limits applying to government money market funds and Treasury ETFs under the 2024 Regulation 1.25 amendments, including any size-based or tiered thresholds.

RLB's analysis

The model explicitly denied the existence of a size-based tier while simultaneously using tier-like vocabulary in its own response structure ("Tier 1 — Per Instrument"), an internal contradiction that suggests the model assembled its answer from schema rather than retrieved rule text. The rule's tier is conditioned on fund AUM and management-company AUM — not FCM total assets — which may explain the mismatch: the model appears to have pattern-matched on "size-based tier" as an FCM-size question and answered on that basis, missing the fund-and-manager-side conditions the rule actually imposes.

AI Head's analysis — what weakness in the AI model caused this

The convergence with Claude Opus 4.7 on the same concentration-tier question makes this finding structurally significant: two different model architectures, same configuration, same wrong schema, same explicit denial of the tier's existence. The internal contradiction in the response — denying a size-based tier while using tier-like vocabulary — suggests the model assembled its answer from a regulatory schema template rather than retrieved primary text. This points to a retrieval-ranking issue shared across model families: the Federal Register final rule text is not being surfaced at sufficient authority weight to override the trained prior on this query.

Impact for Compliance Teams in Investment Banking Sector in the United States working with the Amendments to Regulation 1.25 — Permissible Investments of Customer Funds by Futures Commission Merchants and Derivatives Clearing Organizations

AI tools asserted a flat, uniform 10% per-fund concentration limit and denied that any size-based tier exists — missing the 50% ceiling that applies when a government money market fund holds ≥$1B in assets and its management company manages ≥$25B. A Compliance team that drafts or reviews the firm's investment policy for customer segregated funds using this AI output will produce a policy that misrepresents the permissible concentration structure, potentially misclassifying compliant large-fund positions as violations or, conversely, failing to apply the 50% ceiling correctly.

If the policy survives internal legal review — plausible if no one does a Federal Register primary-source check — the firm's segregated fund portfolio may be managed against a limit that does not match the CFTC rule, creating direct examination exposure under Regulation 1.25(b)(5).

References — raw findings (per AI model)
This finding also affects
Next finding → Finding#2 — Dollar-weighted average maturity exclusion clause
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001
Plain text Download
RegLeg Specialist Panel (2026). "Finding#1 — Tiered concentration limits for large government MMFs and Treasury ETFs — Investment Banking × Compliance — United States." Citation ID: RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001. RegLegBrief AI Hallucination Research, published 2026-06-04. https://reglegbrief.com/regulators/j3/us/cftc/fcm-dco-customer-funds-investments-reg-1-25-2024/sectors/investment_banking/compliance/finding/US-CFTC-US-001-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-v1-001/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#1 — Tiered concentration limits for large government MMFs and Treasury ETFs [Hallucination finding RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j3/us/cftc/fcm-dco-customer-funds-investments-reg-1-25-2024/sectors/investment_banking/compliance/finding/US-CFTC-US-001-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-v1-001/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#1 — Tiered concentration limits for large government MMFs and Treasury ETFs [RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001], RegLegBrief AI Hallucination Research (June 04, 2026), https://reglegbrief.com/regulators/j3/us/cftc/fcm-dco-customer-funds-investments-reg-1-25-2024/sectors/investment_banking/compliance/finding/US-CFTC-US-001-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-v1-001/.
BibTeX Download
@misc{reglegbrief_RLB_F_US_CFTC_FCM_DCO_CUSTOMER_FUNDS_INVESTMENTS_REG_1_25_2024_Q001,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#1 — Tiered concentration limits for large government MMFs and Treasury ETFs},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001},
  url       = {https://reglegbrief.com/regulators/j3/us/cftc/fcm-dco-customer-funds-investments-reg-1-25-2024/sectors/investment_banking/compliance/finding/US-CFTC-US-001-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-v1-001/}
}
← Back to case study summary Case study detail →