Methodology

How we measure concentration

The Correlation Index combines two distinct mechanisms: a map of public relationships between financial institutions and foundation model vendors, and an empirical correlation test between models on risk-decision scenarios. Here's what's measured, how, and with what limitations.

01

Mechanism 1 β€” Dependency mapping

For each tracked institution, we document its public relationships with foundation model vendors (OpenAI, Anthropic, Google, Microsoft, others), then group these relationships by model family rather than by the vendor's commercial name.

The reason: Microsoft very often resells and hosts OpenAI models via Azure OpenAI Service. Counting "Microsoft" as a vendor distinct from "OpenAI" would understate the true concentration. Each row of the data explorer therefore notes whether the cited vendor is simply hosting a model from another family.

02

Mechanism 2 β€” Empirical correlation test

We submit the same financial risk-decision scenarios (credit, trading, underwriting, fraud, counterparty), multiple times each, to several foundation models via their official APIs. We then compare the observed unanimous agreement rate between models to the rate expected under the hypothesis of statistical independence.

The logic mirrors the one used by the Stanford study on systemic rejection in algorithmic hiring (Bommasani et al., ACM FAccT '26): a gap between observed agreement and agreement expected by chance is the quantitative signal of cognitive monoculture. Per-scenario detail is on the Correlation Test page.

Simulator

Chance baseline: what does independence look like?

The same formula used by analyze_results.py: if N models each chose, independently, a response uniformly at random among K options, what's the probability they all agree?

11.11%chance of unanimous agreement if the 3 models decided at random, independently, among 3 options.

Formula: (1 / K)^Nβˆ’1. The larger N or K get, the more an observed unanimous agreement becomes a strong correlation signal rather than coincidence β€” see the real results.

03

Confidence levels

Each documented vendor relationship is classified by the quality of its source:

  • ConfirmedPrimary source β€” official vendor or institution announcement, published case study, public statement from an executive, or regulatory filing.
  • ProbableReliable secondary source β€” specialized press citing internal sources, a job posting explicitly naming the tool.
  • UnverifiedMention found but not corroborated by a second source β€” excluded from aggregate statistics until confirmed.

Before any finding earns a tier, it has to clear a lower bar: is this a vendor relationship at all? Three patterns get excluded outright, regardless of how good the source is: an institution merely investing in a model lab (capital exposure, not usage); an official case study about cloud infrastructure that never names a specific AI product; and language that's exploratory or non-committal ("exploring," "considering") rather than a deployed product, a signed partnership, or an executive on record about something already running.

04

What the index does NOT measure

An institution citing several vendors (Raymond James Financial, for instance, confirmed on three distinct families) isn't necessarily protected: the index measures concentration at the sector level, not just the individual institution. The number that matters isn't "how many vendors does a bank use", but "how many distinct model families exist across the whole sample, and what share of institutions depends on at least one of the top two or three".

The index also does not measure a model's quality, security, or performance β€” only the concentration of dependency.

05

Authorized sources

Public, lawful sources only: press releases, vendor "customer" pages (OpenAI, Anthropic, Google Cloud, Microsoft, Mistral AI), specialized press (American Banker, Fortune, Bank Info Security, CB Insights…), regulatory filings (10-K, 10-Q on SEC EDGAR), public job postings, public statements from executives. No internal data, no scraping of private systems, no information obtained through an unauthorized third party. See the full bibliography on Sources.

06

Honest limitations

Pilot sample. This pilot keeps growing with each research pass β€” see the current institution count on the data page β€” but it remains a sourced sample assembled through targeted searches, not an exhaustive census of every institution's AI vendor relationships worldwide. The empirical correlation test, separately, currently runs across ten decision scenarios: a methodological pilot, not definitive statistical proof. It will take several dozen scenarios per domain for a rigorously publishable result.

Raw models, not real systems. The correlation test queries foundation models via public API, not banks' real production systems β€” which often add fine-tuning, RAG on their own data, and additional guardrails. The result is a lower-bound estimate of the true correlation: production systems could converge even more, or somewhat less depending on the guardrails added.

Models change. Every result documents the date and exact name of the model tested β€” a 2026 result will be worthless to compare as-is once models are updated.

07

What's next

As the sample grows: weight by institution size (total assets) so the index reflects the share of the real economy exposed, not just the number of logos; consider a sub-score per line of business (payments, credit, trading, compliance) rather than a single score per institution, since some dependencies are more critical than others.

Methodology β€” The Correlation Index