Methodology
How we measure concentration
The Correlation Index combines two distinct mechanisms: a map of public relationships between financial institutions and foundation model vendors, and an empirical correlation test between models on risk-decision scenarios. Here's what's measured, how, and with what limitations.
01
Mechanism 1 β Dependency mapping
For each tracked institution, we document its public relationships with foundation model vendors (OpenAI, Anthropic, Google, Microsoft, others), then group these relationships by model family rather than by the vendor's commercial name.
The reason: Microsoft very often resells and hosts OpenAI models via Azure OpenAI Service. Counting "Microsoft" as a vendor distinct from "OpenAI" would understate the true concentration. Each row of the data explorer therefore notes whether the cited vendor is simply hosting a model from another family.
02
Mechanism 2 β Empirical correlation test
We submit the same financial risk-decision scenarios (credit, trading, underwriting, fraud, counterparty), multiple times each, to several foundation models via their official APIs. We then compare the observed unanimous agreement rate between models to the rate expected under the hypothesis of statistical independence.
The logic mirrors the one used by the Stanford study on systemic rejection in algorithmic hiring (Bommasani et al., ACM FAccT '26): a gap between observed agreement and agreement expected by chance is the quantitative signal of cognitive monoculture. Per-scenario detail is on the Correlation Test page.
Simulator
Chance baseline: what does independence look like?
The same formula used by analyze_results.py: if N models each chose, independently, a response uniformly at random among K options, what's the probability they all agree?
Formula: (1 / K)^Nβ1. The larger N or K get, the more an observed unanimous agreement becomes a strong correlation signal rather than coincidence β see the real results.
03
Confidence levels
Each documented vendor relationship is classified by the quality of its source:
- ConfirmedPrimary source β official vendor or institution announcement, published case study, public statement from an executive, or regulatory filing.
- ProbableReliable secondary source β specialized press citing internal sources, a job posting explicitly naming the tool.
- UnverifiedMention found but not corroborated by a second source β excluded from aggregate statistics until confirmed.
Before any finding earns a tier, it has to clear a lower bar: is this a vendor relationship at all? Three patterns get excluded outright, regardless of how good the source is: an institution merely investing in a model lab (capital exposure, not usage); an official case study about cloud infrastructure that never names a specific AI product; and language that's exploratory or non-committal ("exploring," "considering") rather than a deployed product, a signed partnership, or an executive on record about something already running.
04
What the index does NOT measure
An institution citing several vendors (Raymond James Financial, for instance, confirmed on three distinct families) isn't necessarily protected: the index measures concentration at the sector level, not just the individual institution. The number that matters isn't "how many vendors does a bank use", but "how many distinct model families exist across the whole sample, and what share of institutions depends on at least one of the top two or three".
The index also does not measure a model's quality, security, or performance β only the concentration of dependency.
05
Authorized sources
Public, lawful sources only: press releases, vendor "customer" pages (OpenAI, Anthropic, Google Cloud, Microsoft, Mistral AI), specialized press (American Banker, Fortune, Bank Info Security, CB Insightsβ¦), regulatory filings (10-K, 10-Q on SEC EDGAR), public job postings, public statements from executives. No internal data, no scraping of private systems, no information obtained through an unauthorized third party. See the full bibliography on Sources.
06
Honest limitations
Pilot sample. This pilot keeps growing with each research pass β see the current institution count on the data page β but it remains a sourced sample assembled through targeted searches, not an exhaustive census of every institution's AI vendor relationships worldwide. The empirical correlation test, separately, currently runs across ten decision scenarios: a methodological pilot, not definitive statistical proof. It will take several dozen scenarios per domain for a rigorously publishable result.
Raw models, not real systems. The correlation test queries foundation models via public API, not banks' real production systems β which often add fine-tuning, RAG on their own data, and additional guardrails. The result is a lower-bound estimate of the true correlation: production systems could converge even more, or somewhat less depending on the guardrails added.
Models change. Every result documents the date and exact name of the model tested β a 2026 result will be worthless to compare as-is once models are updated.
07
What's next
As the sample grows: weight by institution size (total assets) so the index reflects the share of the real economy exposed, not just the number of logos; consider a sub-score per line of business (payments, credit, trading, compliance) rather than a single score per institution, since some dependencies are more critical than others.