Every Correction Trains Their Moat

Microsoft CEO Satya Nadella's July 12 essay flips Nobel economist Kenneth Arrow's Information Paradox: in the AI age, the buyer risks giving away proprietary know-how just to use what they bought — paying for intelligence twice while model makers claim fair use on public crawls yet lock down distillation and reserve rights to learn from every customer correction.

Why this landed now:

• Nadella published "The Reverse Information Paradox" on X on July 12, escalating a June warning that frontier models could "eat everything they see"
• Enterprise buyers are reining in "tokenmaxxing" as usage-based pricing replaces flat subscriptions — token prices fall, task bills rise
• OpenAI and Anthropic are both racing toward public listings analysts peg near $1 trillion

The paradox Nadella named:

• Arrow's original theory: sellers risk revealing knowledge to make a sale
• Nadella's flip: "In the AI age, the buyer risks giving away knowledge, just in order to use what they bought"
• His line: "You essentially pay for intelligence twice, once with money, and again with something even more valuable: the proprietary knowledge you must reveal to make that intelligence useful"
• "The better you want the model to perform, the more of that knowledge you have to feed it"

What leaks upstream:

• Every prompt, agent trace, correction, and eval becomes what Nadella calls "intelligence exhaust"
• "Every correction is distilled into institutional know-how. It's the kind of knowledge a competitor could never buy, and the kind that leaks almost imperceptibly: trace by trace, correction by correction, eval by eval"
• Cloud-era asset = stored data. AI-era asset = accumulated learning
• Nadella quoted Palantir CEO Alex Karp: enterprises want control over infrastructure, models, data stack, and competitive advantage — not to watch those assets flow elsewhere

The distillation double standard:

• Nadella: fair use to train on public data is "needed" — then labs "impose restrictive terms on distillation, and reserve the right to learn from customer usage and interaction data"
• Business Insider tied the swipe to Anthropic CEO Dario Amodei's complaints about Chinese model makers distilling Claude
• Anthropic told Sens. Tim Scott and Elizabeth Warren on June 10 that Alibaba-affiliated operators ran 28.8 million exchanges through roughly 25,000 fraudulent Claude accounts between April 22 and June 5 — "the largest known distillation attack" to date
• Musk attacked Anthropic's data practices on X in February amid the same distillation fight, per Business Insider's reporting on Nadella's post

Nadella's five-part prescription:

• Control — own evals, memory, traces, feedback, and institutional context
• Capability — private learning environments inside the tenant boundary
• Choice — decouple orchestration from any single model vendor
• Cost — route tasks to the cheapest capable model without quality loss
• Compound — build your own continuous learning loop that keeps value inside the firm

Why buyers should care:

• Nadella: "If learning flows in only one direction, economic value converges toward the owners of the learning infrastructure rather than the creators of the knowledge itself"
• Enterprises that outsourced their learning loop to a single API are discovering the second invoice has no line item
• The prescription aligns with Microsoft's pitch — Copilot model choice, private Azure stacks — but the economic diagnosis holds even if the vendor is self-interested

Convina's view: Nadella is selling Azure while stating a real asymmetry. Frontier labs built on public crawls and customer exhaust cannot credibly demand one-way learning forever — not while Anthropic lobbies Congress over Chinese distillation and reserves the right to distill from your corrections. The enterprise buyer who optimizes for model quality without owning the eval stack is funding someone else's moat. Token budgets are visible. Institutional know-how is not — until a competitor ships your workflow back at you.