Dylan Patel — AI Infrastructure Stack Investment Thesis

Source: Dylan Patel on the infrastructure powering the AI revolution | The Next Big Thing, WisdomTree in Europe, July 8, 2026.

The Framework: Demand Flowthrough × Market Structure

Patel’s investable lens for every AI infrastructure layer: (1) how much of AI end-demand actually flows through to that product, and (2) whether pricing is commodity-elastic or partnership-stable. Memory lets spot/contract markets reprice violently; TSMC takes 5–10% and partners long-term; ASML equipment barely oscillates. Layer that on workload type — workflow AI (freeze quality → chase cheaper tokens) vs assistant AI (smartest model is often cheaper via fewer tokens/iterations).

Filter	What It Asks	Who Wins
Flowthrough	Doubling, +50%, or 4× end-market for this input?	Memory, networking content, power conversion
Market structure	Commodity spot vs oligopoly LTA vs monopoly?	Memory ASPs soar; foundry ASPs crawl
Workload split	Fixed workflow vs human-in-the-loop assistant?	Frontier labs for assistants; open/cheap models for mature workflows
Local vs secular	Catch-up mini-cycle or multi-year shortage?	CPUs = catch-up; memory = years; CPO = delayed

"What matters is how much flowthrough of demand is there actually… and how much is the pricing going to go up based on the market structure."

Investment Thesis #1: Memory Is a Multi-Year Shortage — Not a Classic 18–24 Month Cycle Top

The argument: Cycles still exist, but this is a supercycle: end-market spend has already doubled and will double again; memory pricing is up ~4× and Patel sees another 2–3×. Capacity grows only 20–30%/year for the next three years while demand doubles. Reasoning models (OpenAI o1, Dec 2024 SemiAnalysis note) exploded KV-cache memory intensity — weights stay constant as context scales, KV cache does not — making memory the biggest winner as chat gave way to long-horizon agents. Less-elastic buyers (smartphones, laptops) get priced out; Xiaomi mid/low shipments already −40%; high-end not hit yet, but next-year iPhone/MacBook prices must rise by hundreds, not ~$100, until AI gets its fill. Memory gross margins head toward 85–90% before eventually oscillating down.

"Memory capacity is only growing 20, 30% a year for the next three years. And yet, demand is doubling… Memory prices are going to keep soaring."

Contrarian element: Street still frames memory as a mean-reverting commodity cycle. Patel: this is a years-long shortage driven by reasoning/agent workloads, not a 50% upcycle that tops after a 2–3× stock move.

Trigger: High-end smartphone/PC ASP hikes and unit elasticity; memory ASP and GM trajectory toward mid/high-80s; continued AI vs consumer allocation in supplier commentary.

Names: Samsung Electronics, Micron (MU), SK Hynix (HXSCF) — “three names” in memory; contrast with TSMC’s non-elastic pricing.

Investment Thesis #2: AI Spend Survives Bill Shock — Anthropic Prints; Assistants Prefer Frontier Tokens

The argument: Anthropic is free-cash-flow positive and profitable (April and May closed; June looking the same), recurring revenue past $50B ARR, gross margins above 70%. OpenAI revenue inflecting with Codex. SemiAnalysis annual recurring spend (ARS): <$100K (Nov) → $4M (end-Jan) → ~$11M today (peak week ~$14M) for a ~90-person firm — AI already >one-third of employee-related spend, path toward half. Enterprises blew annual AI budgets in Q1–Q2; winners cut other SaaS or headcount, not AI. Workloads split: mature workflows freeze quality and ride ~60×/year cost deflation (DeepSeek V3 vs GPT-4 ~600× cheaper in ~2 years); assistant work uses the newest model because Opus 4.8 can do in ~25K tokens / one turn what 4.6 needed ~100K tokens / multiple turns — so the smartest model is cheaper and Anthropic’s token efficiency explains why SemiAnalysis stays majority Claude.

"Cost optimization is oftentimes taking the newest model… the cost is actually less because the number of tokens being generated is less."

Contrarian element: Bloomberg-style “AI ROI failing” narratives miss observed lab profitability and serious-user spend curves. Clamping AI budgets is the path to being left behind.

Trigger: Anthropic/OpenAI margin and ARR prints; enterprise AI budgets reset upward vs. SaaS cuts; Opus-class releases that temporarily dip then re-accelerate token spend.

Names: Anthropic (private); OpenAI (private); hyperscaler inference hosts (Amazon, Microsoft, Google) capturing spend; SaaS share-of-wallet losers as the cut target (risk, not opportunity table).

Investment Thesis #3: CPU Demand Is a Real Catch-Up Mini-Cycle — Don’t Let Sellside Overshoot the Ratio

The argument: SemiAnalysis flagged CPU demand in institutional research Nov 2025 after OpenAI/Anthropic struck deals to rent fleet CPUs from Amazon, Google, Microsoft. Drivers: RL environments (unit tests, sandboxes, compilers) and agentic tool calls (search, DB, interpreters) put CPUs in the loop where pre-training/chat did not. Intel and AMD have raised prices; Amazon Graviton is renting “like crazy”; Nvidia now sells standalone CPUs (Vera) with ~$20B CPU revenue guidance; ARM entered as a competitive new server CPU and the stock has gone multiple X. Architecture split matters: Vera = fewer, faster cores (good when GPU stalls waiting on CPU); AMD/Graviton/ARM = more cores, lower per-core perf (better for batched/deployed code — GitHub commits up multiple X).

"We were the first to call it out… some of these CPU stocks have ripped. ARM has gone up multiple X… Intel's gone up multiple X. AMD's ripped."

Contrarian element: Sellside is inventing CPU:GPU ratios that imply CPUs take more dollars than AI compute — Patel says that is false. At ~$50K Blackwell vs ~$5K CPU, even 1:1 unit ratios leave CPUs a fraction of GPU dollars. Current frenzy is catch-up on years of AI chips shipped with too few CPUs; once backlog clears, demand settles to incremental steady state — a mini-cycle, not a permanent CPU > ASIC dollar story.

Trigger: Hyperscaler/lab CPU rental and attach commentary; Nvidia Vera CPU revenue vs. guidance; ARM/Intel/AMD server ASP and unit growth after the catch-up phase.

Names: Intel (INTC), AMD (AMD), ARM (ARM), Amazon (AMZN / Graviton), NVIDIA (NVDA / Vera).

Investment Thesis #4: Networking — Bull Copper & Pluggable Optics Near-Term; CPO Exuberance Is Early

The argument: Networking content is rising from sub-10% toward >10% of spend tied to AI chips; with CPO it can reach 20–30%. Cluster scale drives more optics (and active electrical cables) per GPU regardless. But co-packaged optics are running ahead of manufacturing reality: not 2027; tail-end 2028, real scale-up ramp 2029. Rubin is all copper; Feynman GPU still copper. Medium-term SemiAnalysis stance: bullish copper (e.g. Amphenol backplane connectors/cables), bullish non-CPO optics, relatively bearish CPO timing because chip roadmaps delayed full CPO. Telecom/datacom optics (host cites Ciena) still secular.

"Currently people are a little bit too excited on CPO… really in the tail end of 28 but 29 is the real ramp for scale-up co-packaged optics."

Contrarian element: Consensus treats CPO as the near-term networking lottery ticket. Patel: copper has “a long ways to go” and is innovating to push CPO out — local disjunctions favor copper names over CPO-pure narratives into 2027–28.

Trigger: Rubin/Feynman interconnect roadmaps; Amphenol vs CPO supplier relative performance; CPO yield/volume milestones slipping or accelerating vs. 2029 base case.

Names: Amphenol (APH); non-CPO optical transceiver / datacom stack; Ciena (CIEN) as telecom optics beneficiary; Marvell (MRVL) as host-named networking attention name — timing still gated by copper-first generations.

Investment Thesis #5: Power Is the Binding Constraint — Behind-the-Meter + Dirty/Crazy Solutions Work

The argument: Data-center deployment: ~20 GW this year → ~30 GW next → ~50 GW the year after. Energy is the primary gate (then politics, then construction). Transmission is hardest (regulation, utility amortization). Generation and conversion are the investable legs: within a couple years, ~half of incremental new DC power is behind-the-meter. Dual-combine-cycle gas from GE Vernova, Mitsubishi, Siemens; also reciprocating engines, industrial turbines, and truck/boat/train engines converted to generation — SemiAnalysis sees 10 GW+ of DCs using such approaches. Solar + battery cheaper than gas in ~2 years (reliability/nines caveat). Conversion stack exciting: IGBT, SiC, GaN, 12V → 54V → 800V DC, solid-state transformers, UPS — but Nvidia Rubin Ultra Kyber dropping 800V delays that slice of the chain. SemiAnalysis’s largest research vertical is now data centers / energy / industrials (not semis).

"In a couple years half of the power for data centers for incremental new power… will be generated on-site not offsite."

Contrarian element: Market frets that grid deadlock kills AI. Patel: if you are willing to go “full dirty” (diesel conversions + mechanics) or “fully into space,” solutions exist — constraint is real but not absolute, and the decentralized supply chain has hundreds of names.

Trigger: Behind-the-meter GW additions in SemiAnalysis trackers; GE Vernova / Siemens / Mitsubishi turbine lead times; 800V DC roadmap slips vs. Kyber; solar+storage LCOE crossing gas for target reliability.

Names: GE Vernova (GEV), Siemens Energy, Mitsubishi Power; battery/UPS and power-conversion (SiC/GaN/IGBT) supply chain; space-DC thematic (longer dated).

The Ecosystem Map: Where Patel Is Pointing Capital

Labs: Anthropic as proof ROI works (FCF+, >70% GM, >$50B ARR); OpenAI inflecting via Codex; SemiAnalysis itself a live token-demand sensor (~$11M ARS)
Memory oligopoly: Samsung / Micron / SK Hynix — years of shortage, ASP and GM expansion
CPU catch-up: INTC, AMD, ARM, AMZN Graviton, NVDA Vera — own the mini-cycle, fade dollar-ratio fantasies
Networking timing: Copper (Amphenol) and pluggable optics over near-term CPO lottery tickets
Power: Behind-the-meter gas + unconventional gensets + conversion semiconductors; DEI vertical is SemiAnalysis’s biggest book
Value capture: Commodity-elastic scarce inputs (memory) > fair-priced partners (TSMC) on multiple expansion; absolute dollars still skew to AI compute + memory over CPUs

Key Risks

Memory cycle still exists — troughs will be “brutal” even if trough-to-trough grows; 85–90% GMs are not a permanent plateau
CPU mini-cycle ends — once catch-up backlog clears, incremental attach normalizes and sellside narratives unwind hard
CPO eventually arrives — copper outperformance is a medium-term timing trade; 2029+ CPO ramp can re-rate optics winners
800V / conversion delays — Kyber dropping 800V pushes power-electronics upside out
Enterprise AI budget freezes — firms that clamp spend (vs. cutting SaaS) underperform, but if that cohort dominates, token growth slows
Behind-the-meter permitting — air permits, gas pipelines (Oracle example) can stall on-site generation even when hardware exists
Algorithmic efficiency — sustained 60×/year cost cuts on frozen-quality workflows could slow hardware unit growth if capability jumps stall

Investment Opportunities at a Glance

Tier	Name / Category	Core Thesis	Conviction Signal
1	Micron (MU) / SK Hynix (HXSCF) / Samsung (SSNLF)	Multi-year memory shortage; ASP +2–3× more; GM → 85–90%	Capacity 20–30% vs doubling demand; o1 KV-cache thesis
1	Anthropic (PRIVATE)	FCF+ / >70% GM / >$50B ARR proves AI ROI; token-efficient assistants	Closed April–May books profitable
1	NVIDIA (NVDA)	Still majority of AI compute dollars; Vera adds ~$20B CPU; copper generations first	Blackwell pricing vs CPU ASP framework
2	Intel (INTC) / AMD (AMD) / ARM (ARM)	CPU catch-up mini-cycle from RL + agents; ASPs rising	Called Nov 2025; stocks already ripping
2	Amazon (AMZN)	Graviton rental margins + Trainium/CPU fleet deals with labs	“Renting like crazy”; lab CPU offtake
2	Amphenol (APH)	Copper interconnect wins as CPO slips to late-28/29	Explicit medium-term copper bull case
2	GE Vernova (GEV) / Siemens / Mitsubishi	Behind-the-meter gas turbines for incremental DC GW	Named dual-combine-cycle suppliers
3	Ciena (CIEN) / non-CPO datacom optics	Networking content % rising; pluggables before CPO	Telecom/datacom “ripping”; CPO delayed
3	SiC / GaN / IGBT power conversion	12→54→800V DC conversion stack	Exciting; watch Kyber 800V delay
3	Reciprocating / converted gensets + batteries	10 GW+ unconventional behind-the-meter path	Diesel→gas engine conversions at scale
4	Space data centers	Solar-only generation, no battery — extreme unconstrained path	Named continuum endpoint; long-dated

Monitoring Checklist

Bottom Line

Memory is still early in a multi-year shortage, not late in a 18–24 month commodity cycle — 20–30% capacity growth vs doubling demand, another 2–3× pricing, and consumer hardware demand destruction until AI is filled.
AI ROI is observable: Anthropic already FCF+/>70% GM/>$50B ARR; serious users (SemiAnalysis ~$11M ARS) keep spending and cut SaaS/headcount instead.
CPUs are a catch-up mini-cycle, not a dollar-leadership flip — own INTC/AMD/ARM/Graviton/Vera into the backlog clear; fade sellside CPU>GPU ratio math.
CPO is priced for 2027; copper and pluggables own the next few years — Amphenol-style interconnect is the underappreciated timing trade.
Power constraint is real but solvable — behind-the-meter gas, converted engines (10 GW+), and conversion semis are where incremental electrons (and alpha) show up first.