Real Alpha

Sourcery · 3 min instead of 55 min · Oct 12, 2026

Long-context agents make local hardware cost-competitive with data centers

Aravind Srinivas

Co-founder & CEO, Perplexity

  • Molly O'SheaHost · Founder, Sourcery

    Ex-Upfront Ventures investor; has interviewed Alex Karp and Palmer Luckey.

About this segment

Srinivas explains that chat is cheaper in the data center, but as context grows past about 100k tokens the cloud advantage shrinks to roughly 3x or 1x. That is why Perplexity bets on local hardware plus data centers.

From “Perplexity CEO: SMBs Could Drive the Next Economic Boom”, Oct 12, 2026. Watch the full episode

“as context expands, and as individual user has a lot of personal context, the context window increase dominates the batch size.”
Aravind Srinivasat 30:08 · Sourcery30:08

Takeaways

  1. Chat inference is about 30x more expensive on local hardware
  2. At 100k+ context, the data center advantage falls to about 3x or 1x
  3. Data center build-outs are bottlenecked by permits, power and interconnection queues
Watch 3:28 from 29:26

In this episode

Full episode

  1. 29:26Long-context agents make local hardware cost-competitive with data centers3:28

  2. 26:26AI products compound through recursive usage, not network effects1:57Up next
  3. 42:23The real bottleneck is deciding what to build, not writing code2:14