OpenAgents Episode 194: The Trillion-Dollar Question
What percentage of global AI workloads in 2030 will run on Apple silicon?
ChatGPT Pro thinks the range could be anywhere from 7% to 35%, depending in part on how broadly its edge inference APIs are adopted by developers.
We've got a few things to say about that.
We demo agentic search through a codebase using nothing but Apple's on-device Foundation Models API.
It works-- even while offline. It's local and private with a marginal cost of zero.
How far can we take this?
What percentage of coding agent workloads can shift from cloud to the edge?
We are about to find out.