You’re Wrong About Latency: The Real Bottleneck Isn’t Your Tools
Most engineers believe adding Spanner and Envoy destroys latency. Modal’s 6ms inference proxy proves the opposite: the real bottleneck isn’t the tools—it’s how you synchronize state. By moving routing decisions to a globally consistent control plane, the data plane becomes a dumb, fast highway. Conventional wisdom is wrong: state is the path to ultra-low latency.