cloudflare opened sourced their rust proxy tech, seems like a solid foundation to build on top of for #lmzap. looks like a hackable nginx.
the goal for lmzap is that the api should work exactly like openai's, gated by lightning payments. I want something super reliable. this seems perfect for that.
https://blog.cloudflare.com/pingora-open-source/