cloudflare opened sourced their rust proxy tech, seems like a solid foundation to build on top of for #lmzap. looks like a hackable nginx.
the goal for lmzap is that the api should work exactly like openai's, gated by lightning payments. I want something super reliable. this seems perfect for that.