“PetalsLightning is a chatbot interface that uses a Petals swarm (decentralized compute network) for collaborative inference of large language models (LLMs).” kouloumos, PetalsLightning

How it works 🚨

1) Contributing servers provide a lightning address

2) User pays per message to the main lightning address of the swarm

3) Petals does some magic to select the best servers and calculates the response

4) The payment gets distributed to the servers involved in the inference

#PitchDay #BuildInPublic #Ai4ALL