I should find out how to implement this as a LocalAI backend. :3 Would be neat AF.

https://tenstorrent.com/software/tt-buda/