At the very least, it's probably still great for self hosting in that you can quantize or distille it into a model that could run on a more consumer PC or phone.
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpqx2vc8gu0kj2slcujhkd2y684k32e2zhzn78d2quea4tajn9ql2pqunvqps nostr:nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpqq3sle0kvfsehgsuexttt3ugjd8xdklxfwwkh559wxckmzddywnwsxeuf7k b-b-but you can distribute the premade model and you can run it on "your" own proprietary gpu
Discussion
No replies yet.