Can a #SteamDeck be used to run a local #LLM, in a clear misuse of the tech? Yes. Yes, it can. Actually not bad, if I was in a bind and had only this little computer to use. As models get more distilled and efficient, more and more tiny or older devices could find a second life as mini-servers. https://cdn.nostrcheck.me/88c9ccecb5b3fc139fbf2c50af07101400901196f92a68b09f543c7bc248585a/f2618d2933c7a59c93ba798d37d289fec58db8adea42b0905cb71721347d6e17.webp https://cdn.nostrcheck.me/88c9ccecb5b3fc139fbf2c50af07101400901196f92a68b09f543c7bc248585a/af391086c64b97e29aa0d640285801809ea1c5339e6b1650278e1ec02c0ac00a.webp https://cdn.nostrcheck.me/88c9ccecb5b3fc139fbf2c50af07101400901196f92a68b09f543c7bc248585a/65176326fd3dc91f9b598f0f2ce59b0ad76472b52a99076222dc2d5dfef7f318.webp
Discussion
No replies yet.