Global Feed Post Login
Replying to Avatar Leo Wandersleb

To my understanding, the cluster and GPU setup is for heavy duty operations. I suspect, things can be very well parallelized this way and running a single session on this setup would just not be resource efficient but you could fill your disks with Llama3.1 and use it at your discretion without GPU.

nostr:nevent1qvzqqqqqqypzq3huhccxt6h34eupz3jeynjgjgek8lel2f4adaea0svyk94a3njdqy88wumn8ghj7mn0wvhxcmmv9uq3uamnwvaz7tmwdaehgu3dwp6kytnhv4kxcmmjv3jhytnwv46z7qpqaad092282x5ucgxw8gpl9a4c4lwjxvu0fgq55zs5j9zgqdg8p9csdyerw9

Avatar
Ben Weeks ⚡ 1y ago

By the way, ChatGPT 4.o may not be the top-dog with the likes if Claude depending on what your using it for.

Reply to this note

Please Login to reply.

Discussion

Avatar
Leo Wandersleb 1y ago

Yeah but it happens to be the one that got my subscription and before subscribing to all of them I'm exploring the self-hosted option.

Thread collapsed