Replying to Avatar Shawn

Yeh, Iā€™m down the LLM rabbit hole lately, but check this out. You can now run LLAMA in a low-end Digital Ocean droplet.

https://github.com/ggerganov/llama.cpp/discussions/638

Avatar
Pete Winn šŸ”† 2y ago

Oracle Cloud used to give you 4xA100 High Performance ARM processes with 24gb of Ram for free might be worth a look.

I use them for running BTC Pay server but this might be a better use :)

Reply to this note

Please Login to reply.

Discussion

No replies yet.