running llama3 in the home lab. fired up an ide and installed a coding assistant plugin, pointed at the local llm. hot keys to add query and generate code, feels very fast.
Iβll probably always use vim as my primary editor but man some of these new tools are wild.
How much ram?
Please Login to reply.
Iβm running an 8b parameter model on a machine with 128GB ram and an 8GB gpu.
but thatβs way more than necessary
Sweet!