Avatar
FWEnoir 2y ago

Currently, you can test the Llama2 13B model using Google Colab, and it works smoothly with the A100 & V100 GPU.

#AI #Llama2 #Meta

https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-13b-chat.ipynb

Reply to this note

Please Login to reply.

Discussion

Avatar
FWEnoir 2y ago

7B

https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-7b-chat.ipynb

Thread collapsed
Avatar
FWEnoir 2y ago

13b-GPTQ

https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-13b-chat-GPTQ-4bit.ipynb

Thread collapsed