Currently, you can test the Llama2 13B model using Google Colab, and it works smoothly with the A100 & V100 GPU.
#AI #Llama2 #Meta
https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-13b-chat.ipynb
13b-GPTQ
https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-13b-chat-GPTQ-4bit.ipynb
Please Login to reply.
No replies yet.
