Avatar
FWEnoir 2y ago

Personal research notes thread on Llama2.

#llama #llama2 #AI

Discovered a well-performing and faster model based on Llama2, GPTQ.

colab: https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-7b-chat-GPTQ-4bit.ipynb

Reply to this note

Please Login to reply.

Discussion

Avatar
FWEnoir 2y ago

If you're tired of or feel unnecessary the safety or ethical limitations of Llama2, you can try TheBloke/llama2_7b_chat_uncensored-GPTQ.

model: https://huggingface.co/TheBloke/llama2_7b_chat_uncensored-GPTQ/tree/main

colab: https://colab.research.google.com/gist/eternnoir/23041d067fa34b67c56427c44280104b/llama2_7b_chat_uncensored-gptq.ipynb