Replying to Avatar FWEnoir

Personal research notes thread on Llama2.

#llama #llama2 #AI

Discovered a well-performing and faster model based on Llama2, GPTQ.

colab: https://colab.research.google.com/github/camenduru/text-generation-webui-colab/blob/main/llama-2-7b-chat-GPTQ-4bit.ipynb

Avatar
FWEnoir 2y ago

If you're tired of or feel unnecessary the safety or ethical limitations of Llama2, you can try TheBloke/llama2_7b_chat_uncensored-GPTQ.

model: https://huggingface.co/TheBloke/llama2_7b_chat_uncensored-GPTQ/tree/main

colab: https://colab.research.google.com/gist/eternnoir/23041d067fa34b67c56427c44280104b/llama2_7b_chat_uncensored-gptq.ipynb

Reply to this note

Please Login to reply.

Discussion

No replies yet.