Replying to Avatar Raul007

You could give GPT4ALL a try. It has a built in plugin that can reference local docs. I find it does a good job summarizes concepts, but not so great at pulling out specific information.

24gb is sufficient to run 13B models at 4 or 8 bit quantization, and some will fit at 16bit đź‘Ť
Avatar
Ocean 2y ago

Thank you for the response and insight. I’ll try out some 13b models today.

I noticed there are some ways to hook llama2/codellama into vs studio. I think using “continue” was one of them.

I’d like to do that and have it evaluate some nostr protocol code.

Following you for more llm discussion 🤙

Reply to this note

Please Login to reply.

Discussion

No replies yet.