Hey nostr:npub1h8nk2346qezka5cpm8jjh3yl5j88pf4ly2ptu7s6uu55wcfqy0wq36rpev, what is the best model I can run locally in LLM Studio that can help me with writing/understanding SQL, DAX, etc? #AskNostr
Discussion
Hmm, I still think I have the best results with most things using Mixtral 8x7B, but there may be an SQL specific model out there these days that I don’t know about yet as well. I would try Mixtral, see how it is, then maybe try codellama after to compare if Mixtral is weak for that particular speciality.
I’m new to downloading models from Hugging Face….whats the difference between 8x7B and 8x7B-Instruct?
Instruct is specifically fine tuned for question/answer environments. So go for instruct when available. Otherwise you can do a system prompt that will essentially get a “non instruct” model to act like one, but getting the tuned version will have better results.
Do any of these locally run LLMs support me uploading a document and then asking questions about it (the way Claude does)?