Instruct is specifically fine tuned for question/answer environments. So go for instruct when available. Otherwise you can do a system prompt that will essentially get a “non instruct” model to act like one, but getting the tuned version will have better results.

Reply to this note

Please Login to reply.

Discussion

Do any of these locally run LLMs support me uploading a document and then asking questions about it (the way Claude does)?