Ok and why should I care how many parameters it uses if the end result is not great? Do you think people who use ChatGPT4 every day are going to care what the parameter excuse is if the results suck?
Discussion
The fact that it uses 7b params makes it less accurate, but allows for you to run it on your computer!! Also, system message, prompt, etc... plays a huge role on using these open source, small LLMs. You can try others like Llama 2 or openhermes!
Fiat and Ferrari are boths cars, even made at the same place, they perform the same basic function!!! yet, there's stuff a Ferrari can do that a Fiat can't.