I will have a look thanks for pointing that out 👀 right now I'm researching more about small llms (slm) like qwen2.5-0.5, smol models, granite and so on. This is my naive approach to slms testing, using ollama for the inference https://github.com/gzuuus/slm-testing then I discovered promptfoo https://www.promptfoo.dev/ which is really nice framework for testing.

Reply to this note

Please Login to reply.

Discussion

No replies yet.