Does goose work well with ollama model instances? How many tokens/s are you getting?

Reply to this note

Please Login to reply.

Discussion

The tools feature only works with models that have tool support. gpt4o, sonnet, and the one i linked for a local model. Haven’t tested many. Generation is a bit slower for the local one but i generally run these as background tasks

There's a special goose model for tools of deep seek r1 but it was 70b. Bit slow for my setup, but nice to have locally too.