Replying to Avatar Ben Weeks ⚡

What model are you running and what’s the performance like on the Mac?
Avatar
jb55 9mo ago

Just this one i had on my ollama instance but i think there are better ones now

nostr:nevent1qqsxf6hnc5w07fyg6k8unfvlc2luvc9afrjxm264s85j03ysamkkqsgpzdmhxw309aex2mrp0yhx5c34x5hxxmmdqy28wumn8ghj7un9d3shjtnyv9kh2uewd9hsz9thwden5te0wfjkccte9ekk7um5wgh8qatzqyxhwumn8ghj7mn0wvhxcmmvzqr6lq

Reply to this note

Please Login to reply.

Discussion

Avatar
Ben Weeks ⚡ 9mo ago

I’m using deepseek-r1:14B at the moment but need to try more out. Currently running it concurrently against GPT-4o (which queries OpenAI API) in Open Web UI to compare output (which is a nice feature) I think I need a bigger GPU!

Also been building a custom model (prompt) for Nini.