has anyone tried the new openai open weight models?
Discussion
I can try the 20b one, didn't they just get released how fast are you guys.
To just try out:
Unfortunately open ai as well as grok and anthropic have too much of a bias for me to be interested in using any of them. Will have to wait for other viable options along the lines of, and sadly so, deep seek.
20 b one with 24gb GPU ist super fast. 59.71 token/s. I asked ist to create a secp256k1 Implementation in Python without using any libraries. It failed, but i liked the overall structure and reasoning.
nice test
check out 120b's attempt: https://gist.github.com/callebtc/579717733496f000a6b1f1178bef3c25
This is beautifuly structured ❤