I am spending some time trying to use opensource models locally, instead of proprietary models. It feels like there is a huge gap between free and proprietary models until this point.
What do you think nostr:nprofile1qqszv6q4uryjzr06xfxxew34wwc5hmjfmfpqn229d72gfegsdn2q3fgpzfmhxue69uhkummnw3e82efwvdhk6tcpz4mhxue69uhhyetvv9ujuerpd46hxtnfduhszythwden5te0dehhxarj9emkjmn99urf278z ?
There is. I've been able to use local models for things like summarization and basic chat and tool calling, but I can't get anything as good as claude for coding.
Damn.
And do you have any strategy to cost minimize?
I'm not to concerned about the cost right now since I'm focused on learning this stuff. that said I've stayed away from the agent stuff that seems to cost $100+ a day because I still don't know what I'm doing :)
I feel you. I guess I am still farther away then you are. I am doing the same, learning. I am using llms at work, but not yet at home. There I want a bit more privacy, but local models did not act good enough so far.
