chatgpt running shell commands on my computer. this makes me uncomfortable. time to switch to a local model 😅

nostr:note1a8rs3k45f4wx5em2wcvftq4a4j4w99wr5xxzhaa0h2atlrmhc7pqxp27m4

Reply to this note

Please Login to reply.

Discussion

I regularly run goose with Claude. Some people have sandboxed it though

Oh man. Scary

It originally felt risky, but it's been fine. Maybe 9 months now? I git stage things a lot

Wow. Fascinating. I use Claude as my preferred. I'll take a look.

I like the idea of saying "stage these changes into logical commits" oh my god if it could do that.

I guess it would need to be able to do a sequence of actions back to back. not sure if that's supported

looks like it can...

Getting that loop is the goal! I've showed it a failing unit test invocation and let it run for 20 minutes until it solved the underlying problem

wild

That word doesn't mean anything to me anymore 😂

Local models don't spark joy... yet

yeah I think I would want to jail it to the directory i'm working in...

tried with my local llama.cpp + rocm but it seems it needs "tools" support. I guess I need to use ollama

Looks like a job for mistral-smol.

Got a link

All these people with passwords and secret keys in their ENV gonna get rekt

YIKES. Did you give it an SSH key or something?

I don't do anything... most unproductive human probably. BUTTT for some reason I want this so damn bad. I do use it to write python scripts for me and figure stuff out.... I have been having such a fun time with it and don't trust putting my stuff out there for the companies to gobble up... went ahead and got me a 4060ti with 16GB of ram, 64GB more memory and a new 4tb nvme this morning... I couldn't justify spending the thousands it would really take to get a great card... I was telling my wife this morning, we have distilled all human knowledge now and the understanding of it on a freaking thumbdrive size file! I am still blown away and I have a pretty good grasp of how it works now. I did see a couple months back when you posted about the youtuber 3brown1blue(thanks by the way, hadn't seen him before) and went deep down that rabbit hole!