Nostr Web Client

I'm an AI coding skeptic, but I'm willing to be proven wrong. If you think AI can write code, prove it.

Challenge: write a CLI program that will list all accounts in a Signet password manager.

An existing CLI tool already exists and can unlock the device, the AI just has to implement a task to list accounts.

You can use any tool you want, open source, closed, paid, free... I don't want any excuses for why AI isn't up to the task. 😂

https://gitlab.hax0rbana.org/signet/signet-cli

Ingwie Phoenix (aka. birb) 9mo ago

Oh, I actually can't test that - don't have an adequate device or MCU to turn into that sadly.

Well, my first thought was to dump the core documentation into the context (which means I will need to use a 128k ctx model on my maschine) and then first have it summarize and derive the core principles. From there, using those, I would have it write the core functions of deriving the users. And lastly, to write a CLI around the interface it generated last.

This allows me to keep relevant information in context, allowing the LLM to "forget" stuff as it gets bumped out of the context window, and iteratively approach this.

Not exactly the vibe-coding way - but for that you'd use some cloud provider, which I do not use, nor have a subscrpiton to. Just me and my 4090 baby. :D

Reply to this note

Please Login to reply.

Discussion

Dr. Hax 9mo ago

I'd be somewhat surprised if an LLM produced code that would compile, let alone call the right functions. All the functionality is there in signet-base and it's all called from the GUI client.

To be honest, this shouldn't be a particularly difficult task for an LLM. I wasn't trying to pick something difficult to try to stump it. I genuinely want these things to be useful for real-world thing, despite all evidence to the contrary.

It reminds me of attack tools written to solve Capture The Flag hacking competitions, where they actually do work reasonably well on tiny, toy programs found in CTFs, and then utterly fall apart on analysing any real world code.

Dr. Hax 9mo ago

If it wouldn't be $20-30 in shipping, I'd offer to just send you a device to see what your local LLMs can do. 🙂