It was only on a M3 CPU so far - no GPUs yet. We’ll do that benchmark later but it might be more expensive for relay operators / some users may not have GPUs.

gemma3:1b

llama3.2:1b

Which inference engine and tech stack if I can ask ? Have you used WebGPU and/or Metal on Mac/iOS?

We were already using 1B models but it was too slow. Need faster speeds for smaller models.

poco a poco. #nostr

I've been having this idea gestating in my brain for a while, its part of something bigger that I'm trying to conceptualize but the gist of it is:

DVMs can make passive income from residential internet connections.

More and more websites are trying hard to penalize non-residential traffic with tons of catchas or straight up blocking the requests. Which means that you cannot just roll your own vps somewhere and use it as vpn as easily as it used to be.

Or try downloading a youtube video from it. But you would pay couple sats for it. Which means that any pleb that has a raspi or something else running somewhere at home could run a simple DVM that would download the video for the user and send it to them.

This is only the start, there are a lot more things we could do in a distributed way to basically provide a solution to a problem that many have, specially now in the days of AI where scrapping as much data as possible is something people are paying for.

Forget about trying to run LN nodes to earn an income. Just install a package on your umbrel, start9 or whatever platform you are using and start offering services.

And its not just about serving the people on nostr. We can build websites and abstract the DVMs away. We can use the normie world to fuel our parallel economy, using distributed compute to provide services that people want and are willing to pay for them.

And it actually is easier to do it this way than trying to engineer your way around the restrictions. Why pay for 1000s of proxies if you can have 1000s of people participating in your pool of compute?

I'm building this in Q1 if all goes well, but I'm sharing the idea with the world because the important part is it gets built. If anyone wants to take the lead, participate or just brainstorm hit me up!

Congrats on the release!

I don’t understand why you say that solutions like Boltz are compromising privacy or expsosing funds to seizure.

How do you know if all the random takers you find around are not cops?

Why isn't there a nice CLI Bitcoin wallet?

But yes, they're now *possible*. But they're really a workaround for not being able to express what you actually want.

But sponsors is a general solution to the problem: at allows a marketplace for fee boosting which may be competitive with miners (though it will always take 1 tx more). This works for any covenant scheme, which all seem to have the same "constant, but for fees" problem.

Pinging nostr:npub148jz5r9xujcjpqygk69yl4jqwjqmzgrqly26plktfjy8g4t7xaysj9xhgp .. is there any kind of paper or spec I could refer to to better understand Ark? I'm reading arkdev.info/docs but it's too general/broad for me.

Nostr would be in a better place if we could follow topics.

But it seems topics require algorithms or centralization (indexing of all notes at all times and categorizing them) - which also sounds expensive.

Who is going to figure out how to discover topics on nostr?