https://ollama.com/blog/minions
The Minions project is a new approach to reducing cloud costs for large language models (LLMs) by shifting some of the workload to consumer devices. This is achieved through collaboration between small on-device models and larger models in the cloud. The project has developed two protocol configurations: Minion and MinionS.
* Minion: This protocol allows a cloud model to freely chat with a single local model that has access to data until they reach a solution. It achieves a 30.4x reduction in remote costs while maintaining 87% of the cloud model's performance.
* MinionS: This protocol decomposes tasks into smaller subtasks that can be performed on chunks of the context in parallel by small LLMs. It achieves a 5.7x reduction in remote costs while maintaining 97.9% of the cloud model's performance.
I feel like this would be revolutionary for the localLLM world, no?
https://ollama.com/blog/minions
The Minions project is a new approach to reducing cloud costs for large language models (LLMs) by shifting some of the workload to consumer devices. This is achieved through collaboration between small on-device models and larger models in the cloud. The project has developed two protocol configurations: Minion and MinionS.
* Minion: This protocol allows a cloud model to freely chat with a single local model that has access to data until they reach a solution. It achieves a 30.4x reduction in remote costs while maintaining 87% of the cloud model's performance.
* MinionS: This protocol decomposes tasks into smaller subtasks that can be performed on chunks of the context in parallel by small LLMs. It achieves a 5.7x reduction in remote costs while maintaining 97.9% of the cloud model's performance.
I've been slowly moving my wardrobe to cotton and as much as I can the last year or so. Acquired my first set of wool socks this weekend.
I saw a SN post asking what people would do if they ever happened to generate his key. Was a fun thought experiment.
Thanks, nostr:npub1c856kwjk524kef97hazw5e9jlkjq4333r6yxh2rtgefpd894ddpsmq6lkc for the tips on how to create a custom nip5 verification. I’m now verified by Blitz Wallet!
Very nice
This this this this
The answer is humanity is fucked and I probably just kill myself rather than try to survive some kind of global nuclear fallout XD
Duck.AI:
1. DuckDuckGo follows a "trust we don't log" process. Your chats and responses pass through their system in a way that they could intercept and save them without telling you. You have to take them on their word.
2. Your chats are only saved locally in your browser because they know they aren't encrypting your data privately to you on their servers.
On the Maple side:
1. nostr:nprofile1qyjhwumn8ghj7en9v4j8xtnwdaehgu3wvfskuep0dakku62ltamx2mn5w4ex2ucpxpmhxue69uhkjarrdpuj6em0d3jx2mnjdajz6en4wf3k7mn5dphhq6rpva6hxtnnvdshyctz9e5k6tcqyp7u8zl8y8yfa87nstgj2405t2shal4rez0fzvxgrseq7k60gsrx6zeuh5t by nostr:nprofile1qyshwumn8ghj7en9v4j8xtnwdaehgu3wvfskuep0w3uhqetnvdexjur5qyfhwumn8ghj7ur4wfcxcetsv9njuetn9uqzphchxfm3ste32hfhkvczzxapme9gz5qvqtget6tylyd7wa8vjecgaq9enl encrypts your data in a private data vault using secure enclaves. This is cryptographically provable, similar to the lock icon next to the website address in your browser. We can't see your chats and you can prove it.
2. With an encrypted data vault, your chats may safely be stored in the cloud and sync'd to all of your devices, making it more useful.
I was early on in the TFTC episode when I posted this. By the end i had figured it out haha. Appreciate the response!
2022/23 bear market turned me into a new person
Genuine question:
Why would I wanna pay for nostr:nprofile1qqsd79ejwuvz7v246danxqs3hgw7f2q4qrqz6x27je8er0nhfmykwzqpzamhxue69uhhyetvv9ujuurjd9kkzmpwdejhgtcpzdmhxue69uhhqatjwpkx2urpvuhx2ue0qy2hwumn8ghj7un9d3shjtnyv9kh2uewd9hj7npzg5z when I can talk to Llama 3.3 70b and many other models for free here
https://duckduckgo.com/?q=DuckDuckGo+AI+Chat&ia=chat&duckai=1
Need cheap sats, i say we go even lower by Wednesday night!
I was looking for a second browser with mull being unmaintained now. Thank you sir.
Lol for real. I tried to understand as much as I could for like a year straight and just couldn't retain most of it. The only relevant takeaway was the system is stupid and I should stack more sats.