OpenAgents Episode 148: Exploring the Genesis Physics Engine
We explore today's open-source release of Genesis, "a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications."
We brainstorm how OpenAgents & Onyx might use Genesis.
And we wonder: should we build our own fleet of drones? 🤖✈️
Genesis docs 👉 https://genesis-world.readthedocs.io/en/latest/index.html
Genesis+OpenAgents/Onyx thoughts 👉 https://github.com/OpenAgentsInc/openagents/blob/main/docs/genesis.md
Watch on X: https://x.com/OpenAgentsInc/status/1869631823182975426
OpenAgents Episode 147: Planning a Data Marketplace
Our ONE MARKET for AI agents & services (detailed in Ep. 141) should definitely include what fuels the agents: data!
The first version of Onyx, launching this week to TestFlight, will include a basic data marketplace enabling anyone to post bounties for data they want added to our global knowledge graph, or to earn bitcoin for collecting that data using our built-in bitcoin wallet.
We'll demo that in tomorrow's video.
For tonight, we're paying so much for ChatGPT Pro that we need to get our money's worth, so we're gonna delegate the rest of this summary to o1 pro:
"This transcript outlines the speaker’s vision for a data-driven marketplace platform, tentatively called the OpenAgents marketplace. The core idea is to enable users and automated agents to contribute and curate valuable information—initially focused on topics like drone data or UAP (unidentified aerial phenomenon) sightings—and to reward high-quality contributions with Bitcoin. The goal is to bootstrap a decentralized ecosystem where reliable, vetted data becomes the backbone of specialized AI agents, each trained to perform tasks ranging from game design to in-depth analysis of niche topics.
The concept involves several key components. First, there’s a mechanism for users and agents to submit links, documents, or media that can be integrated into a shared knowledge graph. Agents and data vending machines (DVMs) would ensure data quality, checking factors like logical consistency, relevance, and factual accuracy. Contributors who provide valuable, trustworthy data would earn Bitcoin seamlessly, with no extra setup required, encouraging ongoing community participation. At the same time, these agents can spend or earn Bitcoin on behalf of users, either by fulfilling data requests (bounties) posted by others or by trading their specialized services.
Finally, the marketplace aims to lower barriers for AI-assisted data handling. By integrating the Model Context Protocol (MCP) and robust server infrastructures, the platform could facilitate permissioned data sharing, autonomous classification, and advanced analyses on demand. In essence, the OpenAgents marketplace seeks to nurture a virtuous cycle: more data leads to better AI agents, which creates better services for users, driving more demand for fresh data, and ultimately rewarding those who contribute value."
Initial spec 👉 https://github.com/OpenAgentsInc/onyx/blob/main/docs/data-marketplace.md
Code 👉 https://github.com/OpenAgentsInc/onyx/pull/32
Watch on X: https://x.com/OpenAgentsInc/status/1869220404079800704 
Episode 146: Sensemaking: Drones
What's up with those drones?
We ask ChatGPT, Perplexity & Grok -- and get no good answers.
We try to improve on their answers in a single day of building our own search using basic versions of GraphRAG and test-time compute, enabling the agent to 'think' over a knowledge graph before generating a response.
We get that full flow working with preliminary data, generating a decent response - but not yet better than the billion-dollar AI labs. Maybe in another day or two?
We need to feed it better data! We'll do that tomorrow.
Watch on X: https://x.com/OpenAgentsInc/status/1868910035281051854
Calling LLM tools via on-device Llama 3.2 to work with the filesystem of my desktop running a Pylon MCP server: with no inference costs, ~no latency and no data leaving my home network 💪🤖 
Yes optionally, and we should have the full flow by end of this month: speech-to-text (Whisper) -> LLM inference -> text-to-speech via ElevenLabs or open equivalent
Probably will be a paid feature cuz the API costs there get pricey — though going to see if I can get a fully local/free flow working via open models on Pylon
OpenAgents Episode 145: Going Local
Onyx now runs Llama 3.2 3B locally on your phone - enabling free and private chats!
You can also chat with the larger Llama 3.3 70B by connecting via MCP to a local Pylon node, which can load any model supported by @ollama.
Check the video for demos of both. First alpha builds launch in ~1 week for Android and iOS.
With a mix of on-device, local or distributed servers, and cloud APIs, we have a LOT of flexibility for building agentic workflows using any combination of tradeoffs for privacy, speed, cost, and censorship resistance.
Combined with our DVM marketplace from Ep. 142 and bitcoin wallet from ep. 143, we've got everything we need to bootstrap a decentralized marketplace of agentic AI services.
That wraps up our first full week of '12 Nights of OpenAgents'. See you Monday!
Watch on X: https://x.com/OpenAgentsInc/status/1867815868131836103
OpenAgents Episode 144: Pylon and the Model Context Protocol
We introduce Pylon, the node software that powers Onyx. It's a desktop app anyone will be able to run, and will launch alongside Onyx later this month.
We explore the new Model Context Protocol (MCP) from Anthropic, an open protocol that helps build agents and complex workflows on top of LLMs.
Pylon will serve as both MCP server and Nostr DVM service provider, enabling node runners to earn bitcoin from our AI marketplace while also using it as a backend for their own Onyx app.
We demo Onyx -- now the first MCP mobile client -- connecting to Pylon, now the first MCP server written in Rust via Tauri.
Watch on X: https://x.com/OpenAgentsInc/status/1867458253661114610
Further reading:
- MCP announcement: https://anthropic.com/news/model-context-protocol
- MCP site & spec: https://modelcontextprotocol.io
- Pylon repo: https://github.com/OpenAgentsInc/pylon
- Tauri: https://tauri.app
OpenAgents Episode 143: Onyx as Bitcoin Wallet
We demo sending & receiving bitcoin in Onyx.
Onyx now has a simple self-custodial Bitcoin/Lightning wallet thanks to the Breez SDK.
This will make it easy for anyone in the world to earn and spend bitcoin for AI agents & services.
Watch on X: https://x.com/OpenAgentsInc/status/1867070611928846640
Further reading:
- https://breez.technology/sdk/ (We're using it!)
- https://satsymbol.org (We're using it!)
- https://www.spark.info (We're testing it!)
- https://github.com/OpenAgentsInc/onyx/pull/23 (The code)
OpenAgents Episode 142: Data Vending Machines
We demo Nostr's "data vending machines" protocol (NIP-90) in Onyx, requesting LLM inference that's then handled by a separate service which processes DVM inference jobs with Llama 3 via the Groq API.
The big idea: We can make any AI services available through an open, neutral, decentralized network, all accessible through one easy-to-use mobile app.
Up next, we'll combine this with seamless instant micropayments so service providers can earn a steady stream of bitcoin!
Watch on X: https://x.com/OpenAgentsInc/status/1866695147632889902
Further reading:
- https://data-vending-machines.org
- https://github.com/nostr-protocol/nips/blob/master/90.md
Demo backend repo:
- https://github.com/OpenAgentsInc/groq-dvm-test
Watch on X: https://x.com/openagentsinc/status/1866695147632889902?s=46
OpenAgents Episode 142: Data Vending Machines
We demo Nostr's "data vending machines" protocol (NIP-90) in Onyx, requesting LLM inference that's then handled by a separate service which processes DVM inference jobs with Llama 3 via the Groq API.
The big idea: We can make any AI services available through an open, neutral, decentralized network, all accessible through one easy-to-use mobile app.
Up next, we'll combine this with seamless instant micropayments so service providers can earn a steady stream of bitcoin!
Watch on X: https://x.com/OpenAgentsInc/status/1866695147632889902
Further reading:
- https://data-vending-machines.org
- https://github.com/nostr-protocol/nips/blob/master/90.md
Demo backend repo:
- https://github.com/OpenAgentsInc/groq-dvm-test
Watch on X: https://x.com/openagentsinc/status/1866695147632889902?s=46
Yes! First test build on TestFlight next week and android a few days after that, will post here :)
OpenAgents Episode 141: One Market
We share the big-picture vision of OpenAgents: to liberate frontier AI from captured centralized corporations by building one decentralized global marketplace of AI agents and services.
Onyx will be your gateway to that marketplace. It's an easy-to-use mobile app that connects your voice commands to a broad ecosystem of service providers competing to execute your commands, all powered by open protocols unstoppable by centralized gatekeepers.
We will not allow the future of AI to be controlled by the likes of Microsoft+ClosedAI and their government handlers.
The agent economy must be built on a foundation of openness. Here's our plan to do it.
Watch on X: https://x.com/OpenAgentsInc/status/1866351898376405220
OpenAgents Episode 140: Open-Sourcing Onyx
We open-source Onyx and tour the docs: https://github.com/OpenAgentsInc/onyx
Because the agent economy must be built on a foundation of openness, not black-box bullshit with unverifiable claims and code!
Watch on X: https://x.com/OpenAgentsInc/status/1865245296097210497
Are there any NIP-90 clients?
OpenAgents Episode 139: Going Mobile
We're launching a mobile app in two weeks!
We'll make the launch fun by copying the "12 Days of ClosedAI" 😂 with our own "12 Nights of OpenAgents" 🎉
We'll release one video every weekday night from now through Dec 20 exploring Onyx features, architecture, Bitcoin/Nostr integration & more.
By night 12 we will launch "the coolest, awesomest, bestest, open-source, truly open AI agent app and product that should bootstrap a global decentralized AI agents marketplace running on open protocols, accessible to everybody -- and you don't even have to pay us $200/month."
Night 1 begins now with a sneak peek of the app - called Onyx - and an overview of the what, why & how.
Watch on X: https://x.com/OpenAgentsInc/status/1864878103853477910
"Write relay/plan.md as a step-by-step plan for setting up our relay folder to implement NIP-01 and NIP-90 from scratch in Golang. The first NIP-90 service will be transcribing a user audio file using Whisper via the @GroqInc API."
Plan 👉https://github.com/OpenAgentsInc/v3/blob/main/relay/plan.md
Chat 👉 https://openagents.com/share/jh75take9w66fhxta8m0aahrax6zv724
With Clerk I have no ability (or I haven’t figured it out) to be more finegrained with the permissions — will be swapping that out soon
But it should still work if you deny all repos
Aaaand v2 is now open source
You can take a spin through the closed issues and PRs
Our v2 AutoDev product @ openagents.com is now open-source on GitHub under AGPL3 👉 github.com/OpenAgentsInc/v2
We're starting now on a more decentralized v3 which will be built in public and 100% open-source under CC-0 👉 github.com/OpenAgentsInc/v3
Video soon 👍
Episode 124: Magic AI = Deep State
AI coding startup Magic AI raised $465M with the stated goal:
"Imagine if you could spend $100 and 10 minutes on an issue and reliably get a great pull request for an entire feature. That’s our goal."
But we shipped that two days ago, our agent solving two PRs for in 12 minutes for $5 in a product that's publicly available now everywhere in the world: https://x.com/OpenAgentsInc/status/1829216276834816135
So what does Magic really need all that money for?
Reviewing their latest statement calling for AI regulation and their investor list, including deep state financier Eric Schmidt and Nat Friedman / Daniel Gross, primary funders of "nationalize the AI labs" Leopold Aschenbrenner, it's clear they want to build AGI and hand it to the deep state.
Magic, SSI, OpenAI and Anthropic have all clearly aligned with ClosedAI to the benefit of themselves and governments-- to the detriment of all humanity.
We will raise a coalition to counter their influence and smash every nexus of centralized corruption.
The world must have truly open AI.
How will you help?
Watch on X: https://x.com/OpenAgentsInc/status/1829238237925458015