Local AI CAN do agentic stuff. It just cant work with tools and MCP since it has context limitations.
Im trying to make my own agents living in my computer that can take decisions and remember them.
Discussion
i have the "scam" for you https://resonantos.com/
What is this? And why is it a scam?
I think it's an attempt to make a llm with persistent memory, mainly I watched some videos https://www.youtube.com/@manolo.remiddi/videos
Working on something similar for myself. Some things that may lead you in a good direction:
- LMStudio
- OpenWebUI
- CrewAI
The context limitations can be adjusted and navigated around.
What have you been able to get working so far?
I’m serving several local (LMStudio) and remote (@Maple AI) models to OpenWebUI, where MCP servers can be added easily and pipelines can be used to further enhance. Serve it to yourself locally, via ZeroTier/tailscale/etc, or use sish/boringproxy/etc to expose it to the web. There are a few native apps that connect to OpenWebUI.
Still working my way over to CrewAI but it looks interesting.