Replying to Avatar ABH3PO

Local AI CAN do agentic stuff. It just cant work with tools and MCP since it has context limitations.

Im trying to make my own agents living in my computer that can take decisions and remember them.
Avatar
™ 1mo ago 💬 1

Working on something similar for myself. Some things that may lead you in a good direction:

- LMStudio

- OpenWebUI

- CrewAI

The context limitations can be adjusted and navigated around.

Reply to this note

Please Login to reply.

Discussion

Avatar
ABH3PO 1mo ago 💬 1

What have you been able to get working so far?

Avatar
™ 1mo ago

I’m serving several local (LMStudio) and remote (@⁣⁤Maple AI⁤⁣) models to OpenWebUI, where MCP servers can be added easily and pipelines can be used to further enhance. Serve it to yourself locally, via ZeroTier/tailscale/etc, or use sish/boringproxy/etc to expose it to the web. There are a few native apps that connect to OpenWebUI.

Still working my way over to CrewAI but it looks interesting.