Patience
Having the patience to learn. With 8,000 lines of code a simple chat bot infrastructure can be put in place to learn from. The results are not great compared to leading LLM's but they can learn to be better over time and with sovereign data from tiny devices that is possible. How to address the initial poor results? Be honest with that up front and get to a reasonable beneficial standard or plug in a good open source model (even from the cloud) to cover the initial time period? On for the initial peers to decide on.