Cool trick: it exposes an OpenAI compatible API so you can also use it in place of tools that demand OpenAI access.
Discussion
What apps would you be using that need OpenAI access for example?
I use it with some IDE or Obsidian plugins. Bye bye surveillance machine, hello private AI!
Also nice because it works totally offline for when I want to be off the grid for a minute.
Here's an interesting repo that runs offline using LMStudio: