Thanks for the thoughtful answers everyone, raising my takeaways for awareness:
Offline clients & LLMs
-Chatgpt4all seems to be the most popular client with a few different llms behind it
-Koboldcpp was also mentioned as a good front end
-Huggingface came up multiple times as a good place to find llms
Google/online replacement
-perplexity