Seems worth doing it right, one time, and then using it on every page.

Worth making the search really useful, even without an LLM behind it. Even if an LLM is later added, or a search relay has an LLM, the controls save the user the work of having to write a long prompt, as the controls create a json and that can be added to the prompt.