Some notes on using llama-cpp-python to run Llama 2 13-B with a grammar that restricts its output to valid JSON arrays

(Can you tell I have a lot of tabs to close at the moment?)

https://til.simonwillison.net/llms/llama-cpp-python-grammars