You can try running an small LLM (Mamba 130m parameters, ~500MB) in your browser with WebAssembly:

https://swfsql.github.io/mamba-minimal-dfdx-example/