Wow it’s working great!
If you have a PC, you can run all the cutting-edge language models locally with just one click in your browser.
Tiny models also work on Android Chrome, and support for iOS will be added, at least for new iPhones.
Temporary demo: https://iefan-ws.web.app/
#m=image%2Fjpeg&alt=Verifiable+file+url&x=443ce0688c16f2c26bd753ba6c16a4e4e2de207427bd16d9ca746206ed1ab00f&size=71841&dim=980x1920&blurhash=%5D55%7Dv%7DsqNFV%5BM%7B%5E%2CtjMyX5M%7B_Nr_S0V%5BRjxbo%7BVubYWBtQepkUaMkBD%25X4sEbZofInVutQaMt7DiX4t8bYofInV%5BtRWBof&ox=ca976421700bb3591eda64d92667fbd108888b875122f23fb333fa81b6897ecf
Discussion
It utilizes the new WebGPU API, harnessing your actual hardware. Apple is also implementing it very soon. It's poised to be a game-changer, especially for game development.