Real talk I’m probably going to program this button to activate an off-line and fine tuned version of #llama2 or whatever cutting edge local #LLM is available
#ios #locallm
nostr:note1a6cctctqs9e3hl5097cc3p0cm9nmflnuf7jl4zghygthj0uetccqz3jvl3
Discussion
Someone could optimize it for the A16 neural cores too. 🤩
Here’s a cool iOS LLM client I learned about yesterday
Now imagine the 15 pros’ processing power plus a few more months of advancement on the LLMs
$10 can fine tune own and run it from home and chat with your documents.
What are you using to chat with documents?
This installs all the underlying pieces.
Thank you
Can also test out here 🤙