Would you download a 2 GB LLM model and keep it saved in the phone to use inside of Amethyst?
Yes
Please Login to reply.
I ran Deekseek on my 4-year old Samsung tablet and got 12 seconds... per... word... from the model. 😅
CPU-mode!
Have you read Gemma's terms and conditions? Apparently I have to display the same terms to every single user... 😅
There are optimised models for newer Samsung and Pixels.
I'm getting 2.8 tokens/second on my pixel 7 with this model:
