It’s not inconceivable to think that one day we’ll have phones powerful enough and batteries efficient enough that LLMs can run on them in a consumer friendly manner.
The insistence on moving everything to the ‘cloud’ (someone else’s computer) is shortsighted.