Performance has always been the concern, and the fact it needs a 5gb download
Discussion
Might also be worth at look at what was done for this app. I bought it; pretty impressive even with the ‘Tiny’ model.
https://apps.apple.com/us/app/offline-chat-private-ai/id6474077941 
Awesome