I use it mainly to debug software and explore languages' documentation. Sometimes to fine-tune the translation of content.

AI generally works quite well for these tasks.

I cannot say how well this open models are compared to the "classic" chatgpt ones (I used only the free 3.5), because I just started to use them.

Finally, the possibility to privately feed local documents in these offline instance is really interesting.