Maybe keep a crummy little iphone se or cheap android on wifi only, for just those times you need to touch filthy fiat? Keep it in a faraday bag otherwise?
Discussion
I'd say first see if the bank offers a hardware tokens to do banking trough a website. Mine has that and I use that. If not, thats plan B.