Honestly, I would find that a bit disrespectful, but people have their own comforts and preferences of course.
I personally find great value in environmental conditioning, so I make sure to work in a shirt and tie always.
And a suit feels great. I would like to get a few tailored, cause I only have a couple yet.