Yep! Though if you want a social experience hot tubs and saunas are a nice add. Here is a research paper showing the hot water immersion raises your core temperature more effectively than sauna. https://journals.physiology.org/doi/full/10.1152/ajpregu.00012.2025

You could also go to a public sauna