My point is to spin up a podman container running a fresh install of whatever distro best fits any given experiment at any given time.

You can use containers as if they were lightweight VMs to fuck around, no need for relying on premade container images.