I think we are talking about different things.
There is a difference between potential infinity, which refers to a procedure that gets closer and closer to, but never quite reaches, an infinite end, and an actual infinity, or completed infinity. An infinity that one actually reaches; the process is already done.
Dealing with a mathematical concept of a complete infinity, such as complete sets of natural or real numbers is different to the question of whether infinite things exist physically in nature.