You are 100% correct. Brute force guessing of private keys has always been and will always be a possibility. Once we allow this to be justification for stealing (aka freezing) coins, Bitcoin will cease to provide any assurance of property ownership. Your coins will only be secure as long as the anointed high priests of Bitcoin core say so.