Only if he agrees to the notion that you've married him. Partner can mean many things.

I agree with what you said about them always being able to marry because that's true under common law. However, they have not always been able to until fairly recent under statutory marriage i.e marriage licenses.