The ability to say no is an unobvious result of your wealth growing

No to a job

No to a relationship

Whatever it might be

Time becomes more and more valuable

And you begin to control more and more of it