you can only trust it so far as it's within an hour or so of the actual time it was mined. but there is an extranonce field for miners to use that gets incremented each attempt as well usually.

the consensus does not disallow out of order timestamps, only the previous block hash matters.