I think that in practice randomness is usually injected (on purpose) so that you would not get the exact same response with the same prompt, but in theory if you turn the temperature down to zero (no randomness) then it becomes fully deterministic.