Depends what your tolerance for hallucinations is. If you want to eliminate them as much as possible you should set to 0.0

I could see a case for a little bit of temperature to keep him more entertaining tho :P