I might actually have a slightly different take on that. When I care about someone, I often take time to "arrive" at the answer not only intellectually but also emotionally, and perhaps even deeper. Taking time in this case, in my eyes, is a sign of greater respect than a quick answer.
But it depends on situation and context.