At what point are you telling an AI not to think and just use a calculator for everything?

How far do we take this?

Is there value in AI being fallable in favour of not making a bazillion web calls just like there is value in teaching people things more than where to look to find information?