I think Mises is wrong here, Rothbard and especially Voskuil have a more nuanced understanding of it.
The hoarder isn't postponing consumption. He's consuming NOW: consuming the services of the hoarded good. Security is a present satisfaction. Optionality is a present satisfaction. Peace of mind is a present satisfaction. These aren't future goods; they're present goods produced by the act of holding. The hoarder has purchased something with his capital, he's just purchased liquidity services rather than apples.
The boat case proves rather than undermines this. When Crusoe stores coconuts to eat while building, he IS engaging in temporal exchange, with himself. Present-Crusoe lends to future-boat-building-Crusoe. The "interest" is the boat. He exchanges present consumption for a future good plus return. This differs categorically from storing coconuts indefinitely for security with no productive deployment. The former is investment; the latter is hoarding. The distinction doesn't dissolve in autarky; it becomes intra-personal rather than inter-personal.
Time preference is revealed by the minimum rate at which you'll exchange present for future goods. A purely psychological "orientation toward the future" that never manifests in willingness to lend isn't economically meaningful because it produces no observable market phenomena. The HODLer who won't lend at any rate has revealed infinite time preference in the only sense that matters economically: no offered future return compensates him for parting with present capital.