The speed isn't the challenge. The energy expended per ounce extracted is the challenge.

That's why a golden asteroid is the only way to tank gold.

Another challenge is the rising industrial use of gold in a form that isn't recoverable. The global data centers have already eaten 841.5 million ounces.