The key is deleted from memory. This is not to avoid loading the key, but avoid storing it in the device for other people to find.