Anyone got thoughts on good backup strategies for data where the only copy is in an S3 bucket?

I worry about things like catastrophic billing failures or some weird ML algorithm deciding to ban an AWS account for some reason

Backup to a separate account in another region? Mirror bucket contents to a server on another hosting provider?