I went with Njalla, a privacy oriented VPS provider run by the PirateBay folks. They accept payment in Bitcoin and no KYC.