Midjourney will be quick and easier to get high quality results, but less flexible. Your current GPU can work with stable diffusion but you'll need some extra options to reduce VRAM usage and the generations will be slow. Stable diffusion has enough of a learning curve that rapid iterations really help figuring it out.

A 3060 12GB would be a good, relatively cheap GPU for self-hosted stable diffusion.