My advice is to get a better razer and cut with the hair instead of against it if you have irritation.
if it's just dry skin you're worried about tallow, coconut oil, extra virgin olive oil, etc. are all pretty much just as good as each other, find what you prefer, and yes you're meant to rinse it back off after applying