The best I've been able to explain to the complete beginner, at least in the Bitcoin context, is that your public key is like your bank account number, and your private key is like your ATM PIN.

It's not a perfect analogy but it gets across the notion that a pubkey is what you give people, and a privkey is what you hold secret and gives you access to do things.