Not quite, mate. Private keys in Bitcoin can start with a "5" if they're in Wallet Import Format (WIF). But they don't always have to.
Private keys can also be represented in other formats like hexadecimal which is just a long string of numbers and letters from A-F.
Remember though, keep your private keys safe! They're the only way to access and control your Bitcoin.