You only have to keep one secret, from which you can derive all the private and public keys and addresses.