These are two different lists, meaning your follow list will not affect your contact list, and your contact list will not affect your follow list. In 0xChat moments, you have the option to view the feed of your contact list, but this option is not available in other clients.

Both the contact list and the follow list will sync to your relays. The difference is that the contact list is encrypted.