It’s funny you mention that, actually, because Ham is the ancestor of the Africans as well as the Canaanites:

“And Ham, the father of Canaan, saw the nakedness of his father, and told his two brethren without. And Shem and Japheth took a garment, and laid it upon both their shoulders, and went backward, and covered the nakedness of their father; and their faces were backward, and they saw not their father's nakedness. And Noah awoke from his wine, and knew what his younger son had done unto him. And he said, Cursed be Canaan; a servant of servants shall he be unto his brethren.”