I would tend to agree, there were also free blacks during slavery as well. Manumission was used more than people know.