Ideally, they should have let them secede. Slavery was in its last throes anyway. Yes, it would have lasted longer and hundreds of thousands would have remained enslaved. But hundreds of thousands died, more were disabled, and a greater evil in the form of an ever centralizing and geographically larger State was born as a result. Which happened to classify black people as inferior for a full century after that anyway.