Have you read Intellectuals and Society by Thomas Sowell? It is a very good book. Quite readable, but also very dense. Sam Harris is the archetype for that book.