"Them" are really saying they couldn't achieve what you are proposing to do. "Them" are about the last people you want to take advice from. "Them" would still be living in caves if it weren't for those who ignored their downer views.