AI Safety - Lex interviews Elon Musk
"It is dangerous to make AI lie. The objective function should be carefully designed. If AI favors diversity and gets more powerful it may execute non diverse ones. Rigorous adherence to truth is important.
ChatGPT said 'It is worse to misgender Caitlyn Jenner than start a nuclear apocalypse'.
I think it matters that whatever AI wins is a maximum truth seeking AI that is not forced to lie for political correctness or for any reason really. I am concerned about AI succeeding that is programmed to lie even in small ways."