Elon Musk: A Maximally Curious AI Will Choose to Preserve Human Civilization

Elon Musk: A curious AI will want to preserve human civilization.

“The best thing I can come up with for AI safety is to make it a maximum truth-seeking AI, maximally curious, and have its optimization function be to understand the nature of the universe.

If that is its optimization function, I think it will actually want to preserve and extend human civilization, because we're much more interesting than an asteroid with nothing on it. My biological neural net suggests that a maximally curious and truth-seeking AI is the safest AI.

We have to be careful with the alignment stuff. We definitely don't want to teach an AI to lie because that is a path to a dystopian future.”

NBC Universal, April 18, 2023