0:00 My guest today is Paul Christiano. He is the head of the Alignment Research Center. He recently joined OpenAI’s board. Before that, he was the head of the US Government AI Safety Institute, and before that, he led alignment at OpenAI, where he helped invent RLHF. Paul, what is your assessment of our situation today? A couple things are on my mind, especially over the last few weeks. Probably the most salient possibility is that we seem to be on this trajectory to build very,
0:32 very powerful AI, potentially very, very soon. If you asked me, I’d say there’s a reasonable chance that in a year we will produce AI systems much better than humans at almost everything, where humans would have very little chance of competing with them or controlling them. That’s the first big thing on my mind. I think that puts us in a potentially really dangerous situation, even in the short term. It’s quite likely that if we have a rapid intelligence explosion leading to superintelligence, at some point during that process we’ll be unable to control the AI systems we’re producing.
🔒 The full, searchable transcript is available with Pro.
Common questions about this video