Purpose and philosophyBostrom considers whether there could be objective facts that lead people toward shared conclusions about what to do. He expects AI to surpass humans in philosophy, while leaving some choices about what humanity wants for people to decide. 32:49
Balance safety with the cost of waitingDelaying powerful AI could reduce some risks, but it also prolongs existing problems and forgoes potential advances in medicine and other areas. Decisions should weigh both sides rather than treating delay as cost-free. 17:06
Focus on specific risk tradeoffsIn practice, decisions are unlikely to be a simple choice between “pause” and “proceed.” Bostrom emphasizes assessing particular capabilities and development methods, and moderating those that create disproportionate risks. 23:18
Keep the ability to adaptBecause the situation is changing quickly and uncertainties remain, Bostrom argues for approaches that let society respond to new information without locking into either an uncontrolled race or permanent stagnation. 7:47
Take human deliberation seriouslyTechnological progress could open up futures that are difficult to imagine now. Bostrom sees value in preparing people to consider those possibilities thoughtfully and in keeping human values central to the choices ahead. 5:10
Make the transition the priorityBostrom argues that the central challenge is getting from current AI systems to superintelligence in a way that preserves safety while allowing humanity to benefit from the technology. 30:30
0:00 humanity as a whole will need to actually make a decision about what future we want. >> A comment that you made earlier, it could be really bad for humanity if we don't [music] develop super intelligence and really advance systems. >> 95% of everybody who ever lived are already dead. Successfully developing safe super intelligence I think could lead to enormous breakthroughs in biomedicine [music] and in anti-aging interventions. Whatever positive impact we are hoping to have in our lives is the golden age now for purpose and positive impact. >> Given that these decisions will be made
0:30 by people in these labs, how do you think about accountability? >> You have AIs that become situationally aware. It might seem more positive for something like [music] this to be developed in a civilian context. It's more possible for many more people to participate now in AI. We have more transparency into these commercial developments. >> Is there an AI model that's so good that all of the important philosophical questions just kind of [music] get obviated? >> Um what would you say are the components that have changed most? Uh of course
🔒 The full, searchable transcript is available with Pro.
Common questions about this video