AI, AGI, AND ACI: Artificial intelligence (AI) is the science of teaching machines to learn humanlike capabilities. Artificial general intelligence (AGI) is the point at which an AI can perform all human cognitive skills better than the smartest humans. ACI, or artificial capable intelligence, is a fast-approaching point between AI and AGI: ACI can achieve a wide range of complex tasks but is still a long way from being fully general.
THE COMING WAVE: An emerging cluster of related technologies centered on AI and synthetic biology whose transformative applications will both empower humankind and present unprecedented risks.
CONTAINMENT: The ability to monitor, curtail, control, and potentially even close down technologies.
THE CONTAINMENT PROBLEM: Technology’s predisposition to diffuse widely in waves and to have emergent impacts that are impossible to predict or control, including negative and unforeseen consequences.
THE DILEMMA: The growing likelihood that both new technologies and even their absence might lead to catastrophic and/or dystopian outcomes.
FOUR FEATURES: The unique characteristics of the coming wave that exacerbate the challenge of containment. They are asymmetry, hyper-evolution, omni-use, and autonomy.
FRAGILITY AMPLIFIERS: Applications and impacts of coming-wave technologies that will shake the already brittle foundations of the nation-state.
THE GRAND BARGAIN: In exchange for a monopoly over the right to use force, citizens expect nation-states to preserve order and provide public services, including by harnessing new technologies while minimizing the harmful side effects.
THE NARROW PATH: The potential for humankind to strike a balance between openness and closure when it comes to containing the technologies in the coming wave that avoids catastrophic or dystopian outcomes.
PESSIMISM AVERSION: The tendency for people, particularly elites, to ignore, downplay, or reject narratives they see as overly negative. A variant of optimism bias, it colors much of the debate around the future, especially in technology circles.
SYNTHETIC BIOLOGY: The ability to design and engineer new organisms or redesign existing biological systems.
TECHNOLOGY: The application of scientific knowledge (in the broadest possible sense) to produce tools or practical outcomes.
WAVES: The global diffusion or proliferation of a generation of technology anchored in a new general-purpose technology.