Definition
Existential risk from artificial intelligence, or AI x-risk, refers to the idea that substantial progress in artificial general intelligence (AGI) could lead to human extinction or an irreversible global catastrophe.
Related concepts
2011 end times prediction2012 phenomenon2 Esdras80,000 HoursAI-assisted software developmentAI Futures ProjectAI Now InstituteAI alignmentAI boomAI bubbleAI capability controlAI data centerAI safetyAI takeoverAI winterAbomination of desolationAgainst Malaria FoundationAid effectivenessAl-Masih ad-DajjalAlan TuringAlien invasionAlignment Research CenterAlphaZeroAmazon (company)Amazon Web ServicesAmillennialismAndrew NgAnimal Charity EvaluatorsAnimal Ethics (organization)Anoxic eventAnthropicAnthropogenic hazardAnthropomorphismAntichristAntimatter weaponAntónio GuterresApocalypseApocalyptic and post-apocalyptic fictionApocalyptic literatureApocalypticismAppeal to probabilityApplications of artificial intelligenceArmageddonArmilusArtificial Intelligence ActArtificial consciousnessArtificial general intelligenceArtificial intelligenceArtificial intelligence arms raceArtificial intelligence artArtificial intelligence controversiesArtificial intelligence in governmentArtificial intelligence in healthcareArtificial intelligence in industryArtificial intelligence in mental healthArtificial intelligence systems integrationAsilomar AI PrinciplesAsilomar Conference on Beneficial AIAsteroid impact avoidanceAsteroid impact predictionAtoosa KasirzadehAutomated decision-makingAutomated planning and schedulingAxonBBCBBC NewsBaiduBayesian networkBeast of the EarthBig CrunchBig RipBill GatesBill JoyBiodiversity lossBiological agentBiological warfareBiotechnology riskBioterrorismBitter lessonBlood moon prophecyBook of DanielBook of EnochBook of RevelationBrian ChristianBrian TomasikBuddhist eschatologyBusiness InsiderButlerian JihadCari TunaCascade effect (ecology)Cataclysmic pole shift hypothesisCenter for AI SafetyCenter for Applied RationalityCenter for High Impact PhilanthropyCenter for Human-Compatible AICenter for Human-Compatible Artificial IntelligenceCentre for Effective AltruismCentre for Enabling EA Learning & ResearchCentre for the Study of Existential RiskChain-of-thought promptingChaos theoryCharity assessmentChemical warfareChicago TribuneChinese roomChristian eschatologyChunking (psychology)Claude (language model)Climate apocalypseClimate changeClimate change and civilizational collapseClimate fictionClimate sensitivityClimate variability and changeCobalt bombCoefficient GivingCollapsologyColony collapse disorderCommunications of the ACMComputational complexityComputer scientistComputer visionConvention on Certain Conventional WeaponsCoronal mass ejectionCosmological phase transitionCoup d'étatCultured meatCyberattackCybercrimeCybergeddonCyberterrorismCyberwarfareDAIR InstituteDan HendrycksDaniel DeweyDaniel Kokotajlo (researcher)Dario AmodeiDarwin among the MachinesDead HandDeceptive alignmentDecline in amphibian populationsDecline in insect populationsDecline of the DharmaDeclinismDeepMindDeep learningDeepfakeDeepfake pornographyDefaunationDeforestationDemandingness objectionDemis HassabisDerek ParfitDesertificationDevelopment Media InternationalDhu'l-QarnaynDhu'l-SuwayqataynDick CheneyDisability-adjusted life yearDisasterDisaster filmDisease burdenDistributional cost-effectiveness analysisDo You Trust This Computer?Doing Good BetterDoomsday ClockDoomsday argumentDoomsday deviceDual-use technologyDustin MoskovitzDysgenicsEarning to giveEarth ChangesEarth Overshoot DayEcocideEconomic collapseEconomic depressionEconomic stabilityEcosystem collapseEdge.orgEffective Altruism GlobalEffective accelerationismEffective altruismElectromagnetic pulseEliezer YudkowskyElon MuskEmily M. BenderEnvironmental degradationEnvironmental issues with coral reefsEqual consideration of interestsErewhonEric HorvitzEschatologyEthics of artificial intelligenceEudaimoniaEvents of RevelationEvidence ActionEvolutionary algorithmExecutive Order 14110Existential riskExistential risk from artificial general intelligenceExistential risk studiesExtinctionExtinction eventExtinction risk from climate changeFalse vacuumFamine, Affluence, and MoralityFaunalyticsFile copyingFinancial crisisFine-tuning (deep learning)Fistula FoundationFlood basaltForbesFounders PledgeFour Horsemen of the ApocalypseFrank WilczekFrashokeretiFriendly artificial intelligenceFrontier modelFuture of EarthFuture of Humanity InstituteFuture of Life InstituteFuture of an expanding universeFuturism (Christianity)GPT-4Gamma-ray burstGeneral game playingGenerative artificial intelligenceGenerative audioGenetic erosionGenetic pollutionGeoffrey HintonGeomagnetic stormGiveDirectlyGiveWellGiving MultiplierGiving What We CanGlobal catastrophic riskGlobal dimmingGlobal healthGlobal terrestrial stillingGlossary of artificial intelligenceGo (game)Gog and MagogGood Food FundGood VenturesGoogleGoogle DeepMindGoogle Gemini image generation controversyGray gooGreat ApostasyGreat TribulationGrok sexual deepfake scandalGroup of Governmental Experts on Lethal Autonomous Weapons SystemsHabitat destructionHazardHeat death of the universeHertzHilary GreavesHindu eschatologyHistoricism (Christianity)Historicist interpretations of the Book of RevelationHistory of artificial intelligenceHolden KarnofskyHolocene extinctionHuman CompatibleHuman brainHuman enhancementHuman extinctionHuman impact on marine lifeHuman impact on the environmentHuman intelligenceHuman overpopulationHuman speciesHuman–AI interactionHuw PriceHybrid intelligent systemHypercaneHypernovaI. J. GoodIce ageIdealism (Christian eschatology)If Anyone Builds It, Everyone DiesIlya SutskeverImpact eventImpact winterIncremental cost-effectiveness ratioIndustrial applications of nanotechnologyInstitute for Ethics and Emerging TechnologiesInstrumental and intrinsic valueInstrumental convergenceIntelligence explosionIntelligent agentIntensive animal farmingIntergalactic starInternational Institute for Management DevelopmentInternational relations theoryInterplanetary contaminationIs-ought distinctionIslamic eschatologyIsrafilIt's the Most Terrible Time of the YearJaan TallinnJan LeikeJewish eschatologyJoe BidenJohn McGinnisJonathan GropperJournal of Evolution and TechnologyK. Eric DrexlerKali YugaKalkiKatechonKelsey PiperKevin Kelly (editor)Kinetic bombardmentKinetic energy weaponKnowledge representation and reasoningLand consumptionLand degradationLand surface effects on climateLand useLarge language modelLast JudgmentLethal autonomous weaponLeverhulme Centre for the Future of IntelligenceLife extensionList of apocalyptic and post-apocalyptic fictionList of apocalyptic filmsList of artificial intelligence projectsList of dates predicted for apocalyptic eventsList of disaster filmsList of extinction eventsLiv BoereeLiving High and Letting DieLongtermismMETRMachine Intelligence Research InstituteMachine ethicsMachine learningMachine learning in bioinformaticsMachine learning in earth sciencesMachine learning in physicsMachine translationMahdiMaitreyaMalaria ConsortiumMalaria preventionMalthusianismMan of sinMargaret Mitchell (scientist)Marginal utilityMark ZuckerbergMartin Ford (author)Martin ReesMarvin MinskyMass dewormingMass mortality eventMax MoreMax TegmarkMechanistic interpretabilityMercy for AnimalsMessiahMessiah in JudaismMessianic AgeMessianismMeta PlatformsMichael ChorostMicro black holeMicronovaMicrosoftMillenarianismMillennialismMolecular nanotechnologyMoral circle expansionMoral progressMoral realismMountain gorillaMusic and artificial intelligenceMutually assured destructionNATONBC NewsNanotechnologyNate SoaresNational Public RadioNatural language processingNature (journal)Near-Earth objectNear-Earth supernovaNeglected tropical diseasesNemesis (hypothetical star)NeuronNew Earth (Christianity)New JerusalemNew World Order conspiracy theoryNewsweekNibiru cataclysmNick BostromNobel PrizeNorthwestern University Law ReviewNuclear Threat InitiativeNuclear famineNuclear holocaustNuclear warfareNuclear winterOcean acidificationOlivet DiscourseOpen-source artificial intelligenceOpenAIOpenAI o1Open Letter on Artificial IntelligenceOpen letter on artificial intelligenceOur Final InventionOverexploitationOverfishingOverpopulationOwain EvansOzone depletionP(doom)PandemicPaul ChristianoPauseAIPeter NorvigPeter SingerPeter ThielPhilosophy CompassPhilosophy of artificial intelligencePhysica ScriptaPoliticization of sciencePollinator declinePostmillennialismPosttribulation rapturePotentially hazardous objectPovertyPractical EthicsPremillennialismPreterismPrime Minister of the United KingdomProgress in artificial intelligenceProphecy of Seventy WeeksProton decayPsychological barriers to effective altruismQa'im Al MuhammadQuality-adjusted life yearRace to the bottomRagnarökRaising for Effective GivingRansomwareRaptureRecursive self-improvementRegulation of algorithmsRegulation of artificial intelligenceRegulation of artificial intelligence in the United StatesRemoval of Sam Altman from OpenAIResource depletionRiotRishi SunakRisk of astronomical sufferingRobin HansonRobot ethicsRoboticsRogue planetRoman YampolskiySafe Superintelligence Inc.Safety of high-energy particle collision experimentsSam AltmanSam Bankman-FriedSam HarrisSamuel Butler (novelist)SaoshyantSea level riseSecond ComingSecond Epistle to the ThessaloniansSecretary-General of the United NationsSelf-indication assumption doomsday argument rebuttalSelf-referencing doomsday argument rebuttalSentienceSentience InstituteSeth BaumSeven bowlsSeven sealsSeven trumpetsShane LeggSkeptic (US magazine)Slate Star CodexSlaughterbotsSocial crisisSocietal collapseSolar flareSon of perditionSpeed of electricitySpeed of lightState collapseStatement on AI RiskStatement on AI risk of extinctionStellar collisionStephen HawkingSteve OmohundroSteven PinkerStop AIStrangeletStuart J. RussellSufyaniSun microsystemsSuperintelligenceSupervolcanoSurvivalismSymbolic artificial intelligenceSynthetic biologySynthetic intelligenceSystem accidentTay (chatbot)Taylor Swift deepfake pornography controversyTechnological singularityTerminator (franchise)The Alignment ProblemThe Beast (Revelation)The EconomistThe End of Animal FarmingThe Good Food InstituteThe GuardianThe Humane LeagueThe Independent (UK)The Life You Can SaveThe Most Good You Can DoThe New Yorker (magazine)The Sheep and the GoatsThe Telegraph (UK)Third TempleThéâtre D'opéra SpatialTimeline of artificial intelligenceTimeline of artificial intelligence risks in global financeTimnit GebruTipping points in the climate systemToby OrdTranshumanismTuring testTwo witnessesUltimate fate of the universeUncanny valleyUnintended consequencesUnited NationsUnited Nations Security CouncilUniversal resurrectionUnlimit HealthUtilitarianismVanity Fair (magazine)Venture philanthropyVerneshotVicarious (company)Virtual black holeVoiceverse NFT plagiarism scandalVolcanic winterVox (website)Vulnerable world hypothesisW. W. Norton & CompanyWar in HeavenWater pollutionWater scarcityWhat We Owe the FutureWhore of BabylonWhy The Future Doesn't Need UsWild Animal InitiativeWild animal sufferingWilliam MacAskillWired (magazine)Working memoryWorld War IIIWorld to comeXAI (company)Yann LeCunYear 2000 problemYear 2038 problemYew-Kwang NgYoshua BengioYouGovZombieZombie apocalypse
24 concepts already in your glossary