Culture

The Rise of the “Scenario,” a Trendy Way of Forecasting Our Dystopian Future

“情景预测”的崛起:预测反乌托邦未来的时髦方式

In “Biological War,” Annie Jacobsen imagines society collapsing from a man-made plague—part of a wave of such prophecies. But what do we miss when we try to predict the future?

在《生物战争》中,安妮·雅各布森想象社会因人为瘟疫而崩溃——这是此类预言浪潮的一部分。但当我们试图预测未来时,我们错过了什么?

By Gideon Lewis-Kraus||17 min read
“情景预测”的崛起:预测反乌托邦未来的时髦方式

In the fall of 1989, a select group of Soviet scientists was summoned to Obolensk, a secluded municipality on Moscow’s periphery, and gathered at what appeared to be an insane asylum to discuss a pioneering technique for mass murder. If someone had been observing the institutional activity from space—a distinctly non-theoretical possibility—they might have seen a shuffle of patients roaming the grounds or playing volleyball in their pajamas. These were actors, hired to play the disturbed as a cover story for something even more disturbing. The eight-story glass building at the center of the complex, which had putatively been devoted to vaccine manufacturing, was in fact a highly classified defense facility. Its remit was called Biopreparat, or “biological preparations”—what one participant later described as “the most ambitious Soviet arms program since the development of the hydrogen bomb.” The most recent experiments there had at last demonstrated the viability of a weapon that could wipe out entire enemy populations without leaving a scratch on their infrastructure. It was a pathogen genetically engineered to spread within hours, to kill within days, and to resist all existing treatment.

1989年秋,一批经过挑选的苏联科学家被召集到莫斯科郊外一处僻静的市镇奥博连斯克(Obolensk),在一栋看似精神病院的建筑里,讨论一种大规模杀人的开创性技术。如果有人从太空观察这所机构的活动——这绝非天方夜谭——可能会看到一群病人在院子里闲逛,或穿着睡衣打排球。这些人是演员,受雇扮演精神病人,为一件更令人不安的事打掩护。建筑群中央那栋八层玻璃大楼,对外宣称是疫苗生产厂,实则是一个高度机密的国防设施。它的任务代号叫“生物制剂”(Biopreparat),一位参与者后来形容它是“自氢弹研发以来,苏联最野心勃勃的武器计划”。那里最近的实验,终于验证了一种武器的可行性:它能消灭全部敌方人口,却不伤及对方的基础设施分毫。这是一种经过基因工程改造的病原体,能在数小时内传播,数天内致死,并能抵抗所有现有疗法。

The program was a treaty violation. In 1969, President Richard Nixon had unilaterally dissolved the U.S.’s covert bioweapons initiative, and, over the next six years, the international community had ratified the Biological Weapons Convention, which prohibited the incubation of agents “repugnant to the conscience of mankind.” It was a pact to regulate microscopic organisms, but it had a loophole large enough to drive an aircraft carrier through: there was an exemption for developing bioweapons for “defensive” purposes. The carve-out was troubling but also sort of moot, because the treaty had no meaningful enforcement mechanism. Presumably the Soviets weren’t the only defectors.

这项计划违反了国际条约。1969年,理查德·尼克松总统单方面解散了美国的秘密生物武器计划。此后六年里,国际社会批准了《禁止生物武器公约》,禁止培育“违背人类良知”的制剂。这是一份旨在管控微生物的公约,却有一个大到足以让航空母舰驶过的漏洞:它允许为“防御”目的开发生物武器。这个例外条款令人不安,但某种程度上也无关紧要,因为该条约缺乏有效的执行机制。想必苏联并非唯一的违约者。

The achievement discussed in Obolensk was a “chimera,” or a designer pathogen spliced together from multiple sources. Such a thing had been feasible in principle for almost two decades. In the initial stages of infection, the pathogen would resemble a known illness—one vulnerable to standard vaccines or drug remedies. The administration of antibiotics would trigger a second pathogen that had been occluded inside the first. An infection that was left untreated was excruciating and fatal. A treated infection was differently excruciating and also fatal. The first wave of an epidemic would kill a lot of people. The second wave would terminally undermine all public trust in an enemy regime. Mass casualties of disease were the prelude to mass casualties of chaos.

在奥博连斯克讨论的成果是一种“嵌合体”(chimera),即一种由多种来源拼接而成的定制病原体。这种东西在理论上可行,已有近二十年。在感染初期,这种病原体会表现得像一种已知疾病——一种对标准疫苗或药物疗法敏感的疾病。一旦使用抗生素,就会触发隐藏在第一种病原体内的第二种病原体。未经治疗的感染痛苦不堪,足以致命。经过治疗的感染则以另一种方式痛苦不堪,同样致命。第一波疫情会杀死很多人。第二波疫情则会从根本上摧毁公众对敌方政权的所有信任。疾病造成的大规模伤亡,将是混乱导致的大规模伤亡的前奏。

Much of the Biopreparat work was carried out in the Siberian forest’s State Scientific Center of Virology and Biotechnology Vector. A maximum-containment facility for biological research, or BSL-4 lab, Vector was at the time one of only two official repositories of live smallpox bacteria. (The other was the Centers for Disease Control and Prevention, in Atlanta.) Its freezers also contained samples of Ebola, Marburg, and other viral agents. As the intelligence community has long been aware, the Russian Federation took up where the Soviets left off. On September 6, 2019, there was an explosion at Vector, and one worker was taken to the hospital with third-degree burns. Russian officials attributed the accident to a faulty gas tank, and firefighters extinguished the blaze before it posed an existential threat.

“生物制剂”计划的大部分工作,是在西伯利亚森林里的国家病毒学与生物技术研究中心“矢量”(Vector)完成的。作为一个最高防护级别的生物研究设施,即BSL-4实验室,“矢量”当时是全球仅有的两个活体天花病毒官方储存库之一(另一个是亚特兰大的美国疾病控制与预防中心)。它的冷冻库里还存放着埃博拉、马尔堡及其他病毒制剂的样本。正如情报界长期所知,俄罗斯联邦接手了苏联未竟的事业。2019年9月6日,“矢量”发生爆炸,一名工人因三度烧伤被送往医院。俄罗斯官员将事故归咎于一个故障的气罐,消防员在火势构成生存威胁之前将其扑灭。

All of this, so far, is true. It is the real-life preamble to Annie Jacobsen’s “Biological War: A Scenario.” The new book is a sequel of sorts to Jacobsen’s “Nuclear War,” and it, like its predecessor, is a chimera. It combines strains of investigative reporting, drawn from both historical archives and contemporary sources, and strains of reality-adjacent but speculative fiction. As the author puts it, “The scenario that follows—chronicling the hours, days, and weeks after the release into society of a genetically modified biological weapon—is based on facts and projections sourced from exclusive interviews with presidential advisors, Defense Department officials, medical doctors, microbiologists, epidemiologists, diplomats, congresspeople, C.I.A. officers who work to counter weapons of mass destruction, Federal Emergency Management officials, and first responders who train for mass-casualty biological incidents and attacks.” It also, she continues, “echoes biological war scenarios run by the Pentagon.”

以上这些,到目前为止,都是真实的。这是安妮·雅各布森(Annie Jacobsen)新书《生物战争:一种推演》(Biological War: A Scenario)在现实中的前奏。这本新书在某种程度上是雅各布森前作《核战争》的续篇,它和前者一样,也是一个“嵌合体”。它融合了源自历史档案和当代信源的调查报道,以及贴近现实但又属于推演虚构的叙事。正如作者所说:“接下来的推演——记录了一种基因改造生物武器被释放到社会中之后数小时、数天和数周内发生的事——基于事实和预测,这些事实和预测来自对总统顾问、国防部官员、医生、微生物学家、流行病学家、外交官、国会议员、负责对抗大规模杀伤性武器的中情局官员、联邦紧急事务管理局官员,以及为大规模伤亡生物事件和袭击进行训练的急救人员的独家采访。”她接着说,这本书也“呼应了五角大楼进行的生物战争推演”。

The narrative begins with another fire at Vector. This time it goes uncontained. The virus spreads to the United States in less than a week, and the Administration imposes martial law. Then the state collapses. The President is trapped alone inside a bunker, maybe forever. The surface landscape is patrolled by perhaps a million armed men in full biohazard gear. Almost everyone else is dead. No spoiler alert is necessary. Jacobsen herself warns, at the end of her introduction, that the book “ends in dystopia.”

叙事以“矢量”的又一场火灾开始。这一次,火势未能得到控制。病毒在不到一周内传播到美国,政府实施戒严。然后国家崩溃了。总统一人被困在地堡里,或许永远如此。地表上,可能有上百万身着全套生物防护装备的武装人员在巡逻。其他几乎所有人都死了。无需剧透警告。雅各布森本人在引言结尾就警告说,这本书“以反乌托邦告终”。

The hypothetical events that unfold along the way are grounded in details that are, for the most part, highly plausible; she intermittently breaks the main narrative to provide the context of a relevant “History Lesson.” The danger is that any account of doomsday that feels credible can also feel domesticated. The horrors of uncertainty are translated into the language of manageable risk—risk that somebody, somewhere, has the responsibility and foresight to manage. In her acknowledgments, Jacobsen pauses to remind her readers that her tale’s painstaking realism is just a literary device. She has titled the book “Biological War: A Scenario,” not “Biological War: The Only Scenario.” Some of the alternatives, she continues, are “far worse.”

在此过程中展开的虚构事件,其细节大多具有很高的可信度;她不时打断主线叙事,提供相关的“历史课”作为背景。危险之处在于,任何关于世界末日的叙述,只要感觉可信,也可能让人觉得稀松平常。不确定性的恐怖被转化成了可管控风险的语言——这种风险,总有人、在某处,有责任和远见去管理。雅各布森在致谢中停下来提醒读者,她故事中那种煞费苦心的现实主义只是一种文学手法。她将这本书命名为《生物战争:一种推演》,而非《生物战争:唯一的推演》。她接着说,其他一些可能的推演“要糟糕得多”。

This particular scenario opens at a “crowded disco” in Frankfurt. An American traveller is passing through on a layover from a hunting trip to Siberia, where he was infected by a strain of the pneumonic plague engineered “to kill human beings in the most atrocious ways.” Had he been exposed to a more run-of-the-mill pneumonic plague, symptom onset would have already consigned him to bed. As it happens, however, he feels not crummy but incredible—“euphoric,” even. The novel plague has been insidiously designed to begin with the delivery of a powerful “neurochemical high.” Carriers experience a manic and irresistible sociality. By the time his flight to Texas reaches cruising altitude, however, he no longer feels euphoric. His lungs have begun to rot—pulmonary necrosis—and he showers the lavatory in bloody, black-tissued vomit. The necrotic tissue emits a “putrid, foul odor,” which his fellow-passengers attribute to a nearby baby’s soiled diaper.

这个特定的推演始于法兰克福一个“拥挤的迪斯科舞厅”。一位美国旅行者在此中转,他刚结束西伯利亚的狩猎之旅,在那里感染了一种经过改造的肺鼠疫菌株,旨在“以最残酷的方式杀死人类”。如果他感染的是更普通的肺鼠疫,症状发作早就让他卧床不起了。然而,实际情况是,他非但不觉得难受,反而感觉好极了——甚至“欣快”。这种新型鼠疫被阴险地设计成一开始会带来强烈的“神经化学快感”。携带者会体验到一种躁狂且难以抗拒的社交冲动。然而,当他飞往德克萨斯的航班达到巡航高度时,他不再感到欣快。他的肺开始腐烂——肺坏死——他在洗手间里吐了大量带血的黑色组织呕吐物。坏死的组织散发出一种“腐臭难闻的气味”,同机乘客以为那是附近婴儿弄脏的尿布味。

In theory, there’s still time to quarantine the plane upon landing. Washington knows about the Vector mishap. Reconnaissance satellites reported the explosion within minutes of its occurrence. It takes only eleven hours for the President to convene an emergency late-night meeting of his Principals Committee. The relative speediness of the response is the result of COVID. Health officials have told themselves that “mistakes made during the pandemic cannot happen again,” and the current situation is potentially much graver; as Jacobsen’s C.I.A. director puts it, “Given Vector’s pathogen inventory, we can easily have a worse-than-Wuhan situation on our hands.” Containment is an urgent priority. The Secretary of Defense (now known as the Secretary of War) proposes a nuclear strike as a precautionary response, but the team decides that nuclear annihilation is scarcely preferable to a new pandemic. The Russian government has yet to express commensurate concern, and has neglected to respond to urgent messages from the U.S. Embassy. It has already assured its own citizens that “the incident poses no threat to the surrounding community.”

理论上,飞机降落后仍有时间进行隔离。华盛顿方面知道“矢量”事故。侦察卫星在爆炸发生后几分钟内就报告了此事。总统只用了十一个小时,就召集了他的核心幕僚委员会召开紧急深夜会议。反应相对迅速,是新冠疫情带来的结果。卫生官员告诫自己,“疫情期间犯过的错误绝不能重演”,而当前局势可能严重得多;正如雅各布森笔下的中情局局长所说:“考虑到‘矢量’的病原体库存,我们很容易面临比武汉更糟糕的局面。”遏制疫情是当务之急。国防部长(现称战争部长)提议进行核打击作为预防性回应,但团队认为,核毁灭几乎不比一场新的大流行更可取。俄罗斯政府尚未表现出同等的关切,并且对美国大使馆的紧急信息置之不理。它已经向本国公民保证,“该事件对周边社区不构成威胁”。

Russia’s public messaging holds up until locals begin to die. The Kremlin pivots to a story that blames the fatalities on marmots, which can carry the plague. Marmots, woodland creatures whose raw viscera are believed by Siberians to have medicinal properties, are not infrequently hunted by poachers and sold at wet markets. It’s a plot point that recalls an actual incident in 1979, when dozens of townspeople near another Soviet lab were killed by the inadvertent release of aerosolized anthrax and their deaths were ascribed to a “truckload of contaminated meat sold on the black market.” Back in Jacobsen’s world, a previous pattern of deception isn’t the only reason her hypothetical U.S. officials conclude to mistrust the Russian explanation. It is late spring, and the marmots are hibernating.

俄罗斯的公开说法一直站得住脚,直到当地人开始死亡。克里姆林宫转而将死亡归咎于旱獭,这种动物可以携带鼠疫。旱獭是一种森林动物,西伯利亚人相信其生内脏有药用价值,常被偷猎者在湿货市场出售。这个情节让人想起1979年的一起真实事件,当时另一所苏联实验室附近城镇的数十名居民,因炭疽杆菌气溶胶意外泄漏而死亡,他们的死被归因于“一卡车在黑市上出售的受污染肉类”。回到雅各布森笔下的世界,以往的欺骗模式并非她虚构的美国官员断定俄罗斯解释不可信的唯一原因。当时是春末,旱獭正在冬眠。

It has taken the outbreak less than three days to reach the Dominican Republic, where a haphazard and desperate naval exodus is repelled by the American military with lethal force. Unfortunately, the sickness is already here. Near Los Angeles’s Skid Row, the indigent and unwell begin to arrive at an urgent-care facility, their vomit a “glob of frothy sputum.” Medical personnel are unprepared to diagnose the city’s first plague in a hundred years. The apocalyptic scene rapidly comes to resemble something familiar from zombie films or first-person shooters. Cops in riot gear fire in panic at raving, blood-soaked hordes; the victims suspect that they’ve been subjected to some nefarious form of population control; these and other conspiracy theories are immediately amplified, with vivid and harrowing footage, by cynical online influencers. Local residents take up arms to slaughter homeless people in the street. The reflexive response to a public-health crisis—to dispatch medical and law-enforcement teams to the front lines—only guarantees the swift elimination of precisely those responsible for effective mitigation.

疫情爆发不到三天就到达了多米尼加共和国,那里一场混乱绝望的海上大逃亡被美军以致命武力击退。不幸的是,疾病已经传入美国。在洛杉矶贫民窟附近,穷困和患病的人开始涌入一家急救中心,他们的呕吐物是“一团团带泡沫的痰液”。医务人员对诊断这座城市百年来首例鼠疫毫无准备。这末日般的场景迅速变得类似于僵尸电影或第一人称射击游戏中的熟悉画面。身着防暴装备的警察在恐慌中向胡言乱语、浑身是血的人群开枪;受害者怀疑自己成了某种恶毒人口控制手段的牺牲品;这些和其他阴谋论,伴随着生动惨烈的画面,立刻被愤世嫉俗的网络意见领袖放大。当地居民拿起武器在街上屠杀无家可归者。对公共卫生危机的本能反应——派遣医疗和执法团队到第一线——恰恰保证了那些负责有效缓解疫情的人被迅速消灭。

Thus far, “Biological War” amounts to an exponentially gorier version of recent history. What happens next is a shift from street-level cinematic montage to administrative calculation. The national stockpile of antibiotics is rationed among local distribution centers. Instructions for pickup are discreetly communicated to health-care workers, soldiers, politicians, and cops, but word quickly gets out and the medical depots are swarmed by armed citizens desperate to save themselves. In her research for the book, Jacobsen spoke to the former Senate Majority Leader Tom Daschle, who described “deeply nightmarish” circumstances in such an emergency: “People doing inhuman things just to survive.” Quarantine orders are met with wholesale insubordination, and the government begins to ratchet its way to full martial law. The President shuts down the internet.

至此,《生物战争》的内容相当于一个比近期历史血腥得多的版本。接下来发生的,是从街头电影蒙太奇到行政计算的转变。国家储备的抗生素在各地方分发中心实行配给。领取说明被谨慎地传达给医护人员、士兵、政客和警察,但消息很快走漏,医疗仓库被渴望自救的武装公民包围。在为本书做调研时,雅各布森采访了前参议院多数党领袖汤姆·达施勒(Tom Daschle),他描述了这种紧急状态下“极度噩梦般”的情景:“人们为了生存做出不人道的事。”隔离令遭到大规模违抗,政府开始逐步升级到全面戒严。总统关闭了互联网。

In FEMA’s basement SCIF and at the Pentagon, computational modellers indicate that every American, excepting those in full biohazard gear and those living in extreme isolation, will be infected in less than six days. During the worst of the COVID pandemic, Jacobsen writes, about one case in a hundred was fatal. If the Russian spokesman’s statistics are to be trusted, the fatality rate of this “atypical bacterial pneumonia” is assumed to be a catastrophic twenty-five times higher. The President and other top officials are successfully removed to undisclosed locations, and the “Devolution Plan”—a highly classified protocol to insure continuity of government—is set in motion. The Administration has shifted into subsistence mode. There are enough antibiotics for at most a few million people. Officials have no choice but to write off eighty million Americans as the walking dead.

在联邦紧急事务管理局地下敏感信息隔离设施和五角大楼,计算机模型显示,除了穿戴全套生物防护装备和生活在极端隔绝状态的人之外,每个美国人都将在不到六天内被感染。雅各布森写道,在新冠疫情最严重的时候,大约百分之一的病例是致命的。如果俄罗斯发言人的统计数据可信,这种“非典型细菌性肺炎”的致死率被假定为灾难性的二十五倍。总统和其他高级官员被成功转移到未公开的地点,“权力移交计划”——一项确保政府连续性的高度机密协议——随即启动。政府已转入生存模式。抗生素最多只够几百万人使用。官员们别无选择,只能将八千万美国人视为行尸走肉。

The assumptions made by the computational modellers, it turns out, are reasonable but inaccurate. Antibiotic efficacy is, in fact, worse than zero. Taking antibiotics activates the second pathogen hidden inside the first—the “chimera weapon’s booby-trap mechanism.” Spliced into the pneumonic plague’s genome are genes of equine encephalitis, which causes acute neurological symptoms. The ostensible cure “turns a plague infection that can be survived, with immediate antibiotic treatment, into a death sentence accompanied by the complete destruction of trust in medicine.” The presumed fatality rate of twenty-five per cent was off by a factor of four. A tiny remnant will survive, but only in total isolation or in comprehensive biohazard gear.

事实证明,计算机建模者的假设虽然合理,但并不准确。抗生素的效力实际上比零还糟。服用抗生素会激活隐藏在第一种病原体内的第二种病原体——“嵌合体武器的诡雷机制”。拼接在肺鼠疫基因组中的是马脑炎病毒基因,这会导致急性神经系统症状。这种表面上的疗法“将一种通过立即使用抗生素治疗本可存活的鼠疫感染,变成了一张死刑判决书,同时彻底摧毁了对医学的信任”。之前假设的百分之二十五的致死率,差了四倍。极少数人能幸存下来,但前提是完全隔离或穿戴全套生物防护装备。

From time to time, Jacobsen reminds the reader that her “scenario builds on science fact, not science fiction.” She has taken real events and tweaked them just enough to make her counterfactual seem not only conceivable but inevitable. Other than a few debatable instances—she claims, for example, that the Russians managed to create an actual “chimera weapon,” which has never been proved—she gathers enough evidence from the recent past to project a legitimately frightening future. By the end, however, her methodological commitment comes to seem like a creative constraint. She compares the post-plague American landscape to the Afghanistan of 2012, with “large, fortified military facilities in city centers” and “armed and weary soldiers permanently on village security patrol.” This analogy is strangely anticlimactic and almost consoling, but a pedestrian ending comes with the territory in a scrupulously realistic book about the inconceivable. The problem with the truly unprecedented is that there’s no good precedent for it.

雅各布森不时提醒读者,她的“推演建立在科学事实而非科幻小说之上”。她选取真实事件,并对其稍加调整,足以使她的反事实推演看起来不仅可信,而且不可避免。除了一些有争议的例子——例如,她声称俄罗斯人成功制造了一种真正的“嵌合体武器”,这一点从未得到证实——她从近期历史中收集了足够多的证据,来推演一个合理且可怕的未来。然而,到最后,她方法上的执着似乎成了一种创作上的束缚。她将鼠疫后的美国景象比作2012年的阿富汗,有着“位于市中心的大型坚固军事设施”和“长期在村庄执行安全巡逻的武装而疲惫的士兵”。这个类比出奇地平淡,甚至近乎安慰,但对于一本关于不可思议之事的严谨现实主义著作来说,一个平庸的结局在所难免。真正前所未有之事的问题在于,它没有好的先例可循。

The “scenario” is a voguish genre at the moment. Jacobsen’s previous book was a scenario about nuclear war. Pretty much everyone ends up dead. The most scenario-rich environment is A.I. prognosis. Last year, a group of rationalist forecasters published “AI 2027,” another scenario, in which, again, pretty much everyone ends up dead; a few weeks ago, they followed up with a more optimistic vision. In June, a group of anxious European policy researchers issued Europe 2031, a scenario in which civilization between the Urals and the Atlantic ends up at least functionally extinct. Jacobsen’s book touches explicitly on A.I. risk in only a few sentences at the end. The kinds of biological weapons she describes were once restricted to covert nation-state programs; now they can “be engineered by someone with minimal training in biology, using tools that are increasingly accessible and widely available, including with AI-enabled systems.” It is nevertheless difficult to read a book about any given extinction risk without recalling the current A.I. discourse. That may have been intended. The preface of “Biological War” ends with the observation that a hypervirulent and incurable germ “could be twenty-first-century humans’ last invention.” In an endnote, she credits the line to the philosopher Nick Bostrom, who invoked the idea in a 2015 TED talk. The title of the talk was “What Happens When Our Computers Get Smarter Than We Are?”

“推演”是当下一种流行的文体。雅各布森的前一本书是关于核战争的推演。几乎所有人都死了。推演最丰富的领域是人工智能预测。去年,一群理性主义预测者发表了《AI 2027》,这是另一种推演,其中,几乎所有人也都死了;几周前,他们又发布了一个更乐观的版本。六月,一群焦虑的欧洲政策研究者发布了《欧洲2031》,在这个推演中,乌拉尔山脉和大西洋之间的文明至少是功能性灭绝了。雅各布森的书只在结尾的几句话里明确提到了人工智能风险。她所描述的那些生物武器,曾仅限于秘密的民族国家项目;现在它们“可以由一个只受过最低限度生物学训练的人,使用日益普及和广泛可用的工具,包括人工智能辅助系统,来制造出来”。然而,阅读任何关于特定灭绝风险的书,都很难不让人想起当前关于人工智能的讨论。这或许是有意为之。《生物战争》的前言以这样一个观察结尾:一种高传染性且无法治愈的细菌“可能是二十一世纪人类的最后一项发明”。在一则尾注中,她将此观点归功于哲学家尼克·博斯特罗姆(Nick Bostrom),他在2015年的一次TED演讲中提到了这个想法。那次演讲的题目是《当我们的计算机比我们聪明时会发生什么?》。

It is widely, if not universally, believed in Silicon Valley that the arrival of advanced A.I.—first in the form of artificial general intelligence, then on the plane of artificial superintelligence—will represent the “hinge of history,” or the grand inflection point of the species, a notion that began to circulate on the fringe a few decades ago, and was subsequently popularized by Bostrom. Recently, it has become a widely held premise that life, should it continue to exist, will soon become entirely unrecognizable. This conviction comes in different flavors. The accelerationists look forward to paradise on earth. The doomers argue that the title of a recent book on superintelligence by Eliezer Yudkowsky, an A.I. researcher, is pretty much all there is to say: “If Anyone Builds It, Everyone Dies.”

在硅谷,人们普遍(虽非全体)相信,先进人工智能的到来——首先以通用人工智能的形式,然后达到超级人工智能的层面——将代表“历史的枢纽”,即人类物种的重大转折点。这个观念几十年前开始在边缘圈子流传,随后由博斯特罗姆普及开来。近来,一个被广泛接受的前提是,生命,如果还能继续存在的话,很快就会变得完全无法辨认。这种信念有不同的表现形式。加速主义者期待人间天堂。末日论者则认为,人工智能研究者埃利泽·尤德科夫斯基(Eliezer Yudkowsky)最近一本关于超级智能的书,其标题几乎道尽了一切:《如果有人造出它,所有人都得死》。

Outside of Silicon Valley, there is a tendency to dismiss such prophecies as, at best, patently unserious. Some skeptics take scenarios like “AI 2027” as too self-evidently silly to merit anything but an eye roll. Others respond with something that better approximates a real argument. The key characteristic of history, in this more refined account, is that it has a long and sterling track record of continuity. Certain things may change incrementally—electricity, antibiotics, democracy—but it is the habit of the future to more or less resemble the past. Given the propensity of today to look a lot like yesterday, the odds that tomorrow will look like today are overwhelming. As we have learned from intermittent financial crises, “this time it will be different” is almost always a dumb bet. The world has never revealed a talent for radical overnight transformation. Society muddles its way through.

在硅谷之外,人们倾向于将这类预言斥为,往好了说,明显不严肃。一些怀疑论者认为像《AI 2027》这样的推演,其荒谬不言自明,只配得到一个白眼。另一些人则用更接近真正论证的方式回应。在这种更精致的论述中,历史的关键特征在于,它拥有漫长而可靠的连续性记录。某些事物可能会渐进式地改变——电力、抗生素、民主——但未来的习惯是或多或少地类似于过去。鉴于今天看起来很像昨天,明天看起来像今天的可能性是压倒性的。正如我们从间歇性金融危机中学到的,“这次会不一样”几乎总是一个愚蠢的赌注。世界从未展现出在一夜之间发生彻底转变的天赋。社会总能勉强应付过去。

Most of the time, it seems wise to assume such a deflationary attitude. There is a difference, however, between the default belief that certain predictions are wrong and the default belief that certain predictions are embarrassing. As recently as the nineteen-nineties, when Wired magazine seemed like a monthly dispatch from beyond the event horizon, the fashionable pose to assume was one of electric optimism. Now it is distinctly unfashionable to get overly worked up one way or another about technological novelty. The adoption of an inductive argument about the future—one in which the sun always rises because the sun has always risen—has come to function as a marker of temperament. We are the sort of people who can see through the hysteria and the hype; you are the sort of people who consider yourselves specially elected to witness the singularity. You entertain the naïve conviction that everything can be deduced from first principles; we share the more elegant understanding that everything should be placed in historical perspective. We look cool; you look silly.

大多数时候,持有这种消解性的态度似乎是明智的。然而,默认某些预测是错误的,与默认某些预测是令人尴尬的,这两者之间是有区别的。就在上世纪九十年代,当《连线》杂志看起来像是从事界地平线之外发来的月度快讯时,流行的姿态是充满电力的乐观主义。如今,对技术新奇事物表现得过度兴奋,无论哪种方式,都明显不合时宜了。采用一种关于未来的归纳论证——即太阳总会升起,因为太阳一直升起——已经成了一种性情的标志。我们是那种能看穿歇斯底里和炒作的人;你们是那种自认为被特别选中来见证奇点的人。你们抱着天真的信念,认为一切都可以从第一性原理推导出来;我们则持有更优雅的理解,认为一切都应放在历史视角下审视。我们看起来很酷;你们看起来很蠢。

The flaw in “our” side of the argument—among people who are inclined to view a taste for inductive dismissal as a signal of sophistication—is that we have already decided what counts as historical evidence, or what is called a “reference class.” If you have limited your reference class to “prophecies that correctly anticipated wholesale human salvation or extinction,” you can take succor in the fact that in retrospect every such prophecy has looked idiotic. It is easy, however, for members of the opposing tribe to counter that our choice of reference class has rigged the game. (The economist Robin Hanson, in one of his more memorable coinages, calls this “reference-class tennis.”) We have declared out of bounds such events as the rapturing of the dinosaurs. There are much less extreme examples, too. In the excellent book “Apocalypse,” published last year, the science journalist Lizzie Wade draws upon recent archeological research to describe our species’ repeated encounters with the end of the world: Doggerland, a vibrant swath of paleolithic Europe, disappeared beneath the North Sea; a freakish rise in global temperatures forty-two hundred years ago resulted in the terminal exhaustion of the Indus Valley civilization; the arrival of the conquistadors was an eschatological experience for the Aztecs. Part of the point of Wade’s book is that individual people proved individually resilient, and life carried on. But it can also be read to argue that something well short of an extinction-level event can introduce real historical discontinuity.

在“我们”这一方——倾向于将偏好归纳式否定视为一种成熟标志的人——的论点中,缺陷在于我们已经预先决定了什么算作历史证据,或者所谓的“参考类别”。如果你将自己的参考类别限定为“正确预见了人类整体得救或灭绝的预言”,那么你可以聊以自慰的是,事后看来,每一个这样的预言都显得很愚蠢。然而,对立阵营的人很容易反驳说,我们对参考类别的选择操纵了游戏。(经济学家罗宾·汉森(Robin Hanson)在他一个更令人难忘的造词中,将此称为“参考类别网球赛”。)我们已经将恐龙被“提”走这类事件宣布为界外球。还有一些不那么极端的例子。在去年出版的精彩著作《天启》中,科学记者莉齐·韦德(Lizzie Wade)利用最近的考古学研究,描述了我们这个物种与世界末日的多次遭遇:多格兰,旧石器时代欧洲一片生机勃勃的土地,消失在了北海之下;四千二百年前全球气温的一次异常上升,导致了印度河流域文明的彻底衰竭;对阿兹特克人来说,征服者的到来是一次末世般的经历。韦德这本书的部分观点是,个体的人证明了自身的韧性,生活得以延续。但它也可以被解读为,远未达到灭绝级别的事件也能带来真正的历史断裂。

On the one hand, Wade’s examples establish a reference class for unimaginable rupture: terrible things have happened on a comprehensive scale before, which suggests that they might very well happen again. On the other hand, however, it’s easy to draw the wrong lesson. The existence of these precedents—many of which, not incidentally, involve imperial ambition or climate change—is taken as a credential of their seriousness. If something has happened before, we carry a warrant to worry that it might recur. We can in turn rule out, as unserious, excessively worrisome anticipation of truly novel disasters. There’s danger here. If we write off the kinds of vulnerabilities we’ve never encountered just because we’ve never encountered them, we may only be wrong one time, but we will have guaranteed ourselves to be wrong the one time it matters most. The premise that the future will resemble the past because it has always resembled the past will continue to be true until the first time it isn’t.

一方面,韦德的例子为难以想象的断裂建立了一个参考类别:全面性的可怕事件以前发生过,这表明它们很可能再次发生。然而,另一方面,我们很容易得出错误的教训。这些先例的存在——其中许多,并非巧合地,涉及帝国野心或气候变化——被视为其严肃性的凭证。如果某事以前发生过,我们就有理由担心它可能重演。反过来,我们可以将对真正新奇灾难的过度担忧,视为不严肃而予以排除。这其中有危险。如果我们仅仅因为从未遇到过某些类型的脆弱性就将它们排除在外,我们可能只会错一次,但我们将确保自己在最关键的那一次犯错。未来会像过去,因为它一直像过去——这个前提将继续成立,直到它第一次不再成立。

We have no choice but to resort to scenarios. There is one obvious way in which the scenario of “Biological War” is an important intervention. If one examines the vast scope of human history, one finds plenty of examples of devastating plagues. One might nevertheless reasonably conclude that in the face of tremendous adversity and suffering we mostly managed to muddle through O.K. Jacobsen’s book is a persuasive and unnerving argument to the contrary. She has done a lot of serious reporting to construct a fictional time line in which for the first, only, and final time we do not muddle through O.K. Hers is not just a lesson about bioweapons. It should destabilize those of us who are quick to sneer at any talk of extinction risk as mere Book of Revelations cosplay.

我们别无选择,只能诉诸于推演。《生物战争》的推演是一种重要的介入,这一点显而易见。如果审视人类历史的广阔范围,会发现许多毁灭性瘟疫的例子。尽管如此,人们或许可以合理地得出结论:面对巨大的逆境和苦难,我们大多还是设法勉强应付过来了。雅各布森的书提出了一个令人信服且不安的相反论点。她做了大量严肃的报道,构建了一条虚构的时间线,在这条时间线上,我们第一次、唯一一次、也是最后一次没能勉强应付过去。她的书不仅仅是关于生物武器的教训。它应该动摇我们当中那些习惯于对任何灭绝风险的谈论嗤之以鼻,视其为《启示录》角色扮演的人。

At the same time, however, “Biological War” serves a lesson for those who are in the business of radical prediction: they might not be thinking radically enough. The book is at once terrifying and inert. Jacobsen has assembled plenty of relevant precedents for an unprecedented cataclysm. She set out to make a point, and she succeeded. Perhaps it will help establish a greater consensus to get rid of bioweapons. Obviously, this is important work, and in her particular scenario there is something to be said for a narrow focus. One of the reasons that skeptics are quick to dismiss apocalyptic A.I. forecasts is that they, too, can feel as though they have been argued backward from foreordained conclusions. They might be more broadly compelling if they felt more inventively open-ended. The civilizations in Wade’s book did not collapse in accord with the darker passages of their own Scriptures, as the people imagined they might. Their fates were far more shocking.

然而,与此同时,《生物战争》对那些从事激进预测的人来说也是一个教训:他们可能想得还不够彻底。这本书既令人恐惧,又显得呆滞。雅各布森为一场前所未有的灾难汇集了大量相关的先例。她旨在阐明一个观点,并且成功了。也许这将有助于建立更大的共识来消除生物武器。显然,这是重要的工作,在她这个特定的推演中,聚焦于一点是有道理的。怀疑论者之所以急于否定末日论的人工智能预测,原因之一是这些预测也让人觉得像是从预先注定的结论倒推论证出来的。如果它们感觉上更具创造性的开放性,可能会更有广泛的吸引力。韦德书中的文明并非像人们想象的那样,按照他们自己经文中那些黑暗篇章的预言而崩溃。他们的命运要令人震惊得多。

At its best, “Biological War” is a story about what happens when people lack the nerve or the constitution to take scenario-planning itself with the gravity and curiosity it deserves. For several decades, the U.S. government has routinely engaged in tabletop exercises contrived to ready our response to the sort of unspeakable ordeal Jacobsen contemplates. In the late nineteen-nineties, Jacobsen explains, the national-security establishment conducted a multiagency simulation called TOPOFF 2000. Part of the scenario involved the weaponization of pneumonic plague by a terrorist cell in Denver. The game was played out through only four generations of infection before it was terminated. The cutoff wasn’t because it resulted in a plan of action. The implications were simply so dreadful that the officials just gave up. In 2001, the Andrews Air Force base hosted a follow-up called Dark Winter. As Jacobsen describes it, Al Qaeda buys smallpox from Russia and releases it in three American cities. Cabinet members reserve almost a fifth of the government’s vaccine stockpile for themselves, and the public reacts with mass looting and violent civil unrest. Her gloss: “Martial law is about to be declared when the Dark Winter narrative abruptly ends.”

在最佳状态下,《生物战争》讲述的是当人们缺乏勇气或素质,未能以应有的严肃和好奇心对待推演规划本身时,会发生什么。几十年来,美国政府经常进行桌面推演,旨在让我们准备好应对雅各布森所设想的这类难以言说的考验。雅各布森解释说,在上世纪九十年代末,国家安全机构进行了一次多部门联合模拟,代号“TOPOFF 2000”。推演的部分内容涉及丹佛的一个恐怖组织将肺鼠疫武器化。这场推演只进行了四代感染就被终止了。终止的原因并非它产生了一个行动计划。而是其影响实在太可怕了,官员们干脆放弃了。2001年,安德鲁斯空军基地举行了一场名为“黑暗冬季”的后续推演。据雅各布森描述,基地组织从俄罗斯购买了天花病毒,并在美国三个城市释放。内阁成员将政府近五分之一的疫苗储备留给自己,公众的反应是大规模抢劫和暴力内乱。她的评注是:“就在即将宣布戒严之际,‘黑暗冬季’的叙事戛然而止。”

Our tools, Jacobsen writes, “are advancing faster than the rules that govern them. This gap is where existential danger lives. The point is not panic; the point is pressure.” We must act “before we set something irreversible in motion.” “Biological War” is an indictment of the weapons programs that created our discomfiting reality, and of a leadership that has allowed it to continue. It is even more severe as an indictment of our collective failure of the imagination. It’s not the worst thing in the world to look silly. ♦

雅各布森写道,我们的工具“比管理它们的规则发展得更快。这个差距就是生存危险所在之处。重点不是恐慌,而是施压。”我们必须“在我们启动某些不可逆转的事情之前”采取行动。《生物战争》是对那些创造了我们令人不安的现实的武器计划,以及允许其继续存在的领导层的控诉。它更是对我们集体想象力失败的严厉控诉。看起来愚蠢,并不是世界上最糟糕的事。 ♦

2 free previews left — register to get 30 translations a month