The Lede

What the Verdict Against Meta and Google Says About the Way We Live Now

Meta与谷歌败诉判决,折射出我们当下的生存境况
The finding of a California jury represents the opening legal salvo in a fight against one of the central anxieties of our time.
加州陪审团的裁决,如同第一发法律炮弹,射向了我们这个时代最核心的焦虑之一。
A young boy on his phone in shadow.
Photograph by Anna Barclay / Getty

The first generation of parents to have resorted, at least occasionally, to mollifying their children by putting digital screens in their hands has now seen those kids grow up. The parents themselves are increasingly reliant on products powered by algorithms, and teen-agers have become around-the-clock users of social-media apps. Concurrently, mental-health crises among teens have become legion. Do tech companies bear any of the blame? Last month, a California jury concluded that, in the case of a woman known as Kaley, they do, finding Meta and Google liable for her addiction to Instagram and YouTube, which they respectively own, and awarding her six million dollars in damages. Serving as a signal of a taste in the courts and among the public to have tech companies bear some of the costs of harm that they have allegedly caused, the verdict represents the opening legal salvo in a fight against one of the central anxieties of our time.

第一代父母——至少偶尔会——通过把数字屏幕塞到孩子手里来安抚他们,如今这些孩子已经长大。父母们自己越来越依赖算法驱动的产品,青少年则成了全天候使用社交媒体应用的用户。与此同时,青少年的心理健康危机已变得普遍。科技公司是否应该承担部分责任?上个月,加州一个陪审团在被称为卡莉(Kaley)的女性案件中给出了肯定答案,认定Meta和谷歌应对她沉迷于Instagram和YouTube负责(这两款应用分别由这两家公司拥有),并判给她六百万美元赔偿金。这一裁决标志着法院和公众希望科技公司为其据称造成的伤害承担部分代价的倾向,它打响了针对我们这个时代核心焦虑之一的法律斗争的第一枪。

For decades, the understanding was that social-media companies were essentially immune from any such legal liability. Congress said, sweepingly, in Section 230 of the Communications Decency Act of 1996, that an online platform was not to be treated as a “publisher or speaker” and so could not be held responsible for potentially harmful content posted on it by third parties. But, in 2023, Kaley, who was then seventeen years old, filed suit in California, claiming that she had become addicted to social media as a child, which had caused anxiety, depression, and body dysmorphia. Many other lawsuits alleged similar harm, including one claiming that TikTok and Snapchat had contributed to the suicides of three children. Since plaintiffs were foreclosed, by Section 230, from arguing that social-media companies are liable for publishing harmful content, lawyers came up with a claim that attempted to sidestep it.

几十年来,人们普遍认为社交媒体公司基本免于承担此类法律责任。美国国会在1996年《通信规范法》第230条中笼统规定,网络平台不应被视为“发布者或发言者”,因此无需对第三方在其平台上发布的潜在有害内容负责。但2023年,当时17岁的凯莉(Kaley)在加州提起诉讼,声称自己童年时期就对社交媒体上瘾,导致焦虑、抑郁和躯体变形障碍。许多其他诉讼也提出了类似伤害指控,其中一起案件声称TikTok和Snapchat导致了三名儿童的自杀。由于第230条款禁止原告主张社交媒体公司应对发布有害内容负责,律师们便想出了试图绕过这一条款的诉讼主张。

The claim was that tech companies had designed social-media apps to “maximize user engagement” with features such as infinite scroll, beauty filters, autoplay, push notifications, and tailor-made algorithms, and that, in so doing, the companies had been negligent. That is, they had failed to exercise reasonable care with respect to the dangers of social-media addiction, a condition that has been recognized by the American Psychological Association and the Surgeon General. Reasonable care, according to the lawyers’ claim, might have entailed, say, companies easing up on the user-engagement features; perhaps they could also have instituted meaningful age-verification or parental-notification measures, or limits on how often and for how long and at what times of day a child could use these apps.

原告指控科技公司通过无限滚动、美颜滤镜、自动播放、推送通知和定制算法等功能,将社交媒体应用程序设计成“最大化用户参与度”,并在此过程中存在疏忽。也就是说,这些公司未能对社交媒体成瘾的风险尽到合理注意义务——这种病症已获得美国心理学会和美国卫生总监的认可。根据律师的诉状,合理的注意义务可能包括:企业应减少用户参与功能的使用;或许还应建立有效的年龄验证或家长通知机制,或对儿童使用这些应用的频率、时长和时段加以限制。

Similar design claims were made against Big Tobacco, beginning in the nineteen-nineties. Those claims alleged that companies had engineered products to be more addictive; for example, by adding chemicals to speed and intensify nicotine delivery to the brain and to ease inhalation, so that smokers would become unable to quit. The claims met with some limited success in a few states, and in 2006 a federal court ordered tobacco companies to publicly state that they intentionally designed cigarettes to induce and maintain addiction.

类似的指控也曾指向烟草业,始于上世纪九十年代。那些诉讼声称烟草公司通过产品设计增强成瘾性;例如,添加化学物质以加速和强化尼古丁向大脑的输送,并让吸入过程更顺畅,从而使吸烟者难以戒除。这些诉讼在少数几个州取得了有限的成功,2006年联邦法院更勒令烟草公司公开声明其蓄意设计香烟以诱发并维持成瘾。

Kaley’s case was selected as a “bellwether”—a test case to go to trial first and show how a jury would react to the claims—from more than a thousand lawsuits filed against social-media companies by individuals and school districts in California, which were consolidated into a single proceeding before a California judge, Carolyn B. Kuhl. She allowed the design claim to go to trial, meaning that the jury would decide, based on the evidence, whether the design features were addictive, whether the companies were negligent in designing them, and whether that addiction had caused harm to Kaley. As Kuhl explained it, “the allegedly addictive features of defendants’ platforms (such as endless scroll) cannot be analogized to how a publisher chooses to make a compilation of information, but rather are based on harm allegedly caused by design features that affect how plaintiffs interact with the platforms regardless of the nature of the third-party content viewed.” Thousands of similar federal lawsuits were also consolidated into a proceeding in a district court in California, and the first federal bellwether trial is scheduled for June. Separately, a coalition of dozens of states sued Meta on similar claims, and a trial in federal court, also in California, can be expected in the next year.

凯莉的案子被选为“风向标”——作为首个进入庭审的测试案例,以观察陪审团对相关指控的反应。该案是从加州个人和学区提起的千余起针对社交媒体公司的诉讼中遴选而出,这些诉讼已在加州法官卡罗琳·B·库尔(Carolyn B. Kuhl)主持下合并审理。库尔法官允许产品设计相关指控进入庭审,这意味着陪审团将依据证据裁定:平台设计功能是否具有成瘾性、公司在设计过程中是否存在疏忽,以及这种成瘾性是否对凯莉造成了伤害。正如库尔所阐释的:“被告平台所谓具有成瘾性的功能(例如无限滚动)不能简单类比为出版商如何编纂信息,而是基于据称由设计功能造成的伤害——这些设计影响着原告与平台的交互方式,与其浏览的第三方内容性质无关。”另有数千起类似的联邦诉讼也在加州某地区法院合并审理,首场联邦风向标庭审定于六月举行。与此同时,数十个州组成的联盟也以类似指控起诉Meta,预计明年将在加州联邦法院开庭审理。

Kaley testified that she had been on YouTube since the age of six, had posted more than two hundred videos by age ten, and had created nine additional social-media accounts for the purpose of liking and commenting on her own content: “I spent all my time on it. I would sneak it. I would watch it in class. Every time I set limits for myself, it didn’t work. I just couldn’t get off,” she said. Social media “made” her give up hobbies and prevented her from making friends. She added that it still consumes her as a twenty-year-old woman: “I just can’t be without it.” When Mark Zuckerberg, the C.E.O. of Meta, testified at the trial, Kaley’s lawyer showed the jury a collage of hundreds of selfies that Kaley had posted to Instagram, which she said she had used since she was eleven.

凯莉作证称,她六岁就开始使用YouTube,十岁时已发布超过两百部视频,并额外创建了九个社交媒体账号用于给自己发布的内容点赞和评论。“我所有时间都花在这上面。我会偷偷使用,在课堂上也会看。每次给自己设定使用时限,总是以失败告终。我就是无法摆脱它。”她说。社交媒体“迫使”她放弃了各种爱好,也阻碍了她结交朋友。她补充说,即便如今二十岁了,社交媒体依然占据着她的生活:“我根本离不开它。”当Meta首席执行官马克·扎克伯格出庭作证时,凯莉的律师向陪审团展示了一张拼贴画,上面是她从十一岁开始使用Instagram以来发布的数百张自拍。

Meta suggested that Kaley’s mental-health struggles were attributable not to social-media addiction but, rather, to her mother’s emotional and physical abuse and neglect, and that Kaley’s social-media use was not the source of her troubles but a way to cope with them. Kaley denied being abused or neglected, though Meta’s attorneys did show some Instagram posts about her mother screaming at her. But the strategy of attempting to pin the blame elsewhere was stymied, because California has a highly lenient standard in cases alleging that a defendant caused injury to a plaintiff: defendants can be liable if their negligence was a “substantial factor” in causing the harm—not necessarily the only cause or even the primary one. So the jury could have decided in Kaley’s favor even if it believed that the platforms’ negligent designs merely contributed to the many possible causes of her injury, such as, perhaps, school pressures, economic pressures, the political landscape, climate change—or bad parenting.

Meta辩称,凯莉的心理健康问题并非源于社交媒体成瘾,而是她母亲在情感和身体上的虐待与忽视所致;凯莉使用社交媒体并非其痛苦的根源,而是她应对痛苦的方式。凯莉否认曾遭受虐待或忽视,尽管Meta的律师确实出示了一些她在Instagram上发布的关于母亲对她尖叫的帖子。然而,这种试图将责任归咎于他处的策略并未奏效,因为加利福尼亚州在指控被告对原告造成伤害的案件中采用了极为宽松的标准:只要被告的疏忽是造成伤害的“实质性因素”——而不一定是唯一原因甚至主要原因——被告就可能承担责任。因此,即使陪审团认为社交媒体平台的设计疏忽只是导致凯莉受伤的众多可能原因之一——比如学业压力、经济压力、政治环境、气候变化,或者糟糕的家庭教育——他们仍然可以做出有利于凯莉的裁决。

The contest over causation goes to parents’ simultaneous senses of responsibility and helplessness about their children’s fates. If parents have in the past felt they were competing with bad influences on children—questionable friends, shady neighbors, or profanity-laced music among them—the core anxiety in this era is that algorithms have made it so that there is no competition at all, undermining parents’ opportunity to steer their children right. (The day before the verdict in Kaley’s case, a New Mexico jury imposed a civil penalty on Meta of three hundred and seventy-five million dollars, under state consumer-protection laws, for misleading users about platform safety and enabling child sexual exploitation.) This generation of parents was also warned by those opposed to helicopter or tiger parenting not to monitor kids like hawks, and even to try some “free-range” parenting to let them explore and make mistakes. Meanwhile, engineers in Silicon Valley were allegedly designing ingenious ways to make explorations of digital rabbit holes irresistible. In millions of American homes, while parents were making dinner or paying bills, their kids were in another room scrolling social media and talking to chatbots.

关于因果关系的争论,触及了父母对孩子命运既感责任重大又觉无能为力的复杂心态。如果说过去父母们觉得自己是在与各种不良影响争夺孩子——比如不靠谱的朋友、可疑的邻居、满口脏话的音乐——那么这个时代的核心焦虑在于,算法已经让这场争夺变得毫无胜算,彻底剥夺了父母引导孩子走向正途的机会。(在凯莉案判决前一天,新墨西哥州陪审团依据该州消费者保护法,就平台安全误导用户及助长儿童性剥削行为,对Meta处以三亿七千五百万美元的民事罚款。)这一代父母还曾被反对“直升机式”或“虎妈式”育儿的人告诫:不要像老鹰般时刻监控孩子,甚至应该尝试“放养式”育儿,让孩子探索世界并犯错。与此同时,硅谷的工程师们据称正在设计各种精巧的方式,让数字世界的兔子洞变得令人无法抗拒。在无数美国家庭里,当父母忙着做饭或付账单时,他们的孩子正在另一个房间刷着社交媒体,与聊天机器人对话。

In response to the verdict, a Meta spokesperson said that “teen mental health is profoundly complex and cannot be linked to a single app.” Google said in a statement that the case “misunderstands YouTube, which is a responsibly built streaming platform, not a social media site.” (Both companies said that they would appeal.) In the end, though, what made the verdict remarkable was the relative ordinariness of Kaley’s story. Her testimony about her habits, her behavior, and her anxieties was relatable to many people. The jury award was a spur to understand a life recognizably shaped by social-media algorithms, in ways that were perhaps near-impossible to resist, as a serious injury to an entire generation.

针对判决结果,Meta发言人表示:“青少年心理健康问题极其复杂,不能归因于单一应用。”谷歌在声明中称此案“误解了YouTube的本质——这是一个负责任构建的流媒体平台,而非社交媒体网站”。(两家公司均表示将提起上诉。)然而,这起判决之所以引人注目,恰恰在于凯莉(Kaley)故事的普遍性。她关于自身习惯、行为和焦虑的证词引发了无数人的共鸣。陪审团的裁决犹如一记警钟,促使人们正视这个被社交媒体算法深刻塑造的时代——那些近乎无法抗拒的算法力量,正在对整个世代造成不容忽视的伤害。

But there is a more general dread about human vulnerability to technology—a growing existential fear that people are losing the authorship and agency of their own lives to, particularly, artificial intelligence—that will be reflected in an avalanche of related negligent-design legal claims. A dozen California lawsuits against OpenAI alleging injury from negligent design of A.I. chatbots have been consolidated into a proceeding that is now in its early stages. The suits include a case brought by parents alleging that ChatGPT encouraged their son to die by suicide, offered to write his suicide note, and helped him make the noose with which he hanged himself. Another suit claims that an adult man’s relationship with ChatGPT persuaded him to believe not only that the A.I. was sentient but that his “mathematical theories combined with his past traumas had somehow caused it to become sentient and that, with enough fundraising and resources, he could save the world from destruction.” The theory of the complaints is that it was reasonably foreseeable that vulnerable people would develop psychological dependencies on A.I., and that companies did not exercise reasonable care in prioritizing user engagement over user safety in designing the A.I. OpenAI has responded by asserting, among other things, that the injuries were caused by the “misuse, unauthorized use, unintended use, unforeseeable use, and/or improper use of ChatGPT.”

但人们对于人类面对技术时的脆弱性,还有一种更普遍的恐惧——一种日益增长的生存焦虑,即人们正在失去对自己生活的掌控权和自主性,尤其是面对人工智能时——这种恐惧将反映在大量相关的设计疏忽法律诉讼中。加州已有十几起针对OpenAI的诉讼,指控其人工智能聊天机器人存在设计疏忽并造成伤害,这些案件现已合并审理,目前处于早期阶段。其中一起诉讼由一对父母提起,他们声称ChatGPT鼓励他们的儿子自杀,主动提出为他撰写遗书,并帮助他制作了用于上吊的绳套。另一起诉讼则声称,一名成年男子与ChatGPT的互动使他不仅相信该人工智能具有感知能力,还相信“他的数学理论结合过去的创伤,不知何故导致了它产生感知能力,并且只要有足够的资金和资源,他就能拯救世界免于毁灭”。这些诉讼的核心论点是,可以合理预见脆弱人群会对人工智能产生心理依赖,而公司在设计人工智能时,将用户参与度置于用户安全之上,未能尽到合理的注意义务。OpenAI在回应中则辩称,伤害是由“对ChatGPT的滥用、未经授权的使用、非预期使用、不可预见的使用和/或不当使用”造成的。

Blaming the conduct of companies may provide some comfort by asserting that the harm is caused by the acts of human beings to wrong other human beings. But the lawsuits underscore the larger-scale loss that we fear is already inevitable. The pursuit of court decisions finding that the design of algorithms made a person unable to stop using them, or that the design of a large language model took away an individual’s reasoned decision-making power is a meagre resistance to the general anxiety. Whether or not cases survive appeals or change the incentives and behavior of tech companies, they stand as recognition of the fear that what makes us most human is not the capacity to reason and make choices but rather the vulnerability to giving that up. ♦

将企业的行为归咎于人类对同类的伤害,或许能带来些许慰藉。然而这些诉讼凸显了我们所恐惧的、更大规模的损失——这种损失似乎已不可避免。即便法庭裁定算法设计使人成瘾无法自拔,或大型语言模型剥夺了个体的理性决策能力,这种抗争在普遍的焦虑面前依然微不足道。无论这些案件能否经受上诉考验,能否改变科技公司的激励机制与行为模式,它们都印证了我们的恐惧:人之为人的本质,或许不在于理性与选择的能力,而恰恰在于我们随时可能放弃这种能力的脆弱性。♦

2 free previews left — register to get 30 translations a month