本集简介
双语字幕
仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。
以下是与Demis Hassabis的对话,这是他第二次参加这个播客节目。他是谷歌DeepMind的领导者,现在也是诺贝尔奖得主。Demis是当今世界上最聪明、最引人入胜的思想家之一,他致力于理解和构建智能,并探索宇宙的重大奥秘。这次对话对我来说是一份真正的荣幸和愉快的经历。现在,简短地提一下今天的赞助商。
The following is a conversation with Demis Hassabis, his second time on the podcast. He is the leader of Google DeepMind and is now a Nobel Prize winner. Demis is one of the most brilliant and fascinating minds in the world today, working on understanding and building intelligence, and exploring the big mysteries of our universe. This was truly an honor and a pleasure for me. And now a quick few second mention of your sponsor.
你可以在节目描述中查看这些赞助商,或者访问 lexfreeman.com/sponsors。这是支持本播客的最佳方式。本次赞助商包括:Hampton(用于与创始人和CEO建立联系)、Finn(人工智能客服)、Shopify(用于创建电子商务业务)、Element(每日补充电解质)以及AG one(健康产品)。朋友们,请明智选择。接下来是完整的赞助商介绍。
Check them out in the description or at lexfreeman.com/sponsors. It's the best way to support this podcast. We've got Hampton for connecting with founders and CEOs, Finn for AI customer service, Shopify for building ecommerce businesses, Element for daily electrolytes, and AG one for your health. Choose wisely, my friends. And now on to the full ad reads.
我确实努力让这些广告内容变得有趣,但如果朋友们你一定要跳过,请至少还是看一下我们的赞助商。我喜欢他们的产品,也许你也会喜欢。如果你想联系我,无论出于什么原因,请访问 lexfreeman.com/contact。好了,就这样。
I do try to make them interesting, but if you must skip, friends, please still check out our sponsors. I enjoy their stuff. Maybe you will too. And also to get in touch with me for whatever reason, go to lexfreeman.com/contact. Alright.
开始吧。本期节目由Hampton赞助,这是一个专为高增长型初创公司创始人和CEO打造的私人社区。创业和经营一家公司,尤其是那些快速增长、需要大量招聘、需要大规模扩张的公司,其实是一件有点违反直觉的事情。对于创始人来说,这可能会非常孤独。我想这也是为什么有人建议要有联合创始人的原因之一。但即使如此,当你把一切都押上去,冒着巨大风险,明知成功的机会渺茫时,这种孤独感依然存在。但如果你成功了,收获将是巨大的。
Let's go. This episode is brought to you by Hampton, a private community for high growth founders and CEOs. That's the interesting thing about starting a company and running a company, especially one that's growing really quickly, has to hire a lot, has to scale a lot. It's perhaps a little bit counterintuitive, but for the founder, it can be deeply lonely. I suppose that's one of the reasons they recommend to have a co founder, but even outside of that, there's just a deep loneliness with putting it all on the line, risking everything, knowing that the chances of success are low, But if you do succeed, the gains are huge.
你投入了全部的心血、梦想和信念,但同时还要经历恐惧、怀疑、希望、胜利时刻和失败时刻的不断交替,这种心理上的起伏是持续不断的。无论如何,在这一切之中,能与经历相同处境的人交流是一件非常好的事情,而Hampton正是为此而存在。它每个月都会组织八位创始人面对面交流他们日常的挑战。目前,Hampton的小组正在多个地方成立,包括纽约、奥斯汀、旧金山、洛杉矶、迈阿密、丹佛等。如果你是一位厌倦了独自承担一切的创始人,请访问 joinhampton.com/lex,看看是否适合你。
And you have your heart in it, you have your dreams in it, you believe in it, but also there's a constant roller coaster of fear and doubt and hope and moments of triumph and moments of failure, all those go back and forth and just as a constant psychological turmoil. Anyway, through all that, it's just nice to connect with other people that are going through the same thing, and that's what Hampton is about. It does a thing where every month, eight founders face to face have real conversations about their daily struggles. Groups are forming in a bunch of places, New York City, Austin, San Francisco, LA, Miami, Denver, and so on. If you are a founder who's tired of carrying it all alone, visit joinhampton.com/lex to see if it's a fit for you.
网址是joinhampton.com/lex。本期节目还由Finn赞助,这是一款专注于客户服务的人工智能代理。他们专注于客服应用,并希望在这方面做到全球最好。事实上,如果你以“解决率”作为衡量标准,也就是客服代理成功解决客户问题的比例,他们的平均解决率达到59%,是目前市场上表现最好的客户服务代理。
That's joinhampton.com/lex. This episode is also brought to you by Finn. It's an AI agent for customer service. So they are focused laser focused on the customer service application, and they wanna do that better than anybody else in the world. In fact, if you measure by the metric of the number of resolutions, so when you have the agent resolve the customer service issue, that's resolution, they have a 59% average resolution rate, which makes it the highest performing customer service agent on the market.
Finn已被超过5000名客户服务领导者所信赖,甚至包括顶级AI公司Anthropic。他们的系统设计可以不断从交互中学习和改进,因此你可以持续地进行分析、训练、测试和部署。另外值得一提的是,他们还提供90天无条件退款保证。访问 fin.ai/lex,了解更多关于如何变革你的客户服务并扩展支持团队的信息。网址是fin.ai/lex。
It's trusted by over 5,000 customer service leaders and even top AI companies including Anthropic. The way they design the system is it can continuously improve from the interaction, so you can continuously analyze, train, test, and deploy. Also, probably important to say, they give you a ninety day money back guarantee. Go to fin.ai/lex to learn more about transforming your customer service and scaling your support team. That's fin.ai/lex.
本期节目还由Shopify赞助,这是一个专为任何人打造、用于在任何地方销售商品的平台,拥有外观精美的在线商店。连我自己都在lexfreeman.com/store上创建了一个在线商店,上传了几件T恤。但从那以后我就没怎么管它了,因为我不是一个很认真的人。但有很多认真的人在Shopify上建立了真正的业务。这是一个能让你接触到数百万想买东西的人的平台,并为你提供所有你需要的工具和集成服务,帮助你大规模实现销售目标。
This episode is also brought to you by Shopify, a platform designed for anyone to sell anywhere with a great looking online store. Even I figured out how to create an online store at lex freeman dot com slash store, and I put up a few shirts. I haven't done anything with it since because I'm not a serious person. There's a lot of serious people that build real businesses on top of Shopify. It's a platform that connects you with millions of people that wanna buy stuff and gives you all the tools you need and all the integrations you need to do just that at scale.
正如我们之前和DHH讨论过的,Shopify所基于的Ruby on Rails框架具有惊人的美感和强大的功能。我还没有亲自用Rails构建过中等规模的项目,但我应该去做。我只是需要找到一些我真正需要用Web开发来实现的东西,从而激励自己去构建一些有用的东西。我不想像做一个奇怪的待办事项列表那样,尤其是在有了LLM(大语言模型)之后,很多代码都可以自动生成了。
As we talked about with DHH about the incredible beauty and power of Ruby on Rails that Shopify is powered by. I have not yet built a serious sort of medium scale project on Rails. I need to. It's just I need to actually find things that I need to do web dev type of stuff with to inspire myself to build something useful. I don't wanna build some weird variant of a to do list, especially now with the help of LLMs, you can generate so much of the code.
所以,我现在需要思考的是,当LLM可以生成大量代码时,如何学习新的框架和编程语言。我不想仅仅依靠“感觉式编程”来学习,因为我觉得那不是全面掌握一门技术的方式,但“感觉式编程”确实降低了学习的门槛。如何在这之间找到平衡,是一件需要仔细思考的事情。总之,这就是关于Shopify背后所依赖的编程语言和框架的一些想法。而Shopify本身则以令人惊叹的规模连接着买家和卖家,这种规模令人敬畏。
So I need to figure out how to learn a new framework and new programming languages when LLMs can generate so much of it. And I don't wanna do it exclusively by vibe coding because I feel like that's not a way to learn fully a thing, but vibe coding does remove some of the friction of learning. So balancing that out is a tricky thing to do. Anyway, that's about the programming language and the framework that powers Shopify. But Shopify itself connects buyers and sellers in an incredible scale that's awe inspiring.
访问 shopify.com/lex 注册每月1美元的试用期,全部是小写字母。前往 shopify.com/lex,今天就将你的事业提升到新的高度。本期节目还由 Element 赞助,这是我每天都在喝的无糖美味电解质混合饮品。我最近在旅行,随身带了很多包 Element。
Sign up for a $1 per month trial period at shopify.com/lex. That's all lowercase. Go to shopify.com/lex to take your business to the next level today. This episode is also brought to you by Element, my daily zero sugar and delicious electrolyte mix. I've been traveling recently, and I have a lot of Element packets with me.
我会带着它,还有弹力带,不管你们怎么称呼它们。我自己都不知道它们叫什么。它们就像橡皮筋,可以用来做基本的肩部锻炼。所以如果我要进行大量举重训练或者高强度的柔术训练,我都喜欢先好好热身肩膀,可能是因为我多年来打网球和做卧推动作导致肩膀有些问题。无论如何,我把 Element 当作我锻炼计划中不可或缺的一部分。
And I bring that and I bring bands, whatever you call them. I don't know what they're called. They're like rubber bands for like basic shoulder exercises. So if I have to do a lot of either heavy lifting or heavy jujitsu training, I like to warm up the shoulders really well because probably because I have issues with shoulders from many years of playing tennis and many years of doing stupidly bench press. Anyway, I think of Element as a critical component of my workout routine.
锻炼前补水,锻炼后重新补充水分,充分体验西瓜咸味的美味,这是冠军的味道,也是我推荐的口味。我已经很久没有尝试其他口味了。它们都不错,但对我来说,我是一个专注且有毅力的人,我专注于西瓜咸味。我好像看到他们出了柠檬水味,我想很多人会喜欢柠檬水味。
Hydrate before, rehydrate after, fully embrace the deliciousness of watermelon salt flavor, the flavor of champions, the one I recommend. It's been quite a while since I tried the others. They're all good, but for me, I'm a man of focus and dedication, and I'm dedicated to watermelon salt. I think they have actually I saw a lemonade flavor. I think a lot of people love lemonade.
所以也许那个更适合你。至于我,我还是坚持西瓜咸味。任何购买都可获得免费的八袋试用装。前往 drinkelement.com/lex 尝试一下。本期节目还由 AG One 赞助,这是一种支持健康和最佳表现的一体化日常饮品。
So maybe that's your thing. For me, I'm sticking to watermelon salt. Get a free eight count sample pack with any purchase. Try it at drinkelement.com/lex. This episode was also brought to you by a g one, an all in one daily drink to support better health and peak performance.
我旅行时都会带着它,这让我感觉像是把家的一小部分也带在身边。我至少每天喝一次,很多时候是一天两次。他们也在不断改进产品,最近推出了 AG One Next Gen,在各个方面都有提升,包括更多的维生素和矿物质,以及升级版的益生菌。
I travel with it. It makes me feel like I take a little piece of home with me. I drink it at least once a day, very often twice a day. And they keep innovating, they keep improving it. They recently introduced the AG one next gen, improving every aspect, more vitamins and minerals, and upgraded probiotics.
有趣的是,早晨的例行程序竟然可以成为平静和幸福的来源。我发现如果我在一天最初的几个小时里查看手机,就会产生一种奇怪的焦虑感,最终演变成不快乐。如果不看手机,我就更容易保持深度专注。我的早晨例行事项包括早上喝点咖啡或含咖啡因的饮品,然后过几个小时再喝 AG One,中间可以保持好几个小时的深度专注。它让我感到快乐,让我感到与宇宙融为一体,也帮助我完成了很多事情。
It's funny how a morning routine can be the source of peace and happiness because I find that if I check my phone at all in the first couple hours of the day, I get this weird anxiety that ultimately morphs into unhappiness. And if I don't, I'm much more likely to sort of maintain that deep focus. And a part of that early in the morning is some coffee or caffeinated drink, and then a few hours on is AG one. And it's just many hours of deep focus in between. It makes me feel happy, makes me feel at one with the universe, and it helps me get shit done.
顺便说一下,当你在 drinkag1.com/lex 注册时,他们会送你一个月量的鱼油。这是 Lex Friedman 播客。为了支持节目,请查看描述中的赞助商信息,或者访问 lexfreeman.com/sponsors。同时,也请考虑订阅、评论,并将这个播客分享给可能感兴趣的人。我承诺我会非常努力地工作,持续为大家带来来自各行各业、丰富多样、内容深入的长篇对话。
Anyway, they'll give you one month supply of fish oil when you sign up at drinkag1.com/lex. This is the Lex Friedman podcast. To support it, please check out our sponsors in the description or at lexfreeman.com/sponsors. And consider subscribing, commenting, and sharing the podcast with folks who might find it interesting. I promise to work extremely hard to always bring you nuanced and long form conversations with a wide variety of interesting people from all walks of life.
好了,亲爱的朋友们,现在是 Demis Hassabis。在你的诺贝尔奖演讲中,你提出了一个我认为非常有趣的猜想:‘任何在自然界中可以生成或发现的模式,都可以通过经典学习算法高效地发现和建模。’你当时指的是哪些类型的模式或系统?生物学、化学、物理学,也许还有宇宙学?神经科学?
And now, dear friends, here's Demis Hassabis. In your Nobel Prize lecture, you proposed what I think is a super interesting conjecture that, quote, any pattern that can be generated or found in nature can be efficiently discovered and modeled by a classical learning algorithm. What kind of patterns of systems might be included in that? Biology, chemistry, physics, maybe cosmology Yep. Neuroscience?
我们到底在讨论什么?
What what are we talking about?
当然。嗯,我觉得在诺贝尔奖演讲中,有点挑衅意味是一种传统,我也想遵循这个传统。我当时讲的是,如果你退后一步,看看我们做过的所有工作,特别是 AlphaX 系列项目,比如 AlphaGo 和 AlphaFold。它们本质上是在构建非常高维组合空间的模型。如果你尝试用暴力方法解决,比如找出围棋中的最佳走法,或者找出蛋白质的确切结构,如果你穷举所有可能性,宇宙的时间都不够用。
Sure. Well, look, I I felt that it's sort of a tradition, I think, of Nobel Prize lectures that you're supposed to be a little bit provocative, and I wanted to follow that tradition. What I was talking about there is if you take a step back and you look at all the work that we've done, especially with the AlphaX projects, so I'm thinking AlphaGo, of course, AlphaFold. What they really are is we're building models of very combinatorially high dimensional spaces that, you know, if you try to brute force a solution, find the best move and go or find the the exact shape of a protein. And if you enumerated all the possibilities, you'd there wouldn't be enough time in the in the, you know, the time of the universe.
因此,你必须做一些更聪明的事情。我们在两种情况下所做的,就是建立这些环境的模型,从而以一种智能的方式引导搜索,这样就使问题变得可处理。举个例子,如果你考虑蛋白质折叠这个问题,它显然是一个自然系统,那为什么它是可能的?物理学是怎么做到这一点的?蛋白质在我们体内会在几毫秒内完成折叠。
So you have to do something much smarter. And what we did in both cases was build models of those environments and that guided the search in a smart way and that makes it tractable. So if you think about protein folding, which is obviously a natural system, why should that be possible? How does physics do that? Proteins fold in milliseconds in our bodies.
所以某种意义上,物理学解决了这个问题,而我们现在也通过计算解决了这个问题。我认为之所以可能,是因为在自然界中,自然系统具有结构,因为它们经历了进化过程,这些过程塑造了它们。如果这是真的,那么你或许就可以学习到这种结构是什么。我认为这种观点是非常有趣的,你已经稍微提到了一点,虽然表达得还比较粗略。
So somehow physics solves this problem that we've now also solved computationally. And I think the reason that's possible is that in nature, natural systems have structure because they were subject to evolutionary processes that that shape them. And if that's true, then you can maybe learn what that structure is. So this perspective I think is really interesting one. You've hinted it at it, which is almost like crudely stated.
任何可以通过进化形成的东西,都可以被高效地建模。你觉得这个观点有一定道理吗?是的。我有时把它称为“最稳定者的生存”之类的东西。当然,进化适用于生命体,但如果你从地质时间尺度来看,比如山脉的形状,它也是由风化过程塑造出来的,经历了数千年的时间。
Anything that can be evolved can be efficiently modeled. Think there's some truth to that? Yeah. I sometimes call it survival of the stableist or something like that because, you know, it's it's of course, there's evolution for life, living things. But there's also, you know, if you think about geological time, so the shape of mountains, that's being shaped by weathering processes, right, over thousands of years.
你甚至可以把它扩展到宇宙学层面,比如行星的轨道、小行星的形状。这些都经历了无数次反复作用的生存过程。如果这是真的,那就应该存在某种模式,你可以反过来学习它,找到一种类似流形的结构,帮助你搜索到正确的解、正确的形状,并以高效的方式预测它的某些特性,因为它不是随机的模式。对吧?因此,这可能不适用于人造事物或抽象事物,比如分解大数的问题,除非数域中存在某种模式,也许存在,但如果不存在,而是均匀分布的,那就没有可以学习的模式。
But then you can even take it cosmological, the orbits of planets, the shapes of asteroids. These have all been survived kind of processes that have acted on them many many times. So if that's true, then there should be some sort of pattern that you can kind of reverse learn and a kind of manifold really that helps you search to the right solution, to the right shape, and actually allow you to predict things about it in an efficient way because it's not a random pattern. Right? So it may not be possible for for man made things or abstract things like factorizing large numbers because unless there's patterns in the number space, which there might be, but if there's not and it's uniform, then there's no pattern to learn.
没有可以学习的模型来帮助你进行搜索,你就只能暴力破解。在这种情况下,你可能需要量子计算机之类的东西。但在我们感兴趣的大多数自然事物中,并不是这样的。它们具有因某种原因而演化并长期存在的结构。
There's no model to learn that will help you search. You have to do brute force. So in that case, you you know, you maybe need a quantum computer, something like this. But in most things in nature that we're interested in are not like that. They have structure that evolved for a reason and survived over time.
如果这是真的,我认为这种结构是神经网络有可能学习到的。这就像是大自然正在进行一个搜索过程,而这个搜索过程正在创造可以高效建模的系统,这非常迷人。没错,非常有趣。
And if that's true, I think that's potentially learnable by a neural network. It's like nature is doing a search process and it's so fascinating that it's in that search process is creating systems that could be efficiently modeled. That's right. Yeah. So interesting.
因此,它们可以被高效地重新发现或重建,因为大自然不是随机的。对吧?我们周围看到的一切事物,包括更稳定的元素,它们都经历了某种选择过程或压力。
So they can be efficiently rediscovered or recovered because nature's not random. Right? These everything that we see around us, including, like, the elements that are more stable, all of those things, they're subject to some kind of selection process pressure.
你也是理论计算机科学和复杂性理论的爱好者,你觉得我们是否可以提出一种复杂性类别,比如像复杂性动物园那样的类别,也许可以称为“可学习系统”类别?“可学习自然系统”(LNS)类别?是的,这就是
Do you think because you're also a fan of theoretical computer science and complexity, do you think we can come up with a kind of complexity class, like a complexity zoo type of class where maybe it's the set of learnable systems? The set of learnable natural systems, LNS? Yeah. This is
一个全新的类别
a new class
一类实际上可以通过经典系统以这种方式学习的系统,可以高效建模的自然系统。
of systems that could be actually learnable by classical systems in this kind of way, natural systems that can be modeled efficiently.
是的。我的意思是,我一直对P等于NP这个问题,以及经典系统(也就是非量子系统,实际上是图灵机)能够模拟什么内容非常着迷。实际上,我在空闲时间正和几位同事研究这个问题:是否应该存在一种新的问题类别,可以通过这种神经网络过程来解决,并映射到这些自然系统上。
Yeah. I mean, I've I've always been fascinated by the p equals m p question and what is modellable by classical systems, I. E. Non quantum systems, you know, Turing machines in effect. And that's exactly what I'm working on actually in kind of my few moments of spare time with a few colleagues about is should there be, you know, maybe a new class of problem that is solvable by this type of neural network process and kind of mapped onto these natural systems.
因此,你知道,物理学中存在并具有结构的事物。我认为这可能是一种非常有趣的新思维方式。这与我总体上对物理学的看法是一致的,即我认为信息是首要的。信息是宇宙中最基本的单位,比能量和物质更基本。我认为它们都可以相互转化,但我把宇宙看作是一种信息系统。
So, you know, the things that exist in physics and have structure. So I think that could be a very interesting new way of thinking about it. And it sort of fits with the way I think about physics in general, which is that, you know, I think information is primary. Information is the most sort of fundamental unit of the universe, more fundamental than energy and matter. I think they can all be converted into each other, but I think of the universe as a kind of informational system.
所以当你把宇宙看作是一个信息系统时,P等于NP问题就变成了一个物理学问题。没错。这个问题可以帮助我们解决整个这一大堆问题。
So when you think of the universe as an informational system, then the p equals NP question is a is a physics question. That's right. And it's a question that can help us actually solve the entirety of this whole thing going on.
是的。我认为如果从信息的角度来看待物理学,这是最基本的问题之一。我认为这个问题的答案将会非常有启发性。
Yeah. I think it's one of the most fundamental questions, actually, if you think of physics as informational. And and the answer to that, I think, is gonna be, you know, very enlightening.
再具体到P对NP问题,我们刚才说的一些内容现在听起来可能有点疯狂,就像Christian Anthenson在诺贝尔奖演讲中说的那些有争议的话一样疯狂,但后来他因此获得了诺贝尔奖,和John Jumper一起解决了问题。所以让我们回到P等于NP的问题。你认为我们正在讨论的内容中是否存在某种可能性,比如如果你能在多项式时间或常数时间内提前进行计算,并构建一个庞大的模型,那么你就可以以理论计算机科学的方式解决其中一些极其困难的问题。
More specific to the p n NP question, this again, some of the stuff we're saying is kinda crazy right now, just like the Christian Anthenson Nobel Prize speech controversial thing that he said sounded crazy, and then you went and got a Nobel Prize for this with John Jumper. Solved the problem. So let me let me just stick to the p equals m p. Do you think there's something in this thing we're talking about that could be shown if you can do something like polynomial time or constant time compute ahead of time and construct this gigantic model, then you can solve some of these extremely difficult problems in a theoretical computer science kind of way.
是的。我认为实际上有大量问题可以用这种方式来表达,就像我们做AlphaGo和AlphaFold那样。你知道,你建模的是系统的动态特性、系统的属性以及你试图理解的环境,这使得寻找解决方案或预测下一步变得高效,基本上是多项式时间。因此,经典系统(比如神经网络)可以处理它,它运行在普通计算机上,对吧?
Yeah. I think that there are actually a huge class of problems that could be couched in this way the way we did AlphaGo and the way we did AlphaFold where, you know, you you model what the dynamics of the system is, the the the the properties of that system, the environment that you're trying to understand And then that makes the search for the solution or the prediction of the next step efficient, basically polynomial time. So tractable by a classical system, which a neural network is. It runs on normal computers. Right?
经典计算机,实际上就是图灵机。我认为这是最有趣的问题之一:这种范式究竟能走多远?我认为我们,以及整个AI社区,已经证明了经典系统、图灵机的能力比我们以前认为的要强大得多。你知道,它们可以做诸如建模蛋白质结构、以超过世界冠军水平下围棋这样的事情。很多人在十年前、二十年前可能还认为这些事情离我们还很遥远,甚至可能需要某种量子机器、量子系统才能完成像蛋白质折叠这样的任务。
Classical computers, Turing machines in effect. And I think it's one of the most interesting questions there is is how far can that paradigm go? You know, I think we've proven and the AI community in general that classical systems, Turing machines can go a lot further than we previously thought. You know, they can do things like model the structures of proteins and play go to better than world champion level. And, you know, a lot of people would have thought maybe ten, twenty years ago that was decades away or maybe you would need some sort of quantum machines to to quantum systems to be able to do things like protein folding.
因此,我认为我们甚至还没有真正触及经典系统(所谓的经典系统)所能做的表面。当然,AGI建立在一个又一个神经网络系统之上,而这些系统又运行在经典计算机之上,这将是这一能力的终极体现。我认为,这种系统的边界、它的能力极限,是一个非常有趣的问题,并且直接关系到P等于NP的问题。
And so I think we haven't really even sort of scratched the surface yet of what classical systems so called could do. And of course, AGI being built on a on a neural network system on top of a neural network system on top of a classical computer would be the ultimate expression of that. And I think the limit you know, the the what what the bounds of that kind of system, what it can do, it's a very interesting question and and and directly speaks to the p equals NP question. What
那么你认为,再假设一下,可能在这些系统之外的是什么?比如,如果你观察元胞自动机,某些极其简单的系统中会出现复杂性。是的,也许那是在系统之外?或者你猜测,即使是这些现象,也可能被经典机器高效地建模?
what do you think, again, hypothetical might be outside of this? Maybe emergent phenomena, like if you look at cellular automata Mhmm. Some of the you have extremely simple systems, and then some complexity emerges. Yes. Maybe that would be outside or even would you guess even that might be amenable to efficient modeling by a classical machine?
我认为这些系统正好处于边界上。我认为大多数涌现系统,比如元胞自动机之类的东西,都可以被经典系统建模。你只需要进行一次正向模拟,可能就足够高效了。当然,还有像混沌系统这样的问题,初始条件非常重要,然后你会得到某种不相关的终态。
I think those systems will be right on the boundary. Right? So I think most emergent systems, cellular automata, things like that could be modelable by a classical system. You just sort of do a forward simulation of it and it'd probably be efficient enough. Of course, there's the question of things like chaotic systems where the initial conditions really matter and then you get to some, you know, uncorrelated end state.
现在这些可能很难建模。所以我认为这些属于尚未解决的问题。但我觉得当你退后一步,看看我们在系统方面已经完成的工作,以及我们已经解决的问题,然后再看看像视频生成中的v o three,涉及物理和光照的渲染,以及类似的核心物理基础问题,这其实非常有趣。我认为这向我们揭示了一些关于宇宙结构的基本事实。
Now those could be difficult to model. So I think these are kind of the open questions. But I think when you step back and look at what we've done with the systems and the and the problems that we've solved and then you look at things like v o three on like video generation sort of rendering physics and lighting and things like that, you know, really in core fundamental things in physics. It's pretty interesting. I think it's telling us something quite fundamental about how the universe is structured in my opinion.
从某种意义上说,这正是我想构建AGI的原因,就是帮助我们作为科学家来回答像P等于NP这样的问题。
So, you know, in in a way that's what I want to build AGI for is to help us as scientists answer these questions like p equals m p.
是的。我认为我们可能会不断对经典计算机能够建模的内容感到惊讶。比如在交互方面,AlphaFold 3取得的进展令人意外,你竟然能在那个方向上取得某种突破。AlphaGenome也令人惊讶,你竟然能将遗传密码映射到功能。在这些涌现现象中进行探索,你原以为会有如此多的组合可能性,结果却成功了。
Yeah. I think we might be continuously surprised about what is modellable by classical computers. I mean, alpha fold three on the interaction side is surprising that you can make any kind of progress on that direction. Alpha genome is surprising that you can map the genetic code to the function. Kind of playing with the emergent kind of phenomena, you think there's so many combinatorial options that and then here you go.
你可以找到一个可以高效建模的核心方法。
You can find the kernel that is efficiently modeled.
没错。因为其中存在某种结构,某种能量地貌,或者其他你可以遵循的路径,某种梯度你可以追踪。当然,神经网络非常擅长的就是追踪梯度。所以如果你能找到一个目标函数并正确地定义它,那么你就无需处理所有那些复杂性。我认为这可能是我们过去几十年来对这些问题的天真理解方式。如果你只是枚举所有可能性,这些问题看起来完全无法解决。
Yes. Because there's some structure, there's some landscape, you know, in the energy landscape or whatever it is that you can follow, some grading you can follow. And of course, what neural networks are very good at is following gradients. And so if there's one to follow and object and you can specify the objective function correctly, you know, you don't have to deal with all that complexity, which I think is how we maybe have naively thought about it for decades. Those problems, if you just enumerate all the possibilities, it looks totally intractable.
类似的问题还有很多很多。你可能会想,比如蛋白质结构有10的300次方种可能,围棋的可能状态有10的100次方种,这些数字都远远超过宇宙中原子的数量。我们怎么可能找到正确的解决方案,或者预测下一步?但事实证明,这是可能的。
And there's many many problems like that. And then you think, well, it's like 10 to 300 possible protein structures, 10 to the 100 and, you know, 70 possible go positions. All of these are way more than atoms in the universe. So how could one possibly find the the right solution or predict the next step? And and it but it turns out that it is possible.
当然,现实世界和自然界确实做到了这一点,对吧?蛋白质确实能够折叠。这给了我们信心,说明一定存在某种机制——如果我们能在某种意义上理解物理学是如何做到这一点的,然后我们就能模仿这个过程,就能建模这个过程。
And of course, reality in nature does do it. Right? Proteins do fault. So that that gives you confidence that there must be if we understood how physics was doing that in a sense, then and we could mimic that process. I model that process.
基本上,这就是这个猜想的核心内容:在我们的经典系统上实现这一点应该是可能的。
It should be possible on our classical systems is is is basically what the conjecture is about.
当然,还有非线性动力系统,高度非线性的动力系统,所有涉及流体的问题。
And, of course, there's nonlinear dynamical systems, highly nonlinear dynamical systems, everything involving fluid.
没错。正是如此。
Yes. Right.
你知道,我最近和陶哲轩有过一次对话,他研究的数学问题涉及系统中某些奇点,这些奇点会破坏数学描述,是非常困难的课题。对于我们人类来说,要对高度非线性的动力系统做出清晰的预测是非常困难的。但再次回到你的话题,我们可能会对经典学习系统在流体方面能做的事情感到非常惊讶。
You know, I recently had a conversation with Terrence Tao, who mathematically contends with a very difficult aspect of systems that have some singularities in them that break the mathematics. And it's just hard for us humans to make any kind of clean predictions about highly nonlinear dynamical systems. But again, to your point, we might be very surprised what classical learning systems might be able to do about even fluid.
是的,没错。我是说,动力学、纳维-斯托克斯方程,这些在传统观念中一直被认为在经典系统上非常困难、难以处理的问题。它们需要巨大的计算量,你知道的,像预测系统这类东西都涉及流体动力学计算。但再次说回来,如果你看看像Vio这样的视频生成模型,它能够很好地模拟液体,好得令人惊讶。
Yes. Exactly. I mean, dynamics, Navier Stokes equations, these are traditionally thought of as very, very difficult intractable kind of problems to do on classical systems. They take enormous amounts of compute, you know, where the prediction systems, you know, these kind of things all involve fluid dynamics calculations. And but again, if you look at something like Vio, our video generation model, it can model liquids quite well, surprisingly well.
还有材料、镜面光照。我喜欢那些视频,比如有人生成的视频中,清水通过液压机然后被挤压出来的场景。我以前在游戏行业的早期曾编写过物理引擎和图形引擎,我知道要编写出能实现这种效果的程序有多困难。然而这些系统却似乎通过观看YouTube视频就能反向工程出这些效果。因此可以推测,它正在提取这些材料行为背后的某种基本结构。
And materials, specular lighting. I love the ones where, you know, there's there's people who generate videos where there's like clear liquids going through hydraulic presses and then it's being squeezed out. I used to write physics engines and graphics engines in in my early days in gaming and I know it's just so painstakingly hard to build programs that can do that. And yet somehow these systems are, you know, reverse engineering from just watching YouTube videos. So presumably what's happening is it's extracting some underlying structure around how these materials behave.
所以也许如果我们真正了解了系统内部的运作机制,就会发现存在某种可以被学习的低维流形。这可能也适用于现实世界的大多数现象。
So perhaps there is some kind of lower dimensional manifold that can be learned if we actually fully understood what's going on under the hood. That's maybe, you know, maybe true of most of reality.
是的,我一直被V O Three的这一方面所震撼。很多人会强调不同的方面,包括喜剧效果、梗图等等。还有它以非常逼真的方式捕捉人类形象的能力,让人感觉接近现实,并且还能结合原生音频。
Yeah. I've been continuously precisely by this aspect of v o three. I think a lot of people highlight different aspects, including the comedic and the meme Yes. And all that kind of stuff. And then the ultra realistic ability to capture humans in a really nice way that's compelling and get feels close to reality, and then combine that with native audio.
V O Three的这些方面都很棒,但正如你提到的,真正让我感兴趣的是它的物理模拟能力。是的,它并不完美,但已经相当出色了。而真正有趣的科学问题是,它到底理解了我们世界的什么内容,才能做到这一点?因为对于扩散模型,有一种悲观的看法认为它根本不懂任何东西。
All of those are marvelous things about v o three, but the exactly the thing you're mentioning, which is the physics. Yeah. It's not perfect, but it's pretty damn good. And then the really interesting scientific question is, what is it understanding about our world in order to be able to do that? Because of the cynical take with diffusion models, there's no way it understands anything.
但我觉得,我不认为你能在不理解的情况下生成这种视频,这又把我们哲学上对‘理解’含义的思考带到了表面。比如,你认为V O Three在多大程度上理解了我们的世界?
But it seemed I mean, I don't think you can generate that kind of video without understanding, and then our own philosophical notion of what it means to understand, then it's, like, brought to the surface. Like, do to what degree do you think v o three understands our world?
我认为,只要它能够以连贯的方式预测接下来的画面,某种程度上这就是一种理解,对吧?当然不是拟人化的、某种深层哲学意义上的理解。我不认为这些系统具备那种理解。但它们确实已经建模了足够的动力学特征,可以这么说,它们能够相当准确地生成出八秒钟连贯的视频,至少肉眼一看之下,很难发现其中的问题。
I think to the extent that it can predict the next frames, you know, in a coherent way, that some that is a form, you know, of understanding. Right? Not in the anthropomorphic version of, you know, it's not some kind of deep philosophical understanding of what's going on. I don't think these systems have that. But they they certainly have modeled enough of the dynamics, you know, put it that way, that they can pretty accurately generate whatever it is, eight seconds of consistent video that by eye, at least, you know, at a glance, it's quite hard to distinguish what the issues are.
想象一下,再过两三年时间,这正是我在思考的事情,以及到那时这些视频看起来会有多惊人,考虑到我们两年前还处于早期版本阶段。因此,进步的速度是惊人的。我和你一样,很多人都喜欢那些模仿单口喜剧演员的视频,它们其实很好地捕捉到了很多人类动态和肢体语言。但我印象最深、最着迷的还是物理行为、光照、材质和液体的表现。
And imagine that in two or three more years time. That's the thing I'm thinking about and how incredible that they will look given where we've come from, you know, the early versions of that one or two years ago. And so the rate of progress is incredible. And I think I'm like you is like a lot of people love all of the the the stand up comedians and the the the actually captures a lot of human dynamics very well and and body language. But actually, the thing I'm most impressed with and fascinated by is the physics behavior, the lighting and materials and liquids.
它能做到这一点真的很了不起,我认为这表明它至少具备某种直觉物理的概念,对吧?就像人类小孩理解物理的方式一样,而不是像博士生那样能完全解析所有方程。这是一种直觉上的物理理解。
And it's pretty amazing that it can do that. And I think that shows that it has some notion of at least intuitive physics, right? How things are supposed to work intuitively maybe the way that a human child would understand physics, Right? As opposed to, you know, a PhD student really being able to unpack all the equations. It's more of an intuitive physics understanding.
那么,这种对直觉物理的理解,是基础层面的东西,也就是人们常说的常识。再说一遍,它真的理解了一些东西。我认为这真的让很多人感到惊讶。我简直难以想象,竟然可以在没有理解的情况下生成如此逼真的效果。
Well, that intuitive physics understanding, that's the base layer. That's the thing people sometimes call a common sense. Again, It really understands something. I think that really surprised a lot of people. It blows my mind that I just didn't think it would be possible to generate that level of realism without understanding.
你提到有一种观点认为,你只能通过拥有一个具身化的AI系统,也就是一个与世界互动的机器人,来理解物理世界。这是构建对这个世界理解的唯一方式,对吧。但VO3直接挑战了这一点,感觉上是这样。
You there's this notion that you can only understand the physical world by having an embodied AI system, a robot that interacts with that world. That's the only way to construct an understanding of that world. Yeah. But v o three is directly challenging that Right. It feels like.
没错。这非常有趣,你知道吗,即使你问我五年前或十年前,我可能会说,尽管当时我已经参与其中,我也会说,是的,你可能需要理解直觉物理。比如,如果你把这个玻璃杯推下桌子,它可能会摔碎,液体也会洒出来。我们都知道这些事情。但我以前是这么认为的,而且神经科学中也有很多理论。
Yes. And it's very interesting, you know, even if we if you were to ask me five, ten years ago, I would have said even though was a must in all of this, I would have said, well, yeah, you probably need to understand intuitive physics, you know, like if I push this off the table, this glass, it will maybe shatter, you know, and the and the liquid will spill out. Right. So we know all of these things. But I thought that, you know, and there's a lot of theories in neuroscience.
这被称为行动中的感知,也就是说,你需要在这个世界中行动,才能真正深入地感知它。有很多理论认为你需要具身智能或机器人技术,或者至少是模拟的行动,才能理解像直觉物理这样的东西。但看起来,你似乎可以通过被动观察来理解这些,这对我来说相当出乎意料。再说一次,我认为这暗示了关于现实本质的一些深层问题,而不仅仅是它生成的那些酷炫视频。当然,下一步可能是让这些视频变得可交互。
It's called action in perception where, you know, you you need to act in the world to really truly perceive it in a deep way. And there was a lot of theories about you need embodied intelligence or robotics or something or maybe at least simulated action so that you would understand things like intuitive physics. But it seems like you can understand it through passive observation, which is pretty surprising to me. And and again, I think hints at something underlying about the nature of reality in in in my opinion beyond just the, you know, the cool videos that it generates. And and of course, there's next stages is maybe even making those videos interactive.
这样人们就可以真正走进它们,四处走动,这将是非常震撼的体验,尤其是考虑到我的游戏背景。你可以想象一下。然后我认为,我们开始接近我所说的“世界模型”,即对世界运作方式、世界机制、物理规律以及世界中事物的模型。当然,这也是构建真正AGI系统所需要的。
So one can actually step into them and move around them, which would be really mind blowing, especially given my games background. So you can imagine. And then and then I think, you know, you're we're starting to get towards what I would call a world model, a model of how the world works, the mechanics of the world, the physics of the world, and the things in that world. And of course, that's what you would need for a true AGI system.
我必须和你谈谈视频游戏。你有点调皮了。我觉得你在推特(也就是X)上越来越开心了,这很好。有个叫Jimmy Apples的人发推文说,让我玩一个基于VO3视频的电子游戏吧。谷歌做出了这么棒的可玩世界模型,拼写是W-E-N,问号?
I have to talk to you about video games. So you you were being a bit trolley. I I think you're you're having more and more fun on Twitter on X, which is great to see. So a guy named Jimmy Apples tweeted, let me play a video game of my v o three videos already. Google cooked so good playable world models when spelled w e n question mark.
然后你转发了这条推文,并写道:现在那不是一件很了不起的事吗?那么,用AI构建游戏世界有多难?也许你能展望一下未来五到十年的电子游戏发展,你怎么看?
And then you quote tweeted that with now wouldn't that be something? So how how hard is it to build game worlds with AI? Maybe can you look out into the future of video games five, ten years out? What do you think
那会是什么样呢?游戏其实是我最初的热爱,我最早从事的就是游戏AI的开发,那是我青少年时期做的第一项主要AI系统工作。我一直都想有一天能回到这个领域,满足自己的愿望。我想我会的,我也常常梦想着,如果在九十年代我就能拥有如今这样的AI系统,我会做出什么样的游戏。我认为我们可以做出真正令人震撼的游戏。
that looks like? Well, games were my first love really, and doing AI for games was the first thing I did professionally in in my teenage years and and was the first major AI systems that I built. And I always want to have I want to scratch that itch one day and come back to that. So, you know, and I will do I think and I think I'd sort of dream about, you know, what would I have done back in the nineties if I'd had access to the kind of AI systems we have today. And I think you could build absolutely mind blowing games.
我认为下一步是,我一向喜欢制作我所做过的所有游戏都是开放世界游戏。也就是说,这些游戏中有一个模拟系统,还有AI角色,玩家与这个模拟系统互动,而模拟系统会根据玩家的玩法进行适应。我一直觉得这类游戏是最酷的,比如我参与开发的《主题公园》(Theme Park),每个玩家的游戏体验都是独一无二的,因为你是在与系统共同创造这个游戏。
And I think the next stage is I always used to love making all the games I've made are open world games. So they're games where there's a simulation and then there's AI characters and then the player interacts with that simulation and the simulation adapts to the way the player plays. And I always thought they were the coolest games because so games like theme park that I worked on where everybody's game experience would be unique to them. Right? Because you're kind of co creating the game.
对吧?我们设定了参数,设定了初始条件,然后你作为玩家沉浸其中,与模拟系统共同创造它。但当然,编程开放世界游戏是非常困难的。无论玩家往哪个方向走,你都需要能够生成内容,而且无论玩家选择做什么,你都希望这些内容足够吸引人。
Right? We set up the parameters. We set up initial conditions and then you as the player immersed in it and then you are co creating it with the with the simulation. But of course, it's very hard to program open world games. You know, you've got to be able to create content whichever direction the player goes in and you want it to be compelling no matter what the player chooses.
因此,过去要构建像元胞自动机这样的经典系统其实一直都有些困难,这些系统能够产生一些涌现行为。但它们总是有些脆弱,有些局限。现在,也许在未来几年,未来五到十年里,我们将拥有真正能够围绕你的想象力进行创作的AI系统,它可以聚焦并动态地改变故事,讲述情节,使其充满戏剧性,无论你最终做出什么选择。这就像终极版的‘选择你自己的冒险’游戏。我认为如果我们设想一个互动版的《VO》(VO是一种互动式语音操作系统),再把它向前推进五到十年,你能想象它将会有多棒。
And so it was always quite difficult to build things like cellular automata actually type of those kind of classical systems which created some emergent behavior. But they're always a little bit fragile, a little bit limited. Now, we're maybe on the cusp in next few years, five, ten years of having AI systems that can truly create around your imagination, can narrow and sort of dynamically change the story and story tell the narrative around and make it dramatic no matter what you end up choosing. So it's like the ultimate choose your own adventure sort of game. And, you know, I think maybe we're within reach if you think of a kind of interactive version of VO and then wind that forward five to ten years and, you know, imagine how good it's gonna be.
是的,你刚才说了很多非常有趣的内容。首先,你所描述的那种开放世界是深度个性化的。这不仅仅是开放世界,而是你打开一扇新门时,里面真的会有内容。而是你以无约束的方式选择打开哪扇门,决定了你所看到的世界。
Yeah. So you said a lot of super interesting stuff there. So one, the open world built into that is a deep personalization, the way you've described it. So it's not just that it's open world, but you can open a new door and there'll be something there. It's that the choice of which door you open in an unconstrained way defines the worlds you see.
有些游戏也试图给你选择。是的。但这其实只是选择的幻觉,因为你只有那么几个门可选,比如我最近玩过的《史丹利的寓言》,它本质上只是把你带入一个既定的叙事路径。《史丹利的寓言》是一款很棒的游戏,我推荐大家去玩,它以一种元叙事的方式嘲讽了选择的幻觉,并涉及关于自由意志等哲学概念。
So some games try to do that to give you choice. Yes. But it's really just an illusion of choice because you only like like Stanley Parable is a game I recently played. It's it's it's really there's a couple of doors, and it really just takes you down the narrative. Stanley Parable is a great video game I recommend people to play that kinda, in a meta way, mocks the illusion of choice, and there's philosophical notions of free will and so on.
但我确实喜欢,我最喜欢的游戏之一是《上古卷轴:匕首雨》,我相信它在地牢的生成上使用了随机生成机制。是的,当你进入游戏时,它给你一种开放世界的感觉。你在前面提到了互动性,但其实第一步并不需要太多互动,因为不需要太多的交互。
But I do like, one of my favorite games, Elder Scrolls, is Daggerfall, I believe, that they really played with a, like, random generation of the dungeons Yeah. Of if you could step in and they give you this feeling of an open world. And there, you mentioned interactivity. You don't need to interact. That that's the first step because you don't need to interact that much.
你打开门时,看到的一切都是为你随机生成的。是的,这已经是一种令人惊叹的体验了,因为你可能是唯一一个看到它的人。
You just when you open the door, whatever you see is randomly generated for you. Yeah. And that's already an incredible experience because you might be the only person to ever see that.
是的,没错。但你想要的不仅仅是随机生成而已,对吧?你希望它比A/B选项这种硬编码的选择更好一些。
Yeah. Exactly. And and so but what you'd like is a little bit better than just sort of a random generation. Right? So you'd like and and also better than a simple a b hard coded choice.
对吧?那并不是真正的开放世界。正如你所说,那只是给你选择的幻觉。你真正想要的是在这个游戏环境中可以做任何事情。
Right? That's not really open world. Right? As you say, it's just giving you the illusion of choice. What you want to be able do is is potentially anything in that game environment.
我认为实现这一点的唯一方法是使用生成式系统,也就是能够实时生成内容的系统。当然,你不可能创造出无限多的游戏资源。要知道,现在AAA级游戏的制作成本已经很高了。这一点在九十年代我就已经很清楚了,那时我正在参与这些游戏的开发。
And I think the only way you can do that is to have generated systems, systems that will generate that on the fly. Of course, you can't create infinite amounts of game assets. Right? It's expensive enough already how triple a games are made today. And that was obvious to to us back in the nineties when I was working on all these games.
我想《黑与白》是我早期参与开发的一款游戏,它里面可能拥有当时最好的AI学习系统。那是一个早期的强化学习系统,你得照顾一个神话生物,培养它、养育它。根据你对待它的方式,它会以同样的方式对待那个世界里的村民。如果你对它不好,它也会对村民不好;如果你善良,它就会保护村民。
I think maybe black and white was the game that I worked on early stages of that that had the still probably the best AI learning AI in it. It was an early reinforcement learning system that you, you know, you were you were looking after this mythical creature and growing it and nurturing it. And depending how you treated it, it would treat the villagers in that world in the same way. So if you mean to it, it would be mean. If you're good, it would be protective.
所以,它实际上反映了你玩游戏的方式。事实上,我职业生涯的早期就是通过游戏这个媒介来研究模拟和AI的。而我现在所做的一切,其实仍然是从早期那些硬编码的AI方式延续而来,直到现在,我们才有了能够实现同样目标的通用学习系统。
And so it was really a reflection of the way you played it. So actually, all of the I've been working on sort of simulations and AI through the medium of games at the beginning of my career. And and really the whole of what I do today is still a follow on from those early more hard coded ways of doing the AI to now, you know, fully general learning systems that that are trying to achieve the same thing.
是的。看着这一切非常有趣、滑稽又充满乐趣。你和埃隆显然都迫不及待想创造游戏,因为你们都是游戏玩家。而在你们取得众多科学领域非凡成就的一个令人伤感的方面是,像你们这样从事严肃的成人事业的人,可能没有时间真正去开发一款游戏,最终你们或许只会开发一些工具,让其他人来开发游戏。
Yeah. It's been interesting, hilarious, and fun to watch. You and Elon obviously itching to create games because you're both gamers. And one of the sad aspects of your incredible success in so many domains of science, like serious adult stuff Yeah. That you might not have time to really create a game, you might end up creating the tooling that others would create the game.
你只能看着别人去创造你一直梦想的东西。你觉得在你极其繁忙的日程中,是否还有可能挤出时间来创造类似《黑与白》这样的作品?一个真正的电子游戏,实现你童年梦想的某个东西?
You have to watch other others create the thing you've always dreamed of. Do you think it's possible you can somehow, in your extremely busy schedule, actually find time to create something like black and white? Some some an actual video game where, like, you could make the childhood dream Yeah. To become reality.
你知道,关于这个问题,有两个方面可以思考。也许随着氛围编程(vibe coding)的发展,未来我有可能在空闲时间做到这一点。如果我有时间进行氛围编程的话,我会非常兴奋,也非常渴望去做这件事。另一个可能性是,在通用人工智能(AGI)被安全地引导并交付给世界之后,我可能会休一个长假来做这件事。明白我的意思吗?
You know, there's two things where to think about that is maybe that with vibe coding as it gets better, and there's a possibility that I could, you know, one could do that actually in in your spare time. So I'm quite excited about that as as that would be my project if if I got the time to do some vibe coding. I'm actually itching to do that. And then the other thing is, you know, maybe it's a sabbatical after AGI has been safely stewarded into the world and delivered into the world. You know that?
然后就是我们一开始谈到的,去研究我的物理学理论,这两个将会是我AGI之后的两个项目。我们可以这么称呼它们。
And then working on my physics theory as we talked about at the beginning, those would be the two my my two post AGI projects. Let's call it that way.
我非常期待看到你选择在AGI之后打造的终极游戏。是解决一些人类历史上最聪明的人曾经思考过的问题,比如P是否等于NP,还是去创造一款酷炫的视频游戏?
I I would love to see which The ultimate game. Post AGI, which you choose, solving the the problem that some of the smartest people in human history contended with. So p equals NP or creating a cool video.
是的,不过在我的设想中,这两者可能是有关联的,因为我可能会做一个尽可能逼真的开放世界模拟游戏。你知道,这其实就是在探讨‘宇宙是什么’这个问题。对吧?
Yeah. Well, they but they might but in my world, they'd be related because it would be an open world simulated game as realistic as possible. So, you know, what what is what is the universe? That's that's that's speaking to the same question. Right?
至于P等于NP的问题,我认为在我看来,所有这些问题都是相互关联的。
And p equals m p. I think all these things are related, at least in my mind.
从一个非常严肃的角度来说,我认为视频游戏有时被低估了,人们觉得它只是一个有趣的休闲活动。但随着人工智能越来越多地承担起现代世界中那些枯燥而困难的工作任务,视频游戏可能正是我们寻找意义、寻找如何度过时间的方式。你可以创造出极其丰富而有意义的体验,而这正是人类生活的本质。
I mean, in a really serious way, I think video games sometimes are looked down upon. There's just this fun side activity. But especially as AI does more and more of the difficult boring tasks, something we in in modern world called work, you know, video games is the thing in which we may find meaning, in which we may find, like, what to do with our time. You could create incredibly rich, meaningful experiences. Like, that's what human life is.
而在视频游戏中,你可以创造出更复杂、更多样化的体验方式。
And then in video games, you can create more sophisticated, more diverse ways
生活方式,没错,这正是重点。是的,对于我们这些热爱游戏的人来说,我现在依然如此,它几乎可以让你的想象力自由驰骋。
of living. Right? That's the point. Yeah. I mean, those of us who love games and I still do is is is, you know, it's almost can let your imagination run wild.
对吧?比如说,我以前非常热爱游戏以及开发游戏,因为那是一种融合,尤其是在九十年代和两千年代初,甚至包括八十年代,那可以说是游戏产业的黄金时代。当时一切都还在探索之中,新的游戏类型不断被发现。我们不只是在制作游戏。
Right? Like, I I used to love games and working on games so much because it's the fusion, especially in the nineties and '2 early two thousands, the sort of golden era and maybe the eighties of of of gay of the games industry. And it was all being discovered. New genres are being discovered. We weren't just making games.
我们感觉我们正在创造一种前所未有的娱乐媒介,尤其是在开放世界游戏和模拟游戏出现的时候,作为玩家的你共同参与创作了故事。没有其他娱乐媒介能做到这一点,你是观众,却能共同创造故事。当然,现在还有多人在线游戏,这也是一种非常社交的活动,可以探索各种有趣的世界。但另一方面,你也知道,享受和体验现实世界也是非常重要的。但接下来的问题就是,我认为我们必须再次提出或面对这个问题:现实的基本本质到底是什么?
We felt we were we were creating a new entertainment medium that never existed before, especially with these open world games and simulation games where you were co create you as the player were co creating the story. There's no other media entertainment media where you do that, where you as the audience actually co create the the story. And of course, now with multiplayer games as well, it can be a very social activity and can explore all kinds of interesting worlds in that. But on the other hand, you know, it's very important to also enjoy and experience the physical world. But the question is then, you know, I think we're going to have to call or confront the question again of what is the fundamental nature of reality?
这些日益逼真的模拟游戏、多人游戏以及动态生成的内容,与我们在现实世界中所做的事情之间的区别到底会是什么?
What is the gonna be the difference between these increasingly realistic simulations and multiplayer ones and emergent and what we do
在现实世界中?是的。体验现实世界和自然显然具有巨大的价值。直接与他人面对面互动也同样具有巨大价值,就像我们今天坐在这里一样。但我们必须用科学而严谨的方式来回答这个问题:为什么如此。
in the real world? Yeah. There's clearly a huge amount of value to experiencing the real world nature. There's also a huge amount of value in experiencing other humans directly in person, way we're sitting here today. But we need to really scientifically rigorously answer the question why.
没错。还有,这些体验中哪些方面可以映射到虚拟世界中呢?没错,正是如此。仅仅说一句‘对’是不够的。
Yep. And which aspect of that can be mapped Yep. Into the virtual world. Exactly. And It's not it's not enough to say, yeah.
你该去接触草地,去大自然中待一待。但人们会说,为什么?没错,正是这个问题。那真的有价值吗?
You should go touch grass and hang out in nature. It's like, why Yep. Exactly Yep. Is that valuable?
是的。我想这可能从我职业生涯一开始就在困扰我或者让我着迷的问题。如果你回顾我做过的所有不同事情,它们都与这个问题相关:模拟、现实的本质,以及什么是可以被建模的。
Yes. And I guess that's maybe the thing that's been haunting me or obsessing me from the beginning of my career. If you think about all the different things I've done, that's they're all related in that way. The simulation, nature of reality, and what is the bounds of, you know, what can be modeled.
问个有点荒谬的问题,到目前为止,有史以来最伟大的电子游戏是什么?哪些游戏可以排得上号?
Sorry for the ridiculous question, but so far, what is the greatest video game of all time? What's up there?
嗯,我最喜欢的有史以来的游戏是《文明》,我得这么说。《文明》第一代和第二代是我最喜欢的两款游戏。
Well, my favorite one of all time is civilization, I I have to say. That that was the the the civilization one and civilization two, my favorite games of all time.
我只能猜测你故意避开了最新版的《文明》,因为如果你玩了,你可能会进入一个长期休假状态,彻底消失不见。
I can only assume you've avoided the most recent one because it would probably you would that would be your sabbatical. That you would disappear.
是的,没错。这些《文明》游戏非常耗时间。所以我得对它们小心对待。这是个有趣的问题。
Yes. Exactly. They take a lot of time, these Civilization games. So I gotta be careful with them. Fun question.
你和埃隆似乎都算是资深玩家。擅长玩游戏和成为优秀的人工智能公司领导者之间有联系吗?我不知道,这个问题挺有意思的。我的意思是,我们都热爱游戏,而且有趣的是,他最初也写过游戏。
You and Elon seem to be somehow solid gamers. Is there a connection between being great at gaming and and being great leaders of AI companies? I don't know. I it's an interesting one. I mean, we both love games, and it's interesting he wrote games as well to start off with.
这可能尤其适用于我成长的那个时代,也就是上世纪八九十年代的英国,那时家用电脑刚刚兴起。我最早用的是Spectrum,然后是Commodore Amiga 500,这是我最喜欢的电脑。我就是从那时开始学习编程的。当然,编程中最有趣的事情之一就是编写游戏。我认为学习编程最好的方式之一就是做游戏,现在可能依然如此。
It's probably especially in the era I grew up in where home computers were just became a thing, you know, in the late eighties and nineties, especially in The UK. I had a Spectrum and then a Commodore Amica 500 which is my favorite computer ever. And that's why I learned all my programming. And of course, it's a very fun thing to program is to program games. So I think it's a great way to learn programming, probably still is.
之后,我自然地将它引向了人工智能和模拟的方向,这让我能够将我对游戏的兴趣和更广泛的科学兴趣结合起来。我认为游戏的另一个伟大之处在于它融合了艺术设计,也就是艺术与最前沿的编程技术。在九十年代,所有最有趣的技术进步都发生在游戏领域,无论是人工智能、图形、物理引擎,还是硬件,甚至GPU最初也是为游戏而设计的。所以九十年代推动计算技术发展的所有东西几乎都与游戏有关。有趣的是,当时的研究前沿就在那里。
And and then of course, I immediately took it in directions of AI and simulations, which so I may was able to express my interest in in games and my sort of wider scientific interest altogether. And then the final thing I think that's great about games is it fuses artistic design, you know, art with the the the most cutting edge programming. So again, in the nineties, all of the most interesting technical advances were happening in gaming, whether that was AI, graphics, physics engines, hardware, even GPUs, of course, were designed for gaming originally. So everything that was pushing computing forward in the in the nineties was due to gaming. So interestingly, that was where the forefront of research was going on.
它还与艺术形成了惊人的融合,比如图形、音乐,以及全新的叙事媒介。我非常喜欢这一点。对我来说,这种跨学科的合作是我一生都在享受的事情。
And it was this incredible fusion with with art, you know, graphics, but also music, and just the whole new media of storytelling. And I love that. For me, it's it's sort of multidisciplinary kind of effort is, again, something I've enjoyed my whole my whole life.
我必须问你一个问题。我差点忘记了一个最近众多令人惊叹的成果之一,那就是Alpha Evolve,它似乎还没有得到足够的关注。我们之前稍微谈过进化的问题,它是一个由谷歌DeepMind开发的、通过进化算法来生成算法的系统。是的。这类进化技术是否可以作为未来超级智能系统的组成部分?
I have to ask you. I almost forgot about one of the many and I would say of the most incredible things recently that somehow didn't yet get enough attention is Alpha Evolve. We talked about evolution a little bit, but it's the Google DeepMind system that evolves algorithms. Yeah. Are these kinds of evolution like techniques promising as a component of future superintelligence systems?
对于不了解的人来说,我不确定是否可以说它是大语言模型引导的进化搜索。是的。进化算法在进行搜索,而大语言模型则告诉你应该往哪里找。
So for people who don't know, it's kind of I don't know if it's fair to say it's LLM guided evolution search. Yeah. So evolutionary algorithms are doing the search, and LLMs are telling you where.
是的,没错。大语言模型会提出一些可能的解决方案,然后你使用进化计算来找到搜索空间中新的、独特的部分。实际上,我认为这是一个非常有前景的方向,即将大语言模型或基础模型与其他计算技术结合起来。进化方法是其中之一,我们还可以想象使用蒙特卡洛树搜索,或者基本上各种类型的搜索或推理算法,在基础模型之上运行,或者以基础模型为基础进行操作。
Yes. Exactly. So LLMs are kind of proposing some possible solutions and then you do you use evolutionary computing on top to to to find some novel part of the of the search space. So actually, I think it's an example of very promising directions where you combine LLMs or foundation models with other computational techniques. Evolutionary methods is one, but you could also imagine Monte Carlo tree search, basically many types of search algorithms or reasoning algorithms sort of on top of or using the foundation models as a basis.
所以我确实认为,在这类混合系统中,我们还有很多有趣的东西有待发现。我们可以这么称呼它们。
So I actually think there's quite a lot of interesting things to be discovered probably with these sort of hybrid systems, let's call them.
不过别把进化浪漫化了。是的,我也是人嘛。但你认为那种机制本身确实有一定价值吗?因为我们已经讨论过自然系统的问题。
But not to romanticize evolution. Yeah. I'm only human. But you you think there's some value in whatever that mechanism is? Because we already talked about natural systems.
你认为在理解我们能够建模、能够模拟进化方面,是否存在大量容易获取的成果?然后利用我们对这种受自然启发机制的理解,不断改进搜索能力,使其越来越强。
Do you think where there's a lot of low hanging fruit of us understanding being being able to model, being able to simulate evolution, and then using that whatever we understand about that nature inspired mechanism to to then do search better and better and
更好。所以如果你再次思考我们构建的系统,并将其分解到最基础的核心部分,你会得到关于系统底层动态的模型。而如果你想要发现一些新的、以前从未见过的东西,你就需要某种搜索过程,将你带到搜索空间中新的、独特的区域。你可以通过多种方式来实现这一点。
better. So if you think about again breaking down the sort of systems we've built to their really fundamental core. You've got like the model of the of the underlying dynamics of the system. And then if you want to discover something new, something novel that hasn't been seen before, then you need some kind of search process on top to take you to a novel region of the of the of the search space. And you can do that in a number of ways.
进化计算就是其中一种方法。在 AlphaGo 中,我们使用的是蒙特卡洛树搜索。对吧?正是这种方法发现了第37步,这个以前从未见过的围棋新策略。因此,这就是你如何超越目前已知内容的一种方式。
Evolutionary computing is one. With AlphaGo, we just use Monte Carlo tree search. Right? And that's what found Move 37 the new kind of never seen before strategy in Go. And so that's how you can go beyond potentially what is already known.
因此,模型可以模拟你目前所了解的一切,也就是你目前拥有的所有数据。但你如何进一步超越呢?这就涉及了创造力的概念。这些系统如何创造新事物、发现新事物?显然,这对科学发现,以及推动医学和医疗技术的发展至关重要,这也是我们希望利用这些系统实现的目标。
So the model can model everything that you currently know about, right, all the data that you currently have. But then how do you go beyond that? So that starts to speak about the ideas of creativity. How can these systems create something new, fight, discover something new? Obviously, this is super relevant for scientific discovery or pushing med science and medicine forward, which we wanna do with these systems.
你实际上可以在这些模型之上附加一些相对简单的搜索系统,从而进入空间中的新区域。当然,你还必须确保自己不是在完全随机地搜索这个空间,因为那会太大了。因此,你需要一个你试图优化并逐步提升的目标函数,它会引导你的搜索方向。但在程序空间中,可能有一些有趣的进化机制,比如说……
And you can actually bolt on some fairly simple search systems on top of these models and get you into a new region of space. Of course, you also have to make sure that you're not searching that space totally randomly. It would be too big. So you have to have some objective function that you're trying to optimize and hill climb towards and that guides that search. But there's some mechanism of evolution that are interesting maybe in the space of programs, but
那么程序空间是一个极其重要的领域,因为它可能可以推广到所有事物。嗯哼。明白吗?比如说,突变不仅仅只是像蒙特卡洛树搜索那样的搜索过程。
then the space of programs is an extremely important space because you can probably generalize to to everything. Mhmm. You know? But, you know, for example, mutation, this is not just Monte Carlo tree search where it's like a search.
嗯哼。你可以偶尔将事物组合在一起。
Mhmm. You could, every once in a while Combine things.
是的,组合事物。没错。比如改变某个事物的子部分或组件。对的。
Yeah. Combine things. Yeah. Alter, like, sub like, components of a thing. Yes.
因此,你知道,进化的真正优势不仅仅是自然选择。它还在于将事物组合在一起,并构建出日益复杂的分层系统。没错。
So then, you know, what evolution is really good at is not just the natural selection. It's combining things and building increasingly complex hierarchical systems. Yes.
因此,这一部分非常有趣。是的。特别是在程序空间中,就像 Alpha Evolve 那样。没错,正是如此。
So that component is super interesting. Yeah. Especially like with Alpha Evolve in the space of programs. Yeah. Exactly.
因此,你可以从进化系统中获得一些额外的特性,可能会涌现出一些新的能力。是的。但当然,就像生命进化过程中发生的那样。有趣的是,在没有大语言模型和现代人工智能的早期传统进化计算方法中,这个问题在九十年代和两千年初得到了深入研究,并取得了一些有希望的结果。但问题在于,它们始终无法解决如何进化出新的特性、新的涌现特性。
So there's a you can get a bit of an extra property out of evolutionary systems, which is some new emergent capability may come about. Yes. But of course, like, happened with life. Interestingly, with naive sort of traditional evolution computing methods without LLMs and the modern AI, the problem with them were they know that they were very well studied in the nineties and and and early two thousands and some promising results. But the problem was they could never work out how to evolve new properties, new emergent properties.
你总是只能得到你最初放入系统中的一部分特性。但也许如果我们把这些方法与这些基础模型结合起来,我们就能克服这一限制。显然,自然进化确实做到了这一点,因为它确实进化出了新的能力。对吧?从细菌到我们现在所处的位置。
You always had a sort of subset of the properties that you put into the system. But maybe if we combine them with these foundation models, perhaps we can overcome that limitation. Obviously, natural evolution clearly did because it it did evolve new capabilities. Right? So bacteria to where we are now.
所以很明显,进化系统是有可能生成新的模式,回到我们最初讨论的话题,还有新的能力和涌现特性。也许我们正处在发现如何实现这一点的边缘。
So clearly that it must be possible with evolutionary systems to generate new patterns, you know, going back to the first thing we talked about and new capabilities and emerging properties. And maybe we're on the cusp of discovering how to do that.
是的。听着,AlphaFold 是我见过最酷的东西之一。我在家里的书桌上就放着一个头骨,那是从水中爬上陆地的早期生物之一。我经常就坐在那台电脑前编程,旁边三块屏幕中间放着那个头骨,我经常看着它。
Yeah. Listen, alpha vol is one of the coolest things I've ever seen. I've I've on my desk at home, you know, most of my time is spent on that computer is just programming. And next to the the three screens is a skull of a tectalic, which is one of the early organisms that crawled out of the water onto land. And I just kinda watch that little guy.
进化所使用的计算机制真是令人难以置信。是的,它的确非常、非常了不起。虽然我们不一定非要完全照搬自然进化的方式来做我们的搜索,但永远不要忽视自然所展现出来的力量。
It's like you the the whatever the computation mechanism of evolution is is quite incredible. Yes. It's truly, truly incredible. Yeah. Now whether that's exactly the thing we need to do to do our search, but never never dismiss the power of nature what what it did here.
是的,而且令人惊叹的是,它其实是一个相对简单的算法,对吧?本质上来说,它能够产生如此巨大的复杂性。当然,它是在四亿年的时间里运行的,但你可以把它看作是一个搜索过程,这个过程在宇宙的物理基质上运行了极长的计算时间,最终产生了如此丰富而多样的生命形式。
Yeah. And it's amazing, which is a relatively simple algorithm. Right? Effectively and it can generate all of this immense complexity emerges. Obviously running over, you know, four billion years of time, but but it's it's it's you know, you can think about that as again a a process search process that ran over the physics substrate of the universe for a long amount of computational time, but then it generated all this incredible rich diversity.
我有太多问题想问你了。首先,你确实有一个梦想,就是尝试建模的一个自然系统,是细胞,对吧?是的,这是一个美好的梦想。
So so many questions I wanna ask you. So one, you do have a dream. One of the natural systems you want to try to model is a is a cell. Yes. That's a beautiful dream.
我可以就这个话题继续问你。另外,从更广泛的 AI 科学家角度来看,有一篇由 Daniel Cocatello、Scott Alexander 等人撰写的论文,其中列出了通向人工超级智能(ASI)的步骤,并提出了许多有趣的想法,其中之一就是超级人类水平的程序员和 AI 研究员。在这篇文章中提到了一个非常有趣的术语——研究品味(research taste)。那么在你看来,AI 是否有可能具备这种研究品味,从而像 AI 科学家那样帮助人类科学家,引导他们,甚至最终自己能够判断哪些方向值得探索,从而产生真正新颖的想法?
I could ask you about that. I also just for that purpose on the AI scientist front, broadly. So there's a essay from Daniel Cocatello, Scott Alexander, and others that outline steps along the way to get to ASI, and has a lot of interesting ideas in it, one of which is including a superhuman coder and a superhuman AI researcher. And in that, there's a term of research taste that's really interesting. So in everything you've seen, do you think it's possible for AI systems to have research taste to help you in the way that AI coscientists does, to help steer human human brilliant scientists and then potentially by itself to figure out what are the directions where you want to generate truly novel ideas.
因为这似乎是进行伟大科学研究的一个非常重要的组成部分。
Because that seems to be like a really important component of how to do great science.
是的。我认为这将是模仿或建模最难的部分之一,也就是所谓的品味或判断力。我认为这正是区分伟大科学家和优秀科学家的关键所在。所有专业科学家在技术上都是优秀的,对吧?
Yeah. I think that's gonna be one of the hardest things to to mimic or model is is this this idea of taste or or judgment. I think that's what separates the, you know, the the great scientists from the good scientists. Like all all professional scientists are good technically. Right?
否则,它就不会在学术界走得那么远。但你是否具备那种品味,能够辨别出正确的方向、合适的实验和关键的问题。挑选正确的问题是科学中最难的部分,也是提出正确假设的关键所在。而这一点,目前的系统显然还做不到。我常说,提出一个真正有价值的猜想,比解决它要困难得多。
Otherwise, it wouldn't have been made it that far in in academia and things like that. But then do you have the taste to sort of sniff out what the right direction is, what the right experiment is, what the right question is. So the is the is picking the right question is is the hardest part of science and and making the right hypothesis. And that's what, you know, today's systems definitely they can't do. So, you know, I often say it's harder to come up with a conjecture, a really good conjecture than it is to solve it.
因此,我们可能很快就会拥有能够解决非常困难猜想的系统。去年我们的系统在数学奥林匹克问题上表现不错,取得了银牌,解决了那些非常难的问题。也许最终我们甚至能解决类似千禧年大奖那样的难题。但一个系统能否提出一个值得研究的猜想,一个像Terrence那样的人会说‘哇,这个想法真棒’的猜想呢?
So we may have systems soon that can solve pretty hard conjectures. You know, I I am in Mass Olympiad problems where we we, you know, alpha proof last year. Our system got, you know, silver medal in that really hard problems. Maybe eventually we're better solve a Millennium Prize kind of problem. But could a system come up with a conjecture worthy of study that someone like Terrence would have gone, you know what?
这是一个关于数学本质、数的本质或物理本质的深刻问题。这种类型的创造力要困难得多。目前的系统显然还做不到这一点。我们也不太清楚这种想象力飞跃的机制是什么,就像爱因斯坦提出狭义相对论,然后在当时已有知识基础上提出广义相对论那样的突破。
That's a really deep question about the nature of maths or the nature of numbers or the nature of physics. And that is far harder type of creativity. And we don't really know today's systems clearly can't do that. And we're not quite sure what that mechanism would be, this kind of leap of imagination, like like Einstein had when he came up with, you know, special relativity and then general relativity with the knowledge he had at the time.
关于猜想,你要提出一个有趣的东西,它应该是可以被证明的。是的。比如,提出一个极其困难的东西很容易。是的。
As for as for conjecture, the you want to come up with a thing that's interesting. It's amenable to proof. Yes. So, like, it's easy to come up with a thing that's extremely difficult. Yeah.
提出一个极其简单的东西也很容易,但关键是要处于那个恰到好处的边缘。
It's easy to come up with a thing that's extremely easy, but that at that very edge
那个恰到好处的点,对吧?本质上是推动科学发展,把假设空间一分为二。对吧?无论它是否成立,你都学到了一些非常有用的东西。这很难。而且还要确保这个东西是可以证伪的,并且在你当前可用的技术范围内。
That sweet spot, right, of of basically advancing the science and splitting the hypothesis space into two ideally. Right? Whether if it's true or not true, you you've learned something really useful. And and and that's hard. And and and and making something that's also, you know, falsifiable and within sort of the technologies that you have, you currently have available.
所以这其实是一个非常有创造性的过程,一个高度创造性的过程,我认为仅仅依靠模型之上的简单搜索是远远不够的。
So it's a very creative process actually, highly creative process that I think just a kind of naive search on top of a model won't be enough for that.
好的。把假设空间一分为二的想法非常精彩。我听过你说,只要问题设计得好、实验设计得当,失败其实非常有价值,成功和失败都是有用的。是的。也许正是因为这样,它将假设空间一分为二,就像一次二分查找。
Okay. The idea of splitting the hypothesis space into super interesting. So I've heard you say that there's basically no failure in or failure is extremely valuable if it's done if you construct the questions right, if you construct the experiments right, if you design them right, that failure or success are both useful. So Yes. Perhaps because it splits the hypothesis space in two, it's like a binary search.
没错。当你进行那种纯粹的探索性研究时,只要你选择的实验和假设能够有意义地分割假设空间,就不存在真正的失败。你总能学到一些东西,从一个失败的实验中也能学到同样有价值的信息。只要你实验设计得好,假设本身有意义,它就会告诉你很多关于下一步该往哪里走的信息。你实际上是在进行一个搜索过程,并以一种非常有用的方式利用这些信息。
That's right. So when you do, like, you know, real blue sky research, there's no such thing as failure really as long as you're picking experiments and hypotheses that that that that meaningfully spit the hypothesis space. So, you know, and you learn something, you can learn something kind of equally valuable from an experiment that doesn't work. That should tell you if you've designed the experiment well and your hypotheses are interesting, it should tell you a lot about where to go next. And and then it's you're you're effectively doing a search process and using that information in in, you know, very helpful ways.
那么,回到你关于建模整个细胞的梦想,为了实现这个目标,我们面前有哪些重大挑战?也许我们应该强调一下Alpha系列的进展——当然,有太多突破了。AlphaFold解决了蛋白质折叠问题,这方面有很多令人惊叹的成果值得讨论,包括开源和你们发布的一切。AlphaFold 3现在正在研究蛋白质-RNA-DNA相互作用。
So to go to your dream of modeling a cell, what are the big challenges that lay ahead for us to make that happen? We should maybe highlight that alpha I mean, there's just so many leaps. Yeah. So alpha fold solved, if it's fair to say, protein folding, and there's so many incredible things we could talk about there, including the open sourcing, the everything you've released. AlphaFold three is doing protein RNA DNA interactions
嗯嗯。
Mhmm.
这非常复杂而且引人入胜。这种研究适合建模分析。Alpha基因组可以预测微小的遗传变化,比如我们所考虑的单个突变,是如何与实际功能相关联的。因此,看起来它正在逐步推进。
Which is super complicated and fascinating. This amenable to modeling. Alpha genome predicts how small genetic changes, like, we think about single mutations, how they link to actual function. So those are it seems like it's creeping along
是的。
Yes.
逐渐走向更复杂、更高级的事物,比如一个细胞,但一个细胞本身
To a sophisticate to to much more complicated things like a cell, but a cell has
就包含了许多非常复杂的组成部分。是的。所以在我整个职业生涯中,我一直尝试做的是,我有一些非常宏大的梦想,然后我会像你所注意到的那样,尝试去实现它们,但我也会尝试将它们分解成小块。要知道拥有一个疯狂而雄心勃勃的梦想很容易,但关键在于如何将其分解成可管理、可实现的阶段性步骤,而这些步骤本身就具有意义和实用价值。我称之为‘虚拟细胞’的项目,也就是对细胞进行建模的想法,这个念头我已经有了大概二十五年了。
a lot of really complicated components. Yeah. So what I've tried to do throughout my career is I have these really grand dreams, And then I try to, as you've noticed, and then I try to break but I try to break them down. Any know, it's easy to have a kind of a crazy ambitious dream, but the the the trick is how do you break it down into manageable, achievable interim steps that are meaningful and useful in their own right. And so virtual cell, which is what I call the project of modeling a cell, I've had this idea, you know, of wanting to do that for maybe more like twenty five years.
我过去常常和Paul Nurse交谈,他在生物学领域算是我的一位导师。他创办了克里克研究所,并于2001年获得了诺贝尔奖。我们从九十年代初就开始讨论这个问题。每隔五年我都会回来一次,问他:你是否需要一个完整的细胞内部模型,从而可以在虚拟细胞上进行实验,这些实验是在计算机中进行的(in silico),而这些预测结果可以为你节省大量在湿实验中所需的时间,对吧?
And I used to talk with Paul Nurse who is a bit of a mentor of mine in biology. He runs the the, you know, founded the Crick Institute and and won the Nobel Prize in in 02/2001. It is is we've been talking about it since, you know, before the, you know, in the nineties. And and I come to come back to every five years is like, would you need to model of the full internals of a cell so that you could do experiments on the virtual cell and what those experiment, you know, in silico and those predictions would be useful for you to save you a lot of time in the wet lab. Right?
这才是真正的梦想。也许通过在计算机中进行大部分实验,你可以将实验速度提高100倍,只在最后阶段通过湿实验进行验证。这才是我们的目标。但也许现在终于到了这个阶段,我正在尝试构建这些组件,其中AlphaFold就是其中之一,它最终将使我们能够对细胞的完整交互进行建模和仿真。我可能会从酵母细胞开始,部分原因也是因为Paul Nurse研究的就是酵母细胞,因为酵母细胞是一个单细胞的完整生物体。
That would be the dream. Maybe you could 100 x speed up experiments by doing most of it in silico, the search in silico, and then you do the validation step in the wet lab. That would be that's the that's the dream. And so but maybe now finally, so I was trying to build these components, alpha fold being one that that would allow you eventually to model the full interaction, a full simulation of a cell. And I'd probably start with a yeast cell and partly that's what Paul Nurse studied because the yeast cell is like a full organism that's a single cell.
对吧?所以它属于最简单的单细胞生物。它不仅仅是一个细胞,而是一个完整的生物体。而且酵母已经被研究得非常透彻了。因此,它将是构建完整模拟模型的一个很好的候选对象。
Right? So it's the kind of simplest single cell organism. And so it's not just a cell, it's a full organism. And and yeast is very well understood. And so that would be a good candidate for a kind of full simulated model.
目前,AlphaFold解决的是蛋白质三维结构的静态图像问题,也就是蛋白质看起来是什么样的静态结构。但我们知道,生物学中所有有趣的事情都发生在动态和相互作用之中。而AlphaFold 3正是迈向这一方向的第一步,即对这些相互作用进行建模。首先,是对成对的相互作用进行建模,比如蛋白质与蛋白质之间、蛋白质与RNA和DNA之间的相互作用。但接下来的一步可能是对整个通路进行建模,比如与癌症相关的TOR通路之类的。
Now, AlphaFold is the is the solution to the kind of static picture of what is a what is a protein look three d structure protein look like, a static picture of it. But we know that biology, all the interesting things happen with the dynamics, the interactions. And that's what AlphaFold three is is the first step towards is modeling those interactions. So first of all, pairwise, you know, proteins with proteins, proteins with RNA and DNA. But then the next step after that would be modeling maybe a whole pathway, maybe like the TOR pathway that's involved in cancer or something like this.
最终,我们或许能够对整个细胞进行建模。
And then eventually, you might be able to model, you know, a whole cell.
此外,这里还有另一个复杂性,就是细胞内的各种过程发生在不同的时间尺度上。这会不会很棘手?比如说,你知道的,蛋白质折叠是非常快速的。是的。我不了解所有的生物学机制,但有些过程
Also, there's another complexity here that stuff in a cell happens at different timescales. Is that tricky? It's like the you know, protein folding is, you know, super fast. Yes. Don't know all the biological mechanisms, but some of
可能需要很长的时间。
them take a long time.
没错。因此,这是否意味着相互作用的层级具有不同的时间尺度,而你必须能够对其进行建模?
Yeah. And so is that that's an level so the levels of interaction has a different temporal scale that you have to be able to model.
这样的话就会变得很困难。因此你可能需要多个能够以不同时间动态相互作用的模拟系统,或者至少是一个分层系统,这样你就可以在不同的时间阶段之间上下切换。那么你能否避免——我的意思是,其中一个
So that would be hard. So you'd probably need several simulated systems that can interact at these different temporal dynamics or at least maybe it's like a hierarchical system. So you can jump up or down the the different temporal stages. So can you avoid I mean, one
挑战在于不要试图回避模拟,比如说,所有这些过程中的量子力学层面。对吧?你不想过度建模。你可以跳过这些细节,直接建模那些高层次的内容,从而得到一个对可能发生的事情的很好估计
of the challenges here is not avoid simulating, for example, the the the quantum mechanical aspects of any of this. Right? You want to not overmodel. You could skip ahead to just model the really high level things that get you a really good estimate of what's
所以当你在建模任何自然系统的时候,你必须做一个决定:你要建模到什么程度的细节层次,才能捕捉到你感兴趣的动态。因此,对于细胞来说,我希望可以停留在蛋白质层面,而不需要深入到原子层面。当然,这也是AlphaFold发挥作用的地方。
going to happen. So you you gotta make a decision when you're modeling any natural system. What is the cutoff level of the granularity that you're gonna model it to that and then it captures the dynamics that you're interested in. So probably for a cell, I I would hope that would be the protein level and that one wouldn't have to go down to the atomic level. So, you know, and of course, that's where AlphaVault stock kicks in.
这可能就是基础,然后你可以构建更高层次的模拟系统,把这些作为构建模块,从而得到涌现行为。
So that would be kind of the basis And then you'd build these higher level simulations that take those as building blocks, and then you get the emergent behavior.
提前为我那些可能很傻的问题道歉,但我们是否认为将来有可能模拟生命的起源?也就是说,能够从非生命体模拟出生命的诞生过程。
Apologize for the pothead questions ahead of time, but we'll do you think we'll be able to simulate a model the origin of life? So being able to simulate the first from from nonliving organisms, the the birth of a living organism.
我认为这是当然,生物学中最深奥也最迷人的一个问题。我非常喜欢这个研究领域。比如尼克·莱恩写的有一本非常棒的书,他是这个领域的顶尖专家之一,书名叫《进化的十大发明》。我觉得这本书非常精彩。它也提到了所谓的‘大过滤器’——也就是那些可能阻碍生命发展的关键障碍——它们是已经过去了,还是尚未到来?我认为如果读了这本书,你就会明白产生任何生命本身的可能性就非常低。
I think that's one of the of course, one of the deepest and most fascinating questions. I love that area of biology, you know, these people like there's a great book by Nick Lane, one of the top top experts in this area called the the 10 great inventions of of of evolution. I think it's fantastic. And it also speaks to what the great filters might be, you know, prior or are they ahead of us? I think I think they're most likely in the past if you read that book of how unlikely to go, you know, have any life at all.
然后从单细胞到多细胞似乎是一个极其巨大的飞跃,在地球上花了大约十亿年才实现。对吧?这说明这个过程有多么困难。对吧?外部环境当时非常有利于生命
And then single cell to multi cell seems an unbelievably big jump that took like a billion years, I think, on Earth to do. Right? So it shows you how hard it was. Right? Exteriors were super happy for
非常
a very
早在它们以某种方式捕获线粒体之前很久了。对吧?我不明白为什么不能用AI来帮助解决这个问题,比如某种模拟。这又是一个在组合空间中的搜索过程。比如说,你从所有这些化学汤开始,也就是原始汤,可能存在于地球上的热液喷口附近。
long before they captured mitochondria somehow. Right? I don't see why not, why AI couldn't help with that, some kind of simulation again. It's again, it's a bit of a search process through a combinatorial space. Here's like all the, you know, the chemical soup that that you start with, the primordial soup that, you know, maybe was on earth near these hot vents.
这里有一些初始条件。你能生成一个看起来像细胞的东西吗?所以,或许在虚拟细胞项目之后的下一个阶段就是:如何让类似细胞的东西从化学汤中演化出来。
Here's some initial conditions. Can you generate something that looks like a cell? So perhaps that would be a next stage after the virtual cell project is, well, how how could you actually something like that emerge from the chemical soup.
嗯,如果生命起源也出现一个像第37步这样的关键转折点,我会非常期待。是的,我认为这是最伟大的谜题之一。我想最终我们会发现生命是一个连续体。不存在非生命和生命之间的明确界限。
Well, I would love it if there was a move 37 for the origin of life. Yeah. I think that's one of the sort of great mysteries. I think ultimately what we will figure out is their continuum. There's no such thing as a line between non living and living.
但如果我们能把这个过程变得严谨起来
But if we can make that rigorous
是的。
Yes.
从大爆炸到今天的整个过程其实是一脉相承的。如果我们能打破我们头脑中构建的那堵墙,即关于从非生命到生命的起源之间的界限,认识到它不是一条线,而是一个连接物理、化学和生物学的连续过程。
That that the very thing from the big big bang to today has been the same process. If we can break down that wall that we've constructed in our minds of the actual origin of from nonliving to living, and it's not a line, that it's a continuum that connects physics and chemistry and biology.
是的,因为根本就没有明确的界限。这也是我一生致力于人工智能和通用人工智能研究的根本原因,因为我相信它可以成为帮助我们回答这些问题的终极工具。我也不太理解为什么普通人不会更多地思考或担忧这些问题,比如我们为什么至今还没有一个关于生命、非生命和时间本质的清晰定义,更不用说意识、重力等等这些基本问题了。
Yeah. Because there's no line. I mean, this is my whole reason why I worked on AI and AGI my whole life because I think it can be the ultimate tool to help us answer these kind of questions. And I don't really understand why, you know, the average person doesn't think like worry about this stuff more. Like, how how can we not have a good definition of life and not and not living and non living and the nature of time and let alone consciousness and gravity and all these things.
还有量子力学的诡异现象。对我来说,这些问题一直都在我面前大声呼喊,而且声音越来越响亮。你知道,就像这里到底发生了什么?我是从更深的意义上说的,比如现实的本质,这才是终极的问题。
It's it's just and quantum mechanics weirdness. It's just to me, it's I've always had this sort of screaming at me in my face. The whole I need that it's getting louder. You know, it's like how what is going on here? You know, in in and I mean that in a deeper sense, like in the, you know, the nature of reality, which has to be the ultimate question Yeah.
如果仔细想想,这确实有点疯狂。我们可以彼此对视,可以一直观察这些生命体,可以用显微镜观察,几乎可以将它们分解到原子级别。但即便如此,我们仍然无法清楚地回答这个问题。
That would answer all of these things. It's sort of crazy if you think about it. We can stare at each other and and all these living things all the time. We can inspect it with microscopes and take it apart almost down to the atomic level. And yet we still can't answer that clearly Yeah.
简单来说,你如何定义‘活着’这个问题?是的。这有点令人惊叹。
In a simple way, that question of how do you define living? Yeah. It's kind of amazing.
是的。‘活着’这个问题,你可以用言语来绕开思考,但比如意识。我们有非常明显的主观意识体验,就像是我们各自世界的中心,而且它确实有感觉。然后,你怎能不对这一切的神秘感到惊呼呢?
Yeah. Living, you can kind of talk your way out of thinking about, but, like, consciousness. Like, we have this very obvious subjective conscious experience, like, we're at the center of our own world, and it it feels like something. And then how how how are you not screaming Yeah. At the mystery of it all?
我的意思是,事实上,人类长期以来一直在思考周围世界的奥秘,有很多谜题。比如太阳和雨是怎么回事?是的。那到底是什么情况?比如,去年下了好多雨,而今年却没怎么下雨。
I mean, but really, humans have been contending with the mystery of the world around them for a long, long there's a lot of mysteries. Like, what's up with the sun and and the rain? Yeah. Like, what's that about? And then, like, last year, we had a lot of rain, and this year, we don't have rain.
我们做错了什么吗?人类问这个问题已经很久了。
Like, what did we do wrong? Humans have been asking that question for a long time.
没错。所以,我们已经发展出了很多应对机制来面对这些谜题。
Exactly. So we're quite I guess we've developed a lot of mechanisms to cope with this
是的。
Yeah.
这些我们无法完全理解的深层谜题,我们能看到,但无法完全理解,所以我们只能继续过我们的日常生活。
These deep mysteries that we can't fully we can see, but we can't fully understand, and we have to have to just get on with daily life.
是的。
Yeah.
我们让自己忙碌起来,对吧?某种意义上说,我们是不是在刻意分散自己的注意力?
And and and we get we keep ourselves busy. Right? In a way, do we keep ourselves distracted?
我的意思是,天气是人类历史上最重要的问题之一。直到现在,我们还是习惯用谈论天气来作为寒暄的话题。
I mean, weather is one of the most important questions of human history. We still that's that's the go to small talk direction of of the weather.
尤其是在英国。
Especially in England.
是的。然后你会发现,众所周知,这是一个极其难以建模的系统。即使是这样的系统,Google DeepMind 也已经取得了进展。
Yeah. And then it's which is, you know, famously, it's an extremely difficult system to model. And even that system, Google DeepMind has made progress on.
是的。我们已经创建了世界上最好的天气预测系统,它们比传统的流体动力学系统更优秀,后者通常需要在巨型超级计算机上运行,计算过程需要几天时间。我们成功地使用神经网络系统对许多天气动力学进行了建模,这就是我们的 Weather Next 系统。同样有趣的是,即使这些动力学系统非常复杂,某些情况下几乎接近混沌系统,但它们的许多重要特征仍然可以通过这些神经网络系统进行建模。最近,我们甚至实现了气旋预测,可以预测飓风可能行进的路径,这当然对全球来说都具有极高的实用价值和重要意义。
Yes. We've we are we've created the the best weather prediction systems in the world, and they're better than traditional fluid dynamics sort of systems that usually calculate it on massive supercomputers, takes days to calculate it. We've managed to model a lot of the weather dynamics with neural network systems, with our weather next system. And again, it's interesting that those kinds of dynamics can be modeled even though they're very complicated, almost bordering on chaotic systems in some cases. A lot of the interesting aspects of that can be modeled by these neural network systems, including very recently we had, you know, cyclone prediction of where, you know, parts of hurricanes might go, of course, super useful, super important for the world.
而且及时、快速且准确地完成这些预测是非常重要的。我认为这再次表明了一个非常有前景的方向,那就是对复杂的现实世界系统进行模拟,并运行前向预测和模拟。
And and and it's super important to do that very timely and very quickly and as well as accurately. And I think it's very promising direction, again, of, you know, simulating and so that you can run forward predictions and simulations of very complicated real world systems.
我应该提一下,我在德克萨斯州有机会接触了一个叫做‘追风者’的群体。是的。他们最令人惊叹的地方在于,我还需要多和他们交流,他们对技术非常精通。因为他们必须使用模型来预测风暴的位置。所以那里呈现出一种美妙的结合,就像疯狂的结合。
I should mention that I've got a chance in Texas to meet a community of folks called the storm chasers. Yes. And what's really incredible about them, I need to talk to them more, is they're extremely tech savvy. Because what they have to do is they have to use models to predict where the storm is. So there it's this it's this beautiful mix of, like, crazy Yeah.
疯狂到可以进入风暴眼的程度。
Enough to, like, go into the eye of the storm.
是的。
Yeah.
为了保护自己的生命并预测极端天气事件的发生位置,他们必须不断开发越来越复杂的天气模型。是的,是的。这就像是一种美妙的平衡,一方面是作为生命体亲身参与其中,另一方面又是科学的最前沿。因此,他们实际上可能正在使用 DeepMind 的系统。
And, like, in order to protect your life and predict where the extreme events are going to be, they have to have increasingly sophisticated models of of weather. Yeah. Yeah. It's it's a a beautiful balance of, like, being in it as living organisms and the the cutting edge of science. So they actually might be using a deep mind system.
所以就是这样。
So that's.
是的,他们可能确实在使用。但愿他们确实在使用。我非常希望能加入他们的一次追踪行动,看起来太棒了。
Yeah. They are. But hopefully, they are. And I I love to join them on one of those changes. They look amazing.
对吧?真的去体验一次。没错。另外,也要亲身体验一下准确的预测,是的。某些事情即将发生,以及它将如何演变。
Right? To actually experience it one time. Exactly. And then also to experience the correct prediction Yeah. Where something will come and how it's going to evolve.
太不可思议了。
It's incredible.
是的。你预测我们将在2030年之前实现通用人工智能(AGI)。关于这一点,还有一些有趣的问题:我们实际上将如何知道我们已经达到了这个目标?而AGI的所谓‘第37步’又可能是什么?
Yep. You've estimated that we'll have AGI by 2030. So there's interesting questions around that. How will we actually know that we got there? And what may be the move, quote, move 37 of AGI?
我的估计是在未来五年内大概有50%的可能性实现。比如说,到2030年为止。因此我认为这种情况发生的可能性相当高。其中一部分取决于你对AGI的定义。当然,现在人们对此仍有争论,而我对AGI的标准相当高,一直以来都是如此,比如是否能够匹配大脑所具备的认知功能。
My estimate is sort of 50% chance by in the next five years. So, you know, by 2030, let's say. And so I think there's a good chance that that could happen. Part of it is what what is your definition of AGI? Of course, people arguing about that now and and mine's quite a high bar and always has been of like, can we match the cognitive functions that the brain has?
没错。我们知道,我们的大脑几乎就是通用图灵机的近似。当然,我们用我们的大脑创造了不可思议的现代文明。这也说明了大脑的通用性。而要让我们确认我们拥有了真正的AGI,我们必须确保它也具备所有这些能力。
Right. So we know our brains are pretty much general Turing machines approximate. And of course, we created incredible modern civilization with our minds. So that also speaks to how general the brain is. And for us to know we have a true AGI, we would have to like make sure that it has all those capabilities.
它不会像目前的系统那样,表现出一种参差不齐的智能,某些方面非常擅长,其他方面却存在严重缺陷。而这正是我们当前系统所存在的问题,它们并不一致。因此你希望看到的是在各个领域都具有一致性的智能表现。此外,我认为我们还缺少一些能力,比如真正发明和创造的能力,也就是我们之前提到的那种创造力。
It isn't kind of a jagged intelligence where some things it's really good at like today's systems, but other things it's really flawed at. And and that's what we currently have with today's systems. They're not consistent. So you'd want that consistency of intelligence across the board. And then we have some missing, I think capabilities like sort of the true invention capabilities and creativity that we were talking about earlier.
所以你如何测试这些能力呢?我认为你可以直接进行测试。一种方法是采用一种蛮力测试的方式,测试数以万计的认知任务,我们知道人类可以完成这些任务。或者,也可以让数百位世界顶级专家——每个学科领域的特伦斯·陶(Terence Tao)级别的专家——使用这个系统,并给他们一个月或两个月的时间,看看他们是否能找到系统中的明显缺陷。如果他们找不到,那么我认为你就可以相当有信心地认为我们已经拥有一个完全通用的系统了。
So you'd want to see those. How you test that? I think you just test it. One way to do it would be kind of brute force test of tens of thousands of cognitive tasks that, you know, we know that humans can do and maybe also make the system available to a few 100 of the world's top experts, Terrance Tauss of each each subject area and see if they can find, you know, give them give them a month or two and see if they can find an obvious flaw in the system. And if they can't, then I think you're you're pretty, you know, pretty you can be pretty confident that we have a a fully general system.
也许我可以稍微反驳一下。看起来人类确实非常了不起,随着智能在各个领域的全面提升,我们往往将其视为理所当然。嗯,就像你提到的特伦斯·陶这样的天才专家,他们可能在几周内就会对系统所能做到的一切感到习以为常,然后专注于寻找那些明显的缺陷。
Maybe to push back a little bit, it seems like humans are really incredible as the the intelligence improves across all domains to take it for granted. Mhmm. Like you mentioned, Terence Tau, these brilliant experts, they might quickly, in a span of weeks, take for granted all the incredible things you can do and then focus in, well, right there. You know, I I consider myself, first of all, human. Yeah.
我首先认为自己是一个人类,没错。我知道有些人听我说话的时候会觉得,这家伙不太擅长说话,结结巴巴的,你知道的。所以,即使是人类,在各个领域之外也明显存在局限,更不用说数学、物理等领域了。
I identify as human. The I you know, some people listen to me talk, and they're like, that guy is not good at talking. The stuttering, the you you know? So, like, even humans have obvious across domains limits, even just outside of Of course. Mathematics and physics and so on.
我在想,或许需要像‘第37步’那样的突破性表现,而不是仅仅通过一万项认知任务的测试。也就是说,可能只需要一两个任务,就能让人眼前一亮。
I I wonder if it will take something like a move 37. So on the positive side versus, like, a barrage of 10,000 cognitive tasks Yeah. Where it'll be one or two where it's like
是的。太震撼了。这很特别。没错。所以我认为需要进行广泛的测试,以确保系统具备一致性。
Yes. Holy shit. This is special. Exactly. So I think there's the sort of blanket testing to just make sure you've got the consistency.
但我觉得有一些像‘阿尔法狗’第37步那样的标志性时刻,是我正在寻找的。比如,提出一个关于物理学的新猜想或新假设,就像爱因斯坦当年那样。也许你甚至可以非常严格地进行回溯测试,比如设定知识截止时间为1900年,然后把截止时间之前所有的资料都输入给系统,接着看它是否能推导出狭义相对论和广义相对论,就像爱因斯坦所做的那样。
But I think there are the sort of lighthouse moments like the Move 37 that would I would be looking for. So one would be inventing a new conjecture or a new hypothesis about physics like Einstein did. So maybe you could even run the back test of that very rigorously like have a cutoff of knowledge cutoff of 1,900 and then give the system everything that was, you know, that was written up to 1,900 and then and then see if it could come up with special relativity and general relativity. Right? Like Einstein did.
那将是一个有趣的测试。另一个测试是,它能否发明出像围棋一样的游戏?不只是提出第37步那样的新策略,而是能否发明出一款像围棋一样深奥、审美价值高、优雅的游戏?这些是我会特别关注的事情。如果一个系统能完成其中几项,那就更令人信服了,对吧?
That that would be an interesting test. Another one would be, can it invent a game like Go? Not just come up with Move 37, a new strategy, but can it invent a game that's as deep as aesthetically beautiful as elegant as Go? And those are the sorts of things I would be looking out for and probably a system being able to do several of those things. Right?
这说明它的能力是非常通用的,而不仅仅局限于某个领域。因此,我认为这些至少是我会用来判断一个系统是否达到通用人工智能(AGI)水平的标志。也许为了进一步验证,你还可以检查它的逻辑一致性,确保这个系统没有漏洞。
That's for it to be very general, not just one domain. And so I think that would be the signs at least that I would be looking for that we've got a system that's AGI level. And then maybe to fill that out, you would also check their consistency, you know, make sure there's no holes in that system either.
是的。类似提出一个新猜想或科学发现这样的事情。那将是一种非常酷的体验。
Yeah. Something like a new conjecture or scientific discovery. That would be a cool feeling.
没错。那将令人惊叹。所以这不仅仅是帮助我们完成这些任务,而是系统本身能够提出全新的东西。
Yeah. That would be amazing. So it's not not just helping us do that, but actually coming up with something brand new.
而且你将亲历那一刻。这可能意味着在正式宣布之前,你可能已经知道两三个月了。
And you would be in the room for that. So it would be like probably two or three months before announcing it.
嗯。
Mhmm.
你只能坐在那里,努力克制自己不要
And you would just be sitting there trying not
发推文。类似这样的事情。没错。就像在想,这是多么惊人的新想法啊,对吧?你知道的,比如一个全新的物理学想法?
to tweet. Something like that. Exactly. It's like, what is this amazing new Yeah. You know, physics idea?
然后我们可能会与该领域的全球专家一起进行验证。是的,对吧?我们会进行验证,并逐步了解其运作方式。我想,它也会解释自己的运作原理。
And then we would probably check it with world experts in that domain. Yeah. Right? And validate it and kind of go through its workings. And it I guess it would be explaining its workings too.
是的,那将是一个令人惊叹的时刻。
Yeah. Be an amazing moment.
你会不会担心我们人类,甚至像你这样的专家人类也可能会遗漏某些东西?可能会忽略?
Do you worry that we, as humans, even expert humans like you might miss it? Might miss?
这可能相当复杂。因此,我打个比方,我觉得它不会对最优秀的人类科学家来说完全神秘,但它可能有点像国际象棋中的情况。例如,如果我和加里·卡斯帕罗夫或马格努斯·卡尔森下棋,他们走出一步绝妙的棋,我可能自己想不出那步棋,但他们可以解释为什么那步棋是有道理的。我们会在某种程度上更好地理解它,虽然无法达到他们那样的理解深度,但如果他们擅长解释的话——这也是智力的一部分,能够用简单的方式解释你所思考的内容。我认为这对最优秀的人类科学家来说是非常可能的。
It may be pretty complicated. So it could be the analogy I give there is I don't think it will be totally mysterious to the to the best human scientists, but it may be a bit like, for example, in chess, if I was to talk to Gary Casparo for Magnus Carlsen and play a game with them and they make a brilliant move, I might not be able to come up with that move, but they could explain why afterwards that move made sense. And we will better understand it to some degree, not to the level they do, but in you know, if they were good at explaining, which is actually part of intelligence too, is being able to explain in a simple way that what you're thinking about. I I think that that will be very possible for the best human scientists.
但我想知道,也许你可以给我讲讲围棋方面的事情。我想知道是否有一些来自阿法狗或者加里·卡斯帕罗夫的着法,一开始他们会认为这是个坏棋。
But I wonder, maybe you can you can educate me on the side of Go. I wonder if there's moves from Agnes or Gary where they at first will dismiss it as a bad move.
是的,有可能。但之后,他们会凭直觉发现其中的奥妙,明白为什么这步棋有效。然后,通过实践,游戏的一大好处就是你可以进行一种科学测试。
Yeah. Sure. It could be. But then afterwards, they'll figure out with their intuition that that this why this works. And then and then and then empirically, the nice thing about games is one of the great things about games is you can it's it's a sort of scientific test.
它是否让你赢得比赛?这会告诉你,这步棋最终是好的,那个策略是有效的。然后你可以回头分析它,甚至对自己进一步解释为什么,去探索它背后的原理。国际象棋的分析就是这么进行的。
Does it do you win the game or not win? And then that tells you, okay, that move in the end was good. That strategy was good. And then you can go back and analyze that and and and and and explain even to yourself a little bit more why explore around it. And that's how chess analysis and things like that work.
也许这就是我的大脑运作方式的原因,因为我从四岁起就一直在这样做,你接受过训练,你知道,这是一种非常严格的训练方式。
So perhaps that's why my brain works like that because I I've been doing that since I was four and you're trained, you know, try it's sort of hardcore training in that way.
但即使到现在,比如当我生成代码时,也会出现一种微妙而有趣的矛盾。我一开始可能会认为某些生成的代码在某些有趣而细微的方式上是错误的。但随后我总是要问自己一个问题:这里是否存在更深层的洞察,是我自己错了?
But even even now, like, when I generate code, there is this kind of nuanced fascinating con contention that's happening where I might at first identify as a set of generated code as incorrect in in some interesting nuanced ways. But then I'm always have to ask the question, is there a deeper insight here that that I'm the one who's incorrect?
嗯。
Mhmm.
随着系统变得越来越智能,你将不得不面对这个问题。这就像一个疑问,这是个漏洞还是你刚刚想出来的功能?
And that's going to as the systems get more and more intelligent, you're gonna have to contend with that. It's like, what what what do you is this a bug or a feature where you just came up with?
是的。这些事情做起来会相当复杂,但当然,你可以想象一下,会有AI系统来生成这些代码或者其他类似的东西。然后人类程序员来看这些代码,但同时他们也不是孤立地在看,也会借助AI工具的帮助。嗯,这将会很有趣,可能和现在的AI工具会有些不一样。
Yeah. And they're gonna be pretty complicated to do, but, of course, it will be you can imagine also AI systems that are producing that code or whatever that is. And then human programmers looking at it, but also not unaided with the help of AI tools as well. So Mhmm. It's gonna be kind of an interesting, you know, maybe different AI tools to the ones Yeah.
越是这类监控工具,就越可能是由AI生成的。
That the more, you know, kind of monitoring tools are the ones that generated it.
如果我们从AGI系统来看(抱歉又回到这个话题,但AlphaEvolve真的非常酷),从编程的角度来说,AlphaEvolve具备某种潜在的递归式自我改进能力。比如,你可以想象一下,也许不是第一版AGI系统,而是再往后几个版本的AGI系统,它会是什么样子?你觉得它会很简单吗?
So if we look at a AGI system sorry to bring it back up, but AlphaEvolve. Super cool. So AlphaEvolve enables, on the programming side, something like recursive self improvement potentially. Like, what if you can imagine what that AGI system, maybe not the first version, but a few versions beyond that, what does that actually look like? Do you think it will be simple?
你觉得它会不会是一个自我改进的程序,而且是一个简单的程序?
Do you think it will be something like a self improving program and a simple one?
我认为从理论上来说,这是可能的。不过我不确定这是否可取,因为这可能会引发一种快速起飞的场景。是的。不过,像现在这些系统,比如AlphaEvolve,它们在做各种决策时还是有人类参与其中。它们是人类与AI协作的混合系统。
I mean, potentially, that's possible, I would say. I'm not sure it's even desirable because that's a kind of, like, hard take off scenario. Yeah. But but you you these current systems like Alpha evolve, they have, you know, human in the loop deciding on various things. They're separate hybrid systems that interact.
但可以想象,最终这些过程可能会实现端到端的自动化。我不认为这在理论上有什么不可能。但目前来说,这些系统的水平还不够,还无法在架构设计方面完全自主完成代码的编写。再说一次,这和提出一个全新的假设性想法的概念有些关联。它们在你给出非常明确的指令时表现很好。
One could imagine eventually doing that end to end. I don't see why that wouldn't be possible. But right now, you know, I think the systems are not good enough to do that in terms of coming up with the architecture of the code. And again, it's a little bit reconnected to this idea of coming up with a new conjectural hypothesis. How like they they're good if you give them very specific instructions about what you're trying to do.
但如果你给的是一个非常模糊、高层次的指令,那它们目前就无法很好地完成任务。比如,想象一下,如果指令是“发明一个像围棋一样好的游戏”,这就是一个非常不明确的提示。
But if you give them a very vague high level instruction, that wouldn't work currently. Like and I think that's related to this idea of like invent a game as good as go. Right? Imagine that was the prompt. That's that's pretty under specified.
因此,我认为目前的系统还不知道该如何处理这样的问题,不知道如何将其缩小到一个可行的范围。类似地,比如说“创造一个更好的你自己的版本”,这也是一个过于开放的问题。但我们已经在某些方面做到了这一点,比如AlphaEvolve在矩阵乘法加速方面的成果。当你把目标限定在一个非常具体的问题上时,它在这方面非常擅长逐步改进。
And so the current systems wouldn't know I think what to do with that, how to narrow that down to something tractable. And I think there's similar like, look, just make a better version of yourself. That's too that's too unconstrained. But we've done it in, you know, and and as you know, with AlphaVolve like things like faster matrix multiplication. So when you when you hone it down to a very specific thing you want, it's very good at incrementally improving that.
但目前来说,这些改进更多是渐进式的,属于小幅度迭代。而如果你想要实现理解上的巨大飞跃,那就需要更重大的突破。
But at the moment, these are more like incremental improvements, sort of small iterations. Whereas if, you know, if you wanted a big leap in understanding, you'd need a you'd need a much larger advance.
是的。但这可能也是一种对硬起飞情景的反驳。它可能只是一系列渐进式的改进,比如矩阵乘法。它需要花几天时间坐在那里思考如何逐步改进一个东西,并且它是递归地进行这种改进。而随着你不断改进,进展速度反而会变慢。
Yeah. But it could also be sort of to push back against hard takeoff scenario. It could be just a sequence of incremental improvements, like matrix multiplication. Like, it has to sit there for days thinking how to incrementally improve a thing, and that it does so recursively. And as you do more and more improvement, it'll slow down.
对。那将是一条通往通用人工智能(AGI)的道路,不会像突然爆发那样,而是随着时间的推移逐步改善。
Right. There'll be like a like, the path to AGI won't be like a it'd be a gradual improvement over time.
如果只是渐进式的改进,那它看起来就会是那个样子。所以问题是,它能否像变压器架构(transformers)那样提出新的飞跃?是的,对。它能在2017年做到这一点吗?那时候我们做了,Brain团队也做了。
If it was just incremental improvements, that's how it would look. So the question is, could it come up with a new leap like the transformers architecture? Yeah. Right. Could it have done that back in 2017 when, you know, we did it and Brain did it?
目前还不清楚我们的这些系统,比如AlphaVolt,是否无法实现如此大的飞跃。所以可以肯定的是,这些系统是优秀的。我认为我们有一些系统可以进行渐进式的改进,就像爬山一样逐步上升。
And it's it's not clear that that these systems, something our AlphaVolt wouldn't be able to do, make such a big leap. So for sure, these systems are good. We have systems I think that can do incremental hill climbing.
嗯。
Mhmm.
这是一个更大的问题:从现在起,是否只需要这样的渐进式改进?还是我们实际上还需要一两次重大的突破?
And that's a kind of bigger question about is that all that's needed from here or do we actually need one or two more big breakthroughs?
而且,同样的这些系统是否也能带来这些突破?所以它可能是一系列S型曲线,既有渐进式的改进,但偶尔也会有飞跃。
And can the same kind of systems provide the breakthroughs also? So make it a bunch of s curves, like incremental improvement, but also every once in a while leaps.
是的。我认为目前还没有人拥有能够明确展示出这些重大飞跃的系统。对,我们有很多系统可以沿着你当前所处的S曲线进行爬坡式的改进。
Yeah. I don't think anyone has systems that can have shown unequivocally those big leaps. The the the right. We have a lot of systems that do the hill climbing of the s curve that you're currently on.
是的。就像AlphaGo的第37步那样。
Yeah. And that would be the move 37 is a Yeah.
我认为那确实是一次飞跃,就是那种类似的情况。
I think it would be a leap. It's something like that.
你认为在预训练、训练后、测试阶段和计算资源方面,规模扩展规律是否依然有效?从另一个角度看,你是否预计人工智能的发展会遇到瓶颈?
Do you think the scaling laws are holding strong on pre training, post training, test time, compute? Do you, on the flip side of that, anticipate AI progress hitting a wall?
我们当然觉得在扩展方面还有很大的空间。实际上,所有阶段——预训练、训练后和推理阶段都还有扩展的潜力。因此,目前有三个扩展方向在同时进行。而我们再次强调,这取决于你能有多创新。我们一直以拥有最广泛和最深入的研究团队而自豪。
We certainly feel there's a lot more room just in the scaling. So actually all steps, pre training, post training, and inference time. So there's sort of three scalings that are happening concurrently. And we again, there, it's about how innovative you can be. And we, you know, we pride ourselves on having the broadest and deepest research bench.
我们拥有非常出色的、杰出的研究人员,比如Noam Shazir,他参与发明了Transformer模型,还有领导AlphaGo项目的Dave Silver等等。正是这样的研究基础,意味着如果需要新的突破,比如像AlphaGo或Transformer这样的成果,我相信我们是最适合实现它的团队。所以,其实我反而喜欢在挑战更大的环境下前进。对吧?因为那意味着从单纯的工程实现更多地转向真正的研究,也就是研究或研究结合工程的方向,而这是我们最擅长的领域。
We have amazing, you know, incredible researchers and people like Noam Shazir, you know, came up with transformers and and Dave Silver, you know, who led the AlphaGo project and so on. And it's it's it's that research base means that if some new new breakthrough is required like an AlphaGo or transformers, I would back us to be the place that does that. So I'm actually quite like it when the terrain gets harder. Right? Because then it veers more from just engineering to to true research and, you know, research or research plus engineering and that's our sweet spot.
我认为发明新东西比快速跟进要困难得多。所以,坦率地说,目前还不确定是否需要新的突破,还是现有的扩展方法已经足够。可以说,这两种可能性各占一半。因此,我们以实证的方式,尽可能地同时推进这两个方向。
And I I think that's harder. It's harder to invent things than to than to, you know, fast follow. And so, you know, we don't know. I would say it's a it's kind of fifty fifty whether new things are needed or whether the scaling the existing stuff is gonna be enough. And so in true kind of empirical fashion, we're pushing both of those as hard as possible.
一方面推进全新的、探索性的想法,大概投入了我们一半的资源;另一方面则尽最大努力扩展当前的能力。我们仍然在Gemini的每个新版本上看到了一些惊人的进展。
The new blue sky ideas and, you know, maybe about half our resources on that. And then and then scaling to the max the the current the current capabilities. And we're still seeing some, you know, fantastic progress on each different version of Gemini.
你刚才提到的关于深厚研究团队的说法很有趣。也就是说,如果通往AGI(通用人工智能)的道路不仅仅是扩展计算资源,不仅仅是工程层面的问题,而是更偏向科学层面,需要新的突破,那么你对DeepMind,或者说Google DeepMind也有信心。是的,它确实处于一个非常有利的位置。在那个领域,它能够大展身手。
That's interesting the way you put it in in terms of the deep bench that if progress towards AGI is more than just scaling compute, so the engineering side of the problem, and is more on the scientific side where there's breakthroughs needed, then you feel confident in DeepMind as well. Google DeepMind is well positioned to Yes. Kick kick ass in that domain.
是的,回顾过去十到十五年的历史,现代人工智能领域中大约90%的重大突破最初都来自Google Brain、Google Research和DeepMind。所以,我希望并相信这种趋势能够继续下去。
Well, I mean, you look at the history of the last decade or fifteen years Yeah. It's been I mean, no. Maybe, I don't know, 90% of the breakthroughs that mod that underpins modern AI field today was from, you know, originally Google Brain, Google Research, and DeepMind. So, yeah, I would back that to continue, hopefully. So
在数据方面,你是否
on the data side, are
担心高质量数据,尤其是高质量人类数据的枯竭?我对此并不太担心,部分是因为我认为现有的数据已经足够让系统达到相当高的水平。这也再次回到了模拟数据的问题上。如果你有足够的数据来构建模拟系统,就可以生成更多符合正确分布的合成数据。显然,这是关键所在。
you concerned about running out of high quality data, especially high quality human data? I'm not very worried about that partly because I think there's enough data or and it's been proven to get the systems to be pretty good. And this goes back to simulations again. If you do you have enough data to make simulations or so that you can create more synthetic data that are from the right distribution. Obviously, that's the key.
你需要足够的真实世界数据,才能创建出这类数据生成器。我认为我们目前已经达到了这个阶段。
So you need enough real world data in order to be able to create those kinds of generator data generators. And I think that we're at that step at the moment.
是的。你在科学和生物学方面做了很多了不起的工作。嗯,在数据不多的情况下做了很多事情。
Yeah. You've done a lot of incredible stuff on the side of science and biology Mhmm. Doing a lot with not so much data.
是的。我的意思是,这仍然是很多数据。
Yeah. I mean, it's still a lot
但我想已经足够起飞了。继续吧。
of data, but I guess enough take off. Going.
没错。是的。正是如此。
Exactly. Yeah. So exactly.
计算能力的扩展对于构建通用人工智能(AGI)有多重要?这是一个工程问题。这几乎也是一个地缘政治问题,因为它还涉及供应链和能源问题。是的。你非常关注的一个领域,可能是核聚变。是的。
How crucial is the scaling of compute to building AGI? This is a question that's an engineering question. It's a almost a geopolitical question because it also integrated into that is supply chains and energy Yes. A thing that you care a lot about, which is potentially fusion. Yes.
因此,在能源方面也需要创新。你认为我们还会继续扩展计算能力吗?
So innovating on the side of energy also. Do you think we're gonna keep scaling compute?
我认为会的,有几个原因。我觉得计算能力方面,训练时所需的计算能力通常需要集中部署。实际上,即使是数据中心之间的带宽限制也会影响这一点。因此,在这方面也存在额外的限制。
I think so for several reasons. I think compute there's there's the amount of compute you have for training. Often it needs to be co located. So actually even like, you know, bandwidth constraints between data centers can affect that. So it's it's it's there's additional constraints even there.
显然,这对于训练最大的模型非常重要。但另外,由于现在人工智能系统已经进入产品中,并被全球数十亿人使用,因此现在需要大量的推理计算能力。此外,过去一年出现了一种新的范式——思考系统,这种系统在测试时给予的推理时间越长,它就会变得越聪明。所以,所有这些都需要大量的计算能力。我并不认为这种趋势会放缓。
And that that's important for training, obviously, the largest models you can. But there's also because now AI systems are in products and being used by billions of people around the world, you need a ton of inference compute now. And then on top of that, there's the thinking systems, the new paradigm of the last year that where they get smarter, the longer amount of inference time you give them at test time. So all of those things need a lot of compute. And I don't really see that slowing down.
随着人工智能系统的进步,它们将变得更加有用,也会带来更多的需求。因此,无论是从训练的角度来看,训练其实只是其中的一部分,甚至可能成为所需计算中较小的一部分。是的,在整体所需的计算中,它可能只是较小的一部分。是的。
And as AI system become better, they'll become more useful and there'll be more demand for them. So both from the training side, the training side actually is is only just one part of that. It may even become the smaller part of of what's needed Yeah. In the overall compute that that's required. Yeah.
这是一种有点像模因(meme)一样的东西,就是关于V O 三的成功和令人惊叹的方面。有一些人
That's one sort of almost meme y kind of thing, which is like the success and the incredible aspects of v o three. There's people
有点像是在开玩笑,它越成功,你知道的,服务器就越吃力。
kind of make fun of, like, the more successful it becomes, the, you know, the servers are sweating.
是的。能让你联想到那种场景。对,对,没错。
Yes. Gives you the inference. Yeah. Yeah. Exactly.
我们甚至拍了一个服务器煎鸡蛋之类的小视频。就是这样,我们得想办法解决这个问题。我们在硬件创新方面做了很多有趣的工作。如你所知,我们有自己的TPU芯片系列,我们也在研究只用于推理的设备,也就是只用于推理的芯片,以及如何让它们更高效。
We did a little video of of the servers frying eggs and things. And that's right. And and and we're gonna have to figure out how to do that. There's a lot of interesting hardware innovations that we do. As you know, we have our own TPU line and we're looking at like inference only things, inference only chips and how we can make those more efficient.
我们也非常有兴趣构建人工智能系统来帮助解决能源使用问题。例如帮助数据中心节能,比如冷却系统效率提升、电网优化,最终甚至可以应用在等离子体约束聚变反应堆方面。我们与Commonwealth Fusion在这方面做了大量工作。还可以想象反应堆设计和材料设计方面的应用。我认为这是最具吸引力的新领域之一,比如新型太阳能材料、太阳能板材料、常温超导材料,这些一直是我梦想中的重大突破,还有最优电池。我认为只要解决其中任何一个问题,都会对气候和能源使用带来革命性的变化。
We're also very interested in building AI systems and we have done the help with energy usage. So help data center energy, like for the cooling systems be efficient, grid optimization, and then eventually things like helping with plasma containment fusion reactors. We've done lots of work on that with Commonwealth Fusion. And also one could imagine reactor design and then material design, I think, is one of the most exciting new types of solar materials, solar panel material, super room temperature superconductors has always been on my list of dream breakthroughs and optimal batteries. And I think a solution to any, you know, one of those things would be absolutely revolutionary for, you know, climate and energy usage.
我认为我们可能已经接近这个目标了,再次强调,未来五年内我们将拥有能够实质性帮助解决这些问题的人工智能系统。
And we're probably close, you know, and again, in the next five years to having AI systems that can materially help with those problems.
如果你愿意打个赌——抱歉这个问题有点荒谬——你觉得在二、三十、四十年后,主要的能源来源会是什么?你认为会是核聚变吗?
If you were to bet sorry for the ridiculous question. Yeah. What what is the main source of energy in, like, twenty, thirty, forty years? Do you think it's gonna be nuclear fusion?
我比较看好核聚变和太阳能这两个方向。太阳能,当然,你可以把它看作是天空中的一个核聚变反应堆。我认为主要的问题在于电池和输电技术。当然,未来也许还能开发出更高效的太阳能材料,甚至在太空中实现类似戴森球这样的构想。至于核聚变,我认为它是完全可行的,看起来是这样。
I think fusion and solar are the two that I I would bet on. Solar, I mean, you know, it's the fusion reactor in the sky, of course. And I think really the the problem there is is is batteries and transmission. So, you know, as well as more efficient, more more efficient solar material perhaps eventually, you know, in space, you know, these kind of Dyson sphere type ideas. And fusion, I think, is definitely doable, seems.
如果我们能设计出合适的反应堆,并能够足够快速地控制等离子体等等。我认为这两个问题最终都会被解决。因此,我们将来很可能至少拥有这两种主要的可再生、清洁、接近免费甚至完全免费的能源。生活在这样的时代真是太棒了。
If we have the right design of reactor and we can control the plasma and fast enough and so on. And I think both of those things will actually get solved. So we'll probably have at least those are probably the two primary sources of renewable, clean, almost free, or perhaps free energy. What a time to be alive.
如果我和你一起穿越到一百年后的未来,你会对你看到的文明达到卡尔达肖夫一级文明的程度感到惊讶吗?
If I traveled into the future with you a hundred years from now, how much would you be surprised if we've passed a type one Kardashev scale civilization?
如果是在从现在起100个时间单位之后,我不会感到特别惊讶。我的意思是,如果我们通过刚刚讨论的其中一种方式解决了能源问题,比如核聚变或者非常高效的太阳能,那么一旦能源变得可再生、清洁且近乎免费,就会解决大量其他问题。例如,水资源获取问题就会消失,因为你可以直接使用海水淡化技术,我们已经有这样的技术了。
I would not be that surprised if there's a like a 100 time scale from here. I mean, I think it's pretty clear if we crack the energy problems in one of the ways we've just discussed fusion or or very efficient solar. Then if energy is kind of free and renewable and clean, then that solves a whole bunch of other problems. So for example, the water access problem goes away because you can just use desalination. We have the technology.
它就是太贵了。所以只有像新加坡和以色列等相对富裕的国家才会实际使用它。但如果它便宜的话,那么所有拥有海岸线的国家都可以这么做。而且,你将拥有无限的火箭燃料。你可以利用能量将海水分离成氢气和氧气,而这就是火箭燃料。
It's just too expensive. So only, you know, fairly wealthy countries like Singapore and Israel and so on, like actually use it. But but if it was cheap, then every then, you know, all countries that have a coast could. But also you'd have unlimited rocket fuel. You could just separate seawater out into hydrogen and oxygen using energy and that's rocket fuel.
如果再加上埃隆令人惊叹的可自动着陆的火箭,那么通往太空的旅程可能就会像公共巴士服务一样。这将开启令人难以置信的新资源和领域。我认为小行星采矿将成为现实,人类也将最大程度地繁荣发展,迈向星辰大海。这也是我所梦想的,就像卡尔·萨根所提出的那样,将意识带入宇宙,唤醒宇宙。我认为,如果我们正确地发展人工智能,并用它解决其中的一些问题,从长远来看,人类文明将真正实现这一点。
So combined with, you know, Elon's amazing self landing rockets, then it could be like you sort of like a bus service to to space. So that opens up, you know, incredible new resources and domains. Asteroid mining, I think will become a thing and maximum human flourishing to the stars. I that's what I dream about as well as like Carl Sagan's sort of idea of bringing consciousness to the universe, waking up the universe. And I I think human civilization will do that in the full sense of time if we get AI right and and and and crack some of these problems with it.
是的。我在想,如果你只是一个在太空中旅行的游客,那会是什么样子。你首先注意到的肯定是地球,因为如果你解决了能源问题,你可能会看到很多太空火箭。嗯,就像交通一样。
Yeah. I wonder what it would look like if you're just a tourist flying through space. You would probably notice Earth because if you solve the energy problem, you would see a lot of space rockets probably. So it would be Mhmm. Like traffic
就像在伦敦这里的交通,但发生在太空中,没错。
here in London, but in space Yes.
没错,就是很多火箭。然后你可能还会看到一些漂浮在太空中的能量推力,比如太阳能,是的,潜在的可能性很大。
Exactly. Just a lot of rockets. Yes. And then you would probably see floating in space some kind of thrust of energy like solar Yep. Potentially.
所以地球表面看起来会更加科技化。然后你可以利用这些能源来保护自然,比如雨林之类的。
So Earth would just look more on the surface more technological. And then then you would use the power of that energy then to preserve the natural Yes. Like the rainforest and all that
因为在人类历史上,我们第一次不再受资源限制。嗯嗯。我认为这将为人类开启一个令人惊叹的新时代,不再是零和博弈。对吧?
Because kind of for the first time in in human history, we wouldn't be resource constrained. Mhmm. And I think that could be amazing new era for humanity where it's not zero sum. Mhmm. Right?
我拥有这块土地,而你没有。或者,如果我们把森林留给老虎,当地的村民就无法使用。他们该怎么办?我认为这将解决很多问题。不,不会全部解决。
I have this land, you don't have it. Or if we take, you know, if the tigers have their forest, then the the local villagers can't. What are they going to use? I think that this will help a lot. No.
它不会解决所有问题,因为人类还有其他固有的缺点依然存在,但它至少能消除一个大问题。我认为最大的问题之一就是资源稀缺,包括土地、原材料和能源的匮乏。有些人称之为丰饶时代,也有人称之为激进的富足时代,在这个时代,资源足够所有人使用。当然,下一个重要问题是确保这些资源能够公平地分配,让社会中的每个人都能从中受益。
It won't solve all problems because there's still other human foibles that will will will still exist, but it will at least remove one. I think one of the big vectors, which is scarcity of resources, you know, including land and more materials and energy. And, you know, we should be as some just call it like and others call it about this kind of radical abundance era where there's plenty of resources to go around. Of course, the next big question is making sure that that's fairly, you know, shared fairly, and everyone in society benefits from that.
人性中确实存在某种倾向,让我觉得就像《波拉特》里说的那样:我的邻居,我讨厌你,你开始惹麻烦,我们就会制造冲突。实际上,我最近了解到,游戏从古至今的一个作用,就是把人们从真正的战争中转移出来。所以也许我们可以设计出越来越复杂的电子游戏,让我们释放那种对冲突的需求,满足我们人性中的某种冲动,从而避免因技术日益先进而可能爆发的真实的热战。因为我们早就过了那个阶段,我们现在制造的武器足以摧毁整个人类文明。所以,现在再像以前那样跟邻居找麻烦,已经不是一个好主意了。
So there is something about human nature where I go, you know, it's like Borat, like my neighbor. Like, I like, you start trouble. We we we do start conflicts, and that's why games throughout as I'm learning, actually, and more, e even in ancient history serve the purpose of pushing people away from war, actually, hot war. So maybe we can figure out increasingly sophisticated video games that pull us they they give us that that scratch the itch of, like, conflict, whatever that is, about about us, the human nature, and then avoid the actual hot wars that would come with increasingly sophisticated technologies because we're now we've long passed the stage where the weapons we're able to create can actually just destroy all of human civilization. So it's no longer that's no longer a great way to to start shit with your neighbor.
下盘棋更好。或者踢足球。
It's better to play a game of chess. Or football.
或者踢足球。是的,是的。我想,我的意思是,我觉得这就是我所喜欢的现代体育。我喜欢看足球比赛,而且我以前也经常踢。我觉得它非常有激情,也带有某种部落式的归属感。
Or football. Yeah. Yeah. And I think, I mean, I think that's what my modern sport is. So and I love football watching it, and and I just feel like and I used to play it a lot as well, and it's it's it's it's it's very visceral and it's tribal.
嗯。我认为它确实将许多能量引导到一种人类对归属感的需求之中,但这种方式是有趣的、健康的,而不是破坏性的,是一种具有建设性的事物。我觉得再回到游戏这个话题,我认为它们最初之所以如此棒,尤其是对孩子来说,比如下棋,是因为它们是世界的小小缩影,是世界的模拟。它们也是对世界的一种模拟,只是简化了某些现实世界的情境,无论是扑克、围棋还是国际象棋,它们都体现了现实世界中的不同方面,比如外交、策略等等。
Mhmm. And I think it does channel a lot of those energies into a which I think is a kind of human need to belong to some some group and but into a into a into a fun way, a healthy way and and a not a not destructive way, kind of constructive thing. And I think going back to games again is I think the originally why they're so great as well for kids to play things like chess is they're great little microcosm simulations of the world. They they are simulation of the world too. They're simplified versions of some real world situation, whether it's poker or or go or chess, different aspects or diplomacy, aspects of of the real world.
而且它还让你有机会去练习这些能力。你知道,人生中你能有多少次练习做出重大决定的机会呢?比如选择哪份工作、去哪所大学,你可能一生中只有十几次这样的关键决定。你必须尽可能把它们做好。而游戏提供了一种安全且可重复的环境,让你可以在其中提升自己的决策能力。
And allows you to practice at them too. And and because, you know, how many times do you get to practice a massive decision moment in your life? You know, what job to take, what university go to, you know, you get maybe, I don't know, a dozen or so key decisions one has to make. You've got to make those as best as you can. And games is a kind of safe environment, repeatable environment where you can get better at your decision making process.
也许它还有一个额外的好处,就是将一些能量引导到更具创造力和建设性的追求中去。
And it maybe has this additional benefit of channeling some energies into into more creative and constructive pursuits.
嗯,我认为练习输和赢也是非常重要的。没错。输其实是一种非常重要的体验,这也是我喜欢游戏的原因之一,我喜欢像巴西柔术这样的运动。
Well, I think it's also really important to practice losing and winning. Right. Like, losing is a really you know, that's why I love games. That's why I love even things like Brazilian jiu
巴西柔术,没错。
jitsu Yeah.
在那种安全的环境中,你可以一次又一次地被击败。它提醒你物理的规律,提醒你世界的运行方式,告诉你有时候你会输,有时候你会赢。即使这样,你仍然可以和所有人保持友谊。是的。但那种输的感觉,对我们人类来说,是一种很奇特的体验,需要真正去理解。
Where you can get your ass kicked in a safe environment over and over. It reminds you about the way about physics, about the way the world works, about that sometimes you lose, sometimes you win. You can still be friends with everybody. Yeah. But that that feeling of losing, I mean, it's a weird one for us humans to, like, really, like, make sense of.
输就是生活的一部分。失去,是生命中一个基本的组成部分。
Like, that's just part of life. That is a fundamental part of life is losing.
是的。据我理解,在武术中,以及像国际象棋这种游戏里(至少我当初的体验是这样),很多都与自我提升、自我认知有关。你知道,我做了这件事,这并不是真正为了打败别人,而是为了最大限度地发挥自己的潜力。
Yeah. And I think in martial arts, as I understand it, but also in things like light chess, at least the way I took it, it's a lot to do with self improvement, self knowledge, you know, that okay. So I did this thing. It's not about really being the other person. It's about maximizing your own potential.
如果你以一种健康的方式来对待胜负,你会学会如何正确地利用胜利和失败。不要因为胜利就得意忘形,觉得自己是世界上最厉害的人;而失败则会让你保持谦逊,并始终明白还有更多东西需要学习。总会有比你更厉害的人可以指导你。你知道,我觉得你会从中学会这些的。
If you do in a healthy way, you learn to use victory and losses in a way. Don't get carried away with victory and and think you're the just the best in the world. And and and the losses keep you humble and always knowing there's always something more to learn. There's always a bigger expert that you can mentor you. You know, I think you learn that.
我非常确定在武术中是这样的,而且我认为至少我在下棋时接受的训练也是这样的方式。它们是一样的道理,可以非常严格且非常重要。当然,你想要赢,但你也需要学会如何以一种健康的方式来应对挫折。你要学会把失败时的那种感觉转化为积极的行动,比如‘下次我要在这方面改进,变得更好’。
I'm pretty sure in martial arts and and and I think that's also the way that at least I was trained in chess. And so in the same way and it can be very hardcore and very important. Of course, you want to win, but you also need to learn how to deal with setbacks in a in a healthy way that and and and and wire that that feeling that you have when you lose something into a constructive thing of next time, I'm gonna improve this, right, or get better at this.
那种进步的一步,本身就是幸福和意义的来源,而不是关于输或赢。
There is something that's a source of happiness, a source of meaning that improvement step. It's not about the winning or losing.
是的,就是那种掌控感。没错。没有什么比这更令人满足的了。就像,哇哦。
Yes. The mastery. Yeah. There's nothing more satisfying in a way. It's like, oh, wow.
以前我做不到的事情,现在我可以做到了。而且无论是游戏、体育运动还是脑力运动,它们都有衡量进步的方式,这种衡量方式非常美妙,因为你可以清楚地看到自己的进步。
This thing I couldn't do before. Now I can. And and and again, games and physical sports and and mental sports, their way their ways of measuring, they're beautiful because you can measure that that progress.
没错。这正是我喜欢角色扮演游戏的原因之一,比如那些数字在上升。
Yeah. Right. There's something about that is why I love role playing games, like the number go up
嗯,我也是。
of like my Yes.
在技能树上,那些数值真的在增长。从字面意义上来说,对我们人类而言,这就是意义的来源之一。无论我们擅长什么。
On the skill tree. Like, literally, that is a source of meaning for us humans. Whatever our Yeah.
我们确实很容易沉迷于这种东西。这些数字不断上升,也许这就是为什么我们会设计出这类游戏的原因吧。显然,我们人类本质上就是不断追求进步的系统,对吧?
We're quite we're we're quite addicted to this sort of yeah. These numbers going up and and and and maybe that's why we made games like that because obviously that is something we're we're we're hill climbing systems ourselves. Right?
是的。如果我们没有这种东西,那将会是非常悲哀的事情。
Yes. It would be quite sad if we didn't have
是的。任何按颜色腰带划分的机制。所有这些。我们到处都在这么做,对吧?我们就有这么一个很棒的东西。
Yeah. Any mechanism by color belts. All of it. We do we do this everywhere, right, where we just have this thing that's great.
我并不是想贬低这一点。作为人类,这确实是一个深层次意义的来源。是的。所以在商业和领导力方面,有一个令人难以置信的故事,就是谷歌在过去一年里所做的事情。我认为可以说,一年前在LLM产品方面,谷歌推出的Gemini 1.5表现不佳,而现在凭借Gemini 2.5,它已经取得了领先。你接手了,并领导了这项工作。
And I don't wanna dismiss that. That is a source of deep meaning Yeah. As humans. So one of the incredible stories on the business on the leadership side is what Google has has done over the past year. So I I think it's fair to say that Google was losing on the LLM product side a year ago with Gemini one five, and now it's winning with Gemini two five, and you took the helm and you led this effort.
那么从一年前所谓的失败到现在的成功,这个转变过程中到底经历了什么?
What did it take to go from, let's say, quote unquote losing to quote unquote winning in the in in the span of a year?
是的。首先,我们有一个非常出色的团队,由Coray、Jeff Dean 和 Oriole领导,整个Gemini团队都非常优秀,绝对是世界级的。没有顶尖的人才,你是无法做到这一点的。当然,我们还有强大的计算资源。
Yeah. Well, firstly, it's absolutely incredible team that we have, you know, led by Coray and Jeff Dean and and Oriole and the amazing team we have on Gemini. Absolutely world class. So you can't do it without the best talent. And of course, you have, you know, we have a lot of great compute as well.
但除此之外,是我们建立起来的研究文化。嗯。对吧?基本上,我们把谷歌内部不同的团队整合在一起。比如,Google Brain是一个世界级的团队,还有原来的DeepMind,我们把所有最优秀的人才和最好的想法聚集在一起,共同打造了最强大的系统。这个过程很艰难,但我们都非常有竞争意识,热爱研究。
But then it's the research culture we've created. Mhmm. Right? And basically coming together both different groups in in Google, you know, there was Google Brain, world class team and and then the old deep mind and pulling together all the best people and the best ideas and gathering around to make the absolute greatest system we could. And it was been hard, but we're all very competitive and we, you know, love research.
这个过程非常有趣。你知道,看到我们的进展轨迹并不是理所当然的,但我们现在所处的位置以及进展的速度让我们感到非常满意。如果你回顾一下我们从两年前、一年前到现在的进步,我认为我们一直在持续不断地推进进步,同时不断将这些成果推向市场,这正是我们取得成功的关键。整个领域竞争异常激烈,全球一些最杰出的企业家、领导者和公司都在参与竞争,因为大家都意识到AI的重要性。
This is so fun to do. And we've, you know, it's great to see our trajectory wasn't a given, but we're very pleased with the the where we are in the rate of progress is the most important thing. So if you look at where we've come to from two years ago to one year ago to now, you know, I think our we call it relentless progress along with relentless shipping of that progress is being very successful. And, you know, it's unbelievably competitive. The whole space, the whole AI space with some of the greatest entrepreneurs and leaders and companies in the world all competing now because everyone's realized how important AI is.
看到这些进展对我们来说是一件非常令人欣慰的事情。
And it's very, you know, been pleasing for us to see that progress.
你知道,谷歌是一家非常庞大的公司。你能谈谈在这种情况下自然会发生的一些事情吗?比如官僚主义?比如,你要小心,比如会议、经理等等。
You know, Google is a gigantic company. Can you speak to the natural things that happen in that case is the bureaucracy that emerges? Like, you wanna be careful. Like, you know, like, the the the natural kind of there's there's meetings and there's Yeah. Managers and that.
从领导的角度来看,要突破这些障碍去实现像你刚才说的那样推出产品,面临的一些挑战是什么?比如,过去一年里推出了大量与Gemini相关的产品,数量之多简直令人难以置信。
Like, what what are some of the challenges from a leadership perspective breaking through that in order to, like you said, ship? Like, the the number of products Yeah. Gemini related products that have been shipped over the past year is just insane. Right.
确实是这样。没错。这就是所谓的“不懈努力”的体现。我认为,任何大型公司最终都会出现很多管理层级,这很正常。
It is. Yeah. Exactly. That's that's what relentlessness looks like. I think it's it's a question of like any big company, you know, ends up having a lot of layers of management and things like that.
这基本上就是它的运作方式。但我仍然在进行日常运营,而且我一直是以一种老派深度思维的方式在运作,就像一家初创公司一样。虽然规模很大,但本质上还是一家初创公司。我们今天依然保持着这种风格,与谷歌深度思维一起,以果断和高效的态度运作,拥有来自最优秀的小型组织的那种活力。我们努力两全其美:一方面,我们拥有数以亿计的用户平台,另一方面,我们拥有令人难以置信的产品,可以通过我们的人工智能和研究为其赋能。
It's sort of the nature of how it works. But I still operate and I was always operating with old deep mind as a as a startup still. Large one, but still as a startup. And that's what we still act like today as with Google deep mind and acting with decisiveness and the energy that you get from the best smaller organizations. And we try to get the best of both worlds where we have this incredible billions of users surfaces, incredible products that we can power up with our AI and our and our research.
这真的很棒。你知道,世界上很少有地方可以做到一方面进行令人惊叹的世界级研究,然后第二天就能将其应用,改善数十亿人的生活。这是一个非常了不起的结合。我们一直在努力消除官僚主义,以让研究文化和持续交付的文化蓬勃发展。我认为我们在保持责任感的同时取得了相当不错的平衡,毕竟作为一家大公司,你必须如此,而且我们还拥有众多庞大的产品平台。
And that's amazing. And you can, you know, there's very few places in the world you can get that do incredible world class research on the one hand and then plug it in and improve billions of people's lives the next day. That's a pretty amazing combination. And we're continually fighting and cutting away bureaucracy to allow the research culture and the relentless shipping culture to flourish. And I think we've got a pretty good balance whilst being responsible with it, you know, as you have to be as a large company and also with a number of, you know, huge product surfaces that we have.
你刚才提到关于十亿用户平台的那番话挺有意思的。我之前和一位在这里的大英博物馆名叫欧文·芬克尔的人聊过天,他是一位非常聪明的人。他是研究楔形文字的世界专家,楔形文字是一种刻在泥板上的古老文字。但他对ChatGPT或Gemini一无所知,甚至对人工智能也一无所知。
So a funny thing you mentioned about, like, the the surface of the billion. I I had a conversation with a guy named brilliant guy here at the British Museum called Erwin Finkel. He's a world expert at cuneiforms, which is a ancient writing on tablets. And he doesn't know about ChadGPT or Gemini. He doesn't even know anything about AI.
他第一次接触人工智能,是在谷歌上开启AI模式的时候。他当时说:‘这就是你们说的人工智能模式吗?’
But his first encounter with this AI is AI mode on Yes. Google. Yes. He's like, is that what you're talking about? This AI mode?
这提醒了我们,世界上还有很大一部分人并不了解人工智能这个东西。
And then, you know, it's just it's just a reminder that there's a large part of the world that doesn't know about this AI thing.
是的,我知道。这挺有趣的,因为如果你生活在X(推特)上,至少在我的信息流里全是关于人工智能的内容。在硅谷和某些特定圈子,每个人都在谈论人工智能。但对大多数普通人来说,他们还没有真正接触到它。
Yeah. I know. It's funny because if you live on x and Twitter and I mean, it's sort of at least my feed, it's all AI. And and there's certain places where, you know, in the valley and certain pockets where everyone's just all they're thinking about is AI. But a lot of the normal world hasn't hasn't come across it yet.
但这也意味着他们的第一次接触,对我们来说是一种巨大的责任。
But that's a great responsibility to their first interaction.
是的。
Yeah.
在像印度农村这样广大的地区,或者世界上的其他地方也是如此。
The the the grand scale of the rural India or anywhere across the world.
没错。我们希望它尽可能做到最好。在很多情况下,它其实是在幕后运行的,比如让地图或搜索功能变得更好用。对于很多人来说,理想情况下,这种体验应该是无缝的、自然发生的。
Right. You get to Right. And we want it to be as good as possible. And in a lot of cases, it's just under the hood powering making something like maps or search work better. And and it's ideally for a lot of those people should just be seamless.
展开剩余字幕(还有 209 条)
这只是新技术,让他们的生活更加——你知道的——高效,并且帮助了他们。
It's just new technology that makes their lives more, you know, productive and and and helps them.
Gemini产品和工程团队中的很多人从另一个维度给予了你极高的评价,这几乎是我没有预料到的,因为我一直把你当作深度科学家,关注那些重大的科研问题。但他们也说你是一位出色的产品人,比如,如何创造出一个很多人会使用并且喜欢使用的产品。那么你是否可以谈谈,要创造出一个基于人工智能的产品,而很多人却不喜欢使用它的原因是什么?
A bunch of folks on the Gemini product and engineering teams spoken extremely highly of you on another dimension that I almost didn't even expect because I kind of think of you as the, like, deep scientists and caring about these big research scientific questions. But they also said you're a great product guy. Like, how to create a thing that a lot of people would use and enjoy using. So can you maybe speak to what it takes to create a AI based product that a lot of people don't enjoy using?
是的。嗯,其实这又回到了我做游戏设计的年代,那时我为数百万玩家设计游戏。人们都忘了这段经历。我在产品中应用前沿技术方面有经验,这在九十年代就是游戏行业的特点。所以我其实很喜欢将前沿研究应用于产品,从而带来全新的体验。
Yeah. Well, I mean, again, comes back from my game design days where I used to design games for millions of gamers. People forget about that. I've had experience with cutting edge technology in product that that that that is how games was in the nineties. And so I love actually the combination of cutting edge research and then being applied in a product and to power a new experience.
因此,我认为这其实是相同的技能,你要能设身处地地想象使用它的感受,并且要有良好的品味,这和我们之前提到的内容是一致的。我认为在科学领域有用的这些能力,在产品设计中也同样有用。而且我一直以来就是一个跨学科的人,所以我并不真正看到艺术与科学,或者产品与研究之间的界限。对我来说,它们是一个连续体。
And so I think it's the same skill really of of, you know, imagining what it would be like to use it viscerally and having good taste coming back to earlier. The same thing that's useful in science, I think is is can also be useful in in product design. And I I've just had a very, you know, always been a sort of multidisciplinary person. So I don't see the boundaries really between, you know, arts and sciences or products and research. It's it's a continuum for me.
我的意思是,我只参与那些前沿产品的开发,我喜欢做这样的产品。如果产品背后的技术不是最前沿的,我可能都无法产生兴趣。如果它们只是普通的产品,我也不会感到兴奋。所以这需要具备创新和创造力。
I mean, I only work on I like working on products that are cutting edge. I wouldn't be able to, you know, have cutting edge technology under the hood. I wouldn't be excited about them if they were just run of the mill products. So it requires this invention creativity capability.
当你在与Gemini互动时,尤其是在大语言模型方面,你学到了哪些具体的东西?比如,这个界面布局、交互方式,或者延迟与用户体验之间的权衡,比如如何向用户展示内容、需要等待多久,以及等待时的提示方式,或者功能展示方面。这些都很有趣,因为正如你所说,这确实是最前沿的技术,我们还在不断探索中。
What are some specific things you kind of learned about when you even on the LLM side, you're interacting with Gemini. Like, this doesn't feel like the layout, the the interface, maybe the trade off between the latency, like, how to present to the user, how long to wait Mhmm. And how that waiting is shown or the reason capabilities. There's some interesting things because like you said, it's the very cutting edge. We don't know Yeah.
如何正确地呈现这些内容。那么你有没有学到一些具体的经验?
How to present it how to present it correctly. So is there some specific things you've you've learned?
这个领域变化太快了,我们一直在不断评估。但就目前而言,你需要不断简化一切,无论是界面还是基于模型之上构建的内容,你最好尽量不要阻碍模型本身的表现。
I mean, it's such a false evolving space. We're evaluating this all the time. But where we are today is that you want to continually simplify things. The whether that's the interface or or the interact the what you build on top of the model. You kind of want to get out of the way of the model.
模型发展的列车正沿着轨道飞驰而来,进步的速度快得惊人,正如我们之前提到的那种持续不断的进步。比如对比2.5和1.5版本,进步简直巨大。我们预计未来的版本也会如此。因此,模型的能力正在不断增强,这就带来了当今设计领域的一个有趣现象。
The model train is coming down the track and it's improving unbelievably fast. This relentless progress we talked about earlier, you know, you look at 2.5 versus 1.5 and it's just a gigantic improvement. And we expect that again for the future versions. And so the models are becoming more capable. So you've got the interesting thing about the design space in in in today's world.
这些以AI为核心的产品,你在设计时不能只考虑它现在能做什么,或者当前技术能实现什么,而要考虑一年后的情况。因此,你必须是一个技术背景很强的产品人,因为你需要对技术趋势有良好的直觉和感觉。你现在梦想的某个功能虽然目前还无法实现,但研究路线是否按计划推进,是否能在六个月或一年内实现?你需要预判这个快速变化的技术走向,同时还要考虑不断涌现的新能力,比如现在我们有了视频生成技术,那我们该如何利用它?
These AI first products is you've got to design not for what the thing can do today, the technology can do today, but in a year's time. So you actually have to be a very technical product person because you got to kind of have a good intuition for and feel for okay. That thing that I'm dreaming about now can't be done today, but is the research track on schedule to basically intercept that in six months or a year's time. So you kind of got to intercept where this highly changing technology is going as well as the new capabilities are coming online all the time that you didn't realize before that can allow like the research to work or now we got video generation. What do we do with that?
这种多模态的东西,你知道的,我有一个问题是,我们现在的用户界面,真的会是未来的样子吗?一旦你开始思考这些超级多模态系统,这种文本框聊天的方式看起来非常不可能继续存在。难道不应该更像《少数派报告》里的那种,你以一种协作的方式与它互动吗?对吧?现在的界面看起来限制太多了。
This multimodal stuff, you know, is it one question I have is is it really going to be the current UI that we have today? These text box chats seems very unlikely given once you think about these super multimodal systems. Shouldn't it be something more like minority report where you're you're sort of vibing with it in a in a in a kind of collaborative way. Right? It seems very restricted today.
我认为几年之后,我们再回头看今天的界面、产品和系统,会觉得它们非常古老。所以我认为在产品层面和研究层面,其实还有很多创新的空间。
I think we'll look back on today's interfaces and products and systems as quite archaic in maybe in just a couple of years. So I think there's a lot of space actually for innovation to happen on the product side as well as the the research side.
然后我们之前私下聊过这个话题,键盘是一个开放性的问题,也就是我们什么时候、以及会以多大程度地转向以音频作为与周围机器交互的主要方式,而不是打字输入。
And then we are offline talking about this keyboard is the the open question is how, when, and how much will we move to audio as the primary way of interacting with the machines around us versus typing stuff.
没错。即使你是一个打字非常快的人,打字本身仍然是一种低带宽的交互方式。我认为我们将不得不开始利用其他设备,比如智能眼镜、音频设备、耳机,最终也许是某种神经设备,从而将输入输出的带宽提升到今天的百倍左右。
Yeah. I mean, typing is a very low bandwidth way of doing even if you're a very fast, you know, typer. And I think we're gonna have to start utilizing other devices whether that's smart glasses, you know, audio, earbuds, and eventually maybe some sorts of neural devices where we can increase the the input and the output bandwidth to something, you know, maybe a 100 x of what is today.
我认为界面设计是一种被低估的艺术形式。我觉得如果你没有正确的界面,你就无法释放一个系统智能的真正力量。界面才是你释放这种力量的方式。是的,这个问题非常有趣,关键是怎么去做。
I think that, you know, underappreciated art form is the interface design. I think you cannot unlock the power of the intelligence of a system if you don't have the right interface. The interface is really the way you unlock its power. Yeah. It's such an interesting question of how to do that.
是的。所以你认为,比如,如何做到不碍事才是一种真正的艺术形式。
Yeah. So how you would think, like, getting out of the way isn't real art form.
没错。你知道,这正是史蒂夫·乔布斯经常提到的那种东西,对吧?我们想要的是简洁、美观和优雅。对吧?
Yes. You know, it's the sort of thing that I guess Steve Jobs always talked about. Right? It's simplicity, beauty, and elegance that we want. Right?
但我们还没达到那个境界。据我所知,目前还没有人真正实现这一点。而那正是我希望我们能够达到的目标。再说一次,这有点像再次提到《极乐迪斯科》这样的游戏,一款最优雅、最美丽的游戏。你能,你知道,做出一个一样美丽的界面吗?
And we're not there. Nobody's there yet in my opinion. And that's what I would like us to get to. Again, it sort of speaks to like go again, right, as a game, the most elegant, beautiful game. Can you, you know, that can you make an interface as beautiful as that?
实际上,我认为我们将进入一个由人工智能生成界面的时代,这些界面可能是为你量身定制的。它会符合你的审美、你的感受、你的思维方式。而人工智能会根据不同的任务生成相应的界面,我觉得这很可能是我们最终会走向的方向。
And actually, I think we're going to enter an era of AI generated interfaces that are probably personalized to you. So it fits the way that you your aesthetic, your feel, the way that your brain works. And and and and the AI kinda generates that depending on the task, you know, that feels like that's probably the direction we'll end up in.
没错。因为有些用户是高级用户,他们希望屏幕上显示每一个参数,所有东西都摆在眼前,比如我这样喜欢用键盘的人。是的,我喜欢基于键盘的导航,喜欢每个功能都有快捷键。但也有些人……
Yeah. Because some people are power users and they want every single parameter on the screen, everything everything based like perhaps me with a keyboard Yeah. Keyboard based navigation and like to have shortcuts for everything. And some people
喜欢这种极简主义。把这些复杂的东西都隐藏起来。正是如此。
like the minimalism. Just hide all of that complexity. Exactly.
是的。嗯,我也很高兴你心里也有一个史蒂夫·乔布斯模式。这太棒了。爱因斯坦模式,史蒂夫·乔布斯模式。很好。
Yeah. Well, I'm glad you have a Steve Jobs mode in you as well. This is great. Einstein mode, Steve Jobs mode. Alright.
让我试着诱导你回答一个问题。Gemini 3什么时候发布?是在DTS 6之前还是之后?全世界都在等待这两个消息。
Let me try to trick you into answering a question. When when will Gemini three come out? Is it before or after d t s six? The world waits for both.
那么,从2.5到3.0需要做些什么呢?因为看起来2.5已经发布了很多次,而每一次都已经在性能上有了显著的飞跃。那么推出一个新版本到底意味着什么?是性能上的提升吗?还是意味着一种完全不同的体验风格?
And what does it take to go from two five to three o? Because it seems like there's been a lot of releases of two five, which are already leaps in performance. So what what does it even mean to go to a new version? Is it about performance? Is this about a completely different flavor of an experience?
嗯,我们的不同版本号的工作方式是这样的:我们大概每六个月左右进行一次完整的运行和新版本的全面产品化。在这期间,会涌现出许多新的有趣的研究进展和想法。嗯,我们会将这些想法汇总起来,你可以想象成过去六个月中在架构方面积累的所有有趣的想法。
Yeah. Well, so the way it works with our different version numbers is we, you know, we try to collect so maybe it takes, you know, roughly six months or something to to do a new kind of full run and the full productization of a new version. And during that time, lots of new interesting research iterations and ideas come up. Mhmm. And we sort of collect them all together that, you know, you could imagine the last six months worth of interesting ideas on the architecture front.
也许是数据方面的,可能有很多不同的可能性。我们会将这些内容打包汇总,测试哪些想法可能对下一个版本有用,然后将它们整合在一起。接着,我们开始新的大规模训练运行,对吧?
Maybe it's on the data front. It's like many different possible things. And we collect package that all up, test which ones are likely to be useful for the next iteration, and then bundle that all together. And then we start the new, you know, giant hero training run. Right?
然后当然,这个过程会被持续监控。最终,在预训练结束后,还有各种后续训练。有很多不同的方法可以实现,也有不同的修补方式。因此,这里有一个完整的实验和优化阶段,在这个阶段中还可以获得很多性能提升。通常版本号所指的就是基础模型,也就是预训练模型。
And and then and then, of course, that gets monitored. And then at the end, then there's the of the pre training, then there's all the post training. There's many different ways of doing that, different ways of patching it. So there's a whole experiment and phase there, which you can also get a lot of gains out. And that's where you see the version numbers usually referring to the base model, the pretrained model.
而像2.5这样的中间版本,以及不同大小和小改进的版本,通常是基于相同的基本架构进行后期修补或后续训练的结果。当然,在此基础上,我们还有不同大小的模型,比如Pro、Flash和Flashlight,它们通常是从最大的模型中提炼而来的,比如Flash模型是从Pro模型提炼而来的。这意味着我们提供了多种选择。如果你是开发者,你想优先考虑性能还是速度?对了,还有成本。我们倾向于将这看作是一个帕累托前沿的问题,一方面Y轴代表性能,X轴代表成本或延迟和速度。
And then the interim versions of 2.5, you know, and the different sizes and the different little additions, they're often patches or post training ideas that can be done afterwards off the same basic architecture. And then of course, on top of that, we also have different sizes, pro and flash and flashlight that are often distilled from the biggest ones, you know, the flash model from the pro model. And that means we have a range of different choices. If you are the developer of do you wanna promote prioritize performance or speed, right, and cost. And we like to think of this Pareto frontier of of, you know, on the one hand, the y axis is, you know, like performance and then the the the x axis is, you know, cost or latency and and speed basically.
我们在模型上完全定义了这个前沿。因此,无论你作为个人用户或开发者希望做出怎样的权衡,都应该能找到一个适合你需求的模型。
And we we have models that completely define the frontier. So whatever your trade off is that you want as an individual user or as a as a developer, you should find one of our models satisfies that constraint.
因此,在版本变化的背后,是一次大规模的训练运行。
So behind diversion changes, there is a big hero run.
是的。然后
Yes. And then
产品化本身有着极其复杂的层面。然后是你在帕累托前沿上对不同规模模型的提炼。而当你迈出每一步时,你都会发现可能会有一个很酷的产品,以及一些支线探索。
there's just an insane complexity of productization. Then there's the distillation of the different sizes along that Pareto front. And then as with each step you take, you realize there might be a cool product, the side quests.
是的,完全正确。
Yes. Exactly.
但接着你也会意识到,不能进行太多的支线探索,否则你会拥有数百万种产品版本。
But and then you also don't wanna take too many side quests because then you have a million versions of a million products.
是的。要简化它。这一点并不清晰。
Yes. Pizarize it. It's very unclear.
没错。但你也会非常兴奋,因为这真的太酷了。是的。比如,你怎么看VOs?就非常酷。
Yeah. But you also get super excited because it's super cool. Yep. Like, how does even you look at VOs? Very cool.
它如何融入更大的整体呢?是的。
How does it fit into the bigger Yes.
这个问题?完全正确。是的,完全正确。然后我们持续进行这个被称为‘向上收敛’的过程,你知道的,从产品界面、训练后阶段,甚至更下游的环节中提取想法,然后逐步将这些想法整合到下一轮的核心模型训练中。
Thing? Exactly. Yeah. Exactly. And then you're constantly this process of converging upstream, we call it, you know, ideas from the from the product surfaces or or or from the post training and and even further downstream than that, you you kind of upstream that into the the core model training for the next run.
嗯,对。因此主模型,也就是主Gemini路线会变得越来越通用。最终,就是AGI(通用人工智能)。一次英雄般的运行。
Mhmm. Right? So then the main model, the main Gemini track becomes more and more general. And eventually, you know, AGI. One hero runner.
是的,完全正确。几次英雄般的运行之后。
Yes. Exactly. Few hero runs later.
是的。所以有时候当你发布这些新版本,或者实际上每次发布时,这些基准测试对于展示模型性能来说是有益还是适得其反?
Yeah. So sometimes when you release these new versions or every version really, are benchmarks productive or counterproductive
你需要这些基准测试,但重要的是不要过度拟合它们,对吧?所以它们不应该是衡量一切的最终标准。比如,有LM Arena,以前叫Alemsis。
for showing the performance of a model? You need them, and and but it's important that you don't overfit to them. Right? So they shouldn't be the end with a be all and end all. So there's there's LM Arena or used to be called Alemsis.
这是一个后来逐渐自然形成的主要测试方式之一,至少对于聊天机器人来说,人们喜欢用这种方式测试。当然,还有很多学术上的基准测试,比如测试数学、编程能力、通用语言能力、科学能力等等。此外,我们还有自己内部关心的基准测试。这其实是一个多目标的优化问题,对吧?
That's one of them that turned out sort of organically to be one of the the main ways people like to test these systems, at least the chatbots. Obviously, there's loads of academic benchmarks on from from the test mathematics and coding ability, general language ability, science ability, and so on. And then we have our own internal benchmarks that we care about. It's a kind of multi objective, you know, optimization problem. Right?
你不想只在某一方面表现好,我们想要构建的是在各个方面都表现良好的通用系统,并且你希望在不造成其他方面损失的前提下取得进步。对吧?这就是难点所在,因为你可以当然地加入更多编程数据或者更多游戏数据,但这会不会影响你的语言系统或者翻译系统等你关心的其他方面呢?
You you don't wanna be good at just one thing. We're trying to build general systems that are good across the board And you try and make no regret improvements. So where you improve in like, you know, coding, but it doesn't reduce your performance in other areas. Right? So that's the hard part because you you can of course, you could put more coding data in or you could put more, I don't know, gaming data in, but then does it make worse your language system or in your translation systems and other things that you care about.
因此,你必须持续监控这个日益庞大和复杂的基准测试套件。同时,当你将这些模型集成到产品中时,你也关心用户的直接使用情况和直接反馈信号,无论是程序员还是普通用户在使用聊天界面时的反馈。
So it's you've got to kind of continually monitor this increasingly larger and larger suite of of benchmarks. And also there's when you stick them into products, these models, you also care about the direct usage and the direct stats and the signals that you're getting from the end users, whether they're coders or or or the average person using using the chat interfaces.
是的。因为最终你想衡量的是实用性,但很难将它转化为一个数字。这是基于大量用户的主观感受的基准测试,很难准确把握。对我来说,这会非常可怕,比如你有一个更聪明的模型,但它的表现却只是基于一种感觉。
Yeah. Because ultimately, you wanna measure the usefulness, but it's so hard to convert that into a number. Right. It's it's really vibe based benchmarks across a large number of users, and it's hard to know. And I it would be just terrifying to me to you know you have a much smarter model, but it's just something vibe based.
这并不完全奏效。这很可怕,因为正如你刚才所说,这个模型必须在如此多的领域都既聪明又有用。你会因为突然能解决以前无法解决的编程问题而感到兴奋,但与此同时,它的诗歌创作却变得糟糕透顶。
It's not not not quite working. That's just scary because and everything you just said, it has to be smart and useful across so many domains. So you you get super excited because it's all of sudden solving programming problems you've never been able to solve before, but now it's crappy poetry or something.
没错。
And it's just Right.
我不知道。这种平衡真的让人很焦虑,太难做到了。
I don't know. That's a stressful that's so difficult To balance.
是的,这种平衡很难做到,因为你要面对各种挑战。
Yeah. To balance and because you
不能完全相信基准测试,你真的得相信最终用户。
can't really trust the benchmarks, you really have to trust the end users.
是的。还有一些更加玄妙的因素也会起作用,比如说系统的角色风格,你知道的,它是啰嗦还是简洁?有没有幽默感?不同的人喜欢不同的风格。
Yeah. And then other things that are even more esoteric come into play like, you know, the style of the persona of the the the system, you know, how it you know, is it verbose? Is it succinct? Is it humorous? You know, and and different people like different things.
所以,你知道的,这非常有趣。这几乎就像是心理学研究或者人格研究的前沿领域。我以前在读博士的时候做过类似的研究,比如五因素人格模型。我们到底希望自己的系统是什么样的?不同的人也会喜欢不同的东西。
So, you know, it's very interesting. It's almost like cutting edge part of psychology research or person personality research. You know, I used to do that in my PhD, like five factor personality. What do we actually want our systems to be like? And different people will like different things as well.
因此,这些都是一些产品领域中全新的问题,我认为以前从未真正被解决过,但现在我们必须迅速应对。
So these are all just sort of new problems in product space that I don't think have ever really been tackled before, but we're gonna sort of rapidly have to deal with now.
我认为开发产品的个性是一个非常迷人的领域。是的。在这个过程中,它也像一面镜子映照出我们自己。我们到底喜欢什么样的东西?因为提示工程可以让你控制很多这些元素,但产品能否让这些体验的不同风格、你所交互的不同角色更容易被控制?
I think it's a super fascinating space developing the character of the thing. Yeah. And in so doing, it puts a mirror to ourselves. What are the kind of things that we like? Because prompt engineering allows you to control a lot of those elements, but can the product make it easier for you to control the different flavors of those experiences, the different characters that you interact with.
是的,没错。那么,什么是
Yeah. Exactly. So So what's
谷歌DeepMind获胜的概率有多大?
the probability of Google DeepMind winning?
嗯,我不认为这是一种‘胜利’。我的意思是,我认为我们需要换一种角度来看待它。鉴于我们正在构建的东西非常重要且影响深远,‘胜利’这个词并不合适。有趣的是,虽然我过去常常以竞争的心态来看待事物,但我现在更认为我们这些处于前沿的人负有责任,要谨慎地将这项可能带来巨大益处但也存在风险的技术安全地引入世界,造福全人类。这一直是我梦想的,也是我们一直在努力的。
Well, I don't see it as sort of winning. I mean, I think we need to I think winning is the wrong way to look at it given how important and consequential what it is we're building. So funnily enough, I don't I try not to view it like a game or competition, even though that's a lot of my mindset. It's it's about, in my view, all of us have those of us at the leading edge have a responsibility to steward this unbelievable technology that could be used for incredible good, but also has risks, steward it safely into the world for the benefit of humanity. That's always what I've dreamed about and what we've always tried to do.
我希望最终整个社区,甚至国际社会,在我们越来越接近通用人工智能(AGI)的时候,能够团结一致,认识到这一点。
And I hope that's what eventually the community, maybe the international community will rally around when it becomes obvious that as we get closer and closer to to AGI that that's what's needed.
我完全同意你的看法。我觉得你说得非常精彩。你曾经提到你与一些实验室的负责人关系不错。随着竞争日益激烈,维持这些关系有多困难?
I agree with you. I think that's beautifully put. You've said that you talked to and are on good terms with the leads of some of these labs. As the competition heats up, how hard is it to maintain sort of those relationships?
到目前为止还好。我一直以善于合作为荣。我是一个善于合作的人。研究是一项需要合作的事业,科学同样如此。
It's been okay so far. I tried to pride myself in being collaborative. I'm a collaborative person. Research is a collaborative endeavor. Science is a collaborative endeavor.
对吧?最终如果能治愈一些极其可怕的疾病,并提出令人惊叹的治疗方法,这对人类来说是一件好事。这对人类是一个净收益。能源方面也是如此,所有我感兴趣并希望通过人工智能帮助解决的问题都是这样。我只是希望这项技术能够存在于世界上,并被用于正确的事情,而由此带来的好处,尤其是生产效率方面的提升,能够惠及每一个人。
Right? It's all good for humanity in the end if you cure incredible, you know, terrible diseases and you come with an incredible cure. This is net win for humanity. And the same with energy, all of the things that I'm interested in in in helping solve with AI. So I just want that technology to exist in the world and be used for the right things and and and the the kind of the benefits of that, the productivity benefits of that being shared for every the benefit of everyone.
所以我一直努力与所有领先实验室的人保持良好的关系。他们中的很多人性格都非常有趣,正如你所预料的那样。不过,是的,我和他们几乎都相处得不错。我也希望一直如此。我认为当事情变得比现在更加严肃时,这种关系和沟通渠道将变得更加重要。
So I try to maintain good relations with all the leading lab people. They have very interesting characters, many of them as you might expect. But, yeah, I'm on good terms. I I hope with pretty much all of them. And I I think that's gonna be important when when things get even more serious than they are now, that there are those communication channels.
嗯。这样在需要合作或协作的时候,尤其是在安全等问题上,这种关系就能起到促进作用。
Mhmm. And that's what will facilitate cooperation or collaboration if that's what we is required, especially on things like safety.
是的。我希望在一些风险不那么高的事情上也能有一些合作,从而作为维系友谊和关系的一种方式。比如说,我觉得互联网会非常期待你和马斯克以某种方式合作开发一款电子游戏,那种类型的东西。
Yeah. I hope there's some collaboration on stuff that's sort of less high stakes and in so doing serves as a mechanism for maintaining friendships and relationships. So for example, I think the Internet would love it if you and Elon somehow collaborate on creating a video game, that kind
那种类型的事情。没错。
of thing. Right.
我认为这会增进彼此之间的友好关系。而且你们俩也确实是真正的游戏爱好者,所以这会是一件很有趣的事情。
That I think that enables camaraderie in good terms. And also, you two are legit gamers, so it's just fun to
没错。
Yep.
很有趣。
Fun to
去创造一些东西。太棒了。我们以前也讨论过这个,也许这是一件我们可以去做的事情。我同意你的看法。拥有一些小项目挺好的,在这些项目中大家可以专注于合作,这对双方来说都是一件双赢的事情。
create something. Awesome. And we've talked about that in the past, and it may be a cool thing that that, you know, we can do. And I agree with you. It'd be nice to have kind of side projects in a way where where one can just lean into the collaboration aspect of it, and it's a sort of win win for both sides.
这有点像是在培养一种协作的能力。
And it's and it it kind of builds up that that that collaborative muscle.
我把科学探索看作是人类的一种类似副业的东西。没错。我认为DeepMind一直在推动这方面的发展。我很希望看到其他实验室也多做一些科学相关的工作,并且展开合作,因为看起来在重大的科学问题上进行合作似乎更容易一些。
I see the scientific endeavor as that kind of side project for humanity. Yeah. And I I think deep Google DeepMind has been really pushing that. I would love it if to see other labs do more scientific stuff and then collaborate because it just seems like easier to collaborate on the big scientific questions.
我同意。我也希望看到更多人、更多其他实验室来谈论科学,但我认为我们真的是唯一在认真用它做科学研究的机构。这就是为什么像AlphaFold这样的项目对我来说如此重要。我认为我们的使命就是展示人工智能如何能够以一种非常具体的方式为人类带来切实的好处。
I agree. And I would love to see a lot of people a lot of the other labs talk about science, but I think we're really the only ones Yeah. Using it for science and doing that. And that's why projects like AlphaFold are so important to me. And I think to our mission is to show how AI can this, you know, be clearly used in a very concrete way for the benefit of humanity.
此外,我们还基于AlphaFold衍生出了像Isomorphic这样的公司来进行药物研发,目前进展非常顺利。我们还可以构建类似AlphaFold的技术体系,进入化学领域,加速药物设计。我认为我们需要展示这些案例,社会也需要认识到,人工智能确实可以带来巨大的益处。
And and also we spun out companies like isomorphic off the back of Alpha Fold to do drug discovery and it's going really well and build sort of, you know, you can think of build additional Alpha Fold type type systems to go into chemistry space to help accelerate drug design. And the examples I think we need to show and society needs to understand are well AI can bring these huge benefits.
发自内心地感谢你们以严谨、有趣和谦逊的态度推动科学探索。我真的很喜欢看到这一切。你们还在谈论PE等于9PM,简直太棒了。太棒了。人才争夺战似乎一直在进行。
Well, from the bottom of heart, thank you for pushing the scientific efforts forward with rigor, with fun, with humility, all of it. I just love to see it. And still talking about PE equals 9PM is just incredible. So I love it. There are there there's been seemingly a war for talent.
其中有些可能是段子。我不太清楚你怎么看Meta用高薪抢人大战愈演愈烈的情况。我应该说,很多人认为DeepMind是一个真正适合从事前沿工作的机构,正如你所描述的那样,比如这里有着活跃的科学文化。
Some of it is meme. I don't know. What do you think about Meta buying up talent with huge salaries and and the heating up of this battle for talent. And I I should say that I think a lot of people see DeepMind as a really great place to do cutting edge work for the reasons that you've outlined Yeah. Is like there's this vibrant scientific culture.
是的。当然,Meta现在采取的是一种策略。至少从我的角度来看,那些真正相信通用人工智能(AGI)使命及其潜力的人,能够理解它可能带来的真实后果,无论是好的还是坏的,以及这种责任意味着什么。我认为他们大多数人加入是为了像我一样站在研究前沿,从而帮助引导这项技术安全地走向世界。
Yeah. Well, look, of course, you know, there's a strategy that that Meta is taking right now. I think that from my perspective at least, I think the people that are real believers in the mission of AGI and what it can do understand the real consequences, both good and bad from that and what's what that responsibility entails. I think they're mostly doing it to be like myself, to be on the frontier of that research. So, you know, they can help influence the way that goes and steward that technology safely into the world.
目前,Meta并不处于前沿。也许他们将来能设法重回前沿。从他们的角度来看,他们的做法可能是理性的,因为他们目前处于落后地位,必须采取行动。但我认为,比金钱更重要的是其他一些因素。当然,你必须按照市场水平来支付员工薪酬,而且这些薪酬水平也在不断上涨。
And, you know, meta right now are not at the frontier. Maybe they'll they'll manage to get back on there. And, you know, it's probably rational what they're doing from their perspective because they're behind and they need to do something. But I think there's more important things than than just money. Of course, one has to pay, you know, people their market rates and all of these things and that continues to go up.
但我一直预料到这一点,因为越来越多的人,尤其是公司的领导者,终于开始意识到我过去三十多年一直坚信的一件事:通用人工智能(AGI)可能是人类有史以来最重要的技术发明。从某种意义上说,这样做是理性的。但我也认为还有更大的问题需要思考。如今,人工智能领域的人才薪酬已经非常高了。我记得2010年我们刚起步的时候,我甚至有几年没有给自己发工资,因为资金实在不够。
But as and and and I was expecting this because more and more people are finally realizing leaders of companies, what I've always known for thirty plus years now, which is the AGI is the most important technology probably that's ever going to be invented. So in some senses, it's it's rational to be doing that. But I also think there's a much bigger question. I mean, people in AI these days are very well paid. You know, I I remember when we were starting out back in 2010, you know, I didn't even pay myself a couple of years because it was was enough money.
我们当时根本筹不到任何资金。而现在,实习生的工资已经相当于我们最初整个种子轮融资的金额了。这挺有趣的。我还记得那时候,我必须免费工作,甚至几乎要自己掏钱去实习。对吧?
We couldn't raise any money. And these days, interns are being paid, you know, the amount that we raised as our first entire seed round. So it's pretty funny. And I remember the days where we used I used to have to to work for free and and almost pay my own way to do an internship. Right?
现在,一切都反过来了。但事实就是这样。这是一个新的世界。我们在讨论AGI之后会发生什么,能源问题被解决之后又会怎样。到那时,金钱的意义又将如何定义?
Now, it's all the other way around. But that's just how it is. It's the new world. And but I think that, you know, we've been discussing like what happens post AGI and energy systems are solved and so on. What is even money going to mean?
因此我认为,在经济层面,我们将面临更加重大的问题需要解决,在那样的世界中经济如何运作,公司又将如何存在。所以我认为,如今关于薪资等问题的讨论其实有点偏离重点。
So I think, you know, in the economy and and we're gonna have much bigger issues to work through and how does the economy function in that world and companies. So I think, you know, it's a little bit of a side issue about salaries and things of like that today.
是的,当你面对如此重大的后果以及如此激动人心的科学问题时。
Yeah. When you're facing such gigantic consequences and and gigantic fascinating scientific questions.
这可能只是
Which may be only a
几年之后的事情了。所以从实际和务实的角度来看,如果我们聚焦在工作上,我们可以看看程序员这个职业,因为目前人工智能系统在编程方面表现得非常出色,并且还在不断提升。因此,许多以编程为生、热爱编程的人担心自己会失业。你觉得他们应该有多担心?人们应该如何适应这种新现实,确保自己不仅能在编程领域生存下来,还能蓬勃发展?
few years away. So So on a practical sort of pragmatic sense, if we zoom in on jobs, we can look at programmers because it seems like AI systems are currently doing incredibly well at programming and increasingly so. So a lot of people that program for a living, love programming, are worried they will lose their jobs. How worried should they be, do you think? And what's the right way to sort of adjust to the new reality and ensure that you survive and thrive as a human in the programming world?
有趣的是,编程这件事与我们多年前的预期相反,一些我们曾认为较难的技能,可能反而更容易被人工智能掌握。比如编程和数学,因为你能够生成大量合成数据,并验证这些数据是否正确。因此,这类任务更容易生成训练所需的数据。当然,这也是我们都很关注的领域,因为这些工具可以帮助我们更快、更高效地完成编程工作。
Well, it's interesting that programming and it's again counterintuitive to what we thought years ago maybe that some of the skills that we think of as harder skills are turned out maybe to be the easier ones for various reasons. But, you know, coding and math because you can create a lot of synthetic data and verify if that data is correct. Mhmm. So because of that nature of that, it's easier to make things like synthetic data to train from. It's also an area, of course, we're all interested in because we as programmers, right, to help us and get faster at it and more productive.
我认为在接下来的五年到十年里,我们会发现那些积极拥抱这些技术的人,无论是在创意行业还是技术行业,都会与这些工具融为一体,变得几乎拥有超人的生产力。因此,优秀的程序员会变得比现在更加出色,甚至提升十倍。因为他们能够将自己的技能发挥到极致,充分利用这些工具,最大限度地挖掘它们的潜力。我认为这就是未来几年我们将看到的变化。这将引发巨大的变革。
So I think the for the next era, the next five, ten years, I think what we're going to find is people who are kind of embrace these technologies become almost at one with them, whether that's in the creative industries or the technical industries will become sort of superhumanly productive, I think. So the great programs will be even better, but it'll be even 10 x even what they are today. And because there you'll able to use their skills to utilize that the tools to the maximum, exploit them to the maximum. And so I think that's what we're going to see in the next domain. So that's going to cause quite a lot of change.
没错,这将带来很多人的受益。我认为其中一个例子是,如果编程变得更简单,就会有更多创意人士能够完成更多任务。但我认为顶尖程序员在架构设计方面仍将具有巨大优势。
Right. And so that's coming. A lot of people benefit from that. So I think one example of that is if coding becomes easier, it becomes available to many more creatives to do more. And but I think the top programmers will still have huge advantages as terms of specifying, going back to specifying what the architecture should be.
问题是如何以一种有用的方式引导这些编程助手,比如检查它们生成的代码是否优质。因此,在可预见的未来几年内,这个领域仍有很大的发展空间。
The question should be how to guide these coding assistance in a way that's useful, you know, check whether the code they produce is good. So I think there's plenty of headroom there for the foreseeable, you know, next few years.
因此我认为这里面有几个有趣的观点。其中之一是,持续提升使用这些工具的能力变得越来越重要。他们是在顺应模型不断进步的浪潮。而不是与之竞争。
So I think there's there's several interesting things there. One is there's a lot of imperative to just get better and better consistently of using these tools. So they are they are riding the wave of the improvement improving models Yes. Versus, like, competing against them. Yeah.
但遗憾的是,但这就是地球生命的特点。某些处于前沿的编程类型可能会具有巨大的价值,而其他一些类型的编程价值则会较少。例如,前端网页设计可能更容易像你提到的那样,由人工智能系统来生成,而游戏引擎设计、后端设计,或者在高性能场景下的系统引导和高性能编程方面的设计决策,可能会极其有价值。嗯。但情况会变化的,是的。
But sadly, but that's the the nature of of life on Earth. There could be a huge amount of value to certain kinds of programming at the cutting edge and less value to other kinds. For example, it could be like, you know, front end web design might, be more amenable to to to, as as you mentioned, to generation, by AI systems and maybe, for example, game engine design or something like this or back end design or guiding systems in high performance situations, high performance programming type of design decisions, that might be extremely valuable. Mhmm. But it it will shift Yeah.
人类最被需要的地方,而这对人们来说是令人恐惧的
Where the humans are needed most, and that's scary for people to
调整。我认为你说得对。每当出现巨大的颠覆和变化时,情况都是如此。这并不是第一次,我们在人类历史上经历过很多次,比如互联网、移动技术,更早之前还有工业革命。这将是又一个带来巨大变化的时期。
adjust. I can I think that's right? The the anytime where there's a lot of disruption and change, you know, and we've had this it's not just this time. We've had this in many times in human history with the Internet, mobile, but before that, I was the industrial revolution. And it's gonna be one of those areas where there will be a lot of change.
我认为将来会出现我们现在甚至无法想象的新工作,就像互联网创造的新工作一样。那些具备合适技能的人将能够乘风破浪,变得极其有价值。但也许人们需要重新学习或调整他们现有的技能。而这次更难应对的是,我认为我们将看到的影响可能是工业革命的十倍,而且变化的速度也会是十倍快。对吧?
I think there'll be new jobs we can't even imagine today just like the Internet created. And then those people with the right skill sets to ride that wave will become incredibly valuable, right, those skills. But maybe people will have to relearn or adapt a bit their current skills. And it's the the thing that's gonna be harder to deal with this time around is that I think what we're gonna see is something like probably 10 times the impact the industrial revolution had and but 10 times faster as well. Right?
所以,原本需要一百年完成的变化,现在可能只需要十年。这相当于将影响程度和速度结合在一起,放大了一百倍。我认为这将使社会更难应对这些变化。有很多问题需要思考,我认为我们现在就需要开始讨论这些问题。我鼓励世界上最顶尖的经济学家和哲学家们,开始思考社会将如何受到这种变化的影响,我们应该做些什么,包括像全民基本保障这样的措施,让大部分新增的生产力能够被分享和分配给整个社会,或许以服务设施等形式体现。
So instead of a hundred years, it takes ten years. And so that's gonna make, you know, it's like a 100 x the impact and the speed combined. So that's what I think gonna make it more difficult for society to to to deal with. And it's there's a lot to think through and I think we need to be discussing that right now. And I I, you know, encourage top economists in the world and philosophers to start thinking about how is society gonna be affected by this and what should we do, including things like, you know, universal basic provision or something like that where a lot of the increased productivity gets shared out and distributed to society and maybe in the form of surface services and other things.
如果你想要获得比基本保障更好的生活,你仍然需要去掌握一些极其稀缺的技能,变得与众不同。但社会应该提供一个基本的生活保障。
Where if you want more than that, you still go and get some incredibly rare skills and things like that and and make yourself unique. But but there's a basic provision that is provided.
如果你把政府看作一种技术,那么在政治方面也会出现一些有趣的问题,而不仅仅是经济学问题。如何设计一个能够应对快速变化的时代的制度,从而代表不同群体所感受到的不同痛苦?如何以一种不会导致社会分裂的方式重新分配资源?如何在不加剧分裂的前提下,体现不同人群的希望、痛苦和恐惧?因为政治家们往往很擅长煽动分裂,并利用这种分裂来赢得选举,他们通过定义‘他者’并说他们是坏的来实现这一点。因此,我认为这往往不利于我们充分利用快速变化的技术来帮助世界繁荣。因此,如果我们把政治制度看作一种技术,我们也几乎需要快速地改进我们的政治制度。
And if you think of government as technology, there's also interesting questions not just in economics, but just politics. How do you design a system that's responding to the rapidly changing times such that you can represent the different pain that people feel from the different groups, and how do you reallocate resources in a way that addresses that pain and represents the hope and the pain and the fears of different people in a way that doesn't lead to division. Because politicians are often really good at sort of fueling the division and using that to get elected, the other defining the other and then saying that's bad. And so based on that, I think that's often counterproductive to leveraging a rapidly changing technology, how to help the world flourish. So we almost need to improve our political systems as well rapidly if you think of them as a technology.
没错。我认为我们需要新的治理结构和制度来帮助我们完成这一过渡。因此,政治哲学和政治科学将在这个过程中起到关键作用。但首先我认为最重要的一点是创造更多的资源富足。对吧?
Definitely. And I think I think we'll need new governance structures, institutions probably to help with this transition. So I think political philosophy and political science is gonna be key to that. But I think the number one thing, first of all, is to create more abundance of resources. Right?
这是最重要的事情,提高生产力,获得更多资源,最终摆脱零和博弈的局面。然后第二个问题是,如何使用这些资源以及如何分配这些资源。但在拥有富足之前,这一切都无法实现。
Then there's the so that's the number one thing, increase productivity, get more resources, maybe eventually get out of the zero sum situation. Then the second question is how to use those resources and distribute those resources. But, yeah, you can't do that without having that abundance first.
你曾向我提到过本杰明·列维汀写的书《疯狂之人》(The Maniac),这是一本关于你的书,一本传记。
You mentioned to me the book, The Maniac by Benjamin Levitut, a book on first of all, about you. There's a bio about you.
真是奇怪。是的。
It's Strange. Yeah.
这很难说清楚。是的,当然。很难分清其中有多少是虚构的,有多少是真实的。但我认为,约翰·冯·诺依曼这个核心人物,可以说是对疯狂与天才的迷人而美丽的探索,也可以说是发现的双刃剑。
It's unclear. Yes. Sure. It's unclear how much is fiction, how much is reality. But I think the central figure that is John von Neumann, I would say it's a haunting and beautiful exploration of madness and genius and, let's say, the double edged sword of discovery.
而且,对于不了解的人来说,约翰·冯·诺依曼可以说是一个传奇般的人物。他为量子力学做出了贡献,参与过曼哈顿计划,被广泛认为是现代计算机和人工智能之父或开创者。很多人说,他可能是人类历史上最聪明的人之一,所以这真的非常吸引人。
And, you know, for people who don't know, John von Neumann is a kind of legendary mind. He contributed to quantum mechanics. He was on the Manhattan Project. He is widely considered to be the father of or pioneered the modern computer and AI and so on. So as many people say, he is, like, one of the smartest humans ever, so it's just fascinating.
同样吸引人的是,作为一个亲眼见证核科学和物理学如何催生原子弹的人,他看到了想法如何对世界产生巨大影响。他也预见了计算技术的类似发展。是的,这再次体现了这本书的美丽而令人不安的一面。书中向前迈出了一大步,提到了AlphaGo、AlphaZero这样的重要时刻,也许正是冯·诺依曼的思想最终变成了现实。所以我想问的是,如果你现在能和约翰·冯·诺依曼待在一起,你觉得他会怎么说现在发生的事情?
And what's also fascinating is as a person who saw nuclear science and physics become the atomic bomb, so you you got to see ideas become a thing that has a huge amount of impact on the world. He also foresaw the same thing for computing. Yeah. He's he and that's the a little bit, again, beautiful and haunting aspect of the book, then taking a leap forward and looking at this at least at all alpha zero, alpha go, alpha zero big moment that maybe John von Neumann's thinking was brought to to to to reality. So I I I guess the question is, what do you think if you got to hang out with John von Neumann now?
你觉得他会怎么说现在发生的事情?
What what would he say about what's going on?
嗯,那将是一次令人惊叹的经历。你知道,他是一个非凡的头脑,而且我也非常喜欢他在普林斯顿高等研究院度过的很多时光,那是一个非常特别的思考之地。他是一位真正的博学者,参与发明了很多东西,当然也包括现代计算机所基于的冯·诺依曼架构。他有惊人的远见。我想他会喜欢我们今天所处的时代,我想他一定会非常喜欢AlphaGo,毕竟他一直研究博弈论。
Well, that would be an amazing experience. You know, he's a fantastic mind, and and I also love the the way he he spent a lot of his time at Princeton at the Institute of Advanced Studies, a very special place for thinking. And it's amazing how much of a polymath he was in the spread of things he helped invent, including, of course, the Von Neumann architecture that all the modern computers are based on. And he had amazing foresight. I think he would have loved where we are today and he would have I think he would have really enjoyed AlphaGo being, you know, game he always did game theory.
我认为他预见了很多关于机器学习系统的发展,这些系统是通过‘成长’出来的,而不是单纯编程实现的。我觉得他就是这样称呼它们的。我不确定他会不会对此感到惊讶,因为这些正是他在20世纪50年代就已经预见的结果。我想知道他会给出什么建议。他曾经看到过……
I think he foresaw a lot of what would happen with learning machine systems that that that are kind of grown, think he called it rather than programmed. I'm not sure how even maybe he wouldn't even be that surprised. There's the fruition of what I think he already foresaw in the nineteen fifties. I wonder what advice he would give. He got see
曼哈顿计划中原子弹的建造。是的。我相信一定有很多有趣的事情没有被充分讨论,也许是一些官僚主义的问题,也许是政治家的影响,也许是没有足够地拿起电话,和那些被政治家称为敌人的人沟通。那个时代可能有一些深刻的智慧,我们今天已经遗忘了。
the the building of the atomic bomb with the Manhattan Project. Yeah. I'm sure there's interesting stuff that maybe is not talked about enough, maybe some bureaucratic aspect, maybe the influence of politicians, maybe maybe not enough of picking up the phone and talking to people that are called enemies by the said politicians. There might be some, like, deep wisdom that we just may have lost from that time, actually.
是的。我相信一定有。我的意思是,我们也研究过、读过很多那个时代的书,记录过那个时代的情况,也涉及一些非常杰出的人物。但我同意你的看法,我认为也许我们需要更多的对话和理解。
Yeah. I'm sure I'm sure there is. I mean, I've we we, you know, study I read a lot of books for that time as well, chronicle time and some brilliant people involved. But I I agree with you. I think maybe there needs to be more dialogue and understanding.
我希望我们能从那个时代学到一些东西。我认为不同之处在于,人工智能是一项多用途技术。显然,我们正试图用它来解决各种疾病、能源和资源匮乏等问题,这些都是了不起的事情,这也是为什么我们所有人,包括我自己,30年前就开始了这段旅程。当然,这也伴随着一定的风险。
I hope we can learn from those those times. I think the difference here is that the AI has so many it's a multi use technology. Obviously, we're trying to do things like that that solve, you know, all diseases, help with energy and scarcity. These incredible things, this is why all of us and and myself, you know, worked started on this journey 30 ago. And but of course, there are risks too.
而可能冯·诺依曼,我的猜测是他预见到了这两方面。而且我想他大概对他的妻子说过,计算机对世界的影响会更加深远。正如我们刚刚讨论的那样,我认为这是对的。我认为它至少会是工业革命的十倍影响。所以我认为他是对的。
And probably Von Neumann, my guess is he foresaw both. And and I think he sort of said, I think it's to his wife that that that it would be a this is computers would be even more impactful in the world. And as we just discussed, you know, I think that's right. I think it's gonna be 10 times at least of the industrial revolution. So I think he's right.
所以我想他应该会对我们现在所处的位置感到着迷。
So I think he would have been, I imagine fascinated by where we are now.
我认为书中也许有一个观点你可以纠正我一下,书中提到的‘理性的疯狂梦想’不足以引导人类在构建这些超级强大技术的过程中前行,还需要别的东西。比如,某种宗教层面的元素。无论是什么样的神,无论是什么样的宗教,它给予我们某种东西,激发我们人类精神中的某种力量,这是纯粹的、冰冷的理性所无法给予的。
And I think one of the maybe you can correct me, but one of the takeaways from the book is that reason, as said in the book, mad dreams of reason, is not enough for guiding humanity as we build these super powerful technology, that there's something else. I mean, there's also like a religious component. Whatever god, whatever religion gives, it give it pulls us something in the human spirit that raw, cold reason doesn't give us.
我同意这一点。我认为我们必须以某种方式来面对它,你可以称之为精神维度或人文维度,不一定要与宗教相关。对吧?但是这种关于灵魂的概念,让我们成为人类的本质,也许与意识有关,当我们最终理解意识的时候。我认为这必须成为这项事业的核心。
And I I agree with that. I think we need to approach it with whatever you wanna call it, the spiritual dimension or humanist dimension doesn't have to be to do with religion. Right? But this idea of a soul, what makes us human, this spark that we have perhaps has to do with consciousness when we finally understand that. I think that has to be at the heart of the endeavor.
我一直将技术视为一种赋能者,对吧?这些工具使我们能够繁荣发展,并更深入地理解世界。在这方面我比较认同费曼的观点,他总是谈论科学与艺术是相辅相成的。对吧?你可以从两个角度来看:一朵花的美,它有多么漂亮,同时也可以理解这花的颜色为何会进化成这样。
And technology, I've always seen technology as the enabler, right? The tools that enable us to to flourish and to understand more about the the world. And I'm sort of with Feynman on this and he used to always talk about science and art being companions. Right? You can understand it from both sides, the beauty of a flower, how beautiful it is, and also understand why the colors of the flower evolved like that.
对吧?这只会让花的内在之美更加突出。我一直都是这样看的。或许,在文艺复兴时期,当时的伟大发现者,比如达·芬奇,我想他并不认为科学、艺术甚至宗教之间有什么区别,对吧?
Right? That just makes it more beautiful that that that just the intrinsic beauty of the flower. And and I've always sort of seen it like that. And maybe, you know, in the Renaissance times, the great discoverers then like people like da Vinci, you know, they were I don't think he saw any difference between science and art and perhaps religion. Right?
对他们来说,这一切都是人类的一部分,是被我们周围世界所激发的灵感。这也是我所信奉的哲学。我最喜欢的哲学家之一是斯宾诺莎。我认为他很好地融合了这一切,他试图理解宇宙以及我们在其中的位置。那是他理解宗教的一种方式。我认为这非常美好。
They were everything was it's just part of being human and being inspired about the world around us. And that's what I the philosophy I tried to take and one of my favorite philosophers is Spinoza. And I think he combined that all very well, you know, this idea of trying to understand the universe and understanding our place in it. And that was his kind of way of understanding religion. And I think that's quite beautiful.
对我来说,所有这些事情都是相互关联的:技术以及作为人类意味着什么。尽管我们在技术与研究中沉浸其中,但记住这一点非常重要。我发现我们领域中的许多研究人员视野有些狭窄,只懂技术。我认为这也是为什么这个问题需要整个社会广泛讨论的原因。我非常支持这样的事情,比如人工智能峰会的召开,以及政府对AI的理解。
And for me, every all of these things are related, interrelated, the technology and what it means to be human. And I think it's very important though that we remember that as when we're immersed in the technology and the research. I think a lot of researchers that I see in our field are a little bit too narrow and only understand the technology. And I think also that's why it's important for this to be debated by society at large. And I'm very supportive of things like this, the AI summits that will happen and governments understanding it.
我认为聊天机器人时代以及人工智能的产品时代的一件好事是,普通人都能够实际感受到并互动最先进的AI,亲自体验它。
And I think that's one good thing about the chatbot era and the product era of AI is that everyday person can actually feel and and interact with cutting edge AI and and and feel feel it for themselves.
是的,因为它们迫使技术人员展开关于人性的对话。没错,确实是这样。
Yeah. Because they they force the technologists to have the human conversation. Yeah. For sure.
是的,这就是它的全部完整面貌。
Yep. That's the whole full aspect of it.
就像你说的,这是一项双重用途的技术,我们正强行将全人类都带入关于人工智能的讨论中。因为最终,人工智能、通用人工智能将会被用于国家通常使用技术的目的,比如冲突等等。而我们越是通过与人类的交流将人类带入这个图景中,我们就越能进行引导。
Like you said, it's a dual use technology that we're forcefully integrating the entire humanity into it by into the discussion about AI. Because ultimately, AI, AGI will be used for things that states use technologies for, which is conflict and so on. And the more we integrate humans into this picture by having chats with them, the more we will guide.
是的,社会将能够适应这些技术,就像我们过去一直适应我们发明的那些惊人技术一样。
Yeah. Be able to adapt. Society will be able to adapt to these technologies like we've always done in the past with with incredible technologies we've invented in the past.
你认为是否会出现类似曼哈顿计划的情况?也就是说,各国是否会以旧有的思维方式,将这项技术的威力进一步升级,试图将其作为武器技术来使用,从而引发这种升级?
Do you think there will be something like a Manhattan Project where there will be an escalation of the power of this technology in states in their old way of thinking will try to use it as weapons technologies, there will be this kind of escalation.
我希望不会。我认为那样做是非常危险的,而且我认为这也不是这项技术的正确用途。我希望如果真的需要的话,我们最终能采取一种更合作的方式,更像是一个像欧洲核子研究中心(CERN)那样的项目。你知道的,就是以研究为导向,让全球最聪明的人才汇聚一堂,谨慎地完成最后的步骤,并确保在向世界推出之前是负责任地完成的。
I hope not. I think that would be very dangerous to do. And I think also, you know, not the right use of the technology. I I hope we'll end up with more something more collaborative if needed, like more like a like a CERN project Yeah. You know, where it's research focused and the best minds in the world come together to carefully complete the final steps and make sure it's responsibly done before, you know, like deploying it to the world.
我们拭目以待吧。我的意思是,在当前的地缘政治环境下,我认为很难看到合作的可能,但事情是会变的。我认为至少在科学层面,研究人员之间保持联系、在这些话题上保持密切交流是非常重要的。
We'll see. I mean, it's difficult with the current geopolitical climate, I think, to to see cooperation, but things can change. And I think at least on the scientific level, it's important for the researchers to to to to keep in touch and and and keep close to each other on at least on those kinds of topics.
是的,我个人认为在教育和移民方面,如果在两个方向上都能实现——西方人移民到中国,中国人也移民回去——那将是一件好事。我的意思是,有一些像家庭和人性的方面,人们彼此融合。是的,这样建立的联系就会变得牢固,你就不能再用那种老式的思维来互相敌对了。
Yeah. And I I personally believe on the education side and immigration side, it would be great if both directions, people from the West immigrated to China and China back. I mean, there is some, like, family human aspect of people just intermixing. Yeah. And thereby, those ties grow strong, so you can't sort of divide against each other, this kind of old school way of thinking.
因此,多文化、多学科的研究团队共同研究科学问题,这才是希望所在。不要让那些好战的领导人、那些好战分子分裂我们。我认为科学最终是真正美好的连接纽带。
And so multi, multicultural, multidisciplinary research teams working on scientific questions, that's like the hope. Don't don't let the the warm leaders that are warmongers because it divide us. I think science is the ultimately really beautiful connector.
是的,我认为科学一直都是非常具有合作性的努力。嗯嗯,而且你知道,科学家们也明白这是一种集体的努力,我们都能从彼此身上学到东西。所以,也许科学可以成为促进一些合作的途径。
Yeah. Science has always been, I think, quite a a very collaborative endeavor. Mhmm. And, you know, scientists know that it's it's a it's a collective endeavor as well, and we can all learn from each other. So perhaps it could be a vector to get a bit of cooperation.
你那个荒诞的问题是什么?你认为人类文明自我毁灭的概率是多少?
What's your ridiculous question? What's your p doom? Probability that human civilization destroys itself.
嗯,看吧,我并没有一个具体的数字,你知道的,我没有一个精确的‘P毁灭’概率。我之所以没有给出具体数字,是因为我觉得这会暗示一种并不存在的精确性。所以,我不太明白人们是怎么得出他们的PDU数字的。我认为这个想法有点荒谬,因为我想说的是,这个概率绝对不是零,而且可能还相当可观。仅凭这一点,就足以让人清醒了。
Well, look, I I don't have a it's a you know, I don't have a p doom number. The reason I don't is because I think it would imply a level of precision that is not there. So, like, I don't know how people are getting their PDU numbers. I think it's a kind of a little bit of a ridiculous notion because what I would say is it's definitely non zero and it's probably non negligible. So that in itself is pretty sobering.
而我的看法是,这一切仍然存在巨大的不确定性。对吧?这些技术究竟能做到什么程度,它们的发展速度有多快,它们是否可控。有些事情可能最终会比我们想象的要容易得多,希望如此,对吧?
And my my view is it's just hugely uncertain. Right? What these technologies are going to be able to do, how fast are they going to take off, how controllable they're going to be. Some things may turn out to be and hopefully, like way easier than we thought. Right?
但也有可能存在一些非常困难的问题,比我们现在预想的还要难。我认为我们目前还无法确定这些。因此,在这种高度不确定的情况下,但结果的影响又是极其巨大的。一方面,我们可以解决所有疾病、能源问题,不再是稀缺问题,然后实现星际旅行、意识扩展,以及人类最大程度的繁荣发展。另一方面,则是那种所谓的‘P毁灭’情景。因此,鉴于这种不确定性和重要性,对我来说,唯一理性和合理的做法就是保持谨慎的乐观态度。
But it may be there some really hard problems that are harder than we guess today. And I think we don't know that for sure. And so in under those conditions of a lot of uncertainty, but huge stakes both ways, you know, on the one hand, we we could solve all diseases, energy problems, not the the the scarcity problem and then travel to the stars and consciousness of the stars and maximum human flourishing. On the other hand, is this sort of p doom scenarios. So given the uncertainty around it and the importance of it, it's clear to me the only rational sensible approach is to proceed with cautious optimism.
我们当然希望实现好的结果,希望获得人工智能带来的所有好处。如果我没有看到类似人工智能这样的技术正在逐步发展,我会为人类感到非常担忧,尤其是在我们面临其他诸多挑战的情况下——气候变化、疾病、人口老龄化、资源问题等等。对吧?
So we want the outcome. We want the benefits of course and all of the amazing things that AI can bring. And actually, would be really worried for humanity if I if given the other challenges that we have, climate, disease, you know, aging resources, all of that. If I didn't know something like AI was coming down the line. Right?
我们又该如何解决所有这些问题呢?我觉得很难。所以我认为,人工智能可能会带来极其积极的变革。但另一方面,你也知道,那些我们已知的风险,我们却无法准确量化。因此,最好的做法就是运用科学方法开展更多研究,尝试更精确地定义这些风险,并加以应对。
How would we solve all those other problems? I think it's hard. So I think we've you know, it could be amazingly transformative for good. But on the other hand, you know, there are these risks that we know are there, but we can't quite quantify. So the the best thing to do is to use the scientific method to do more research, to try and more precisely define those risks and of course address them.
我认为我们正在这么做。但随着我们越来越接近通用人工智能(AGI)的边界,我认为我们需要为此投入的努力应该是现在的十倍。
And I think that's what we're doing. I think there probably needs to be 10 times more effort on that than there is now as we're getting closer and closer to the to the to the AGI line.
对你来说,更令人担忧的来源会是什么?是人为造成的,还是人工智能,特别是通用人工智能(AGI)造成的?
What would be the source of worry for you more? Would it be human caused or AI, AGI caused?
是的。
Yeah.
是人类滥用这项技术,还是AGI本身通过你刚才提到的机制,比如欺骗等行为?这种现象会越来越隐蔽,秘密地变得越来越好、越来越好。
The humans abusing that technology versus AGI itself through mechanism that you've spoken about, which is fascinating, deception, or this kind of stuff Yes. Getting better and better and better secretly and then
我认为这两者在不同的时间尺度上运作,而且都同样重要,都需要应对。首先就是常见的那种,比如坏人利用新技术,特别是专门开发的技术,并将其用于有害的目的。这是一个巨大的风险。我认为这会带来很多复杂的问题,因为总体而言,我非常支持开放科学和开源。事实上,我们所有的科学项目都是这样做的,比如AlphaFold等项目,都是为了造福科学界。
I think they're they're they operate over different time scales and they're equally important to address. So there's just the the the common garden of variety of, like, you know, bad actors using new technology, in this case, purpose technology and repurposing it for harmful ends. And that's a huge risk. And I think that has a lot of complications because generally, you know, I'm in huge favor of open science and open source. And in fact, we did it with all our science projects like AlphaFold and all of those things for the benefit of of the scientific community.
但是,我们如何限制坏人访问这些强大系统的能力呢?无论是个人还是流氓国家,同时又要让好人能够最大程度地在此基础上进行开发。这是一个相当棘手的问题,我还没有听说过明确的解决方案。因此,一方面存在坏人滥用的问题,另一方面,随着系统变得越来越自主,越来越接近通用人工智能(AGI),我们如何确保它们遵循我们设定的规则,并始终处于我们的控制之下呢?
But how does one restrict bad actors access to these powerful systems, whether they're individuals or even rogue states and but enable access at the same time to good actors to to maximally build on top of. It's pretty tricky problem that there's I've not heard a clear solution to. So there's the bad actor use case problem, and then there's obviously, as the systems become more agentic and and closer to AGI and more autonomous, how do we ensure the guardrails and they stick to what we want them to do and under our control?
是的。我倾向于——也许我的想法有限——更担心人类中的坏人。在这种情况下,一部分问题是如何不让破坏性技术落入坏人之手;但从地缘政治和技术角度来看,另一部分问题是如何减少世界上坏人的数量。这也是一个有趣的人类问题。
Yeah. I tend to, maybe on my mind, is limited, worry more about the humans, the bad actors. And there, it could be, in part, how do you not put destructive technology in the hands of bad actors? But in another part, from, again, geopolitical technology perspective, how do you reduce the number of bad actors in the world? That's that's also an interesting human problem.
没错。这是一个难题。我的意思是,看看吧。我们或许也可以利用技术本身来帮助提前预警一些坏人可能的滥用行为,对吧?
Yeah. It's a hard problem. I mean, look. We we we can maybe also use the technology itself to help early warning on some of the bad actor use cases. Right?
无论是生物领域、核领域还是其他方面,只要所使用的AI本身是可靠的,AI在这些方面都可能有所帮助。对吧?所以这是一个相互关联的问题,这也正是它非常棘手的原因。而且,再次强调,这可能需要国际社会达成一些共识,至少在中国和美国之间就一些基本标准达成一致,对吧。
Whether that's bio or nuclear or whatever it is, like AI could be potentially helpful there as long as the AI that you're using is itself reliable. Right? So it's a sort of interlocking problem and that's what makes it very tricky. And and again, it may require some agreement internationally, at least between China and The And and The US of of of some basic standards. Right.
我必须问你关于那本书《疯子》(The Maniac)的事情。其中有一个‘上帝之手’的时刻,李世石(Louis Saddell)第78手的妙招,可能是人类最后一次以纯粹的人类智慧击败AlphaGo,或者说让它‘崩溃’了。是的。抱歉我用了拟人化的说法,但这是一个有趣的时刻,因为我认为在许多领域中,类似的事情还会不断发生。
I have to ask you about the the book, The Maniac. There's there's this the the hand of God moment, Louis Saddell's move 78 Mhmm. That perhaps the last time a human did a move of sort of pure human genius and beat AlphaGo or like broke its brain. Yes. If sorry to anthropomorphize, but it's an interesting moment because I think in so many domains, it will keep happening.
是的,那是一个特殊的时刻。你知道,这对李世石来说非常棒。我认为从某种意义上说,这是一种相互激励。我们团队当时被李世石的才华和高尚精神所鼓舞,也许他也从AlphaGo的表现中获得灵感,从而创造了这个令人振奋的时刻。这一切在相关的纪录片中被很好地记录了下来。
Yeah. It's a special moment and, you know, it was great for Lisa Dole and, you know, I think it's in a way that was sort of inspiring each other. We as a team were inspired by Lisa Doll's brilliance and nobleness. And then maybe he got inspired by, you know, what AlphaGo was doing to then conjure this incredible inspirational moment. It's all, you know, captured very well in the in the documentary about it.
我认为在许多领域中这种现象还会继续出现,至少在可预见的未来,人类仍将通过自己的创造力提出正确的问题,然后以某种方式利用这些工具来攻克难题。是的。当AI变得越来越聪明时,一个值得我们思考的有趣问题是:人类的特别之处到底是什么?
And I think that'll continue in many domains where there's this, at least for the for the again, the foreseeable future of, like, the humans bringing in their ingenuity and asking the right question, let's say, and then utilizing these tools in a way that then cracks a problem. Yeah. What as the AI becomes smarter and smarter, one of the interesting questions we can ask ourselves is what makes humans special?
我们人类可能确实深感自己特别,但我不确定这种特别是否来自我们的智力。也许还有其他东西,一种超越理性疯狂梦想之外的东西。
It does feel perhaps biased that we humans are deeply special. I don't know if it's our intelligence. It could be something else that that other thing that's outside the mad dreams of reason.
这正是我小时候踏上这段旅程时一直想象的事情。我当时当然对意识等问题非常着迷,还攻读了神经科学博士学位,研究大脑的工作机制,特别是想象力和记忆力。我专注于海马体的研究。我一直认为,最好的方法当然是进行哲学思考、思想实验,甚至像神经科学那样在真实大脑上进行实验。但最终,我一直设想,制造一种智能的人工制品——也就是AI,然后将其与人类心智进行比较,看看它们之间的差异,这才是揭示人类心智特别之处的最佳方式,当然前提是人类心智真的有什么特别之处的话。
I think that's what I've always imagined when I was a kid and starting on this journey of, like, I was, of course, fascinated by things like consciousness, did did a neuroscience PhD to look at how the brain works, especially imagination and memory. I focus on the hippocampus. And it's sort of going to be interesting. I always thought the best way, of course, one can can philosophize about it and have thought experiments and maybe even do actual experiments like you do in neuroscience on on real brains. But in the end, I always imagine that building AI, a kind of intelligent artifact, and then comparing that to the human mind and seeing what the differences were would be the best way to uncover what's special about the human mind, if indeed there is anything special.
我怀疑人类心智确实有特别之处,但要理解这一点并不容易。我认为我们正在经历的这段旅程将帮助我们去理解并定义它。你也知道,我们这些以碳为基础的生命体与以硅为基础的系统在信息处理方式上可能存在差异。我最喜欢的一个关于意识的定义是:意识就是我们在处理信息时信息所带来的一种感受。对吧?是的。
And I suspect there probably is, but it's gonna be hard to you know, I think this journey we're on will help us understand that and define that. And, you know, there may be a difference between carbon based substrates that we are and silicon ones when they process information. You know, one of the best definitions I like of of of consciousness is it's the way information feels when we process it. Right? Yeah.
可能是这样。
It could be.
我的意思是,
I mean,
它并没有给出一个非常有帮助的科学解释,但我认为它是一种颇为有趣的直觉性解释。因此,你知道,我们所进行的这一段旅程,这一段科学旅程,我认为将有助于揭开那个谜团。
it doesn't have it's not a very helpful scientific explanation, but I think it's kind of interesting intuitive one. And and so, you know, on this this this journey, this scientific journey we're on will, I think, help uncover that mystery.
是的。我无法创造的东西,我就无法理解。这是你非常敬佩的一个人,理查德·费曼说过的话,就像你刚才提到的那样。你也提到了维格纳关于普遍性的梦想,他是在受限领域中,甚至更广泛地在数学等领域中看到这一点。你在很多方面都在推进,虽然不是要在最后制造麻烦,但提到了罗杰·彭罗斯。
Yeah. What I cannot create, I do not understand. That's somebody you deeply admire, Richard Feynman, like you mentioned. You also reach for the so Wigner's dreams of universality that he saw in constrained domains, but also broadly generally in in mathematics and so on. So so many aspects on which you're pushing towards, not to start trouble at the end, but Roger Penrose.
是的。好,那么,
Yes. Okay. So,
你知道,你认为意识是否存在这个困难的问题,也就是信息为何会有感受。首先,你认为意识是一种计算吗?如果是的话,如果它正如你所说的是信息处理,那么它是否可以用经典计算机来建模?是的。
you know, do do you think consciousness there's this hard problem of consciousness, how information feels. Do you think consciousness, first of all, is a computation? And if it is, if it's information processing, like you said, everything is. Is it something that could be modeled by a classical computer? Yeah.
还是说它的本质是量子力学的?
Or is it a quantum mechanical in nature?
嗯,我们的彭罗斯是一位非凡的思想家,可以说是现代最伟大的人物之一,我们在这方面有过很多讨论。当然,我们友好地持不同意见。我觉得,他与许多优秀的神经科学家合作,试图在大脑中寻找可能表现出量子力学行为的机制。据我所知,他们至今还没有发现任何令人信服的证据。所以我倾向于认为,大脑中发生的主要是经典计算,这意味着所有现象都可以用经典计算机来建模或模仿。但我们会看到的,也许意识的感受,也就是所谓的感受质,这些哲学家争论的问题,可能是该物质基质所独有的。
Well, our Penrose is an amazing thinker, one of the greatest of the modern era, and he we've had a lot of discussions about this. Of course, we cordially disagree, which is, you know, I I feel like I mean, he collaborates with a lot of good neuroscientists to see if he could find mechanisms for quantum mechanics behavior in the brain. And they to my knowledge, they haven't found anything convincing yet. So my betting is there is is that that it's mostly, you know, it is just classical computing that's going on in the brain, which suggests that all the phenomena are modellable or mimickable by a classical computer. But we'll see, you know, there there may be this final mysterious things of the feeling of consciousness, the qualia, these kinds of things that philosophers debate where it's unique to the substrate.
当我们进行像Neuralink这样的项目,并与AI系统建立神经接口时,我们可能会逐渐理解这一点,我认为我们最终可能会这么做,也许是为了一直跟上AI系统的步伐。我们实际上可能能够亲身体验在硅基上计算是什么感觉。对吧?这或许会告诉我们答案。所以我认为这将是一件非常有趣的事情。
We may even come towards understanding that when if we do things like Neuralink and and have neural interfaces to the AI systems, which I think we probably will eventually, maybe to keep up with the AI systems. We might actually be able to feel for ourselves what it's like to compute on silicon. Right? So and maybe that will tell us. So I think it's it's gonna be interesting.
我曾与已故的丹尼尔·丹尼特有过一次辩论,主题是为什么我们认为彼此是有意识的。好,这有两个原因。其一是你表现出了与我相同的行为。因此,从行为上看,如果你是有意识的,那么你也像是一个有意识的存在。
I had a debate once with the late Daniel Dennett about why do we think each other are conscious. Okay. So it's for two reasons. One is you're exhibiting the same behavior that I am. So that's one thing behaviorally, you seem like a conscious being if I am.
但第二点常常被忽视,那就是我们是在相同的基质上运行的。因此,如果你的行为方式和我一样,而我们又是在相同的基质上运行,那么最简练的假设就是你正在经历和我一样的感受。但对于运行在硅基上的AI来说,即使它表现出第一点,也就是行为看起来像有意识的生物,我们也无法依赖第二点。它甚至可能声称自己有意识,但我们无法知道它实际的感受是什么。
But the second thing which is often overlooked is that we're running on the same substrate. So if you're behaving in the same way and we're running on the same substrate, it's most parsimonious to assume you're feeling the same experience that I'm feeling. But with an AI that's on silicon, we won't be able to rely on the second part even if it exhibits the first part that behavior looks like a behavior of a conscious being. It might even claim it is. But we but but we wouldn't know how it actually felt.
而且它可能也无法知道我们的感受。至少在最初阶段是这样,也许当我们达到超级智能以及构建这种技术的时候,我们或许能够弥合这一差距。
And it probably couldn't know we what we felt. At least in the first stages, maybe when we get to superintelligence and the technologies that builds, perhaps we'll we'll be able to bridge that.
不。我的意思是,这是一次巨大的考验,考验我们是否能产生根本性的共情,去共情一个不同基质的存在。
No. I mean, that's a huge test for radical empathy is to empathize with a different substrate.
没错。我们以前从未面对过这样的情况。
Right. Exactly. We never had to confront that before.
所以也许通过脑机接口,我们可以真正地共情作为一台计算机是什么感觉。
Yeah. So maybe maybe through brain computer interfaces, be able to truly empathize what it feels like to be a computer.
嗯,把信息放在非碳基系统中进行处理。
Well, to put information to be computed, not on a carbon system.
我的意思是,这非常深刻。有些人甚至会用这种观点来看待植物或其他生命形式。
I mean, that's deeply I mean, some people kinda think about that with plants with other life forms,
是的,确实如此。完全正确。
which Yeah. It could be. Exactly.
类似的基质,但在进化树上已经离得足够远。是的,这就需要一种根本性的共情能力,但要做到这一点
Similar substrate, but sufficiently far enough on the evolutionary tree. Yep. That it requires a radical empathy, but to do that
去共情一台计算机。我是说,路,我们在这方面其实有一些动物研究的例子,比如像虎鲸、海豚、狗和猴子这样的高等动物。你知道,它们当然还有大象,它们肯定具备某些意识层面的特征。对吧?尽管它们在智商意义上可能并不那么聪明。
with a computer. I mean, Lou, we sort of there are animal studies on this of, like, of course, higher animals like, you know, killer whales and dolphins and dogs and and monkeys. You know, they have some and elephants, you know, they have some aspects certainly of consciousness. Right? Even though they're not might not be that that that smart on an IQ sense.
所以我们已经可以对此产生共鸣了。也许有一天,我们的某些系统也能做到类似的事情。比如我们开发了一个叫做 Dolphin Gemma 的系统,它的一个版本是通过海豚和鲸鱼的声音进行训练的。也许在未来的某个时刻,我们能够打造出一种翻译或解释器。这将会非常酷。你对人类文明的未来抱有什么希望呢?嗯,让我感到希望的是,首先我认为我们几乎拥有无限的创造力。我认为我们之中最优秀的人,拥有最杰出的头脑,这是令人难以置信的。
So so we can already empathize with that. And maybe even some of our systems one day like we built this thing called Dolphin Gemma, you know, which can one a version of our system was trained on dolphin and whale sounds and maybe we will be able to build an interpreter or translator at some point. It should be pretty cool. What gives you hope for the future of human civilization? Well, what gives me hope is I think our almost limitless ingenuity, first of all, I think the best of us and the best human minds are incredible.
你知道,我喜欢与那些在各自领域登峰造极的人交流或观察他们,无论是体育、科学还是艺术。看到他们在自己的领域中游刃有余、进入状态,这简直没有比这更美妙的事情了。我认为这几乎是无限的。我们的大脑是通用系统,是智能系统。因此,我认为从潜在可能性上来说,我们几乎可以做到任何事情。另一个值得期待的是我们极强的适应能力。
And, you know, I love, you know, meeting and watching any human that's the top of their game, whether that's sport or science or art, you know, it's it's it's just nothing more wonderful than that seeing them in their element in flow. I think it's almost limitless. You know, our brains are general systems, intelligent systems. So I think it's almost limitless what we can potentially do with them. And then the other thing is our extreme adaptability.
我认为从长远来看,一切都会好起来的。虽然一定会经历很多变化。但看看我们现在所处的环境,仅仅依靠我们最初作为采集者和猎人的大脑,我们竟然能够应对现代世界,比如乘坐飞机、录制播客,或者玩电脑游戏和虚拟仿真。这本身已经令人难以置信了,要知道我们的大脑原本是为了在苔原上猎捕野牛而进化的。
I think it's gonna be okay in terms if there's gonna be a lot of change, but but look where we are now without effectively our hunter gatherer brains. How is it we can, you know, we can cope with the modern world. Right? Flying on planes, doing podcasts, you know, playing computer games and virtual simulations. I mean, it's already mind blowing given that our mind was was developed for, you know, hunting buffalos on the on the tundra.
因此,我认为这只是下一步而已。而且实际上挺有趣的是,我们已经看到社会是如何适应今天所拥有的这些令人惊叹的AI技术的。现在人们已经觉得和聊天机器人对话是一件再正常不过的事情了。
And and so I think this is just the next step. And and and it's actually kind of interesting to see how society's already adapted to this mind blowing AI technology we have today already. It's sort of like, oh, I talk to chatbots. Totally fine.
我今天正在参与的这个播客活动,很有可能会被AI完全取代。我是很容易被替代的,而我对此
And it's very possible that this very podcast activity, which I'm here for, will be completely replaced by AI. I'm very replaceable, and I'm
等着你做到那个水平再说吧,Lex。我不这么认为。
waiting for level that you can do it, Lex. I don't think.
谢谢。
Thank you.
这就是我们人类之间常做的事情——互相赞美。没错。
That's that's what we humans do to each other. Complement. Exactly.
好的。我对我们人类拥有无限的好奇心、适应能力(就像你所说的那样),以及同情心和爱的能力,感到由衷的感激。
Alright. And I'm deeply grateful for us humans to have this infinite capacity for curiosity, adaptability, like you said, and also compassion and ability to love.
没错。这些都是深深属于人类的特质。
Exactly. All of those human that are deeply human.
嗯,这真是莫大的荣幸,德米斯。你是世界上真正特别的人之一。非常感谢你所做的工作,也感谢你今天来交流。再次,非常感谢。
Well, this is a huge honor, Demis. You're one of the truly special humans in the world. Thank you so much for doing what you do and for talking today. Well, thank you very much. Thanks.
感谢收听与德米斯·莱萨巴斯的这次对话。要支持这个播客,请查看描述中的赞助商,并考虑订阅这个频道。现在,让我回答一些问题,并尝试表达一些我一直在思考的事情。如果你希望提交问题,无论是音频还是视频形式,请访问 lexstreaming.com/ama。我收到了很多精彩的问题、想法和请求。
Thanks for listening to this conversation with Demis Lesabas. To support this podcast, please check out our sponsors in the description and consider subscribing to this channel. And now, let me answer some questions and try to articulate some things I've been thinking about. If you like to submit questions, in audio and video form, go to lexstreaming.com/ama. I got a lot of amazing questions, thoughts, and requests from folks.
我会尽量随机挑选一些,在每一集的最后进行评论。今年5月21日我收到一条留言说:你好,Lex。二十年前的今天,大卫·福斯特·华莱士在凯尼恩学院发表了著名的《这是水》演讲。你怎么看待这个演讲?首先,我认为这可能是有史以来最伟大、最独特的毕业演讲之一。
I'll keep trying to pick some randomly and comment on it at the end of every episode. I got a note on May 21 this year that said, hi, Lex. Twenty years ago today, David Foster Wallace delivered his famous this is water speech at Kenyan College. What do you think of this speech? Well, first, I think this is probably one of the greatest and most unique commencement speeches ever given.
当然,我还有很多喜欢的演讲,包括史蒂夫·乔布斯的那篇。大卫·福斯特·华莱士是我最喜欢的作家之一,也是我最欣赏的人之一。他的作品中有一种悲剧性的诚实,总让人觉得他一直在与自己的内心进行一场持续不断的斗争。而他的写作,就像是这场斗争前线的笔记。现在回到他的演讲,让我引用其中的一些内容。
But of course, I have many favorites including the one by Steve Jobs. And David Foster Wallace is one of my favorite writers and one of my favorite humans. There's a tragic honesty to his work, and it always felt as if he was engaging in a a constant battle with his own mind. And the writing, his writing, were kind of his notes from the front lines of that battle. Now onto the speech, let me quote some parts.
当然,演讲中有一个关于鱼和水的寓言:有两条小鱼一起游着,途中遇到了一条老鱼迎面游来,向它们点头致意,并说:“早上好,孩子们。水怎么样?”两条小鱼继续游了一段,最后其中一条看着另一条说:“水是什么鬼东西?”在演讲中,大卫·福斯特·华莱士接着说:“鱼的故事的重点只是想说明,最明显、最重要的现实往往最难看到和谈论。当然,用英语句子表达出来,这不过是一句陈词滥调,但在成人世界日复一日的现实中,这些陈词滥调可能具有生死攸关的重要性,这是我今天在这个干燥而美好的早晨想要告诉你们的。”
There's of course the parable of the fish and the water that goes, there are these two young fish swimming along and they happen to meet an older fish swimming the other way, who nods at them and says, morning, boys. How's the water? And the two young fish swim on for a bit, and then eventually, one of them looks over at the other and goes, what the hell is water? In the speech, David Foster Wallace goes on to say, the point of the fish story is merely that the most obvious important realities are often the ones that are hardest to see and talk about. Stated as an English sentence, of course, this is just the banal platitude, but the fact is that in the day to day trenches of adult existence, banal platitudes can have a life or death importance, or so I wish to suggest to you in this dry and lovely morning.
从这个寓言和随后的演讲中,我有几点体会。首先,我认为我们必须质疑一切,尤其是那些关于现实、生活以及存在本质的最基本假设。而且这是一项非常个人化的任务。在某种根本意义上,没有人能真正帮助你完成这个发现的过程。这里所传达的行动号召,我认为正如大卫·福斯特·华莱士所说的那样,是要‘少一点傲慢,对自己和自己的确定性多一点批判性的认知。’
I have several takeaways from this parable and the speech that follows. First, I think we must question everything, and in particular the most basic assumptions about our reality, our life, and the very nature of existence. And that this project is a deeply personal one. In some fundamental sense, nobody can really help you in this process of discovery. The call to action here, I think, from David Foster Wallace, as he puts it, is to quote, to be just a little less arrogant, to have just a little more critical awareness about myself and my certainties.
因为我自己倾向于坚信的许多东西,结果证明是完全错误和荒谬的。好了,回到我自己,Lex来说。第二个体会是,我们生命中最重要的精神斗争,并不是发生在某个山顶冥想静修时,而是在日常生活的平凡时刻。第三个体会是,我们太容易把自己的时间和注意力交给了世界提供给我们的各种干扰。
Because a huge percentage of the stuff that I tend to be automatically certain of is, it turns out, totally wrong and deluded. Alright. Back to me, Lex speaking. Second takeaway is that the central spiritual battles of our life are not fought on a mountain top somewhere at a meditation retreat, but it is fought in the mundane moments of daily life. Third takeaway is that we too easily give away our time and attention to the multitude of distractions that the world feeds us.
这些是吞噬注意力的无底黑洞。在这种情况下,大卫·福斯特·华莱士所呼吁的是,要深刻地意识到每一刻的美,并在平凡中找到意义。我经常引用大卫·福斯特·华莱士关于生活关键的一句话:‘要难以忍受。’我认为这完全正确。每一刻、每一个物体、每一次经历,只要仔细观察,都蕴含着无限的探索价值。既然本期播客的嘉宾德米斯·莱萨巴斯和我都是理查德·费曼的忠实粉丝,那我也来引用一下费曼先生在这个话题上的观点。
The insatiable black holes of attention. David Foster Wallace's call to action in this case, is to be deeply aware of the beauty in each moment, and to find meaning in the mundane. I often quote David Foster Wallace in his advice that the key to life is to be unbearable, And I think this is exactly right. Every moment, every object, every experience, when looked at closely enough, contains within it infinite richness to explore. And since Demis Lasabas of this very podcast episode and I are such fans of Richard Feynman, allow me to also quote mister Feynman on this topic as well.
他说:‘我有个朋友是艺术家,他有时持有一些我不太认同的观点。他会举起一朵花说:你看这朵花多美。我也会同意。然后他说:作为一个艺术家,我能欣赏它的美,但你作为一个科学家,却把它拆解得索然无味。我认为这种说法有点荒谬。首先,他所看到的美,其他人包括我也都能看到。’
Quote, I have a friend who's an artist and has sometimes taken a view which I don't agree with very well. He'll hold up a flower and say, look how beautiful it is, and I'll agree. Then he says, I as an artist can see how beautiful this is, but you as a scientist take this all apart and it becomes a dull thing. And I think that's kind of nutty. First of all, the beauty that he sees is available to other people and to me too, I believe.
虽然我在审美上可能不如他那么细腻,但我也能欣赏一朵花的美。与此同时,我能从花中看到的远比他看到的要多。我可以想象其中的细胞,想象内部复杂的活动,这些同样也很美。我的意思是,美不仅仅存在于一厘米尺度的维度上,在更小的维度上,比如内部结构和过程,也同样美丽。
Although I may not be quite as refined aesthetically as he is, I can appreciate the beauty of a flower. At the same time, I see much more about the flower than he sees. I can imagine the cells in there. The complicated actions inside which also have beauty. I mean, it's not just beauty at this dimension at one centimeter, there's also beauty at the smaller dimensions, the inner structure, also the processes.
花朵的颜色进化是为了吸引昆虫为其授粉,这一事实很有趣。这意味着昆虫能够看到颜色。这引发了一个问题:这种审美感是否也存在于更低级的生命形式中?为什么会有审美?科学知识只会增加我们对花朵的兴奋感、神秘感和敬畏感,从而引发各种各样的有趣问题。
The fact that the colors in the flower evolved in order to attract the insects to pollinate it is interesting. It means that the insects can see the color. It adds a question, does this aesthetic sense also exists in lower forms? Why is it aesthetic? All kinds of interesting questions which the science knowledge only adds to the excitement, the mystery, and the awe of a flower.
它只会增加。好的,回到大卫·福斯特·华莱士的演讲。他里面讲了一个我很喜欢的精彩故事。故事是这样的:有两个家伙坐在阿拉斯加偏远荒野的一家酒吧里。
It only adds. Alright. Back to David Foster Wallace's speech. He has a great story in there that I particularly enjoy. It goes, there are these two guys sitting together in a bar in the remote Alaskan wilderness.
其中一个家伙是宗教信徒,另一个是无神论者。两人正带着一种喝了第四杯啤酒后特有的激烈情绪争论着上帝是否存在。无神论者说:‘听着,我不是真的没有不相信上帝的理由。我也不是从来没尝试过祈祷之类的。就在上个月,我在暴风雪中远离营地迷路了,完全看不到任何东西,气温是零下50度,所以我试了一下。’
One of the guys is religious. The other is an atheist, and the two are arguing about the existence of God with that special intensity that comes after about the fourth beer. And the atheist says, look, it's not like I don't have actual reasons for not believing in God. It's not like I haven't ever experimented with the whole God and prayer thing. Just last month, I got caught away from the camp in that terrible blizzard, and I was totally lost, and I couldn't see a thing, and it was 50 below, and so I tried it.
我跪在雪地里大声呼喊:‘上帝啊,如果你真的存在,请帮帮我,我现在暴风雪中迷路了,不帮我我就会死掉。’现在回到酒吧里,那个有宗教信仰的人困惑地看着无神论者说:‘那你现在应该相信了吧,毕竟你现在还活着啊。’无神论者只是翻了个白眼。
I fell to my knees in the snow and cried out, oh god, if there is a god, I'm lost in this blizzard, and I'm gonna die if you don't help me. And now back in the bar, the religious guy looks at the atheist all puzzled. Well, then you must believe now, he says. After all, there you are, alive. The atheist just rolls his eyes.
‘不,伙计。发生的事情不过是几个爱斯基摩人碰巧路过,把我带回了营地。’我认为这一切告诉我们,一切都取决于你的视角,而智慧可能在我们保持谦逊、不断转换和拓展世界观的过程中到来。谢谢你们允许我稍微谈了下大卫·福斯特·华莱士。他是我最喜欢的作家之一,也是一位美好的灵魂。
No, man. All that happened was a couple of Eskimos happened to be wandering by and show me the way back to the camp. All this I think teaches us that everything is a matter of perspective, and that wisdom may arrive if we have the humility to keep shifting and expanding our perspective on the world. Thank you for allowing me to talk a bit about David Foster Wallace. He's one of my favorite writers and he's a beautiful soul.
如果可以的话,我还想简短地提一下另一件事。我发现自己处于一个奇怪的处境中,经常在网上被各方攻击,包括有时被断章取义地歪曲,但更多时候就是彻头彻尾的谎言。坦率地说,这一切令我心碎,但我逐渐明白,这就是互联网的运作方式,也是我所选择的道路必须付出的代价。有些时候,这些事情对我的心理影响确实挺大。
If I may, one more thing I wanted to briefly comment on. I find myself to be in this strange position of getting attacked online often from all sides, including being lied about sometimes through selective misrepresentation, but often through downright lies. I don't know how else to put it. This all breaks my heart, frankly, but I've come to understand that it's the way of the Internet and the cost of the path I've chosen. There's been days when it's been rough on me mentally.
被人造谣当然不好受,尤其是当这些事情长期以来都是我快乐和幸福的来源时。但话说回来,这就是生活。我会继续带着同理心和严谨的态度去探索人类和思想的世界,尽可能地敞开心扉。对我来说,这才是唯一的活法。顺便说一句,针对我的一个常见攻击点是我曾在麻省理工学院(MIT)和德雷塞尔大学(Drexel)的经历,这两所我热爱并充满敬意的优秀大学。
It's not fun being lied about, especially when it's about things that are usually, for a long time, have been a source of happiness and joy for me. But again, that's life. I'll continue exploring the world of people and ideas with empathy and rigor, wearing my heart on my sleeve as much as I can. For me, that's the only way to live. Anyway, a common attack on me is about my time at MIT and Drexel, two great universities I love and have tremendous respect for.
由于网上围绕这些话题已经积累了不少谎言,有时令人悲哀,有时甚至荒诞可笑,我想我再一次向少数可能关心的听众简要陈述一下我人生中的一些基本事实。TLDR(太长不看),两点:第一,正如我经常提到的,包括在最近一期被数百万听众收听的播客中,我自豪地在德雷塞尔大学完成了我的学士、硕士和博士学位。第二,我是麻省理工学院的研究科学家,并且在过去十年里一直从事带薪的研究工作。接下来我可以稍微详细地解释一下这两点,但如果这些对你毫无兴趣,请跳过。
Since a bunch of lies have accumulated online about me on these topics to a sad and at times hilarious degree, I thought I would once more state the obvious facts about my bio for the small number of you who may care. TLGR, two things. First, as I say often, including in a recent podcast episode that somehow was listened to by many millions of people, I proudly went to Drexel University for my bachelor's, master's, and doctorate degrees. Second, I am a research scientist at MIT and have been there in a paid research position for the last ten years. Allow me to elaborate a bit more on these two things now, but please skip if this is not at all interesting.
就像我之前说的,针对我的一个常见攻击是说我与麻省理工学院没有任何真正的联系。这个指控,我想,是因为我曾经在那里讲过一堂课,就声称自己与MIT有关联。不,这个指控完全是谎言。我在麻省理工学院已经有超过十年的带薪研究职位,从2015年至今。
So like I said, a common attack on me is that I have no real affiliation with MIT. The accusation, I guess, is that I'm falsely claiming an MIT affiliation because I taught a lecture there once. Nope. That accusation against me is a complete lie. I have been at MIT for over ten years in a paid research position from 2015 to today.
为了说得更清楚一点,我是麻省理工学院LIDS实验室(信息与决策系统实验室)的一名研究科学家,隶属于计算学院。目前我仍在麻省理工学院工作,你可以在学院的人员目录和各个实验室的网页上看到我的信息。这些年来,我确实在MIT讲授过许多课程,其中一小部分我上传到了网上。对我来说,教学一直是一件有趣的事情,而不是研究工作的一部分。我个人认为我并不擅长教学,但我总是能从教学经历中学到东西并获得成长。
To be extra clear, I'm a research scientist at MIT working in LIDS, the Laboratory for Information and Decision Systems in the College of Computing. For now, since I'm still at MIT, you can see me in the directory and on the various lab pages. I have indeed given many lectures at MIT over the years, a small fraction of which I posted online. Teaching for me always has been just for fun and not part of my research work. I personally think I suck at it, but I have always learned and grown from the experience.
就像费曼说的那样,如果你想深入理解某件事,试着去教别人是很有帮助的。但就像我说的,我的主要精力一直都在研究上。我发表了很多经过同行评审的论文,你可以在我的谷歌学术档案中看到这些论文。我在麻省理工学院的头四年,工作非常努力。大多数星期的工作时间都在八十到一百个小时。
It's like Feynman spoke about, if you want to understand something deeply, it's good to try to teach it. But like I said, my main focus has always been on research. I published many peer reviewed papers that you can see in my Google Scholar profile. For my first four years at MIT, I worked extremely intensively. Most weeks were eighty to a hundred hour work weeks.
之后到了2019年,我仍然保留了研究科学家的职位,但我开始分出一部分时间,跳出麻省理工投身于人工智能和机器人领域的项目,同时也花大量时间在播客节目上。正如我所说,我不断惊讶于准备一期节目竟然需要这么多时间。有很多期播客,我需要花上一百、两百甚至更多小时的时间去阅读、写作和思考,这些时间往往横跨数周甚至数月。从2020年开始,我就没有再积极发表研究论文了。我觉得播客这件事本身就需要全身心投入。
After that, in 2019, I still kept my research scientist position, but I split my time taking a leap to pursue projects in AI and robotics outside MIT and to dedicate a lot of focus to the podcast. As I've said, I've been continuously surprised just how many hours preparing for an episode takes. There are many episodes of the podcast for which I have to read, write, and think for a hundred, two hundred, or more hours across multiple weeks and months. Since 2020, I have not actively published research papers. Just like the podcast, I think it's something that's a serious full time effort.
但没有发表论文、没有全职做研究这件事一直困扰着我,因为我热爱研究,也热爱编程,喜欢构建系统来验证一些有趣的技术想法,尤其是在人机交互或人与机器人互动的背景下。我希望在未来几个月和几年内改变这种状况。我逐渐意识到,如果我不发表成果,或者不推出人们实际使用的系统,我就会觉得缺少了什么。这确实能带给我真正的快乐。无论如何,我为我在麻省理工的时间感到骄傲。
But not publishing and doing full time research has been eating at me because I love research and I love programming and building systems that test out interesting technical ideas, especially in the context of human AI or human robot interaction. I hope to change this in the coming months and years. What I've come to realize about myself is if I don't publish or if I don't launch systems that people use, I definitely feel like a piece of me is missing. It legitimately is a source of happiness for me. Anyway, I'm proud of my time at MIT.
我过去和现在都一直被比我聪明得多的人包围着,其中许多人已经成为我终生的同事和朋友。麻省理工是我逃离现实世界的地方,是我专注于探索科学与工程前沿问题的地方,这真的让我感到非常快乐。当我在心理层面因此受到攻击时,这种打击确实很沉重。也许我确实做错了什么。如果真是这样,我会努力做得更好。
I was and am constantly surrounded by people much smarter than me, many of whom have become lifelong colleagues and friends. MIT is a place I go to escape the world, to focus on exploring fascinating questions at the cutting edge of science and engineering. This again makes me truly happy, and it does hit pretty hard on a psychological level when I'm getting attacked over this. Perhaps I'm doing something wrong. If I am, I will try to do better.
在所有关于学术工作的讨论中,我希望你能明白,我从不认为自己在任何方面是专家。在播客中和私下生活中,我也从不自诩聪明。事实上,我经常称自己是个傻瓜,并且我是认真的。我尽量多自嘲,总的来说,更愿意去赞美他人而不是自己。现在我想谈谈我也热爱、引以为豪并深深感激的德雷塞尔大学。
In all this discussion of academic work, I hope you know that I don't ever mean to say that I'm an expert at anything. In the podcast and in my private life, I don't claim to be smart. In fact, I often call myself an idiot and mean it. I try to make fun of myself as much as possible, and in general to celebrate others instead. Now to talk about Drexel University, which I also love, am proud of, and am deeply grateful for my time there.
如我所说,我在德雷塞尔大学完成了学士、硕士和博士学位,专业是计算机科学和电气工程。我已经在很多场合提到过德雷塞尔大学,有趣的是,就在最近一期关于唐纳德·特朗普的播客节目的结尾部分,我回答了一个关于研究生院的问题,解释了我自己在德雷塞尔的经历,并表达了我对这段经历的感激之情。这期播客被数以百万计的人收听过。如果你感兴趣的话,可以去听听那期节目的结尾部分,或者观看相关的片段。在德雷塞尔大学,我遇到了许多杰出的研究人员和导师,从他们那里我学到了很多关于工程、科学和人生的知识。我在德雷塞尔的时光收获颇丰。
As I said, I went to Drexel for my bachelor's, master's, and doctor degrees in computer science and electrical engineering. I've talked about Drexel many times, including, as I mentioned, at the end of a recent podcast, the Donald Trump episode, funny enough, that was listened to by many millions of people, where I answered a question about graduate school and explained my own journey at Drexel and how grateful I am for it. If it's at all interesting to you, please go listen to the end of that episode or watch the related clip. At Drexel, I met and worked with many brilliant researchers and mentors from whom I've learned a lot about engineering, science, and life. There are many valuable things I gained from my time at Drexel.
首先,我修了很多非常难的数学和理论计算机科学课程。它们教会了我如何深入而严谨地思考,也教会了我如何努力工作,即使觉得自己太笨无法解决技术问题时也不放弃。其次,那段时间我编程很多,主要是用C和C++。我编写过机器人程序、优化算法、计算机视觉系统、无线网络协议、多模态机器学习系统,以及各种物理系统的仿真程序。正是在那个时候,我真正培养起了对编程的热爱,包括对Emacs和Kinesis键盘的喜爱。
First, I took a large number of very difficult math and theoretical computer science courses. They taught me how to think deeply and rigorously, and also how to work hard and not give up even if it feels like I'm too dumb to find a solution to a technical problem. Second, I programmed a lot during that time, mostly c, c plus plus. I programmed robots, optimization algorithms, computer vision systems, wireless network protocols, multimodal machine learning systems, and all kinds of simulations of physical systems. This is where I really develop a love for programming, including, yes, Emacs, and the Kinesis keyboard.
同时,那段时间我也读了很多书。我还弹了很多吉他,写了很多糟糕的诗歌,也在柔道和巴西柔术方面训练了很多,我对此充满感激。巴西柔术在我二十多岁时每天都在提醒我保持谦逊,直到今天,每当我有机会训练时,它依然如此。总之,我希望那些偶尔被网络上那些想要摧毁他人的群体裹挟的人,不要迷失其中。归根结底,我仍然相信人性中善多于恶,但我们都一样,每个人都是优点和缺点的混合体。
I also, during that time, read a lot. I played a lot of guitar, wrote a lot of crappy poetry, and trained a lot of in judo and jujitsu, which I cannot sing enough praises to. Jujitsu humbled me on a daily basis throughout my twenties, and it still does to this very day whenever I get a chance to train. Anyway, I hope that the folks who occasionally get swept up in the chanting online crowds that want to tear down others don't lose themselves in it too much. In the end, I still think there's more good than bad in people, But we're all, each of us, a mixed bag.
我知道我自己也有很多缺点。我说话不自然,有时候会说出愚蠢的话,我也会不理性地情绪化,该友善的时候却表现得过于刻薄。
I know I am very much flawed. I speak awkwardly. I sometimes say stupid shit. I can get irrationally emotional. I can be too much of a dick when I should be kind.
关于 Bayt 播客
Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。