Your Brain On - 你的大脑与...脑机接口 封面

你的大脑与...脑机接口

Your Brain On... Brain-Computer Interfaces

本集简介

恢复人类语言能力、让瘫痪者重获行动力、比以往更早检测神经退行性疾病——这些仅是脑机接口技术带来的部分突破。 本期节目将探索BCI(脑机接口)的奇妙世界:这项技术正为肌萎缩侧索硬化症等患者重新赋予自主权与独立性。 我们将探讨: • BCI如何通过解码脑信号帮助神经退行性疾病与脊髓损伤患者实现交流 • 脑机接口的实际工作原理(以及为何它们并非"读心术") • 为何运动皮层植入体即使置于非预期脑区仍可能解码语言 • 脑连接设备时代面临的隐私、数据所有权与使用权限等伦理挑战 • 该领域未来前景:从中风后语言功能重建到脑瘫儿童沟通辅助 节目特邀三位引领该神经科学前沿领域的顶尖学者与临床专家: • Leigh Hochberg博士 - 麻省总医院神经技术与神经康复中心主任,BrainGate神经接口系统试点临床试验首席研究员 • David Brandman博士 - 神经外科医生,加州大学戴维斯分校神经假体实验室联合主任 • Sergey Stavisky博士 - 神经工程师,加州大学戴维斯分校神经假体实验室联合主任 了解更多Braingate项目信息或申请参与研究:https://braingate.org/ 本期主题是...《脑机接口时代的大脑》 《你的大脑》系列由神经学家、科学家及公共卫生倡导者Ayesha与Dean Sherzai夫妇主持 《脑机接口时代的大脑》• 第五季 • 第3集 ——— 关注我们 Instagram: https://www.instagram.com/thebraindocs YouTube: https://www.youtube.com/thebraindocs 官网: https://thebraindocs.com/

双语字幕

仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。

Speaker 0

这个设备开着吗?

Is this thing on?

Speaker 0

这是一位名叫凯西·哈雷尔的男子在参与脑机接口试验时提出的问题。尽管ALS(肌萎缩侧索硬化症)让凯西失去了控制说话肌肉的能力,这项技术却让他重新获得了说话的能力。

That's what a man named Casey Harrell asked while participating in the trial of a brain computer interface which though ALS had caused Casey to lose control of the muscles used to speak allowed him to speak again.

Speaker 0

那是一个无比震撼的时刻,我们非常激动且荣幸能与实现这一突破的科学家、神经外科医生和神经工程师们讨论这个项目。

It was an incredibly powerful moment and we're so excited and honored to be discussing the project with the scientists neurosurgeons and neural engineers who made it happen.

Speaker 0

我们是艾莎医生和迪恩·谢尔扎伊医生,这里是《你的大脑与脑机接口》节目。

We're doctors Aisha and Dean Scherzai and this is your brain on brain computer interface.

Speaker 0

迪恩,这期节目太令人兴奋了,特别是在当今时代,我们正见证着这一领域的飞速发展。

Dean this is such an exciting episode especially because of how at this day and age we're seeing the advances that are happening in this area.

Speaker 0

作为一个《星际迷航》粉丝,我从小看着这部剧长大,是个十足的科幻迷,你也是。看到这些曾经只存在于故事和传说中的事物成为现实,并见证它对患者生活产生的改变,真是令人无比振奋,在很多方面都让人肃然起敬。

And as a Trekkie, I grew up watching Star Trek, and I'm a big sci fi fan, and you are as well, To see some of these things that were basically related to stories and myths coming to reality and seeing its impact on patients' lives is incredibly exciting and awe inspiring in many ways.

Speaker 1

确实如此。

It is.

Speaker 1

特别是作为神经科医生,我们经常在急诊室见到因事故导致瘫痪的患者——脊髓损伤或枕叶/眼部受伤使他们余生都无法行动或视物,或是中风后失去语言能力,又或是ALS患者逐渐丧失说话和行走能力。

Especially as neurologists we see patients who come to the emergency room who've had an accident and are paralyzed for the rest of their life because of a spinal cord injury or injury to their occipital lobe or eyes and they can't see or the fact that they had a stroke and they can't speak, or they have ALS and they slowly lose their ability to speak or walk.

Speaker 1

我们正站在医学革命的风口浪尖上,以前不能行走的人现在可以走了,不是可能,他们必将能够行走。

We are at the precipice of a remarkable revolution in medicine where people couldn't walk before could potentially walk, not potentially, they will be walking.

Speaker 1

是的,那些失去语言能力的人,我们现在看到的这个案例,非常令人振奋。

And those who had lost their capacity to speak, that one we're seeing now, it's very exciting.

Speaker 0

本期节目的两位嘉宾是神经外科医生。

Two of our guests for this episode are neurosurgeons Doctor.

Speaker 0

David Brandman和神经工程师。

David Brandman and neural engineer Doctor.

Speaker 0

Sergei Staviski。

Sergei Staviski.

Speaker 0

两位都是加州大学戴维斯分校神经假肢实验室的联合主任,该实验室开发了我们开场提到的技术。

Both are the co directors of the UC Davis neuroprosthetics lab, which developed the technology we mentioned in the intro.

Speaker 0

以下是他们近期视频中的一个片段。

Here's a snippet from one of their recent videos.

Speaker 2

这感觉非常像我。

It feels a lot like me.

Speaker 2

这让许久未听到我声音的人们落泪。

It makes people cry who have not heard me in a while.

Speaker 3

我认为这项技术已足够成熟,能真正让他融入社会并正常交流。

I think we're at a point where it does work well enough that it really lets him just be a part of society and to talk.

Speaker 2

我仍能全职从事气候行动工作,借助这个设备,我可以高效出色地完成工作。

I am able to still work full time for climate action, and I am able to do that well and efficiently with this device.

Speaker 2

我希望现在像我这样的人都能拥有这样的设备来辅助沟通,获得与我同等的机会。

I hope that we are at a time when everyone who is like me have the same opportunity as I do to have a device like this that will help them communicate.

Speaker 2

让我们一起实现这个目标,好吗?

Let's all make that happen okay.

Speaker 0

布兰德曼医生提到的一个有趣现象是,

One of the interesting things that Doctor.

Speaker 0

社会对脑机接口和这类医疗技术的认知仍深受科幻作品的影响。

Brandman mentioned was how society's perception about brain computer interface and this technology in medicine is still influenced by their perception of what sci fi is.

Speaker 0

我觉得很多事物都存在这种情况。

And I I think that's the case with a lot of things.

Speaker 0

通常新概念最初都是以故事和神话的形式出现,然后不知不觉间就成为了我们现实的一部分。

Usually newer concepts are introduced as stories and as myths and then suddenly before you know it they become a part of our reality.

Speaker 0

这确实会在人们心中引发某种忧虑和恐惧。

That does bring about some sense of apprehension and fear in people.

Speaker 1

确实如此。

It does.

Speaker 1

这很自然,尤其是在大众层面上,人们对新事物总会持怀疑态度。

That's natural especially at the population level for people to be incredulous and suspicious of new things.

Speaker 1

这几乎像是一种防御机制。

It's almost like a defense mechanism.

Speaker 1

从进化角度来说,我们更倾向于自我保护。

Evolutionarily we are more on the side of protecting ourselves.

Speaker 1

这就是为什么每当新事物出现时总会遇到阻力。

That's why anytime something new comes up there's resistance to it.

Speaker 1

抗生素问世时就曾遭到极大质疑。

When antibiotics came there was a huge suspicion.

Speaker 1

X射线问世时,人们对其用途和实际效用充满疑虑。

When x rays came there was a suspicion of what it was being used for and whether it was useful.

Speaker 1

其他成像技术和基因技术也是如此。

Same thing with other imaging techniques and genetics.

Speaker 1

你会听到各种关于基因技术的传言,很多与现实毫无关联,但人们对基因检测这类技术仍相当怀疑。

You hear all these stories about genetics, really things that don't even have any connection to reality, but people are quite suspicious of genetic testing and things of that nature.

Speaker 1

每个发展阶段都伴随着担忧和猜疑。

And every step has worries and suspicions.

Speaker 1

部分原因在于我们过去在向大众传播科学方面存在不足。

And part of it is that we have failed in the past, really translating science to the population.

Speaker 1

这正是问题所在。

That's where the failure has been.

Speaker 1

我们从科学角度将自己与大众割裂开来,突然推出新技术时却缺乏必要的背景铺垫。

We separate ourselves from a scientific perspective, from the population, and all of a sudden something is introduced without the necessary storylines that have to be built around something.

Speaker 1

而关于脑机接口的叙事,细想起来全是负面内容。

And the storylines around brain machine interface, if you think about it, it's all negative.

Speaker 1

《星球大战》,博克。

Star Wars, Bork.

Speaker 0

天啊。

Oh my gosh.

Speaker 0

那个

The

Speaker 1

半机械人?

cyborg?

Speaker 1

半机械人。

The cyborg.

Speaker 0

在电影里,通常都是被外部力量控制的那个反派角色。

In movies, it's usually that villain that is being controlled by an outside force.

Speaker 0

光是想到你的大脑被你自己以外的其他东西控制,以及整个隐私问题——这些信息如何可能直接公之于众,这本身就非常可怕。

And just the thought of your brain being controlled by something else other than you and the whole privacy issue of how things can actually just become available to public, that's also very scary too.

Speaker 0

你说得对。

And you're right.

Speaker 0

我认为我们在这方面对公众的解释工作做得不够好。

I don't think we've done a good job of explaining this to the public.

Speaker 0

这次对话的整个目的就是向大家——我们可爱的听众们——介绍这个概念和技术,让他们了解所有这些正在进行的精彩工作。

The whole purpose of this conversation is to introduce this concept and this technology to everyone, our lovely listeners, and for them to be aware of all this fantastic work that is being done.

Speaker 0

是的。

Yes.

Speaker 0

这可能听起来令人不适且新奇,大脑中植入东西的整个想法听起来很具有侵入性。

It may sound uncomfortable and new, and the whole idea of something inside your brain sounds intrusive.

Speaker 0

但当你看到结果,看到它如何影响人们的生活时,我认为这部分可能是最具人性化的事情了。

But when you look at the outcome and when you look at how it impacts people's lives, I think that part of it is probably one of the most human thing ever.

Speaker 0

我们正在提升人的尊严、尊重、生活质量,以及他们成为想成为之人的能力。

We're augmenting human dignity and respect and their quality of life and their capacity to be who they want to be.

Speaker 0

绝对美妙。

Absolutely beautiful.

Speaker 0

我觉得这极其美好且充满希望,对于我们的演讲者即将深入探讨这个话题,我感到非常兴奋。

I find that incredibly beautiful and hopeful, and I'm so excited for our speakers to actually dive into this.

Speaker 1

虽然我们的工作重点一直放在预防上,但这项技术不仅能让我们实现预防,还能进行检测和早期发现。

Though much of our work has been focused on prevention, this technology gives us access not just to prevention, but also detection and early detection.

Speaker 1

这至关重要,因为它能每分钟、每秒实时监测,因为它与你的身体相连。

And that's critical because it can do that minute by minute, second by second as it's connected to your body.

Speaker 1

这有点吓人,但也令人难以置信地充满力量。

That's a little scary, but it's also incredibly empowering.

Speaker 1

借助这些新工具,我们检测疾病的能力呈指数级提升。

Our capacity to detect disease moves exponentially with these new tools.

Speaker 1

现在我们必须谨慎,但类似的担忧我们以前也有过。

Now we must be cautious, but we've had these fears before.

Speaker 1

在19世纪,我们发明了听诊器。

In the eighteen hundred's, we found stethoscope.

Speaker 1

人类首次能够听到他人的心肺声音。

For the first time, could hear people's hearts and lungs.

Speaker 1

当时人们认为这是种魔法,是邪恶的,并为此感到担忧。

And it was thought that this was a magical thing and it was evil and people were worried about it.

Speaker 1

在二十世纪初,我们发现了X光,能够真正透视人体内部,看到骨骼和组织。

And in the early nineteen hundred's, we discovered x-ray, where you could actually go inside of a person's body and see their bones and tissue.

Speaker 1

到了七十年代,我们又有了CT和MRI技术。

And in nineteen seventy's, we detected CTs and MRIs.

Speaker 1

现在我们可以看清人体内部的一切。

Now you could see everything inside somebody's body.

Speaker 1

这本身就令人畏惧。

That's scary in itself.

Speaker 1

接着我们迎来了基因组学和蛋白质组学,让我们能够真正了解构成我们的基本物质和编码方式。

And then we got genomics and proteomics where we can actually know the very fiber, the very substance of what we are made of and how we are coded.

Speaker 1

这简直不可思议。

That's incredible.

Speaker 1

这是下一步发展。

This is the next step.

Speaker 1

一步。

Step.

Speaker 1

如今我们有了可穿戴设备,能告诉你睡眠质量、深度睡眠时长、行走步数、呼吸模式,甚至压力模式。

And now we have wearables that can tell you how you slept, the depth of your sleep, how much you walked, your breathing patterns, even your stress patterns.

Speaker 1

这些都是非凡的工具。

These are remarkable tools.

Speaker 1

这款设备将技术提升到新高度,因为它能直接与你的身体连接。

This one takes it to the next level because it connects directly to your body.

Speaker 1

对于那些功能缺失的人,它能帮助他们恢复功能。

And for those that don't have a function, it gives them that function back.

Speaker 1

疾病的早期检测将变得无处不在。

Early detection of disease becomes ubiquitous.

Speaker 1

它将始终存在,这非常强大。

It becomes ever present and that's powerful.

Speaker 0

为了进一步探讨脑机接口的过去与未来,我们很荣幸邀请到首位嘉宾神经学家。

To talk more about the past and future of brain computer interface, we're excited to welcome the first guest neurologist, Doctor.

Speaker 0

李·霍克伯格博士。

Lee Hochberg.

Speaker 0

医生。

Doctor.

Speaker 0

霍赫伯格是麻省总医院神经技术与神经康复中心的主任,这听起来非常棒,同时也是BrainGate神经接口系统试点临床试验的首席临床研究员。

Hochberg is the director of the Center for Neurotechnology and Neurorecovery that sounds awesome at Massachusetts General Hospital and principal clinical investigator of the pilot clinical trial of the BrainGate neural interface system.

Speaker 0

医生。

Doctor.

Speaker 0

霍赫维克花费了超过二十年时间,致力于为严重瘫痪患者(如ALS或脊髓损伤患者)恢复沟通和行动能力的研究。

Hogwerk has spent over two decades working on ways to restore communication and mobility for individuals with severe paralysis such as those affected by ALS or spinal cord injuries.

Speaker 0

他的见解不仅涉及脑机接口背后的技术。

His insights don't just address the technology behind brain computer interface.

Speaker 0

他还以对临床实施和人类自主权的深刻尊重来探讨伦理问题。

He also discusses the ethics with a profound respect for clinical implementation and human autonomy.

Speaker 0

以下是他的谈话内容。

Here's his conversation.

Speaker 4

我对神经科学和医学的兴趣始于很久以前,但对脑机接口这一领域产生兴趣,是在我申请医学博士项目时,当我从布朗大学毕业时,遇到了一些思考该领域现状的杰出人物。

My interest in neuroscience and medicine started long ago, but the interest in what developed to be this field of brain computer interfaces was really, as I was looking around at MD PhD programs, as I was graduating from Brown got to me some incredible people who were thinking about what the state of the field was at that point.

Speaker 4

许多人没有意识到的是,美国国立卫生研究院自60年代末70年代初就设立了神经控制实验室和神经假体项目。

And what many people don't realize is that the NIH has had a laboratory of neural control and a neural prosthesis program dating back to the late 60s and early 70s.

Speaker 4

早在70年代就有一些重要的早期论文和会议,当时人们就公开预言未来瘫痪患者可能重获肢体控制能力——因为我们能从大脑记录运动意图信号,例如跨越颈髓损伤的断连处重新连接这些信号,进而刺激肢体恢复运动功能。

And there's some great early papers and some really important conferences that date back certainly to the 70s, where people were saying out loud about our future where somebody with paralysis might regain the ability to control their limbs, because we'd be able to record their intent to move from the brain and reconnect those signals, for example, across a disconnection across a cervical spinal cord injury, and then stimulate limb and re enable movement.

Speaker 4

因此在这种背景下,当我正在规划自己的专业发展方向时,埃默里大学有位生理学教授表示,他确信并成功获得了NIH首批专注于神经假体项目的合约之一。

So in that context, as I was trying to figure out where my training was going to continue, there was a professor of physiology at Emory, who said that he believed he was about and he did to receive one of the first NIH contracts that was focused on this neural prosthesis program.

Speaker 4

他提出要解答这个问题:如果我们从大脑多个位点进行记录,能否实时解析这些神经活动不仅用于控制肢体运动,还能仅凭神经活动预测肢体运动轨迹。

And he said he wanted to answer the question, if we were recording from a handful of places in the brain, would we be able to understand in real time how that neural activity was being used not only to move the limb, but could we then predict what the movement of the limb was from just the neural activity alone.

Speaker 4

我至今记得坐在他办公室的情景——他名叫唐·汉弗莱——当他提出要利用神经活动来控制机械臂时,

And I remember sitting in his office, his name was Don Humphrey, as he said this, and I and he said he was gonna use the neural activity in order to control a robot arm.

Speaker 4

我的第一反应是:什么?

And I remember what my response was, which was what?

Speaker 4

你能再说一遍吗?

Can you say that again?

Speaker 4

那一刻我清晰地意识到:只要我们对系统神经科学有足够认知,只要技术发展到能长期稳定记录大脑活动——当然是指单神经元集群层面的记录——这种可能性就真实存在。

And it was quite clear from that moment that there was a possibility that if we understood enough systems neuroscience, if the technology was developed well enough to be able to record chronically from the brain, we could record at the level of ensembles of single neurons, certainly.

Speaker 4

如果我们能安全地实现这一点,并且这些记录能长期持续,还能实时解码这些活动,那么通过这类设备恢复丧失的神经功能这一希望确实可能成真。

And if we could do that safely, and those recordings lasted for a long period of time, and we could decode that activity in real time that this this hope that we'd be able to restore lost neurologic function with these devices could indeed come true.

Speaker 1

这是个美好的起点,因为你知道,正是好奇心和我们对下一个前沿的兴奋感推动着人类不断前进。

That's a beautiful place to start because, you know, curiosity and us getting excited about the next horizon is what's keeping humanity moving forward.

Speaker 1

而我们总是站在那个前沿的边缘,但那大概是什么时候的事?

And we're always at the edge of that horizon, but that was what year was that roughly?

Speaker 4

1990年。

1990.

Speaker 1

1990年。

1990.

Speaker 4

这些对话就发生在那个时候。

That was when these conversations were happening.

Speaker 4

我部分时间担任神经重症监护医生,在神经重症监护室工作。

So I spent some of my time as a neurocritical care doc, I work in the neuro ICU.

Speaker 4

所以我见到的人们两天前还能自如活动、流畅说话,但昨天或今天早些时候突然遭遇了变故。

And so I see people who were able to move and were able to speak quite well two days ago, but yesterday, or earlier today, something happened.

Speaker 4

脊髓损伤或脑干中风会导致患者陷入闭锁状态——清醒且警觉,却无法行动和言语,只能感知发生在自己身上及周围的一切,或许仅剩些许眼球运动能力作为唯一表达方式。

So spinal cord injury or a brainstem stroke that left that person locked in awake and alert, unable to move, unable to speak, but aware of everything that's happened to them and around them, except for perhaps some ability to move their eyes may be the only efforts.

Speaker 4

我接触的肌萎缩侧索硬化症患者正逐渐丧失行动和语言能力。

I meet people with ALS who are slowly losing the ability to move and the ability to speak.

Speaker 4

这个领域的研究重点(这很合理)一直致力于恢复这些患者更便捷的沟通能力和行动能力。

And a lot of the focus in this field, think rightly so, has been on trying to get to the point that we can restore any of those people's ability to communicate more easily and to move more easily.

Speaker 4

我们的大脑步态研究已持续二十年。

Our brain gait studies have been going on now for twenty years.

Speaker 4

这是一项关于植入式脑机接口的多中心研究。

It's a multisite study of a implanted brain computer interface.

Speaker 4

在我们的研究及其他项目中,那些因ALS导致严重构音障碍的患者,通过植入不同类型的大脑记录传感器,我们得以解码与目标词汇相关的神经活动。

For our research and others, there are people who are profoundly dysarthric from ALS, who have different types of recording sensors placed in the brain, we're able to decode the neural activity associated with the intended words.

Speaker 4

尽管由于严重构音障碍,患者实际发出的语音可能难以辨识,但神经活动可被解码——音素能被检测,词汇可被识别,最终通过计算机语音合成技术实现有声输出。

And even though those words when they're spoken may not be audibly intelligible because of the profound dysarthria, that neural activity can be decoded, the phonemes can be detected, the words can be recognized, and then through computer generated speech, those words can be heard aloud.

Speaker 4

这是该领域近期取得的重要突破之一。

So that's one recent achievement for the field.

Speaker 4

回顾过去二十年,已有案例显示无法移动手臂或手的患者仅通过想象自己手的动作就能控制电脑屏幕上的光标。

If we go back over the past twenty years, there have been examples of people unable to move their arms or hands who are controlling cursors on a computer screen just by thinking about the movement of their own hand.

Speaker 4

也有针对颈髓损伤患者的演示,他们通过想象自己手的开合动作来实现控制。

There have been demonstrations of people also with cervical spinal cord injury, thinking about opening and closing their own hand.

Speaker 4

他们之所以能做到这一点,不仅因为我们能检测到其运动意图,还因为能够通过刺激肌肉或周围神经来重新激活瘫痪的肢体。

And they're able to do so because not only can we detect the intended movement, but it's been possible to stimulate the muscles or peripheral nerves to reanimate that paralyzed limb.

Speaker 4

该领域已有许多这样的示范案例,我认为这些确实推动了科学进步。

There's a number of these demonstrations in the field that I think have really been pushing the science forward.

Speaker 1

就您个人研究而言,目前主要聚焦在哪些方面?

And in your case, your own particular research, where are you focusing on at this point?

Speaker 1

是否有特别有趣的案例想与听众分享?

And are there any specific cases that are interesting that you would like to share with the audience?

Speaker 4

是的,我们正在进行BrainGate临床试验——此刻我正坐在波士顿麻省总医院,这里是该试验的协调中心。

Yeah, so our brain gate clinical trials, I'm sitting at the moment at Mass General Hospital in Boston, which is the coordinating center for these trials.

Speaker 4

我们与布朗大学、普罗维登斯退伍军人医疗中心、加州大学戴维斯分校、斯坦福大学和埃默里大学共同组成了BrainGate研究联盟。

Together with Brown University, the VA Health Center in Providence, University of California, Davis, Stanford and Emory, that's our BrainGate consortium.

Speaker 4

我们正在进行这项临床试验,让居家患者使用实验性的BrainGate设备,他们要么尝试说话让我们解码其语音意图,要么尝试移动双手来控制平板电脑、机械臂或其他有助于日常生活的设备。

We're all engaged in this ongoing clinical trial where people who are at home have this investigational BrainGate device, and they're either attempting to speak while we decode their attempted speech or attempting to move their hands in order to gain control over either tablet computers or robot arms or other devices that might be helpful in their own daily lives.

Speaker 4

我们最近发表在《新英格兰医学杂志》上的一篇论文,来自加州大学戴维斯分校的优秀团队,报道了一位四十多岁的ALS患者,他患有严重的构音障碍。

One of our most recent papers, which was in the New England Journal last year, from great brain gay teams out at the University of California Davis was reporting a gentleman in his forties with ALS who was truly profoundly dysarthric.

Speaker 4

实际上只有他的妻子和护理伙伴能听懂他发出的模糊语音。

Only his wife and his care partner are really the only two people who hearing his audible speech can interpret it.

Speaker 4

说实话,当我听到他说话时无法理解,研究团队也同样听不懂。

Certainly, I couldn't when I heard him and research team unable as well.

Speaker 4

当然,其他任何想与他交流的人也都无法真正明白那些话语。

And certainly anybody else that might want to interact with him wouldn't really understand those words.

Speaker 4

但他希望推动这项技术发展。

But he wanted to help to push this technology forward.

Speaker 4

于是他参加了BrainGate试验,在其语言优势侧的中央前回运动皮层植入了电极阵列,这样不仅能记录单个神经元活动,还能捕捉到他试图说话时的神经元集群信号。

And he enrolled in the brain gate trial, he had arrays of electrodes placed into the motor cortex on his language dominant side that is placed into the dominant precentral gyrus, which allows for the recordings of not only single neurons, but ensembles of neurons associated with his attempt to speak.

Speaker 4

在植入这些设备约三周后,我们进行了首次计划中的记录会话。

After placing these devices, about three weeks later was the first planned recording session.

Speaker 4

他被要求读出屏幕上显示的词语。

He was presented and was asked to say some words that were presented on the screen.

Speaker 4

这就是我们训练解码器或过滤器的方式,让它能够理解神经活动,并将这些神经活动转化回语言。

That's how we train the decoder or train the filter that understands the neural activity, if you will, and then translate that neural activity back into words.

Speaker 4

经过约半小时的训练后,他被要求说出我们显示在屏幕上的短语。

And after about half an hour of training that computer program, he was asked to say some phrases that we had put on the screen.

Speaker 4

他从约50个词的词汇库中选择词语尝试发音,这些词语随即在屏幕上显示。

Selecting from a vocabulary of about 50 words, he would attempt to say them and those words appeared on the screen.

Speaker 4

这些词语通过非标准计算机合成语音呈现,而是使用了他ALS发病前的声音样本合成的深度仿造语音,这样听起来更像他本人。

And then they were made audible through a not necessarily standard computer generated speech, but through what's equivalently a deepfake for good, a version of his own voice pre onset of ALS that had been programmed so it would sound more like him.

Speaker 4

你甚至能听到他声音中蕴含的情感。

And you could hear some of the emotion in his own voice.

Speaker 4

据在场研究团队转述,当第一天系统成功运行时,所有人都因情绪激动不得不暂停工作。

And as the research team who was there relayed, everybody had to stop because of everybody's emotion when it worked on day one.

Speaker 1

太不可思议了。

Amazing.

Speaker 1

太神奇了。

Amazing.

Speaker 4

而且,这已经足够震撼地展示了这类技术的能力。

And and that was striking enough in terms of a demonstration of what these types of technologies could do.

Speaker 4

但仅有50个词汇量时,能表达的内容非常有限。

But with only a 50 word vocabulary, there's only so much that can be communicated.

Speaker 4

他第二天休息了一天。

He got the next day off.

Speaker 4

团队可没休息。

The team did not.

Speaker 4

团队在周六加班加点,到了使用该设备的第二天大家又回来了。

The team worked hard over the Saturday, and then people came back on what was day two of using the device.

Speaker 4

他获得或提供的词汇量扩展到了12.5万个单词,基本上涵盖了英语词典中除部分专有名词外的所有词汇。

He was presented with or he provided was with a 125,000 word vocabulary that he could select from, which is basically nearly all of the words except for perhaps some proper nouns in the English dictionary.

Speaker 4

然后研究人员就让他随心所欲地说任何想说的话。

Then he was just asked to say whatever he wanted to say.

Speaker 4

他说的第一句话是:这东西开着吗?

And the first thing he said was, is this thing on?

Speaker 4

这句话不仅反映了技术确实在运作,还展现了他绝妙的幽默感。

Which kind of reflected not only the fact that indeed the technology was working, but his great sense of humor.

Speaker 1

哦,天哪。

Oh my goodness.

Speaker 1

太神奇了。

Amazing.

Speaker 1

我有个问题。

I have a question.

Speaker 1

这个设备,当你说他被要求说的时候,是指口头说出来,还是反映他应该想的内容?

This device, when you're saying he was asked to say, was it verbal say or was he was that reflective of what he was supposed to think?

Speaker 1

我们知道机器在读取他的想法,但他是否也被要求实际说出那些话?

We know that the machine is reading what he's thinking, but he was he also asked to physically say that those words?

Speaker 4

所以我不认为机器是在读取他的想法。

So I wouldn't say that the machine was reading what he was thinking.

Speaker 4

实际上,我不会这么描述它。

Actually, that's not how I would describe it.

Speaker 4

我们是从中央前回进行记录的。

We're recording from the precentral gyrus.

Speaker 4

通俗地说,我们记录的是运动皮层,目标是仅解码尝试性言语。

Very generically, we're recording from motor cortex, and the goal is to only be decoding attempted speech.

Speaker 4

所以我们无法知道他当时在想什么。

So we couldn't know what he was thinking about.

Speaker 4

这是当前技术尚无法感知或解码的内容。

It's not something that the technology is capable of perceiving today or decoding.

Speaker 4

但我们的目标是解码他实际尝试说出的言语。

But our goal is to decode his actual attempted speech.

Speaker 4

就他的情况而言,至少在早期阶段,这是他真实的说话尝试,通过他构音障碍的声音可以听到。

And in his case, at least early on, it was his genuine attempt to speak, which is heard audibly through his dysarthric voice.

Speaker 4

尽管如此,不仅在他尝试说话时有效,当他不尝试发声但仍有意向输出时也同样有效。

With that, though, not only does it work when he's attempting to speak, it also works when he's not attempting to vocalize, but he is still intending that output.

Speaker 4

所以要准确描述这一点确实有点棘手,但即便是身体健全的人,也可以想象试图说些什么而不动嘴、不动舌头、不动声带。

So it gets a little bit tricky to describe this as well as we can, but even somebody who's able-bodied can think about attempting to say something without moving their mouth, without moving their tongue, without moving their vocal cords.

Speaker 4

正是这种意图,这种动作可以被解码成屏幕上的文字。

And it's that intention, that action can be decoded into words on a screen.

Speaker 1

太神奇了。

Amazing.

Speaker 1

从尝试到解释或翻译是否存在延迟时间?

Is there a lag time between that attempt and the interpretation or translation thereof?

Speaker 4

由于他在参与研究前约四年被诊断出患有ALS(肌萎缩侧索硬化症),并且正如言语病理学家常做的那样,他们曾指导他放慢语速以便他人能理解他的话。

So because he had been diagnosed with ALS about four years before joining the study, and as speech and language pathologists often do, they had instructed him to slow his speech down so that others might be able to understand what he's saying.

Speaker 4

因此,由于这种训练和ALS本身的影响,他尝试性言语的速度约为每分钟30个单词——这大概是他能完整说出一句话的最快速度——我们以这个语速成功解码了他的尝试性言语,文字会逐个出现在屏幕上。

So as a result of that, and as a result of ALS itself, his attempted speech at pace was about 30 words per minute, that was probably about as fast as he could have attempted to just speak a sentence, for example, it was roughly at that 30 words per minute that we were able to decode his attempted speech, the words would appear on the screen one word at a time.

Speaker 4

需要强调的是,这些文字之所以能出现,是因为首先检测到音素,然后通过统计预测这些音素更可能代表某个特定单词。

It is important to note that the words themselves appear because first phonemes are detected, and then those phonemes are assumed to be or predicted to be more statistically accurately representative of a particular word.

Speaker 4

就像健全人打字或用笔记本电脑时看到的文字修正那样,当一连串单词组合后,系统会通过AI方式确保句子完全正确,而不仅仅是接近正确。

And then after a stream of words are put together, much like somebody who's able-bodied, whether they're texting or using their laptop might see word correction appear or might see an AI approach to getting that sentence actually right, as opposed to almost right.

Speaker 4

这增加了一点额外的延迟。

That adds a little additional lag.

Speaker 4

因此即使屏幕上每次出现最可能的单词,在结合上下文考虑后,这些单词中的一个很常见会被替换为第二可能的单词。

So that even if the most likely word one at a time appeared on screen, it's quite common that one of those words might have been replaced to the second most likely word after the rest of the sentences considered in context.

Speaker 4

我们一直使用至今已有二十年的设备,这个设备是三十年前为基础科学研究开发的,我试着把它举到我的太阳穴附近,我会把它靠近摄像头,我们看看效果如何。

The device that we've been using and have now been using for twenty years, and it was a device that was developed for basic science research thirty years ago, I'm going try to hold this up against my picky, and I'll bring it close to the camera, and we'll see how well this works.

Speaker 4

这是一个4×4毫米的平台。

That is a four by four millimeter platform.

Speaker 4

如果你眯起眼睛看,而且我刚好把它对焦清楚,这个4×4毫米的平台上分布着100个电极。

If you squint your eyes, and I happen to get it in focus, there are 100 electrodes on that four by four millimeter platform.

Speaker 4

每个电极长度1.5毫米,可以放置在大脑表面并接入大脑,让我们能够探测到大脑皮层的浅表层,大概到三五边界区域。

They're each 1.5 millimeters in length, and it can be placed on top of the brain and tapped into the brain, allowing us to get to the superficial layers of cortex, maybe to the three five border.

Speaker 4

每个电极都有可能记录到一两个单独的神经元活动,虽然并非所有电极都能记录到神经元信号,有些会记录到一两个。

And each of those electrodes has the potential to be able to record from one maybe two individual neurons, not all of them will necessarily record from a neuron, some will record one or two.

Speaker 4

它还能记录多个神经元在电极尖端附近的综合活动,并能记录一些局部场电位——这些是能从大脑内部记录到的更类似模拟信号的活动。

It also can record the sum activity from multiple neurons near any of those electrode tips, and can record some of the local field potentials, the more analog activity that can be recorded from inside the brain.

Speaker 4

我刚才展示的那个设备叫做犹他电极阵列。

That device that I showed you is called the Utah Array.

Speaker 4

它是由犹他大学的迪克·诺曼在三十多年前开发的。

It was developed by Dick Norman at the University of Utah back thirty plus years ago now.

Speaker 4

至今仍被用于我们的脑门研究项目。

It continues to be used in our brain gate research.

Speaker 1

太神奇了。

Amazing.

Speaker 1

你认为这个领域未来几年会如何发展?特别是随着人工智能、机器学习以及所有这些增强元素的加入?

Where do you see this field moving in the next few years, especially with the addition of AI and machine learning and all these augmented elements?

Speaker 1

你觉得未来两三年内这个领域会走向何方?

Where do you see it going in the next couple of years?

Speaker 4

是的,这个领域最初是从解码部分开始的,计算神经科学这部分真正起源于我们对单个神经元与意向运动关系的基础理解——具体来说,就是布罗德曼第五层初级运动皮层的皮质运动神经元,我们知道这个细胞很可能与脊髓运动神经元相连。

Yeah, so the field started with the decoding part of the field, the computational neuroscience part of this field really started with our fundamental understanding of how individual neurons are related to intended movement, that is an individual neuron, a corticomotor neuronal cell in layer five of Brodmann for primary motor cortex, we know that cell is likely connected to a motor neuron spinal cord.

Speaker 4

因此当那个神经元放电时,它实际上与肌肉活动——或者多块肌肉的活动相关。

And so when that neuron fires, it is really related to a muscle activity, or maybe the activity of a muscles.

Speaker 4

过去五年里,机器学习和人工智能的快速引入、普及及其强大能力,使我们不再需要假设神经活动的具体作用,而是可以采取假设无关的方式,直接将神经活动与其目标相匹配,并创建解码方法——这确实推动了整个领域向前发展。

The past five years, the rapid entrance and availability and the power of machine learning of AI to not necessarily have a hypothesis for what that neural activity is doing, but to be hypothesis agnostic, and to match the activity with its goal, and then to create the decoding approach that's really moved the field forward.

Speaker 4

这也是我们在过去几年中看到某些技术进步的部分原因。

And it's part of the reason for some of the advances we've seen in just the past few years.

Speaker 4

我认为只需短短几年时间,市场上就会出现用于交流或行动功能的植入式脑机接口设备。

I think it's just a handful of years before we actually have devices available on the market that are implanted BCIs for communication or mobility.

Speaker 4

需要说明的是,目前已有用于癫痫治疗的响应性神经刺激技术,这完全可以被视为一种植入式脑机接口。

I should say that there are already something that would quite reasonably be considered an implanted BCI in responsive neural stimulation for epilepsy.

Speaker 4

这些设备记录神经活动,目的是检测癫痫发作,如果检测到临床前期的癫痫发作,就会进行刺激以抑制发作,防止其发展为临床发作。这至少初步构成了一个脑机接口。

Those devices record neural activity, the goal is to detect seizure, and if detected, if detecting a preclinical seizure, then to stimulate and to suppress that seizure before it becomes clinically That, at least at a first pass, is a BCI.

Speaker 4

它记录神经活动,解读信息,并利用这些信息做出有益的行动。

It records neural activity, it interprets the information, and it does something useful with it.

Speaker 1

这真是太棒了。

That's wonderful.

Speaker 1

在这个领域中,你们需要应对哪些伦理问题?

What are the ethical issues that you deal with in this realm?

Speaker 1

这涉及到自主权问题、隐私问题以及长期护理问题。

There's questions of autonomy, there's questions of privacy, long term care.

Speaker 1

当有人说他们是在没有受到任何胁迫的情况下自主做出决定时,考虑到他们所处的环境,实际情况并不像人们想象的那么明确。

And when somebody says that they're making a decision on their own and without any coercion, that's not as clear cut as people think it is, given the situations they're in.

Speaker 1

我很想了解您认为在这个领域及其发展过程中,我们需要应对哪些伦理问题。

I would love to know what you think are the ethical issues that we need to deal with this field and where it's going.

Speaker 4

是的,确实存在几个非常重要的伦理问题。

Yeah, there are several and they're really important.

Speaker 4

在我们自己的脑机接口研究中,自二十年前启动试验以来,我们就一直在深入思考这些问题。

And in our own brain gate research, we've been thinking about these deeply since we launched the trial twenty years ago.

Speaker 4

其中一个问题是我们在进行大脑记录。

One of them is we're recording from the brain.

Speaker 4

这就是植入式脑机接口的起点。

That's that's where the implantable BCI starts.

Speaker 4

而且我们记录的信息也涉及隐私。

And there's information that we're recording.

Speaker 4

我主张我们记录的信息归属于被记录者,你的大脑数据属于你自己。

And I would propose that information that we're recording belongs to the person from whom we're recording, that your brain data are yours.

Speaker 4

这看似简单——为了使其有用,我们进行的记录需要被解码并以某种实用方式反馈,无论是控制电脑屏幕上的光标、操控肢体,还是重建语音。

It seems like a simple thing to say those data in order to be useful, the recording that's being made is being made so that it can then be decoded and returned in some useful way, whether it's for control of a cursor on a computer screen or control over to somebody's own limb, or recreated speech.

Speaker 4

我和许多人都非常认同:这些神经数据只能在数据生成者许可的情况下与他人共享。

I and I think many are very comfortable with the fact that those neural data should only be shared with anybody else with permission of the person who generated the neural data in the first place.

Speaker 4

如果我们沿着这个思路,设想一个完全通过审批的市场化设备正在被使用,这些神经数据的所有权归谁?

If we head down the line and we think about a fully cleared marketed device that somebody is using, who is the owner of those neural data?

Speaker 4

是个人吗?

Is it the person?

Speaker 4

是临床医生吗?

Is it the clinician?

Speaker 4

是公司吗?

Is it the company?

Speaker 4

我们记录的数据内容究竟是什么?

What is the content of the data that we're recording?

Speaker 4

当我在记录时,当我们的团队在记录一个意图手部动作时?

When I'm recording, when our team is recording an intended hand movement?

Speaker 4

这正是我们在此的目的——试图让某人能够解码或控制电脑屏幕上的光标,举例来说。

That's the reason that we're there is to try to allow somebody to decode or somebody to control a cursor on a computer screen, for example.

Speaker 4

但毫无疑问,这些神经活动中还蕴含着其他信息,比如他们当时的警觉程度,这些似乎也应包含在我们记录的神经活动中。而要就这些设备可能记录的内容提供充分知情同意,确实颇具挑战。

But there's undoubtedly other information in that neural activity could be reflecting, for example, their level of alertness at that moment seems like that should be somewhere in the neural activity that we're recording, providing the best informed consent that we can about what these devices may be recording is challenging.

Speaker 4

我们尽力分享这些信息,也坦诚认知的局限,但我认为这引发了一些伦理问题。

We share this information as best we can, we share the limits of our knowledge, but I think that raises some ethical questions.

Speaker 4

还有一点,获取这些技术的途径至关重要。

There are others, the access to these technologies is incredibly important.

Speaker 4

这与任何其他先进医疗技术并无二致。

This is not different than any other advanced medical technology.

Speaker 4

但我真心希望这些技术能广泛惠及所有可能从中受益的人群。

But these technologies, I really hope are going to be widely accessible to anybody who would benefit from them.

Speaker 4

作为由医生、科学家、瘫痪亲历者、监管者和费用支付方组成的共同体,我们必须共同解决如何让这些技术真正普及,并确保其持续发展以推出第二代产品。

As a community of physicians and scientists and people with lived experience of paralysis and regulators and people responsible for reimbursement, I think as a community, we really have to figure out how will these technologies actually get out there and get out there widely and be available in a manner that allows the technology to continue to develop so that version two can be created.

Speaker 4

我认为不仅需要开展这些对话,更重要的是让这些对话能够影响设备研发过程中的一些决策。

I think it's important not only have these conversations, but to allow these conversations inform some of the decisions that are made during the device development.

Speaker 4

对于植入式脑机接口,我们理论上可以使用各种植入式硬件加密技术来确保数据传输的绝对安全,但这需要消耗电力。

For an implanted brain computer interface, we could potentially use all kinds of implanted hardware encryption to be absolutely sure that the data that are transmitted securely, that takes power.

Speaker 4

这些芯片需要配备电池,它们需要某种形式的电源支持。

Those chips require a battery, they require power of some sort.

Speaker 4

目前可用的电力预算相当有限。

There's a pretty limited power budget.

Speaker 4

高性能芯片也会发热。

Chips that are powerful also become hot.

Speaker 4

而我们不希望植入设备产生热量。

And we don't like heat in implanted devices.

Speaker 4

事实上,对于植入或靠近神经系统的设备,其周围产生的热量有非常严格的限制。

In fact, there's a very strict limit to how much heat can be generated around a device that's placed in our near the nervous system.

Speaker 4

但如果传输这些数据的目的只是在一米范围内传送,且超过一米就无法接收,而且传输的数据只是用户控制电脑发送推文的指令,那么从一开始就没有加密的必要。

But if the goal of transmitting those data was only to transmit it a meter away anyway, and nothing beyond a meter could pick it up, and the data that are being transmitted are again, somebody's requests for controlling the computer so they can send out a tweet, there was no reason to encrypt it in the first place.

Speaker 4

因此需要在技术能为人们带来的益处与强加的安全需求之间找到平衡

So there's a balance between the benefit that technology could provide somebody, which may be somewhat tempered by the security requirements that are imposed

Speaker 1

on

Speaker 4

它上面。

it.

Speaker 1

完全同意。

Absolutely.

Speaker 1

你认为五十年后我们会发展到什么程度?

Where do you see us in fifty years?

Speaker 1

说实话,在我看来,以目前的发展速度,五十年都太长了。

Or to be honest, fifty years is too long at the rate things are moving from my perspective.

Speaker 1

那么在二十到二十五年内,你认为瘫痪患者中会有相当大比例的人能够重新行走吗?特别是借助人工智能、增强数据、实时数据处理和实施技术?

And twenty to twenty five years, do you see that people who have paralysis, a great number of them would be able to walk, especially with AI and augmented data, real time data processing and implementation?

Speaker 4

既然你好心地给了我五十年的时间跨度,这很棒。

Since you were kind enough to give me a fifty year runway, which is great.

Speaker 4

我认为你刚才提到的许多目标在那个时间段内完全有可能实现,仅看过去五年发生的变化就可见一斑。

I think a lot of the things that you just said are well within reach in that period of time, just seeing what's happened over the past five years.

Speaker 4

你描述的下肢运动功能恢复方面,我们已经看到一些成功案例——通过相对简单的脊髓刺激技术帮助患者恢复基础下肢运动。若结合皮层或其他脑部信号记录来驱动脊髓刺激,还能进一步改善功能,实现更复杂的下肢活动,比如调节步态节奏。不过躯干稳定性等需求可能超出了脑机接口的必要范畴。

Some of what you described lower extremity mobility, we've seen some nice examples of some pretty straightforward spinal cord stimulation being used to re enable some lower extremity movement that may be further improved by using cortical or other cerebral recording in order to drive some of that spinal stimulation to allow for even more complex lower extremity activity to change the pace of walking or there's a lot of trunk stability that is required that's outside necessarily the realm of a brain computer interface.

Speaker 4

随着神经调控和神经记录技术各自的发展,我认为皮层内微刺激技术的进步将带来某种形式的视力改善。

As these neuromodulation and neural recording technologies independently advance, I think we'll see some improvements in intracortical microstimulation leading to some version of improved vision.

Speaker 4

在更短的时间内,我希望我们能向渐冻症患者承诺:他们永远不会丧失沟通能力。

With a much shorter runway, what I hope is that we're gonna be able to tell somebody with ALS that they will never lose the ability to communicate.

Speaker 4

毫无疑问,我们需要神经学界的全力参与。

What's required is without a doubt, we need the engagement of the neurology community.

Speaker 4

今天能与您合作令我倍感振奋,但我们需要更多神经科医生加入。

I'm thrilled to be joining you today, but we need more neurologists.

Speaker 4

希望在您的倡导和平台支持下,我们能达成这个目标。

And hopefully, with your advocacy and platform, we can get there.

Speaker 4

我认为神经科医生最有能力判断哪些姑息性设备最适合诊所里的具体患者,或是推荐两三种方案,而不必考虑第四第五种选择。

I think neurologists are well positioned to understand of the hopefully palliative devices that will be available, which ones are most likely to benefit any individual patient in their clinic, or to make recommendations to consider two or three of them, but not necessarily the fourth or fifth.

Speaker 4

我认为这将是必需的,并且显然需要持续获得慈善和联邦资金支持,以便研究能够继续创造出更好的设备。

I think that will be required and clearly continued philanthropic and federal funding so that the research can continue to create ever better devices.

Speaker 0

我们非常感谢博士。

We're so thankful to Doctor.

Speaker 0

霍克伯格的深刻见解,特别是在医疗平等方面的观点。

Hockberg for his insights, especially when it comes to the equality of care.

Speaker 0

尽管这些优质资源通常会被引入社区,但平等性和可及性却完全没有得到解决。

And even though these fantastic resources are usually introduced into the community, but equality and access is really not addressed at all.

Speaker 1

往往最需要帮助的人群反而最难获得这些资源。

It often doesn't get to the people that need it the most.

Speaker 0

是的。

Yeah.

Speaker 0

这非常令人遗憾,我认为这已经成为一种历史模式——最脆弱的群体和最需要这些工具的人往往最后才能获得帮助。

And that's very sad, and I think that has been the historical pattern where the most vulnerable people and the ones that need the tools the most are often the last to get it.

Speaker 0

这几乎造成了一种资源分配的不平衡——那些有经济能力或身处临床试验研究中心附近的人更容易获得帮助,但事情本不该如此。

It almost becomes an imbalance of providing this for people who may have the means or who are present around that clinical trial in the research center, but it doesn't have to be that way.

Speaker 0

正如你们稍后将听到下一位嘉宾布兰德蒙德博士和斯塔维斯基博士所言,目前这个领域仍处于前竞争和商业化前期阶段,这实际上让研究人员、监管机构和公众都能对此发表意见。

And as you will hear in a moment from our next guests, doctor Brandmond and doctor Staviski, this is still a precompetitive and a precommercial moment in the field, and it actually allows the researchers, the regulators, the public to actually have a say in this.

Speaker 0

他们可以围坐在同一张桌子旁,就安全、安全、可及性等重要议题展开对话

And they can sit around the same table and have conversations about important things such as safety, safety, access

Speaker 3

伦理问题。

The ethics.

Speaker 0

所有这些的伦理考量。

The ethics of all of it.

Speaker 0

甚至那些对其技术细节并不真正了解的人,也应该有权决定谁可以获得它、如何获得它,以及如何让所有人都能使用它。

And even people who are not really aware of the specific tech part of it should have a say in determining who gets it, how do they get it, and how it should be available for everyone.

Speaker 0

对此我持谨慎乐观态度。

I'm cautiously optimistic about that.

Speaker 0

这一切将我们引向与大卫·布兰德曼博士和谢尔盖·斯塔维斯基博士的对话,他们作为加州大学戴维斯分校神经假体实验室的联合主任,正工作在工程、创新和以患者为中心护理的交叉领域。

And all of this brings us to our conversation with doctor David Brandman and doctor Sergey Staviski who are working right at the intersection of engineering, innovation, and patient centered care as co directors of the neuroprosthetic lab at UC Davis.

Speaker 0

谢尔盖和大卫正在构建系统、合作伙伴关系和开放框架,使符合伦理、可扩展且包容的脑机接口部署成为可能。

Sergei and David are building the systems, the partnerships, and open frameworks that can make ethical, scalable, and inclusive deployments of brain computer interface possible.

Speaker 1

大卫,你是怎么踏上这条探索之路的?

David, how did you get into this journey?

Speaker 5

是的。

Yeah.

Speaker 5

谢谢提问。

Thanks for the question.

Speaker 5

我是一名神经外科医生。

I'm a neurosurgeon.

Speaker 5

天啊,我是怎么进入脑机接口领域的呢?

And gosh, how did I get into brain computer interfaces?

Speaker 5

2010年我在加拿大新斯科舍省哈利法克斯市进入神经外科住院医师培训,开始实习不到一年就意识到自己渴望学术发展道路。

When I matched to neurosurgical residency in Halifax, Nova Scotia in 2010, within a year of starting my residency, I realized I wanted an academic trajectory.

Speaker 5

我喜欢挑战临床医学认知边界并帮助他人的理念。

Like I liked the idea of pushing the boundaries of what we know in clinical medicine and helping folks out.

Speaker 5

于是在2011年,我参加了一个工程学会议,遇到一位做脑机接口演讲的学者,当时就觉得这简直是世界上最酷的东西。

So in 2011, I went to an engineering conference and I met a guy who was giving a talk on brain computer interfaces and I said, this is the coolest thing ever.

Speaker 5

我走上前对他说,你好,我是一名神经外科住院医生。

I walked up to him and I said, hi, I'm a neurosurgical resident.

Speaker 5

你能多告诉我一些关于脑机接口的事吗?

Can you tell me more about BCI?

Speaker 5

于是他请我喝了杯咖啡,简单介绍了这个领域,两年后我就成了他的博士生。

So he bought me a coffee and tell me a little about the field and then he fast forward two years later and I'm his PhD student.

Speaker 5

2011年我在一场会议上遇到了李·霍克伯格,当时他正在介绍自己参与的BrindGate二期临床试验工作,后来我于2013至2017年加入他的课题组攻读博士学位。

So I met Lee Hochberg at a conference as he was talking about his work as part of the BrinGate two clinical trial back in 2011 and actually joined his group as a PhD student from 2013 to 2017.

Speaker 5

我做了个短暂的'胜利巡游'——这是我对那段短暂博士后经历的戏称,之后继续完成住院医师培训,接着在埃默里大学跟随尼克·布利斯、鲍勃·格罗斯和尼克·杨开始功能性立体定向研究。

I did a short victory lap as I like to call it, doing a very short postdoc before continuing to finish residency and then starting to do my functional stereotactic fellowship at Emory University under Nick Bullis, Bob Gross and Nickel Young.

Speaker 5

2021年我以教职身份加入加州大学戴维斯分校。

I started out in faculty in UC Davis in 2021.

Speaker 5

所以对我来说,脑机接口是顺理成章的选择。

So for me, BCI made a lot of sense.

Speaker 5

我的专业背景是物理学。

My background was in physics.

Speaker 5

我一直很喜欢计算机编程,并且看到了需求。

I've always enjoyed computer programming and I saw a need.

Speaker 5

就像我在神经外科培训期间遇到的瘫痪病人,他们渴望与环境互动却无能为力。

Like I met patients as part of my neurosurgical training that were paralyzed, that wanted to interact with their environment but couldn't.

Speaker 5

我认为脑机接口能完美结合我的专长与兴趣,同时直接帮助有需要的人。

And I saw BCIs as a really attractive way to build on my strengths and my interests while still being able to directly help people in need.

Speaker 1

太棒了。

Amazing.

Speaker 1

简直不可思议。

Absolutely amazing.

Speaker 1

我很欣赏你能找到这个方向。

I love that you were able to get that direction.

Speaker 1

我想很多神经科医生、神经外科医生和神经科学家都有这种远见,知道工程学与生物学的革命将在两界交汇处发生。

I think a lot of the neurologists and neurosurgeons and neuroscientists had that in mind, knowing that there's going to be an interface between these two realms of the revolution of engineering and biology.

Speaker 1

你们成功找到了这个交汇点。

You guys were able to find it.

Speaker 1

谢尔盖,你那精彩的经历是怎样的?

Sergei, what was your amazing journey?

Speaker 1

是啊。

Yeah.

Speaker 3

你会听到一些相似的主题。

You're gonna hear some similar themes.

Speaker 3

我在布朗大学读本科时,2004年入学,恰好是原始BrainGate系统——首个采用多电极阵列的慢性脑机接口——正由布朗大学衍生的一家初创公司进行测试的年份。

So I was a undergraduate at Brown University, and I started college in 2004, which happened to be the year that the original BrainGate system, which is the first chronic brain computer interface using a multielectrode array, was actually being tested by a spinout company that came out of Brown.

Speaker 3

于是我就去上大学了。

And so I went to college.

Speaker 3

我一直对工程学很感兴趣。

I'd always been interested in engineering.

Speaker 3

我热爱编程。

I love to program.

Speaker 3

我喜欢动手制作东西。

I like to build things.

Speaker 3

我对生命科学有着广泛的兴趣。

I was interested in life sciences broadly.

Speaker 3

从哲学角度,我对心智也很感兴趣,就像大多数18岁、有点自恋的年轻人一样,想了解自己以及是什么造就了现在的我。

I was philosophically interested in the mind as well as I think most 18 year olds who are a little bit narcissistic and wanna know about themselves and what makes me who I am.

Speaker 3

当时我正在上神经科学导论课,不知为何在布朗大学,这实际上是你秋季学期上的第一门生物课。

And I was taking this intro to neuroscience class, which for whatever reason at Brown is actually the first biology class you take in the fall.

Speaker 3

另一位教授约翰·多纳休(与李·霍克伯格密切合作)客座讲授了脑机接口的概念,并展示了他们与首位参与Cyberkinetics脑机接口试验的受试者刚出炉的最新成果视频。

And a different professor, John Donahue, who actually worked very closely with Lee Hockberg, gave one of the guest lectures talking about this idea of a brain computer interface and showing some videos from their, like, fresh, hot off the presses results with their very first participant in this cyberkinetics brain gate trial.

Speaker 3

那展示的是一位比我年长几岁的年轻男子,他在一场刀战中受伤,导致颈部以下瘫痪。

And that was showing a young man, just a few years older than me, who had been injured in a knife fight and was paralyzed from the neck down.

Speaker 3

在这首次真正惊人的成果中,几年后发表在《自然》杂志上,引起了巨大轰动,但本质上,他当时正试图移动自己的手。

And in this first ever really phenomenal result, it was published a couple years later in Nature, was a big deal, but basically, he was trying to move his hand.

Speaker 3

他们正在解码他试图移动手时的神经活动,他当时正利用这些信号——以今天的标准来看——非常不精确地控制电脑光标。

They were decoding the neural activity as he was trying to move his hand, and he was using that to, by today's standards, very poorly control a computer cursor.

Speaker 3

但尽管如此,他确实能够移动那个电脑光标,甚至还能操控一个简单的机械手臂。

But nonetheless, he was able to move that computer cursor and even had to move a little simple robotic arm.

Speaker 3

我觉得那简直酷毙了。

I thought that was the coolest thing ever.

Speaker 3

我当时就说:这太神奇了,而且完全符合我的兴趣。

I said, this is amazing, and this perfectly aligns.

Speaker 3

我一直想做些与医疗相关的事情来帮助他人。

I wanted to do something medical related to help people.

Speaker 3

于是我加入了BrainGate项目——那时它已转型为学术研究而非商业项目,之后我又去斯坦福攻读博士学位。

So I worked for BrainGate, which at that point had become an academic endeavor rather than a commercial one, and then went on to do my PhD at Stanford.

Speaker 3

实际上我和大卫有过短暂交集,后来我们同一天入职加州大学戴维斯分校担任助理教授。

Actually, I overlapped briefly with David and then started my assistant professor job here at UC Davis on the same day as David.

Speaker 3

这倒不是刻意安排的同步招聘,但也不是纯属巧合。

It was not like a super coordinated hire, but it was not coincidence.

Speaker 3

简单来说,我们俩同时申请了加州大学戴维斯分校同一系里的两个不同职位,当时的系主任发现:『我这里有个想做脑机接口的神经外科医生,还有个想做脑机接口的神经科学家』。

So basically, both of us applied for two separate jobs in the same department at UC Davis, and our chair at the time said, I've got a neurosurgeon and a neuroscientist that both want to do brain computer interfaces.

Speaker 3

他们真该好好聊聊。

They should probably talk.

Speaker 3

我们确实这么做了,并且很快达成共识,发现彼此兴趣非常相似,决定共同运营一个实验室。

And we did, and we quickly agreed that we had very similar interests and wanted to run a lab together.

Speaker 3

所以就有了现在的我们。

So here we are.

Speaker 1

太棒了。

Amazing.

Speaker 1

我认为我们正站在重大突破的边缘。

Right now I think we're at the precipice of something huge.

Speaker 1

能告诉我们你们目前的研究进展和未来方向吗?

So tell us where you are in that journey and where are going?

Speaker 5

作为开场白,我先介绍一下BrainGate的临床情况。这是一项临床试验,志愿者通过脑部手术在大脑控制运动的区域植入电极。

So maybe by way of introduction, I'll just tell you about the clinical So BrainGate, it's a clinical trial in which people volunteer to undergo brain surgery to place electrodes into part of the brain that controls movement.

Speaker 5

这项临床试验的主要目的是研究我们植入的电极是否安全。

So the point of the clinical trial is to study whether or not the electrodes we're implanting are safe.

Speaker 5

但实际上,参与临床试验的志愿者还会与科研团队合作,共同开发新一代神经技术来帮助瘫痪患者。

But actually as a consequence of signing up for the clinical trial they work with a scientific team to develop next generation neurotechnologies to help people with paralysis.

Speaker 5

这项临床试验目前正在进行中,由麻省总医院主导,属于研究者发起的临床试验,即由个人而非公司负责运营。

So the clinical trial is ongoing, it's led out of Mass General Hospital and it's a sponsor investigator led clinical trial which means a guy runs the clinical trial as opposed to a company running the clinical trial.

Speaker 5

那个人就是李·霍克伯格。

That guy is Lee Hochberg.

Speaker 5

基本上,该试验面向因脊髓损伤、脑干中风、肌萎缩侧索硬化症及其他神经退行性疾病导致瘫痪的患者开放。

Essentially it's open to people living with paralysis from things like spinal cord injury, brainstem stroke, ALS and other kinds of neurodegenerative diseases.

Speaker 5

作为临床试验的一部分,他们会接受这些电极的手术植入,随后在一年时间内与科学家和工程师合作开发神经假体。

And as part of the clinical trial they undergo surgical implantation of these electrodes and then over the course of a year, with scientists and engineers to develop neuroprosthetics.

Speaker 5

可以说,诊所成立的前二十年,确切地说是临床试验的前十七年,我们主要致力于通过点选鼠标控制来恢复交流能力,或是通过机械臂控制来恢复功能独立性。

So I would say that the first twenty years of the clinic, the first seventeen years of the clinical trial really focused on restoring communication by way of point and click mouse control or restoring functional independence by way of robotic arm control.

Speaker 5

具体来说,就像你操作电脑时用手移动鼠标,光标随之在屏幕上移动并点击目标那样。

So what I mean by that is as you interact with your computer, you take your hand and you move your mouse and then your mouse moves on a computer and you can click on things.

Speaker 5

但如果你瘫痪了,就无法完成这些动作。

But if you're paralyzed, you can't do that.

Speaker 5

因此我们在前十七年至今仍在探索的是:能否仅凭思维来操控电脑光标?

And so what we were learning for the first seventeen years and still learning right now, can you control a computer cursor using your thoughts?

展开剩余字幕(还有 221 条)
Speaker 5

所以当你尝试移动你的手,尽管瘫痪状态下,我们可以将你的大脑信号转化为电脑屏幕上的光标移动,让你通过这种方式实现交流。

So you try to move your hand and despite being paralyzed, we can translate your brain signals to allow a computer cursor to move on a screen and allowing you to communicate that way.

Speaker 5

于是在2018年,谢尔盖实际上提出了一个问题:好吧,我们能够控制光标,其他人也展示了可以控制手写,但语音呢?

So 2018, Sergei actually asked the question of, okay, we can do cursor control and other people had shown that you can do handwriting control, but what about speech?

Speaker 5

我们能否真正尝试解码瘫痪患者的言语?

Can we actually try to decode speech despite being paralyzed?

Speaker 5

而谢尔盖实际上是第一个证明这可以从大脑错误区域通过单个神经元水平实现的人。

And Sergei was actually the first one to demonstrate this was possible at a single neuron level from the wrong part of the brain.

Speaker 5

我所说的错误的大脑区域,是指传统上被认为控制手部运动的那个脑区,对吧?

And what I mean by the wrong part of the brain, it is the part of the brain that's canonically thought to control hand movements, right?

Speaker 5

如果你上过医学院或关注神经科学研究,就会知道人类大脑在运动控制方面是有组织结构的。

So if you've been to medical school or you follow studies in neuroscience, you know that there's this organization to the human brain when it comes to motor control.

Speaker 5

控制腿部的区域位于中间,手臂区域稍偏外侧,而越往大脑边缘方向,则逐渐过渡到面部控制区域。

Your leg is in the middle, your arm is a little bit more lateral to that on the side and then as you go further towards the side, the edge of the brain, you start going towards facial control.

Speaker 5

因此之前的许多植入设备都专注于手部控制,并且是基于从大脑手部控制区域采集的信号来实现的。

And so a lot of the previous implants focused on hand control and hand control based on recording from the hand areas of the brain.

Speaker 5

而我们发现实际上可以从大脑的手部区域进行语音解码。

And what we found is we could actually do speech decoding from the hand area of the brain.

Speaker 5

这非常令人惊讶。

And this is very surprising.

Speaker 5

当我把这个告诉医生时,他们的反应都是:真的吗?

And when I tell this to doctors, they're like, really?

Speaker 5

我告诉很多神经科学家时,他们会说:哦,这真的很有趣。

And I tell this to a lot of neuroscientists, they're like, oh, that's really interesting.

Speaker 5

我想知道这是怎么实现的。

I wonder how that works.

Speaker 5

这里需要稍微解释一下大脑在微米级别的组织结构与毫米或厘米级别有何不同。

And there's a little bit to unpack there in terms of how the brain's actually organized differently at a micrometer level than it is organized at a millimeter or centimeter level.

Speaker 3

我要说明我们解码的是语音而非语言。

I will say we're decoding speech and not language.

Speaker 3

这个区别在我们后续的对话中可能会变得更加重要。

And this is a distinction that may become more relevant later in our conversation.

Speaker 3

言语是运动行为,也常被用于讨论理解言语的过程。

Speech is the motor act or often used when talking about understanding speech.

Speaker 3

所以可以理解为感知或运动层面,而语言则基本涵盖其他所有方面。

So think about either the sensory or the motor side, and then language is basically everything else.

Speaker 3

它是认知层面的。

It's the cognitive.

Speaker 3

它是意义层面的。

It's the meaning.

Speaker 3

包括语法、以及我们组织词语传递意义的结构。

It's the grammar, the structure of how we assemble words to convey meaning.

Speaker 3

由于我们参与了这项BrainGate临床试验,我们试图恢复诸如脑控机械臂功能或脑控计算机鼠标功能。

Because we were part of this BrainGate clinical trial, we were trying to restore things like brain controlled robot arm function or brain controlled computer mouse function.

Speaker 3

我们已经在运动皮层的手部区域植入了多电极阵列。

We already had multi electrode arrays in the hand area of motor cortex.

Speaker 3

所以我们当时就想,好吧。

And so we thought, okay.

Speaker 3

我们知道在解码手部动作方面,多电极阵列似乎比ECOG更有效。

We know that for decoding hand movements, multi electrode arrays seem to be better than ECOG.

Speaker 3

我们曾认为解码语音信号是极其困难的。

We used to think that decoding speech was ridiculously difficult.

Speaker 3

语速非常快,每分钟150个单词。

Speech is super fast, 150 words per minute.

Speaker 3

这需要协调大约100块肌肉。

It involves coordinating about a 100 muscles.

Speaker 3

我们已经有了这些临床试验参与者。

We already had these clinical trial participants.

Speaker 3

他们仍然能够说话。

They could still speak.

Speaker 3

他们是从颈部以下瘫痪的四肢瘫痪患者,但他们能说话。

They were paralyzed from the neck down, people with tetraplegia, but they could talk.

Speaker 3

所以对他们来说说声'嘿'并不困难。

So it wasn't hard for them to say, hey.

Speaker 3

你能从屏幕上读出这些单词吗?

Can you read these words off a screen?

Speaker 3

我和几位参与者一起完成了这个实验。

And I did that with a couple participants.

Speaker 3

令人惊讶的是,我们确实发现手部运动皮层中的许多神经元确实对语音有反应,这在科学上既令人意外又很酷。

And lo and behold, we actually found that a lot of the neurons in the hand motor cortex did respond for speech, which was scientifically surprising and cool.

Speaker 3

此外,通过对比同期使用ECoG技术的研究论文,我们发现能以相近的准确率解码他们所说的单词或音节。

But also, we found that based on comparing to papers around the same time using ECOG, we could decode what words or syllables they were saying with about the same accuracy.

Speaker 3

这说明虽然我们研究的是大脑的错误区域,但取得了同样好的效果。

And so we were in the wrong part of the brain, and we were doing about as well.

Speaker 3

这表明如果我们将这些电极阵列植入大脑的正确区域——语言运动皮层(比我们现有位置更靠腹侧的位置),或许能,或许我们就能准确解码语音,使患者真正将其用于交流。

That suggests that if we were to put these electrode arrays in the right part of the brain, the speech motor cortex, so more ventrally to where we already were, maybe we could decode speech accurately enough that someone could actually use this to communicate.

Speaker 3

当然,这将极大地提升他们的独立性和生活质量。

And that would, of course, be hugely enabling for their independence and quality of life.

Speaker 3

于是这个项目就这样推进了。。

And so that kinda went ahead.

Speaker 3

这位患有肌萎缩侧索硬化症的女性,言语严重不清,他们在她的言语运动皮层植入了两个微电极阵列,另外两个植入在44区布洛卡区。

The woman with ALS, severely dysarthric, and they put two microelectrode arrays in the speech motor cortex and two in area forty four Broca's area.

Speaker 3

结果发现44区的阵列效果并不如预期,但言语运动皮层的那些效果相当不错。

And it turned out actually the 44 arrays didn't work as well as one would think, but the ones in speech motor cortex worked pretty well.

Speaker 3

大约25%的词错误率,也就是说四分之三的单词是正确的,使用的词汇量非常大,达到12.5万个单词,基本上涵盖了英语中所有词汇,而这位患者在其他情况下很难被理解。

About 25% word error rate, so meaning three out of four words were correct, using a very large vocabulary of 125,000 words, basically every word in English, in this person who otherwise couldn't easily be understood.

Speaker 3

她仍能发声,仍能说话,但言语非常不清晰。

She could still vocalize, she could still talk, but it was very dysarthric.

Speaker 3

这令人极其兴奋,验证了我们的方法,我们说,哇,这真的有效。

That was extremely exciting and vindicated this approach, we said, wow, this is working.

Speaker 3

我和大卫在2021年成立了一个实验室。

David and I started a lab in 2021.

Speaker 3

我们招募了第一位参与者。

We recruited our first participant.

Speaker 3

也许我该把话筒交回给大卫了。

Maybe I'll pass the baton back to David.

Speaker 3

你可以简单描述一下他。

You can describe him a little bit.

Speaker 5

好的。

Okay.

Speaker 5

在为BrainGate二期临床试验获取受试者同意时,对我来说,这个谈话过程需要大约10到12个小时,分多次进行。

So when it comes to consenting someone for the BrainGate two clinical trial, for me, that conversation took about ten or twelve hours over multiple visits.

Speaker 5

原因在于,这并不是一种我可以为患者开具处方的临床治疗方案,对吧?

And the reason for that is because this is not a clinical, this is not a treatment that I can prescribe for someone, right?

Speaker 5

如果有人患有ALS,我目前还不能为其开具脑机接口的处方。

If someone has ALS, I can't prescribe a brain computer interface yet.

Speaker 5

相反,如果一位ALS患者有兴趣为科学做出贡献,我需要将其招募为研究的一部分——这项研究旨在评估安全性,而他们也自愿贡献时间推动科学发展,明白吗?

Instead what I have to do is if someone has ALS and they're interested in contributing towards science, I recruit them as part of a study designed to study the safety profile at which they also volunteer their time to develop science, right?

Speaker 5

这是一个非常深入的讨论过程。

This is a very extensive discussion.

Speaker 5

关于T15号受试者,我可以告诉你的是,他现在46岁,居住在距离萨克拉门托三小时车程的地方。

So what I can tell you about participant T15 is that he's now a 46 year old man with a three hour driving distance of Sacramento.

Speaker 5

我和我的共同主刀医生Kia Chelet——现任神经外科主任,将四个微电极阵列植入了控制言语的大脑区域。

Myself and my co surgeon Kia Chelet who's the chairman of neurosurgery now implanted four microelectrode arrays into the part of the brain that controls speech.

Speaker 5

已公开姓名的Casey患有ALS,他瘫痪在轮椅上,当他试图说话时,人们很难听懂他的话。

So Casey, who's gone public with his name, has ALS, he's paralyzed, he's in a wheelchair, and when he tries to speak, it's very difficult to understand him.

Speaker 5

我认识他已经有一段时间了,当我与他交谈时,我大概能听懂他说的5%到10%的内容。

I've known him for a while now and when I speak with him I can maybe understand five to 10% of what he says.

Speaker 5

他曾是个非常聪明的人,现在依然如此,在患上ALS之前是个能力非常出众的人。

A very intelligent man, still is a very intelligent man, but very high functioning man prior to developing ALS.

Speaker 5

他理解基线的方式,实际上是通过像他妻子这样的专业护理伙伴来翻译他说的话,或者通过使用像陀螺头鼠标这样的辅助通讯设备。

The way that he's understood a baseline is really by having expert care partner like his wife trying to translate what he says or by using an assistive communication device like the gyroscopic head mouse.

Speaker 5

在这两种情况下,他每分钟大约能被理解约六个正确单词。

And in both cases he can be understood at about six correct words per minute.

Speaker 5

所以当我和你在进行这个播客对话时,我每分钟能说100到150个单词,而他只能达到这个速度的一小部分。

So as you and I are having this conversation over this podcast, I'm speaking at somewhere between 100 to 150 words per minute and he was going a fraction of that speed.

Speaker 5

作为临床试验的一部分,他接受了微电极阵列的植入手术,大约一个月后我们来到他家做了以下操作。

And so as part of the clinical trial, he had the implantation of the microelectrode arrays and about a month later we showed up at his house and we did the following.

Speaker 5

我们启动了电脑,穿戴好脑机接口系统后对他说:看,我们只是想让你试着读出屏幕上的一些句子。

We turned on our computers, we had donned the brain computer interface system and we said, look, we just want you to try to read some sentences off the screen.

Speaker 5

于是他面前出现了短句,我们请他尽可能重复这些短语,并收集了约一个半小时的数据。

And so he was presented with short phrases and he was asked to repeat those phrases as best as he could and we collected about an hour and a half of data.

Speaker 5

之后我们说:好的,现在我们将尝试在你说话时解码你的话语。

And after that we said, okay, now we're gonna try to decode what you're saying as you try to say it.

Speaker 5

当他尝试时,第一个单词出现在屏幕上,这场景令人无比动容——因为这个能完全理解他人、清楚知道自己想说什么的人,却被疾病剥夺了身体机能。

And he did and when the first words showed up on the screen, it was incredibly moving experience because this is a man who has no problem understanding others, is a man who has no problem knowing what he wants to say but his body is failing him because of his disease.

Speaker 5

每当他试图说话时,文字就会出现在屏幕上。

And as he tries to speak, words show up on a screen.

Speaker 5

我们第一次去他家就成功实现了这个系统,在50个单词的有限词库内效果出奇地好。

The very first time we showed up at his house and we got this to work, we got it to work remarkably well within a limited 50 word dictionary.

Speaker 5

我们以很小的词汇量就捕捉到了他99%的说话意图。

We got 99% of what he tried to say with like a very small vocabulary.

Speaker 5

需要说明的是:这些句子仅由那50个单词构成。

So just the caveat is those 50 words of those sentences.

Speaker 5

当时我们都欣喜若狂。

So then we were elated.

Speaker 5

我们回到了实验室。

We went back to the lab.

Speaker 5

我们进行了一些数据分析,做了些调整,第二天又去了。

We did some data analysis, made some tweaks, and we showed up on the second day.

Speaker 5

然后我们撤掉了辅助训练机制。

And then we took off the training wheels.

Speaker 5

于是我们从50个单词的词库扩展到了125,000个单词的词库。

So we went from a 50 word dictionary to a 125,000 word dictionary.

Speaker 5

到了第二天,准确率达到了十之八九。

And on day two, it was accurate nine times out of 10.

Speaker 5

所以我们获得了约91%的准确率。

So we got about 91% accuracy.

Speaker 5

自那以后,又发生了几件事。

And then since then, a few things have happened.

Speaker 5

一是我们获得了更多数据。

One is we've gotten more data.

Speaker 5

换句话说,我们的算法对他的脑部数据特征有了更深入的学习。

In other words, our algorithms have learned more about how his brain data looks.

Speaker 5

第二是我们修复了代码中的错误。

The second is that we fixed bugs in our code.

Speaker 5

我们仍是研究实验室,目前仍在积极开发这项技术。

We're still research laboratories and we're still actively developing as part of this.

Speaker 5

第三是我们实施了更多机器学习方面的创新。

And third is we instituted more innovations in machine learning.

Speaker 5

这三者的结合使我们达到了现在能持续解码他所说内容约97%准确率的水平。

And the combination of those three things have got us to the point where we're now consistently decoding what he's saying about 97% of the time.

Speaker 5

现在我们已经能做到每50次中有49次准确解码他想表达的内容。

And now we can consistently decode what he's trying to say 49 times out of 50.

Speaker 5

这真的很棒。

So that's pretty cool.

Speaker 1

这是我听过最了不起的事情。

That's the most remarkable thing I've ever heard.

Speaker 1

而且进展如此之快,简直令人难以置信。

And such rapid rate, It's just it's just bewildering.

Speaker 5

我还想补充几点,并明确指出这并非读心设备。

I just wanna say a few more things as part of that and point out the fact that this is not a mind reading device.

Speaker 5

我们并不是在窥探他内心最深处的秘密。

Like, we're not listening to his deepest dark secrets.

Speaker 5

对吧?

Right?

Speaker 5

相反,我们只是利用了大脑中控制肌肉协调的部分仍在运作这一事实,然后将这些脑电信号转化为屏幕上的文字。

Instead, all we're doing is capitalizing the fact that the part of the brain that wants to coordinate muscles is still working and then translating those brain signals into words on a screen.

Speaker 5

那么我们是如何做到的呢?

So how are we doing that?

Speaker 5

其实原理相当简单。

It's fairly straightforward.

Speaker 5

基本上每80毫秒,我们会从这个脑区记录大约250个神经元,也就是250个神经细胞的活动。

Basically every eighty milliseconds, we're recording from about two fifty neurons, two fifty nerve cells from this part of the brain.

Speaker 5

我们只是在他尝试说话时,判断这些英语音素中哪个与我们之前见过的模式最为相似。

And all we're doing is saying, okay, as he's trying to speak, which one of these English phonemes is most similar to this kind of patterns we've seen before?

Speaker 5

换句话说,我们有训练数据,知道他尝试说'hello'时会产生怎样的数据模式。

In other words, we have training data, we know what happens when he tries to say hello, what that pattern of data looks like as he runs through the word hello.

Speaker 5

现在看到这个数据模式后,我们判断哪个英语音素与之最相似。

Now that we've seen this pattern of data, which one of these English phonemes most resembles a pattern of data?

Speaker 5

我们只是将这些英语音素串联起来,然后通过人工智能算法将脑信号转化为音素,再组合成词语和句子。

And we're simply stringing together those English phonemes and then running them through artificial intelligence algorithms to take brain signals into phonemes into words and words into sentences.

Speaker 5

部分语言模型需要几秒钟运行时间。

Some of our language models take a few seconds to run.

Speaker 5

所以如果是20、30、40或50个单词的句子,需要几秒钟来解析并通过语言模型得出最佳推测。

So if we have a twenty, thirty, forty, fifty word sentence, it'll take a few seconds to parse that, run that through the language models and comes up with the best guess as part of that.

Speaker 5

但请别误会,这个系统确实是实时运作的。

But make no mistake, this is working in real time.

Speaker 5

我们现有的延迟完全是因为计算机处理速度跟不上他试图表达的内容。

And any delay that we have is entirely based on the fact that our computers aren't fast enough in terms of keeping up with what he's trying to say.

Speaker 1

太神奇了。

Is amazing.

Speaker 1

那么我们接下来该往哪个方向发展?

So where do we go from here?

Speaker 5

目前有几家公司正在积极筹备临床试验,或已开展相关研究,或正着手评估这类技术的疗效。

Right now there's a few companies out there that are actively either planning to run clinical studies, currently have active clinical studies, or looking towards their efficacy studies in these kinds of technologies.

Speaker 5

我立刻想到的公司包括Paradromix、Neuralink、Synchron和Precision Neurotechnology,它们都处于不同研发阶段,致力于开发帮助瘫痪患者的完全植入式设备。

So the companies that come immediately to mind are Paradromix, Neuralink, Synchron, and Precision Neurotechnology that are in these various states of development towards developing fully implantable devices to help people living with paralysis.

Speaker 5

我希望五年后我能走到患者面前说:很抱歉史密斯女士,您被诊断出患有ALS,这种疾病很可怕,我无法治愈您,但至少当您与家人共同面对时,您将有能力与他们沟通。

I'm hoping we're five years away where I can walk up to a patient and say I'm sorry Ms.

Speaker 5

您可以告诉家人您爱他们,告诉他们您感到疼痛,让他们知道您遇到的问题,在这些重要时刻保持联系,并能够自由表达想说的话。

Smith, you've been diagnosed with ALS, this is an awful disease and I don't have a cure for you, but at least as you go through this journey with your family, you'll have a way to communicate with your family to let them know that you love them and let them know that you're in pain, let them know that you have an issue, be there for those moments and be empowered to say what you want to say.

Speaker 5

BrainGate临床试验主要针对瘫痪患者和那些渴望说话却无法发声的人群。

The BrainGate clinical trial is really focused on people with paralysis and people who want to talk but can't.

Speaker 5

具体到我们案例中讨论的是言语障碍问题。

Specifically talking about problems with speech in our case.

Speaker 5

如果我们开始讨论有语言障碍的人群会怎样?

What happens if we start talking about people with problems with language?

Speaker 5

全球有数百万人正遭受中风困扰。

There are millions of people who live with strokes.

Speaker 5

非常常见的问题是患者会出现语言障碍。

A very common problem with that is you start having difficulty with language.

Speaker 5

我们能否帮助那些有语言障碍的人?

Could we help people who have problems with language?

Speaker 5

我不知道。

I don't know.

Speaker 5

脑机接口或许能成为一种卓越的康复工具。

It may be that a brain computer interface could be a remarkable rehabilitation tool.

Speaker 5

也可能它并不奏效。

It may be that it doesn't work.

Speaker 5

这些正是像我们这样的学者必须提出的问题。

And these are exactly the kinds of questions that academics like us have to ask.

Speaker 5

或者说,我们能否让从未说过话的人获得说话的能力?

Or could it be that we can empower someone to speak who's never spoken before?

Speaker 5

想想患有脑瘫的孩子们,有很多脑瘫患儿由于无法发展出正常的肌肉控制能力而难以交流,但他们的意识是清醒的。

So if you think about kids with cerebral palsy, there are a lot of kids out there with cerebral palsy who never developed the correct musculature control to want to communicate, but are in there.

Speaker 5

他们有着丰富的内心世界,只是无法表达自己想说的话。

They have vibrant personal lives, but they just can't communicate what they want to say.

Speaker 5

脑机接口能否赋予某人说话的能力?

Could a brain computer interface empower someone to speak?

Speaker 5

那么晚期帕金森病呢?

What about advanced Parkinson's disease?

Speaker 5

你刚才提到了自己患帕金森病的经历。

You talked about your own experience with Parkinson's.

Speaker 5

脑机接口能否帮助晚期帕金森病患者恢复沟通能力?

Could a BCI be helped to empower someone to communicate who lives with advanced Parkinson's?

Speaker 5

因此我们有许多问题需要探讨,其中有一个极其重要的问题需要提出以推动进展。

So there's all these questions we have to ask and there's a really important question to ask and to push things forward.

Speaker 5

但当我们着眼于当下正在遭受病痛的人们时,我满怀希望,大约五年后我们将能有一种设备可以开给患者使用。

But as we move to the here and now for people that are suffering today, hopeful that we're going to have a device that I can prescribe for someone in about five years.

Speaker 3

太棒了。

Amazing.

Speaker 3

谢尔盖?

Sergei?

Speaker 3

是的,我认为大卫已经阐述得非常好了。

Yeah, I think David covered it very nicely.

Speaker 3

或许可以就最后那个观点再展开一下。

Maybe just to expand upon that last idea.

Speaker 3

对于中风和语言障碍患者,尤其是表达性失语症患者,可以这样类比。

So people with stroke and language disorders, aphasias, especially expressive aphasias, the analogy is as such.

Speaker 3

我们目前的语音脑机接口是什么?

What is our current speech brain computer interface?

Speaker 3

你可以把它想象成一种神经旁路。

You can think of it as sort of a neural bypass.

Speaker 3

对于患有ALS或皮层下中风的患者,当他们试图说话时,大脑细胞仍在正常工作,但信号无法传递到肌肉。

So in the brain of someone with ALS or a subcortical stroke, when they try to talk, all those brain cells are doing what they always do, but that signal is not reaching the muscles.

Speaker 3

因此我们目前所做的,实质上是直接获取他们试图做出的口面部肌肉运动和声带、横膈膜动作的神经信号源信息,通过神经活动读取这些信号,再经由计算机实现发声。

And so you can think of what we've currently done is really going to the source of information of what movements of the orofacial muscles they're trying to make in their vocal tract and their diaphragm, reading that out from neural activity, and making that happen basically through a computer.

Speaker 3

这样你就绕过了瘫痪的肌肉。

So you've bypassed the paralyzed muscles.

Speaker 3

实现了从大脑到声音的直接转换。

You've gone from brain to sound.

Speaker 3

但类比到失语症患者,问题不在于他们肢体瘫痪,而是...

But by analogy, people with aphasia, the idea is it's not that they are paralyzed necessarily.

Speaker 3

他们能形成语义概念——有想要表达的思想或观点,也能想到词语,但这两者间的连接被切断了。

It's that you have semantic concepts, so you have a thought or an idea you're trying to communicate, and then there are words, but that connection is somehow disrupted.

Speaker 3

所以他们无法将想传达的意念转化为要说的话语并表达出来。

So you can't go from the ideas you want to communicate to finding the words you want to say and being able to say it.

Speaker 3

因此我们或许能够重复我们已经完成的这项工作,但要更进一步。

And so we might be able to repeat this thing that we've done, but one step higher.

Speaker 3

我们将在更广泛的语言区域植入电极,也就是大脑中参与语言生成的部分,然后解读患者试图表达的意图或沟通意愿,通过一系列人工智能算法精确识别这些意图,将其转化为句子,并再次通过计算机让他们发声。

So we would put electrodes into the wider language area, so parts of the brain that are involved in language production, and figure out the idea or the communication intent that the person's trying to make, use a bunch of artificial intelligence algorithms to figure out what exactly that is, convert that into sentences, and again, have them speak through a computer.

Speaker 3

这样他们就能通过电脑与你交流,就像我们目前的参与者一样,但适应症会非常不同。

So they would talk to you through their computer much like our current participants are, but with a very different indication.

Speaker 3

我认为这是一个长期目标。

I think that is a long term goal.

Speaker 3

这需要攻克大量科学难题。

There's a lot of science that has to happen.

Speaker 3

我们并不真正了解人类大脑中语音是如何编码的。

We don't know how speech is really encoded in the human brain.

Speaker 3

存在许多挑战。

There are many challenges.

Speaker 3

如何获取这些脑部信号?

How do you get these brain signals?

Speaker 3

是高度分布式的吗?

As highly distributed?

Speaker 3

但我认为我们可以通过逐步扩大适应症范围,并利用这些机会在学习人类大脑的同时完成其他事情,最终实现这一目标。

But I think we can get there by slowly expanding the set of indications and taking advantage of these opportunities to learn about human brains while we're doing other things.

Speaker 5

迪恩,你之前提到过关于各种神经系统疾病患者的需求。

You mentioned something earlier, Dean, of the needs of people through various kinds of neurological diseases.

Speaker 5

如果你问那些瘫痪的人,他们无法移动双腿,什么是最重要的事情,你可能会认为是行走。

So if you ask people who live with paralysis, they can't move their legs, what the most important thing is, you might think it's to walk.

Speaker 5

结果并非如此。

It turns out it's not.

Speaker 5

实际上是膀胱、肠道和性功能。

It turns out it's bladder, bowel, sexual function.

Speaker 5

但如果你问那些无法移动手臂和腿的人,什么是最重要的事情,答案是手臂功能。

But if you ask people that can't move their arms and their legs, what the most important thing is, the answer is arm function.

Speaker 5

而如果你问那些无法说话、无法移动手臂和腿的人,什么是最重要的事情,答案是希望能交流。

But if you ask people that can't talk, can't move their arms and their legs, what the most important thing is, the answer is they like to be able to communicate.

Speaker 5

这是人类与他人建立联系的基本需求。

This is a fundamental human need to be able to relate with others.

Speaker 5

而现在有些人正缺乏这种能力。

And there are people who lack this now.

Speaker 5

我认为谢尔盖和我目前关注的重点,就是帮助那些需要这些设备的人们。

And I think what Sergey and I are focusing on right now is helping people that need these devices.

Speaker 5

这些自愿贡献时间和精力参与临床试验的人们非常特别。

These people who volunteer their time and energy to be as part of clinical trials are incredibly special.

Speaker 5

他们是患有脊髓损伤、渐冻症等疾病的患者,却自愿投入时间精力配合我们进行手术,教会我们这些科学家、医生、外科医生和工程师如何帮助他人而非自己。

These are people that live with diseases like spinal cord injuries like ALS where they're volunteering their time and energy to work with us to undergo a surgery, to teach us as scientists, as doctors, as surgeons, as engineers how to help not themselves but how to help other people.

Speaker 5

这确实非常了不起。

So that's incredibly special.

Speaker 5

如果要问这个领域有什么被低估的部分或发展方向,我想再次强调:我们对参与者付出的精力、时间和承诺感到无比谦卑。

And I think that if you were to ask me when is something that's underappreciated as part of this field or where this field is going, I just wanna circle back to say we are incredibly humbled by the energy and the time and the commitment that our participants have at working.

Speaker 5

我们正在积极招募志愿者。

We're actively recruiting.

Speaker 5

所以如果你是瘫痪患者,或者认识居住在斯坦福大学、加州大学戴维斯分校、麻省总医院或亚特兰大附近三小时车程范围内的人,请联系我们。

So if you are someone living with paralysis you know someone that is that lives within three hours driving distance of Stanford, UC Davis or Mass General Hospital or Atlanta reach out.

Speaker 5

就我个人而言,想联系我只需发邮件至braingate@ucdavis.edu,我很乐意回复。

I can speak for myself to get a hold of me you just email braingate@ucdavis.edu braingate@ucdavis.edu and basically I'm happy to respond.

Speaker 0

我们衷心感谢

Our gratitude to Doctor.

Speaker 0

Stavitsky医生和

Stavitsky and Doctor.

Speaker 0

Brandman医生分享他们的专业知识。

Brandman for sharing their expertise.

Speaker 0

通常当人们谈论脑机接口时,总会提到Neuralink这个词。

Usually when people talk about brain computer interface or brain machine interface, the term Neuralink comes up.

Speaker 0

我希望你能详细谈谈这个。

I wanted you to expand on that.

Speaker 0

你对此有什么看法?

What are your thoughts on that?

Speaker 1

我一直在思考研究的包容性,确保私立学术合作及整个体验具有广泛性,这意味着既有私营部门也有学术机构在进行研究,因为这是两种不同的路径。

I'm always thinking about the inclusivity of the research and making sure that the private academic collaboration and the whole experience is broad, meaning that there are private sectors that are doing the research as well as academic because it's a different approach.

Speaker 1

它能提供不同类型的信息。

It gives you different kind of information.

Speaker 1

两者都蕴含一定的创新性,重要的是要推动所有这些发展。

There's a bit of innovation in either one and it's important that all of it is promoted.

Speaker 1

关于Neuralink,外界有很多喧嚣和浮夸,但截至目前,他们在论文发表和成果公开方面做得并不多。

With the Neuralink, there's a lot of noise, there's a lot of flash, but as it happens up to now, there hasn't been much as far as publications and as far as release of outcomes.

Speaker 1

我们希望这种情况能有所改变,鉴于他们拥有的资源和目标,我认为这是有可能实现的。

We're hoping that will turn around and I think that given the resources that they have and the objectives they have that will happen.

Speaker 1

这是学术界在其工作中表现相当出色,并在许多方面引领整个努力的案例之一。

This is one of those cases that the academic world is doing pretty well in their work and in many ways leading the whole effort.

Speaker 1

所以这并不是一场竞赛。

So this is not a competition.

Speaker 1

我不认为这是公立与私立或学术界与企业之间的竞争。

I don't see it as a competition of public and private or academic versus companies.

Speaker 1

最重要的是,这些团体和公众要共同监督各方,确保其透明度,因为对于如此重要的事情而言,透明度就是一切——从积极方面来说。

The most important thing is that these groups and the public hold all of them accountable and keep them transparent because the transparency is everything for something this important on the positive side.

Speaker 1

虽然我们谈得不多,但这某种程度上是危险的,因为这些机器连接着你的大脑。

And although we didn't speak much about it, somewhat dangerous because these machines are connected to your brains.

Speaker 1

它们会收集信息。

They collect information.

Speaker 1

如果它们收集的信息超出了预设范围怎么办?

What if they collect information that's beyond the thing that they're supposed to do?

Speaker 1

如果它们能获取你内心最深处的想法怎么办?

What if they have access to your deepest thoughts?

Speaker 1

虽然目前还不可能,但我们不能完全否定这种可能性。

Although that's not possible right now, we can't negate that altogether.

Speaker 1

因此必须解决其中的伦理问题。

So the ethics of it must be addressed.

Speaker 1

这些担忧必须得到解决。

The concerns must be addressed.

Speaker 1

必须落实问责制。

The accountability must be had.

Speaker 1

这正是每个人都应该对此发表意见的地方。

And that's where everybody should have a a say in this.

Speaker 0

是的。

Yes.

Speaker 0

我同意。

I agree.

Speaker 0

我认为最令我担忧的问题之一就是缺乏透明度,我们希望这种情况能得到缓解或至少得到解决。

I think one of the things that is very concerning for me is the lack of transparency in this, and we hope that could be mitigated or at least addressed.

Speaker 0

这对人类来说是个绝佳机遇,但如果不解决透明度和伦理问题,我认为会非常危险。

It is a great opportunity for humanity, but if transparency and the ethics part of it is not addressed, I think it's dangerous.

Speaker 0

Brandman博士和Staviski都曾讨论过,像患者Casey Harrell这样的人如何在该领域承担起合作者角色,让公众与科学家、外科医生及整个医疗系统接触,从而更好地理解某种情境、病例或疾病,将计算机接口更有效地融入其中。

One of the things that doctor Brandman and Staviski both discussed was how people like Casey Harrell, who is a patient, actually takes on a role of a collaborator in the field and public coming in contact with scientists and surgeons and the entire health care system to help understand a situation, a case, or a disease, bring computer interface in this situation much better.

Speaker 0

我非常欣赏这种协作方式,希望未来能有更多机会让人们——让科学家们——为这些可怕的疾病和病症找到更好的解决方案。

I love that collaborative approach, and I hope that there's more opportunity for people to be able to scientists get better answers for these horrifying diseases and conditions.

Speaker 1

这些自愿参与这些工具初期试验的患者都是英雄。

These patients that volunteer for these initial stages of these tools are heroes.

Speaker 1

我记得2002年在NIH,我的一位患者患有进行性核上性麻痹。

I remember in 2002 at NIH, one of my patients had progressive supranuclear palsy.

Speaker 1

这是一种快速恶化的退行性疾病,三年内就会夺走他们的生命、行动能力等一切。

It's a rapidly progressive degenerative disease that over three years takes their life, their movement, everything.

Speaker 1

这位患者自愿接受将导管穿过颅骨植入基底神经节的手术,一侧注射生长因子,另一侧作为对照组。

And the patient had volunteered to have these tubes put through their skull into the basal ganglia, and on one side there was the growth factor and the other side was control.

Speaker 1

所以他们实际上让自己成为研究对象,既接受治疗也接受对照研究。

So they actually made themselves subject to a study, control as well as treatment.

Speaker 1

我们在NIH的实验治疗部门反复看到这种情况,那些个体前来奉献自己的一生,他们将自己置于潜在的危险中,基本上就是为了帮助科学发展、推动科学进步。

And we saw this over and over again in the experimental therapeutics branch of NIH where individuals came and dedicated their life, they put themselves at harm's way potentially to basically help science, to further science.

Speaker 1

他们是英雄。

They are heroes.

Speaker 1

而这位患者,尽管初期阶段病情轻微,他们原本对此并不抱太大期望。

And this patient, although their initial stage was minimal, they were expecting not much out of this.

Speaker 1

他参与了这项研究,确实获得了惊人的回报。

He came into the study and yes, he saw incredible returns.

Speaker 1

后来他基本上成为了一个长期研究对象。

And then he basically became a perpetual subject.

Speaker 1

他们持续收集数据,从他身上获得的经验知识帮助巨大。

They continuously collected data and the amount of knowledge that they gained from his experience actually has helped so much.

Speaker 0

他真令人敬佩。

He's so inspiring.

Speaker 0

他和他的家人,他们所有人通过帮助科学界更好地理解这个问题,都令人深受鼓舞。

Him and his family, all of them are so inspiring for actually helping the field of science understand this better.

Speaker 0

这期节目整体非常鼓舞人心,我们的嘉宾都是杰出的人物。

This was such an inspiring episode altogether, and our speakers are just marvelous people.

Speaker 1

他们是英雄。

They're heroes.

Speaker 0

他们是英雄。

They are heroes.

Speaker 0

如果你想了解更多关于他们工作的信息并支持他们,可以访问他们的网站braingate.org。

And if you want to learn more about their work and support them, their website is braingate.org.

Speaker 0

我们会把链接放在节目说明中,方便你查看并以任何方式支持他们。

And we'll put it in the show notes so that you can go and take a look at it and support them in any way you can.

Speaker 0

希望你喜欢这次对话。

We hope you enjoyed this conversation.

Speaker 0

我们是主持人Aisha医生和Dean Shirzai医生,本期节目带你了解脑机接口技术。

We've been your hosts, doctors Aisha and Dean Shirzai and this has been your brain on brain computer interface.

Speaker 0

非常感谢你的收听。

Thank you so much for listening.

关于 Bayt 播客

Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。

继续浏览更多播客