本集简介
双语字幕
仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。
如果一只仿生手不仅能随你的意念移动,还能让你感受到物体的边缘、质地,甚至物体滑过皮肤的触感,那会怎样?
What if a bionic hand, in addition to moving with your thoughts, would also let you feel the edges, textures, and even the motion of objects sliding across your skin.
在本期《神经关怀者BCI大奖》特别节目中,我们将与博士对话。
In this special episode of the Neurocarers BCI Awards series, we sit down with Doctor.
2024年BCI大奖得主贾科莫瓦利,共同探索神经技术领域的突破性进展——为脑控仿生手实现的合成触觉。
Giacomovali, the first place winner of the 2024 BCI Award, to explore a groundbreaking leap in neurotechnology, synthetic touch for brain controlled bionic hands.
贾科莫与团队通过体感皮层的皮层内微刺激技术推进了触觉反馈的前沿研究,成功恢复了缺失的触觉感知。
Together with his team, Giacomo has advanced the frontier of tactile feedback by using intracortical microstimulation of the somatosensory cortex to restore the missing sense of touch.
通过施加具有空间和时间模式的电刺激,他们成功唤起了对边缘、触觉形状和皮肤表面运动的感知,让瘫痪患者通过脑控义肢与外界建立更自然、灵巧且有意义的连接。
By delivering spatially and temporally patterned electrical stimulation, they have been able to evoke sensations of edges, tactile shapes and motion across the skin, allowing individuals with paralysis to experience a more natural, dexterous and meaningful connection to the world through their brain controlled prosthetic hands.
这项创新让我们得以窥见未来:义肢不仅能恢复功能,还能重获作为人类的感受。
This innovation is a glimpse into a future where prosthetic limbs both restore function and bring back the feeling of being human.
请继续关注,我们将深入探索贾科莫的研究历程、模式化微刺激背后的科学原理,以及这一突破对BCI和神经假体未来的意义。
So stay with us as we dive into Giotomy's research journey, the science behind patterned microstimulation, and what this breakthrough means for the future of BCIs and neuroprosthetics.
欢迎你,贾科莫。
Welcome, Giacomo.
非常高兴再次邀请您参加我们的播客节目。
It's a great pleasure to have you again on our podcast.
是的。
Yeah.
谢谢。
Thank you.
非常感谢你再次邀请我,米莱娜。
Thank you very much, Milena, for the invitation again.
很荣幸能来到这里,分享关于新研究、你们的工作以及神经假肢方面的进展。
And it's a pleasure to be here and update on new studies and your work and, yeah, about the neuroprosthetics.
所以我非常兴奋。
So very excited.
是的。
Yes.
非常感谢你再次来到这里。
Thank you so much for being here again.
这次你是在哪里加入我们的?
And where are you joining us this time?
我记得上次你是在瑞典加入我们的。
I remember you were joining us last time from Sweden.
那你现在在哪里呢?
So where are you located at the moment?
是的,我还在瑞典。
Yeah, I'm still in Sweden.
所以我现在可以确认,我在世界上的位置更加稳定了。
So I can confirm that now now I'm more stable, like, in terms of location in the world.
我现在是查尔姆斯理工大学哥德堡分校仿生学系的助理教授。
So now I'm I'm assistant professor in in Vionics at at Chalmers University of Technology in Gothenburg.
我和我的团队研究如何通过神经假体和脑机接口技术,为患有不同类型神经系统障碍的患者恢复感觉运动功能,当然这些障碍主要影响感觉运动系统。
And and we my team, we study how to restore sensory motor function through the use of neuroprosthetics and BCI in people with different type of neurological impairments and affecting, of course, the the sensory motor system.
是的。
Yes.
我仍然与芝加哥保持着大量合作,确切地说是与芝加哥匹兹堡的皮质仿生研究小组合作,该小组正是2024年BCI奖获奖研究的实施团队。
I collaborate a lot with with Chicago still, so with Chicago Pittsburgh, so with the cortical bionic research group where actually also the study was performed and the study that won the BCI award 2024.
我们依然保持着这种合作关系。
So we still keep the collaboration.
我们仍有共同开展的研究项目。
We still have studies and and research together.
这种合作非常富有成效,继续与这些BCI受试者共事令人十分愉快。
It's very fruitful, very, very nice to continue to work with these BCI participants.
是的。
Yes.
能了解更多细节非常非常有趣。
Very, very interesting to get more details about that.
能否请你谈谈今年在PCI竞赛中获得一等奖的这个项目?
And can you tell us about this project that won the first place this year in the PCI competition?
是的,我为这项工作感到非常自豪。
Yeah, I'm very proud of this work.
首先,我想说明这项研究实际上是在芝加哥大学的Zlieben Besmaya实验室完成的,他于2023年8月去世了。
Firstly, I want to say that the work was actually performed at the University of Chicago, in the lab of Zlieben Besmaya, who passed in in 2023 in August.
某种程度上,这也是对他职业生涯的最后致敬——在神经假体领域,特别是在脑机接口方面,因为这项研究结合了神经科学和触觉研究,并将这些知识转化为应用,利用这些知识开发能恢复触觉的技术。
And this is a kind of the last study that is also somehow celebrate his, career in neuroprosthetics as well, I feel, in in BCI because was the part that was combining the neuroscience and the study of touch with the application, the translation application of this knowledge, leverage this this knowledge to develop technology able to restore touch.
事实上,这项研究发表在《科学》杂志上,并获得了这一 prestigious 奖项。
And, actually, the the the study was published in science and also got this prestigious award.
我也为Sleeman感到非常高兴,能够通过这最后一项重大研究实现这一里程碑。
So I'm very, very happy also for for Sleeman as well to have this milestone achieved with with this last last big study.
这就是为什么我也想提一下这件事,因为这也是我们共同完成的。
So this is why I wanna also mention this because it's something that we did together as well.
他在研究的第一阶段就参与了。
So he he was present during the first part of the study.
后来我继续与查尔斯、罗伯以及团队其他成员合作。
And then I I continue with with Charles and Rob and the other members of the team.
正如你现在所知,因为你在之前的播客活动和会议中对我有所了解,我是从外围开始这项研究的。
So the study is actually, as as you know now, because you know me a little bit from the previous podcast events and and and meetings, I started from the periphery.
所以我最近才进入这个领域,大概就是过去三四年间,尝试探索如何为瘫痪患者恢复触觉和感知,而不再是为截肢者设计假肢。这个领域的人群还遭受着感觉分离的痛苦,他们与自己的身体失去了联系,尽管身体仍然存在,这与截肢者失去肢体的情况不同。
So I moved in this field more recently, like, say, in the last three years, three, four years, trying to to see how to restore the sense of touch and sensation in not anymore in prosthetics for amputees, but in a field where people with paralysis, they're also suffering from a differentiation, so they don't have any more connection with their body, even if their body is still present compared to amputees where actually you don't have the body part.
这里你的肢体仍然存在,但你实际上感受不到也无法移动它。
Here you have the body part, but you don't actually feel and move this limb.
实际上有两种研究路径。
And actually there are two approaches.
一种是尝试恢复原生肢体的功能,通过功能性电刺激或外骨骼进行神经再激活。
One is trying to regain function of the net native limb, reactivate with functional electrical stimulation, exoskeletons.
而我们正在尝试的另一条路径是开发体外肢体——一种安装在轮椅或桌面上的假体装置,你可以通过思维和自主控制来操控它,同时还能通过假体上的传感器获得触觉反馈。
And then there is this other approach that we were trying to follow is to have a extracorporeal limb, so a prosthetic device attached to the wheelchair or on the table that you can control with your thoughts and with your volitional control, but you can also sense from the sensors that you have on on the prosthetics.
所以最终概念其实与截肢者的情况类似,本质上都是要实现相同目标。
So the concept is at the end kind of similar to the amputees condition, where actually you wanna again do that.
但不同于从肌肉采集信号,这次我们直接从大脑进行记录。
But instead of recording from the muscle, in this case, we record from the brain.
也不同于刺激周围神经,这次我们直接刺激大脑皮层。
And instead of stimulating the nerves here, we're stimulating the cortex.
这是我第一次着手解决这个问题。
So this was the first time that I was approaching this problem.
我将自己的专业知识从外周神经系统转移到了大脑皮层领域。
And I transferred my knowledge from periphery more on the cortex.
这项研究就是这样开始的,试图恢复那些功能。
So this is how the study started, trying to restore that.
此外还有很多可以探讨的内容,我们借鉴了视觉皮层假体的经验,以及在试图通过刺激视觉皮层而非体感皮层来恢复盲人视力方面取得的成果。
And also there is a lot of that we can maybe discuss on this, that we took inspiration from the visocortical prosthetics and what was achieved in trying to restore vision in blind individuals stimulating the visual cortex instead of a somatosensory.
因此我们也从他们的成果中获得了许多灵感。
So we also took a lot of inspiration from their results.
是的。
Yes.
是的。
Yes.
有太多东西要讨论了。
So many things to discuss.
我真心感谢你提到与你共事的团队以及比斯马亚教授,正如你所说,他已经离世。
And I truly appreciate you acknowledging the team that you worked with and professor Bismayah, who, like you said, passed away.
我能感受到这对整个学术界是多么巨大的损失,许多人对此深感悲痛,这件事确实触动了大家的心。
And I think I saw how big was that loss for the whole community and there were so many opposed and people really were taking it very close to the heart.
对于可能不太了解教授及其工作的听众,能否请你简要概述一下他的贡献?
For those who maybe are not very familiar with professor and his work, can you just give us a brief overview of his contributions?
他在该领域做出了哪些成就?他因何而闻名,至今仍被铭记?
What did he did to the field and what he was known for and still is known for?
是的。
Yes.
对。
Yeah.
谢谢。
Thank you.
我们至今仍追随着他的足迹,继承他在该领域的探索——齐勒曼教授可能是体感和触觉研究领域最著名、最受认可的神经科学家之一。
So we are still following his footsteps, no, and and his steps in the field with what he discovered because so Zliemann was the probably one of the most famous and acknowledged neuroscientists in the field of somatosensation and touch.
因此他开始在非人灵长类动物中研究这个领域多年,在周边神经系统、脊髓、楔束核、丘脑、皮层以及涉及触觉的不同皮层区域进行神经记录。
So he started to study this in nonhuman primates for for many, many years doing neural recording in in the periphery, in the spinal cord, in a cuneate nucleus, in the thalamus, in the cortex, different part of the cortex involving the sense of touch.
他是一位真正的神经科学家,对理解我们触觉体验和感知背后的机制非常感兴趣,研究大脑如何编码这些信息,以及不同感觉通道的纤维如何工作。
So he was really he was a neuroscientist, so he really was interested in understanding the mechanism behind our experience and perception of touch, understanding how the brain is encoding this information, how the fibers, the different sensory channels.
他在这个领域有着长期的研究历史。
So he has a lot of long history of of researchers on that.
从运动、边缘、凹陷、压力等触觉特征开始,这些都是我们触摸物体时体验到的。
So the starting from motion, edges, indentation, pressure, and all these type of tactile features that we experience when we touch something.
我们的感觉传入神经和皮层神经元以不同方式编码这些特征,而他试图解析这些在多维编码过程中的贡献。
Our sensory afferents and cortical neurons are coding these features in different ways, and he was trying to disentangle the contribution of that in this multidimensional encoding process.
他还在心理物理学领域做出了很多贡献,不仅研究人类灵长类,还在健康个体的感知层面进行研究。
Then he also contribute a lot in the field of psychophysics, where actually he was studying this not only in human primates, but also at the perceptual level with healthy individuals.
比如我们如何感知纹理、运动、方向,以及当我们被动或主动操作物体时手部的感知。
So how we perceive textures, how we perceive motion, how we perceive orientation with our hands when we manipulate object passively or actively.
这是另一个层面的研究。
So this is another layer.
因此我们通过神经编码研究非人灵长类动物,并借助植入物和神经假体设备进行探索。
So we we have the neural coding with the new normal primates, and you study this with implants, with neuroprosthetic devices.
在心理物理学领域,你可以研究健康个体的自然感知,了解人们如何实际感受这些特征,以及如何从自然硬度、强度等维度进行评价。这类研究领域。
And psychophysics, you can study the natural perception of health individuals, how you actually feel these features and how you rate this in terms of national natural hardness, in terms of intensity, So this type of field.
在他职业生涯的最后阶段,他开始转型成为脑机接口(BCI)领域恢复触觉的权威专家,因为他是该领域最杰出的学者之一。
And then in the last part of his career, he started to translate and to be the reference person for the BCI aiming to restore touch because he was the one of the greatest experts in this.
因此神经工程师们邀请他协助设计人工触觉系统。
And so engineers, neuro engineers, ask him to help in design how to design as an artificial sense of touch.
他是首位在体感皮层进行此类植入的开拓者,2016年Fleischer等人的论文记载了这项成果。
So he was the first one contributing with the the the first implant of this kind in the somatosensory cortex and the Fleischer et al paper in 2016.
他们发表了首例在脊髓损伤患者感觉皮层植入电极阵列的研究。
They published the first work with an spinal cord individual was implanted with array in the sensory cortex.
通过精确的脑部电刺激,他们成功恢复了触觉感知。
And through the stimulation, they were able to restore the sense of touch, stimulating the brain in a precise way.
他的所有工作对脑机接口的安全参数设定也至关重要,这些参数可用于人类触觉恢复——他开创性地研究了在不损伤皮层的前提下,皮层可承受的最大刺激强度。
His all his work is also very important for the BCI in terms of safety parameters that we can use for restoring touch in humans because he did these very seminal studies on how much you can stimulate the cortex without damaging the cortex.
他最初在动物身上进行了这项研究。
So he did this in animal.
他发表的研究表明,使用这些参数进行刺激是安全的。
He published this that is safe to stimulate with this parameter.
甚至在我们VCI的FDA档案中,这些研究仍被用作参数选择的参考依据。
And still in the FDA dossier of our VCI, there are these studies as a, you know, reference for the parameters that we use.
这些研究非常重要,正是基于他的成果,我们才能使用这个安全范围。
These are very important because we can use this range because of his studies.
因此从基础神经科学到心理物理学,再到脑机接口的初期发展,他在多个领域都做出了贡献。
So in many different aspects, he contributed from the basic neuroscience to the psychophysics and then for the BCI for the first steps.
直到这项研究为止,它始终是该领域的里程碑式成果。
And until this study, that was the last one in the field.
最终它融合了两种技术路线的优势。
At the end, it is a kind of mix of the two.
因为我们同时整合了边缘运动感知和触觉精细特征识别技术,以及脑机接口系统。
You Because we have edge and motion and the the thing the the part of the fine features of touch and the BCI.
是的。
Yes.
是的。
Yes.
毫无疑问,他的工作将会延续下去,因为这是所有研究的核心。
And definitely, the his work will continue because it's in the the essence of all of it.
和他一起工作是什么感觉?
How was it like to work with him?
确实如此。
Exactly.
然后还有另一方面,他实际上在所有领域都是个摇滚明星般的存在,无论是生活态度还是科学态度,都充满了好奇心和激情,真的能把这种热情传递给整个实验室和团队。
Then then there is all the other part where actually he was a rock star in everything, like from the, you know, how approach life and approach science, so very with curiosity driven approach with passion, really able to transfer this passion to to the entire lab, to the the group.
这就是为什么每个人都竭尽全力为这项研究付出的原因。
And this is the reason why everybody was really trying to do his or her best to to to for this research.
还能激励脑机接口的参与者——如果你有机会和我们的参与者交谈,他们也被他的热情所感染。
Motivate also the the BCI participants because if you have the opportunity to talk with our participants, they were really motivated from also by his passion.
他就像一股纯粹的能量,充满想法和远见,我认为这对团队领导者、对PI来说至关重要。
And so was was a very, like, pure energy with ideas and vision that this, I think, is very crucial for for a for a leader, for the PI of the group.
你知道吗?
You know?
这是我从他身上学到的,并试图模仿他的沟通方式——他传达长期愿景的能力,以及他对领域发展方向的定义和引领。
It's something that I learned from him and trying to emulate his his his way to communicate, like, his his long term vision and how what what is the field is where the field is going and actually defining where the field is going.
他是那种整个领域都会追随的人。
So he was one of those persons that actually the field was following.
正因如此,随着他和克里斯蒂安·查诺伊的离去,BCI领域失去了两位指引未来愿景的重要导师。
And this is the reason why with him and also Kirstjian Chanoi, the field of BCI lost, like, very two big mentors for the vision of the future.
当然还有其他杰出人士,但这两位确实是该领域的重大损失。
And then then so, of course, all the others on tribe, but what these those were, like, big lost for for the field.
我们仍在遵循他们的一些愿景、建议和步伐,继续沿着他们的足迹前进。
And still, are following some of their, you know, vision and advices and steps following their steps for sure.
但最令人惊叹的是总能学到新东西,那段经历非常宝贵。我现在仍在自己实验室里努力效仿他的处事态度。
But, yeah, what was amazing was really like always learning something new and was a great experience, and I'm still copying his attitude also in in my lab as well trying.
当然,我不一样,因为他真的是纯粹的能量,像个摇滚明星,而我不是。
And, of course, I'm not the same because he was really pure energy, a rock star, and I'm not.
不过,对我来说,和他共事是非常非常棒的体验。
But, yeah, a great, great for me with him.
你和他工作中最难忘的经历是什么?
What was your most memorable encounter experience working with him?
实际上,有一个在实验室里也非常有名的时刻。
Actually, this moment, there was this moment very famous also in the lab.
这类首次植入手术是在匹兹堡完成的,至少在这个皮层仿生网络中,首批参与者十年前就在运动和感觉皮层植入了电极。
So the first implants of this kind were performed in Pittsburgh, at least in this network of the cortical bionics with the first participants implanted now ten years ago with the with the electrode the sensory cortex in the motor cortex.
现在他们在匹兹堡有三名受试者,芝加哥有两名。
And then now they have three individuals in Pittsburgh and two in Chicago.
2020年芝加哥完成了首例植入,斯科特·因布里也很棒——我建议你可以邀请他做个播客,他不仅是个优秀的沟通者,人格魅力也很强。
So in 2020, there was the first implant in Chicago, and and Scott Inbry is also like a good I I I invite you to to ask him maybe like a podcast because he's a great person and also very well for communication.
他是脑机接口受试者,但他非常愿意讲述自己的故事和参与研究的动机。
He's a BCI participant, but he's wants to tell his story and and his motivation to participate in that.
所以他是芝加哥的第一位参与者。
So he was the first participant in Chicago.
而西尔本在植入前当然很焦虑,毕竟这是首例植入手术。
And and, Sileben, before the implant was, of course, anxious and and then, you know, it was the first implant.
当我们植入这个用于触觉的电极时,最关键的是要将其精准定位在大脑的适当位置。
And when we implant this electrode, for touch, of course, it's very important to place the electrode in the right position in the brain.
需要将其定位在手上,特别是手指尖区域,因为犹他电极阵列非常小巧。
So to place that on the hand and in particular on the fingertips because the utah rays, these arrays are pretty small.
即便是微小的位置偏移,也会改变我们提供的触觉感知区域——这当然是该设备的局限性之一,实际覆盖范围相当有限。
And even like a small like, shifting the position can change where the sensation that we provided is one of the limitation of this device, of course, where actually the coverage is pretty limited.
因此必须非常精确地将其定位在指尖。
So you need to place this very precisely on the fingertip.
这个术前准备阶段相当漫长,虽然我们的技术越来越成熟,但必须确保手部和指尖区域被精准定位。
So there is this phase preimplant pretty long where actually we are better and better with with the techniques, but we need to be sure that the area of the hand and the fingertips are exactly there.
所以先要进行术前规划,然后才实施手术。
So there is this pre surgical planning, and then there is a surgery.
但直到我们开始操作的第一周,我们仍无法确定具体位置。
But until, you know, the first week when we start to do stuff, we are not sure about the location.
对吧?
Right?
所有的预测是否都准确。
If all the prediction were correct or not.
当时有个相关视频记录了这一幕——在最初的几天里,斯科特来到实验室进行第一阶段的记录工作。
So there was this moment where there is actually a video on that as well where so the first day one of the first days, so Scott came to the to the lab for the for the first phase of recording.
由于他保留着部分知觉,所以能感受到刺激。
And since he's a sensei, so he can feel.
他是植入者中的特殊案例,极少数甚至可能是唯一仍保留残余触觉的人。
So he's a particular case of among the other implanted because he one of the few or probably the only one with the a residual sensation.
因此他能感知到触觉。
So he can feel sensation.
实际上,你可以刺激神经元并观察是否记录到触觉反应。
And, actually, you can play the neurons and see if you are recording something from touch.
这就是猴子感受野的定义方式。
And this is how the receptive field in monkeys are defined.
但当时Zlemman一边触碰Scott的指尖,一边刺激神经元,想看看是否能听到一些反应信号。
But so so Zlemman was like touching Scott's fingertips and play the neurons at the same time to see if we can listen hear some response.
然后在某个时刻,会出现一个临界点,当你听到类似条形符号的活动信号时。
And then at a certain point, there was, like, this point where you've when you hear, like, so the bar symbol, the activity.
因此我们可以确定那是来自指尖的信号。
And so you we were sure that there was fingertip.
所以我们当时正好在指尖区域。
So we were exactly in the fingertip region.
那一刻所有人都很开心,面带笑容,包括斯科特在内的每个人。
So that was like the moment everybody was happy, smile, and also Scott, everybody.
这对团队来说是个相当感人的时刻,斯科特肯定也会这么说。
So that that was a pretty emotional moment for the group, and Scott will will say that the same for sure.
然后扎伊曼也非常——是的,同样超级兴奋。
And then and Zayman was super was, yeah, super excited as well.
当时我们所有人都在庆祝。
So everybody would we were, like, celebrating.
像这样的时刻还有很多。
So there were many moments like this.
关于BCA,我认为这是一个非常重要的时刻。
And regarding BCA, I think this was a a very important one.
是的。
Yes.
第一次尝试时大家总是很紧张。
And the first time it's always everyone is anxious.
能成功吗?
Will it work?
会不会失败呢?
Will it not work?
我记得我们在佛罗里达州奥兰多新成立的医疗中心完成了首例癫痫手术。
I remember we had first epilepsy surgery in the center that we established here in Florida, in Orlando.
那第一台手术,会进行得如何。
And that first surgery, how it will go.
所有人都在那里。
And everyone is there.
所有人都在看着。
Everyone is watching.
当手术成功时,大家都非常高兴。
And when it works, everyone is so happy.
是的。
Yes.
没错。
Exactly.
对他来说这同样非常重要,因为他是触觉领域的专家。
For him, it was very important as well because he, I mean, he was the expert of touch.
你知道吗?
You know?
他说,想象一下如果在我的实验室里,我们完全忽略了触觉这个领域。
He was saying, imagine if in my lab, we miss completely the the area of touch.
你知道吗?
You know?
然后这就会变得非常糟糕,我们无法进行实验等等。
And then then this would be like a very bad and, you know, we cannot do the experiment and etcetera.
他非常、非常期待这一刻,想看看一切是否顺利。
He was very, very expecting this moment to see if everything went well.
最后,一切都很顺利,结果非常棒。
And at the end, everything went well and was great and from yeah.
是的。
Yes.
是的。
Yes.
谢谢你分享这个。
Thank you for sharing this.
这让我想到下一个问题。
And this brings me to the next question.
通常人们在想到瘫痪患者时,首先想到的是他们肢体活动的障碍。
Usually people, when they're thinking about those who are paralyzed, they're thinking about their challenges with moving their limbs.
对吗?
Yes?
但人们通常不会考虑到触觉也可能受损。
But people usually don't think that the touch or the sense of touch also might be impaired.
那么伴随运动障碍出现的触觉损伤有多普遍?
So how frequent is the impairment of touch that goes along with the impairment of movement?
在哪些情况下患者仍能保留你提到的残余触觉?
And in what cases we still might have that residual sensations that you mentioned.
又有多少病例会完全丧失触觉?
And in how many cases we wouldn't have any of that.
所以这个问题到底有多普遍存在?
So just how persistent is this problem?
它有多大?
How big is it?
因为我认为它至少没有得到应有的足够关注或认可。
Because I think it doesn't get enough attention or recognition at least that it might deserve.
是的。
Yes.
不是。
No.
确实如此。
Exactly.
那么从触觉的重要性说起。
So starting from the importance of touch.
我们知道,手的灵巧性是人类特征之一,也在某种意义上塑造了我们的智力。
So we know that our manual dexterity that characterize us as as humans and also shape in a certain sense our intelligence.
不是吗?
No?
因为智能行为源于我们的双手和精细触觉,通过这些我们能表达艺术,展现组装精密机械或成为钢琴家的精湛能力。
Because an intelligent behavior because with with hands and with our fine sense of touch, we can express, you know, our art, our fine abilities to assemble the clockwise mechanism or be a pianist.
这些能力都得益于我们拥有精细的触觉,使我们能够以极其精准、快速的方式控制双手。
Or so all these abilities are guaranteed by the fact that we we have this fine sense of touch that allow us to control our hand in a very fine way and precise and fast.
从许多案例中我们知道这是不可能的,但很容易联想到寒冷天气里双手完全冻僵时,操作物品会变得非常困难。
And we know from many cases where this is is not possible, but we can also think very easily by a colder day where actually your hand are completely, you know, very cold and and and manipulate stuff would be difficult.
明白吗?
You know?
还有证据表明,当手指被麻醉后尝试操作时,表现也会非常糟糕。
There are then other proof where if you anesthetize the fingers and you try to do stuff, also, you're very bad in that.
若观察因神经病变、神经损伤或纤维退化导致感觉丧失的病例,会发现运动控制能力严重受损——因为视觉无法真正替代触觉。
And then if you go and see the condition where actually you have a sensory loss due to neuropathy or a lesion of the nerve or or or degeneration of the fibers, you can see that the motor control is very impaired by that because vision cannot really replace touch.
你的精确度会大打折扣。
You you are not precise in the same way.
这不利于从环境中提取信息,也无法精确施加适当力度或准确感知手部姿态。
It's not suitable to extract that information from the environment, and then you're not able to precisely exert the right amount of force to know exactly the configuration of the hand.
因此,有许多证据表明触觉对我们的操作能力以及与物体的互动尤为重要。
And so the there are many evidences showing how touch is important for our manipulation in particular and interaction with objects.
在脊髓损伤的情况下,当然,根据损伤类型的不同——这里我们讨论的是颈髓损伤——损伤也会影响上半身。
So in case of spinal cord injury, of course, accordingly I mean, depending by the type of lesion, and here we are talking about cervical spinal cord lesions, Here, we have the the impairment affecting the the upper body as well.
当然,在四肢瘫痪的情况下,可能是完全性的,你会完全丧失感觉和运动功能。
Of course, in case of tetraplegia, so, like, a complete can be complete, you have the completely loss of sensory and motor function at all.
此外还有相当一部分脊髓损伤是部分性的,会立即影响运动功能。
And then there are like a big chunk of the spinal cord injuries that are partial and that are affecting immediately the motor function.
那么具体损伤位置在哪里?
Then accordingly, where is the lesion?
如果是背侧或腹侧损伤,会影响运动或感觉功能,但这两者差异很大。
If it's dorsal ventral, it's affecting the motor or the sensory, but, you know, they're very different one to the other.
你可能丧失运动或感觉功能,或两者兼失,这是可以评估的。
And you have the loss of motor or sensory function or both, and this is something that can be evaluated.
当然,当你失去运动功能时,保留感觉功能对你的功能性活动并没有实际帮助。
Of course, in the moment that you lose the motor function, having the sensory are not really useful for your functional activities.
不是吗?
No?
因为没有运动功能,你能感觉到有人触碰你的手,但无法实际做出反应。
Because without motor function, you can feel if someone is touching your hand, but you cannot actually interact.
但很多情况下可能存在一些残余感觉,不过这些感觉是受损的,因为只有少量神经纤维能到达这里,大部分都已被损伤或病变。
But there are many cases where maybe there is some residual sensation, but this is impaired because few fibers are arriving here, but most of them are are damaged or lesion.
所以你会有一些感觉,但这些感觉非常粗糙且不具体。
So you have some sensation, but it's very crude and and and not specific.
同样地,你会有这种无法感知物体触碰的问题。
So again, you have these problems of not feeling that if some something is touching.
也许你能明白有东西在碰你的手,但不知道具体位置、力度,可能感受不到疼痛或温度,只能感知极热或极冷,而无法辨别中间状态。
Maybe you can understand that something is touching the hand, but you don't know where, you don't know how strong, you don't feel maybe pain, or you don't feel temperature, only feels very hot or very cold, but not in the middle.
所以情况会非常复杂多样。
So you have very different condition.
关键在于,特别是在我们试图构建的这种架构系统中,要让患者能直接控制体外肢体。
The point is that in particular in this architecture, this system that we we are trying to create, so to having external extracorporeal limb that the patient can control directly.
即便受试者仍保留部分触觉,为了能灵巧地控制这条机械臂,我们仍需为其添加触觉反馈功能。
In that moment, even if the subject has some residual touch, to have the ability to control this arm in a dexterous way, we need to add a touch on that.
因为如果仅靠视觉观察动作,你将无法高效地使用这个设备。
Because if not only looking at what you are doing, you will not be able to use this device in a very efficient way.
这就是为什么即使脊髓损伤患者保留部分触觉,由于我们使用的是体外肢体,也必须能够为其提供触觉反馈。
So this is the reason why even if there is a spinal cord injury individual with some residual touch, since we are using an extracorporeal limb, we have to be able to provide the touch also in that.
嗯。
Yep.
这完全合理。
It makes complete sense.
而恢复触觉功能早就是你多年来的研究主题了。
And restoring touch was the topic of your work for many years already.
是的。
Yes.
能否简要概述下在这项新研究之前,你们已通过大脑皮层刺激取得了哪些成果?
Can you provide us just with a brief overview of what you've done so far before this new study already with stimulation of the cortex of the brain?
是的。
Yes.
所以我最初的研究是从外周神经植入物开始,也就是将电极植入外周神经——躯体神经中,针对上肢和下肢截肢患者,我们根据仿生手或仿生足上的传感器来相应刺激这些神经。
So I started with working with the peripheral implants or electrodes implanted into the peripheral nerves, in the somatic nerves, and of amputees, both upper limb and lower limb, where actually we stimulated these nerves accordingly to sensors placed on bionic hand or a bionic foot.
通过刺激神经可以实现的是——由于神经仍与大脑相连,通往体感皮层,从最近发表的研究中我们也知道,大脑的这张身体映射图是稳定且依然存在的。
And stimulating the nerve, what you can do is since the nerve is still going to the brain, to the somatosensory cortex, and from the study that also recently has been published, we know that this map of the brain and your body map are stable, are still there.
即使截肢多年后,如果我们刺激神经,仍能在幻肢(幻手或幻足)上唤起感觉知觉。
If we stimulate the nerve, even after years of amputation, you can evoke sensation, perceive on that in on the hand on the phantom hand or on the phantom foot.
实际上,我们正在利用残余的神经活动。
So, actually, we are using what is the residual activity.
但由于手已不存在,我们绕过它直接作用于神经。
But since there is no the hand anymore, we are bypassing and go directly in the nerve.
这些传入神经原本支配着手部,因此若受刺激,仍能唤起相应感觉。
But those afferents were normally innervating the hand, so if stimulated, can evoke sensation on that.
所以我深入研究如何刺激这些外周神经纤维,为义肢和义足创造具有信息价值的感觉反馈。
So I extensively study how to stimulate these fibers and the periphery to create meaningful informative sensation for prosthetic hands and and feet.
后来我转向了脑机接口领域,对于脊髓损伤患者,由于损伤位置在上方,我们无法直接刺激他们的神经。
And then I, like, I move in the in the field of BCI and and where actually we implant we cannot stimulate the nerves in people with spinal cord injury because the lesion is above.
这会阻断信号向上传递。
So that is blocking the message to going up.
因此在这种情况下,我们可以选择靶向脊髓、丘脑核团、皮层或其他脑部结构。
So in this case, we can all target the spinal cord or the nuclei on the thalamus or the cortex or the brain structures.
于是就有了这种靶向初级躯体感觉皮层的方案。
So there is this, like, approach where the idea is to target the somatosensory cortex, the primary somatosensory cortex.
为什么选择这里?
Why?
主要有三个原因。
For three main reasons.
第一是相比丘脑、楔束核等信号传递的深层结构,这里手术更容易触及。
The first one is that is easier to be accessed surgically compared to deeper structures like the thalamus, the the cuneate nucleus, or other regions where the the signal is passing through.
因为只需进行开颅手术移除头皮,就能直接暴露中央后沟的初级躯体感觉皮层。
Because here, we just need a craniotomy to to remove the scalp, and then you have already exposed in the postenter sulcus, the somatosensory cortex, the primary somatosensory cortex.
所以它位于表层,可以通过现有的神经技术进行访问。
So it's superficial and can be accessed with the current neurotechnologies available.
第二点是大脑的这个部分实际上具有躯体拓扑组织结构。
The second thing is that this part of the brain is actually somatotopically organized.
这意味着什么?
What does it mean?
意味着你的身体在这个皮层表面以及大脑的这个部分都有对应表征。
Means that your body is represented on this cortical surface and then on this part of the brain.
因此不同区域会编码并处理来自身体不同部位的信号。
So different parts are encoding and are processing messages of different parts of your body.
也就是说如果你找到手部对应区域,那里会完整表征你的手部包括从拇指到小指的所有手指。
So that means that if you find the part of the hand, will have your hand represented with all your fingers from the thumb to the pinky finger all represented there.
所以这些表征已经是明确分离的。
So it's already well separated.
这与神经纤维的情况不同——神经纤维都是混合在一起的,你需要非常精准地选择激活特定纤维。
And this is, for example, different compared to the nerves when all the fibers are mixed and you need to be very selective in activating one or the other.
在这里,你只需将电极放置在正确位置,就能针对不同部位进行操作。
Here, you just place the electrode in the right position and you can target the different parts.
所以我们有更便捷的接入方式。
So we we have an easier access.
我们具备这种躯体定位组织结构。
We have this hematotopic organization.
最后,它的尺寸足够大便于定位——躯体感觉皮层的尺寸使得与我们现有技术的接口成为可能,因为我们的技术是毫米级的,几平方毫米左右,所以可以精确放置且尺寸匹配。
And finally, is large enough to be targeted in the sense that the size of the somatosensory cortex make the interface with our current technology feasible because our technology is millimeters, squares of something, some millimeters, so we can place this and the size is matching.
其他区域非常小且紧凑,因此我们需要更精细的小电极来定位,因为所有结构都集中在较小的区域,比如楔束核就小得多。
Other region are very small and compact, so we'll you will need a more selective and small electrode to target that because everything is concentrated in a smaller structure like the cuneate, for example, is much smaller.
所有信号都汇聚到那里,然后在你的躯体感觉皮层再次扩展。
Everything goes there and then becomes again bigger in your somatosensory cortex.
由于面积较大,你可以更轻松地放置电极。
So since it's larger, you can place electrodes in an easier way.
因此他们最初的想法就是通过定位这个区域来闭合脑机接口的环路。
So in this way, this was the idea that they had at the beginning to target this area to close the loop of the BCI.
这就是我们在这些研究中做的事情。
And this is what we did in these studies.
我甚至可以告诉你更多关于我们如何开展这项研究的细节,但这大致就是背景情况。
Even I can tell you more about how we arrived at this study, but this is more or less the background.
是的。
Yes.
是的。
Yes.
谢谢。
Thank you.
你已经提到了一些相似点和不同之处,是的,关于外周神经刺激方面。
And you already mentioned some of the similarities and differences, yes, over the stimulation of the peripheral nerves.
你需要处理一束神经,并确定刺激哪一根以及如何刺激。
You would have a bundle of nerves and you need to figure out which one to stimulate and how to do it.
在这里,你有一个更清晰的图景。
Here, you have a more clear picture.
是的,一种元主题组织。
Yes, a metatopic organisation.
是的,你刺激这里,就能得到这个手指和这部分,一切都更加清晰。
Yes, you stimulate this, you get this finger and this part and all is more clear.
你能详细谈谈你之前在外周神经系统研究和现在中枢神经系统研究之间的区别吗?有哪些经验是从之前的研究带到这个新项目中的?
Can you tell more about the difference between the studies that you've done with the peripheral nervous system and now central nervous system, what things you carried from those studies into this new project?
还有哪些是你在之前项目中未曾遇到过、需要解决的新挑战?
And what were the new challenges that maybe you didn't have in your previous projects that you needed to solve?
对,对,对。
Yeah, yeah, yeah.
不,完全正确。
No, exactly.
这正是我进入这个领域时首先做的事情——立即建立平行对比,找出差异和相似之处。
This is what exactly I started to when I approached this field was exactly you create immediately parallelism and differences, similarities.
首先,大脑中这种组织的不同之处在于,正如你提到的,我们面对的是由不同类型皮质神经元组成的神经网络。
And first of all, a part of this organization that is different in the brain is also that, as you mentioned so here we are in a network of neurons, cortical neurons of different types.
而在其他情况下,存在平行传入纤维向上传导。
And in other case, you have parallel fibers afferents that are going up.
这里,当你刺激网络时,整个网络会被激活,并传递这种刺激。
And here, when when you stimulate the network, the entire network is activated, is propagating this.
因此,预测通过刺激实际能达到的效果会更为困难,因为这不再是轴突的一对一激活或类似机制。
And so the the prediction of what you actually can do with the stimulation are a bit more difficult to have because it's not more one to one activation or similar to that for the axons.
这里存在一个更为复杂的神经网络,它还与其他网络相连,包括运动网络、后顶叶皮层以及更高层级的结构。
Here, you have a more complex nectar that is also connected with other networks that are the motor networks, the the posterior parietal cortex with higher level structures.
所以这个神经网络相当复杂,而且处于触觉处理层级中相当高的位置。
So the nectar is pretty complex, and it is also you are quite high in the hierarchy of the processing of touch.
不是吗?
No?
想象你需要人工发送一个信号——从外周神经系统发出的信号其实只经过了机械感受器的初步处理,然后才进入神经传导。
So if you imagine that you have to send a signal artificially, so from the periphery, you actually send something that was just processed by the mechanoreceptor, and then we are in the nerve.
所以我们处于非常早期的阶段,也就是仅经过机械感受器处理的阶段。
So we are pretty early stage, you know, which was just the mechanoreceptor processing.
然后我们把信号向上传递。
And then we send the signal up.
但如果我们向体感皮层发送信号,理论上需要复现的是到达那里之前的所有处理过程。
But if we send in the somatosensory cortex, in theory, what you have to replicate is all the process done up to there.
所以楔束、脊髓、神经核、丘脑等所有环节,因为这些不仅仅是中继站,实际上都在进行某些处理。
So the cune, the spinal cord, the nuclei, the thalamus, everything, because I'm not just relays of I'm actually doing some process.
这方面已有一些重要研究成果。
There are some important works on that.
所以我们的第一个挑战——实际上是莱曼,有个《60分钟》纪录片里他解释过——他最初的想法是:如果我们刺激大脑,什么都不会发生。
So the first challenge for us, and actually is Lehman, there is like a documentary on sixty minutes when he actually explained this, that his first idea was, okay, if we have to do this when we stimulate the brain, nothing will happen.
我的意思是,系统如此复杂,需要完成所有这些处理过程,不可能说我们粗暴地刺激这个脑区就能产生任何有意义的感知信息。
I mean, it's so complex that we have to do all this process that it's not possible that if we brutally stimulated this area of the brain, we can elicit anything being like anything informative.
但事实上他错了,因为即使对这个脑区进行非常简单的刺激,被试者就能感知到类似手指上的触觉并加以描述。
And actually he was wrong because even with a very simple stimulation of this part of the brain, the subject was perceiving sensation like on the finger and able to describe that.
所以这个我们原以为的挑战,实际上并不成立。
So that was actually a thing that we thought was a challenge, but actually was not really a thing.
另一个非常令人惊讶的现象是,当我开始与这位参与者合作时,相比外周神经刺激,大脑刺激被描述为更自然的感官质量。
Another like very surprising thing is that when I started to work with this participant, the stimulation in the brain was described more naturally terms of quality compared to peripheral nerve.
这实际上也让我感到意外,非常令人惊讶,因为我原本认为我们刺激神经后会利用整个信息处理过程,但不知何故信息到达时更失真,产生的感觉更像是干扰性的,不够自然。
That was actually also surprised me for me, like was very surprising because I was saying, okay, we stimulate the nerve and then we exploit all the process of information, but somehow the information arrived more corrupted and then the sensation is more parasitic, not really natural.
然而当我们直接刺激大脑时,受试者报告的大部分时间虽然也有电击感,但更多时候触觉感受相当自然。
Well, if we stimulate the brain directly, the subject is reporting most of the time, also electric feelings, but most of the time, like touch sensation pretty naturally.
因此这又是另一个意外发现。
So this was also another surprising.
当然,大脑刺激的安全标准比外周神经要高些,因为你直接刺激的是大脑,必须避免诱发任何类型的癫痫发作或神经网络过度激活。
And of course, from the level of safety here for the brain stimulation is a bit higher compared to the periphery because of course you are stimulating the brain And what you wanna avoid is to evoke any type of seizure or any type of, you know, network over activation since you are stimulating directly the brain of the subject.
所以安全参数探索范围相对更小,需要谨慎规划每个步骤。
So the level of safety and parameter exploration is a kind of more smaller, and you need to be planned carefully every step.
并非说外周神经就没这么做,但如你所想,大脑刺激在侵入性层面完全不同,我们所有模拟或非模拟刺激类型的探索——记得吗,在大脑这里我们对感官编码技术的运用限制更严格,不过我们还是设法取得了一些成果。
Not that was not done, I mean, also for the periphery, but here we are, as you can imagine, another level of invasiveness in terms of stimulation and also to explore all all the type of stimulation that we by mimetic or not, you remember, here for the brain, we have a little bit more strict exploitation of of the technology to encode the sensation, but we managed them to do something as well.
当然这与外周神经的情况是截然不同的。
But of course, that was a a different thing compared to to the peripheral nerves.
是的。
Yes.
我对此非常好奇。
And I was very curious about that.
是的。
Yes.
你们试图在周围神经系统的工作中创造那些自然的感觉,并且使用了不同的参数。
That you were trying to create those naturalistic sensations in your peripheral work, work with peripheral system, and you were using different parameters.
你们发现某些方法可以产生更自然的感觉。
You found certain things that can create those more naturalistic sensations.
你们如何将那些工作成果应用到中枢神经系统的研究中?
How did you apply from that work to your studies in central nervous system?
这个发现——即使简单刺激体感皮层也能产生更自然的感觉——又是如何影响研究的?
And how did this finding that actually even simple stimulation of somatosensory cortex already feels more natural.
是的。
Yes.
对于人们来说,这在整个仿生刺激的图景中是如何体现的?
To people, how did this play in all this picture of this biomimetic stimulation?
所以这正是其中一个要点,我们实际上采用了与周边神经系统研究相同的方法开始。
So this was was one of the point, and we actually started in the same way as we did for the periphery.
所以我必须提到这一点。
So I have to mention that.
因此,这个体感BCI在成就和结果方面,相比周围神经刺激略有落后,主要有两个原因。
So the the b c the somatosensory BCI, it's a bit behind the peripheral nerve stimulation in terms of achievement and results for two main reason.
首先从历史角度看,2016年我们首次为一名受试者完成了中枢神经系统植入,而现在已有更多受试者完成植入。而早在2000年代初期,针对截肢者的外周神经系统假体植入就已开始。
One is because historically, the first implant was done in 2016 in one participant, and then now there are more participant implanted while for the early two thousand, the peripheral implants for amputees and prosthetics started.
因此从时间线上看存在一定断层。
So there is a bit of gap historically.
另一个原因是,我们这里实现的脑控技术本质上比假体的肌电控制更为复杂——因为需要协调手腕健康状态等多重自由度参数。
And also because in general, here we have then also brain control, a brain control that is more complex to do than EMG control of the prosthetic because you have many degrees of freedom here of the health of the wrist, etcetera.
而将触觉反馈与这些功能相结合的研究,目前尚未像外周系统功能任务组合那样被充分探索。
And combine that with touch is still not soup like explore in the same way as all the combination of functional task for the periphery.
所以我们稍微落后一些。
So we are a little bit behind.
就像我们与利曼在周边神经系统做的那样,我们开始时有大量信息数据,他是研究大脑和这部分皮层如何编码触觉信息的专家。
So as we did it for the periphery with Liman, also, we started so so he had a lot of information data, and he was the expert on that on how the brain and this part of the cortex was encoding tactile information.
我们首先观察到的是在群体水平上——不是单个神经元层面——无论是皮层还是神经中的神经元反应都没有太大差异。
And the first things that we observed was that at the population level, so not at the single neuron level, but both at the population level, the response of neurons in the cortex and in the nerves is not super different.
举个例子来说。
So for example make an example.
比如我按压你的手指然后松开,会有这两个动作:接触和解除接触。
So if I press your finger and then I release, have these two, like, contact and, like, on and offset of the contact.
这在周边神经系统中被编码为接触时的首次神经冲动爆发。
And this is encoded in the periphery as a first burst of activity when they touch.
如果持续按压,会有少量活动但明显减弱。
Then if you stay pressed, there is a bit of activity but much less.
当你松开时,又会引发另一次神经冲动爆发。
And then when you release, there is another burst of activity.
这种响应模式同样存在于大脑的布罗德曼1区。
This kind of response is also present in the brain in the broad area one.
在我们阵列靶向的初级躯体感觉皮层区域,针对同类刺激在群体水平上也观测到这两部分活动。
So this area of the primary somatosensory cortex that we target with our array for the same type of stimulus is present these two parts of activity at the population level.
不过单个神经元的响应方式会略有不同。
Then if you look at the individual neurons are responding slightly different.
但当我们用设备进行刺激时,实际上激活的是神经元群体。
But when we stimulate with our device, we actually activate the group of neurons.
因此在群体水平上,我们观测到了这种相似性。
So at the population level, we we observe this similarity.
这让我们相信,在末梢神经有效的仿生策略可能同样适用于大脑皮层。
So this was making us believe that the biomimetic strategies that were working with the periphery maybe could work also with the cortex.
关于仿生技术,2025年还有另一项研究发表。
So for the biomimetic, there is another study published in 2025.
今年泰勒·霍布斯和罗伯·冈特的研究进一步探索了这种仿生刺激技术,特别是在改善感觉自然度方面——尤其是针对审美感知通道取得了 promising 的成果。
So this year from Taylor Hobbs and Rob Gaunt exploring a little bit this biomimetic stimulation for making the sensation more natural, in particular for those channels that are for aesthetics with promising results.
但我们与Ziehman合作的初衷是想从更简单的起点开始,而不是直接采用现有的生物模拟触觉刺激方案。
But the idea with Ziehman that we had was to try to start a little bit simpler, respect to having already the biomimetic source on the biomimetic stimulation for for touch in general.
我们从这个研究开始尝试结合多通道同步刺激技术——也就是今天讨论的关于触觉引擎与运动的研究。
We started from trying to combine multichannel stimulation and multiple channels at the same time with this study with tackle engines and motion, the one that we are we are talking about today.
试图理解参数如何影响感知,以及如何将多通道信息组合起来编码触觉特征,从而为受试者提供更具信息量的反馈。
Trying to understand how the parameters are influencing the perception and how multiple channels may be combined together to encode some tactile feature to give more a more informative feedback to the subject.
嗯。
Yeah.
谢谢。
Thank you.
你提到这个项目还借鉴了视觉皮层假体的相关技术?
You mentioned that for this project also you used some information from visual cortical prosthetics.
对。
Yes.
在讨论结果之前,我还想深入了解一些背景。
So before we get into the results, I still want to understand more.
展开剩余字幕(还有 445 条)
是的。
Yes.
所以你们还从其他类型的神经假体技术中引入了一些内容到这个项目中。
So you brought also something from other type of neuroprosthetics into this project.
具体是什么呢?
So what was that?
从历史上看,对于脑机接口(BCI)来说,目前所取得的成果都是由同一个团队、同一批人完成的。
So looking at historically, so for the BCI, what was achieved so far was by the same group, by the same people.
由于大脑皮层是按躯体拓扑结构组织的,我们首先需要编码接触信息。
So what we were able to do was since this the the cortex is organized somatoptically, the first point is to encode contact.
因此当用假肢手指触碰时——用食指触碰就感受到食指的触感,用拇指触碰就感受到拇指的触感。
So where the sensation is felt in order that if you touch with the prosthetic hand, when you touch with the index, you fill with the index, when you touch with the thumb, you fill with the thumb.
这其实相当直观:当你放置多通道电极阵列(本研究中用的是子宫电极)时,如果切换通道从皮层外侧移动到内侧,由于大脑的躯体拓扑映射,实际上就是从拇指区域移动到了小指区域。
And that was pretty straightforward because when you place your multichannel electrode array, so the uterine in this case, if you change channel and you go from the lateral to the medial part of the cortex, you actually move from the thumb to the pinky because of the somatography of the brain.
所以这部分实现起来相对容易,我们能够轻松地编码位置和接触信息。
So that was pretty easy to do, and we were able to encode the location and the contact pretty easily.
正如我们在外周神经系统所做的那样,你可以将刺激的幅度和频率与感知对应起来。
Then as we did for the periphery, you can map the amplitude of your stimulation and the frequency of stimulation with the perception.
与外周神经系统类似,我们观察到的是振幅越高强度越大,频率越高强度也越大。
So similarly to the periphery, what we observed was higher is the amplitude, higher is the intensity, higher is the frequency, higher is the intensity.
因此反应的强度是由这两个参数调节的。
So the magnitude of the response was modulated by these two parameters.
通过这种方法,就有可能编码力量,例如。
And with with this, it's possible to encode force, for example.
这实际上就是体感脑机接口的最新技术水平。
So that was actually the state of art of the somatosensory BCI.
能够提供接触感和力量反馈。
So able to provide contact and provide a force feedback.
当然,这已经足以完成功能性任务了。
That is already enough to do functional task, of course.
但是和莱曼一起,我们想,好吧。
But so with Lehman, we thought, okay.
这些设备的灵活性仍然非常差。
The dexterity of these devices is still very bad.
我们需要超越这个水平。
We need to go beyond that.
其中一个原因是它们表现不佳,因为我们提供的信息仍然非常基础。
And one of the things is why they're not very good is because the information that we provide is still very basic.
当我们触摸物体时,能立即感知其形状、纹理、曲率、边缘、温度分布等多种信息——仅靠接触力和压力反馈是远远不够的。
When we touch something, we know immediately the shape of the object, the texture, curvature, edges, where to take the temperature, so many different, like, information at the same time that contact and force are not enough.
为此,我们采用了我之前提到的两种方法。
So to do that, we proceed as as I told you in two ways.
第一种方法是研究大脑和神经元如何编码边缘、运动和曲率信息。
One way was, okay, let's see how edges, motion, curvature is encoded by the brain and in the neurons.
即这些触觉特征如何在神经元中被编码。
So how the these tactile features are encoded in the neuron.
而纹理、边缘等特征已被Slimon团队深入研究过。
And textures, edges, all these type of stuff was extensively studied by Slimon and his team.
另一方面,我也开始探索视觉皮层假体,因为这是另一种感觉假体,实际上早在六七十年代就已开始研究,之后出现了断层。
On the other hand, I started to explore also visocortical prosthetics because another type of sensory prosthetics that actually started before this in the sixties, seventies, then there was a gap.
而现在,西班牙、荷兰和美国的不同研究团队又重新开展这项工作。
And now, again, different groups in Spain and in Netherlands and in The US, they're they're doing this.
Neuralink公司也有一个关于视觉假体的项目。
And also Neuralink has a program on on visual prosthetics.
实际上,这个想法类似——将电极或某种电极植入V1区(初级视觉皮层),或者V2、V3甚至V4区,但主要聚焦于V1区,因为它与S1区存在相似性,正如我们研究S1区而电极植入V1区那样。
Actually, it's was a similar idea to place an electrode or type of electrode on the V one, so in primary visual cortex or also other V two, V three, and up to v four, but mostly like v one was focused on v one since there are similarities with s one because we are in s one and and those were in v one.
事实上,曾有实验表明:当你刺激视觉皮层时,会诱发光幻视现象。
And, actually, there were this experiment where when you stimulate the visual cortex, you evoke a phosphate.
即通过单通道刺激时,会产生不同形状或大小的模糊对比图像。
So this blur contrast image that's of different with different shape or different sizes when you stimulate from one channel.
我在非人灵长类动物实验中观察到,它们能够将这些光幻视组合成线条和字母。
And I I observed that in man in nonhuman primates, they showed that it they were able to combine these phosphates in lines and letters.
所以我的直觉反应是:好吧。
So my intuition was, okay.
这里没有触及。
Here it didn't touch.
我们没有磷酸盐现象,但当我们从一个通道刺激时,实际上受试者会在这里感知到一个光点。
We don't have phosphates, but when we stimulate from one channel, actually, the subject is perceiving one spot here.
如果我们把这个和另一个结合起来会发生什么?
What happened if we combine this one with the other?
所以这是个相当简单的想法,不是什么高深科学,但他们说好吧。
So it was pretty trivial idea, nothing like rocket science, but they're saying, okay.
让我们尝试以有意义且信息丰富的方式组合这些投射场,来编码某些信息,比如关于触碰你手指的物体的方向性和方位。
Let's try to combine this projected field in a meaningful way, in informative way to encode some information, for example, about the directionality and the orientation of something touching your finger.
为此,我们首先研究的是能否线性叠加投射场。
To do that, one of the first thing that we did was to study if you can add projected field linearly.
也就是说,是否真的能将这些投射场逐一相加,或者当你用两三个刺激时,它们的组合会呈现某种非线性叠加并产生新的模式。
Like, if you you can really add these things one to another, or when you stimulate with two or three, the combination is some kind of nonlinear combination and create another.
我们最初观察到的现象是:它们实际上具有相当好的可加性。
So what the first thing that we observe is that it are actually pretty additive.
当你拥有这些投射场时,即当你刺激时感知到的皮肤区域,你可以将其组合成各种形状。
So when you have these projected fields, so the patch of skin that is perceived when you stimulate, you can combine that in shapes.
受试者报告称能感受到具有特定方向的边缘,这与我们进行的组合方式相符。
And the subject was reporting to feel an edge with the specific orientation accordingly to the combination that we were doing.
这相当引人注目,因为有时我们进行一些奇怪的组合,而受试者确实在这里描绘出这种感知,正如通过投射场组合所预测的那样。
And it was pretty remarkable because sometimes we did like some weird combination, and the subject was actually drawing this perception here as the one predicted by the combination of the projected field.
因此第一个结果实际上是关于方向的,而且我们在两名受试者身上进行了这项实验。
So the first result was actually about the orientation, and and we did this in two subjects.
这确实非常、非常令人惊讶。
So the what was pretty, pretty, like, surprising.
这是研究的第一个突破点,因为当我们观察到可以组合这些投射场并形成形状时,我们就有了继续研究的所有思路。
And that was the first kick of the study because when we observed that it was possible to actually combine these projected fields and have a shape, we had all the ideas to proceed with the study.
这非常了不起。
That is remarkable.
另外,回到你之前提到的,至少Bosmaier教授最初预期通过刺激体感皮层来唤起任何感觉会很困难。
Also, going back to what you said that there was a different expectation at the beginning, at least by Professor Bosmaier, that it will be difficult to evoke any sensations, yes, by stimulating somatosensory cortex.
而且你当时认为这可能不如外周神经系统刺激那样自然。
And also you were thinking that it might be not as natural as with the peripheral nervous system stimulation.
为什么结果实际上恰恰相反?
Why did it turn out actually even in opposite?
是的,它引发了更自然的感受,而且你知道,这并不成问题。
Yes, it was evoking more naturalistic sensations and, you know, it wasn't problematic.
从现在回顾的角度来看,你如何解释这一点?
Looking now from current perspective back, how do you explain this?
你怎么看?
What do you think?
仍在讨论中。
Still under debate.
所以我们仍在尝试解释这个现象。
So we are still trying to explain that.
但我们有一个想法是:如果你想象外周刺激时,你是在非常早期的阶段进行刺激,可以想象你的人工刺激引入了相当多的噪声信号。
But one idea that we had was the fact that so if you imagine that when you stimulate peripherally, you stimulate at the exactly very early stage, and you can imagine that you are inserting with your artificial stimulation pretty noisy signal.
对吧?
Right?
因为这不同于机械感受器的输出,更像是人工激活。
Because it's not as the the mechanoreceptor output, but it's more like an artificial activation.
类似地,你知道有个游戏:你在前面的人背上写字,然后对方要在前面画出来。
And similarly to do you know with this there is like a a game where you write a letter or something on the back of the person in front of you, and then the other one is to draw in in the front.
最后信息往往变得一团糟。
And at the end, the message is a kind of mess.
我们认为类似地,我们在外围植入了噪声信号,然后在不同阶段会有不同的突触。
We think is similarly that you we insert some noisy signal at the periphery, and then you have different synapse at different stages.
但这种噪声会被不断放大、放大、再放大,最终形成非常明显且失真的信号。
But this noise is kind of amplifying, amplified, amplified, and at the end, arrive very apparent and parastatic.
因此这变得无法解读。
And so this is not interpretable.
而如果直接激活目标神经元,就能诱发更接近真实的有意义感觉。
While if you go directly there and you activate the neurons and the correct neurons already, you can evoke maybe a more like, a meaningful sensation.
这是其中一个假设,但我们并不确切知道为何存在这种差异。
This is one of the, you know, the the hypothesis, but we don't know exactly why there is this difference.
实际上凯斯西储大学的Emily Gratzik刚在元档案库发布了一项研究,对同一受试者同时进行了外周和皮层刺激。
There's actually one study just put on the meta archive by the case case Western Emily Gratzik had one participant both in a single individual, both the peripheral and the cortical.
也就是在同一名受试者身上进行的。
So in the on the same subject.
而且该受试者能够比较两种刺激方式,表示皮层刺激比外周更自然。
And, also, his subject that who can actually compare the two said that the cortical stimulation is more natural than the peripheral.
我想她对此也有一些理论。
I think she she also has some some theories on that.
但在这里我们刺激的区域也在编码。
But then also here for the so the area that we are stimulating is also encoding.
已经有专门的神经元对特定特征做出反应。
There are specialized neurons already responding for specific features.
所以这不是信息到达皮层的第一个区域。
So this is not the first area of of the cortex where the message arrives.
所以3D区域位于中央沟内,因此难以触及。
So there is area three d that is in the sulcus, in the central sulcus, so it is difficult to reach.
那甚至处于更早期的阶段。
That is even more at the early stage.
所以它可能更类似于V1区,但无法触及。
So it's probably more similar to V one, but it's not accessible.
因此我们选择了位于表面的宽带1区,可以通过我们的手术植入物接触到。
So we go on area on area one, broadband area one that is on the surface, so it's accessible with with our surgical implant.
刺激这个区域时,我们会产生不同种类的感觉。
And stimulating that, we have sensation of different kind.
但其中有些对大脑来说也是寄生性的。
But some of that are also parasitic also for the brain.
我不想说所有感觉都是自然的。
And I don't wanna say that everything is natural.
只是说可能存在更多自然通道。
But it's just that there are maybe more channel naturally.
虽然它被描述为更自然,但这仍是我们正在研究的课题。
There's also is described as more natural, but it's still something that we are investigating.
但有趣的是,关于个体投射场的类型特征,当你组合这些特征时,它们会被感知为某个方向的线条。
But in this case, what's what's interesting that regarding the type of the individual characteristic of the individual projected field, when you combine that, those are, like, perceived as a line in some direction.
这确实非常显著。
So that was remarkable.
这绝对是非凡的发现。
It is absolutely remarkable.
患者们报告了什么情况?
And what did the patients report?
他们体验这些感觉时的具体经历是怎样的?
What were their experience having all those sensations?
他们对能够感知到某些事物感到非常兴奋。
They were pretty excited about the the fact to perceive something.
你明白吗?
You know?
一般来说,你必须想象他们体验到的触觉通常没有任何背景信息。
In general, you have to imagine that they experience when we provide touch is normally without any context.
不。
No.
他们就在那里。
They are there.
我们进行刺激,然后他们必须描述自己的感受。
We stimulate, and they they have to describe what they feel.
这实际上相当困难,就像你在黑暗中,我把某物放在你手上,而你只能被动接受——因为他们无法主动探索。
It is actually pretty difficult because it's a kind of similar if you are in the dark and I place something on your hand and just passively because they cannot explore.
对吧?
Right?
所以我们进行几秒钟的刺激感知,然后他们需要说出那是什么。
So we stimulate and perceive something for a few seconds, and then they need to tell what was that.
因此对他们来说,每次要描述这种感觉都不太容易。
So every time for them, it's not super easy to describe the sensation.
当然,你不想给他们带来偏见。
And then, of course, you you don't wanna bias them.
所以你可以询问,然后他们可以自由地按照自己的想法描述。
So you can you ask, and then they are open to describe as they want.
但当感觉变得更像这样,更多通道化,带有更多特征时,他们能更清晰地描述出来。
But then when the sensation becomes more like this, more multichannel, more with some feature on that, they were able to describe this more clearly.
我认为他们对此很兴奋,因为不再只是单点感知,而是能感受到某些特征或结构。
And I think they were excited about that because instead of one point where they have to say something here, there is some feature or some something in that.
我觉得这非常酷。
And I think it was pretty cool there.
我有一些相关视频,也包括运动感知的。
I have a v some videos on that, but also for motion.
因为下一步——现在回想起来很简单,但当时是首次发现——我们想:
Because the next step was, again, in my opinion now posteriori pretty trivial, but at the time was not because it was the first time that we saw we thought, okay.
如果我们把这些投射场结合起来,就能唤起线条感,被试者可以判断是水平线、垂直线还是无线条之类的。
If we did like, we combine this projected field together and you can evoke, like, a kind of line or an orient the the subject can tell if it's a horizontal or vertical line or there is no line or something like that.
让我们看看如果快速连续激活会发生什么。
Let's see if we activate one after the other very quickly.
发生了什么?
What happened?
也许受试者会如何感知这种现象。
If something maybe how the the subject will perceive that.
这里又出现了同样的问题:通道切换的速度应该多快。
And again, here, but how quick, how we how fast we we should change channel one from the other.
再次强调,我参考了视觉神经科学的研究。
And again here, look I look to the neuroscience in vision.
其实视觉领域有个实验,大概是六十年代甚至更早的。
So there is actually an experiment in vision pretty, like, I think in the sixties of even before.
我们描述了闪光灯的现象。
We describe the fact of flashing lights.
比如有两个交替闪烁的灯,你会感觉看到了两盏灯。
So if you have, like, two flashing lights and you have they are alternating, you feel you see, like, two lights.
但当两个信号之间的时间间隔变得非常短时,你会开始感知到物体在朝另一个方向移动。
But then if the temporal gap between one and the other is becoming very fast, you start to perceive that this one moving on the other direction.
同样地,如果间隔太短,你就会开始同时感知到两个信号。
And then again, if the you know, if it's too short, then you start to perceive too simultaneously.
所以我们做的第一个测试就是用不同时间间隔激活两个投射区域。
So the first test that we did is to activate two projected fields with different temporal gaps.
在短时间间隔下,受试者表示能同时感受到两次触碰。
And in with short temporal gaps, the subjects were saying, I feel two touches simultaneously.
当间隔缩短到约一秒或五百毫秒时,受试者会开始感知到一个向上移动的物体。
Then if you start to have a gap under, like, one second, five hundred millisecond, the subject will start to perceive one thing moving up.
而如果间隔过长,就会变成两次交替的敲击感,不再有连续运动的感觉。
And then if the gap is too much, two taps, like alternating, not anymore a continuous motion.
于是我们意识到,只要在通道间设置正确的时间间隔,就能在皮肤上编码连续运动。
So we realize that we can encode continuous motion on the skin with the if you have the correct temporal gap between one channel and the other.
所以我们重复了之前的实验,但这次不是给出线条,而是用不同间隔来激活这些通道。
So we repeated the task before, but instead of giving lines, we activate these channels with actually different gap.
受试者能够分辨出,我感觉有什么东西在我的皮肤上朝这个方向移动,或者另一个方向。
And the subject was able to tell, I feel something moving on my skin in this direction, in this other direction.
所以我既能判断是否有运动,也能判断运动的方向。
So I was able to tell both if there was motion or not and also in which direction.
这确实非常酷,因为这种现象在视觉领域的磷光现象和视皮层假体中也得到了验证。
That was really, pretty cool because also was was something that also was demonstrated with phosphine and visocortical prosthetics for vision.
这种平行性让我着迷——在两个完全不同的领域,使用相同的范式,我们竟然能用相似的编码策略实现类似的效果。
So that that parallelism, I was really fascinated by the fact that in both devices, actually, in two two different field with the same paradigm, we're able to encode a similar thing, but in two different domains with the same encoding strategies.
这就是为什么最近我们加强了交流,之前这两个领域都是独立工作,但现在我们正尝试更多沟通,看看视皮层假体和体感皮层假体之间能如何相互借鉴。
This is the reason why recently we have talked more because the fields before were working, like, separately, but now we are trying to communicate more and see what is working in visocortical prosthetics and somatosensory cortical prosthetics and talk more because of that.
嗯。
Yeah.
以及这两个领域如何互相促进。
And how those two fields can help each other.
是的。
Yes.
一个领域的实验会推动另一个领域的进步,反之亦然。
Experiments in one would advance another and vice versa.
是的。
Yes.
以及那些关于感官知觉的主要普遍原则。
And to those main principles of in general, sensory perceptions.
是的。
Yes.
相同的原理似乎在不同模态中都适用。
They seem to work in different modalities, the same principles.
没错。
Yeah.
这太美妙了。
That's beautiful.
那么你能总结下这项研究的目标以及最终实际取得的成果吗?
So if you would summarize the goals of the study and then the results that you actually got at the end?
是的。
Yes.
这项研究旨在扩展体感脑机接口的人工触觉库,尝试借鉴人类灵长类动物研究的成果,利用我们已知的大脑如何编码运动、边缘及更复杂感觉特征的知识,同时从视觉皮层假体获取灵感,尝试编码更复杂的内容。
So the study was aiming to expand the repertoire of artificial touch for somatosensory BCI and trying to leverage the knowledge from the human primate research and what we know about how the brain is encoding motion and edges and more complex sensory features, and also taking inspiration for visocortical prosthetics, trying to encode something more complex.
我们取得的成果是,通过皮层内微刺激实现多通道同时刺激多个通道的刺激,能够编码边缘和定向触觉刺激的感觉,被试者能够识别这些触觉刺激。
So what we achieve is that simultaneous stimulation of multiple channels in the with the intercortical microstimulation was able to encode sensation of edges and oriented stimuli, tactile stimuli, that the subject was able to recognize.
这些通道的连续激活则能够编码运动信息。
And the sequential activation of these channels were able to encode motion.
最后,我们实际上还进行了两项更复杂的实验。
And then finally, we actually did two more complex experiment.
其中一项是尝试用这两种机制编码更复杂的形状。
One was to try to encode more complex shapes with the two mechanism.
一个是同时激活。
One was simultaneous activation.
所以我们定义了一些形状。
So we define some shapes.
在这个案例中,我们选择了字母,但也可以是任何你拥有的不同形状。
In this case, we choose letters, but can be any different shape that you that you have.
通过同步刺激进行编码,更像是按压皮肤时的感觉,或者用序列刺激来描摹形状。
Encoded that with simultaneous stimulation, more like if you press this on the skin, imagine, or to trace that with the sequential stimulation.
比如你有一个字母然后进行描摹。
So if you have a letter and you trace.
我们的假设是触觉具有一种称为图形觉的特性,因此你可以通过触觉来阅读。
And our hypothesis was you have a property of your sense of touch called graphesthesia, so you can read with your sense of touch.
如果我在你皮肤上描摹字母,你能读出我写的内容,而且这种方式比在皮肤上压印相同字母效果更好。
So if I trace the letter on your skin, you are able to read what I'm writing, and you are actually much better than compare if I indent the the same letter on the skin.
事实上我们发现,如果以自然触觉方式描摹形状轮廓,受试者能更好地区分不同形状。
Indeed, we found that the subject was able to discriminate the different shapes better if you trace the shape of the context as the natural touch.
这是首次对功能性更强的方案进行比较。
So that was the first comparison of something more functional.
接着我们在闭环状态下进行了实验,使用了假体头部装置。
And then we did an experiment in close loop, so with the prosthetic head.
因为我们的想法是,既然受试者现在能感受到更复杂的触觉,那就尝试用机械手、机械臂来测试。
So because the idea was, okay, Now that the subject can feel this more complex sensation, let's try with the robotic hand, the robotic arm.
当然,我们在传感器方面存在一些局限,因为要传递运动感觉,就必须能追踪假肢手的运动。
So the but, of course, we had some limitation in terms of sensorization because to to to give the sensation of motion, you need to be able to track motion on the prosthetic hand.
所以需要为此配备传感器。
So you need to have sensors for that.
为此我们需要电子皮肤。
So we need electronic skin for that.
我们使用了一款原本设计用于方向盘操控的脑控机械臂进行实验。
So we did an experiment with the brain control robotic arm that was actually used for steering a wheel.
在这个实验中,我们编码了方向盘左右转动的运动感觉,要求受试者根据感知到的运动感觉来相应调整动作。
So in this case, we encode a sensation of motion, apparent motion of this steering wheel in one or the other direction, And the subject was asked to correct the motion accordingly to the sensation of motion perceived.
这只是一个概念验证,证明受试者能够通过脑信号控制机械臂。
So this was just a proof of concept to show that the subject was able to control with the brain signal and the robotic arm.
同时利用这种人工触觉——这种更复杂的感知来完成功能性任务。
And at the same time, you exploit this artificial sensation, this more complex sensation to do a functional task.
因此我们证明了这是可行的。
And so we proved that that was possible.
这是最初的构想,现在我们正在研究更复杂的领域,比如纹理感知之类的。
So this was the first idea, and then now we are going through something more complex and maybe textures and something like that.
是的。
Yes.
那么既然你已经提到了一些内容,接下来你们计划做什么?
So what what are your next step now now that you started already mentioning something?
对。
Yes.
下一步计划是什么?
What's what's the next step?
下次你来我们播客时,我们会听到哪些新进展?
What what we will be hearing about next time you come to our podcast?
没错。
Yeah.
是我,我的意思是今年我不能提交,因为我实际上是评委会主席和君主。
It's a me I mean, this year, I cannot submit because I'm I'm actually the the jury chair and a monarch.
今年我们不会提交,但也许明年会。
That's this year, we'll not submit, but maybe next year.
这实际上是一个显著的结果,我们正试图在更多受试者中复现,当然因为这次只有两个受试者,我们还想在所有其他受试者中测试这个。
That is actually it was a remarkable result that we are trying to replicate with more subjects, of course, because this was in two subjects, and we want to test also this in in all the other subjects.
但思路是回归到仿生刺激,深入研究大脑如何编码这些特征,用仿生刺激来编码纹理等特征,并与传统方法进行对比,以验证仿生理论在此是否同样有效——这实际上是我们需要进一步探索的,以实现更复杂的触觉编码。
But the idea is to going back to the biomimetic stimulation again and define like something more on the biomimetic studying how the brain is encoding this feature and use biomimetic stimulation to encode maybe textures and and compare that with more classic way to understand that if really the biomimetic theory is valid also here and is a way to I mean, it is actually what we have to go and to encode more complex sense of touch.
然后皮层体感假肢还面临另一个挑战——S1与M1区域的神经通讯问题。
Then there is another challenge for the cortical somatosensory prosthetics that is actually S1M1 communication.
当我们刺激S1区时,与周边刺激不同,这里存在神经网络:刺激S1区会引发M1区大量激活。
So when we stimulate on S1, so differently compared to the periphery, since here we have a network, but actually you stimulate on s one, you have a lot of activation on m one.
这里正是我们获取控制手部动作信号的位置。
So we're actually where we take the signal for controlling the the hand.
这不仅仅是人为干扰信号。
And it's not just artifact.
并不是说我们刺激S1区就会产生这种干扰信号,从而破坏我们的运动解码器或影响我们控制手部的能力。
It's not that if we stimulate an s one, we create this artifact that then can ruin our motor decoder or can affect our ability to control the hand.
但实际上它是在改变M1区的活动,因为这些是信息。
But it's actually modifying the activity in m one because it's information.
所以如果M1区根据正在发生的触觉事件从S1区接收信息,我们就需要创建能够协同接收这些信息的运动解码器,以构建一个功能性的双向触觉脑机接口——因为这是我们想要实现这类双向假体所面临的挑战。实际上这对周边神经系统不是问题,因为我们是从肌肉记录信号。
So if m one is receiving information from s one accordingly to the touch the tactile event that are happening, so we need to create motor decoders that are able to synergistically take this information in to create a functional bidirectional BCI for for touch because that is a challenge that is is there for for us that we wanna do this type of bidirectional prosthetics, and it was actually not really a problem for the periphery because we were recording from the muscles.
即使你刺激神经,也不会在肌肉中产生大量干扰信号或激活。
And then even if you stimulate the nerve, you don't create a lot of artifact or a lot of activation in the muscle.
不会。
No.
你实际上可以解码这些信号。
You can actually decode that.
但对于大脑来说,由于所有信号都在那里,S1区会引发大量我们需要考虑的调制作用。
But for the brain, since everything is there, you have a lot of modulation induced by s one that we need to take into account.
是的。
Yes.
好的。
Yeah.
我会密切关注后续进展。
I will be looking forward towards the updates.
你认为该项目的主要创新点是什么?
And what do you say were the main innovations by the project?
就是那个。
That one.
那个词。
That word.
是的。
Yes.
毫无疑问,主要创新在于人工触觉实现的精细度和丰富度——这类特征从未在任何类型的神经假体(无论是外周、脊髓还是皮层)中被编码过,此前根本无法实现这种效果。
For sure, the main innovation is about the level, the richness achieved in terms of artificial touch because these type of features have not been encoded in any type of neuroprosthetics in general, considering peripheral, spinal, and cortical before was not possible to achieve something like that.
或许我有兴趣回到外周神经领域,看看能否在运动控制方面为外周神经刺激做些改进,但这之前是不可能实现的吧?
And maybe I'm interested to go back in the periphery and see if I can I can do something with engine motion for for the peripheral stimulation, but this was not possible?
而且我确实很喜欢我们提到的与视觉皮层假体的这种比较,因为我认为这项研究能真正建立两个领域之间的联系。
And I think also I really like this comparison with visocortical prosthetics that we mentioned because it's I think is is this is a study that can really put the connection between the two fields.
他们尝试了许多事情,有成功也有失败,反之亦然。
And there are many things that they try and they fail or they succeed and vice versa.
去那里仔细研究他们实现的一些成果是否也适用于这里会非常有用,因为这是一个明显的例子,表明我们可以将一个领域的成果转化到另一个领域。
It will be very useful to go there, look carefully if some of the things that they manage to achieve is valid also here, because this was a clear example where actually we can translate some result in another field.
也许我们可以用其他我们容易实现或投入更多时间实现的东西做同样的事,看看是否也适用于中脑皮层假体。
We can do maybe the the same thing with the other other things that we we achieve easily or we achieve because we invest more time in that, And we can see if is can can work also for mesocortical prosthetics.
是的。
Yes.
说到这个,你提到视觉假体实际上是最早人们真正想要创造的之一。
And speaking about that, you mentioned that visual prosthetics was actually, it was one of the first that people really wanted to create.
是的。
Yes.
但由于其复杂性,最终被放弃了。
But then because of the complexity of it, yes, it was abandoned.
人们转而研究人工耳蜗植入,这是一个非常成功的项目。
People switched to cochlear implants, which was a very successful project.
但现在看来,视觉神经假体技术正在再次兴起。
But now it looks like the visual neuroprosthetics is on the rise again.
那么说到这里,神经假体领域目前的现状如何?
So with that said, what is the current picture in the neuroprosthetics world?
现在又流行什么研究方向?
What is again being popular?
主要的研究和工作领域有哪些?
What are the main areas of research of work?
主要趋势是什么?
What are the major trends?
在这个领域,我们在不久的将来可以期待什么?
And what can we expect in the near future in this field?
现在从更宏观的角度来看。
Just taking more global perspective now.
好的。
Sure.
没问题。
Sure.
不。
No.
正是如此。
Exactly.
首先,得益于大量投资,这个领域正在以惊人的速度发展。
So first of all, it's it's feel it is a field that is growing incredibly thanks to the investments.
而且我认为公众兴趣也推动了这一趋势。
And also, I think also the the the public interest also push on that.
就个人而言,这很酷。
And personally, it's cool.
所以我感觉越来越多学生对这个领域的工作充满热情。
So I think more and more, I feel students that are super excited to work in this in this field.
总的来说,这对这类神经修复领域是个好现象。
So this is in general a good point for this type of neuroprosthetic field.
随着新型电极和接口的出现,我认为这确实可能改变我们现有的可能性——因为直到几年前,特别是对于刺激技术,也包括记录技术,获得FDA批准的电极非常少,CE认证的更少,但FDA批准用于这类研究或临床干预的更是寥寥无几。
With the coming of new electrodes and interface, I feel that this can be really something that can change a bit the possibilities that we have because up to now, a few years ago, in particular for stimulation, but also for recording, very few were the electors FDA approved and CE Mark even less, but FDA approved for this type of research or this type of clinical intervention.
现在有更多公司正在开发新型脑机接口技术,这将为人类研究和临床试验开辟更多可能性。
So now there are more companies developing novel type of interfacing with the brain that can open up the possibility to do more in human research and in human trials.
正如你提到的,视觉皮层处理可能在多年前就开始了,但考虑到当时可用的脑接口技术还不足以实现这一目标。
And exactly as you mentioned, the visocortical proceeding maybe before, years before, considering also the technology available to interface the brain was not enough to achieve that.
但借助高分辨率、多通道的技术,比如Neuralink提出的可以深入大脑的方案,或是能够靶向不同区域的接口技术。
But with a technology with high resolution, high channels count, higher channel counts, maybe go deeper as the Neuralink is proposing or or something that can target the different areas.
因此我觉得现在有更多工具可用,这将扩大应用范围。
So I feel that more tools are available, so this can expand the the the usage.
毫无疑问,运动皮层接口(PCI)历史上最初是作为光标控制开始的,现在他们称之为赋予用户'数字自主权'——能够控制电脑、智能手机等。我认为这很快就能帮助患者,正如Neuralink、Synchron等公司提出的主要目标之一,实际上我指的是对患者的临床益处,以及可用的研究工具和设备。
For sure, the motor PCI historically is the one that started as a control of a cursor to give what they call now digital independence to the user so be able to control your computer, your smartphone, etcetera, I think is is something that can soon help patients at at what Neuralink, Synchron, and other are proposing as one of the main points, no, for the I mean, I'm I'm saying for, actually, the clinical benefit for for the patient, you for research tool and and devices that are available.
特别是对于假肢技术,正如你所知,NCI奖项也多次提到,我们现在每秒传输位数和单词数都在增长,这使得我们能够以接近自然语速的方式进行非常自然的交流。
And especially for prosthesis, I think, as you know, and also the NCI award note is mentioning this multiple times in the sense that there is growing in terms of bit per second and and words per second that we can to have a very natural way to communicate with the natural pace and that we have now.
在内部言语研究中,他们展示了言语神经假体的非常有趣的应用。
In inner speech, they show so but they are very interesting applications of of speech neuroprosthetics.
体感功能当然是运动功能实现物理世界操作的必要下一步,比如控制机械臂和手进行物理交互。
The somatosensory is, of course, the, I think, the next step necessary for the motor to be really to move on something physical in the physical world and control robotic arms and hand and interact with that.
我认为认知神经假体领域也非常值得关注,因为它涉及与大脑其他区域的接口尝试建立通讯。
And I think would be the field of of, you know, more cognitive neuroprosthetics, I feel is also very interesting and to look because it's interfacing with other area of the brain and trying to to communicate.
归根结底,如果我们总结应用场景,就是能够解码大脑信息并用于特定目的——无论是视觉、触觉信息的编码传递,还是如何准确向大脑输入信息。
Because at the end, I think if we summarize the application or in the you know, able to decode information from the brain and use that for something or to communicate and encode information that can be for vision, that can be for touch, but how to communicate that information right into the brain information.
因此我认为相关算法正在不断涌现。
So I think there are more and more algorithms.
有些人采用更偏向黑箱的AI方法来实现信息输出。
There are people following more AI based approach, more like a black box that able to provide information.
但我个人更倾向于先理解大脑工作机制,在此基础上再应用AI方法。
And but I feel I'm I'm more from trying to understand the mechanisms of how the brain is is working and trying to apply that and maybe then AI based mechanism after that.
不过AI方法的进步确实与这个领域的发展密切相关。
But also the the increase and the the growth of AI methods are is connected with that.
如果我们考虑用于语音的大型语言模型,或者其他应用。
If we think a language large language model for speech, for example, or or others.
所以我认为还有很多很多其他的机会。
So I think there are many, many other opportunities.
是的。
Yes.
是的。
Yes.
我能看到这个领域正在迅猛发展。
I can see that the field is exploding.
我们已经有好几个团队在研究神经假体了。
We have several teams already coming up with neuroprosthetics.
是的。
Yes.
不。
No.
这简直太神奇了。
It is absolutely amazing.
说到这个,我听了一位我认为非常出色的教授关于人类感官感知的讲座。
And speaking about that, I listened to a lecture of one of, I think, wonderful professors on the topic of, in general, human sensory perception.
他提到理论上存在实现《黑客帝国》那种矩阵体验的可能性——通过刺激我们的神经系统来创造周围现实,唤起包括视觉、听觉以及躯体感觉在内的所有感知。
And the thing that he mentioned that in theory, the possibility of having this matrix like experience, like in the movie Matrix, yes, when the reality is being created around us by stimulating our nervous system and evoking all the sensations that are around us, including visual, auditory, and of course, somatosensory that theoretically it is possible.
也就是说我们可能生活在一个与现实同样真实的虚拟世界里,但从技术上讲目前还无法实现。
So we we can live in a virtual world that will be as real as ours, but technically it's still not possible.
那么包括你们工作在内的研究进展,距离实现这种完全自然感知的虚拟世界还有多远?
So how close are we getting with the development, including your work, yes, to the time or to the possibility when this completely naturalistically feeling a virtual world will become possible?
你怎么看?
What do you think?
老实说,我觉得我们还差得很远。
I feel honestly, it's we are far from that.
我也希望如此,因为我不想离开现实世界。
I I hope as well because I don't wanna leave it.
我想逃离的是现实生活,不是虚拟世界,而是这个人。
I wanna leave the real life, not the the virtual one, but this person.
不过确实。
But yeah.
我想说的是,我们的受试者已经在使用虚拟现实环境,并且能控制虚拟肢体。
So what I wanna mention is that it's true that our subjects already are already using virtual reality settings, and they control the virtual limb.
他们在操作时能感受到来自虚拟肢体的感觉。
And they can feel from the virtual limb while they are doing stuff.
我们并不总是使用实体机器人,因为它会消耗能量、产生噪音还可能损坏。
So we don't use always the physical robot because it's burning energy and is also noisy and can break.
只有在必要时我们才会使用它。
So when when when it's needed, we use it.
但如果我们需要在虚拟现实中运行某些内容,也可以轻松放置物体并进行参数设置。
But if we wanna have something that we can run-in virtual reality, we can easily also place objects and and parameterize that.
所以从技术上讲,受试者已经在虚拟现实中使用手臂,并能体验到虚拟现实中的感觉。
So so, technically, the subject is already using an arm in virtual reality, and they can experience sensation from virtual reality.
实际上非常有趣的是,为什么他们在虚拟现实中描述的感受与物理世界不同——在物理世界里他们能看到机器人握人的手并真实感受到触感。
And it's actually also very interesting why why they describe experience in virtual reality compared to the physical world where it's actually the physical world where they see the robot shake the hand of a person and they can feel that.
这与虚拟现实中的体验形成鲜明对比。
That is a very different experience compared in the in the virtual reality.
但关键在于,我们仍严重缺乏实现所需接口水平的技术,在我看来这关乎信息编码。
But the point is that we are still really lacking of of technology to interface at the at the level that is needed, in my opinion, for encoding.
我们能在视觉皮层手术中观察到这点,同样在我们的案例中——我们只能通过有限信息覆盖指尖区域来诱发触觉。
We we can see in this visocortical procedure, but also in our case where we can, yes, evoke sensation on the fingertip only because we can cover only that part and with the limited amount of information.
因此我们的触觉仍是贫乏版本,是对自然触觉的苍白再现。
So our touch is still an impoverished version is is still a pale representation of the natural touch.
这就是为什么我认为前路依然漫长。
So this is the reason why I feel that the way is still long.
以我们为例,本体感觉仍然缺失,这是相当关键的信息。
There there there's still in our case, for example, proprioception is still missing or rather important information.
所以在我看来,我们距离目标还很遥远。
So in my opinion, we are still far from that.
但我们的目标是复制并真正实现与大脑的沟通。
But we the goal is that, is right to replicate and really commune and and find a way to communicate with the brain.
这在我看来将成为治疗疾病的关键转折点,并总体上将我们与外部设备连接起来。
That is my belief is would be the game changer in terms of treating diseases and in general to to connect us with the external devices.
谢谢。
Thank you.
还有一个问题与最近我们可获得的信息有关。
And another question is related to what became available to us recently.
在此之前,普遍认为当肢体被截肢时,大脑会发生重组
Until this time, I think a general opinion was that when the limp gets amputated, there is reorganization that is happening in the brain and that there is a takeover of the adjacent areas of the brain area that was responsible for that limp.
有一项纵向研究表明可能并非如此。
And there is a longitudinal study that is showing that that might not be really the case.
我认为这项研究最近获得了广泛关注
So I think this research got a lot of attention recently.
我想听听您对此的看法
So I would like you to comment on that.
那么这些最新发现是什么?它们意味着什么?
So what are these recent findings and what do they mean?
对于神经假体领域和脑机接口领域整体而言呢?
And for the field of neuroprosthetics and for the field of BCIs in general?
是的。
Yeah.
不,不,这是个非常好的观点,因为实际上,我觉得这项研究的第一作者是安德森,今年——确切说是上个月发表在《自然神经科学》上的,与剑桥大学的塔玛·麦金合作的。
No, no, that's a very good point because actually it was, so I feel that so Andersson is the first first author of the study published this this year, like this month, actually, last week in Nature Neuroscience with with the Tamar Mackin University of Cambridge.
事实上,我认为这项研究对神经假体领域非常重要,原因有很多。
And actually, it's for the field of neuroprosthetic, I think is a very important study for many reasons.
首先,因为至少在我们的领域里,这是我们一直有所设想但从未真正在这个层面和严谨度上得到验证的事情。
First of all, because it's something that in the field, at least in our field, was already, you know, something that we had in mind and but never really demonstrated at this at this level and with this rigor.
因为我们参与了针对外周神经系统(截肢者的腿、手臂)和中枢神经系统(脊髓、大脑)的临床试验,在不同部位植入设备以恢复感觉功能,受试者包括刚截肢几个月到二三十年前的患者,以及脊髓损伤一年到三四十年不等的病例。
Because if we implanted and I participate in clinical trial both for the periphery, so amputees, leg, arms, and spinal cord in the brain, and we've got the implant in different part of the nervous system to restore sensation, people amputated maybe the few months before up to twenty years, thirty years before, and also spinal cord injury the year before or thirty years, forty years before.
但在所有这些案例中,当我们刺激大脑或神经的特定部位时,受试者总能立即在预期位置(如手、脚)产生感知,从未出现类似面部或嘴唇等部位的错位感知。
But in all these cases, when we stimulated this part of the brain or the nerves, the subject immediately perceived sensation where was supposed to perceive, like hand, foot, never like face, lips, or something.
所以这已经算是一种证明或间接证据,表明实际上没有发生区域入侵的情况。
So that was already like a kind of proof or indirect proof of the fact that, you know, there was there was not really invasion of area.
也就是说这些脑区仍然存在并准备好接收信息。
Like, the The area was still there ready to receive information.
因此这个假设认为,同时朱利曼也是这一理论的推动者,基于神经修复技术的最新研究显示,在关键期后——即年轻时具有更高可塑性的阶段之后,身体映射和感觉质量需要保持稳定可靠。
And so the hypothesis was that and also Zuliman was also a promoter of this theory, thanks to the evidence that he also, like, saw in the in the field of neuroprosthetics where actually after the critical period, so this period where you are young, where there is like more plasticity, then after the critical period, in particular, your body maps and the sensory mass needs to be stable and reliable.
因为你不想出现这些变化,比如我现在坐在这里的情况。
Because you don't wanna have these changes that that I'm seated here.
想象一下,如果我长时间保持肘部不动,大脑对肘部的表征可能会变得比手部更大。
Imagine that if I stay hours here with my elbow, then the brain representation of the elbow becomes larger than the hand.
所以你肯定不希望发生这种情况。
So you don't want that.
你希望有一个稳定的映射,每次与禁运交互时都能可靠地参考。
You want to have the stable map that you refer to every time that you interact with embargo that is very stable.
当然,已有研究表明这类重组确实存在。
And but of course, there were like studies showing this type of reorganization.
所以这有点棘手,特别是如果你不是专门研究这个领域的科学家。
So it's a kind of tricky, no, to find I mean, in particular, if you're not a scientist that is studying exactly exactly that.
但最近,Tamar Makin和John Krakauer在Eli上发表了一篇很好的论文,反对皮质重组理论,他们指出那些显示此类重组的研究只是对数据的误解,或者可能是这样的:例如,大脑某个区域原本主要接收来自一个区域的输入,同时也接收其他区域的次要输入。当因截肢或损伤切断主要输入后,这个区域现在会被那些次要输入激活。
But recently, there was also a very nice paper published by Tamar Makin and John Krakauer on Eli's describing this theory against cortical reorganization, where they described that the studies in that showing this type of organization was just a misinterpretation of the data, or could be in the sense that one example was the fact that if you have an area of the brain that is receiving major inputs from one area and then also other inputs from the other areas, When you cut this input because of the amputation or because of the lesion, and you look at this area, this area now is activated by these small other inputs.
于是你误以为这个区域现在变成了面部区域,但它原本就与面部有连接。
And so you misinterpret that this area is now a face area, but was already connected with the face.
只是现在输入信号仅来自面部而已。
It's just that now the inputs are arriving only from the face.
所以它似乎在面部活动期间被激活,但之前并非如此。
So it seems activated during the face, but before was not the case.
因此存在一种功能上调现象,这种功能在截肢前就已存在,这是一种解释。
So there is like upregulation of function that was already present before amputation that this was a kind of interpretation.
但他们在这次综述或观点文章中解释得非常清楚。
But they explained very well in this review or in this, like, opinion.
通过他们现在发表的这项研究,他们获得了最终证据:在截肢前对受试者进行测量,用fMRI详细绘制了大脑图谱。
And with this study that they published now, they have the final proof where they have people before amputation, where they measure the map in a very detailed way of the brain with fMRI.
然后在截肢后,不同的时间点,从几个月到几年,他们显示这张图谱保持稳定。
And then after amputation, a different time point, months up to years, and they show that this map remains stable.
这对神经假肢尤其重要,因为这意味着我们可以不受时间限制地招募和植入患者。
So this is an important in particular for neuroprosthetics because that means that we can recruit and implant people regardless the time.
不是吗?
No?
因为即使你在23年前截肢,也可以像这样拥有假肢。
Because even if you're amputated in twenty three years, you can have a prosthetic like that.
你可以植入假体。
You can have an implant.
不存在与重组相关的问题。
There is no problem related to the reorganization.
这就是神经假肢的情况。
So this is for the neuroprosthetics.
对于疼痛而言,这也涉及治疗理论,因为当理论认为疾病适应不良的可塑性时,这种入侵可能会影响你的感知,并与幻肢痛相关,而现在或许更倾向于外周输入等理论可能更为合理。
And for pain, it's also about the theories of the treatment because where theory is saying disease maladaptive plasticity, this invasion can be something that is affecting how you perceive and and related to phantom pain where maybe the theory is more of the with the peripheral inputs or something like that are now more probably more reasonable or something like that.
因此,我认为这项研究很重要,因为它触及了多个要点,同时也在重新审视之前的文献。
So this is where I mean, this study is important because it's touching, I think, on different points and also revising the literature from before.
是的。
Yes.
但那些绝对是令人惊叹的新进展和演示,确实支持了神经假肢的发展。
But those, I think, absolutely amazing, amazing new developments and demonstrations, yeah, that support the development of neuroprosthetics.
基于你提到的所有这些发展,目前该领域正在发生什么?你认为对于想要加入这一领域的人来说,有哪些新机遇正在开启?
Based on all these developments that you mentioned, what's going on right now in the field, what do you think opportunities that are opening up for people who want to join the field?
他们可以在哪些领域找到自己的位置?
Where they can find themselves?
当然。
Sure.
是的。
Yeah.
没错。
Exactly.
首先,从小的方面来说,我们实验室正在不断发展壮大。
So first of all, in the in the small way, we as a lab, we are growing.
我们正在招收学生,包括博士生和硕士生等。
We we are recruiting students, PhD and and master students, etcetera.
由于这是一个多学科领域,我们会从不同角度培养学生来解决这个问题——有的侧重算法,有的侧重硬件,有的侧重临床部分,还有的实施落地。
And and since it's a multidisciplinary field, we take students and to to approach this problem on the different point of view from the more on the algorithm, more on the hardware, more on the clinical part and then implementation.
我感觉现在有越来越多的公司,在欧洲和美国都能获得神经假体领域的宝贵经验,这些公司也在不断发展壮大,需要越来越多的人才。
I feel that now there are more more companies also where actually the the you can have an experience both in Europe and in US in the field of neuroprosthetics that can be valuable, and they they are growing as well with searching more and more people.
而且我认为,在方法上也存在着这种多元化的环境。
And I feel that also this there is this diverse different I mean, there is this diverse environment in terms of approaches.
有些研究采用皮层内或皮层上的不同方式实现相同目标,或者针对不同方面开发神经假体和脑机接口。
There are some that go intracortical, epicortical for the same goal, or you have neuroprosthetic and BCI for different aspects.
所以不仅限于过去那种控制屏幕光标的脑机接口领域(至少是侵入式的,因为非侵入式应用更广泛)。
So not only for, as was before, for control the cursor of the screen that that was the the BCI field, at least invasive, because noninvasive much more.
但对于非侵入式技术,现在有更多不同的技术和研究团队在探索不同方面和不同类型的疾病。
But for non now invasive, there are many more, like, techniques and also groups studying the different aspects and different type of diseases.
因此我觉得学术界和工业界都有更多机会。
So I feel that there there are more opportunities both in academia and industry.
而在健身行业,这正是人们当前争相涌入的领域。
And in the strength industry, something that people are really trying to get in right now.
它变得非常热门。
It becomes very popular.
那么你有什么建议?
And what would be your advice?
是的。
Yes.
对于想要进入这个领域的人。
For people who want to enter the field.
我相信人们正带着各种问题联系你。
I'm sure people are contacting you with all kinds of questions.
我刚接待了一位来咨询的人,我们还聊到你收到多少消息,因为他给你发了信息,谈话就这么开始了。
I just had one person who came for a consultation And we even had a little chat about how many messages do you receive because he sent a message to you and that's how the conversation started.
他还没收到回复,因为这是最近才发的。
He didn't receive the reply yet because it was just recently.
但我告诉他,别担心。
But I told him, Don't worry.
我敢肯定Jack O'Moo每天至少收到10条这样的消息。
I'm sure Jack O'Moo gets at least 10 messages like this per day.
他说,不,不是10条。
He says, No, not 10.
我确信他每天会收到数百条消息。
I'm sure he receives hundreds of messages a day.
不是在抱怨。
Not complaining.
数量确实很多。
A lot of them.
好吧。
Fine.
不过你至少收到了很多问题。
So but you are receiving at least many questions.
是的。
Yes.
那么你最常听到的问题是什么?
So what is the most common questions that you hear?
也许你可以在这里直接回答,这样他们就不需要为此联系你了。
Maybe you can answer it right here so that they wouldn't need to contact you about it.
对。
Yeah.
不。
No.
没错。
Exactly.
总的来说,就像我说的,学生们对这个领域如此感兴趣真是太好了。
So in general, as I said, it's it's very nice that the students are really attracted by this this field.
他们还需要考虑到,有许多背景知识需要学习,而且涉及非常不同的方面,每个部分都是相互关联的基础。
They also have to consider that there is a lot of background that you need to learn, and there are very different aspects and you can every part is fundamental together.
当然,每个人都想来这里,与病人一起工作并处理所有事务。
Of course, everyone want to come here, work with the patient and do the everything.
但这当然需要循序渐进,有人负责这部分,其他人负责那部分,然后再整合起来。
But of course, it's like piece by piece and someone has to take care about one part, some other on the other part, and then put together.
所以在这个过程中,当然会有些小步骤,我认为这对学生来说可能难以理解,这些是通向目标的微小步伐。
So there, of course, there are maybe small steps, and this is something difficult, I think, for the students to try to understand that that is a small step that towards something.
你不可能立即就达到目标。
You You cannot jump there immediately.
但我认为重要的是要表现出你对该领域真诚的兴趣。
But but I feel that that is is important to show the your your interest your genuine interest in the in the field.
当然,也要乐于尝试对你具有挑战性的事情,或超出舒适区的内容,这也是学习新事物的机会,不能只局限于你研究的领域。
And and, of course, be open to to try also something that can be challenging for you or maybe out of your comfort zone, but you is also an opportunity to learn something new and, of course, cannot be only the thing that you study.
但由于这是非常跨学科的领域,举个例子,如果你是计算机科学家,来这里编写算法,但对大脑一无所知,也是可以做到的。
But since this is a very multidisciplinary, if you are from a maybe make an example, like a computer scientist and you come here to write algorithms, but you don't know anything about the brain, can do it.
但作为学生,既然我们在这里从事与神经科学、医学、工程学相关的工作,你需要对所有领域都有个概览,甚至要学习那些可能不完全符合你兴趣的内容。
But, of course, as a student, it's something that since here we do stuff related that also for the neurodesys touching neuroscience, medicine, engineering, you need to have an overview of of everything and also study this type of stuff that maybe is not as complete of your interest.
特别是作为学生,你需要灵活学习,像海绵一样尽可能吸收知识,然后再专注于某个特定领域。
But in particular as a student, you need to be flexible to learn and to be a sponge, you know, and and try to learn as much as possible to then specialize on one specific thing.
这是我的建议。
This is my suggestion.
非常感谢你,贾科莫。
Thank you so much, Giacomo.
再次强调,总是很愉快。
Again, it's always a pleasure.
我刚才在说,今年提交BCI奖项申请对你来说与去年有多么不同。
I was telling how different it was for you to submit the BCI award application this year compared with the last year.
那么你学到了什么?也许可以和我们的听众分享一下这次提交经历带给你的收获?
So what did you learn that maybe you can share with our listeners about the submission that came with the experience for you?
是的。
Yeah.
我觉得申请本身非常相似,从某种意义上说,它相当直接明了。
So I feel that the application per se was very similar in the sense that, you know, it's pretty straightforward.
而且,你知道,目标就是要解释清楚这个项目。
And, you know, the the goal is to explain the project.
当然,评审委员会和专家评委们都是专业人士。
Of course, the the the the committee and the jury is and the jury of experts.
所以作为研究人员会稍微容易些,因为你可以详细撰写项目概述,而且实际上你是根据细节被评估的。
So it's a bit easier as a as a researcher to because you can write actually a project summary in detail and because actually you are evaluated and on the detail.
对吧?
No?
因为他们是专家,他们了解这个领域——重点不在于产品,而在于该领域内想法的创新性,以及为什么它值得在世界上占有一席之地。
Because they are experts, so they know the field is not about the product, but the novelty about the idea in this field, the why is is deserved in the world.
你明白吗?
You know?
所以你需要传达出这个想法相较于现有技术水平的创新之处。
So you need to convey the message about the novelty compared in particular to the state of art.
因此我觉得这是我们有所改进的地方。
So this is something that I feel we improved.
另外,我现在会多花些时间制作实验相关的解说视频,因为现在可以提交短视频了。
And also, I I spend a little bit more time on the making the videos, explanatory videos about the experiment now because there is this possibility to have a short film on that.
所以我们更专业地录制了一些实验视频,更注重解说性,展示我们的工作内容。
So we recorded a little bit more video about experiment more professionally and also in a more, like, explanatory and then of the the things that we were doing.
我认为这也能体现创新性,当你实际展示时,大家能更直观地看到它确实更简便。
And I think that is also sign of something that is novel and that if you can show that actually and they can you can see that is is actually easier.
这其实挺好的,要知道这并不是我第一次提交方案了。
So it's a kind of nice that, you know, I started this is not the first that was not the first time of the submission exactly.
从获得提名开始,然后是第三名,再到第一名。
Started with being the nominee and then, like, the third place and then first place.
可以说是在稳步上升。
So it was actually rising.
这个过程真的很不错。
So it was it was nice.
这真的非常棒。
It was it was very nice.
所以我会再次考虑,当然,就像我之前说的,现在我成了评委之一。
And so I will consider again, of course, as I as I said before, now I'm in the jury.
我和Christophe还找到了其他优秀的评委成员。
And with Christophe, we found also other great members.
我真的很为今年的评委团感到骄傲,成员多元且来自世界各地,拥有不同的专业背景。
So I'm really proud of the the jury this year, diverse and coming from all over the world from different expertise.
我非常期待看到今年的参赛作品。
And I'm really curious to see the application of this year.
是啊。
And yeah.
现在我站在另一边,所以我知道评选的难度有多大。
So I I I I now I'm the other side, so I I know the difficulty to combat that.
但我会寻找那些真正创新且有趣的方案。
So but I will I will look to something very innovative and interesting.
是的。
Yes.
是的。
Yes.
完全同意。
Absolutely.
我也非常期待。
I'm also looking forward to it.
再次感谢你参加我们的播客,期待未来能与你继续合作播客节目,或许我们还可以邀请你合作过的患者一起参与。
And thank you again for coming to our podcast, looking to the future podcast with you, and maybe we can do one with you and the patients that you worked with.
在我们结束播客之前,你有什么想对我们的听众分享的吗?
And as we're ending our podcast, is there anything you would like to share with our listeners?
也许有些内容我没问到,但你仍然想提及的。
Maybe something that I didn't ask, but you still want to mention.
好的。
Yeah.
好的。
Yeah.
既然你提到了参与者,可能还有一件事想说。
Maybe just one thing about the since you mentioned the participants.
是的。
Yes.
我要感谢这些参与者。
I want to thank the participants.
我之所以喜欢这个,是因为他们是先驱者,也是BCI先驱者联盟的成员。
I mentioned I like this because they are the pioneers and they are also part of the BCI Pioneers Coalition.
这个联盟是由一位前参与者创立的,他完成了一项试验体验。
It is a coalition founded by one of the ex participants, so a participant that finished his experience in a in a trial.
因此他现在是这个联盟的领导者。
So that he's now the leader of this coalition.
他们都是很棒的人。
They are wonderful people.
他们自称是超级英雄,因为他们拥有不同的超能力。
They they call themselves we call themselves superheroes because they they have different powers.
你知道吗?
You know?
因为他们会说,哦,好吧。
Because they say, oh, okay.
我在某个流程中有发言权。
I have a speech in a procedure.
其他人拥有现代神经处理器。
Other has the modern neuroprocess.
所以他们会在活动中见面,这非常棒。
So they they they they they meet in events, and it's very nice.
对于学生们,我真心建议你们观看一些他们的视频或活动,因为他们能真正让你体验到使用这项技术的感觉,而且他们也是这个群体的一部分。
And for students, I I really suggest to watch some of their videos or events because they can have really the give you the of the experience of someone using that, and, also, they are part of the group.
他们是这项研究中真正的先驱者,没有他们,一切都不可能实现。
They are the real pioneers in this research, and without them, nothing would be possible.
真的非常非常感谢他们为此奉献了自己的时间和生命,他们每天都来参加实验。
So really, really, I wanna thank you them for donating their time and and life to this, and they are coming every day to run sessions.
这是为科学未来做出的惊人努力。
So it is an incredible effort for the future for science.
他们是为了下一代而做这些。
They do this for the next generation.
为了未来。
For the future.
是的。
Yes.
完全正确。
Absolutely.
我很高兴看到这个联盟,因为他们可以互相支持。
And I'm so glad to see this coalition because they can support each other.
我认为这非常重要。
I think that's so important.
同时也支持未来的参与者。
And also support future participants.
是的,看到这个我真的很高兴,我期待能和他们一起做一期播客。
I think, yes, I'm so glad to see that and I'm looking forward to doing a podcast with them.
再次感谢你,贾科莫。
So thank you again, Giacomo.
祝你一切顺利。
All the best.
那么我们未来的播客中再见。
And we will see you in our future podcast then.
祝你学业顺利。
All the best with your studies.
谢谢。
Thank you.
谢谢。
Thank you.
谢谢。
Thank you.
《神经载体》播客的听众们,感谢你们加入我和这些非凡嘉宾的旅程,共同探索神经科学和神经技术领域的职业发展。
Neurocarriers podcast listeners, thank you for joining me and my incredible guests on this exciting journey into careers in neuroscience and neurotechnologies.
我希望这些将突破性想法转化为实际影响的故事能激励你们。
I hope you've been inspired by the stories of those turning groundbreaking ideas into impactful realities.
若您需要更多关于神经领域职业发展的指导,欢迎预约与我——K博士(你们的播客主持人兼神经职业教练)在神经方法研究所的咨询,这是唯一专门服务于神经科技专业人士需求的职业服务机构。
If you are looking for more guidance on advancing your neuro career, book a consultation with me, Doctor K, your podcast host and neuro careers coach at the Institute of Neuro Approaches, the only career service dedicated specifically to the needs of professionals in neurotech.
让我们携手迈向您在神经领域职业成功的下一步。
Let's take the next step toward your neurocareer success together.
除了免费咨询外,神经方法研究所还提供多种服务,旨在帮助您在神经科技领域蓬勃发展。
In addition to free consultations, the Institute of Neuro approaches offers a variety of services designed to help you thrive in neurotech.
首先是职业发展规划。
First, professional development planning.
我们帮助您制定个性化的职业发展计划,识别知识缺口,并为您提供在神经科学和神经技术领域实现目标所需的工具。
We help you create a tailored career development plan, identify knowledge gaps, and equip you with the tools needed to achieve your goals in neuroscience and neurotechnologies.
第二,简历和求职信审核。
Second, a resume and cover letter review.
获取专家反馈,学习如何专门针对神经科技领域的职位机会打造申请材料。
Get expert feedback on how to craft documents that are specifically designed for job opportunities in the neurotech field.
第三,面试准备。
Third, interview preparation.
通过模拟面试和针对性反馈来提升面试技巧,包括软技能、神经科技硬技能(如BCI、EG、MED)、现场编程和演讲准备。
Sharpen your interview skills through mock interviews and targeted feedback including soft skills, hard skills in neurotech, bci, eg, med, live coding and presentation preparation.
第四,人脉拓展与求职策略。
Four) Networking and job search strategy.
学习如何在竞争激烈的神经科技就业市场中有效建立人脉并挖掘工作机会。
Learn how to effectively network and uncover job opportunities while standing out in the competitive neurotech job market.
薪酬谈判与薪资建议。
Negotiation and salary advice.
获取专家指导,学习如何协商薪资福利,并为目标职位确定合理的薪酬范围。
Receive expert guidance on negotiating salaries and benefits and determining a fair salary range for your desired position.
这一切以及更多内容都可以在www.neuroapproaches.org上找到。
All this and more can be found at www.neuroapproaches.org.
再次提醒,网址是ww.neuroapproaches.org。
Again, ww.neuroapproaches.org.
那你还在等什么呢?
So what are you waiting for?
让我们一起探索神经科学职业的成功之路,将不可能变为可能。
Let's navigate the path to success in the world of neurocareers together and turn the impossible into possible.
我们期待与您合作。
We're looking forward to working with you.
关于 Bayt 播客
Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。