The branches · 7 of 7
The link to machines
A direct connection between a brain and a computer, and how much can pass through it.
The hard version of merging with machines: a wire, a chip or a sensor that carries signals between a brain and a computer directly, with no hands, eyes or voice in between. The project's second number, how much information can pass through such a link each second, is plotted here.
7 upgrades
furthest stage reached: in wide use- A headset worn on the scalp controls a device without surgery
Electrodes pressed against the scalp pick up the faint electrical hum of the brain through the skull. The signal is coarse, but it is enough to pick a letter, steer a toy or tell when a person is calm, and it needs no surgeon. Headsets that do this have been sold to the public since 2007, as toys, meditation aids and gaming controllers, in the hundreds of thousands. It is the only link to a machine on this branch that is in wide use, and by far the weakest.
- A brain implant gives a person touch from a robotic hand
Signals going the other way: pressure sensors on a robotic hand's fingers drive tiny currents into the part of the brain that feels the hand, and a paralysed man feels his own fingers being touched when the robot's are. Reported in 2016, it closed the loop between brain and machine for the first time in a person, and made the robotic arm he already controlled by thought much faster to use.
- A brain implant turns intended speech into text at conversational speed
A person who can no longer speak tries to, and the implant reads the brain's instructions to the mouth and throat and turns them into words on a screen. In August 2023 two groups reported people with paralysis producing sixty to eighty words a minute this way, from large vocabularies, which is within sight of the hundred and fifty of ordinary conversation. It is the fastest a brain has yet talked to a machine, and the first point on this branch's bandwidth series.
- A fully implanted wireless brain chip lets a paralysed person control a computer
A device under the skin and skull reads the brain's signals and sends them out by radio, with no wire through the skin: nothing to plug in, nothing to infect, usable at home. Wired implants have done this in laboratories since the 1990s. The first fully implanted wireless one was used at home by a woman with motor neurone disease in the Netherlands, reported in 2016, to select letters on a screen. The first high-channel version, with a thousand electrodes, went into a person in January 2024 and let him play chess and games by thought.
- A wired brain implant lets a paralysed person control a cursor
The original brain-computer link: an electrode in the part of the brain that plans movement, a wire out through the skull to a computer, and a cursor that moves where the person means it to. The first paralysed person to do this was reported in 1998, with a single electrode; the hundred- electrode version that most later work builds on went into a man in 2004. Every speech, touch and robotic-arm result on this branch grew from it. It has never left the laboratory, because the wire does.
- A brain link carries more information per second than speech
The number the merger argument rests on. Speech moves about forty bits of information a second, in every language measured; typing, less. A brain link that beat speech would be the first time a person had a faster way out of their own head than the mouth, and the stated goal of the best-funded implant companies. No link has come close: the fastest, the 2023 speech decoders, move the equivalent of speech at half speed with errors, and they do it by reading the instructions for speech itself. Whether the brain can originate more than it already says is the open question.
- An uploaded animal brain reproduces something it learned
The long shot behind every story about uploading a mind: read a brain out completely, run the reading as a program, and get the same creature back. The honest test is small. Teach an animal something, map its brain, and see whether a simulation built from the map does what the animal learned, without being taught again. The complete wiring diagram of a fruit fly's brain was published in 2024 and a simulation built from it produces some of the fly's reflexes, but no simulation has yet reproduced a memory that one particular animal formed. That is the gap.
The second number: how much can pass between a brain and a machine
8 figures, 2006 to 2024The merger argument has rested on one number since 2017: how much information can pass between a brain and a computer each second, and whether that can beat the mouth and the hands. This is the record of what has actually been demonstrated, each figure in the unit its source used, from the peer-reviewed papers and the makers' own releases, against the rates a reader already has. Two kinds of figure are kept apart, because a rate of text and a rate of pointing at a screen cannot share an axis without an assumption the sources did not make.
The best figure so far for text is 78 words a minute, from attempted speech decoded by a brain implant, reported on 23 August 2023: Sean Metzger, Kaylo Littlejohn, Alexander Silva, David Moses, Margaret Seaton and colleagues at the University of California, San Francisco (Edward Chang, senior author). Speech in conversation runs at about 160 words a minute, so the fastest brain link yet talks at about half the speed of talking, with one word in four wrong.
For pointing at a screen, the best figure is 8 bits a second, the maker's own figure and not yet in a peer-reviewed paper, reported on 8 May 2024; the best peer-reviewed figure is 4.16 bits a second, from 21 February 2017. An engineer with a mouse scores about ten.
- a demonstrated figure, from a peer-reviewed paper
- a demonstrated figure, from the maker's own release
- the best figure so far
- a rate a reader already has
Characters a minute are shown as words at five characters a word, the convention typing speed is measured by (so 90 characters a minute is shown as 18 words a minute, which is also how the 2023 Stanford paper restates the 2021 figure).
- a demonstrated figure, from a peer-reviewed paper
- a demonstrated figure, from the maker's own release
- the best figure so far
- a rate a reader already has
Every figure, oldest first
-
13 July 2006 no rate stated peer-reviewed paper
The first BrainGate participant moving a cursor, opening simulated e-mail and operating a television through a 96-electrode array in the part of the brain that plans hand movement. The paper states no rate: no bits a second, no characters a minute.
-
21 February 2017 4.16 bits a second peer-reviewed paper
Cursor control on a grid task: 4.16 bits a second for participant T5 on a 9 by 9 grid, which the paper calls, to its authors' knowledge, the highest documented brain-computer interface communication rate for a person with motor impairment. On the 6 by 6 grid the averages were 2.2 (T6), 3.7 (T5) and 1.4 (T7) bits a second.
-
21 February 2017 39.2 correct characters a minute peer-reviewed paper
Copy typing on an on-screen keyboard by cursor control: 39.2 correct characters a minute (the paper's own 7.8 words a minute) for participant T5 with an optimised keyboard layout; 31.6 for T6 and 13.5 for T7. Free typing by T6 ran at 24.4 correct characters a minute over three days.
-
12 May 2021 90 characters a minute peer-reviewed paper
Attempted handwriting decoded into text: 90 characters a minute with 94.1 per cent raw accuracy online, and above 99 per cent offline with a general-purpose autocorrect. The paper compares it with smartphone typing in the participant's age group, 115 characters a minute.
-
23 August 2023 62 words a minute peer-reviewed paper
Attempted speech decoded into text: 62 words a minute, with a 23.8 per cent word error rate on a 125,000-word vocabulary and 9.1 per cent on a 50-word vocabulary. The paper calls it 3.4 times the previous record and says it begins to approach the speed of natural conversation, which it puts at 160 words a minute.
-
23 August 2023 78 words a minute peer-reviewed paper
Silently attempted speech decoded into text, speech sounds and a talking avatar: a median of 78 words a minute (78.3 in the main text) with a median word error rate of 25 per cent (25.5), on a vocabulary of 1,024 words, from high-density recordings on the surface of the speech cortex. The paper calls this large-vocabulary decoding; the 1,024 words are those of the sentences used to test it (249 sentences, not used in training), and a larger vocabulary of 39,378 words was tried only offline, at a word error rate of 27.6 per cent.
-
8 May 2024 8 bits a second the maker's own release
Cursor control on the company's grid task: 8.0 bits a second, after a first-session figure of 4.6 that the company called a new world record for human brain-computer interface cursor control. The post says he was trying to beat the company's engineers using a mouse, about 10 bits a second. A later post (2024-08-21) says his performance has since more than doubled the prior record, without a new number.
-
14 August 2024 31.6 words a minute peer-reviewed paper
Attempted speech decoded into text at the participant's own pace: 31.6 words a minute with a 2.5 per cent word error rate on a vocabulary of over 125,000 words, sustained at 97.5 per cent accuracy over 248 hours of use across eight months. Slower than the 2023 decoders and far more accurate; included because the series records every demonstrated figure, not only the records.
The rates a reader already has
- Speech in conversation: 160 words a minute. The rate the 2023 Stanford speech paper gives for natural conversation, citing a 2006 study of conversational speaking rate by Jiahong Yuan, Mark Liberman and Christopher Cieri. doi.org. Willett and colleagues, Nature 2023, abstract: "begins to approach the speed of natural conversation (160 words per minute)", with the citation to Yuan, Liberman and Cieri, Interspeech 2006 (DOI 10.21437/Interspeech.2006-204).
- A fast typist: 120 words a minute. The rate Jieyu Zheng and Markus Meister (California Institute of Technology) give for an advanced typist working from a manuscript, in their 2024 analysis of the speed of human behaviour. doi.org. Zheng and Meister, Neuron, published online 2024-12-17: "An advanced typist produces 120 words per minute", which they put at about 10 bits a second.
- Typing on a phone: 115 characters a minute. The rate the 2021 Stanford handwriting paper gives for smartphone typing by people in its participant's age group. doi.org. Willett and colleagues, Nature 2021, abstract: "typical smartphone typing speeds of individuals in the age group of our participant (115 characters per minute)".
- Engineers with a mouse: 10 bits a second. Neuralink's own figure for its engineers using a mouse on the same grid task, about 10 bits a second. neuralink.com. Neuralink, 2024-05-08: "currently trying to beat scores of the Neuralink engineers using a mouse (~10 BPS)".
- Speech, as information: 39 bits a second. The information rate of speech across 17 languages, measured by Christophe Coupé, Yoon Mi Oh, Dan Dediu and François Pellegrino (CNRS and the University of Lyon) in 170 speakers reading texts aloud: a mean of 39.15 bits a second. Shown here because it is the number the merger argument compares a brain link against; it is a rate of language, not of pointing. doi.org. Science Advances 5, eaaw2594, published 2019-09-04: "languages encoding similar information rates (~39 bits/s)"; Results give 39.15 bits a second with a standard deviation of 5.10.
The series is data/bandwidth.toml in the public repository, and the rules for a point are in its layout document there. A figure missing or misread: say so.