It's worth noting that this isn't new technology. This paper is specifically about how their new technique provides a small but statistically significant improvement on existing techniques.
The fact that they provide code and dataset is really praiseworthy.
So attended an interesting talk a couple years ago:
- fMRI and/or brain implants are the best to figure out brain waves
- but they are expensive or invasive
- EEG is a lot cheaper and easier but not as precise
- BUT what if you used LLMs to analyze EEG data taken at the same time as brain implants etc
The answer seemed to be that "yes, you can get better than traditional EEG data using EEG + LLMs". Curious to see where this ends up and hopefully not that like that Black Mirror episode with the brain scanning leading to murders.
This wouldn’t work. Apart from it being very difficult to get people to sleep deeply enough for them to dream in machines like this, the brain state is very different whilst asleep compared with awake. Also the data generated from typing would be very different than thought since it’s likely picking up on broad electrical activity in the primary motor cortex.
Source: spouse works in a sleep lab studying dreams with MRI
The ultrasound technique there is more like MRI, static imaging, not measuring dynamic electrical signals. Also, regardless of static vs moving, all of this hinges on massive relatively expensive devices (ultrasound is never going to be dirt cheap or miniaturized compared to a smartwatch or even a VR headset) and for the subject to remain perfectly still and probably go through regular calibration sequences. All for <75% accuracy on simple classification tasks. The information mixes in the propagation out of the skull, erasing information. It's analogous to trying to do a row hammer attack on a CPU from outside the computer case.
Also, in the Meta result here, "while actively typing" is actually quite different than passive mind reading because the motor cortex sits nicely near the top surface of the skull, and the muscle memory from past typing makes for a nice well formed signal to measure and classify. It's the same trick over and over since the Brown BrainGate days where you can have people perform or imagine movements and get a decent but not good classification result, and it never gets much better after that trick is exploited. Project dies, VCs and grant writers forget or never appreciated the effect, time goes by, a grad student or corporate research lackey rediscovers it, media puts out an article claiming mind reading is here, and the cycle repeats...
Interesting -- really excited for the future of human-brain interfaces and just in general more interface exploration enabled by large transformers. I'm already very excited by voice, although wish I could get something akin to the subvoc common in scifi novels. Seems like it would be an easier path than human-brain and would allow me to use voice models in public.
As an aside, disappointed by the very low quality of comments on this article here.
It's worth noting that this isn't new technology. This paper is specifically about how their new technique provides a small but statistically significant improvement on existing techniques.
The fact that they provide code and dataset is really praiseworthy.
So attended an interesting talk a couple years ago:
- fMRI and/or brain implants are the best to figure out brain waves
- but they are expensive or invasive
- EEG is a lot cheaper and easier but not as precise
- BUT what if you used LLMs to analyze EEG data taken at the same time as brain implants etc
The answer seemed to be that "yes, you can get better than traditional EEG data using EEG + LLMs". Curious to see where this ends up and hopefully not that like that Black Mirror episode with the brain scanning leading to murders.
Piramidal was doing that last I checked: https://techcrunch.com/2024/08/23/piramidals-foundation-mode...
great news!, I would like to conversate with my dog...i'm sure he has more important thing than lots of people
And you reverse it to go from words to brain waves! Mind reading at a distance.
I do not trust Zuckerberg anywhere near my brain waves.
why is there no live demo? Anyone seen this in action? Can someone share a demo video or something
The size of that machine
The participants end up looking a bit like Toad from Mariokart.
How realistic would it be to make a smaller device?
Patients should get a "My other hat is a superconducting quantum interferometer" hat.
Someone should try it while sleeping and see if anything is related to a dream.
This wouldn’t work. Apart from it being very difficult to get people to sleep deeply enough for them to dream in machines like this, the brain state is very different whilst asleep compared with awake. Also the data generated from typing would be very different than thought since it’s likely picking up on broad electrical activity in the primary motor cortex.
Source: spouse works in a sleep lab studying dreams with MRI
Now the remaining problem is to make Magnetoencephalography devices affordable and not insanely huge.
From a few days ago, uses ultrasound.
https://news.ycombinator.com/item?id=48685558
The ultrasound technique there is more like MRI, static imaging, not measuring dynamic electrical signals. Also, regardless of static vs moving, all of this hinges on massive relatively expensive devices (ultrasound is never going to be dirt cheap or miniaturized compared to a smartwatch or even a VR headset) and for the subject to remain perfectly still and probably go through regular calibration sequences. All for <75% accuracy on simple classification tasks. The information mixes in the propagation out of the skull, erasing information. It's analogous to trying to do a row hammer attack on a CPU from outside the computer case.
Also, in the Meta result here, "while actively typing" is actually quite different than passive mind reading because the motor cortex sits nicely near the top surface of the skull, and the muscle memory from past typing makes for a nice well formed signal to measure and classify. It's the same trick over and over since the Brown BrainGate days where you can have people perform or imagine movements and get a decent but not good classification result, and it never gets much better after that trick is exploited. Project dies, VCs and grant writers forget or never appreciated the effect, time goes by, a grad student or corporate research lackey rediscovers it, media puts out an article claiming mind reading is here, and the cycle repeats...
[stub for offtopicness]
p.s. come on you guys - this is not what HN is for. You may not owe $megacorp better but you owe this community better if you're participating here.
Feels like the premise for a spy comedy with a protagonist whose mind can’t be read.
When the bad guys try they just get the lyrics to Yoko Ono music.
Do they test against people not in their training cohort?
It'll be a cold day in hell before Meta gets access to my brainwaves. Good heavens, can you imagine?
I'm glad that, with any luck, I'll be dead before this kind of thing is commonplace.
non-invasive tech from meta? i don't buy that
Interesting -- really excited for the future of human-brain interfaces and just in general more interface exploration enabled by large transformers. I'm already very excited by voice, although wish I could get something akin to the subvoc common in scifi novels. Seems like it would be an easier path than human-brain and would allow me to use voice models in public.
As an aside, disappointed by the very low quality of comments on this article here.