Meta is also going at it [0], which inevitably makes me ponder some orwellian questions for the near future:
If I bring my pet mouse to the cinema and my friend scans the movie back using his apple ifmri does the DRM still holds or will the mouses be DRM locked?
Will my iris suffice for booting my computer or would I need to press accept all brainwave cookies?
Can I email my local Flock representative to install a new Brain Pole in my neighborhood? I saw a bunch of dark thoughted young males around and my amazon think camera says the probability of missing packages increased.
Certainly the thing of sci-fi nightmares, but not practical.
All of these imaging techniques are very involved. Ultrasound requires direct contact and this technique only works with a long IV infusion of bubbles. fMRI isn’t going to be a portable device that you can point at something for many reasons.
The connection to what you’re thinking is more sci-fi than reality. This technique could theoretically see some changes in blood flow to different regions, but what would that mean? Is the patient having anxiety, or are they just nervous about the IV injecting bubbles into them to travel to their brain and the machine attached to their head?
The super-resolution trick as they’ve done it is highly reliant on the sparseness of the bubbles. If you imagine a point or a very sparse set of points at low resolution, you can fit for the locations of those points even though you don’t see them clearly. This is a common technique in radio astronomy and (I assume although I don’t have personal knowledge) astrometry, and compressed sensing was an extremely hot field a while back.
But RBCs are weird squishy things, and they fill the bloodstream quite densely, and ChatGPT estimates that they’re spaced about 20µm apart and that, when confined to a capillary, they’re about 7µm long. (And that sounds at least plausibly correct to me.)
So, even ignoring the much worse scattering properties of RBCs, they not nearly as sparse. You mostly lose a whole dimension of sparseness and up trying to resolve the entire capillary. Which seems possible but much harder. Unfortunately, brain capillaries are about 40µm apart, so the result might be a mess.
The article did not say what wavelength they’re using or what their native (wavelength/2) resolution is.
Showing us a technique that is entirely reliant on sparseness and then saying they hope to employ it on something that isn’t sparse at all (blood cells) does feel misleading.
I’m filing this in the category of technologies I wish could be true, but for which no plausible path to overcoming the obvious limitations has been provided.
I’m a complete layman to this field, but what the article did say was they’re hopeful that AI/ML can help develop a model that can pull out information such as the scattering caused by RBCs (which is present in the large volume of data gathered by the probe but is too weak to be used for manual techniques) and turn that into meaningful visuals. That’s gonna require a ton of data and that is exactly what they are trying to gather now with what they have built so far.
> The bubbles themselves are pockets of sulfur hexafluoride encapsulated in lipid shells.
The high resolution images were generated by injecting sparse bubbles of this contrast agent. How sparse are they? Is the image we see a stacked set of many bubbles over time composited together?
Their aspirations at the end of doing this without the bubbles are great, but there’s a big “now draw the rest of the owl” energy around that leap. The first technique relies entirely on the bubbles, but they provide no explanation for how they think this could be achievable without the bubbles other than vaguely saying that technology is advancing.
The Midjourney scanners don’t do the same thing that this is using. See how blurry the first image on the page is? That’s what you get from ultrasound through bone like the skull.
They used a trick to inject sparse bubbles into the patient and let them flow through the brain, then looked for the perturbations caused by those sparse bubbles.
The Midjourney scanners aren’t injecting this bubble contrast agent into everyone’s veins.
I thought the whole "we can guess what you're thinking from an MRI" thing was BS, along the lines: take a small set of photos, image people's brains as they are looking at these pictures, to map to some low-dimensional vector of "brain activity". Then show them some of these (in sample!) pictures, measure the vector of activity and predict back what they were looking at.
Happy to be corrected. But if that's right then this... does the BS thing in a potentially less intrusive way?
This is ridiculously cool, but I have a ton of questions.
> The bubbles themselves are pockets of sulfur hexafluoride encapsulated in lipid shells. They're an FDA-approved contrast agent,
Combined with ultrasound, could these be causing damage of any kind to the vasculature?
> A few years ago, a paper came out that blew our minds. The idea was that you can decode what someone is looking at just from their brain activity.
How realistically close can this get to reading thoughts, visuals, etc.?
Do we have a path to imaging people's visual cortex? Their inner lives, dialogues, memories? (Scary thought - this could be used as an interrogation tool without consent. "Did you kill Bob?" could be a simple brain scan.)
Can it be done in real time in a feedback loop and perhaps be used as an advanced reinforcement learning system?
How about just getting it more established in orthopedic practices so patients aren't required to 1. See ortho for MRI referral 2. schedule mri at imaging facility 3. PAY $750 - $3000 for an MRI 4. Wait to get back into ortho.
I really don't understand why a fetus' heart can be examined for defects, but you can't use it in the office to tell me if my labrum is torn?
Meta is also going at it [0], which inevitably makes me ponder some orwellian questions for the near future:
If I bring my pet mouse to the cinema and my friend scans the movie back using his apple ifmri does the DRM still holds or will the mouses be DRM locked? Will my iris suffice for booting my computer or would I need to press accept all brainwave cookies? Can I email my local Flock representative to install a new Brain Pole in my neighborhood? I saw a bunch of dark thoughted young males around and my amazon think camera says the probability of missing packages increased.
[0]https://ai.meta.com/blog/tribe-v2-brain-predictive-foundatio...
Certainly the thing of sci-fi nightmares, but not practical.
All of these imaging techniques are very involved. Ultrasound requires direct contact and this technique only works with a long IV infusion of bubbles. fMRI isn’t going to be a portable device that you can point at something for many reasons.
The connection to what you’re thinking is more sci-fi than reality. This technique could theoretically see some changes in blood flow to different regions, but what would that mean? Is the patient having anxiety, or are they just nervous about the IV injecting bubbles into them to travel to their brain and the machine attached to their head?
re: imagining red blood cells
The super-resolution trick as they’ve done it is highly reliant on the sparseness of the bubbles. If you imagine a point or a very sparse set of points at low resolution, you can fit for the locations of those points even though you don’t see them clearly. This is a common technique in radio astronomy and (I assume although I don’t have personal knowledge) astrometry, and compressed sensing was an extremely hot field a while back.
But RBCs are weird squishy things, and they fill the bloodstream quite densely, and ChatGPT estimates that they’re spaced about 20µm apart and that, when confined to a capillary, they’re about 7µm long. (And that sounds at least plausibly correct to me.)
So, even ignoring the much worse scattering properties of RBCs, they not nearly as sparse. You mostly lose a whole dimension of sparseness and up trying to resolve the entire capillary. Which seems possible but much harder. Unfortunately, brain capillaries are about 40µm apart, so the result might be a mess.
The article did not say what wavelength they’re using or what their native (wavelength/2) resolution is.
Showing us a technique that is entirely reliant on sparseness and then saying they hope to employ it on something that isn’t sparse at all (blood cells) does feel misleading.
I’m filing this in the category of technologies I wish could be true, but for which no plausible path to overcoming the obvious limitations has been provided.
I’m a complete layman to this field, but what the article did say was they’re hopeful that AI/ML can help develop a model that can pull out information such as the scattering caused by RBCs (which is present in the large volume of data gathered by the probe but is too weak to be used for manual techniques) and turn that into meaningful visuals. That’s gonna require a ton of data and that is exactly what they are trying to gather now with what they have built so far.
> The bubbles themselves are pockets of sulfur hexafluoride encapsulated in lipid shells.
The high resolution images were generated by injecting sparse bubbles of this contrast agent. How sparse are they? Is the image we see a stacked set of many bubbles over time composited together?
Their aspirations at the end of doing this without the bubbles are great, but there’s a big “now draw the rest of the owl” energy around that leap. The first technique relies entirely on the bubbles, but they provide no explanation for how they think this could be achievable without the bubbles other than vaguely saying that technology is advancing.
It feels like ultrasound is solving everything for the last week.
There were a lot of people who declared very loudly last week during the Midjourney discourse that this was an impossible use of ultrasound.
The Midjourney scanners don’t do the same thing that this is using. See how blurry the first image on the page is? That’s what you get from ultrasound through bone like the skull.
They used a trick to inject sparse bubbles into the patient and let them flow through the brain, then looked for the perturbations caused by those sparse bubbles.
The Midjourney scanners aren’t injecting this bubble contrast agent into everyone’s veins.
Is this the same tech the Midjourney scanner device is using?
I thought the whole "we can guess what you're thinking from an MRI" thing was BS, along the lines: take a small set of photos, image people's brains as they are looking at these pictures, to map to some low-dimensional vector of "brain activity". Then show them some of these (in sample!) pictures, measure the vector of activity and predict back what they were looking at.
Happy to be corrected. But if that's right then this... does the BS thing in a potentially less intrusive way?
This is ridiculously cool, but I have a ton of questions.
> The bubbles themselves are pockets of sulfur hexafluoride encapsulated in lipid shells. They're an FDA-approved contrast agent,
Combined with ultrasound, could these be causing damage of any kind to the vasculature?
> A few years ago, a paper came out that blew our minds. The idea was that you can decode what someone is looking at just from their brain activity.
How realistically close can this get to reading thoughts, visuals, etc.?
Do we have a path to imaging people's visual cortex? Their inner lives, dialogues, memories? (Scary thought - this could be used as an interrogation tool without consent. "Did you kill Bob?" could be a simple brain scan.)
Can it be done in real time in a feedback loop and perhaps be used as an advanced reinforcement learning system?
This kind of mind reading could easily become the end of human privacy.
That's bad enough in democracies, but the consequences in more common forms of government seem really dystopian.
How about just getting it more established in orthopedic practices so patients aren't required to 1. See ortho for MRI referral 2. schedule mri at imaging facility 3. PAY $750 - $3000 for an MRI 4. Wait to get back into ortho.
I really don't understand why a fetus' heart can be examined for defects, but you can't use it in the office to tell me if my labrum is torn?
Sulfur hexafluoride escaping is exceptionally damaging as a greenhouse gas, is there nothing else they can use?
Edit: wow, serves me right for asking / not understanding that contrast means SF6...
Their goal is contrast-free imaging — read the bottom of the article.