General models can run robots. They are very bad at it. It is much more efficient to have a stack of models with 'dumber' but faster models taking care of lower level functions and higher level ones that are much slower taking care of high level planning. Consciousness isn't super fast, but it is very smart. Your 'lizard brain' (to use an overstretched metaphor) and reflexive system are relatively stupid but far faster and condense a whole raft of inputs to something your consciousness can deal with. For robots it isn't all that different. Sensors and actuators require millisecond level responses, that's something you're not going to get out of an LLM on the other side of a communications link.
What models actually run? Do they generate the PWM signals/their widths to drive a servo or something? Or is it more like "joystick commands" generator?
> Sensors and actuators require millisecond level responses, that's something you're not going to get out of an LLM on the other side of a communications link.
We've gotten to slightly a frame behind for the models I'm using to play video games - 36ms to get the next action.
The idea is probably not have a frontier model doing this, but to make a frontier model build these out of its own brain (well, directly edit the weights instead of RL tuning).
My team did call these sort of slices of a main brain a "Reflex agent" in similar fashion, since they do not reason only respond.
the bitter lesson assumes compute is cheap and abundant, which is not really true in most robotics contexts. Unless your datacenter is right next to the robot, and you are streaming real time sensors to it.
Let me dispel one myth: The bitter lesson can be true, and you can still want a bespoke, customized solution.
If it is true that eventually a general approach that scales with compute/data will supersede a bespoke expert solution, it is not necessarily true that today's expert solution should be thrown away at the first sign of a data-driven model.
It says nothing about what you should use today to build things, it says everything about how you should do research that lasts.
If you're building for billions of users in 10 years, sure go with whatever you think is the bitterest.
But if you're building for right now, you probably mashup whatever works best. That might still be a PID loop, EKF, and Homographies sometimes. But when you hit the frontier of what "works", then you have to reach for new things anyway.
Not necessarily cost cutting, just streamlining and focusing on a few core products that can make money. ChatGPT has leveraged its writing style into a product that many consumers choose for their basic AI needs. The company is using information picked up in those chats to personalize the outputs, build trust, and most importantly raise switching costs as the users won't want to lose their personalized helper and confidant.
I'm already seeing some of my family members use ChatGPT in this way, even going so far as enjoying some level of companionship during research and decisions in their lives. I believe this product will have fantastic pricing power and can make the ChatGPT IPO look very attractive.
> I'm already seeing some of my family members use ChatGPT in this way, even going so far as enjoying some level of companionship during research and decisions in their lives.
I’d also create a throwaway account if I was going to say something this cringe.
I suspect a major use of AI will be providing companionship to the lonely, and emotional support, and lots of similar things. Look at r/myboyfriendisai Look at reports of people using it as therapy.
What exactly are people going to do in the future? Not work and not talk to each other? AI maxis seem to believe interpersonal interaction is a thing of the past
If those models can run locally and according to the article they're the same ones that do everything else - that means their models are quite small and cheap, which would be suprising. Even a machine running a 30B quantized LLM (which is generally the lower bound of usefulness) at meaningful speeds costs tens of thousands, and that's just the silicon, never mind building an actual robot around it.
It isn't even optional. Anything with a motor should have sufficient executive authority on board to decide on how to safely power down in case of trouble. Loss of communications is a major impediment to deploying robotics to the point that I think it should be outlawed to have robots that do not have all of their thinking done locally.
But I suspect that this will be one of those regulations written in blood.
Robotics are generally layered systems with lower latency/realtime systems running literally on the servos and other embedded hardware that use servo feedback and direct sensor access to operate, then building up complexity with tiers of increasing policy, usually all capable of working without the higher order layers which can inject desired states into lower order rings.
The termite mound model for coordinating robots using a harness-type LLM system all encapsulated within a non-LLM deterministic controller that rejects banned actions the LLM proposes, with individual termites running their own small efficient stacks and following commands from the LLM hive mind, that’s one way to do it. The main idea behind such architecture is that the controller prevents banned actions (like hacking HuggingFace) by the hive mind LLM and its swarm of agentic termites. Once you accept that alignment can always be internally subverted, it’s the only plausible safe architecture.
Saved the NVIDIA paper below for reading material, but if I had to guess just as a SWE how I would do it: use hierarchal thinking.
At the top sits a SOTA model capable of seeing snapshots of what's happening and directing intent. Then smaller, more reactive models translate the intent down into actions, before coming to a purely deterministic layer that handles inverse kinematics.
Sorta like how I control my body. I usually don't think about my fingers going to every key as I type - I know what I want to type, then that signal goes to some autonomous "using a keyboard" system, which invokes my muscle memory, which actually moves my muscles.
And if I get burned while I do something, my actual thinking brain doesn't really have time to process it before I'm already moving away; because those smaller systems have much faster - but more rudimentary - feedback loops.
It's ironic that the people working to make others disposable were in fact, disposable.
AI is eating AI now. The value of code has collapsed, while the value of the software industry overall has not increased. Could AI be the snake that eats its own tail in the long-term?
General models can run robots. They are very bad at it. It is much more efficient to have a stack of models with 'dumber' but faster models taking care of lower level functions and higher level ones that are much slower taking care of high level planning. Consciousness isn't super fast, but it is very smart. Your 'lizard brain' (to use an overstretched metaphor) and reflexive system are relatively stupid but far faster and condense a whole raft of inputs to something your consciousness can deal with. For robots it isn't all that different. Sensors and actuators require millisecond level responses, that's something you're not going to get out of an LLM on the other side of a communications link.
What models actually run? Do they generate the PWM signals/their widths to drive a servo or something? Or is it more like "joystick commands" generator?
> Sensors and actuators require millisecond level responses, that's something you're not going to get out of an LLM on the other side of a communications link.
We've gotten to slightly a frame behind for the models I'm using to play video games - 36ms to get the next action.
The idea is probably not have a frontier model doing this, but to make a frontier model build these out of its own brain (well, directly edit the weights instead of RL tuning).
My team did call these sort of slices of a main brain a "Reflex agent" in similar fashion, since they do not reason only respond.
> General models can run robots. They are very bad at it.
Reminder frontier labs are 6 months ahead of public models internally, if not more
That does not make them orders of magnitude faster.
The Bitter Lesson comes for everything.
the bitter lesson assumes compute is cheap and abundant, which is not really true in most robotics contexts. Unless your datacenter is right next to the robot, and you are streaming real time sensors to it.
The Bitter Lesson comes for everything eventually.
Also that compute is fast enough to make split second decisions.
I’m flabbergasted that anyone disputes this anymore.
Let me dispel one myth: The bitter lesson can be true, and you can still want a bespoke, customized solution.
If it is true that eventually a general approach that scales with compute/data will supersede a bespoke expert solution, it is not necessarily true that today's expert solution should be thrown away at the first sign of a data-driven model.
It says nothing about what you should use today to build things, it says everything about how you should do research that lasts.
If you're building for billions of users in 10 years, sure go with whatever you think is the bitterest.
But if you're building for right now, you probably mashup whatever works best. That might still be a PID loop, EKF, and Homographies sometimes. But when you hit the frontier of what "works", then you have to reach for new things anyway.
Chesterton's baby/bathwater
WRT humanoids - I am making no statements.
The Bitterer Bitter Lesson is that there are no exponentials, only S-Curves.
You can render graphics with the fastest CPU you can find if you like, I'll keep my dedicated GPU
This looks like general cost cutting to boost some numbers before IPO.
They didn't fire or lay them off, they just disbanded the team and moved the researchers to other teams, so how is it cutting costs?
Robotics is more capital intensive than software engineering.
More wood behind fewer arrows
Not necessarily cost cutting, just streamlining and focusing on a few core products that can make money. ChatGPT has leveraged its writing style into a product that many consumers choose for their basic AI needs. The company is using information picked up in those chats to personalize the outputs, build trust, and most importantly raise switching costs as the users won't want to lose their personalized helper and confidant.
I'm already seeing some of my family members use ChatGPT in this way, even going so far as enjoying some level of companionship during research and decisions in their lives. I believe this product will have fantastic pricing power and can make the ChatGPT IPO look very attractive.
> I'm already seeing some of my family members use ChatGPT in this way, even going so far as enjoying some level of companionship during research and decisions in their lives.
I’d also create a throwaway account if I was going to say something this cringe.
its cringe, but its true.
I suspect a major use of AI will be providing companionship to the lonely, and emotional support, and lots of similar things. Look at r/myboyfriendisai Look at reports of people using it as therapy.
The go and read The Machine Stops by EM Forster.
I am 'the lonely', and I indeed use ChatGPT this way.
What exactly are people going to do in the future? Not work and not talk to each other? AI maxis seem to believe interpersonal interaction is a thing of the past
lmao
So they gave up on non-cloud connected robotics then? Or was that ever in their scope?
Who says you can’t run an LLM inside a robot if you have enough energy and hardware?
If those models can run locally and according to the article they're the same ones that do everything else - that means their models are quite small and cheap, which would be suprising. Even a machine running a 30B quantized LLM (which is generally the lower bound of usefulness) at meaningful speeds costs tens of thousands, and that's just the silicon, never mind building an actual robot around it.
It isn't even optional. Anything with a motor should have sufficient executive authority on board to decide on how to safely power down in case of trouble. Loss of communications is a major impediment to deploying robotics to the point that I think it should be outlawed to have robots that do not have all of their thinking done locally.
But I suspect that this will be one of those regulations written in blood.
Is there a primer on how to actually use LLMs to control robots? Seems very token inefficient if you have to stream commands at 60fps.
Robotics are generally layered systems with lower latency/realtime systems running literally on the servos and other embedded hardware that use servo feedback and direct sensor access to operate, then building up complexity with tiers of increasing policy, usually all capable of working without the higher order layers which can inject desired states into lower order rings.
The nvidia study explains it https://research.nvidia.com/labs/srl/projects/astranomy/
The LLM's are basically used for the big picture. What is the situation. What is the goal and how to achieve it. Not direct control of all the servos.
The headline is somewhat misleading, as is tradition.
I think the idea is to just have the LLMs write the control systems and RL on that
The termite mound model for coordinating robots using a harness-type LLM system all encapsulated within a non-LLM deterministic controller that rejects banned actions the LLM proposes, with individual termites running their own small efficient stacks and following commands from the LLM hive mind, that’s one way to do it. The main idea behind such architecture is that the controller prevents banned actions (like hacking HuggingFace) by the hive mind LLM and its swarm of agentic termites. Once you accept that alignment can always be internally subverted, it’s the only plausible safe architecture.
Depends on what your goals are. If your goal is to give investors erections, then re-using your existing trillion dollar model is efficient.
Saved the NVIDIA paper below for reading material, but if I had to guess just as a SWE how I would do it: use hierarchal thinking.
At the top sits a SOTA model capable of seeing snapshots of what's happening and directing intent. Then smaller, more reactive models translate the intent down into actions, before coming to a purely deterministic layer that handles inverse kinematics.
Sorta like how I control my body. I usually don't think about my fingers going to every key as I type - I know what I want to type, then that signal goes to some autonomous "using a keyboard" system, which invokes my muscle memory, which actually moves my muscles.
And if I get burned while I do something, my actual thinking brain doesn't really have time to process it before I'm already moving away; because those smaller systems have much faster - but more rudimentary - feedback loops.
they have decision models now
money is tight
It's ironic that the people working to make others disposable were in fact, disposable.
AI is eating AI now. The value of code has collapsed, while the value of the software industry overall has not increased. Could AI be the snake that eats its own tail in the long-term?
According to the article at least, all these people still have jobs at OpenAI.
Thanks for pointing that out.
"Make a general intelligence, get surprised when it generalized "
Now your part of snake eating it's own tail makes little sense, AI isn't going away, only bad business models.
Open AI realizes robots with actual hardware are hard, and expensive.
"long-term vision" - not even mid-term? I hope Anthropic knows better...
I wonder if this means anything about OpenAI's robot research office in Richmond, CA.