Rendered at 21:40:35 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
w10-1 1 days ago [-]
Was it expected that Qwen is working on this? What are the current alternatives?
The TAM for robots is much, much larger than for coding or services, and much more strategic when you think about manufacturing and war-making.
The Qwen "suite" is a workmanlike breakdown with demonstrated tasks that seems to me as an outsider to suggest that one could start building integrated systems this year, and have simple products next year. I'd be very interested in an assessment from engineers from the robotics companies (cars, biomedical robots, manufacturing...).
Elsewhere on HN I see hundreds of comments on SpaceX's long-telegraphed merger with Cursor but no serious evaluation of this.
martythemaniak 1 days ago [-]
I come from a regular swe background, but I've spent the last few months getting into robotics and trying to build a snow-clearing robot, so here's my noob notes:
First, very much expected. Both Google and Qwen have been building explicit spatial reasoning and spatial output capabilities in their models since last fall, gemini 3 was released with support for outputting trajectories for example. I only took a look at Robonav (more relevant for my needs) and its architecture and capabilities are inline with other similar models (eg nVidia's alpamayo).
Second, the overall architecture they describe mirrors what I've been working on: You have general purpose LLM that takes a look at the works and the task in front of it and reasons to break it down into subtasks and tool calls, and you can think of RoboNav and RoboManip as tool calls here. The harness keeps a memory and manages the context of the LLM and tools and keep looping until the objective is complete.
Consider the task of clearing snow off a driveway using this suite: An LLM (Qwen 3.7 plus) takes look at the driveway and decides which areas to clear. The harness then tells robotnav to go to an certain location, then robotnav takes over an runs in a loop until the robot is that that location. Then the harness tells robotmanip to use the plow to clear strip of snow. The harness will then call the planner LLM to plan an execute the next clearing and repeats until the driveway is clear.
So what' the issues? Well, they didn't release the weights, nor the training scripts so you can't actually use it. But also, it's all very research-y still, the models are "small" but still huge/expensive for current edge hardware. You'd still need lots of data collection, HITL, and fine-tuning and evals to make it work for your task. You'd also need a secondary safety system to make sure the models don't wreck something. But overall, I do expect robots to use an agent/model combo like this in prod in a few years.
euroderf 2 minutes ago [-]
I wonder if there is hope for clearing ice off asphalt and concrete. It's a real problem in Scando, where temps can hover around freezing longtime, for repeated thaw/freeze cycles.
jvanderbot 22 hours ago [-]
This is bananas to me. Theres been successful entries to snow plow competitions for ages. What a world that people now expect networks to handhold through it. Irresistable to all parties I suppose.
Well I guess I'll have to have a look!
martythemaniak 7 hours ago [-]
Yeah, there's commercially available snow plow robots, you can buy a Yarbo for your house today. As far as I can tell, they all operate on a classical robotics stack - for the Yarbo you install an RTK antenna to give the robot cm-level precision, define a map and a routine, then the Yarbo can execute that routine by itself.
But can it deal with arbitrary lots without extensive premapping, manage piles, handle obstacles intelligently, correct itself (ie spot needs a second clearing ), tackle windrows, etc? It can't, and my hunch is that LLMs are the first tech we have that can plausibly handle all the various cases that a proper robot would need to handle.
jvanderbot 3 hours ago [-]
My hunch is that some kind of planning stack with environmental awareness at a network level is a good solution to this. My hunch is that LLMs aren't really it. Maybe VLA but I'd bet lower.
Robotics probably will absorb a lot of Rl/diffusion-based tech, with LLM at a high level interface at best.
martythemaniak 1 hours ago [-]
Yeah, afaik the approach people take today is always some form of bi or tri level hierarchical control, with a slow LLM doing planning and sub task management and diffusion or VLA doing the motor control at higher frequencies. Major differences seem like where and how you draw the boundaries. For my project I'm personally trying to use ROS2 as a low level tool call (instead of diffusion), with an agent /LLM doing the main decisions.
Having said that, this scheme seems like it might just be a reaction to current hardware limitations. When I saw Talaas demonstrate a 8B model running on a custom chip at 17k Tok/sec, first thing I thought was "wow, you can just run an LLM in a control loop"
officialchicken 15 hours ago [-]
> This is bananas to me. Theres been successful entries to snow plow competitions for ages.
Why do you hate subscriptions? What if you get a summertime snow storm?
rsalus 17 hours ago [-]
> The TAM for robots is much, much larger than for coding or services
how do you figure?
Schiendelman 16 hours ago [-]
The physical work in the world far outstrips the information work. Most information work is simply organizing physical work, attempting to make physical work more efficient.
crazylogger 15 hours ago [-]
The promise of intelligence might be larger still. By scaling and using superintelligent LLMs to write code for itself, it's possible that the whole field of robotics is just another problem you can point LLM agents at and expect to be solved by afternoon, just like one of those math puzzles. "Traditional" robotics R&D (or any R&D really) would be worthless due to abundance.
RetroTechie 12 hours ago [-]
You're just confirming GP's point. If AI agents make those software problems trivial, the physical tasks are all that's left.
Regard it as market segments. It's not hard to envision eg. agriculture & food processing robotized to the point where no human ever touches your food. A few generations in, and people would see potatoes as "nutrient-containing object that comes from a factory" and forgot how to grow potatoes.
I'm rooting for the 'market segment' where AGI (or ASI) finds solutions to long-standing science questions, that are hard to obtain but easy to verify. Or makes new discoveries. Stuff like cancer research, protein folding, synthetic biology, new materials, battery tech, number theory, particle physics, etc etc.
Schiendelman 11 hours ago [-]
I'm with you. As these models grow in ability and commoditize across the TAM of basically every business in the world, it's going to get cheaper and cheaper to solve everything.
ragebol 16 hours ago [-]
How many people have homes that require chores to be done? Laundry, cleaning, setting/clearing tables, yard work, some consider cooking a chore.
If I could get an affordable robot to do a subset of them, I'm in the market for one.
aamdias 9 hours ago [-]
[flagged]
aliljet 1 days ago [-]
This sounds incredible. Have these models effectively solved the problem of trying to use a fast-processing network to predict the world's state ahead? For example, to catch a ball?
ltononro 11 hours ago [-]
I wonder how one gets data for training foundational models like this.
Any idea?
andy_ppp 10 hours ago [-]
Control the means of production?
ramon156 11 hours ago [-]
Really cool but I can only imagine this will be used for military purposes. Then again I am not working in this space, so perhaps this is a bit short-sighted of me.
theplumber 10 hours ago [-]
I am not that pessimist. We have stuff like Roborock so why not a super Roborock ?
lukewarm707 1 days ago [-]
qwen just keeps delivering, it's too good
amluto 1 days ago [-]
The qwen.ai webpage should learn to deliver plain HTML with its content instead of overcomplicated JavaScript and CSS to display obnoxious pulsating rectangles where the content ought to be but hasn’t managed to load.
lukewarm707 14 hours ago [-]
i would read this stuff if it arrived by pigeon.
halJordan 1 days ago [-]
Bike shedding exhibit a:
amluto 1 days ago [-]
I don’t think it’s bike shedding if I literally cannot load the content. This is a recurring problem on these qwen.ai announcements.
trilogic 1 days ago [-]
This is brilliant, the very future of humanity and huge market share for the next 30 years. The cards on the table too early can be a mistake. With Qwen background this can be mass production like 1 Million units/year in the next 3 years. Think of excavators but in minisize for human use. OMG Europe look at this and take note, every industry dream, the robot suit. It will take over the car market by X10 fold in the next decade. Please Europe get on this fast.
karunamurti 21 hours ago [-]
With Chinese robotics capabilities and silicone doll capabilities they can be the forefront in the humanoid robotics if everything converge.
voakbasda 21 hours ago [-]
I certainly would not bet on anyone else to win this game. It will be a decisive tipping point, revealing US tech hegemony has fallen.
dyauspitr 7 hours ago [-]
I think they should get into the biological skin market. Artificially grown and maintained human skin over a robot frame.
idiotsecant 1 days ago [-]
I can't view the videos on my phone. How much existential terror should I feel?
They've released quite a bit of models... Based on that organization page, seems like the answer is no, Qwen-Robot Suite isn't open source.
yogthos 21 hours ago [-]
In my opinion, training through embodiment and constructing an internal world model makes it possible to do genuine reasoning about how objects behave in the physical world. We have a continuous feedback loop where we take an action, and see the result giving basis to our shared context we lean on when communicating with each other. Having context is key for being able to explain why you made a particular decision, and allows for error correction and guidance towards better decisions through conversation. This is largely what we mean by having understanding in a human sense. So, having a world model in the context of robotics is the most likely path towards creating a genuine artificial intelligence.
pcell 19 hours ago [-]
[flagged]
Kuyawa 1 days ago [-]
Think, move, sense, at a neck breaking pace. Awareness is just an iteration away.
The TAM for robots is much, much larger than for coding or services, and much more strategic when you think about manufacturing and war-making.
The Qwen "suite" is a workmanlike breakdown with demonstrated tasks that seems to me as an outsider to suggest that one could start building integrated systems this year, and have simple products next year. I'd be very interested in an assessment from engineers from the robotics companies (cars, biomedical robots, manufacturing...).
Elsewhere on HN I see hundreds of comments on SpaceX's long-telegraphed merger with Cursor but no serious evaluation of this.
First, very much expected. Both Google and Qwen have been building explicit spatial reasoning and spatial output capabilities in their models since last fall, gemini 3 was released with support for outputting trajectories for example. I only took a look at Robonav (more relevant for my needs) and its architecture and capabilities are inline with other similar models (eg nVidia's alpamayo).
Second, the overall architecture they describe mirrors what I've been working on: You have general purpose LLM that takes a look at the works and the task in front of it and reasons to break it down into subtasks and tool calls, and you can think of RoboNav and RoboManip as tool calls here. The harness keeps a memory and manages the context of the LLM and tools and keep looping until the objective is complete.
Consider the task of clearing snow off a driveway using this suite: An LLM (Qwen 3.7 plus) takes look at the driveway and decides which areas to clear. The harness then tells robotnav to go to an certain location, then robotnav takes over an runs in a loop until the robot is that that location. Then the harness tells robotmanip to use the plow to clear strip of snow. The harness will then call the planner LLM to plan an execute the next clearing and repeats until the driveway is clear.
So what' the issues? Well, they didn't release the weights, nor the training scripts so you can't actually use it. But also, it's all very research-y still, the models are "small" but still huge/expensive for current edge hardware. You'd still need lots of data collection, HITL, and fine-tuning and evals to make it work for your task. You'd also need a secondary safety system to make sure the models don't wreck something. But overall, I do expect robots to use an agent/model combo like this in prod in a few years.
Well I guess I'll have to have a look!
But can it deal with arbitrary lots without extensive premapping, manage piles, handle obstacles intelligently, correct itself (ie spot needs a second clearing ), tackle windrows, etc? It can't, and my hunch is that LLMs are the first tech we have that can plausibly handle all the various cases that a proper robot would need to handle.
Robotics probably will absorb a lot of Rl/diffusion-based tech, with LLM at a high level interface at best.
Having said that, this scheme seems like it might just be a reaction to current hardware limitations. When I saw Talaas demonstrate a 8B model running on a custom chip at 17k Tok/sec, first thing I thought was "wow, you can just run an LLM in a control loop"
Why do you hate subscriptions? What if you get a summertime snow storm?
how do you figure?
Regard it as market segments. It's not hard to envision eg. agriculture & food processing robotized to the point where no human ever touches your food. A few generations in, and people would see potatoes as "nutrient-containing object that comes from a factory" and forgot how to grow potatoes.
I'm rooting for the 'market segment' where AGI (or ASI) finds solutions to long-standing science questions, that are hard to obtain but easy to verify. Or makes new discoveries. Stuff like cancer research, protein folding, synthetic biology, new materials, battery tech, number theory, particle physics, etc etc.
If I could get an affordable robot to do a subset of them, I'm in the market for one.