MIT’s ultrasound wristband tracks every finger movement and lets you control a robot hand in real time


TL;DR

MIT built an ultrasound wristband that tracks 22 degrees of hand motion and controls a robot hand in real time with 120ms latency.

Engineers at MIT have built an ultrasound wristband that can track 22 degrees of freedom in the human hand and use that data to control a robotic hand in real time, according to research published in Nature Electronics in March 2026. The device uses a ring of small ultrasound transducers worn around the wrist to monitor the movement of tendons and muscles in the forearm, translating subtle shifts into a complete picture of finger and thumb position. In tests with eight volunteers, the system achieved continuous tracking with approximately 120-millisecond latency, fast enough to mirror a human hand’s movements on a robotic counterpart with what the researchers describe as near-natural responsiveness.

The research was led by Xuanhe Zhao, a professor of mechanical engineering at MIT, with co-authors including Gengxi Lu, Xiaoyu Chen, Shucong Li, Bolei Deng, SeongHyeon Kim, Dian Li, Shu Wang, Runze Li, and Anantha Chandrakasan, MIT’s dean of engineering. The team demonstrated the wristband’s precision by having all eight participants perform the full American Sign Language alphabet, successfully recognising all 26 letters. The device operates wirelessly and does not require cameras, gloves, or any sensors attached to the fingers themselves.

Existing hand-tracking systems typically rely on cameras, which fail when fingers are occluded, or instrumented gloves, which restrict natural movement and are impractical for extended wear. The MIT approach works by reading the body’s own mechanics from the outside. When a finger moves, the tendons and muscles in the forearm shift in patterns that are specific to each movement.

The ultrasound transducers detect those shifts and a machine learning model maps them to the 22 degrees of freedom that define hand posture, covering individual joint angles across all five fingers and the thumb’s opposition. No cameras or finger-mounted sensors are involved. The entire system sits on the wrist.

The 💜 of EU tech

The latest rumblings from the EU tech scene, a story from our wise ol’ founder Boris, and some questionable AI art. It’s free, every week, in your inbox. Sign up now!

The 120-millisecond latency figure is significant because it falls within the range that humans perceive as responsive in manual control tasks. The team demonstrated this by having participants control a dexterous robotic hand through the wristband, performing grasping and manipulation tasks. The robotic hand mirrored the operator’s movements closely enough that the researchers describe the interaction as suitable for teleoperation applications, where a human operator controls a remote robot to perform tasks in environments that are dangerous, sterile, or otherwise inaccessible.

The implications extend well beyond laboratory teleoperation. Dexterous hand control remains one of the most persistent unsolved problems in humanoid robotics, where even well-funded companies producing thousands of units struggle with fine manipulation. A wristband that lets a human operator lend their dexterity to a robot hand in real time could serve as a bridge technology, enabling robots to perform complex manual tasks under human guidance while autonomous manipulation capabilities continue to develop.

The research was funded by the National Institutes of Health, the National Science Foundation, the Department of Defense, and the Singapore National Research Foundation. The funding mix reflects interest from both medical and defence communities, where remote dexterous manipulation has obvious applications in surgery, bomb disposal, and handling hazardous materials. The paper does not describe a commercial product or announce a startup, and the device as published is a research prototype.

It is worth noting that the Nature Electronics paper was published in March 2026, making the underlying research roughly three months old at the time of wider media coverage. The AP wire story that brought broader attention to the work is a delayed feature, not a report on a new announcement. The core findings have been in the public record since March.

As major companies like Nvidia and Hyundai race to industrialise robotics and bring humanoid machines to factory floors, the question of how humans will interact with and control those machines remains largely unanswered. MIT’s wristband suggests that the interface might not be a screen or a joystick but the operator’s own hand, read through the skin.

Whether the device moves from a research lab to a product depends on challenges the paper does not address, including manufacturing cost, durability, and whether the machine learning model generalises across a wide population of hand anatomies without per-user calibration. The eight-volunteer study is a proof of concept, not a clinical trial. But as a demonstration of what is physically possible, a wearable that turns any human hand into a robot controller without touching the hand itself is a meaningful step toward making teleoperation practical outside specialised laboratories.



Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


Robot mowers on a yard

Maria Diaz/ZDNET

Follow ZDNET: Add us as a preferred source on Google.


The perfect robot mower for you is not nearly as fancy and feature-heavy as you may think. I’ve said it before, and I’ll say it again: it’s not the lawn mower, it’s all about the yard. A robot mower may be a market leader with top-of-the-line specs and still not be a good fit for your yard.

Here’s the great news: There’s a perfect robot mower for almost any yard. As someone who’s tested numerous types of robot lawn mowers, I’ve learned that many of the specs that brands market as groundbreaking are simply not vital for most shoppers. A mostly flat, fenced-in 0.10-acre yard doesn’t need the power that a hilly, sectioned, unfenced one-acre yard does.

Also: I tested the Ferrari of robot mowers for a month – here’s my verdict

If you’re looking to choose the best mower for your home, be sure to check out ZDNET’s robot mower buying guide

Here’s what you don’t need to stress over when buying a robot mower

Eufy E15 Robot Mower

Maria Diaz/ZDNET
For yards with… Best robot mower type Examples
No fences A wired boundary is best, but a great GPS/RTK robot mower can stick to the map you make with it. Yardcare E400, Mammotion Luba 3
Fences A LiDAR robot mower that can be dropped to mow with little setup and learn its map as it navigates. Eufy E15, Ecovacs Goat A3000
A lot of trees A LiDAR or wired boundary mower, since trees can interfere with satellite signals. Husqvarna iQ series (optional wire, EPOS)
Unbordered garden beds A GPS/RTK robot mower that you can set up to avoid flower beds when mapping. Mammotion Luba 3, Husqvarna iQ Series
Bordered garden beds A LiDAR, GPS, or wired boundary robot mower works for these yards. If you choose a wired boundary, you may have to bury wire around the flower beds, unless the borders are tall enough for the mower to avoid. Mammotion Yuka, Navimow Series H
pets A LiDAR robot mower that can adjust its navigation in real-time in reaction to its surroundings. Mova LiDAX Ultra 2000, Segway Navimow i2
Hills and uneven terrain An AWD robot mower capable of handling steep slopes, regardless of the navigation type. Mammotion Luba 3, , Husqvarna iQ

1. Don’t focus on: ‘AI-powered’ or other marketing buzzwords

Segway Navimow X3 Series robot mower

Maria Diaz/ZDNET

Artificial intelligence (AI) has surpassed the popularity of acid-wash jeans in the 80s and Baby G watches in the early 2000s. And tech companies — including robot lawn mower manufacturers — are capitalizing on its appeal.

Most of these “AI-powered” or “intelligent mowing” terms are vague, geared to grab shoppers’ attention with buzzwords. That doesn’t mean that the robots don’t use AI to navigate, however. 

The key is to find out how the robot uses AI to its benefit, and whether that will meet your AI expectations. 

Also: This robot mower took care of my lawn for months – and it’s currently $300 off

AI algorithms typically process data captured by the robot’s hardware to help it make quick decisions and adjustments. For example, a robot lawn mower may have a set of sensors and cameras to capture its surroundings. The robot’s processor then uses AI to convert that information into actionable data, so it knows whether to swerve to avoid an obstacle or slow down around a retaining wall.

Instead, look for: The navigation tech under (and on) the hood

Instead of AI and other buzzwords, you should focus on matching the robot lawn mower’s hardware and navigation system to your yard. This includes whether the robot uses RTK (Real-Time Kinematic) for positioning, and whether it features LiDAR, cameras, and sensors. 

Then look at real user reviews to assess how accurately the robot mower maps and how well it performs around various types of obstacles.

There’s no blanket rule for robot mowers, but most do well with the following guidelines.

2. Don’t focus on: Premium extras

Yardcare E400 robot lawn mower

Maria Diaz/ZDNET

Skip the premium extras that don’t match your yard. You really don’t need the most advanced robot mower; you need the one that will best handle your lawn. 

Most US homeowners have mostly flat lawns, simple rectangular layouts, minimal obstacles, and small yards. Yet some of the most popular mowers advertise features that don’t match this, and you don’t want to spend an extra few hundred dollars on advanced features that won’t deliver a noticeable difference in your yard.

Instead, look for: Only as much as you need

Do you have a mostly flat lawn with no fences and need a robot that can navigate to several sections separated by paths? Then you can skip AWD models and commit to superior mapping and navigation features, like multi-zone intelligence.

Also: I let a modular yard care robot mow my lawn – here’s my verdict after a month

Similarly, if you have a yard with dense trees covering most of it, it’s safe to skip the RTK models and go for LiDAR or boundary wire options instead. 

3. Don’t focus on: Flashy app features

Mammotion Luba 2 robot mower path

The path lines created by the Mammotion Luba 2, as captured by our Bink Outdoor camera, is one flashy app feature I can’t quit.

Maria Diaz/ZDNET

Any dependable robot lawn mower requires an equally reliable mobile app to let you use it effectively. However, manufacturers market many flashy app features that end up being unnecessary for many users. 

Don’t make app features the deciding factor unless it’s something you genuinely care about. Many users don’t rely on voice control to run their mowers and don’t mind using a separate app for their robot rather than integrating it into an existing home automation system.

Also: I let a smart planter maintain itself for 2 months – here’s the result

A robot lawn mower with mediocre navigation and cutting performance can still have a flashy app — all while leaving behind missed patches or taking longer to finish mowing.

Instead, look for: The features you’ll actually use

Most robot mower users keep them running on a schedule to get the lawn-cutting chore off their minds. The majority of the most popular models offer basic features beyond scheduling, such as remote start and stop, basic mapping, automatic rain delay, and theft protection. 

It’s easy to find robot lawn mowers with these features, but if you’re looking for anything beyond that, just be sure that the feature is worth it, especially if you’re paying extra for that model.

Also: I’ve tested robot mowers for years – here’s my expert advice for every yard type

An example of a flashy app feature that is completely unnecessary, but I love having? The Mammotion’s pattern cutting. I can select the cutting pattern I want on the Mammotion app, whether I want lines or checkered, but I can also have the robot cut in custom patterns, like letters and numbers. I don’t care for mowed letters in my yard, but I like that it always has that freshly mowed checkered patterned with no effort from me. 

4. Don’t focus on: Cutting system extras

Segway Navimow X3 Series robot mower

Maria Diaz/ZDNET

The cutting width and system specs are important, as they can determine whether a robot can cover a given area in a day. However, most robot mowers use similar multiple-blade mulching systems. 

Unlike traditional lawn mowers with large blades for aggressive cutting in a single pass, robot mowers typically feature a set of small blades that constantly spin. Because of this, robot mowers trim smaller amounts of grass with each pass than a traditional mower, but they also cut more frequently and leave behind smaller grass clippings that decompose naturally.

Also: I powered my 3,000-sq-ft home with an EcoFlow battery in a blackout – here’s how it kept my AC on

Because the robot mowers have a smaller, compounding cutting system, the real-world differences between the cutting systems from one brand to another are often smaller than you’d expect. Other issues, like poor navigation, will be glaringly obvious before small differences in blade design.

Instead, look for: Cutting width and yard size

The average US yard would benefit more from navigation quality, consistency, and connectivity than blade design. Instead, you should focus on matching the mower to your yard size.

The robot’s capacity is measured in how many acres it can cover in a day. Among other features, this is calculated based on your robot’s battery size and cutting width. Essentially, most users want a robot that can mow an entire yard in a day, so you can set it and forget it and always come home to a mowed yard. You get this by getting the appropriate robot for your yard size.





Source link