MIT engineers have developed an ultrasound wristband that tracks hand movements in real time by imaging wrist muscles and tendons. An AI algorithm translates the ultrasound images into 22 degrees of freedom across the fingers and palm. In tests with eight volunteers, the device accurately predicted hand gestures including all 26 American Sign Language letters. Demonstrations showed a wearer wirelessly controlling a robotic hand to play piano and manipulate virtual objects on screen. The team plans to miniaturize the hardware, expand the training dataset, and ultimately enable anyone to control humanoid robots or VR environments with high dexterity.
Sort: