Smartwatch detects objects touched by wearer

Objects give off different electro-magnetic signals depending on their operations and composition. Using the human body as an antenna, the EM-Sense watch filters these signals to determine what objects the user is in contact with. Software can distinguish between a host of different everyday items, from drills and door handles, to computer screens and toothbrushes. The work is published at Disney Research.

“Our approach exploits unintentional EM noise emitted by many everyday electrical and electromechanical objects, such as kitchen appliances, computing devices, power tools and automobiles,” the study’s abstract states.

“These signals tend to be highly characteristic, owing to unique internal operations (e.g., brushless motors, capacitive touchscreens) and different enclosure designs, material composition and shielding. When a user makes physical contact with these objects, electrical signals propagate through the user’s body, as it is conductive. By modifying a commodity software-defined radio receiver, we can detect and classify these signals in real time, enabling robust, on-touch object detection.”