LingBot-Touch brings different robot touch sensors into one model
China’s Robbyant team has developed LingBot-Touch to give robot-control models a shared representation of signals from different tactile sensors. The preprint combines magnetic, piezoresistive and vision-based sensing, with experiments on two robot hands. A separate release announcement describes the model’s opening, while the research examines how learned touch information transfers between hardware and control systems.
Artificial Intelligence··Evening
Different sensors feed a shared representation
China’s Robbyant robotics team has developed LingBot-Touch, a model that translates different kinds of touch signals into a shared representation for robot control. Its November 9 preprint covers magnetic, piezoresistive and vision-based tactile sensors. A November 10 release announcement describes the same model. The approach places a common touch-processing layer between the physical sensors and systems that choose a robot’s movements.[1], [2]
Glove and robot-hand data train the encoder
The researchers assembled 4,983 hours of data from tactile gloves and remotely operated robot hands. Separate input transformations handle each sensor family before signals enter a shared network. The representation includes time, finger identity and positions within a common fingertip coordinate space. During training, the model predicts hidden representations instead of attempting to reproduce every raw sensor measurement directly.[1]
Physical tests cover two robot hands
The team tested four families of movement-control policies across 26 tasks on two robot hands, using 20 consecutive trials per task. The pretrained touch encoder stayed frozen while the policies learned from demonstrations. One hand used a magnetic sensor model absent from pretraining, with its geometry mapped into the common coordinates. These experiments were conducted by the authors; palm contact and capacitive sensors remain limitations of the training coverage.[1]
Related columns
For more information on this topic, you can read the related columns.