Hugging Face Daily PapersElizaveta Kovtun, Matvey Konovalov, Andrey Sakhovskiy1 min readpaperadvanced
Tactile-JEPA: Topology-Aware Self-Supervised Representation Learning for Distributed Tactile Sensors
Summary
Tactile-JEPA is a self‑supervised pre‑training technique that leverages the irregular graph layout of distributed tactile skins to learn richer representations. Experiments show it reduces force and orientation estimation errors and improves downstream policy learning across diverse sensor types.
- Tactile-JEPA predicts embeddings of masked taxels using a sensor connectivity graph, making the SSL objective topology‑aware.
- Dual‑scale masking forces the encoder to capture fine‑grained contact details and the global state of the tactile surface.
- Across three datasets, pre‑training cuts force estimation error by 6.3% and in‑hand orientation error by 20.8% versus prior SOTA.
- Method works for both magnetic and piezoresistive skins, and for single‑sensor as well as paired‑sensor robot setups.
Robotics engineers building manipulation systems should care because better tactile encoders directly translate into more accurate force/pose estimation and more reliable policies.
8/10

