proomt

Search

Search posts, papers, and topics

All posts

Hugging Face Daily PapersRyosei Hara, Wataru Ikeda, Masashi Hatano1 min readpaperintermediate

EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset

Read on arxiv.org

Summary

EventEgoHands++ adds an instance‑aware hand detector and an Adaptive Attention module to event‑camera egocentric hand‑mesh reconstruction, distinguishing left/right hands and modeling their interaction. The authors also release EEH‑R, a ~1 M‑frame real dataset, and report consistent gains over prior baselines on synthetic and real tests.

  • Hand Detector outputs per‑hand bounding boxes and masks, enabling left/right distinction in egocentric event streams.
  • Adaptive Attention gates attention using detection results to capture spatial relationships between hands.
  • EEH‑R dataset offers ~1 M annotated real frames across low‑light conditions, the largest of its kind.
  • Synthetic N‑HOT3D dataset is extended to support training of the proposed pipeline.

AR/VR and robotics engineers needing robust hand tracking in low‑light or high‑motion scenarios should consider the new dataset and architecture.

6/10
computer visionevent camerashand meshegocentricdataset

Related reading

  1. Fingers as Legs: Learning Self-Supported Locomotion and Manipulation with an Anthropomorphic Hand

    The authors train an anthropomorphic robotic hand to crawl, steer, and recover from falls using its fingers for both support and manipulation, via a reinforcement‑learning reward formulation tuned to the hand's asymmetry. Sim‑to‑real experiments show faster locomotion than quadruped‑style rewards and successful untethered tasks without onboard vision.

    Hugging Face Daily Papersarxiv.org1 minpaper

  3. SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image

    The paper presents SNAP3D, a physics‑guided pipeline that converts a single image into a set of 3D parts that can be assembled without interpenetration. By using simulation‑driven connector placement and a new physics‑based evaluation, the method yields assemblies that are both geometrically accurate and stable enough for 3D printing.

    Hugging Face Daily Papersarxiv.org1 minpaper

  4. Breaking the Vision-Action Shortcut: Latent Interface Training for Generalizable Robotics Foundation Models

    Latent Interface Training (LIT) first learns a goal‑conditioned action prior without visual input, then adds a pose‑supervised latent interface as the only visual conditioning path. Applied to several vision‑language‑action models, LIT cuts vision‑action shortcuts and lifts LIBERO‑Plus success by 3.9–10.7 points and real‑world task success by 13.3–16.7 points under distribution shifts.

    Hugging Face Daily Papersarxiv.org1 minpaper

  5. VABench: Measuring Embodied Spatial Intelligence through Visual Demonstrations, Active Perception, and Metric Control

    VA‑Bench is a new benchmark that evaluates general‑purpose multimodal LLMs on the full observe‑reason‑act‑revise loop in embodied robotics, using RGB demonstrations, active camera control, and metric Cartesian commands. The best model reaches 53.9% average task success, showing active perception helps but long‑horizon tasks remain unsolved.

    Hugging Face Daily Papersarxiv.org1 minpaper

  6. Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control

    Zing‑0.5 is a 5 B autoregressive world model that lets users control generated environments in real time using both keyboard actions and text prompts. The paper introduces unified action‑text conditioning, segment‑level teacher distillation, and a low‑cost streaming inference pipeline that runs at 24 FPS (832×480) for about $0.009 per minute, achieving 81 % overall and 88.5 % consistency on a nav…

    Hugging Face Daily Papersarxiv.org1 minpaper