\(\small \mathcal{T(R,O)}\) Grasp++: Cross-Embodiment Dexterous Grasping in Cluttered Environments at Scale

Xin Fei1,2, Zhixuan Xu1,2, Huaicong Fang3, Fangjun Chen2,4, Zhaoyu Mu1, Rui Yang1,2, Zhexi Luo2,5, Lin Shao1,2
1National University of Singapore, 2RoboScience, 3Zhejiang University, 4Southern University of Science and Technology, 5Sun Yat-sen University
Teaser Image

Abstract

Dexterous grasping in cluttered scenes remains a central challenge in robotic manipulation, as it requires high-dimensional hand coordination under complex object-environment constraints. To address this problem, we introduce one of the largest simulation benchmarks to date, comprising around 0.5B grasp annotations across eight dexterous hands and approximately 50K objects. Further, we propose \(\small \mathcal{T}(R,O)\) Grasp++, a scalable diffusion-based framework for cross-embodiment dexterous grasp synthesis in cluttered environments. Extensive experiments demonstrate that our model significantly outperforms existing baselines, achieving an average success rate of 88% across eight dexterous hands. Meanwhile, our pipeline achieves only 0.3s inference latency while improving inference sample efficiency by over 10 times.

Method Overview

Teaser Image

Overview of \(\small \mathcal{T(R,O)}\) Grasp++: We define \(\small \mathcal{T(R,O)}\) Graph++ to capture spatial relations among target object, surrounding environment, and arbitrary dexterous hand. We then apply a graph diffusion model to generate link-wise \(\small SE(3)\) poses.

Simulation Results

Mesh ID: 0

Real-world Results

XHand: 85%

LEAP Hand: 82%

Single View Grasping

Wuji Hand: 82.1%

Sequential Table Clearing