BestMan: A Versatile Mobile Manipulation Platform with Seamless Sim2Real Integration and Modular Algorithm Deployment

1College of Computer Science, Chongqing University, 2Shanghai Artificial Intelligence Laboratory, 3State Key Laboratory of Mechanical Transmission for Advanced Equipment, Chongqing University, Equal contribution, *Corresponding author.
Short Version

Abstract

The emergence of embodied intelligence frameworks has significantly advanced the field of robotics, particularly in mobile manipulation. However, the complexity of algorithm development within the real-to-sim-to-real cycle, coupled with heterogeneous and incompatible robot platform interfaces, often impedes seamless solution migration and deployment. To address this need, we introduce BestMan, a versatile platform designed to facilitate the integration and deployment of mobile manipulation algorithms developed in simulated home environments. Specifically, an efficient real-to-sim twin architecture is designed to reduce the virtualization difficulties, which accelerates the digital construction of real-world assets. Following that, we propose a fully modular functional architecture that integrates and collaborates perception, planning, and control capabilities with state-of-the-art algorithms to enable the robots to perform diverse tasks. Then, to support seamless migration, we introduce a unified middleware abstraction layer for the simulation and real device interface structure. Finally, an exemplar workflow across various representative tasks demonstrates the feasibility and flexibility of algorithm deployment using BestMan. Extensive functional comparisons against competitive frameworks demonstrate BestMan's comprehensiveness and adaptability. The open-sourced code is available at https://github.com/AutonoBot-Lab/BestMan.

Architecture

Your image description
  • The platform comprises eleven top-level modules (highlighted in blue and red). ch module contains several submodules (highlighted in yellow), where various algorithms or contents can be implemented. (highlighted in green).
  • The ellipsis (...) indicates customizable modules or algorithms that users can extend.
  • The unified simulation-hardware robotics APIs are constructed based on the controller and sensor modules, while other components are independent of these robotics APIs.

Asset Overview

Your image description
  • We provide an extensive collection of rigid and articulated interactive objects, simulating a wide range of household scenarios.
  • The platform supports diverse configurations of mobile manipulators, which consist of modular components such as mobile bases, robotic arms, end effectors and sensors, offering flexibility for various task executions.

Simulation Demos


  • The video showcases basic demonstrations within the platform's simulation environment, featuring tasks such as autonomous navigation, object manipulation, and interaction with articulated objects in a household scenario.
  • The entire simulation process is rendered through Blender, delivering high-quality visual effects that enhance the realism and detail of the simulated environment.

Author

Kui Yang

Kui Yang

Master Student, Chongqing University

202414021045T@stu.cqu.edu.cn

Yan Ding

Dr. Yan Ding

Researcher at Shanghai AI Lab

yding25@binghamton.edu

Xianlei Long

Chao Chen

Researcher at Chongqing University

xianlei.long@cqu.edu.cn

Dr. Yan Ding

Dr. Yan Ding

Full Professor, Chongqing University

cschaochen@cqu.edu.cn

BibTeX


@inproceedings{Yang2024BestManAM,
    title={BestMan: A Modular Mobile Manipulator Platform for Embodied AI with Unified Simulation-Hardware APIs},
    author={Kui Yang and Nieqing Cao and Yan Ding and Chao Chen},
    year={2024},
    url={https://api.semanticscholar.org/CorpusID:273403368}
}