Physics-based multi-mode contact simulation system and method for visuo-tactile sensor
By developing a physics-based multi-mode contact simulation system and method for visual-tactile sensors, and utilizing the material point method and ray tracing technology, the system solves the problems of high data acquisition cost and low efficiency in visual-tactile sensor simulation, and achieves efficient and low-cost visual-tactile simulation.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- BEIJING UNIV OF POSTS & TELECOMM
- Filing Date
- 2025-01-06
- Publication Date
- 2026-05-21
AI Technical Summary
Existing simulation technologies for visual-tactile sensors suffer from high data acquisition costs, poor robustness of generative models, and low efficiency of FEM models, making it difficult to efficiently generate high-quality visual-tactile sensor contact information in complex environments.
A physics-based visual-tactile sensor multi-mode contact simulation system and method are adopted. Through the material point method, camera model and ray tracing technology, the system realizes the simulation of elastic body contact, coordinate system transformation and tactile image merging, and generates high-quality tactile images and marker point joint images.
It reduces the time and cost of acquiring visual-tactile contact data, improves simulation efficiency, and enhances the robustness of visual-tactile sensors under different motion states.
Smart Images

Figure CN2025070650_21052026_PF_FP_ABST