Physics-based multi-mode contact simulation system and method for visuo-tactile sensor

By developing a physics-based multi-mode contact simulation system and method for visual-tactile sensors, and utilizing the material point method and ray tracing technology, the system solves the problems of high data acquisition cost and low efficiency in visual-tactile sensor simulation, and achieves efficient and low-cost visual-tactile simulation.

WO2026102895A1PCT designated stage Publication Date: 2026-05-21BEIJING UNIV OF POSTS & TELECOMM
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
BEIJING UNIV OF POSTS & TELECOMM
Filing Date
2025-01-06
Publication Date
2026-05-21

AI Technical Summary

Technical Problem

Existing simulation technologies for visual-tactile sensors suffer from high data acquisition costs, poor robustness of generative models, and low efficiency of FEM models, making it difficult to efficiently generate high-quality visual-tactile sensor contact information in complex environments.

Method used

A physics-based visual-tactile sensor multi-mode contact simulation system and method are adopted. Through the material point method, camera model and ray tracing technology, the system realizes the simulation of elastic body contact, coordinate system transformation and tactile image merging, and generates high-quality tactile images and marker point joint images.

Benefits of technology

It reduces the time and cost of acquiring visual-tactile contact data, improves simulation efficiency, and enhances the robustness of visual-tactile sensors under different motion states.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025070650_21052026_PF_FP_ABST
    Figure CN2025070650_21052026_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed in the present invention are a physics-based multi-mode contact simulation system and method for a visuo-tactile sensor. The system comprises: an elastomer contact simulation unit, used for performing particle-based processing on an elastomer of a visuo-tactile sensor, and using elastomer contact simulation to obtain three-dimensional coordinates of particles on a surface of an object; a coordinate system conversion unit, used for calculating coordinates of markers in a pixel coordinate system by means of a coordinate system conversion relationship, so as to obtain a marker simulation image; a tactile image simulation unit, used for processing the three-dimensional coordinates of the particles to generate a tactile simulation image; and a tactile-marker combined simulation unit, used for combining the marker simulation image and the tactile simulation image to obtain a tactile-marker combined simulation image. The present invention can efficiently complete simulation of tactile images, marker images and tactile-marker combined images of visuo-tactile sensors in motion states such as pressing, sliding and rotation.
Need to check novelty before this filing date? Find Prior Art