This invention discloses a
human body surface
palpation simulation training
system based on multimodal AI interaction, belonging to the fields of
medical simulation training and human-computer
interaction technology. The
system includes: a photoelectric-triboelectric fusion
tactile perception and feedback unit, a
palpation-specific micro-tactile feature
library, an AI dynamic tactile rendering engine, and a hardware
clock synchronization module. The photoelectric-triboelectric fusion
tactile perception and feedback unit integrates modules such as multispectral imaging, synchronously collects four types of
palpation data, and generates corresponding feedback. The feature
library stores multi-dimensional features of real clinical palpation. The AI engine is based on the
Transformer architecture, combines the collected data and the feature
library, and generates driving signals through calculation formulas. The synchronization module uniformly controls the sampling timing of each module. This invention integrates multiple modules to synchronously collect multi-dimensional palpation data, constructs a real clinical palpation feature library, and combines a customized AI
algorithm that is deeply integrated with hardware to achieve high-fidelity, low-latency three-dimensional tactile
simulation, ensuring the consistency of tactile feedback across different devices.