The invention discloses an
electronic skin tactile perception feature extraction method based on hierarchical semantic coding. The method comprises the following steps of S1, collecting
electronic skin signals; high-density flexible
electronic skin is pasted on the hands or fingertips of the
robot; S2, touch signals are preprocessed; performing alignment
processing on the tactile
signal, the
image signal and the voice
signal in time through a multi-
modal data synchronization mechanism; S3, performing multi-level semantic coding on the tactile
signal; s4, carrying out cross-
modal mapping; a hierarchical semantic
encoder is provided, tactile signals are abstracted into high-dimensional semantic vectors with
interpretability step by step, human-like tactile understanding is achieved, extracted tactile features support multi-
modal alignment and embedding in a
shared space, native cooperation with CLIP / VLM class models can be achieved, modal barriers are broken, and the method has the advantages of being simple in structure, convenient to operate and high in practicability. The tactile information
feature extraction method has strong generalization and adaptability, can be directly applied to a
large model of vision-language-tactile multi-modal
information fusion, and realizes real-time training and
decision making.