The invention relates to the technical field of
gesture recognition interaction, and discloses an intelligent interaction
system and method based on
gesture recognition. The method comprises the following steps: when an environment meets a condition, synchronously acquiring an
image sequence of a gesture and depth distance
field data; a
hand joint point two-dimensional motion track is extracted from an image,
surface deformation fluctuation information is separated from depth data, the two-dimensional motion track and the
surface deformation fluctuation information are subjected to space-time registration fusion, a continuous motion track curved surface in a three-dimensional space is constructed, and then geometric topology features and dynamic change features of the continuous motion track curved surface are extracted. And inputting the fusion features into a
neural network classifier subjected to
incremental learning training, outputting corresponding semantic tags and confidence evaluation values, and mapping to generate a control instruction after
verification. According to the method, an accurate three-dimensional dynamic model is constructed through deep fusion of multi-
source data, and an
incremental learning mechanism is utilized to enable the
system to have online adaptive capability, so that the recognition precision of complex gestures and the long-term applicability of the
system are improved.