983 results about "Body movement" patented technology

The invention provides an AI-based virtual digital human interaction system, and relates to the technical field of data processing, and the system is used for obtaining a user feature data set by performing feature extraction on an interaction data set, calculating an audio change rate and speech speed stability, obtaining speech emotion data, calculating syntactic complexity and counting the number of emotion words. Calculating a facial expression symmetry degree; obtaining facial emotion data; calculating body stability and identifying a visual staying area; obtaining attention state data; adjusting tone and speed of the virtual digital person according to the virtual digital person text, optimizing sentence pattern complexity and sentiment words in the virtual digital person text, adjusting changes of eyes, eyebrows and mouth corners of the virtual digital person, and adjusting information display sequence and visual focus guidance. According to the method, the interaction efficiency of the virtual digital human is improved by analyzing the facial expressions and the body actions of the user.

The invention provides a PPG optical sleep and respiration monitoring method and system based on a gravity sensing intelligent ring, and the method comprises the steps: synchronously collecting a PPG signal and a three-dimensional gravity acceleration signal of a hand through the intelligent ring, carrying out the adaptive filtering of the PPG signal, extracting a time-domain pulse wave and a frequency-domain heart rate variability feature, and carrying out the detection of the PPG signal. Body movement intensity and body position change frequency are calculated according to the gravitational acceleration signals, and body movement feature vectors are generated. And then fusing the pulse wave characteristics, the heart rate variability characteristics and the body movement characteristics, constructing a multi-dimensional physiological parameter matrix, analyzing and dividing sleep stages based on spatial-temporal correlation of the matrix, and detecting abnormal respiratory rhythm. And finally, dynamically adjusting a judgment threshold value of the abnormal respiratory rhythm, and outputting a sleep quality evaluation result and a respiratory event alarm. According to the invention, the accuracy and real-time performance of sleep monitoring can be improved.

The invention discloses an emotional understanding and feedback method for a full-duplex interactive question-answering digital person, and the method comprises the steps: S1, arousing interaction: enabling a digital person of a digital person system to enter an interaction state in a human body detection arousing or voice instruction arousing manner by a user; s2, state analysis: the digital human system judges the state of the user in real time by collecting image data and audio data of the user, and identifies and analyzes the direction, emotion and speech content of the user in real time; and S3, feedback output: the digital human system drives the digital human in voice, expression and body movement through a screen in real time according to the analysis result of the direction, emotion and speech content of the user, and feeds back the result to the user in a manner of adding auxiliary characters, images and videos. The method has the advantages that the emotional state of the user is accurately judged through an advanced algorithm, digital human expressions, body actions and voice feedback are driven in real time according to the emotion and speech content of the user, response is made in time, and a real-person-like real-time interaction scene is achieved.

The invention discloses a vital sign and sleep monitoring method and system based on a millimeter-wave radar, the method utilizes the millimeter-wave radar to realize non-contact sleep monitoring, and the millimeter-wave radar is firstly used to collect radar echo signals obtained by vibration of a chest wall in a sleep state; determining the position of a monitored object and extracting a vital sign signal of the target; then accurately detecting a first amplitude body movement and a second amplitude body movement of the target; whether an apnea event happens to the target is detected in real time, and alarm information is prompted under the condition that the event happens for a long time; three sleeping postures of supine, side-lying and prostrate are detected; and finally, sleep state monitoring is formed, a user sleep quality analysis report is formed in combination with the monitored information, and health suggestions are given. The method is simple, convenient, accurate, economical and efficient, is suitable for various application scenes such as families, hospitals and nursing homes, and provides all-weather health monitoring services for users.

The invention discloses a sleep state monitoring and analyzing system based on multi-sensor fusion, and relates to the technical field of health monitoring, the sleep state monitoring and analyzing system comprises a multi-modal sensor module used for collecting multi-dimensional data related to a sleep state, the multi-dimensional data comprises a bio-electricity signal, a physiological parameter, body movement data and an environment parameter, and the multi-modal sensor module is used for collecting the multi-dimensional data; the multi-modal sensor module comprises a non-contact sensor, a flexible electronic skin sensor and a bio-electricity signal sensor, and the data fusion and processing module is used for carrying out preprocessing, dynamic self-adaptive fusion and federal learning modeling on collected original data. According to an existing contact type sleep state monitoring scheme, more flexible and accurate sleep state data are realized through a non-contact type monitoring sensor in cooperation with dynamic adjustment of sleep monitoring content and adjustment of weights of various sensors for monitoring the sleep state; and a more accurate and intuitive reference report is provided for the sleep state and the health state of the subsequent user.

The invention provides a system and method for assisting rehabilitation in sleep, and the system comprises an electroencephalogram monitoring assembly, a heart rate and breath monitoring assembly, a myoelectricity monitoring assembly and a body movement monitoring assembly which are used for obtaining physiological signals of an object; the intervention component is used for performing predetermined intervention operation when being activated; the control component is used for determining a sleep stage according to the physiological signal of the object; when the sleep stage is a deep sleep stage, determining an intervention priority score according to a day rehabilitation training target, a focus position and a stability score of the current deep sleep stage of the object; when the intervention priority score is larger than or equal to a preset threshold value, the object is in the deep sleep period at present, and the stability of the current deep sleep period meets a preset stability condition, a corresponding intervention assembly is activated. By means of the technical scheme, accurate intervention can be achieved in the sleep process, and the rehabilitation process of a patient is accelerated by effectively connecting intervention in the sleep stage with a rehabilitation training target in the daytime.

The invention provides an immersive concert experience system based on virtual reality, and belongs to the technical field of virtual reality, and the system comprises a dynamic adjustment module which is used for predicting the preference of a user for stage arrangement, light effects and music types through a machine learning model according to the historical preference data of the user, and outputting the preference to the stage arrangement, light effects and music types; dynamically adjusting visual elements and sound field parameters of the virtual scene and a refresh rate and a field angle of the virtual scene in combination with the user physiological indexes and the user head motion trail which are acquired in real time; the action capture and feedback module is used for capturing an interaction instruction sent to the dynamically adjusted virtual scene by the limb action of the user in real time; and the interaction feedback module is used for enabling the virtual performer to respond to the interaction instruction of the user in real time based on the expression recognition and voice synthesis technology, and generating personalized interaction feedback content. A user constructs an immersive music interaction field domain, and experience logic of a virtual music meeting is completely reconstructed.

The invention provides a life sleep sign monitoring method, and relates to the technical field of sign data monitoring, and the method comprises the following steps: collecting an original echo signal of a monitoring area, and extracting a respiration signal, a heartbeat signal and a body movement signal corresponding to a body movement event from the original echo signal; obtaining relevance characteristics of the respiratory signal and the heartbeat signal and adjusting characteristics of the body movement event on the respiratory signal and / or the heartbeat signal; according to the relevance features and the adjustment features, biological features representing individual physiological differences are generated; based on the biological characteristics, target identity probability distribution is obtained; and performing interference suppression processing on the original echo signal according to the target identity probability distribution so as to separate a target respiration waveform and a target heartbeat waveform of the target individual from the original echo signal. The method is suitable for practical application scenes such as multi-person same-bed monitoring and family bedroom monitoring, and the technical bottleneck that the monitoring precision is reduced along with the increase of the target number in the prior art is broken through.

The invention belongs to the technical field of intelligent medical treatment, and discloses a camera-free intelligent vital sign monitoring patient bed system which comprises a sickbed body, a vital sign monitoring module, a state sensing module, an abnormal behavior recognition module, an intelligent reminding module and a computer terminal. The sickbed body is used for sensing whether a patient is on the bed, the lying position and the body movement condition, the vital sign monitoring module is used for monitoring vital signs of the patient in real time, the state sensing module is used for judging the life state of the patient, and the abnormal behavior recognition module is used for recognizing whether the behavior of the patient is abnormal. The intelligent reminding module is used for reminding medical staff to pay attention to the condition of the patient, and the computer terminal is used for displaying the real-time state of the patient in each sickbed. According to the camera-free intelligent vital sign monitoring patient bed system, the vital signs, states and behaviors of the patient can be monitored in real time on the premise that the privacy of the patient is protected, and a nurse is reminded to deal with abnormal conditions in time.

The invention provides a digital human control method and device based on multiple modes and electronic equipment, and relates to the technical field of data processing. In the method, voice data, facial expression data and body movement data of a user are acquired, and the user interacts with a digital human; performing semantic analysis on the voice data by adopting a Transform model to obtain an emotional state and a language habit corresponding to the user; performing feature extraction on the facial expression data by adopting a convolutional neural network model to obtain a facial expression type corresponding to the user; performing action analysis on the limb action data by adopting a hidden Markov model to obtain effective action features corresponding to the user; generating a fusion result based on the emotional state, the language habit, the facial expression type and the effective action features; and adjusting the multi-modal output corresponding to the digital human according to the fusion result. By implementing the technical scheme provided by the invention, the interaction experience feeling of the user can be improved.

The invention relates to the technical field of sleep monitoring, in particular to a sleep monitoring method and system based on combination of electroencephalogram and millimeter wave radar, and aims to solve the problem that OSA judgment accuracy is insufficient due to complication. The method comprises the following steps: acquiring an electroencephalogram signal of a user based on a wireless EEG sensor, and acquiring a physiological signal of the user by using a millimeter wave radar; performing sleep staging analysis on the electroencephalogram signal, and detecting a micro-awakening event in combination with body movement data; the physiological signals are processed through a physiological signal processing model, physiological signal features of the user are extracted, and an apnea event, a hypopnea event, an arrhythmia event, a blood pressure fluctuation abnormal event and a periodic leg movement event of the user are monitored; calculating each OSA judgment index according to the event; and calculating OSA personalized scores according to the OSA judgment indexes, performing OSA severity grading, and generating an OSA severity grading report for assisting medical staff in diagnosis and treatment scheme formulation.

The invention discloses a sleep state real-time monitoring method and system, and belongs to the technical field of sleep monitoring, and the method specifically comprises the steps: collecting a heart rate variability signal, an electroencephalogram signal and body movement data of a user in real time through a non-invasive sleep pad integrating a piezoelectric sensor, a flexible dry electrode and a pressure sensor; based on the physiological data, whether the user reaches an autonomous sleep state or not is judged through a first algorithm model; if not, starting an active intervention program for playing the adjustable music, and dynamically adjusting the music volume, the playing speed or the track in combination with the physiological data feedback until the user enters an autonomous sleep state; after the user falls asleep, physiological data are continuously collected, and a sober period, a light sleep period, a deep sleep period and a rapid eye movement period are divided through a second algorithm model; if the staging result is a waking period, the autonomous sleep state judgment is executed again; according to the invention, non-intrusive monitoring and personalized intervention are combined, and the monitoring comfort and accuracy are improved.

The invention discloses a non-contact sleeping posture detection and vital sign monitoring method based on a millimeter-wave radar, and the method employs a multi-transmitting and multi-receiving millimeter-wave radar, employs an innovative signal processing algorithm and a data processing algorithm, and carries out sleep monitoring through comprehensive consideration of frequency spectrum information and point cloud information. Comprising the steps of extraction of vital sign data such as respiration and heartbeat and judgment of in-bed, body movement and sleeping posture states. Breathing and heartbeat components are effectively extracted through cross-correlation entropy operation, then the signal-to-noise ratio of the breathing and heartbeat components is increased, then fast Fourier transform is carried out on cross-correlation entropy, and it is proved that the breathing and heartbeat frequency is effectively extracted.

The invention provides a result judgment and use method of a portable borborygmus monitor, and relates to the technical field of medical monitoring equipment.The method comprises the steps that abdominal borborygmus is collected through a piezoelectric ceramic sensor array in multi-channel triangular distribution, and breathing and body movement interference is eliminated in combination with a dynamic noise filtering algorithm; extracting borborygmus outbreak duration, interval period and time-frequency energy indexes, and constructing an activeness and rhythm disorder two-parameter evaluation system; dynamically adapting a reference threshold value by adopting an age piecewise function, and introducing a feeding time compensation factor to optimize an individualized criterion; the intestinal obstruction risk is judged through a time sequence matching algorithm and a multi-parameter classification model dual-verification mechanism; a three-dimensional dynamic map is generated based on a sound source localization algorithm and spectral analysis, and data integrity is guaranteed in combination with a priority transmission protocol. According to the method, spatial-temporal feature analysis and an intelligent decision model are fused, sensor anti-interference, individual adaptability and pathological early warning precision are considered, and the core pain points of high misjudgment rate and poor clinical compatibility of traditional equipment are solved.

The invention relates to the technical field of motion monitoring, in particular to a running posture monitoring method based on an image recognition technology, which comprises the following steps: deploying cameras at different angles, synchronously recording whole body actions of a user during running, extracting a joint angle change sequence, and constructing a running three-dimensional action model. According to the method, the consistency and the difference of the actions are recognized by comparing the amplitude and the speed of the joint movement, so that the detection of the action defects is facilitated, and the stability and the deviation of the gait can be quantitatively evaluated by analyzing the foot landing angle and the stride change; analysis of the motion change frequency and amplitude allows coaches and athletes to adjust and optimize gaits in a targeted manner in the training process, the risk of sports injury is reduced, and through continuous simulation and motion symmetry evaluation, recognition of sports defects and adjustment of the camera angle and shooting speed, the training effect of the coaches and the athletes is improved. And the data capture and analysis process in the training process is more efficient and targeted.

The invention relates to a non-contact sleep monitoring method based on cross-modal compensation. In order to overcome the defects that vital sign radar is single in physiological information and prone to being interfered, the method is achieved through multi-modal fusion of a radar sensor, a video sensor and an audio sensor. Specifically, a radar sensor obtains heartbeat, respiration and body movement physiological information through chest mechanical waves, a video sensor obtains heartbeat, respiration and body movement physiological information through a photoplethysmography (PPG), an audio sensor receives sound and the like, feature parameters are extracted, a ReliefF algorithm is used for feature optimization, a machine learning algorithm (Subspace KNN, Bagged Tres and the like) is adopted for classification, and the feature parameters are extracted. And finally, decision-level fusion is carried out through a naive Bayes classifier, and a sleep staging result is output. Experimental results show that the method is robust in a complex environment, the accuracy and reliability of sleep staging can be remarkably improved, cross-modal compensation is achieved, and measurement is more continuous and accurate.

The present invention provides a solution of a human-computer interaction method and system based on three-dimensional coordinate measurement, and a plurality of solutions for applying same to solve technical problems. An operation body and / or an operator performs input and operation interaction by means of a virtual keyboard and a virtual mouse, or integrates a display picture space and carries out various participatory and interactive direct operations and experiences on object components and objects in virtual and real scenes. Virtual handwriting input, body movement posture recognition, and lip recognition interaction methods are further provided, and virtual mode control and interaction methods such as gesture recognition and virtual touch screen interaction are supported. Contact is not needed and there is no need to touch the screen, and mobility is achieved. The present invention is suitable for the two-dimensional conventional computing field, and particularly suitable for three-dimensional space computing fields (comprising VR, MR, AR, meta-universe, virtual simulation, software games, three-dimensional graphics, three-dimensional animation, and other three-dimensional scenes). Human-computer interaction operations in work and life of people can be greatly facilitated and optimized.

Provided herein is a string shooting device, and more particularly, a string shooting device having that is wearable and operable by hand gestures or body movement. Embodiments include a wearable device for propelling a string including: a string shooting device; a band configured to attach to a body part of a user; and a holder, where the holder is secured by the band to the user; where, in response to the body part of the user being in a first position, the string shooting device is not actuated, and where in response to the body part of the user being in a second position, the string shooting device is actuated.

The invention relates to the technical field of game development and artificial intelligence, and discloses a Qt interactive game role action response control method fused with AI emotion recognition, which comprises the following steps: S1, acquiring multi-modal data such as facial expression, voice intonation and limb action of a player by using sensors such as a camera and a microphone on game equipment; s2, the collected multi-modal data are transmitted to an AI emotion recognition module, a deep learning algorithm is adopted to analyze and process the data, and the current emotion state of the player is recognized; and S3, obtaining current game scene information and other operation instructions input by the player through the Qt framework. According to the Qt interactive game role action response control method and system fused with AI emotion recognition, through the AI emotion recognition technology, a game role can sense the emotion state of a player and make the emotion interaction action matched with the game role, the emotion resonance between the game role and the player is enhanced, and the interaction experience and immersion of a game are greatly improved.

The invention discloses a multi-dimensional personality evaluation method for dynamic emotion changes, and relates to the technical field of personality evaluation, the system is composed of a plurality of functional modules, and the method comprises the following steps: step 1, recording physiological data in real time through a wearable device, capturing micro-reactions by using a computer vision technology, and determining whether the micro-reactions exist or not; the micro-reactions comprise facial micro-expressions, limb actions and voice and intonation changes; based on a preset dynamic simulation social scene, observing an emotion regulation strategy of the subject in pressure; step 2, using an LSTM model to carry out time sequence modeling on the multi-modal acquisition data, capturing dynamic evolution of emotions, and combining an attention mechanism to dynamically adjust the weight of each modal; based on six basic emotions and nine mental disorder tendencies, establishing a classification model, and capturing association between emotions and personalities; reinforcement learning is introduced, and model parameters are dynamically optimized according to feedback of a subject; and predicting the emotion trend of the subject in a period of time in the future through an autoregressive integral moving average model.

The invention relates to the technical field of service robots, and discloses an elderly care service robot based on an emotion adjustment system, and the robot comprises a multi-mode emotion recognition module which is used for carrying out the comprehensive perception of the emotional state of the elderly through combining various emotion signals of voice, facial expression and limb movement; the personalized emotion adjusting module is used for generating personalized emotion responses meeting the requirements of the old people; the emotion memory module is used for recording emotion changes, important life events and personal preferences of the elderly; the scene self-adaption module is used for sensing the living environment of the old people in real time and adjusting the emotional expression mode of the robot according to the environment information; the health intervention module is used for generating a health management scheme through long-term monitoring of the emotional state and health of the old people; and a safety monitoring module. According to the invention, the emotion state of the elderly is analyzed through the multi-modal fusion network, the emotion misjudgment probability is reduced, and the man-machine interaction experience and the emotion support effect of the elderly are remarkably improved.

The invention relates to the technical field of medical diagnosis, and discloses a blood oxygen monitoring system fused with sleep rhythm modeling, which comprises the following steps: identifying a sleep stage conversion moment through a photoelectric volume pulse wave signal, detecting a blood oxygen saturation valley value in a window after conversion, and calculating response lag duration; according to the method, the physiological rhythm is converted into a natural probe for the compensatory ability of the respiratory system, dual diagnosis of sleep staging and respiratory function is realized through a single-path signal, and meanwhile, body movement interference is converted into an observation window for the respiratory stress recovery ability. The diagnosis reliability in a home monitoring scene is remarkably improved, the system completes core analysis at an edge node, and a respiratory function evaluation report which can be directly used for clinical decision making is output.

The invention relates to the technical field of medical instruments, and discloses an intelligent device for monitoring the cardio-pulmonary function of a heart failure patient, the intelligent device comprises a multi-mode sensor module, an AI analysis module, a biological feedback module and a wearable carrier, the multi-mode sensor module is used for collecting heart rate, respiratory rate, oxyhemoglobin saturation and body movement data in real time, and the AI analysis module is used for analyzing the heart rate, the respiratory rate, the oxyhemoglobin saturation and the body movement data; monitoring modes can be dynamically switched in rest, motion and sleep scenes; the AI analysis module is used for detecting abnormity based on real-time data and predicting a heart failure deterioration risk in combination with historical data; and the biological feedback module is used for providing personalized intervention in a vibration or audio mode according to the analysis result. The heart rate, the respiration rate, the blood oxygen saturation and the body movement data are collected at the same time through the multi-mode sensor module, sleep apnea or periodic respiration is recognized in combination with the AI analysis module, the defect of separation of cardiopulmonary function monitoring and sleep mode analysis in the prior art is overcome, and therefore early intervention and treatment adjustment are supported.

The invention discloses a text narrative-guided virtual reality motion sickness monitoring and relieving system, and relates to the technical field of virtual reality, the text narrative-guided virtual reality motion sickness monitoring and relieving system comprises an adaptability monitoring module, the adaptability monitoring module comprises a data acquisition unit, and the data acquisition unit is used for acquiring physiological information of a user in virtual reality training in real time; the data is transmitted to the adaptability evaluation unit; the dynamic adjustment module is used for receiving the sensing data acquired by the data acquisition unit and dynamically adjusting parameters of the virtual reality equipment according to the received data; by monitoring physiological information and perception data of a user in real time, signs of motion sickness can be rapidly recognized, the real-time monitoring is combined with dynamic adjustment of visual and vestibular stimulation in a VR environment, the risk of motion sickness caused by mismatching of sensory input and actual body movement can be effectively reduced, and the motion sickness can be rapidly recognized through the dynamic adjustment. The system can preventively adapt to individual differences of users and reduce motion sickness.

The invention relates to the technical field of respiratory training, in particular to a respiratory muscle training system based on thoracic induction, which comprises a thoracic dynamic monitoring module, a respiratory muscle state recognition module, a fatigue judgment and adjustment module, a training control module and a task construction module. According to the method, through combined extraction of capacitance sensing data of chest expansion change, a vertical displacement trend and chest pressure floating, the reduction precision of a real respiration traction process is effectively improved, a time axis is used as a unified reference, different types of sensing data are synchronously analyzed, the respiration traction judgment accuracy is remarkably improved, and the method is suitable for popularization and application. The probability of misjudgment caused by electromyography and body movement dislocation is eliminated, the capacity of capturing the participation state of respiratory muscles is enhanced, the variation trend between electromyography response and traction starting is tracked and captured through the time difference of continuous periods, the training execution accuracy is improved, the intervention targeting is recovered, and the training efficiency is improved. And leap-over improvement is realized in the aspects of multi-source information collaborative identification and training personalized adjustment.

A body-worn PAP system providing proper mask fitment during body movement, reduced leakage, and elimination of a need for a connecting hose to the blower unit, and a PAP blower adapted for use in a PAP system with a compact noise reduction system that does not utilize acoustic foams in the airflow path.

The invention discloses a virtual digital human interactive question and answer method, system and device and a storage medium, and relates to the field of virtual reality. The method comprises the following steps: carrying out first processing on dialogue content of a user, and carrying out second processing on a facial image of the user to obtain a first emotional state; performing third processing on the text after the first processing to obtain a second emotional state of the user, and determining a target emotional state in combination with the first emotional state and the second emotional state; performing fourth processing on the text after the first processing based on a deep learning model to generate a first answer, and adjusting an expression mode of the first answer according to the target emotional state and the dialogue context to generate a second answer; and constructing a virtual digital person by using a virtual reality technology, and determining the facial expression, the body movement and the voice intonation of the virtual digital person according to the emotional tendency in the second answer to display the second answer. By implementing the technical scheme provided by the invention, the emotional state of the user can be identified more accurately, and then the answer more conforming to the emotion of the user is generated.

The invention discloses an oxygenerator remote control system and method based on the Internet of Things, and belongs to the technical field of intelligent medical equipment and remote health management, and the method comprises the steps: S1, collecting multi-dimensional physiological data of a user in real time through a multi-source physiological signal collection module, a heart rate variability index and a body movement signal; s2, based on the multi-dimensional physiological data, processing is performed through a preset physiological state prediction model, and a unified physiological stress index is solved; s3, determining a predictive oxygen supply flow rate value in combination with the physiological stress index and a preset user basic oxygen supply flow rate; s4, according to the predictive oxygen supply flow velocity value, a control signal for a physical execution component of the oxygen generator is generated so as to dynamically adjust oxygen supply parameters, and conversion from passive compensation to active prediction is achieved.

The invention discloses a digital human personalized shaping method and device based on user psychology and a medium. The method comprises the following steps: acquiring multi-modal data when a user interacts with a digital human; based on the multi-modal data, according to the style preference of the user, establishing a psychological feature model through an adaptive learning mode; dialogue voice of the digital person is generated according to the psychological feature model, and matched facial expressions and limb actions of the digital person are generated according to the dialogue voice and the psychological features of the user. According to the digital human personalized shaping method and device based on the psychology of the user and the medium, the psychological feature model is established based on the style preference of the user, and the interaction content matched with the conversation voice, the facial expression and the body movement is generated, so that the digital human can show more real and natural personalized behaviors, and the user experience is improved. The problem that it is difficult to carry out personalized behavior shaping on the digital human according to psychological characteristics and interaction preferences of the user can be solved.

The invention relates to the technical field of intelligent wearable devices, and discloses a multi-modal sensing and motion state recognition method and device for an intelligent wearable device, and the method comprises the steps: carrying out the anatomical coordinate transformation of original motion data collected by a wrist wearable device, and obtaining an acceleration sequence and an angular velocity sequence; performing sliding window segmentation and multi-scale wavelet packet decomposition to obtain a potential conversion period window set and corresponding multi-scale time-frequency features; constructing a conversion period feature vector for describing a conversion relation between the wrist movement and the whole body movement; inputting the conversion period feature vector into a hierarchical conversion identification model for processing to obtain a conversion type label and a conversion confidence coefficient; body part association mapping and lower limb action state inference are executed, a lower limb state sequence and a whole body action conversion type in the conversion process are obtained, real-time efficient recognition of action conversion is achieved, limitation of a single model is avoided, and the high recognition rate under low calculation complexity is kept.