13544 results about "Human body" patented technology

The invention provides a human body posture detection method and equipment based on machine vision, which are applied to posture recognition in physical fitness detection, and are used for generating a dynamic human body region set of a target user by acquiring a multi-frame continuous image sequence of a physical fitness training scene and performing human body region positioning processing on the multi-frame continuous image sequence. Performing posture feature extraction processing on the dynamic human body region set to obtain a space-time posture feature set of the target user, performing posture state recognition processing on the space-time posture feature set based on a preset physical fitness evaluation model to generate a posture state recognition result of the target user, and generating physical fitness evaluation parameters according to the posture state recognition result, and the physical fitness evaluation parameters are fed back to the physical fitness training guidance system. According to the method, the identification capability of fine posture change in the fitness action of the complex body can be improved, the synchronous evaluation of the action specification degree and the physiological load state is realized, and the limitation of the traditional single-dimensional action evaluation is broken through.

The invention relates to a human shape posture recognition method and system based on image analysis, and the method comprises the steps: inputting the reference human shape data of a monitored object, and collecting the multi-modal data of an RGB image, an infrared image and inertial measurement data in a target scene in real time; space-time alignment processing is carried out, and corresponding features are fused; image space features are extracted, time sequence modeling is carried out on inertial data, and dynamic weighted fusion of two paths of network outputs is realized through a gating mechanism; human body basic joint points are positioned, and refined posture vectors including joint angles and limb relative positions are generated; according to attitude data and environment information collected in real time, adaptively adjusting an attitude classification threshold value and a similarity measurement standard, and predicting abnormal behaviors in a future time period; and when the abnormal behavior is predicted, triggering to execute a preset safety measure. Multi-modal data can be efficiently fused, attitude features can be accurately extracted, an identification strategy can be adaptively adjusted, and human shape attitude identification with behavior trend prediction capability can be realized.

The invention relates to the field of medical robots, and discloses a meridian point foundation construction method for precise positioning of an acupuncture robot, which comprises the following steps: scanning skin texture, muscle contour and skeleton mark features of a human body surface, and establishing a human body surface feature digital model; the method comprises the following steps: acquiring temperature distribution data of a human body surface, human body surface feature digital model data and elastic modulus data, performing weight mapping feature level fusion to generate an enhanced acupuncture point feature map, and establishing an acupuncture point-meridian association relationship matrix based on the enhanced acupuncture point feature map; compared with the prior art, the method has the advantages that three-dimensional body surface scanning, infrared thermal imaging and elastic modulus data are integrated through the multi-modal data fusion technology to generate the enhanced acupoint feature map, the dynamic meridian-acupoint twinborn model is constructed in combination with double-ellipse section fitting and implicit curved surface reconstruction, and tissue deformation is simulated in real time.

The invention provides a 3D posture estimation method and system based on space-time double-flow intersection in the technical field of monocular video 3D human body posture estimation, and the method comprises the steps: S1, obtaining a large number of historical human body videos, carrying out the frame-by-frame processing of each historical human body video through a 2D human body posture estimation model, obtaining a 2D coordinate position, and carrying out the frame-by-frame processing of each historical human body video; constructing a joint space-time sequence data set; s2, creating a 3D human body posture estimation model based on a joint semantic coding module, a dynamic graph convolution module, a space-time double-flow cross fusion module and a 3D posture decoding module; s3, training the 3D human body posture estimation model through the joint space-time sequence data set and the loss function; and S4, acquiring a real-time human body video, and reasoning the real-time human body video through the 2D human body posture estimation model and the 3D human body posture estimation model to obtain a 3D human body posture estimation result. The method has the advantages that the precision and robustness of 3D human body posture estimation are greatly improved.

The invention discloses a chronic disease patient personalized diet and exercise guidance system and method, and relates to the technical field of medical health information, and the system comprises a data sensing module which continuously collects the dynamic physiological data, behavior data and environment variable data of a patient through an intelligent sensing device, the dynamic physiological data comprises a heart rate time sequence, a step number time sequence and a blood glucose concentration time sequence monitored by the wearable device, and the behavior data comprises a medication operation record with a timestamp and a patient's daily symptom self-grading number. According to the personalized diet and exercise guidance system and method for the chronic disease patient, the time synchronization precision of multi-source data is effectively improved, the accuracy of medication compliance monitoring and physiological index correlation analysis is ensured, and by establishing the dynamic correlation model of the environment temperature and the human body metabolic rate, the accuracy of medication compliance monitoring and physiological index correlation analysis is improved. The timeliness and safety of clinical intervention are improved, and powerful support is provided for health management of chronic disease patients.

The invention discloses a public transport passenger flow monitoring method and system based on human body detection, and the method comprises the steps: synchronously collecting skeleton key points, heat distribution and contour features of passengers through a vehicle-mounted multi-view camera and an infrared sensor, and generating a passenger space-time feature matrix; outputting a passenger movement track set based on the passenger space-time characteristic matrix; generating a dynamic congestion degree index according to the staying duration and the spatial distribution density of the passengers in the passenger movement track set; calculating an abnormal behavior probability based on the dynamic congestion degree index, and outputting an abnormal event early warning signal; and fusing the dynamic congestion degree index, the abnormal event early warning signal and the real-time passenger flow data, and generating a bus passenger flow monitoring result through space-time correlation analysis. According to the embodiment of the invention, high-precision, low-delay and intelligent passenger flow state monitoring and abnormity early warning can be realized.

The invention relates to the technical field of human body health assessment, in particular to a health assessment method and system based on a 3D human body posture image model. The method comprises the following steps: acquiring human body annular scanning data; extracting a dynamic posture sequence of a vertical position, a forward bending position and a lateral bending position of the human body annular scanning data, and performing phase shift fringe projection on the human body annular scanning data according to the dynamic posture sequence to obtain human body three-dimensional point cloud data; a sagittal plane, a coronal plane and a cross section of the human body three-dimensional point cloud data are analyzed for orthogonal projection, and a human body multi-angle projection image group is generated; and identifying skeleton contour features of the human body multi-angle projection image group so as to establish a dynamic marking system of the anatomical mark points. Through high-precision dynamic acquisition and multi-dimensional space analysis, precision, standardization and individuation of 3D human body posture health assessment are realized, and the accuracy and comprehensiveness of human body posture health assessment are improved.

The invention discloses a three-dimensional attitude high-precision acquisition and reconstruction system for exercise training, which relates to the technical field of three-dimensional attitude acquisition and reconstruction and comprises a camera calibration module, an image acquisition module, a key point extraction module, a three-dimensional reconstruction module, an attitude optimization module, a data fusion module and a feedback generation module. The camera calibration module is used for performing internal and external parameter calibration on a multi-view camera assembly by adopting a self-adaptive joint calibration method to obtain a projection matrix parameter and a transformation matrix of each camera; the image acquisition module is used for synchronously acquiring multi-view video images of the athlete in the training process based on the calibration parameters, and performing timestamp alignment processing to obtain an original image sequence; and the key point extraction module is used for detecting and identifying a human body image by adopting a deep learning model, extracting two-dimensional coordinates of key human body joint points of each frame from an original image sequence, and obtaining a two-dimensional key point set under each view angle.

The invention discloses a human body posture key point recognition method based on feature enhancement high resolution, and the method comprises the steps: firstly introducing a Res2Net module into a backbone network, constructing a layered similar residual connection structure, achieving the fine-grained multi-scale feature representation, effectively expanding the network receptive field range, and improving the recognition precision of a human body posture key point. According to the structure, multi-scale feature extraction and fusion are achieved in a single residual block, the adaptability of a model to different scale targets is enhanced, meanwhile, the calculation complexity is reduced, then a multi-scale convolution attention MSCA module is embedded, space context information of different scales is captured through multi-branch depth separable convolution, and the multi-scale feature fusion is achieved. According to the method, the key features are adaptively enhanced in combination with a channel attention mechanism, the positioning capability of the key points of the human body is remarkably improved, and finally, richer and more accurate key point information of the human body posture is acquired by fusing multi-scale and deep feature representation, so that accurate recognition of the human body posture is realized.

The invention discloses a three-dimensional attitude estimation method combining global modeling and local refinement, which comprises the following steps of: firstly, extracting a two-dimensional attitude sequence by using a human body video data set; secondly, inputting the two-dimensional attitude sequence into a structural modeling main branch, modeling a spatial topological relation and a time sequence dynamic state between joints, and outputting a global three-dimensional attitude sequence; and inputting the two-dimensional attitude sequence into a local refining branch, modeling dynamic change and detail information of a local area, and outputting a local three-dimensional attitude sequence. And finally, fusing the global three-dimensional attitude sequence and the local three-dimensional attitude sequence, generating a three-dimensional attitude sequence output, and completing three-dimensional attitude estimation. According to the method, the problem of insufficient cross-frame information transmission in a traditional method is relieved, and the accuracy and robustness of attitude estimation in a dynamic complex scene are remarkably improved.

The invention discloses a lower limb exoskeleton gait track prediction method based on an LSTM-KAN fusion model, and the method comprises the steps: collecting human motion data through a sensor assembly, and carrying out the filtering, missing value processing and normalization of the human motion data; then constructing an overall architecture of a prediction model based on an LSTM-KAN network, optimizing parameters of the prediction model by using a particle swarm optimization (PSO) algorithm, extracting key features in the preprocessed data as a training data set, and inputting the training data set into the prediction model for training; and finally, collecting current human body motion data, pre-processing the current human body motion data, inputting the pre-processed current human body motion data into the trained prediction model, and outputting future human body gaits and tracks by the prediction model. And the controller takes a future gait track generated by the prediction model as a reference track to generate a driving signal and sends the driving signal to the actuator so as to realize accurate control of the actuator. By adopting the gyroscope sensor, the acceleration sensor and the pressure sensor for gait estimation, exoskeleton motion control can be effectively improved, and man-machine interaction experience is effectively improved.

The invention provides a human body skeleton point positioning identification method and system based on OpenPose, and the method comprises the steps: carrying out the preprocessing of an input human body image, and obtaining the preprocessing image data; performing skeleton point detection on the preprocessed image data by adopting a double-domain multi-path self-supervised diffusion model in combination with a convolutional neural network to obtain two-dimensional human skeleton point coordinate data; performing signal-to-noise ratio evaluation and noise reduction processing on the two-dimensional skeleton point coordinate data to obtain two-dimensional skeleton point data after noise reduction; performing two-dimensional to three-dimensional conversion through a triangulation principle and a feature matching technology to obtain preliminary three-dimensional skeleton point coordinate data; performing skeleton point optimization through rate perception analysis and a three-dimensional Gaussian compression algorithm; and carrying out shielding prediction and completion processing on the optimized three-dimensional skeleton points to obtain a complete human skeleton point positioning identification result. According to the invention, the problems of accuracy and stability of skeleton point positioning in a complex dynamic scene are solved.

The invention discloses an exercise rehabilitation assessment method and system based on limb posture and emotion recognition, and the method comprises the steps: collecting a motion video, recording the age and gender information of a patient, constructing a self-made data set, defining a candidate region containing the rehabilitation motion of the patient, constructing a basic motion posture data set, and carrying out the recognition of the rehabilitation motion of the patient based on a posture estimation algorithm. Personalized limb skeleton key points are extracted, and emotion features are obtained through face key point detection and face action unit analysis; analyzing the motion trail of the knee joint based on the personalized limb skeleton key points, and extracting limb posture information; and carrying out feature fusion on the limb posture information and the emotional features to form a quantitative rehabilitation evaluation result. According to the invention, high-precision capture of the key points of the human skeleton is realized through computer vision and pattern recognition technologies. In addition, in combination with analysis of the emotional state of the patient, the evaluation accuracy is enhanced, and the rehabilitation training effect evaluation is more comprehensive and accurate.

The invention discloses a virtual fitting method and device, a storage medium and electronic equipment, and is applied to the technical field of computer image processing, and the method comprises the steps: processing a target video, and obtaining the human body posture data of each video frame in the target video; constructing a 3D human body model of each video frame by using the human body posture data of each video frame; for the 3D human body model of each video frame, acquiring clothing rendering information of the 3D human body model, and rendering virtual clothing on the 3D human body model based on a dynamic fitting algorithm and the clothing rendering information to obtain a virtual rendering video frame of the video frame; and generating an AR fitting video based on each virtual rendering video frame, and displaying the AR fitting video to the user. Therefore, the selected costume can be tried on in the AR form, the fitting effect of the costume can be displayed for the user, the problem that the size is improper due to the fact that the costume purchased online cannot be tried on is solved, the probability of refunding and changing goods is reduced, and good shopping experience is provided for the user.

The invention discloses a physical fitness evaluation method based on human skeleton trajectory tracking, which comprises the following steps: S1, acquiring whole-process video data of a physical fitness test through video acquisition equipment, and generating a video frame according to an acquisition frequency; s2, processing the video frame by using a skeleton dynamic analysis algorithm, and extracting human skeleton key points; s3, extracting identity features of the testee through a motion map identity recognition network, and tracking and confirming the identity features; s4, performing action recognition, fragment segmentation and compliance judgment on the skeleton key point time sequence track; s5, aiming at the abnormal skeleton key points, performing complementation and time sequence smoothing by adopting an inverse kinematics inference method; s6, inputting the complete skeleton key point time sequence data into the human body action evaluation model for processing, and quantizing and outputting a physical ability evaluation index; and S7, generating a physical ability evaluation report and giving action feedback and optimization suggestions. According to the invention, objectivity, accuracy and intelligent level of physical ability evaluation are effectively improved.

The invention relates to the technical field of action recognition, in particular to a somatosensory action interaction recognition method and system based on skeleton coordinate points. The method comprises the following steps of collecting real-time skeleton coordinate data of a human body and performing multi-modal feature extraction to obtain a real-time skeleton coordinate sequence; obtaining a standard skeleton posture corresponding to the target interaction action, performing pre-recording and feature coding, and generating a target posture skeleton feature template library; performing skeleton time sequence filtering and joint mapping and joint included angle calculation on the real-time skeleton coordinate sequence, performing similarity measurement and dynamic binding tracking at the same time, and starting a binding recovery mechanism when binding loss is detected so as to guide the user to execute a preset binding posture and re-establish a binding relationship; and mapping the joint included angle time sequence data to a corresponding joint of the virtual human shape interaction model in real time, outputting a somatosensory interaction instruction, and driving to repeat a human body action so as to trigger a somatosensory action interaction event. According to the invention, the stability of somatosensory action interaction recognition can be improved.

The invention discloses a posture feature recognition method based on a video stream, and the method comprises the steps: carrying out the preprocessing of a continuous video stream, obtaining video frame training data, extracting a key frame and an adjacent frame in each frame of image, constructing a feature extraction module for a human body region, and obtaining a global frame, performing local extraction on the human body area by using adjacent frames on the left side and the right side to obtain local frames, and constructing semantic association information for the global frame through time sequence continuity between the local adjacent frames and the current key frame; acquiring enhanced feature representation by adopting a conditional feature aggregation algorithm; obtaining attitude sequence data through the attitude detail features; the method comprises the following steps: establishing three-dimensional coordinates, adaptively extracting posture change data by adopting a human body motion decoupling model, predicting human body posture characteristics through a smooth optimization strategy, and introducing a cross attention mechanism to realize deep fusion of spatio-temporal characteristics, so that the understanding ability of the model to a complex action mode is enhanced; and the attitude expression capability of the model in a sheltered or fuzzy region is obviously improved.

The invention discloses a tumble behavior judgment and early warning method and system based on multi-modal data, and belongs to the technical field of intelligent monitoring and health safety, and the method comprises the steps: processing a video stream obtained by a camera through a Jeson Nano processor, and obtaining a human body posture detection result; the millimeter-wave radar obtains human body motion state information, judges a motion state according to the sudden change value and obtains a human body motion state detection result; the blood oxygen bracelet collects human body physiological data and recognizes sudden physiological abnormalities to obtain physiological abnormality data; according to the posture detection result, the motion state detection result and the physiological anomaly data, sending different levels of signal states to a cloud platform; and the cloud platform receives and fuses the signal states, and based on the fused multi-dimensional information, adopts falling behavior grading early warning and triggers a grading alarm mechanism. The problems of low data utilization rate and single response means are solved, and the accuracy and adaptability of fall monitoring are improved.

The invention relates to the technical field of computer vision, and discloses a high-speed human motion trail motion mode recognition system. Through multi-modal sensor fusion and an adaptive space-time attention network (ASTAN), the problems that a traditional optical system depends on mark points and IMU accumulative errors exist are effectively solved, and the high-speed movement track reconstruction precision and the environmental adaptability are remarkably improved; self-supervised data enhancement and dynamic model compression technologies are combined, so that the dependence on labeled data is greatly reduced, lightweight edge deployment is realized, and the real-time requirement is met; the system can synchronously output multi-mode feedback instructions, supports multi-scene application such as sports action correction, medical rehabilitation evaluation, security and protection anomaly detection and man-machine interaction control, and solves the core pain points of insufficient precision, real-time performance, robustness and generalization ability in the prior art. And an efficient, reliable and low-cost comprehensive solution is provided for high-speed motion analysis.

The invention discloses an occlusion state 3D human body posture estimation method based on multistage optimization. According to the method, a plurality of synchronously calibrated cameras are used for acquiring RGB images, and a plurality of data enhancement strategies including random rotation, horizontal overturning, geometric shielding, object shielding and the like are introduced, so that the robustness of a 2D joint point detection network under complex visual angle and shielding conditions is improved. And then an initial three-dimensional human body posture is preliminarily estimated by using a voxel space back projection method through the detected multi-view 2D heat map. For the occlusion problem, a visibility evaluation model fusing autologous occlusion and visual angle occlusion is constructed, and robust and stable human body three-dimensional attitude estimation can still be realized under the severe occlusion condition by introducing multiple constraints such as visual consistency, time sequence continuity, attitude priori and skeleton consistency to optimize and predict a 3D attitude in a multi-stage manner. According to the method, high-precision and shielding-robust 3D joint point detection can be realized only by inputting a multi-view-angle RGB image during operation, and the method is suitable for a real scene with a complex shielding condition.

The invention relates to the technical field of non-electrical variable control or regulation systems, and discloses a temperature rising blanket temperature closed-loop control method and system based on human body position recognition feedback, and the method comprises the steps: calculating a form compactness coefficient representing a heat dissipation boundary based on pressure data, and calling a mapping function to convert the form compactness coefficient into an equivalent thermal impedance estimated value; introducing the estimated value and dynamically constraining the forward channel gain of the temperature closed-loop controller according to a negative correlation strategy; according to the method, a real-time mapping mechanism of the contact topological characteristics and the control gain is constructed, so that the problem of model mismatch caused by body position change of the controlled object is solved; when the high-impedance contact state is detected, energy input is automatically reduced, the local heat accumulation effect is restrained, and the convergence and safety of the thermodynamic control process under the variable boundary condition are ensured.

The invention belongs to the technical field of electrical safety, and particularly relates to a human body electric shock protection method and system based on multi-parameter fusion, multi-dimensional characteristic parameters are formed by extracting a high-frequency harmonic component, a voltage abrupt change slope and a magnetic field intensity fluctuation value of a residual current waveform, and the weight is dynamically adjusted according to the instantaneous change rate of each characteristic, so that the human body electric shock protection is realized. Generating a weighted feature vector; and a comprehensive criterion value is calculated in combination with a preset rule base and is compared with a dynamic threshold value, so that whether the circuit breaker is triggered to act or not is determined. According to the method, through fusion analysis of a plurality of physical characteristics, the identification capability of the system in a complex electromagnetic environment is improved, the probability of misoperation caused by external interference is effectively reduced, the action accuracy and stability of the circuit breaker are improved, and the power utilization safety and the power supply continuity are guaranteed.

The invention discloses an in-vitro bionic mechanical testing system and method for spinal skeletal muscles, and particularly relates to the field of mechanical testing, and the system comprises a bionic construction module, a finite element modeling module, a multi-axis mechanical loading module, an iterative calculation module and a correction module; through modular design, the system comprises a vertebral body unit, an intervertebral disc simulation assembly and a skeletal muscle simulation unit, each assembly is customized according to anatomical features of a human body, a finite element modeling module is utilized to generate a three-dimensional model, a multi-directional mechanical load is applied, and response data is collected; experimental data are input into the finite element model for iterative calculation, so that stress distribution, a strain field and kinematic deviation are compared; if the error exceeds a preset threshold value, the model parameters and the physical parameters are corrected until the experiment and simulation results converge; and finally, based on the optimized finite element model, predicting a failure mechanism of the spinal skeletal muscle under a complex load, and evaluating the risks of fracture, hairline fracture, nucleus pulposus protrusion and muscle strain.

The invention discloses a human motion posture recognition method and system based on multi-modal data fusion, and relates to the technical field of posture recognition, and the method comprises the steps: firstly, synchronously obtaining a human motion posture video frame and an IMU segment, then carrying out the feature extraction of the two kinds of heterogeneous data in a shunt parallel mode, and carrying out the feature extraction of the two kinds of heterogeneous data; and respectively capturing visual space attitude information and dynamic inertial characteristics of the IMU. Afterwards, specific features of the modals are uniformly expressed through a mixed Token and embedding mechanism, and a space-inertia collaborative attention fusion mechanism is further introduced to realize dynamic association and deep fusion of cross-modal information; and finally, classifying the multi-modal fusion representation vector obtained by fusion so as to realize accurate recognition of the human motion posture. In this way, the defect that traditional fusion is insufficient in capturing subtle action differences can be overcome, and the accuracy and stability of action recognition in a complex scene are improved.

The invention provides a massage robot multi-mode fusion treatment system and method based on 3D vision, and relates to the technical field of massage robots. The region recognition module is used for establishing a human body recognition model and recognizing human body features in the processed image; the massage terminal is used for carrying out massage operation according to parts needing to be massaged and human body characteristics and monitoring skin pressure of the massaged parts in real time; the pain sense recognition module is used for human body pain sense recognition; the force adjusting module is used for adjusting skin pressure. According to the method, pertinence and safety of massage operation are remarkably improved through multi-modal image preprocessing and an initialized human body recognition model of a fusion segmentation model and a key point detection model; a global path strategy is generated and optimized through a hybrid ant colony algorithm, efficient and accurate motion control of the mechanical arm is achieved, through multi-modal data fusion analysis, the pain feeling of a user is sensed in real time, the massage strength is dynamically adjusted, and the comfort and the safety coefficient are improved.

The invention relates to the technical field of artificial intelligence application, and discloses a standard dressing intelligent identification method based on target detection and human body key points, and the method comprises the steps: carrying out the frame skipping human body detection of a monitoring video stream, extracting the human body key points, and carrying out the screening according to a preset confidence coefficient threshold value, determining a head area, an upper body area and a lower body area based on the screened high-confidence-coefficient key points; when the head area and the upper body area exist at the same time, if the safety helmet and the work clothes are detected at the same time, and when and only when all the following conditions are met at the same time, it is judged that the user is normatively worn: the ratio of the width of the minimum head external rectangle to the width of a safety helmet recognition frame is within a first preset threshold range, and the distance between the center points of the minimum head external rectangle and the width of the safety helmet recognition frame is smaller than a second preset value; the ratio of the height of the minimum upper body external rectangle to the height of the work clothes identification frame is within a third preset threshold range, and the intersection-parallel ratio of the two is larger than a fourth preset value. According to the invention, the condition that the person is partially shielded can be more effectively handled, and each main part of the human body can be accurately positioned.

The invention relates to a human motion data processing method, and belongs to the technical field of data processing. Comprising the following steps: controlling a microwave radar to emit a detection signal, and detecting a heart rate signal and a respiration signal of a human body; performing clustering analysis on the data according to the collected heart rate and respiratory rate, and extracting heart rate, respiratory rate change, duration and exercise intensity characteristics; according to the extracted heart rate change, duration, exercise intensity and other characteristics, the exercise stage is recognized, and according to the neural network model library, an energy consumption result is output in combination with data analysis. According to the human motion data processing method provided by the invention, the microwave radar is combined with the intelligent wearable device, so that the detection precision of heart rate and respiration signals is remarkably improved, multi-modal data fusion is realized, personalized heart rate prediction is performed, motion stage division is optimized in combination with acceleration data, and the accuracy of motion data processing is improved. The accuracy of motion mode recognition is improved, and personalized motion suggestions can be provided for the user.

The invention belongs to the technical field of three-dimensional reconstruction, and discloses a three-dimensional digital human generation method and system capable of voice interaction. According to the invention, brand new speaking audios in different languages are automatically generated according to different languages of the input target text and the sampled human voice audios; the sequential stability and detail reduction capability of three-dimensional human motion are guaranteed by using multi-model joint estimation and a sequential loss function, and facial expression details and hand postures in the image can be accurately estimated. After the high-precision three-dimensional human body model is obtained through estimation, human body action and expression generation is carried out based on voice driving, accurate synchronization of actions and expressions generated through voice is achieved, and facial expression movement and body posture movement, namely a whole-body three-dimensional human body model, conforming to brand-new speaking audio are accurately generated; and finally, rendering the whole-body three-dimensional human body model into a real digital human capable of voice interaction by using a three-dimensional neural rendering model. According to the invention, the realization of single person picture input, high-precision three-dimensional digital person generation and voice interaction is facilitated.

The invention discloses a single-person abnormal behavior identification method and system based on multi-modal skeleton feature fusion, and the method comprises the steps: S1, collecting continuous RGB images and infrared thermal imaging images in a monitoring video, carrying out the human body detection and key point estimation of visible light and infrared images through employing a multi-modal fusion model of YOLOv12 in combination with Transform, and constructing a single-person posture time series data set; s2, key point speed vectors are calculated for the continuous skeleton frame sequence of each target person, skeleton key point information and speed information are fused, and an action feature sequence is formed; s3, inputting the motion feature sequence into an MPED-RNN model, decomposing skeleton motion into a global displacement component and a local attitude deformation component, and performing joint coding, decoding and prediction through a dual-channel GRU network; and S4, calculating a prediction error and a reconstruction error according to a reconstruction result and a future skeleton key point prediction result, evaluating whether the current behavior deviates from a normal trajectory, and judging whether the current behavior is in an abnormal state. According to the invention, real-time identification of abnormal behaviors of a single person in a complex scene is realized.

The invention relates to the technical field of intelligent sensing and data fusion, in particular to a real-time motion guidance and error correction method and system based on multi-source data analysis, and the method comprises the following steps: S1, synchronously collecting the motion data of a user through a hardware-synchronized multi-source sensing network, completing the timestamp alignment and standardization processing of the multi-source data, and obtaining the motion data of the user; outputting standardized motion data with a unified time sequence; and S2, performing multi-sensor data fusion processing on the standardized motion data, and reconstructing three-dimensional human body joint posture data based on a state estimation algorithm. Through a time sequence mode recognition algorithm, in combination with various motion data such as joint Euler angles and angular velocities, accurate recognition is performed on different motion stages, through recognized stage labels, a user personalized model is called to dynamically generate an evaluation threshold value of the current stage, then motion deviation diagnosis is performed, and the accuracy of motion deviation diagnosis is improved. The problem caused by the fact that the motion stages cannot be distinguished due to the fact that a fixed threshold value is used is effectively solved, and adaptability and accuracy of posture deviation diagnosis are remarkably improved.