1506 results about "Action recognition" patented technology

An action localization method, device, electronic equipment, and computer-readable storage medium are provided. The action localization method includes: identifying at least one target video segment containing a target object in a video; acquiring a first action recognition result of at least one image frame in the at least one target video segment and a second action recognition result of the target video segment; and acquiring an action localization result of the video based on the first action recognition result and the second action recognition result.

The invention relates to the technical field of artificial intelligence, in particular to a family service method and system based on artificial intelligence, and the method comprises the following steps: obtaining a statement analysis action sequence and a task direction, collecting the feedback of a device to generate a state structure, judging an instruction trend, recombining a statement to generate a behavior chain, and disassembling an action recognition conflict to extract a main control path. Analyzing a behavior time sequence generation prominent trend, and adjusting a display sequence to generate a function scheme. According to the method, through semantic component extraction and equipment state mapping, the accuracy of instruction target recognition is improved, word order rearrangement and logic connection enhance the continuity of a behavior chain, a control path is optimized and sorted according to verb density and object association, the task scheduling precision is improved, and behavior time sequence analysis recognizes a high-frequency operation forward trend; according to the method, priority dynamic adjustment and rearrangement of recommended content in combination with instruction frequency and time sequence characteristics are realized, the response initiative and the service matching degree are enhanced, and collaborative optimization of semantic understanding, behavior prediction and content recommendation is integrally realized.

The invention discloses a video analysis-based multi-scene operator violation behavior identification method and system, and belongs to the technical field of intelligent operation safety monitoring and artificial intelligence identification, and the method comprises the steps: collecting a real-time video stream of a multi-scene operation site; recognizing a continuous action time sequence in the real-time video stream by using an action recognition depth model; constructing the continuous action time sequence into an action behavior sequence; the action behavior sequence is constructed into a directed behavior graph with time, space and action labels, the directed behavior graph is compared with a directed behavior graph corresponding to the standard action behavior sequence, and illegal behaviors are recognized; and carrying out multi-mode early warning on the identified illegal behaviors. According to the method, the bottleneck that the traditional image recognition technology is weak in action sequence semantic understanding and poor in environmental adaptability is broken through, and accurate recognition and real-time early warning of illegal behaviors in multi-scene operation are achieved.

The invention relates to the technical field of physical education, and discloses an artificial intelligence-based physical education evaluation system, which comprises a data acquisition module, a multi-target detection module, a key point modeling module, an action trajectory analysis module, a multi-modal fusion module and a dynamic feedback module. The data acquisition module receives a video stream of the camera device and motion physiological data of the wearable sensor; the multi-target detection module locates a target based on a YOLOv8 algorithm; the key point modeling module constructs a three-dimensional action attitude model by using an OpenPose algorithm; the action trajectory analysis module evaluates action standard; the multi-modal fusion module integrates the data to construct a multi-dimensional feature matrix; the dynamic feedback module generates a real-time score and a personalized correction instruction through the optimized LSTM network. In addition, the system further comprises a model self-adaption module, an abnormal action recognition module and a distributed calculation module. According to the system, precise evaluation of physical education is realized, the sports safety is guaranteed, personalized teaching is promoted, and the physical education quality is effectively improved.

The invention discloses a remote monitoring and guiding system for rehabilitation training in the orthopedics department, particularly relates to the technical field of medical rehabilitation intelligent monitoring, and is used for solving the problems that in an existing remote rehabilitation system, timing sequence dislocation exists in action recognition and regulation and control instruction execution, and joint movement safety early warning is delayed. According to the method, localized time sequence alignment processing is performed on joint movement data and electromyographic signals based on edge computing nodes, a joint linkage action time sequence difference is generated, and an abnormal action risk level is judged in real time by combining an electromyographic signal pre-activation feature and a conflict detection mechanism of a standard action intention; historical abnormal records are matched through the cloud platform to generate a hierarchical regulation and control instruction set, and progressive safety intervention is triggered by the patient end equipment according to the dynamic deviation of the joint activity; through a collaborative mechanism of edge side action stage accurate analysis, electromyographic signal feed-forward verification and multi-stage instruction dynamic binding, millisecond-level response of joint linkage abnormity in staged rehabilitation training is realized, and the risk of joint over-limit activity is effectively avoided.

The invention discloses a physical fitness evaluation method based on human skeleton trajectory tracking, which comprises the following steps: S1, acquiring whole-process video data of a physical fitness test through video acquisition equipment, and generating a video frame according to an acquisition frequency; s2, processing the video frame by using a skeleton dynamic analysis algorithm, and extracting human skeleton key points; s3, extracting identity features of the testee through a motion map identity recognition network, and tracking and confirming the identity features; s4, performing action recognition, fragment segmentation and compliance judgment on the skeleton key point time sequence track; s5, aiming at the abnormal skeleton key points, performing complementation and time sequence smoothing by adopting an inverse kinematics inference method; s6, inputting the complete skeleton key point time sequence data into the human body action evaluation model for processing, and quantizing and outputting a physical ability evaluation index; and S7, generating a physical ability evaluation report and giving action feedback and optimization suggestions. According to the invention, objectivity, accuracy and intelligent level of physical ability evaluation are effectively improved.

The invention relates to the technical field of action recognition, in particular to a somatosensory action interaction recognition method and system based on skeleton coordinate points. The method comprises the following steps of collecting real-time skeleton coordinate data of a human body and performing multi-modal feature extraction to obtain a real-time skeleton coordinate sequence; obtaining a standard skeleton posture corresponding to the target interaction action, performing pre-recording and feature coding, and generating a target posture skeleton feature template library; performing skeleton time sequence filtering and joint mapping and joint included angle calculation on the real-time skeleton coordinate sequence, performing similarity measurement and dynamic binding tracking at the same time, and starting a binding recovery mechanism when binding loss is detected so as to guide the user to execute a preset binding posture and re-establish a binding relationship; and mapping the joint included angle time sequence data to a corresponding joint of the virtual human shape interaction model in real time, outputting a somatosensory interaction instruction, and driving to repeat a human body action so as to trigger a somatosensory action interaction event. According to the invention, the stability of somatosensory action interaction recognition can be improved.

The invention discloses a micro posture recognition method based on multi-modal feature fusion and fine adjustment, and relates to the field of computer vision and action recognition. The method is characterized in that a universal cross-modal knowledge fusion framework is provided, and multi-modal features are respectively extracted through a fine tuning network by using three kinds of modal information of video, skeleton and text. Meanwhile, a video-skeleton and text-skeleton fusion module is introduced to enhance the interactivity between modals. Compared learning is adopted to align feature distribution, and model training is optimized in combination with a freezing-fine tuning strategy, so that the calculation complexity is reduced, and the recognition efficiency is improved. According to the method provided by the invention, the problem of single-mode information loss can be solved, the perception capability of tiny attitude change is enhanced, the recognition precision and robustness are improved, and the method is suitable for multiple application scenes such as behavior monitoring, human-computer interaction and safety protection.

The invention belongs to the technical field of vehicle control, and particularly relates to a vehicle-mounted image recognition and target detection system based on deep learning, and the system comprises a distributed monitoring module which collects the operation, obstacle and traffic signal information of a target vehicle through multi-modal classification and scene matching, completes the marking of a shielding region and the matching of information through the combination of shared data, and achieves the recognition of the target vehicle. Forming an enhanced monitoring set; the label planning module constructs an enhanced topological space based on the enhanced monitoring set, and adjusts moving tracks in different scenes by combining with vehicle and pedestrian track probability distribution fed back by dynamic intention recognition; the action recognition module predicts trajectory parameters and collision probabilities of non-target vehicles and pedestrians by using Bayesian and multi-modal algorithms; the decision-making module generates a real-time control instruction through particle swarm optimization and fuzzy control, and optimal control parameters are fed back through simulation; according to the invention, intelligent track planning and real-time control in a complex scene are realized, and the detection precision and control robustness of the shielded and label-free area are improved.

The invention discloses a multi-source federal cross-domain and source-domain enhanced millimeter wave action recognition method and system, and the method comprises the steps: generating a micro-Doppler spectrogram through a millimeter wave radar, and extracting the motion features of human body actions through a signal processing module; in the federal multi-source domain adaptation module, dynamically evaluating and fusing knowledge of a plurality of source domains by adopting a voting-based pseudo-tag method and a weighted knowledge aggregation mechanism, and optimizing the generalization ability of a target model; and through a generalization gap optimization method, the performance of the source domain model is improved, and the robustness of the system in different environments is ensured. Through combination of a federated learning framework and a multi-source domain adaptation technology, unsupervised learning under the condition that a target domain has no annotated data is realized, only a single set of millimeter wave equipment is needed, a millimeter wave communication protocol is compatible, and the method has the characteristics of privacy protection, unsupervised learning, multi-source knowledge fusion and strong generalization ability. The method is suitable for application scenes of smart home, health monitoring, man-machine interaction and the like, and has wide practical application value and research prospect.

The invention discloses a human motion posture recognition method and system based on multi-modal data fusion, and relates to the technical field of posture recognition, and the method comprises the steps: firstly, synchronously obtaining a human motion posture video frame and an IMU segment, then carrying out the feature extraction of the two kinds of heterogeneous data in a shunt parallel mode, and carrying out the feature extraction of the two kinds of heterogeneous data; and respectively capturing visual space attitude information and dynamic inertial characteristics of the IMU. Afterwards, specific features of the modals are uniformly expressed through a mixed Token and embedding mechanism, and a space-inertia collaborative attention fusion mechanism is further introduced to realize dynamic association and deep fusion of cross-modal information; and finally, classifying the multi-modal fusion representation vector obtained by fusion so as to realize accurate recognition of the human motion posture. In this way, the defect that traditional fusion is insufficient in capturing subtle action differences can be overcome, and the accuracy and stability of action recognition in a complex scene are improved.

The invention belongs to the technical field of action recognition, and discloses a small sample human body action recognition method based on a cross attention mechanism. An end-to-end small sample action recognition model is provided, the end-to-end small sample action recognition model is based on a prototype network, on a feature extraction-prototype construction-distance measurement framework of the model, a spatial-temporal feature extraction network is adopted for feature extraction, a prototype-like construction module is adopted for prototype construction, and an end-to-end small sample action recognition model is obtained. And adopting a classification and prediction module for the measurement distance. According to the method, the skeleton position image is introduced to effectively reduce the interference of irrelevant factors such as illumination and view angle change, and the robustness of the model to human body action recognition is enhanced; through the adaptive spatio-temporal feature fusion method, the model can accurately capture fine-grained features, so that the accuracy of action recognition is improved. The design of the multi-branch feature classification loss function optimizes the feature extraction and coding capability, so that the model has better performance in a small sample learning scene.

The invention relates to the technical field of shot action recognition, and discloses a shot throwing action recognition method based on a single attitude sensor. The method comprises the following steps: acquiring a single attitude sensor original data stream in a shot throwing process, and extracting a three-axis acceleration sequence and a three-axis angular velocity sequence from the single attitude sensor original data stream; performing motion event segmentation processing on the two sequences, and generating a key action time period mark set comprising a preparation stage, a sliding step stage, a power generation stage and a release stage; based on the mark set, calling an attitude feature solution algorithm to perform spatial trajectory reconstruction on the original data stream to obtain a key attitude frame set containing a joint angle change curve and a centroid displacement trajectory; and inputting the key attitude frame set into an action recognition model for attitude mode matching, and outputting a shot throwing action classification result which comprises an action deviation parameter generated based on a standard action template library and a key frame correction identifier. According to the method, key attitude information is reconstructed, and support is provided for shot throwing action analysis and improvement.

The invention relates to the technical field of spine rehabilitation training, and discloses a computer vision recognition and guidance system for spine rehabilitation training actions. The system comprises a data acquisition module for acquiring user spine motion three-dimensional dynamic image data by using a multi-camera array; the action recognition module tracks bone joint points based on an improved algorithm to generate a real-time action sequence; the posture evaluation module is used for extracting spine curvature and joint angle features through a multi-scale convolutional neural network; the guidance instruction generation module inputs the features into a reinforcement learning model to generate a personalized instruction; and the feedback execution module constructs a fuzzy self-adaptive control model to correct the motion trail of the spine. According to the system, training actions can be accurately recognized, personalized guidance is provided, real-time correction is achieved, the spine rehabilitation training effect is effectively improved, subjectivity and errors of manual evaluation are reduced, and rehabilitation requirements of different patients are met.

The invention discloses a control method of a vehicle-mounted mosquito repelling device, the vehicle-mounted mosquito repelling device and a storage medium, relates to the field of vehicle-mounted technologies, and discloses the control method of the vehicle-mounted mosquito repelling device, the control method is applied to the vehicle-mounted mosquito repelling device, and the vehicle-mounted mosquito repelling device comprises an image acquisition device and a sound wave mosquito repelling device. The method comprises the following steps: determining a mosquito identification result based on an image in a cabin acquired by an image acquisition device; determining an action recognition result according to the image in the cabin; determining a mosquito repelling mode according to the mosquito recognition result and the action recognition result; and controlling the sound wave mosquito repelling device to operate according to the operation parameters corresponding to the mosquito repelling mode. On the basis, the mosquito information can be automatically detected, the mosquito repelling device is automatically started after the mosquito information is detected, and the mosquito repelling effect is improved.

The invention belongs to the technical field of computer application, and relates to a limb rehabilitation action recognition and evaluation method based on deep learning, and the method comprises the steps: collecting video data and skeleton data of limb function rehabilitation actions, carrying out the preprocessing, and constructing a training set and a verification set of the video data and the skeleton data; a hybrid model of SE-ResBlock3D and LSTM is constructed, and recognition and classification of limb function rehabilitation actions are achieved on input video data through an execution convolution layer, four residual block sequences and an LSTM module in sequence by the hybrid model; and a deep learning network SGP-Net is constructed, and the deep learning network SGP-Net extracts and evaluates space and time sequence characteristics of the limb function rehabilitation actions by executing an STGCN module, a GAT module and a PMTC module on the input preprocessed skeleton data in sequence, so that quality evaluation of the limb function rehabilitation actions is realized.

The invention relates to the technical field of data processing, in particular to an integrated multi-mode culture resource intelligent data governance and management system. The system comprises a data acquisition module, an intelligent processing module, a data management module, a knowledge organization module and an interactive display module. Synchronous acquisition of videos, audios, images and three-dimensional point clouds is realized through camera equipment, audio acquisition equipment and a laser scanner, and cultural elements are extracted through action recognition, speech recognition model processing dialect transcription, image semantic segmentation and named entity recognition by adopting a convolutional neural network. The system realizes structured description and semantic mapping of data on the basis of non-abandoned domain ontology, and constructs a knowledge graph by means of a graph database and a graph neural network. And finally, realizing three-dimensional visual display of the cultural resources by combining a virtual reality technology. According to the method, the problems of non-abandoned multi-modal data processing splitting, insufficient semantic organization and weak display interactivity in the prior art are solved, and the digital governance level and the propagation capability of cultural resources are improved.

The invention discloses a sign language recognition method and device based on multi-modal deep learning, and the method comprises the steps: multi-modal data input: capturing hand motions, gesture tracks and facial expressions at the same time through a camera, a motion capture sensor and other devices, and forming multi-modal data input; sign language action recognition: precise recognition of sign language actions is realized through a combined model of a deep convolutional neural network and a long-short-term memory network; facial expression and gesture track combined recognition: realizing understanding and translation of complex sign language sentences by combining the captured facial expressions and gesture tracks; and context natural language processing: generating a target statement in combination with context semantic understanding, and outputting a translation result. Through hand motion capture, facial expression analysis, gesture trajectory tracking and context natural language processing, complex sign language motions can be recognized more accurately and translated into characters or voices in real time, and low delay and high accuracy are achieved.

The invention discloses a method, a device and equipment for identifying illegal actions in a video and a storage medium, and relates to the technical field of computers. The method comprises the following steps: carrying out joint point detection on a target video stream to determine a joint point coordinate of each video frame, and generating a joint point coordinate sequence based on the joint point coordinates; inputting the articulation point coordinate sequence and the target video stream into a double-flow feature modeling network, and extracting articulation point spatial-temporal features of the articulation point coordinate sequence and image semantic features of the target video stream; and performing cross attention processing on the joint point spatial-temporal features and the image semantic features, and performing illegal action recognition according to the obtained fused features. It can be seen that the double-flow feature modeling network is utilized to extract the joint point spatio-temporal features and the image semantic features at the same time, the fused features rich in the context relation are generated through cross attention processing, illegal action recognition is conducted according to the fused features, and the accuracy of illegal action recognition in the video is improved through the multi-modal features.

The invention discloses an aircraft basic action recognition method based on a selectable feature fusion model, and the method comprises the steps: inputting original time sequence data into an original time sequence feature construction module, obtaining features related to aircraft actions, amplifying the features into the original time sequence data, obtaining new time sequence data, and carrying out the recognition of the aircraft basic actions according to the new time sequence data. Input features of the selectable feature fusion model and corresponding aircraft basic action category labels are obtained; constructing a selective feature fusion model; training the selectable feature fusion model through the total loss function to obtain a trained selectable feature fusion model and parameters thereof; the method comprises the following steps: inputting original data into an original time sequence feature construction module, converting the original data into an input feature format required by a selectable feature fusion model, loading trained selectable feature fusion model parameters, and carrying out end-to-end reasoning to obtain an identification result of basic actions of an aircraft; according to the invention, the performance of aircraft basic action recognition is improved.

The invention relates to the technical field of sports competition real-time penalty, and discloses a sports competition real-time penalty system and method based on multi-modal sensing and AI algorithms, and the system comprises a monitoring identification module, an instrument tracking module, a rule parameter construction module, a fusion penalty module, an output and snapshot module, and a wireless linkage and energy management module. The method comprises the following steps: acquiring image and instrument data, and constructing a multi-modal sensing structure; calling a rule base to generate a penalty vector and loading a structure constraint; fusing the image and the instrument features to generate a feature tensor; inputting an AI model to judge the legality of the action and outputting a penalty result; driving the snapshot logic to generate an image record and synchronizing the image record to the terminal; and adjusting the energy consumption strategy according to the task load and the equipment state. According to the invention, a multi-modal perception input structure fusing instrument motion data and a visual image flow is introduced, so that the system can synchronously acquire displacement, acceleration and attitude images in the action recognition process, and a penalty basis is checked in a cross manner from multiple dimensions.

The invention discloses a motion recognition method and system based on a redox photoelectric memristor, a terminal and a storage medium, and the method comprises the steps: selecting classical motions based on a human body motion data set, extracting time sequence data, and coding the time sequence data into an optical pulse sequence; constructing a reservoir array composed of a plurality of photoelectric memristors, and expanding an optical pulse sequence signal into a high-dimensional state vector; constructing a supervised training model, solving a weight matrix, and constructing a memristive cross array; and outputting an action classification result through simulation domain operation based on the output current multi-path light current signals in combination with the memristor cross array. According to the method, the motion features can be directly fed into a rear-end classification network for action recognition without depending on a complex digital feature extraction algorithm, so that the transmission and processing overhead of redundant data is fundamentally eliminated; a high-efficiency, low-delay and high-robustness hardware solution is provided for real-time and anti-noise motion recognition in scenes such as intelligent monitoring and man-machine interaction.

The invention relates to the technical field of image segmentation, in particular to an intensive care unit video image processing method based on image semantic segmentation, which comprises the following steps of: acquiring a video image through monitoring camera shooting, dividing a semantic region, calculating a pixel displacement direction of each part, identifying an abnormal track, erasing interference, recombining a boundary contour, and comparing shape change. And constructing a trend and re-drawing a structure, evaluating stability in combination with directions, speeds and amplitudes, screening and correcting inconsistent labels, and outputting an index result. According to the method, track features are constructed by introducing pixel direction coding, a deviation region is identified and interference is eliminated in combination with a direction change trend, an edge structure is reconstructed by using a boundary connection sequence and curve fitting, contour division is optimized through deformation direction consistency, and labels are corrected by synthesizing direction change and boundary speed. Dynamic tracking and accurate labeling of the patient state are achieved, the abnormal action recognition efficiency and the label updating accuracy are improved, and the time sequence integrity and the space expression ability of image data are enhanced.

The invention discloses a dance movement recognition method, device and equipment based on dynamic time warping and a computer readable storage medium. The method comprises the steps of obtaining a user skeleton point sequence corresponding to a user dance movement and a standard skeleton point sequence corresponding to a standard dance movement; for each pair of frames in the user skeleton point sequence and the standard skeleton point sequence, multi-dimensional differences including joint point position differences, angle differences and motion amplitude differences are calculated; a double-layer dynamic weighting mechanism is applied to perform weighted fusion on the multi-dimensional difference values, and local cost between two frames is calculated; constructing a cost matrix based on local cost, and determining an optimal regular path and a dance motion similarity score by applying a path constraint dynamic time warping algorithm; and on the basis of the dance motion similarity score and the optimal regular path, generating an identification report including an overall score, a subitem score and visual correction information. The method has the advantages of being high in dance movement recognition precision, high in specialty and the like.

The invention discloses an action recognition method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring and labeling a plurality of skeleton data sequences to obtain a training set; building a multi-stage space-time fusion network, taking the training set as input, taking the behavior type as output, and training the multi-stage space-time fusion network to obtain a human body action recognition model; inputting the to-be-recognized skeleton data sequence into the human body action recognition model to obtain a behavior type corresponding to the to-be-recognized skeleton data sequence; the multi-stage space-time fusion network comprises an action structure diagram convolution module, a time convolution module, a space-time tuple attention module, an inter-frame feature aggregation module and a classification module which are connected in sequence. According to the scheme, the accuracy and timeliness of action recognition on the skeleton data can be improved.

The invention relates to the technical field of action recognition, in particular to a pattern rope skipping action recognition system and method, and the system comprises a limb angle collection module, a stability recognition module, an action triggering and screening module, a rope body direction analysis module and a cross mapping judgment module. According to the method, by introducing three-dimensional coordinate extraction and included angle change trend analysis of limb key joints in the jumping period, the dynamic characteristics of limbs in the action process can be accurately reflected, and the action amplitude and stability change can be effectively expressed through an angle data sequence constructed by multi-dimensional indexes such as the maximum value, the minimum value and the average value of the included angle in the period; a stability identification mechanism is constructed to carry out local regression fitting and residual error statistics on a periodic angle trend, accurate labeling of a stable state of an action posture is realized, and then a key frame sequence with an actual jump intention and a continuous posture in the jump action is effectively identified through fusion screening of labeled frames and a jump-empty state.

The invention discloses a zero sample skeleton behavior recognition method based on cross-modal progressive interaction. The method comprises the following steps: S1, processing an input skeleton sequence by adopting a pre-trained graph convolutional network, and extracting skeleton features with space-time characterization capability; s2, constructing a shared set containing M semantic attributes, and forming a standardized attribute feature set; s3, inputting the skeleton features and the attribute feature set into a semantic attribute decoupling module to obtain an attribute feature sequence aggregated with the skeleton features and a correlation matrix used for feature aggregation; s4, inputting the attribute feature sequence output in the S3 and the skeleton feature with the space-time representation capability output in the S1 into an attribute perception enhancement module, and outputting a skeleton enhancement feature with the length consistent with that of the skeleton sequence; and S5, carrying out average pooling on the skeleton enhanced features for training and testing, and finally realizing classification of behavior data samples with unknown categories. According to the method, efficient zero sample recognition can be realized only by optimizing a small number of interaction parameters.

This disclosure relates generally to action recognition and more particularly to system and method for real-time radar-based action recognition. The classical machine learning techniques used for learning and inferring human actions from radar images are compute intensive, and require volumes of training data, making them unsuitable for deployment on network edge. The disclosed system utilizes neuromorphic computing and Spiking Neural Networks (SNN) to learn human actions from radar data captured by radar sensor(s). In an embodiment, the disclosed system includes a SNN model having a data pre-processing layer, Convolutional SNN layers and a Classifier layer. The preprocessing layer receives radar data including doppler frequencies reflected from the target and determines a binarized matrix. The CSNN layers extracts features (spatial and temporal) associated with the target's actions based on the binarized matrix. The classifier layer identifies a type of the action performed by the target based on the features.

The invention relates to the technical field of action recognition, in particular to a skeleton action recognition method based on a space-time dependency enhanced network, which comprises the following steps: acquiring a graph containing skeleton action articulation points; constructing an AMGC-IBM-CNN network: establishing a space-time diagram by taking joints as nodes and skeletons as edges, performing global feature vector and local feature vector extraction on the space-time diagram by using the AMGC network, inputting the global feature vector into an IBM module, then inputting the global feature vector into the CNN network, performing addition operation on the output feature vector of the CNN network and the local feature vector, and finally obtaining the AMGC-IBM-CNN network. And performing global average pooling, and outputting an action category through a classifier after FC. According to the method, the problems that time and space convolution layers are separated in a traditional model, cross-space-time information exchange is obstructed, and the cross-space-time dependency relationship of the joint points is difficult to obtain are solved.

The invention discloses a mechanical arm control method and device based on human body posture recognition and a storage medium, and relates to the technical field of robots. The mechanical arm control method comprises the steps that human body skeleton joint point coordinate information, collected by a sensor arranged on a robot, of an operator is obtained; on the basis of a preset action recognition model, action type recognition is conducted on the human skeleton joint point coordinate information, and the action type of the operator is obtained; determining the intention of the operator according to the scene information, the action type and the movement track of the operator; and determining a target task associated with the intention of the operator, and controlling the robot to execute the target task. In the invention, the robot can dynamically adjust the task execution strategy according to the real-time action and intention of the operator, so that the task execution efficiency and flexibility are improved.