348 results about "Human behavior" patented technology

The invention belongs to the technical field of intelligent perception and mode recognition, and particularly relates to a human body behavior recognition method based on millimeter wave radar and multi-task learning. The method comprises the steps that millimeter wave radar point cloud data and RGB video streams are synchronously collected, and a five-dimensional point cloud scene is generated through three-dimensional analysis and dynamic target extraction; a hierarchical Point Transform network is constructed to extract radar space-time features, and human body key point features are generated by using visual auxiliary attitude estimation; radar and key point features are dynamically fused through a cross-modal attention mechanism, a multi-task joint optimization strategy is combined, behavior classification serves as a main task, attitude estimation serves as an auxiliary task, and a behavior recognition result is output. According to the method, through multi-task cooperation and cross-modal feature interaction, on the premise of ensuring privacy security, the accuracy and robustness of human behavior recognition in a complex scene are remarkably improved, and efficient and reliable technical support is provided for the fields of intelligent monitoring, human-computer interaction and the like.

The invention discloses a human abnormal behavior monitoring method based on a large-model multi-agent, which is executed by a modular multi-agent system deployed on a back-end server, obtains information through a monitoring camera, and comprises the following steps: obtaining a video stream from the monitoring camera by a sensing agent and extracting human body posture features; analyzing the key frame by a scene understanding agent by using a visual large model, and constructing a time sequence dynamic scene graph; the core reasoning agent evaluates the scene semantic conformity based on the pre-trained large model and performs abnormal preliminary judgment; performing fine-grained classification, interpretation generation and risk assessment on the abnormal behaviors; and the report and action agent generates an alarm and records event data. According to the invention, through multi-agent cooperative work and a large model technology, efficient and accurate monitoring of human abnormal behaviors is realized, and the intelligent level of the monitoring system and the abnormal behavior identification accuracy are improved.

The invention discloses a space-time decoupling human behavior recognition method, device and equipment based on a dynamic semantic guide mask. The method comprises the following steps: extracting human skeleton sequence data from an original video and performing data enhancement; based on a dynamic semantic guide mask mechanism, performing mask operation on the skeleton sequence after data enhancement in two dimensions of space and time; respectively sending the skeleton sequence data after mask operation into a query encoder and a momentum encoder, respectively obtaining spatial representation and time representation, constructing cross-domain contrast loss, and carrying out contrast learning training to obtain a human behavior recognition model; and inputting the to-be-recognized video into the human body behavior recognition model to obtain a prediction result of the human body behavior in the to-be-recognized video. According to the space-time decoupling human body behavior recognition method, device and equipment based on the dynamic semantic guide mask, the human body behavior recognition precision and the environmental adaptability are remarkably improved under the condition that manual labeling is not needed.

The invention relates to the technical field of artificial intelligence, and particularly provides a human behavior recognition system and method based on multi-dimensional and multi-scale feature extraction. The system comprises a human body behavior data acquisition module, a human body behavior data transmission module, a human body behavior data storage module, a human body behavior data preprocessing module, an LGAM simple human body behavior recognition network module, an MPFEFN complex human body behavior recognition network module and a human body behavior information application module. The MPFEFN complex behavior recognition network module comprises an initialization unit, a residual error multi-parallel multi-attention feature extraction unit, a residual error multi-parallel channel enhancement and extraction unit, a feature fusion unit and a complex behavior judgment output unit, and the residual error multi-parallel multi-attention feature extraction unit and the residual error multi-parallel channel enhancement and extraction unit are connected in parallel. The recognition accuracy of the easily-confused behaviors is improved, effective recognition of complex human body behaviors is achieved, and the recognition performance of an existing model is improved.

The invention belongs to the field of cable monitoring and protection, and discloses a human behavior identification method and system for cable external damage prevention based on space-time diagram convolution. The method comprises the following steps: acquiring image data and electrical data through a multispectral camera and a sensor respectively; preprocessing the image data, and constructing a skeleton motion topological graph containing time sequence dynamic association; the improved space-time diagram convolution network is utilized to jointly model the multi-scale global space-time features of the action through multi-layer space-time convolution, and the behavior recognition probability is output; and outputting a fusion behavior recognition probability by using a cross-modal adversarial discriminator, judging a risk level and formulating a hierarchical response strategy. According to the invention, joint determination of behavior identification probability and electrical characteristics is realized, the problem of low damage behavior identification precision under a complex background is solved, and artificial cable external force damage accidents can be effectively prevented.

The invention relates to the technical field of computer vision, in particular to a human body behavior recognition method and system. According to the method, a multi-head space hypergraph convolution module is arranged before each time graph convolution of an ST-GCN model, and a human body behavior recognition model is constructed; the multi-head space hypergraph convolution module constructs a non-uniform hypergraph to represent the topological relation of the human skeleton through the maximum number, which can be contained by hyperedges, of each node, and generates the output of the module in combination with a physical adjacency matrix reflecting the relation of each joint; virtual connection is also added, virtual features which are the same as the input channel dimension and the time dimension of the multi-head space hypergraph convolution module are constructed, and the virtual features and modal data features are spliced along the joint dimension and then serve as module input again, so that global semantic information of real nodes is enriched, generalization information of human body behavior modes is supplemented, and the real-time performance of the multi-head space hypergraph convolution module is improved. And stage dense connection is introduced between different layers to smooth the change degree of the features, so that the human behavior recognition precision is improved.

The invention relates to the technical field of safety monitoring, and discloses a multi-source data fusion-based personnel behavior safety early warning system, which comprises a data acquisition module, a fusion decision module, a dynamic adjustment module, a cross validation and correction module, an accumulated score management module, an early warning comparison module, an early warning response module and an equipment linkage module, the data acquisition module acquires identity permission, dynamic position, environmental perception and video stream data in real time, and encrypts and transmits the data to the fusion decision module, the fusion decision module performs modeling by using an improved D-S evidence theory, identifies illegal behaviors and gives initial scores, the dynamic adjustment module performs weighting according to time and position coefficients to obtain dynamic scores, and the dynamic adjustment module performs decision making according to the dynamic scores. The cross validation module calculates correction scores such as conflict coefficients, the score accumulation module performs rolling accumulation according to 24 hours, attenuation and reset rules exist, the early warning comparison module marks three-level threshold values to determine risk levels, the early warning response module triggers corresponding strategies according to the levels, and the equipment linkage module controls hardware to realize closed-loop control so as to guarantee regional safety.

The invention provides a human behavior recognition method based on fusion of multi-modal data acquired by an unmanned aerial vehicle, and the method comprises the following steps: splicing a joint Tokens with a space CLS Tokens of the same frame after feature extraction is completed by using a space Transform, and obtaining a feature fusion module; performing structure coding on the joint point sequence based on a human anatomy structure, and constructing a human topological structure association module; the method comprises the following steps of: constructing a time sequence cross Transform module; the space Transform, the feature fusion module, the human body topological structure association module and the time sequence crossing Transform module are stacked to obtain a trunk feature extraction network; a 10-layer trunk feature extraction network is adopted to perform deep feature extraction on input early-stage fusion data and feature fusion data, and classification is performed by using a classification head; the features output by the backbone network are mapped to the dimensions with the same number as the behavior categories, a prediction score is output for each category, and a human body behavior recognition result is obtained according to the prediction scores. According to the method, the human body behavior in the multi-modal data acquired by the unmanned aerial vehicle can be effectively identified.

The invention discloses a deep learning-based human behavior recognition method and recognition system, and the method is characterized in that the method comprises the following steps: S1, data collection: collecting video data containing a plurality of human behaviors through a high-definition camera or a video database, and covering different scenes, illumination conditions and human postures; s2, data preprocessing: firstly extracting a three-dimensional coordinate sequence of human skeleton key points by using a Medape pre-training model, and then performing mean filtering and normalization preprocessing on the collected data to improve the generalization ability of the model; according to the method, the advantages of the DCN and the LSTM are combined, the improved double-flow convolution model is added with the space-time soft attention mechanism, the problems that space-time feature extraction is insufficient and feature design is complex in human body action recognition are effectively solved, the lightweight degree of the model is remarkably improved, and the human body action recognition accuracy is improved. And a new method is provided for research and application of human behavior recognition.

The invention provides a through-the-wall radar human body behavior recognition method and recognition system based on spatial-temporal characteristics, and the method comprises the steps: obtaining and processing through-the-wall radar human body behavior echo sampling signals, and obtaining a corresponding time-Doppler spectrogram as a sample set; and training a constructed TWRMama network by using the sample set, in which the network adopts a CA-Mama block as a core feature extraction module, can efficiently model and input a time sequence dynamic feature and a spatial dependency relationship of a time Doppler spectrogram, and effectively enhance the feature expression ability in a shielding scene, thereby realizing accurate recognition of human behaviors of the through-the-wall radar. Besides, information interaction between patches is introduced into a patch embedding module of the TWRMama network, so that the expression capability of the network can be further improved, and the calculation complexity of the network is effectively reduced.

The invention discloses a human body behavior prediction method and system, and the method comprises the steps: carrying out the skeleton point sequence extraction of a real-time behavior video image of a target person, and obtaining a joint point coordinate set and a skeleton motion sequence; determining a spatio-temporal feature sequence of the joint point coordinate set, and determining a skeleton motion sequence to perform spatio-temporal attention coding to obtain global spatio-temporal dynamic features; fusing the action probability distributions corresponding to the spatial-temporal feature sequence and the global spatial-temporal dynamic features to obtain short-time action probability distribution data; candidate action screening is carried out on the short-time action probability distribution data, and candidate action comprehensive features are obtained; performing feature coding on the historical action sequence of the target person to obtain a historical context vector, and splicing the historical context vector with the candidate action comprehensive features to obtain a fusion feature; and inputting the fusion features into a probability model for intention probability evaluation to obtain a behavior prediction result of the target person. According to the method, the accuracy of behavior prediction is improved.

The invention relates to a behavior recognition method and system based on adaptive sliding window multi-head self-attention, and the method comprises the steps: preprocessing a training set of a human behavior video data set, inputting the preprocessed training set into a neural network model for training, preprocessing a test set, and inputting the preprocessed test set into the trained neural network model for behavior detection, obtaining the detection accuracy of the neural network model; and inputting to-be-recognized human body behavior video data into the tested neural network model for behavior recognition. According to the method, the long-time dependency and global features in the video can be captured, so that the extracted features are more comprehensive, the problems that the receptive field of the convolutional neural network is limited and the long-time dependency relationship in the video is difficult to capture can be effectively solved, and the recognition accuracy of various behaviors is greatly improved.

This invention presents a computer-implemented method for answering polls and surveys using large language models (LLMs), a novel approach that leverages an LLM's ability to emulate a group of human responses for diverse data collection. The system involves training a single or multi-modal LLM on a comprehensive dataset comprising one or more categories of text, image, sound and other sensory input data, which can be continuously updated with current events and trends, to ensure accurate representation of human behaviors and opinions. Utilizing a user interface, the method includes receiving survey and poll questions, posing these questions to a unique instance of the trained LLM and receiving the answers, recording the question-answer sessions, and compiling the results for presentation. Additionally, the system prioritizes data privacy and integrates a feedback mechanism for continuous improvement, providing an efficient solution to answering surveys or polls in the digital age.

The invention provides a radar-based human skeleton estimation method, system and product, and the method comprises the steps: carrying out the target detection of collected radar echo data, and generating a target four-dimensional point cloud containing distance information, speed information and angle information based on a target detection result; dividing the target four-dimensional point cloud into a plurality of human body topology point cloud blocks based on the velocity direction similarity of each point in the target four-dimensional point cloud; and inputting the human body topology point cloud block into a human body skeleton estimation network for human body skeleton estimation to obtain a human body skeleton estimation result. According to the human skeleton estimation method provided by the invention, human topology priori can be constructed from sparse millimeter wave radar point clouds, point cloud block features sensed by a structure are extracted, the modeling capability of a model for the spatial relationship of key parts of a human body is enhanced, diversified and natural daily human behaviors in a non-inductive monitoring scene can be adapted, and the human skeleton estimation accuracy is improved. The human body skeleton estimation with higher generalization ability is realized, and the accuracy and robustness of human body posture prediction can be effectively improved.

The invention discloses an output matching method based on a smart humanization engine, and the method comprises the following steps: S1, defining personality features, and building the association configuration of the personality features and online platform user behaviors on an online platform; s2, acquiring user behavior data on the online platform in real time; s3, according to the association configuration established in the step S1, converting the user behavior data into a personality feature score of the user, and establishing a user portrait big data model according to the personality feature score; s4, for any user, on the basis of the user portrait big data model, carrying out AI model construction to form a simulated digital person based on a smart humanization engine, simulating behaviors of the simulated digital person, and collecting behavior data of the simulated digital person in different virtual environments; and S5, according to the behavior data, collected in the step S4, of the simulated digital human in different virtual environments, predicting the behavior trend and demand of the corresponding user in real life.

The invention discloses a sound mixing and noise reduction method and system, and the method comprises the steps: firstly, carrying out the recognition of the emotional state of a person in a vehicle through an emotion recognition method; and then, whether the person in the vehicle has a bad emotion which can influence the behavior state or not can be judged according to the emotion recognition result. And if the person in the vehicle does not have the impatient emotion, the current noise in the vehicle does not need to be processed. On the contrary, if the person in the vehicle has a restless emotion, the sound signal in the vehicle is immediately collected through the sound pick-up. And finally, a sound wave identification method can be adopted to extract a noise feature vector of a noise sound segment which affects the emotion of people in the vehicle from the collected sound signals, and a corresponding sound mixing sound wave band is generated based on the extracted noise feature vector and is fused with the noise sound segment which affects the people in the vehicle, so that the sound mixing sound wave band becomes a sound segment which can be accepted by people. Therefore, the influence of noise on the behavior state of people is reduced.

A security platform architecture is described herein. A user identity platform architecture which uses a multitude of biometric analytics to create an identity token unique to an individual human. This token is derived on biometric factors like human behaviors, motion analytics, human physical characteristics like facial patterns, voice recognition prints, usage of device patterns, user location actions and other human behaviors which can derive a token or be used as a dynamic password identifying the unique individual with high calculated confidence. Because of the dynamic nature and the many different factors, this method is extremely difficult to spoof or hack by malicious actors or malware software.

The invention provides a human skeleton behavior recognition method based on a multi-modal enhancement converter and a hypergraph structure. The method comprises the following steps: S1, acquiring original skeleton data representing human behavior recognition; preprocessing the skeleton data to obtain four skeleton modal data in total; s2, carrying out single-mode feature extraction on the four types of skeleton modal data, and then carrying out multi-mode feature fusion to form unified skeleton features; s3, performing feature refining and three-dimensional dynamic feature reinforcement on the skeleton features of the unified mode in time and space; and S4, the refined skeleton features are subjected to a global average pooling layer and a full connection layer to obtain a behavior identification prediction result, and the result is a discrete action classification label. According to the method, a lightweight multi-modal converter network and a double hypergraph topological structure are constructed to enhance the multi-modal skeleton data fusion performance and capture the cooperative motion relationship between joint groups, so that the recognition accuracy and recognition efficiency of double interaction behaviors are improved.

The application discloses a kind of spatio-temporal decoupling human behavior recognition method, device and equipment based on dynamic semantic guide mask, comprising: extracting human skeleton sequence data from original video and carrying out data enhancement;Based on dynamic semantic guide mask mechanism, the skeleton sequence after data enhancement is masked in operation in two dimensions of space and time;Skeleton sequence data after masking operation is sent into query encoder and momentum encoder respectively, spatial representation and time representation are obtained respectively, cross-domain contrast loss is constructed, contrast learning training is carried out to obtain human behavior recognition model;The video to be identified is input into human behavior recognition model, and the prediction result of human behavior in the video to be identified is obtained.The spatio-temporal decoupling human behavior recognition method, device and equipment based on dynamic semantic guide mask of the application significantly improve human behavior recognition precision and environmental adaptability without manual label.

The invention discloses an ecological protection area human behavior recognition method and device based on gait feature recognition. An annular first optical fiber detection layer is laid on the periphery of an isolation belt of a protection area; deploying a radial second optical fiber detection layer on the isolation strip towards the center of the isolation area; the three-frequency WiFi probe array is deployed in the isolation zone domain; the intrusion position identification module is used for detecting a vibration signal by using the first optical fiber detection layer, calculating an intrusion position coordinate through a time difference positioning formula, and activating a monitoring channel of a radial second optical fiber detection layer in a corresponding direction according to the position coordinate; the gait feature fusion extraction module is used for extracting multi-scale energy features and generating gait comprehensive features through the multi-scale energy features; and the identity judgment module is used for inputting the gait comprehensive features into a pre-trained classification model, and judging the identity of an intruder according to the gait comprehensive features, thereby realizing the construction of an ecological protection area protection technology system with intelligent perception, dynamic response, global linkage and low cost.

The invention relates to the technical field of people flow simulation analysis, and particularly provides a people flow simulation analysis method and system based on spatio-temporal behavior dynamics, and the method comprises the steps: obtaining urban multi-dimensional spatio-temporal heterogeneous data, and carrying out the standardization; constructing a dynamic coupling mechanism of crowd behaviors, spatial constraints and industrial function supply, and extracting travel decision rules and destination selection logic; by taking the mechanism as a constraint, constructing a space-time behavior dynamic model in combination with subject modeling, simulating group flow space-time evolution and outputting crowd flow characteristic parameters; and based on the parameters, predicting the people flow distribution and aggregation dissipation trend of the target scene, and performing visual display. According to the method, through combination of multi-factor dynamic coupling and subject modeling, simulation accuracy and scene adaptability are improved, a prediction result is visual, and scientific decision support can be provided for urban planning, traffic management, public safety guarantee and the like.

The invention provides a multi-scale space-time cross attention-driven human body behavior recognition method, which comprises the following steps of: inputting a joint mode, a skeleton mode, a joint movement mode and a skeleton movement mode serving as input modes into a multi-scale space-time cross graph for convolution to obtain final space-time feature representation; performing residual connection on the final spatial-temporal feature representation and an input mode to obtain features after residual connection, and inputting the features after residual connection into a dynamic multi-scale time convolution; in the dynamic multi-scale time convolution, performing dynamic multi-scale time convolution processing on the features after residual connection to obtain output feature representation of the dynamic multi-scale time convolution; obtaining a prediction result of each modal branch based on the final spatial-temporal feature representation and the output feature representation of the dynamic multi-scale time convolution; and obtaining a final prediction category based on the prediction result of each modal branch. The invention provides an efficient computing framework, and the computing cost is reduced by optimizing a network structure and a reasoning process.

The invention discloses a human body behavior recognition method based on GCN-Transform and multi-scale time convolution, and the method comprises the steps: carrying out the estimation of a video stream posture through an open-source human body posture estimation frame OpenPose, obtaining key point coordinate data, and carrying out the matrix completion; processing the data into a graph data structure through a graph processing module, and processing the data into four flow state data sets; extracting spatial features by using a GCN module, and extracting time dimension information by using a multi-scale convolution module; modeling is carried out on the space-time global relationship by using a Transform; combining the three modules into a Block and stacking the Block to form a recognition network model; outputting a prediction result of the model by classifying the head; and training and optimizing network parameters, fusing results, and obtaining a final composite neural network and an identification result. According to the human body behavior recognition method, the graph convolutional neural network and the Transform neural network are combined, the global dependency relationship of joint movement in time and space is captured, and the recognition precision is improved.

A method of maintaining fidelity of a bond between a person and an artificial intelligence agent bound to the person includes capturing data for behavioral modalities of a person, calculating a score for each behavioral modality, calculating a similarity score from the calculated scores, and comparing the similarity score against the threshold value. In response to determining the similarity score fails to satisfy the threshold value, the method substitutes a snapshot of a Baseline Persona Model of the person for the Baseline Persona Model. The Baseline Persona Model is a machine learning model that encodes the behavioral modality data of a person over time. The snapshot is a copy of the Baseline Persona Model at an instant in time. Subsequently data for the behavioral modalities of the person is captured over time. The Baseline Persona Model is retrained using a set of the subsequently captured data approved by the person.

The invention discloses a human behavior prediction method based on a double-flow space-time diagram convolutional network, and belongs to the technical field of computer vision and deep learning, and the method comprises the following steps: S1, obtaining a human skeleton data set; s2, preprocessing skeleton point data; s3, processing the preprocessed skeleton point data through a double-flow space-time diagram convolutional network; s4, constructing a multi-scale joint point spatial dependency relationship; s5, processing the output features of the first stream through frequency weighting and a channel feature importance attention mechanism, dynamically adjusting the feature weights of high-frequency and low-frequency channels, and generating enhanced spatial-temporal features; and S6, fusing the output features of the double-flow network, generating a final behavior prediction result, and realizing human body behavior prediction. According to the method, through a multi-space category modeling graph convolution module and a frequency weighting and channel feature importance attention mechanism, a multi-space category modeling double-flow space-time graph convolution network is further provided, and the accuracy of behavior prediction is remarkably improved.

The invention relates to the technical field of computer vision, in particular to a three-dimensional human body behavior recognition method and device, a terminal and a medium, and the method comprises the steps: inputting four-dimensional point cloud data into a trained state space model, and extracting subsequences of different time scales in the four-dimensional point cloud data; sorting each frame of three-dimensional point cloud in each sub-sequence to obtain an ordered space sequence; splicing the ordered space sequence according to a time sequence to obtain a spliced ordered space-time sequence corresponding to each subsequence; determining a center point feature corresponding to each sub-sequence according to the spliced ordered space-time sequence; and obtaining low-order spatial-temporal characteristics, and obtaining an action recognition result based on the low-order spatial-temporal characteristics and the central point characteristics of each sub-sequence. According to the method, space and time information is taken into consideration, a complex space-time dependency relationship can be captured, and the calculation complexity is reduced through the trained state space model, so that the accuracy and efficiency of a behavior recognition result are improved.

A security platform architecture is described herein. A user identity platform architecture which uses a multitude of biometric analytics to create an identity token unique to an individual human. This token is derived on biometric factors like human behaviors, motion analytics, human physical characteristics like facial patterns, voice recognition prints, usage of device patterns, user location actions and other human behaviors which can derive a token or be used as a dynamic password identifying the unique individual with high calculated confidence. Because of the dynamic nature and the many different factors, this method is extremely difficult to spoof or hack by malicious actors or malware software.

The invention provides a human body behavior recognition method based on machine learning, and relates to the technical field of human body behavior recognition, and the method comprises the steps: obtaining target video data, and collecting video data containing different human body behaviors and corresponding behavior types as historical data; preprocessing the target video data and the historical data to obtain target data and training data; constructing an LSTM network model optimized based on a crayfish optimization algorithm, and inputting training data for training to obtain an optimal behavior recognition model; and inputting the target data into the optimal recognition model to obtain a behavior category. According to the method, the LSTM network model optimized based on the crayfish optimization algorithm is constructed, the training data is input for training, the optimal recognition model is obtained, feature extraction is performed on the target video data, global feature representation is obtained through an inverse weighting mode, behavior information in the video is comprehensively reflected, and the recognition efficiency is improved. And the accuracy and reliability of the optimal behavior recognition model are improved.

The invention discloses a multi-modal feature fusion-based human body behavior recognition method and device, terminal equipment and a storage medium, and belongs to the field of computer vision, and the method comprises the steps: generating a key point feature sequence through recognizing human body key point features of a target person in each video frame of a target video; identifying dynamic change features of the human body key point features according to a time sequence, generating a time sequence feature matrix, constructing a spatial feature matrix and an optical flow feature matrix by identifying spatial features and optical flow features of each video frame in a target video, and fusing the time sequence feature matrix, the spatial feature matrix and the optical flow feature matrix to obtain a fusion feature matrix; and a fusion feature matrix is generated, so that the behavior recognition model pays attention to the action change of the target person and the spatial change of the environment when performing behavior recognition. Therefore, the defect that the current human body behavior identification method is difficult to accurately identify the human action behavior can be solved.

The invention provides a human body behavior real-time recognition system based on an FPGA and a millimeter wave radar. The technical problems that an existing human body behavior recognition system cannot achieve off-line recognition, is insufficient in real-time performance and is low in data transmission accuracy are solved. Comprising a millimeter wave radar and further comprises a radar signal preprocessing module and a neural network identification module which are electrically connected. The radar signal preprocessing module enables the FPGA to be directly connected and controls a data acquisition card in the millimeter-wave radar to acquire radar original echo data, extract a specific sampling point, compress each frame of chirp signal to obtain a one-dimensional vector, respectively perform windowing to obtain windowing data, and perform FFT to obtain frequency spectrum data after FFT; performing normalization and conversion to obtain a binarized distance time graph and a binarized speed time graph, and performing fusion to generate a feature graph; and the neural network identification module stores parameters obtained by feature map training into a neural network model, and deploys the neural network model to the FPGA. The method can be widely applied to the technical field of human behavior recognition.