590 results about "Perception" patented technology

The invention discloses a scene interactive AI rehabilitation evaluation training and health monitoring system, and relates to the technical field of rehabilitation medical treatment and artificial intelligence, a semantic perception module is used for collecting and recognizing voice input, facial expressions, action tracks and eye movement paths of a user in a training process, and extracting context parameters; the knowledge-driven training generation module is used for calling a rehabilitation knowledge graph constructed by a graph neural network based on context parameters and individual training history, and generating a multi-path training scheme; training a feedback regulation engine, collecting posture offset, physiological stress and emotion feedback, and dynamically adjusting task difficulty, rhythm and prompt mode based on a dual-channel reinforcement learning model; the prediction module fuses training and monitoring data, and predicts a network identification function degradation risk through degradation driving; the cloud edge fusion platform is used for realizing task quick response and graph strategy iterative updating; according to the invention, the individuation, self-adaption and intelligent prediction capabilities of rehabilitation training are improved, and the rehabilitation effect and the system practicability are obviously optimized.

The invention relates to the technical field of AI interaction data processing, and discloses an AI interaction data processing system based on multi-modal perception and dynamic decision, comprising the following modules: a multi-modal perception module used for collecting environment data through a multi-source sensor; the data fusion module is used for generating fused feature data; the causal decision-making module is used for generating a decision-making action to cope with the change of the environment; the decision security module is used for identifying potential safety hazards in the high-risk scene and generating alternative decision or early warning information; the sensing calibration module is used for optimizing a sensing strategy in a changing environment; and the adaptive optimization module continuously optimizes the perception and decision strategy. According to the invention, the multi-modal sensing module is combined with a cross-modal consistency learning mechanism and a noise robustness enhancement technology, and the data fusion module introduces a context sensing attention mechanism and a multi-level feature alignment network, so that the sensing ability of the system to complex environment information and the comprehensiveness and accuracy of feature representation are effectively improved.

The invention relates to the technical field of slope protection, in particular to a slope protection intelligent detection system based on deep learning. According to the technical scheme, the system comprises a multi-source heterogeneous data sensing module, a data fusion and feature extraction module, a slope state intelligent diagnosis and early warning module, an edge-cloud collaborative computing architecture and a system optimization module. Registration and feature complementation of multi-source heterogeneous data are realized through a multi-modal detection network, an overfitting phenomenon is effectively inhibited through a physical information neural network architecture, risk quantitative evaluation is realized through construction of a dynamic risk evaluation model, early warning response time is shortened in cooperation with a four-level early warning strategy, the false alarm rate is reduced, and the early warning efficiency is improved. Besides, the detection precision of the system in an extreme scene is improved through a physical constraint adversarial training method, so that the environmental adaptability of the system is improved, continuous updating and evolution of the model are realized through an online incremental learning module, and the problem of performance degradation of a traditional system caused by change of geological conditions is solved.

The invention discloses a brain tumor multi-mode large model construction method, device and equipment and a storage medium, and is applied to the technical field of brain tumor imagines.The method comprises the steps that pixel-concept level alignment is conducted on a multi-mode MRI image and a pathological text; constructing a multi-modal feature fusion network for fusing image features and text features by adopting an attention mechanism of pathology perception and combining medical semantic information; training the multi-modal feature fusion network to generate an analysis report and a segmentation result; according to the technical scheme of multi-task cooperation, cross-modal pathological semantic accurate alignment, pathological knowledge graph injection and lightweight and continuous optimization parallelization, full-process coverage of brain tumor accurate segmentation, analysis report generation and prognosis prediction is achieved, the problems that a traditional model lacks pathological semantic support and is insufficient in clinical adaptability are solved, and the clinical adaptability of the traditional model is improved. And the deployment feasibility and the dynamic optimization capability are also considered.

The present disclosure relates to a multi-modal brain network computation method associated with structural function, apparatus, device, and medium. The method is applied to train a brain disease prediction model, and the brain disease prediction model includes an association perception dual-channel generation module, a disease feature regression module, a topological structure discriminator, and a time-space joint discriminator. In a model training process, by performing a multi-level interactive fusion learning on a high-order topological feature of brain functional magnetic resonance data and magnetic resonance diffusion tensor imaging data, a multi-modal time series activity signal of each brain region is obtained.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes such as medical health fund, fusion science and technology and mental health recuperation, and discloses a guidance method, device, equipment and medium based on multi-modal perception.The guidance method comprises the steps that physiological index data and motion trail data are collected, and a multi-modal body data set is generated; inputting a pre-trained mind and body association model to generate a mind and body state mapping relation; combining the three-dimensional scene model library and the dynamic attention parameters to generate an immersive interaction scene, and analyzing a scene interaction instruction based on a domain knowledge graph; and fusing the user portrait and the real-time state vector, generating a comprehensive decision parameter, and screening personalized guidance content from the guidance content library according to the feature similarity between the comprehensive decision parameter and the scene interaction instruction and outputting the personalized guidance content. According to the method, through multi-modal data acquisition and body and mind state modeling, accurate perception of the physiological state and behavior characteristics of the user is realized, and the accuracy of personalized guidance is improved in combination with immersive scene interaction and knowledge graph analysis.

The invention belongs to the technical field of artificial intelligence and health monitoring, and particularly relates to an emotion recognition and intervention system based on facial micro-expression and physiological signal fusion. The emotion recognition precision is improved through space-time alignment analysis of facial micro-expressions and physiological signals, adaptive feedback is achieved in combination with cognitive load correlation modeling and a wearable multi-channel regulation and control terminal, cross-period emotion evolution prediction and group situation awareness are supported, a'awareness-decision-intervention 'complete closed loop is constructed, and the emotion recognition efficiency is improved. And the accuracy and initiative of emotion management in a complex environment are enhanced.

The invention belongs to the technical field of intelligent control of robots, and discloses a self-adaptive adjustment system for behavior modes of an intelligent robot with a body, which comprises a neuromorphic sensing module for acquiring and fusing multi-mode environment sensing information, performing space-time compression on the multi-mode environment sensing information by referring to a brain visual cortex sparse coding principle, and generating a neural network; generating an environment state representation vector, and constructing a neuromorphic perception path; the cognitive constraint decision module is used for generating an action strategy by adopting a neural symbol hybrid architecture based on the environment state representation vector; through a cognitive momentum optimization mechanism, a strategy inertia item is introduced to improve an updating process of an action strategy parameter, and a behavior decision vector is obtained; the variable impedance execution module is used for mapping the behavior decision vector into a plurality of virtual muscle cooperation elements through a muscle cooperation mapping rule, and solving an expected movement track of each execution joint of the robot; and the intelligent robot with the body has higher adaptability, stability and execution capability.

Provided is a method for token-based representation and learning of robotic perception data based on a graph neural network, comprising: obtaining a plurality of types of perception data of a robot; performing token-based representation according to types of the plurality of types of perception data; constructing an initial feature graph based on the plurality of types of perception data after the token-based representation; learning a compact representation of the initial feature graph based on an autoencoder and reconstructing a graph structure; after the autoencoder completes learning of the graph structure, fixing the graph structure; and converting the plurality of types of perception data into node feature vectors, constructing a feature graph based on the graph structure, and performing numerical encoding on each of the node feature vectors by utilizing the graph neural network to obtain a representation of high-dimensional feature vectors of the plurality of types of perception data.

The invention belongs to the related technical field of brain image processing, and provides an Alzheimer's disease classification method and system based on topology perception and a group hypergraph in order to solve the problem of inaccurate classification of the Alzheimer's disease in the prior art. Constructing a dynamic function connection network sequence through a sliding window strategy; a local topology perception encoder and a global topology perception encoder are respectively used for extracting local topology features and global topology features of each time window, deep interaction and fusion are carried out, and comprehensive feature representation of a tested level is generated; according to the method, each subject is used as a hypergraph node, hyperedges are constructed on the basis of comprehensive feature representation of a subject level and by combining feature similarity calculated by diffusion tensor imaging features and clinical embedded features of the subject, then a group hypergraph is constructed, a classification result is obtained by using a hypergraph neural network, and the early classification diagnosis accuracy of the Alzheimer's disease is effectively improved.

The invention discloses a psychotherapy and healing robot based on high human emotion fitting degree simulation analysis, and the robot comprises a multi-mode perception layer which is used for collecting the interaction data of physiology, movement and environment; the multi-modal sensing layer comprises a heterogeneous data acquisition module, a spatial-temporal feature extraction network and an attention fusion mechanism module; the dynamic decision-making layer is used for generating an intervention strategy based on the interaction data; the dynamic decision-making layer comprises a reinforcement learning strategy engine and a hierarchical intervention selection tree; the generative interaction layer is used for generating a co-estrus response conforming to ethical specifications based on the intervention strategy; the generative interaction layer comprises an ethical constraint system and an emotional response generator; the brain science verification layer is used for monitoring neural feedback in real time through EEG and adjusting an intervention strategy; and the brain science verification layer comprises a neural feedback regulation module and a multi-mode feedback design module. Therefore, a precise and personalized psychological intervention decision closed loop is provided, and the defects of an existing AI psychological product in the aspects of emotion recognition, intervention strategies and effect quantification are overcome.

The invention relates to the technical field of cultural tourism guide, in particular to a marine culture intelligent guide system based on artificial intelligence and the Internet of Things, which integrates multi-source data acquisition, context semantic understanding, user portrait construction, personalized content recommendation and adaptive content presentation, and the system acquires user voice, position, facial image and environment information, so as to realize the intelligent navigation of the marine culture. Accurate data acquisition is realized; the system combines semantic understanding and user portraits, dynamically generates interest models, recommends personalized marine culture contents to users, ensures effective information transmission through a self-adaptive presentation module, optimizes resource allocation through a distributed processing module, guarantees stable operation of the system, constructs a user-environment-cultural relic three-dimensional perception network, improves the acquisition precision by 65%, and improves the real-time performance of the system. The data dimension is obviously expanded, a comprehensive data basis is provided for intelligent navigation, and efficient and personalized cultural tourism experience is achieved.

The invention provides a port facility management and maintenance large model report review agent construction method and system, and the method comprises the steps: collecting a cross-modal original data set, constructing a multi-modal feature fusion perception layer, and generating facility damage feature alignment data; constructing a cognitive neural network four-level architecture, and generating an inference decision tree; constructing a root cause-path-result causal chain, and generating a fault attribution analysis report; constructing a prediction-intervention-verification active defense closed loop, and generating a Pareto optimal maintenance strategy set; and executing an intervention strategy and feeding back a verification result by using the digital twin verification platform and the block chain evidence storage system. According to the method, cross-modal data deep semantic alignment is realized through the multi-modal feature fusion perception layer, a data island is broken, and the damage feature extraction accuracy is improved; an interpretable causal chain is constructed based on related architecture and modules, the decision black box problem is solved, and a maintenance strategy has causal logic support; and real-time verification and credible tracing of a strategy effect are realized through an active defense closed loop.

Disclosed in the present invention is a general-purpose intelligent agent. The general-purpose intelligent agent comprises: an input module, which is configured to acquire a preprocessed input signal; a consciousness module, which is configured to perform perception and cognitive operations in a transparent and interpretable abstract thinking form; a self-awareness module, which is configured for perception and cognition of an intelligent agent body; a subconsciousness module, which is configured to use a data-driven model to implement perception and cognitive functions at a subconscious level; an information exchange module, which is configured to perform mutual exchange between perception, cognition and other information generated by the consciousness module, the self-awareness module and the subconsciousness module, thereby enabling integration and utilization; and an output module, which is configured to output a processing result on demand. In a machine intelligent agent of the present invention, a machine uses a general-purpose language as an underlying language for thinking and interaction, a thinking process and result are completely transparent, and thus autonomous decision-making, autonomous learning and continuous evolution are realized under fully controllable conditions. Further disclosed is a method for constructing a general-purpose intelligent agent and a general-purpose language. Compared with the prior art in which a natural language is used, the machine intelligent agent based on the general-purpose language has wide versatility in application.

The invention relates to the technical field of artificial intelligence, in particular to a remote medical inquiry system based on AI recognition, which comprises a voice structure analysis module, a semantic association mapping module, a knowledge graph reasoning module, an inquiry path adjustment module and a disease traceability analysis module. According to the method, the logic relation of a description chain is accurately obtained by performing specific value mapping on the time delay and the semantic frequency of the voice information, the structural perception ability of the semantic information is enhanced, the symptom frequency and the health index trend are combined, accurate measurement is performed on abnormal fluctuation dependency, inquiry priority grading is optimized, and the key symptom recognition sensitivity is improved; through induction of a periodic fluctuation trend, formation of a dynamic evolution sequence, enhancement of the monitoring capability of health risk evolution, improvement of decision precision and optimization of a diagnosis chain, overall processing is performed through time sequence and semantic association analysis, the recognition and intervention capability of a complex health state is enhanced, and the health assessment adaptability and accuracy in multiple rounds of interaction are improved.

The invention provides an artificial intelligence and cognitive behavior combined depression treatment intervention and early warning system, which comprises the steps of collecting patient interaction data, physiological perception data and third-party data through a dynamic on-demand authorization mechanism, and extracting four-dimensional feature indexes of cognition, emotion, behavior and physiology; constructing a first psychological matrix of cognition, emotion, behavior and physiological dimensions, dynamically adjusting dimension weights by adopting a Bayesian network to generate a second psychological matrix, and fusing weighted feature scores, change rates and historical mean values to output psychological health state vectors; generating a basic scheme group based on the state vector matching treatment strategy library; and calculating the unit time fluctuation intensity of the mental health state vector in real time, and triggering three-level early warning in combination with a self-adaptive Z-score safety threshold. According to the method, multi-modal data fusion analysis, dynamic personalized intervention and active risk prevention and control are realized, and the accuracy and safety of depression management are improved.

The invention discloses a force sense feedback control method for an intelligent mechanical arm, which comprises the following steps of: 1, acquiring data through a multi-modal sensor and fusing the data to obtain a multi-dimensional perception vector; 3, calculating a force sense tracking error and a change rate and triggering an event-driven control decision mechanism; 4, designing a nonlinear compensation control rule and outputting a control torque instruction, wherein a control system comprises a multi-mode sensing module, a dynamic prediction module, an event-driven control module and a cooperative calculation module; according to the method, multi-mode sensing information is fused with the lifting force sense representation capacity, advanced adjustment is achieved in combination with a dynamic force sense prediction mechanism, event-driven control is used for reducing calculation redundancy, robustness to complex interference is enhanced through a nonlinear compensation strategy, and finally high-precision and low-delay force sense control of the mechanical arm in a dynamic interaction scene is achieved.

The invention relates to the technical field of medical image classification, in particular to a myopic macular traction lesion grading method and system. The method comprises the following steps: taking a convolutional neural network, a direction perception attention module and a classifier which are connected in sequence as an MTM classification model; a direction perception attention module extracts weight information of a space position through a direction perception space attention module, and a channel attention module is used for extracting weight information of a channel; an MTM classification model is used as a backbone network, direction perception attention modules and auxiliary branches which are connected in sequence are arranged after first M-1 feature coding stages of a convolutional neural network, and a self-distillation model is constructed; by combining a structural knowledge distillation strategy based on multi-stage feature fusion, a historical knowledge distillation strategy based on a linear growth mechanism and a category perception comparison learning strategy, multi-angle feature information interaction is fully utilized, multi-angle information collaborative optimization is realized, and the classification precision of the MTM classification model is effectively improved.

The invention provides an intelligent brain-like decision-making method, system and device with a body, and a storage medium, and relates to the technical field of artificial intelligence, and the method comprises the steps: receiving a task instruction; analyzing the received task instruction based on a pre-trained large language model, outputting a task description semantic vector, and then carrying out multi-modal data acquisition on the environment to obtain multi-modal perception data; task description semantic vectors are supplemented based on the multi-modal perception data, and task description parameters are obtained; converting the task description parameter into a control signal based on a pre-constructed pulse neural network model, wherein the control signal comprises a plurality of pulse frequencies arranged according to the sequence of the action execution time; and executing corresponding actions according to the sequence of the plurality of pulse frequencies. In this way, the multi-modal perception data and the semantic vectors are combined in the large language model to generate the task description parameters to improve the perception precision of the environment, and the task description parameters of the large language model and the pulse sequence of the pulse neural network are combined to improve the decision response efficiency.

The invention relates to the technical field of electric acupuncture apparatuses, and discloses a method and a system for automatically adjusting stimulation parameters of an electric acupuncture apparatus. According to the method, body surface electromyographic signals, skin impedance and capillary hemodynamic parameters of a user are collected in real time through a sensor set, feature extraction and analysis are conducted through a time sequence prediction model of a Transform architecture, and physiological feature data are generated. And then, constructing a user physiological state characterization model by adopting a multi-modal neural perception fusion algorithm, and carrying out collaborative optimization on the electrical stimulation parameters through an adaptive quantum particle swarm optimization algorithm to generate a stimulation parameter combination matched with the real-time neuromuscular response characteristics of the user. The system drives electrical stimulation output according to the parameter combination, monitors physiological data changes in real time, realizes closed-loop dynamic balance of stimulation parameters and biological feedback signals through the dynamic parameter compensation module, and improves the treatment effect and safety.

The invention provides an intelligent interaction system and method based on a multi-stage cognitive mode, and the system comprises a multi-modal data collection module which is used for collecting user interaction data through a multi-modal sensor, and the data comprise language input, non-language behaviors, interface operation data, expressions, eye movement tracks and the like; and the cognitive feature analysis module is used for calling a deep learning model to perform feature extraction on the interaction data. According to the method, language, behavior, interaction, physiology and other data are fused through the multi-modal sensor, the cognitive driving vector is generated by using the deep learning model, the real-time cognitive state of the user is effectively captured, then the probability distribution of the cognitive stage is constructed in combination with Bayesian reasoning, the problems that in the prior art, only the cognitive level can be statically judged, and real-time updating is difficult are solved, and the user experience is improved. The accuracy and timeliness of user state perception are remarkably improved, and dynamic accurate recognition and continuous modeling in the cognitive stage are achieved.

The invention discloses an intelligent perception analysis system for the real-time participation degree and cognitive state of a mathematics classroom. The intelligent perception analysis system comprises a multi-source data acquisition module, a fusion analysis engine module, a real-time feedback module and an offline optimization module. The method has the beneficial effects that a dynamic participation index is innovatively designed, and an attention attenuation resetting mechanism is introduced; the real-time feedback module generates a cognitive thermodynamic diagram of HSL color mapping to position group obstacle points, and triggers self-adaptive question pushing; and the off-line optimization module dynamically updates the edge weight of the knowledge graph through error co-occurrence analysis, and early warns a cognitive confusion relationship without textbook association. According to the method, the limitation of single-mode perception is broken through, the problem solving step quality visual diagnosis and the cross-cycle cognitive impairment prediction are realized, a teaching closed loop of'multi-source perception-hierarchical quantification-real-time intervention-knowledge evolution 'is formed, and the mathematical classroom cognitive state analysis precision and the teaching intervention timeliness are remarkably improved.

The invention discloses an edge end multi-modal perception and decision cooperation method and system, and relates to the edge calculation and artificial intelligence cross technology field, and the system comprises a multi-modal perception unit used for collecting heterogeneous perception data of an environment; the data processing unit is in communication connection with the multi-mode sensing unit; wherein the data processing unit comprises a dynamic cognitive kernel, and the dynamic cognitive kernel sequentially comprises a modal credibility evaluation layer, a context reasoning layer and a decision verification layer; and the modal credibility evaluation layer is configured to receive the heterogeneous sensing data. According to the edge-end multi-modal sensing and decision-making collaboration method and system, by introducing a dynamic cognitive kernel, real-time evaluation and dynamic weight adjustment of the reliability of multi-modal sensing data are achieved, the defect that the collaboration efficiency of a traditional fixed rule system is reduced when the environment changes is effectively overcome, and the collaborative performance of the system is improved. And the adaptability and decision accuracy of the system in a complex scene are improved.

The invention provides a brain organism closed-loop rehabilitation system and a control method thereof, belongs to the field of brain-computer interfaces and rehabilitation medical treatment, and is used for solving the problems of insufficient brain state perception, poor adaptability and low robustness of a brain organism rehabilitation system in related technologies. The method comprises the following steps: synchronously acquiring multi-modal physiological signals by cooperating with physiological signal monitoring, task induction and regulation and control equipment modules, removing artifacts through preprocessing and redundancy check, extracting neuroplasticity characteristics, dynamically adjusting weight decoding brain activity intentions, regulating and controlling stimulation parameters in a closed loop, and training an optimization model in combination with a multi-center federation; accurate and highly-adaptive rehabilitation regulation and control are realized, and the rehabilitation effect and the model generalization are improved.

The invention discloses an accompanying dialogue system and method based on real-time environment perception and knowledge graph enhancement. The system comprises a multi-mode real-time environment perception module, a knowledge graph construction and enhancement module, a natural language understanding and dialogue management module, a personalized recommendation and narration generation module and an immersive multi-mode interaction module. The method comprises the steps of multi-modal real-time environment perception and situation data generation; performing dynamic association, query and enhanced reasoning on the knowledge graph; natural language understanding and dialogue management, personalized recommendation and narrative generation, and immersive multi-modal interaction presentation and feedback reception. According to the method and the system, the concern point of the user, namely scenery or details, can be accurately positioned, and context information required by subsequent service intelligence is provided, so that the problems of poor environment perception ability, weak interaction immersion, dull knowledge service, lack of individuation, insufficient intelligent accompanying experience and the like in the existing tourism auxiliary technology are solved.

The invention belongs to the field of big data and artificial intelligence, and discloses a hydropower station oil and gas pressure system fault prediction method fusing perception data and a knowledge graph, which is characterized by comprising the following steps: collecting and preprocessing multi-modal data; performing feature extraction and cross-modal correlation analysis; constructing and dynamically updating a knowledge graph; fusing the physical mechanism model and the data driving model; constructing a fault mode library and reasoning knowledge; training and optimizing a multi-modal prediction model; and generating a fault early warning and maintenance strategy. The method has the main beneficial technical effects that the accuracy of fault prediction is improved, the fault root cause analysis capability is improved, the comprehensive perception and cognition capability is enhanced, the decision support capability is enhanced, the interpretability and credibility of the model are improved, and a whole-process intelligent operation and maintenance closed loop is realized.

The invention discloses an end-to-end automatic driving method based on hierarchical uncertainty estimation and dynamic safety response, and belongs to the technical field of intelligent driving. The method comprises the steps of environment observation data acquisition and preprocessing, perception information enhancement, adaptive space-time attention fusion and trajectory prediction, hierarchical uncertainty estimation and dynamic safety response, experience pool storage and end-to-end deep learning optimization. By dynamically integrating the multi-modal features of the RGB image and the LiDAR point cloud, a space-time dependency relationship is captured, and high-precision trajectory prediction is realized; meanwhile, layering quantification cognition and random and time sequence uncertainty are carried out, and a five-level safety response strategy is triggered in combination with an environment self-adaptive threshold value; and carrying out reinforcement learning by adopting priority experience playback and a multi-task loss function. According to the method, the limitation of traditional fixed weight fusion is overcome, the prediction accuracy and the system safety are improved, the average displacement error (ADE) can be reduced in a complex traffic scene, the uncertainty calibration degree is improved, and the method is suitable for real-time decision making of an automatic driving vehicle.

The invention relates to the technical field of knowledge maps, in particular to a few-sample knowledge map completion method and system fusing relation perception information bottleneck. The method comprises the following steps: S1, preprocessing an input triple; s2, building a global aggregation module, and updating entity embedding; s3, establishing a relationship aggregation module, and updating relationship embedding; s4, establishing a relationship-based information bottleneck module, filtering noise irrelevant to tasks, and meanwhile, retaining relationship-specific information; s5, building an EM attention pooling module, adaptively aggregating multi-path semantic representation, and highlighting the correlation between the entity and the relationship; and S6, establishing a score calculation module, calculating a triple score and outputting the triple score. The invention provides a few-sample knowledge graph completion method and a few-sample knowledge graph completion system fusing relation perception information bottleneck, which are used for solving the problems of insufficient relation and entity representation coupling, high redundant information interference and difficulty in modeling due to high-order relation dependence in a knowledge graph completion task, and realizing efficient inference of potential relation facts.

The invention relates to an infantile autism classification method based on a double-branch functional topological graph neural network. The infantile autism classification method can realize the classification of the infantile autism by using functional magnetic resonance imaging data. According to the provided autism classification network, long-distance connection and short-distance connection are divided based on the shortest path between brain intervals, then an exponential decay mask is introduced through a functional topological graph Transform branch to adjust attention weight and accurately extract long-distance dependency features, a graph isomorphic network in the other branch is subjected to multiple neighborhood aggregation operations, short-distance dependency features are captured, and the short-distance dependency features are extracted. According to the method, multi-scale dependence of the brain network is extracted in parallel through a double-branch structure, information redundancy is reduced by means of a topology perception attention mechanism, and the adaptive ability of the model to the heterogeneous brain network is improved by using the adaptive fusion module, so that multi-scale dependence of the heterogeneous brain network is balanced in a self-adaptive manner. The classification accuracy is remarkably superior to that of an existing mainstream method, objective and efficient technical support is provided for autism diagnosis, and high interpretability is achieved.

The invention relates to the technical field of robot control, in particular to a cross-modal perceptual driving body robot compliance control system which comprises the steps that a sensor is adopted to synchronously collect environment information, multi-source data bias is eliminated through a space-time alignment algorithm, a radial basis function neural network is adopted to analyze multi-modal fusion features, and a multi-modal model is obtained; human operation intention probability distribution is extracted to decompose a task into a path planning layer and a motion control layer, a collision-free trajectory is generated through an RRT algorithm, a high-fidelity physical engine is adopted to construct a virtual interaction scene, and robot learning results are shared through federal learning. According to the method, the problems of inaccurate perception, incoordination between intention recognition and interaction control, difficulty in control strategy verification, slow new task adaptation and difficulty in multi-robot learning result sharing caused by multi-source data deviation and large multi-modal semantic difference of the body robot in a complex environment are solved.