19004 results about "Human machine interaction" patented technology

The invention relates to the technical field of artificial intelligence, and discloses an anomaly detection emergency processing system and method based on artificial intelligence, and the system comprises a data collection module; a data preprocessing module; an anomaly detection module; an emergency decision module; an emergency execution module; a real-time monitoring and state feedback module; a multi-mode communication and coordination module; a man-machine interaction and visualization module; and a knowledge updating and model iteration module. The method is reasonable in design, the accuracy and timeliness of anomaly detection are remarkably improved through a multi-source heterogeneous data fusion and dynamic threshold adjustment technology, and the model robustness is enhanced in combination with incremental learning and an adversarial training mechanism; the intelligent decision-making module realizes multi-objective optimization processing by relying on a knowledge graph and a digital twinborn pre-judgment risk; redundant fault-tolerant execution and distributed consistency guarantee ensure high reliability of the system, and a man-machine cooperation mechanism considers both automation efficiency and manual intervention accuracy.

The invention relates to a work order material intelligent tracking and dynamic updating system based on multi-source data fusion. The system comprises an acquisition module, a tracking module, an updating module, a man-machine interaction module and a storage module, the acquisition module is used for acquiring work order information from a bill of material, scheduling information and inventory and supplier data, and constructing a material data model; the tracking module monitors material inventory, consumption and material shortage risks based on the model, and realizes automatic state updating and graphical path recording in combination with bar code recognition and ambiguity analysis; the updating module predicts material requirements through a machine learning algorithm, optimizes a distribution plan and outputs a dynamic report; the interaction module supports multi-format data import, unstructured field classification and interrupted operation control; the storage module ensures credible synchronization and tamper-proofing performance of data among different systems through a block chain technology; according to the invention, high-efficiency management and dynamic allocation of work order materials can be realized in an environment without an MES system, and the production transparency and the resource utilization efficiency are improved.

The invention relates to the technical field of multi-modal information processing, and provides a deep semantic collaborative fusion method for heterogeneous multi-modal data. The invention provides a dynamic adaptive fusion framework aiming at the problems that a modal interaction mechanism is rigid and semantic modeling is shallow in the prior art. The method comprises the following steps: carrying out feature coding and alignment on text, audio and video modal data to generate unified-dimension single-modal representation; dynamic interaction is realized through an enhanced multi-head gating fusion module, and double-path features are generated; and carrying out cross-modal depth modeling on the basis of a stacked Transform encoder, and outputting final fusion semantics. Wherein the multi-head attention path calculates cross-modal mapping by taking a text as a query vector and taking an audio / video as a key value vector; the gating path generates a dynamic weight through cosine similarity and a learnable temperature parameter; and the dual-path adaptive fusion adopts a balance factor alpha weighted combination. According to the method, the multi-modal data fusion precision and the system robustness are improved, and the method is suitable for government affair service, man-machine interaction and other scenes.

The invention discloses a multi-field part size and appearance defect intelligent detection system, and relates to the field of image analysis. The system comprises an image acquisition module, an image preprocessing module, a feature extraction module, a defect identification and size measurement module, a data processing and analysis module, an automatic control module and a man-machine interaction module. According to the method, CNN and LBP, Hough transform and SIFT algorithms are fused, high-level semantics and bottom-level texture / geometric features are considered, 2304-dimensional fusion feature vectors are formed through feature splicing, the feature extraction integrity of parts in multiple fields is improved, texture detail features can be accurately extracted, geometric shape features can be accurately obtained, and the method is suitable for large-scale popularization and application. Meanwhile, the adaptive feature selection mechanism dynamically optimizes the feature combination according to the detection result, the problem of calculation redundancy is reduced, and the detection precision is ensured while the detection efficiency is improved.

The invention discloses a cockpit active recommendation system and method based on a knowledge graph and semantic reasoning, and relates to the technical field of intelligent cockpits. The system receives natural language voice input of a user, executes voice recognition and semantic analysis, extracts user intention, keywords and slot entities, generates structured semantic information, constructs or calls a knowledge graph structure with semantic relation edges in combination with environment context information, and obtains the knowledge graph structure with the semantic relation edges. Semantic path reasoning is carried out based on the path dependence weight and the semantic similarity, a semantic edge label guided graph attention mechanism is introduced to calculate a path consistency score, a candidate recommendation set is generated, the semantic fitting degree and the path score are fused to sort and output recommendation content, and the graph edge weight and the user portrait are updated based on user feedback. According to the method, semantic understanding precision, recommendation path interpretability and system adaptive capacity are improved, and the method is suitable for personalized voice recommendation, man-machine interaction and scene linkage control tasks in an intelligent cockpit.

The invention specifically relates to the technical field of big data analysis, and discloses a water conservancy gate multi-parameter cooperative intelligent monitoring system, which comprises a multi-parameter acquisition module, a multi-parameter processing module, a comprehensive analysis module, an intelligent decision module, an operation and maintenance early warning module and a man-machine interaction module, the multi-parameter processing module is used for calculating flood control and discharge indexes, structure safety indexes and equipment health indexes; the comprehensive analysis module is used for judging gate risk levels; the intelligent decision-making module is used for generating an optimal gate scheduling scheme; the operation and maintenance early warning module is used for constructing a multi-level early warning mechanism; according to the method, parameter coverage is comprehensive, a gate digital twinborn model and a gate opening comprehensive evaluation model are constructed, the gate risk level is evaluated, an optimization strategy is dynamically adjusted through an intelligent decision module, the accuracy of gate risk judgment is improved, and the self-adaptive capacity of the system is improved.

The invention discloses a screening and evaluating system and method for cognitive impairment of old people, and belongs to the technical field of intelligent medical treatment. According to the system, electroencephalogram, VR / AR interaction, physiology and gait data are collected through the multi-modal acquisition module, the data processing module carries out data processing, dynamically selects a scale and carries out fusion analysis, the man-machine interaction module realizes natural interaction, and the output module generates a visual report and carries out early warning. The core algorithm comprises dynamic scale selection, multi-modal fusion evaluation and the like. The evaluation method comprises the steps of data acquisition, scale selection, data fusion, confidence verification, output and the like. Compared with a traditional method, the method overcomes the defects that subjectivity is high, and static evaluation, data splitting and base layer application are limited. The cognitive impairment assessment method can accurately and dynamically assess cognitive impairment, improves assessment accuracy, realizes full utilization of data, is simple and convenient to operate, is suitable for various scenes, provides efficient and reliable support for diagnosis, monitoring and intervention of cognitive impairment, and promotes development of intelligent medical treatment.

The invention discloses a distributed intelligent warehouse scheduling system based on artificial intelligence, and belongs to the technical field of warehouse scheduling. Comprising a multi-source environment sensing module, a dynamic inventory management module, a distributed task scheduling module, an intelligent path planning module, a resource dynamic allocation module, an anomaly detection and emergency response module, an energy consumption optimization module, a supply chain collaboration module and a man-machine interaction and visualization module. A warehouse digital twinborn model is constructed, immersive display of a storage state and a scheduling strategy is realized, an AR scene is superposed through a color coding path, a thermodynamic diagram and a particle flow form, a manager can intuitively master inventory distribution, task progress and an abnormal region, eye movement tracking and a gesture recognition technology support an interactive decision, and the workload of the manager is reduced. The AR marking function can mark an abnormal area and synchronize the abnormal area to a decision making system, and through combination of AR and AI, a brand new interaction normal form is provided for intelligence and humanization of warehouse management.

The invention provides a multi-mode-based man-machine interaction method and system, and relates to the technical field of man-machine interaction. Voice input of a user is received, environment information is collected, facial expressions of the user are captured, and voice features, environment features and facial features are obtained based on the input; utilizing a pre-trained emotion recognition model to generate emotion features of the user, and utilizing a pre-trained user behavior model to generate behavior features according to the current operation information of the user; after the features are obtained, the first weights and the second weights of the features are dynamically adjusted, feature weighted fusion is carried out, and comprehensive features are obtained; the multiple candidate responses are generated based on the comprehensive characteristics, the final response is screened out through a preset scoring mechanism and output, comprehensive understanding of the intention and the emotional state of the user is achieved through comprehensive utilization of multiple data sources, and meanwhile the weight of each characteristic can be dynamically adjusted so that more intelligent and humanized interaction experience can be generated.

The invention provides a civil engineering structure apparent damage diagnosis method based on a multi-modal large model. The method comprises the steps of structure apparent damage multi-modal data unified representation and alignment fusion, a structure damage identification reasoning method based on a multi-modal thinking chain, multi-modal data set construction and large model fine adjustment, and civil engineering structure damage identification and feature description. According to the method, vector coding of a structure damage image is completed by using a multi-modal large model, the structure damage image is aligned with text coding features, a damage semantic segmentation map is generated by calling a computer vision model to serve as a visual thinking chain, and a language thinking chain is formed by constructing a fine tuning data set; and reasoning of multi-modal information coding and generation of structural damage diagnosis are completed by the pre-trained large language model. According to the method, a multi-modal large model is used as a base, and a multi-modal thinking chain reasoning method is fused, so that the model can perform man-machine interaction through a natural language, various structural damages are efficiently diagnosed, and the generalization ability and accuracy of the structural damage diagnosis model are improved.

The invention provides a vehicle-mounted display terminal man-machine interface interaction experience optimization method and system, and relates to the technical field of vehicle-mounted man-machine interaction, and the method comprises the steps: obtaining eyeball watching, hand operation and head rotation data of a driver, and carrying out the fusion to generate an attention distribution thermodynamic diagram; constructing a dynamic scene recognition model in combination with the vehicle running state and the environment information; and calculating a function module optimization index based on the thermodynamic diagram and scene prediction, and dynamically adjusting the position, the response area and the display level of the function module. According to the invention, the interaction efficiency of drivers can be improved, the operation distraction risk is reduced, and the driving safety is enhanced.

The invention discloses an intelligent operation and maintenance method and system based on an MCP protocol, and belongs to the crossing field of artificial intelligence and operation and maintenance automation. The system comprises an AI Agent module, a central intelligent analysis engine module, a man-machine interaction module and a safety control module. The method comprises the following steps: collecting system operation data in real time through an AI Agent module, and packaging the system operation data into an MCP protocol format; the central intelligent analysis engine module predicts the load based on an LSTM model, and generates operation and maintenance decision suggestions in combination with log anomaly recognition and reinforcement learning; the man-machine interaction module realizes understanding of user input through a natural language large model, automatically converts the user input into an MCP instruction, and supports multiple rounds of interaction confirmation and instruction verification; the safety control module provides an MCP operation sandbox and semantic instruction verification, and the operation safety is guaranteed. The system can dynamically schedule resources and automatically dispose faults, realizes that non-technical personnel can execute complex operation and maintenance operations, and is suitable for application scenes with high reliability requirements, such as industrial data acquisition and chemical engineering.

The invention discloses a cloud edge collaborative multi-source data fusion safety management and control system for intelligent power distribution equipment, relates to the technical field of intelligent power grids and power distribution automation, and is used for managing and controlling 10-35 kV power distribution equipment. The system comprises an edge data acquisition module, a preprocessing module, a cloud storage management module, a cloud edge collaborative scheduling module, a multi-source data fusion module, an intelligent risk assessment module, a safety control execution module, a safety protection module and a man-machine interaction module. The modules are interacted through a 5G / industrial Ethernet; the acquisition module obtains multiple parameters, the preprocessing module cleans standardized data, the cloud side performs hierarchical storage, the scheduling module allocates tasks, the fusion module integrates data, the evaluation module performs grading risk, the protection module guarantees safety, and the interaction module performs visual alarm. The method improves the power distribution data quality and risk assessment precision, optimizes the cloud edge cooperation efficiency, enhances the safety protection capability, achieves the preventive operation and maintenance of equipment, reduces the fault and power failure time, reduces the operation and maintenance cost, and provides support for the safe and efficient operation of a power distribution network.

The invention relates to the technical field of risk analysis, in particular to a dangerous chemical transportation risk prediction system and method based on big data analysis, and the system comprises a multi-dimensional data acquisition module which is used for collecting human-machine-ring-pipe four-dimensional data in the liquid ammonia water transportation process, and carrying out the standardization processing and time-space synchronization, and obtaining a multi-source heterogeneous data set; the risk level acquisition module is used for constructing a man-machine-ring-management collaborative risk assessment model and analyzing the multi-source heterogeneous data set to obtain a risk assessment result; the human-machine-environment-management collaborative risk assessment model comprises a human-machine interaction key node identification layer, a management behavior-equipment response association analysis layer, an environment-material interaction dynamic risk assessment layer and a multi-dimensional factor risk cascade assessment layer; and the emergency disposal scheme acquisition module constructs an emergency disposal scheme intelligent recommendation model to perform grading and classification analysis on the risk assessment result, generates a multi-level risk early warning and emergency disposal scheme, and optimizes the emergency disposal scheme.

The invention belongs to the technical field of intelligent perception and mode recognition, and particularly relates to a human body behavior recognition method based on millimeter wave radar and multi-task learning. The method comprises the steps that millimeter wave radar point cloud data and RGB video streams are synchronously collected, and a five-dimensional point cloud scene is generated through three-dimensional analysis and dynamic target extraction; a hierarchical Point Transform network is constructed to extract radar space-time features, and human body key point features are generated by using visual auxiliary attitude estimation; radar and key point features are dynamically fused through a cross-modal attention mechanism, a multi-task joint optimization strategy is combined, behavior classification serves as a main task, attitude estimation serves as an auxiliary task, and a behavior recognition result is output. According to the method, through multi-task cooperation and cross-modal feature interaction, on the premise of ensuring privacy security, the accuracy and robustness of human behavior recognition in a complex scene are remarkably improved, and efficient and reliable technical support is provided for the fields of intelligent monitoring, human-computer interaction and the like.

The invention relates to the technical field of medical auxiliary evaluation and human-computer interaction, in particular to a cognitive level evaluation system and method applied to a caregiver of a cerebral infarction patient. Generating task parameter data based on the multi-modal feature data through a task generation module; the cognitive state decoding module decodes a comprehensive cognitive state by using a double-flow deep learning network to generate a cognitive load, an attention trend and a task response score; the feedback optimization module predicts the change trend of the cognitive ability in combination with a dynamic Bayesian network, and dynamically adjusts task parameters through a closed-loop feedback mechanism; according to the method, the dynamic adaptation of the evaluation task and the design of the intervention task are realized, and the accuracy, interestingness and applicability of evaluation are effectively improved.

The embodiment of the invention discloses a multi-mode adaptive industrial instrument intelligent control system based on deep learning, and relates to the technical field of industrial instrument intelligent systems. The system comprises a multi-modal data acquisition module used for acquiring multi-modal data of an industrial instrument in real time, the multi-modal data comprising at least two of image, sound, temperature and vibration data; the heterogeneous data fusion module is used for carrying out space-time alignment and feature fusion on the multi-modal data; the deep reinforcement learning control module is used for dynamically optimizing a control strategy and generating a control instruction; the self-adaptive human-computer interaction interface is used for providing visual operation and real-time feedback; and the predictive maintenance subsystem is used for predicting faults and generating maintenance suggestions based on the equipment state. The multi-modal data fusion technology of dynamic weight distribution is adopted, the problem that a traditional single sensor loses efficacy under the complex working condition is solved, and the performance of an industrial instrument in the aspects of measurement precision, self-adaptability and operation and maintenance efficiency is improved.

The invention provides a traffic comprehensive query optimization method and system applied to intelligent human-computer interaction, and the method comprises the steps: obtaining a traffic query request input by a target user in an interaction scene, carrying out the multi-modal feature analysis of the traffic query request, generating a semantic understanding feature and a scene correlation feature, and obtaining a semantic understanding feature and a scene correlation feature based on a preset language large model; performing dynamic interaction feature fusion processing on the semantic understanding feature and the scene association feature to generate a multi-dimensional intention feature, and performing service path optimization on the traffic query request of the target user according to the multi-dimensional intention feature to generate a comprehensive response strategy; and converting the comprehensive response strategy into interactive feedback information, dynamically adapting to equipment parameters in the real-time environment association information, and executing feedback operation to complete optimized response of the traffic query request. According to the invention, the response real-time performance, decision reasonability and execution reliability of the intelligent traffic query service can be improved.

The invention relates to a man-machine hybrid autonomous navigation system in an unknown dynamic environment, which comprises an environment sensing module for acquiring environment information by using sensors such as a laser radar, a camera and an inertial measurement unit and performing data preprocessing; the local target point selection module selects a local target point set meeting requirements in the environment according to the real-time information provided by the environment sensing module; the decision planning module is used for generating an optimal path and a navigation strategy based on mixed training of a deep reinforcement learning algorithm and artificial experience; and the learning optimization module improves the generalization ability of the algorithm through online learning and transfer learning technologies, and realizes effective introduction and strategy adjustment of human experience in combination with the man-machine interaction module. The man-machine interaction module can work in cooperation with the local target point selection module so as to dynamically adjust target point selection according to external input and optimize path planning. According to the method, high decision stability can be kept in an unseen environment, the training cost is reduced, and the method is more suitable for autonomous navigation application in the real world.

The invention discloses a project-level visualization display method and system for highway multi-source data fusion, and the method comprises the following steps: 1, constructing a multi-source heterogeneous data exchange and integration frame, and carrying out the seamless connection and mapping of a BIM model, GIS space geographic information and an oblique photography three-dimensional point cloud model; 2, formulating a standardized interface specification, and performing specification processing on data from different sources through a data analysis and conversion engine; 3, dynamically and synchronously updating the multi-source engineering data and the project progress in real time; 4, gathering engineering data to construct a digital twinborn model of the expressway project to realize centralized management, multi-dimensional analysis and dynamic presentation in a visual scene; 5, carding and extracting management business logic to construct a flexibly expanded professional application module so as to realize intelligent analysis of the engineering project; and step 6, performing visual immersive display on the multi-source data fusion project by adopting visual man-machine interaction. According to the invention, visual comprehensive management and traceability of each element of the project are realized.

The invention provides a multi-construction-method collaborative dust fall intelligent control method based on deep learning. The method comprises the following steps: collecting mine field data of a mine field in real time; wherein the mine field data comprises mine field environment data, equipment operation data and topographic data; constructing a digital mine field model based on the mine field data; wherein the digital mine field model comprises a terrain model, an equipment model and a dust generation and diffusion model; based on the mine field data and the digital mine field model, constructing a reinforcement learning agent; based on the reinforcement learning agent, performing dust fall control on the mine field; the dust fall control is monitored on the basis of the pre-created human-computer interaction interface, intelligent and efficient control over the mine field dust fall process is achieved, the dust fall effect and the resource utilization efficiency are improved, and meanwhile the flexibility and reliability of the system are improved through human-computer cooperative control.

The invention discloses a digital production plan scheduling method and system, and belongs to the technical field of optimal scheduling, and the method comprises the steps: constructing a distributed storage architecture based on edge computing nodes; a central coordinator is adopted to realize cross-node data synchronization through an improved Raft consensus algorithm, multi-version concurrency control is realized based on a vector clock, and a global consistent data view is established; a visual scheduling platform is built based on a Vue3 framework, and man-machine interaction is realized by adopting a Canvas and WebGL collaborative rendering framework; establishing a dynamic coordinate conversion model based on bilinear interpolation, designing a space mapping function containing distortion compensation, establishing a multi-thread coordinate service based on WebWorker, and realizing submillimeter-level bidirectional mapping of pixel coordinates and physical coordinates; constructing a three-dimensional space-time analysis model fused with the multi-dimensional features; and all the units are subjected to feature fusion through residual connection, and finally a scheduling scheme with a confidence coefficient weight is output. The method and the device have the effect of meeting various scheduling requirements.

The invention discloses an intelligent cabin interaction method and system combined with digital twinning, and relates to the technical field of man-machine interaction, and the method comprises the steps: collecting the multi-dimensional perception data of a cabin, and constructing a layered cabin digital twinning model; performing scene analysis on the cockpit digital twin model, extracting driver state features, predicting driver potential interaction demands, generating a multi-modal interaction strategy set in combination with the driver potential interaction demands and a current driving scene, and performing simulation evaluation on the multi-modal interaction strategy set to obtain an interaction evaluation index set; performing multi-objective decision optimization under the driving safety constraint based on the interaction evaluation index set, and determining and adaptively executing an optimal interaction strategy; and acquiring actual execution data and driver feedback data of the optimal interaction strategy, and incrementally updating the hierarchical cabin digital twin model. According to the invention, the interaction adaptability and the safety reliability of the intelligent cabin system in a complex driving scene are obviously improved, and an effective technical support is provided for realizing intelligent man-machine cooperative driving.

The invention relates to a tower crane operation control system based on complex scene three-dimensional real-time modeling. According to the system, a lifting hook is coarsely positioned through a lifting hook positioning and state sensing unit, a real-time position is positioned by combining a laser radar point cloud clustering algorithm with historical pose data, and visual tracking is synchronously performed by means of a tower top camera AI; converting the real-time point cloud data into a 3D voxel grid map, generating a global path by using a 3DA algorithm, and outputting a hoisting track after smooth processing and track optimization; establishing a sling-lifting hook double-pendulum dynamic model, predicting a state sequence based on a model prediction control algorithm, and adjusting a control signal through a feedforward compensation item and a feedback correction item; and the man-machine interaction and monitoring unit is used for displaying the cantilever angle, the lifting hook height and the three-dimensional map of the tower crane in real time and remotely intervening the operation state of the tower crane. According to the system, multi-source data are fused to construct a high-precision three-dimensional map, lifting hook positioning and full-view tracking are achieved, and lifting safety and trajectory tracking precision are improved through path planning and dynamics control.

The invention relates to the technical field of computer vision and human-computer interaction, and discloses an AI digital human intelligent interaction method, system and equipment based on multiple modalities, and the method comprises the steps: pre-awakening a digital human when a human face is detected, and further thoroughly awakening the digital human based on recognized preset voice information or preset gesture information; voice and video information of a user in the interaction process is obtained, a keyword extraction result, a gesture recognition result and an emotional state tag are generated, a pre-constructed knowledge base is utilized to retrieve related information, a big language generation model module is combined to generate an answer text, and the answer text is input into a preset voice synthesis model to generate emotional voice output. And based on the current emotional state label of the user, driving the digital human animation to be output in an emotional manner. According to the method and the system, the digital human for understanding the emotion of the user, generating personalized answers, providing voices with rich emotions and displaying natural expressions and actions can be created, better interaction with the user can be realized, and more humanized and effective services can be provided.

The invention discloses a vehicle-mounted streaming language dialogue interaction system and method based on a large language model, and the system comprises the large language model disposed at a vehicle-mounted end, and the large language model is used for carrying out the local processing and cloud processing of information inputted by a user, so as to obtain a processing result. Wherein the large language model is connected with the edge calculation and privacy protection module, the edge calculation and privacy protection module is used for carrying out edge calculation on a processing task in local equipment and distributing a data processing reasoning process to local and cloud service for processing, and the proportion of a local processing part is larger than that of the cloud service. The advantages of the LLMs are fully utilized, the special requirements of the vehicle-mounted environment can be met, and the method has important significance for improving the intelligent level of vehicle-mounted man-machine interaction and the user experience.

The invention discloses a language learning assistance application system based on speech recognition, and belongs to the technical field of learning assistance. The system comprises an intelligent voice acquisition and enhancement module for realizing acquisition and preprocessing of high-quality voice signals in a complex environment; the multi-modal feature extraction module dynamically extracts and fuses multi-dimensional learning feature information, completes feature analysis and boundary segmentation of a phoneme level, and is responsible for feature normalization and optimization; the deep speech recognition module is used for realizing high-precision speech recognition based on the normalized features; the intelligent evaluation engine module is used for realizing real-time and multi-dimensional evaluation on the language performance of the learner; the personalized learning management module integrates the evaluation results for dynamically planning an optimal learning path for the learner, manages the learning progress, and provides learning effect prediction and intervention suggestions at the same time; and the learning interaction experience module is responsible for visual presentation of learning feedback, multi-modal man-machine interaction design and user interface optimization.

The invention discloses a mechanical arm natural language instruction control system and method based on a large language model, and belongs to the field of intelligent manufacturing. Aiming at the limitation that traditional mechanical arm control depends on pre-programming and a static rule library, a dynamic mapping mode from a natural language instruction to an atomic action sequence is designed, an atomic skill library including detection, grabbing, moving, placement and other operations is constructed, and semantic analysis and a multi-mode cooperation technology are combined, so that the atomic action sequence is obtained. And support is provided for man-machine cooperation of a flexible assembly task. The method specifically comprises the steps that a DeepSeek-Distil-Llam-8B large model and a LoRA fine tuning technology are adopted, and a natural language instruction is converted into an executable atomic action sequence; based on a transfer learning optimized YOLOv8 target detection technology and a binocular vision positioning technology, a sensing module adaptive to an assembly scene is constructed and is fused with a mechanical arm motion planning module, and positioning grabbing of parts and tools is achieved. And an interactive interface is built by combining a voice-to-text large model and a Gradio front-end framework, so that the convenience of man-machine interaction is improved. By optimizing large model reasoning and motion planning cooperation efficiency, response delay from instructions to execution is reduced, and an efficient and extensible solution is provided for man-machine cooperation in intelligent manufacturing.

The invention relates to the field of artificial intelligence, particularly discloses an intelligent optimal management system for urban traffic congestion based on artificial intelligence, and aims to solve the problems of congestion and low efficiency caused by response delay, local optimization and low data utilization rate of an existing traffic management system. The system comprises a data acquisition and fusion module, a traffic state perception and prediction module, a decision optimization module, an instruction issuing and execution module and a man-machine interaction and visualization module. Through multi-source data fusion, graph neural network prediction and multi-agent reinforcement learning, traffic flow real-time perception, accurate prediction and adaptive control are realized, congestion is effectively relieved, and the overall operation efficiency and toughness of a road network are improved.

The invention relates to the technical field of man-machine interaction, in particular to a mixed interaction system based on an AI large model, which comprises a multi-modal question acquisition module, a preprocessing and classification module, a retrieval and analysis module, a mixed processing module, a result integration and output module, an interaction module and an answer display module, the problem preprocessing and classification module performs text cleaning, semantic analysis and classification, and the hybrid processing module distributes tasks to natural language processing or AI large models according to a data complexity threshold value, so that the problem processing flow is optimized, the system performance is improved, and the system performance is improved. According to the system, model parameters are optimized based on a machine learning classification algorithm and transfer learning training, classification accuracy is ensured, the system adapts to problem changes, through cooperation of all the modules, the existing technical problems are effectively solved, the man-machine interaction efficiency and quality are improved, the system has wide application prospects in multiple fields, and the man-machine interaction technology is promoted to be developed to be intelligent and efficient.