24226 results about "Human machine interaction" patented technology

The invention relates to the technical field of artificial intelligence, and discloses an anomaly detection emergency processing system and method based on artificial intelligence, and the system comprises a data collection module; a data preprocessing module; an anomaly detection module; an emergency decision module; an emergency execution module; a real-time monitoring and state feedback module; a multi-mode communication and coordination module; a man-machine interaction and visualization module; and a knowledge updating and model iteration module. The method is reasonable in design, the accuracy and timeliness of anomaly detection are remarkably improved through a multi-source heterogeneous data fusion and dynamic threshold adjustment technology, and the model robustness is enhanced in combination with incremental learning and an adversarial training mechanism; the intelligent decision-making module realizes multi-objective optimization processing by relying on a knowledge graph and a digital twinborn pre-judgment risk; redundant fault-tolerant execution and distributed consistency guarantee ensure high reliability of the system, and a man-machine cooperation mechanism considers both automation efficiency and manual intervention accuracy.

The invention discloses a visual inspection system for appearance defects of a pressure sensor, and relates to the technical field of visual inspection of defects. Comprising a light source control module, an image acquisition module, an image preprocessing module, a feature extraction module, a defect identification module, an evaluation grading module, a result display module and a man-machine interaction module which are integrated on the appearance defect AOI equipment, and all the modules are connected through electric signals. According to the visual inspection system for the appearance defects of the pressure sensor, through the high-precision industrial camera and the advanced image processing technology, precise recognition of tiny defects on the surface of a product is achieved, compared with a traditional manual inspection mode, higher inspection precision is achieved, tiny scratches and sunken defects which are difficult to perceive by human eyes can be found, and meanwhile, the visual inspection system is convenient to use. The automatic detection process greatly shortens the detection time and improves the production efficiency, and the system can detect a large number of products in a short time.

The invention, which relates to the technical field of the industrial internet, discloses an intelligent equipment data interaction system based on the industrial internet, comprising an industrial internet platform. The industrial internet platform is in communication connection with a data acquisition and preprocessing module, an edge calculation module, a data transmission module, an anomaly analysis module, an intelligent decision module, a feedback control module and a man-machine interaction module, and all the modules are in electric signal connection. According to the intelligent equipment data interaction system based on the industrial internet, the production efficiency is remarkably improved by monitoring and optimizing the production process in real time, data are collected through a sensor and an equipment state monitor, and abnormal states in the production process are quickly recognized and responded through preprocessing and analysis of an edge calculation module; and the intelligent decision-making module generates an optimization control scheme according to an analysis result and feeds back the implementation scheme of the control module, so that the risks of equipment failure and production interruption are reduced.

The invention provides a vehicle-mounted display control method and system based on man-machine interaction, and relates to the technical field of display control, and the method comprises the steps: collecting a face image of a driver through a vehicle-mounted camera, extracting eyeball movement features, and calculating the coordinates of a real-time fixation point; matching the fixation point coordinate with a preset interaction area, and triggering an activation state; generating interactive display content according to the activated state, and calculating a dynamic projection position; detecting a moving track of the fixation point in the activation area, and identifying an interaction gesture to trigger a control instruction; and updating a display interface according to the control instruction and sending a feedback prompt tone. According to the method, the interaction efficiency and safety of the vehicle-mounted display system are improved.

The invention relates to a work order material intelligent tracking and dynamic updating system based on multi-source data fusion. The system comprises an acquisition module, a tracking module, an updating module, a man-machine interaction module and a storage module, the acquisition module is used for acquiring work order information from a bill of material, scheduling information and inventory and supplier data, and constructing a material data model; the tracking module monitors material inventory, consumption and material shortage risks based on the model, and realizes automatic state updating and graphical path recording in combination with bar code recognition and ambiguity analysis; the updating module predicts material requirements through a machine learning algorithm, optimizes a distribution plan and outputs a dynamic report; the interaction module supports multi-format data import, unstructured field classification and interrupted operation control; the storage module ensures credible synchronization and tamper-proofing performance of data among different systems through a block chain technology; according to the invention, high-efficiency management and dynamic allocation of work order materials can be realized in an environment without an MES system, and the production transparency and the resource utilization efficiency are improved.

The invention relates to the technical field of multi-modal information processing, and provides a deep semantic collaborative fusion method for heterogeneous multi-modal data. The invention provides a dynamic adaptive fusion framework aiming at the problems that a modal interaction mechanism is rigid and semantic modeling is shallow in the prior art. The method comprises the following steps: carrying out feature coding and alignment on text, audio and video modal data to generate unified-dimension single-modal representation; dynamic interaction is realized through an enhanced multi-head gating fusion module, and double-path features are generated; and carrying out cross-modal depth modeling on the basis of a stacked Transform encoder, and outputting final fusion semantics. Wherein the multi-head attention path calculates cross-modal mapping by taking a text as a query vector and taking an audio / video as a key value vector; the gating path generates a dynamic weight through cosine similarity and a learnable temperature parameter; and the dual-path adaptive fusion adopts a balance factor alpha weighted combination. According to the method, the multi-modal data fusion precision and the system robustness are improved, and the method is suitable for government affair service, man-machine interaction and other scenes.

The invention discloses a multi-field part size and appearance defect intelligent detection system, and relates to the field of image analysis. The system comprises an image acquisition module, an image preprocessing module, a feature extraction module, a defect identification and size measurement module, a data processing and analysis module, an automatic control module and a man-machine interaction module. According to the method, CNN and LBP, Hough transform and SIFT algorithms are fused, high-level semantics and bottom-level texture / geometric features are considered, 2304-dimensional fusion feature vectors are formed through feature splicing, the feature extraction integrity of parts in multiple fields is improved, texture detail features can be accurately extracted, geometric shape features can be accurately obtained, and the method is suitable for large-scale popularization and application. Meanwhile, the adaptive feature selection mechanism dynamically optimizes the feature combination according to the detection result, the problem of calculation redundancy is reduced, and the detection precision is ensured while the detection efficiency is improved.

The invention discloses a cockpit active recommendation system and method based on a knowledge graph and semantic reasoning, and relates to the technical field of intelligent cockpits. The system receives natural language voice input of a user, executes voice recognition and semantic analysis, extracts user intention, keywords and slot entities, generates structured semantic information, constructs or calls a knowledge graph structure with semantic relation edges in combination with environment context information, and obtains the knowledge graph structure with the semantic relation edges. Semantic path reasoning is carried out based on the path dependence weight and the semantic similarity, a semantic edge label guided graph attention mechanism is introduced to calculate a path consistency score, a candidate recommendation set is generated, the semantic fitting degree and the path score are fused to sort and output recommendation content, and the graph edge weight and the user portrait are updated based on user feedback. According to the method, semantic understanding precision, recommendation path interpretability and system adaptive capacity are improved, and the method is suitable for personalized voice recommendation, man-machine interaction and scene linkage control tasks in an intelligent cockpit.

The invention relates to the technical field of virtual simulation and human-computer interaction, in particular to a semantic association modeling and self-adaptive simulation method based on multilayer correction, which comprises the following steps of: acquiring characteristic data from a three-dimensional simulation model and an electrical schematic diagram, and generating situation dynamic model data through data cleaning and standardization processing; constructing a semantic incidence matrix based on the situation dynamic model data, generating a geometric layer model, a logic layer model and a cross-domain layer model, and generating dynamic state and logic state data through distributed cellular automaton simulation; and in combination with simulation data, optimizing a semantic incidence matrix and a dynamic modeling rule by utilizing a causal path inference algorithm and a multi-layer correction mechanism, and realizing state linkage and user interaction feedback of the three-dimensional simulation model and the electrical schematic diagram. The state synchronization accuracy and interaction efficiency of the complex system are remarkably improved, and the method is suitable for the fields of industrial design, simulation verification and teaching training.

The invention specifically relates to the technical field of big data analysis, and discloses a water conservancy gate multi-parameter cooperative intelligent monitoring system, which comprises a multi-parameter acquisition module, a multi-parameter processing module, a comprehensive analysis module, an intelligent decision module, an operation and maintenance early warning module and a man-machine interaction module, the multi-parameter processing module is used for calculating flood control and discharge indexes, structure safety indexes and equipment health indexes; the comprehensive analysis module is used for judging gate risk levels; the intelligent decision-making module is used for generating an optimal gate scheduling scheme; the operation and maintenance early warning module is used for constructing a multi-level early warning mechanism; according to the method, parameter coverage is comprehensive, a gate digital twinborn model and a gate opening comprehensive evaluation model are constructed, the gate risk level is evaluated, an optimization strategy is dynamically adjusted through an intelligent decision module, the accuracy of gate risk judgment is improved, and the self-adaptive capacity of the system is improved.

The invention provides a vehicle-mounted display personalized regulation and control method and system based on deep learning, and relates to the technical field of vehicle-mounted display regulation and control, and the method comprises the steps: obtaining multi-dimensional data of a driver state, and adaptively determining personalized configuration parameters of a vehicle-mounted display interface; acquiring historical preference data of the driver from the cloud knowledge base, generating a vehicle-mounted display optimization strategy based on the driving scene and driver preference, and generating a personalized vehicle-mounted display interface according to the vehicle-mounted display optimization strategy; obtaining visual behaviors and man-machine interaction behaviors of a driver, performing continuous optimization on the state detection model and the personalized display rule by using a self-adaptive optimization algorithm according to subjective and objective feedback data of the personalized vehicle-mounted display interface, taking the subjective and objective feedback data of the driver as reward and punishment signals in the self-adaptive optimization algorithm, and outputting the reward and punishment signals to the personalized vehicle-mounted display interface. Weight parameters of the state detection model and personalized rules of the display template library are updated, and self-adaptive evolution of the vehicle-mounted display system is achieved.

The invention discloses a screening and evaluating system and method for cognitive impairment of old people, and belongs to the technical field of intelligent medical treatment. According to the system, electroencephalogram, VR / AR interaction, physiology and gait data are collected through the multi-modal acquisition module, the data processing module carries out data processing, dynamically selects a scale and carries out fusion analysis, the man-machine interaction module realizes natural interaction, and the output module generates a visual report and carries out early warning. The core algorithm comprises dynamic scale selection, multi-modal fusion evaluation and the like. The evaluation method comprises the steps of data acquisition, scale selection, data fusion, confidence verification, output and the like. Compared with a traditional method, the method overcomes the defects that subjectivity is high, and static evaluation, data splitting and base layer application are limited. The cognitive impairment assessment method can accurately and dynamically assess cognitive impairment, improves assessment accuracy, realizes full utilization of data, is simple and convenient to operate, is suitable for various scenes, provides efficient and reliable support for diagnosis, monitoring and intervention of cognitive impairment, and promotes development of intelligent medical treatment.

The invention discloses a distributed intelligent warehouse scheduling system based on artificial intelligence, and belongs to the technical field of warehouse scheduling. Comprising a multi-source environment sensing module, a dynamic inventory management module, a distributed task scheduling module, an intelligent path planning module, a resource dynamic allocation module, an anomaly detection and emergency response module, an energy consumption optimization module, a supply chain collaboration module and a man-machine interaction and visualization module. A warehouse digital twinborn model is constructed, immersive display of a storage state and a scheduling strategy is realized, an AR scene is superposed through a color coding path, a thermodynamic diagram and a particle flow form, a manager can intuitively master inventory distribution, task progress and an abnormal region, eye movement tracking and a gesture recognition technology support an interactive decision, and the workload of the manager is reduced. The AR marking function can mark an abnormal area and synchronize the abnormal area to a decision making system, and through combination of AR and AI, a brand new interaction normal form is provided for intelligence and humanization of warehouse management.

The invention provides a multi-mode-based man-machine interaction method and system, and relates to the technical field of man-machine interaction. Voice input of a user is received, environment information is collected, facial expressions of the user are captured, and voice features, environment features and facial features are obtained based on the input; utilizing a pre-trained emotion recognition model to generate emotion features of the user, and utilizing a pre-trained user behavior model to generate behavior features according to the current operation information of the user; after the features are obtained, the first weights and the second weights of the features are dynamically adjusted, feature weighted fusion is carried out, and comprehensive features are obtained; the multiple candidate responses are generated based on the comprehensive characteristics, the final response is screened out through a preset scoring mechanism and output, comprehensive understanding of the intention and the emotional state of the user is achieved through comprehensive utilization of multiple data sources, and meanwhile the weight of each characteristic can be dynamically adjusted so that more intelligent and humanized interaction experience can be generated.

The invention provides a civil engineering structure apparent damage diagnosis method based on a multi-modal large model. The method comprises the steps of structure apparent damage multi-modal data unified representation and alignment fusion, a structure damage identification reasoning method based on a multi-modal thinking chain, multi-modal data set construction and large model fine adjustment, and civil engineering structure damage identification and feature description. According to the method, vector coding of a structure damage image is completed by using a multi-modal large model, the structure damage image is aligned with text coding features, a damage semantic segmentation map is generated by calling a computer vision model to serve as a visual thinking chain, and a language thinking chain is formed by constructing a fine tuning data set; and reasoning of multi-modal information coding and generation of structural damage diagnosis are completed by the pre-trained large language model. According to the method, a multi-modal large model is used as a base, and a multi-modal thinking chain reasoning method is fused, so that the model can perform man-machine interaction through a natural language, various structural damages are efficiently diagnosed, and the generalization ability and accuracy of the structural damage diagnosis model are improved.

The invention provides a vehicle-mounted display terminal man-machine interface interaction experience optimization method and system, and relates to the technical field of vehicle-mounted man-machine interaction, and the method comprises the steps: obtaining eyeball watching, hand operation and head rotation data of a driver, and carrying out the fusion to generate an attention distribution thermodynamic diagram; constructing a dynamic scene recognition model in combination with the vehicle running state and the environment information; and calculating a function module optimization index based on the thermodynamic diagram and scene prediction, and dynamically adjusting the position, the response area and the display level of the function module. According to the invention, the interaction efficiency of drivers can be improved, the operation distraction risk is reduced, and the driving safety is enhanced.

The invention provides a distributed AGV system traffic control and scheduling method realized based on ROS2, and the method comprises the steps: building AGV vehicle nodes, building a traffic control module, developing a scheduling module, building a communication network, integrating a sensor data processing module, providing a central control board / man-machine interaction interface, and building a database / log module. According to the method, efficient data interaction and collaborative operation between AGVs are realized by using a distributed communication framework of ROS2, and by constructing a traffic control module and an optimized scheduling algorithm, the position and state of each AGV can be monitored in real time, the running path of each AGV can be dynamically adjusted, and traffic congestion and collision events are avoided. Compared with a traditional centralized control system, the system has the advantages that the expandability and fault-tolerant capability of the system are improved, the system is suitable for a complex and changeable industrial logistics environment, and the efficiency and reliability of logistics transportation are remarkably improved.

The invention discloses an intelligent operation and maintenance method and system based on an MCP protocol, and belongs to the crossing field of artificial intelligence and operation and maintenance automation. The system comprises an AI Agent module, a central intelligent analysis engine module, a man-machine interaction module and a safety control module. The method comprises the following steps: collecting system operation data in real time through an AI Agent module, and packaging the system operation data into an MCP protocol format; the central intelligent analysis engine module predicts the load based on an LSTM model, and generates operation and maintenance decision suggestions in combination with log anomaly recognition and reinforcement learning; the man-machine interaction module realizes understanding of user input through a natural language large model, automatically converts the user input into an MCP instruction, and supports multiple rounds of interaction confirmation and instruction verification; the safety control module provides an MCP operation sandbox and semantic instruction verification, and the operation safety is guaranteed. The system can dynamically schedule resources and automatically dispose faults, realizes that non-technical personnel can execute complex operation and maintenance operations, and is suitable for application scenes with high reliability requirements, such as industrial data acquisition and chemical engineering.

The invention discloses a cloud edge collaborative multi-source data fusion safety management and control system for intelligent power distribution equipment, relates to the technical field of intelligent power grids and power distribution automation, and is used for managing and controlling 10-35 kV power distribution equipment. The system comprises an edge data acquisition module, a preprocessing module, a cloud storage management module, a cloud edge collaborative scheduling module, a multi-source data fusion module, an intelligent risk assessment module, a safety control execution module, a safety protection module and a man-machine interaction module. The modules are interacted through a 5G / industrial Ethernet; the acquisition module obtains multiple parameters, the preprocessing module cleans standardized data, the cloud side performs hierarchical storage, the scheduling module allocates tasks, the fusion module integrates data, the evaluation module performs grading risk, the protection module guarantees safety, and the interaction module performs visual alarm. The method improves the power distribution data quality and risk assessment precision, optimizes the cloud edge cooperation efficiency, enhances the safety protection capability, achieves the preventive operation and maintenance of equipment, reduces the fault and power failure time, reduces the operation and maintenance cost, and provides support for the safe and efficient operation of a power distribution network.

Disclosed in the present invention is a person concentration recognition and evaluation system based on machine vision. The technical method belongs to the field of computer vision and human-machine interaction in the field of artificial intelligence. During an assembly activity, the states of listeners and audiences are important links for feeding back the assembly effect, but there is no accurate scoring standard, and therefore the links are referred to as fuzzy links. Taking a party, a speech or a conference as an example, the evaluation system designed herein innovatively performs listener (audience) behavior discrimination across four dimensions, which are respectively expression screening, concentration recognition, facial distance monitoring and facial position monitoring; fuzzy evaluation can be better performed on the real-time states of the listeners (audiences) by means of a fuzzy algorithm; a particle swarm fuzzy algorithm scheme is provided to enable the state discrimination to break through the polarization limitation; and a membership function is set to define a fuzzy area, the degree of behaviors of the minority being different from behaviors of the majority is discriminated, and boxes of different colors are provided for marking.

The invention relates to the technical field of risk analysis, in particular to a dangerous chemical transportation risk prediction system and method based on big data analysis, and the system comprises a multi-dimensional data acquisition module which is used for collecting human-machine-ring-pipe four-dimensional data in the liquid ammonia water transportation process, and carrying out the standardization processing and time-space synchronization, and obtaining a multi-source heterogeneous data set; the risk level acquisition module is used for constructing a man-machine-ring-management collaborative risk assessment model and analyzing the multi-source heterogeneous data set to obtain a risk assessment result; the human-machine-environment-management collaborative risk assessment model comprises a human-machine interaction key node identification layer, a management behavior-equipment response association analysis layer, an environment-material interaction dynamic risk assessment layer and a multi-dimensional factor risk cascade assessment layer; and the emergency disposal scheme acquisition module constructs an emergency disposal scheme intelligent recommendation model to perform grading and classification analysis on the risk assessment result, generates a multi-level risk early warning and emergency disposal scheme, and optimizes the emergency disposal scheme.

The invention provides a large language model intelligent interaction method and system with memory management capability in the technical field of artificial intelligence. The method comprises the following steps: S1, creating a work memory module, a long-term memory module, a memory fusion module and an intelligent interaction module; s2, acquiring external knowledge and integrating the external knowledge into a long-term memory module; s3, the intelligent interaction module obtains an intention sequence based on a user query statement and sends the intention sequence to a work memory module; s4, the memory fusion module retrieves context information from the long-term memory module based on the user query statement and sends the context information to the working memory module; s5, the work memory module constructs a work memory sending intelligent interaction module based on the intention sequence, the context information and the system instruction; s6, the intelligent interaction module outputs a query result based on the working memory; s7, a memory fusion module extracts semantic memory and plot memory from user query statements and query results and stores the semantic memory and plot memory in a long-term memory module. The method has the advantage that the man-machine interaction performance is greatly improved.

The invention belongs to the technical field of intelligent perception and mode recognition, and particularly relates to a human body behavior recognition method based on millimeter wave radar and multi-task learning. The method comprises the steps that millimeter wave radar point cloud data and RGB video streams are synchronously collected, and a five-dimensional point cloud scene is generated through three-dimensional analysis and dynamic target extraction; a hierarchical Point Transform network is constructed to extract radar space-time features, and human body key point features are generated by using visual auxiliary attitude estimation; radar and key point features are dynamically fused through a cross-modal attention mechanism, a multi-task joint optimization strategy is combined, behavior classification serves as a main task, attitude estimation serves as an auxiliary task, and a behavior recognition result is output. According to the method, through multi-task cooperation and cross-modal feature interaction, on the premise of ensuring privacy security, the accuracy and robustness of human behavior recognition in a complex scene are remarkably improved, and efficient and reliable technical support is provided for the fields of intelligent monitoring, human-computer interaction and the like.

The invention provides a question and answer method based on a large model, and relates to the technical field of artificial intelligence, in particular to the technical fields of natural language processing technologies, deep learning, large language models, human-computer interaction and the like. The method comprises the steps of obtaining question information, reference information corresponding to the question information and prompt information; by calling a large model, processing the question information and the reference information according to the prompt information and a multi-task processing mode of answer generation and answer evaluation, and obtaining target answer information of the question information; and outputting the target answer information. The invention further provides a training method and device based on the large model, equipment, a medium and a product.

The invention relates to the technical field of medical auxiliary evaluation and human-computer interaction, in particular to a cognitive level evaluation system and method applied to a caregiver of a cerebral infarction patient. Generating task parameter data based on the multi-modal feature data through a task generation module; the cognitive state decoding module decodes a comprehensive cognitive state by using a double-flow deep learning network to generate a cognitive load, an attention trend and a task response score; the feedback optimization module predicts the change trend of the cognitive ability in combination with a dynamic Bayesian network, and dynamically adjusts task parameters through a closed-loop feedback mechanism; according to the method, the dynamic adaptation of the evaluation task and the design of the intervention task are realized, and the accuracy, interestingness and applicability of evaluation are effectively improved.

The embodiment of the invention discloses a multi-mode adaptive industrial instrument intelligent control system based on deep learning, and relates to the technical field of industrial instrument intelligent systems. The system comprises a multi-modal data acquisition module used for acquiring multi-modal data of an industrial instrument in real time, the multi-modal data comprising at least two of image, sound, temperature and vibration data; the heterogeneous data fusion module is used for carrying out space-time alignment and feature fusion on the multi-modal data; the deep reinforcement learning control module is used for dynamically optimizing a control strategy and generating a control instruction; the self-adaptive human-computer interaction interface is used for providing visual operation and real-time feedback; and the predictive maintenance subsystem is used for predicting faults and generating maintenance suggestions based on the equipment state. The multi-modal data fusion technology of dynamic weight distribution is adopted, the problem that a traditional single sensor loses efficacy under the complex working condition is solved, and the performance of an industrial instrument in the aspects of measurement precision, self-adaptability and operation and maintenance efficiency is improved.

The invention provides a traffic comprehensive query optimization method and system applied to intelligent human-computer interaction, and the method comprises the steps: obtaining a traffic query request input by a target user in an interaction scene, carrying out the multi-modal feature analysis of the traffic query request, generating a semantic understanding feature and a scene correlation feature, and obtaining a semantic understanding feature and a scene correlation feature based on a preset language large model; performing dynamic interaction feature fusion processing on the semantic understanding feature and the scene association feature to generate a multi-dimensional intention feature, and performing service path optimization on the traffic query request of the target user according to the multi-dimensional intention feature to generate a comprehensive response strategy; and converting the comprehensive response strategy into interactive feedback information, dynamically adapting to equipment parameters in the real-time environment association information, and executing feedback operation to complete optimized response of the traffic query request. According to the invention, the response real-time performance, decision reasonability and execution reliability of the intelligent traffic query service can be improved.

The invention relates to a man-machine hybrid autonomous navigation system in an unknown dynamic environment, which comprises an environment sensing module for acquiring environment information by using sensors such as a laser radar, a camera and an inertial measurement unit and performing data preprocessing; the local target point selection module selects a local target point set meeting requirements in the environment according to the real-time information provided by the environment sensing module; the decision planning module is used for generating an optimal path and a navigation strategy based on mixed training of a deep reinforcement learning algorithm and artificial experience; and the learning optimization module improves the generalization ability of the algorithm through online learning and transfer learning technologies, and realizes effective introduction and strategy adjustment of human experience in combination with the man-machine interaction module. The man-machine interaction module can work in cooperation with the local target point selection module so as to dynamically adjust target point selection according to external input and optimize path planning. According to the method, high decision stability can be kept in an unseen environment, the training cost is reduced, and the method is more suitable for autonomous navigation application in the real world.

The invention discloses a project-level visualization display method and system for highway multi-source data fusion, and the method comprises the following steps: 1, constructing a multi-source heterogeneous data exchange and integration frame, and carrying out the seamless connection and mapping of a BIM model, GIS space geographic information and an oblique photography three-dimensional point cloud model; 2, formulating a standardized interface specification, and performing specification processing on data from different sources through a data analysis and conversion engine; 3, dynamically and synchronously updating the multi-source engineering data and the project progress in real time; 4, gathering engineering data to construct a digital twinborn model of the expressway project to realize centralized management, multi-dimensional analysis and dynamic presentation in a visual scene; 5, carding and extracting management business logic to construct a flexibly expanded professional application module so as to realize intelligent analysis of the engineering project; and step 6, performing visual immersive display on the multi-source data fusion project by adopting visual man-machine interaction. According to the invention, visual comprehensive management and traceability of each element of the project are realized.

The invention provides a multi-construction-method collaborative dust fall intelligent control method based on deep learning. The method comprises the following steps: collecting mine field data of a mine field in real time; wherein the mine field data comprises mine field environment data, equipment operation data and topographic data; constructing a digital mine field model based on the mine field data; wherein the digital mine field model comprises a terrain model, an equipment model and a dust generation and diffusion model; based on the mine field data and the digital mine field model, constructing a reinforcement learning agent; based on the reinforcement learning agent, performing dust fall control on the mine field; the dust fall control is monitored on the basis of the pre-created human-computer interaction interface, intelligent and efficient control over the mine field dust fall process is achieved, the dust fall effect and the resource utilization efficiency are improved, and meanwhile the flexibility and reliability of the system are improved through human-computer cooperative control.