3910 results about "Deep neural networks" patented technology

The present invention relates to the field of industrial intelligent predictive maintenance, and in particular to an interpretable deep feature fusion network-based industrial intelligent predictive maintenance method, comprising: acquiring gearbox vibration data comprising noise; performing preliminary extraction and noise suppression on features of the acquired data by establishing an interpretable feature extraction module having a physical information constraint; integrating multi-scale features comprising long-distance and local dependencies by means of a dual-branch feature fusion module having global and local feature fusion capabilities; performing dimensionality reduction on a high-dimensional feature and generating an output by means of a classifier to obtain a final fault identification result; and performing interpretability analysis on a diagnosis process of a model. In the present invention, by embedding the signal processing technology having a well-defined physical theory support into a deep neural network, the interpretability and reliability of model inference results are effectively improved while the fault identification accuracy of the model is improved.

Disclosed in the present invention is an improved deep learning model-based refrigeration unit fault detection method. The method uses an LOF algorithm to remove outliers from a fault dataset, and then uses ADASYN technology to solve the problem of data imbalance. In addition, in respect of the problems that existing refrigeration unit fault diagnosis deep learning models are prone to network degradation, and refrigeration unit fault diagnosis models generally lack weighting critical features, the present invention first alleviate, on the basis of ResNet, the problem of network performance degradation which is prone to occur in deep neural network training processes, and then integrates a CBAM for capturing critical features in fault data, so as to improve the feature extraction capability of a network. Experimental results show that the LOF-ADASYN-ResNet-CBAM method provided by the present invention effectively diagnoses refrigeration unit faults.

The invention relates to the technical field of water conservancy project detection, and discloses a water conservancy project safety detection early warning method based on artificial intelligence. The method comprises the following steps: acquiring multi-modal monitoring data of a key part through a distributed sensor network, and extracting a dynamic feature sequence in a preset time period through space-time alignment and noise filtering; inputting the image into a deep neural network fused with an attention mechanism, constructing a multi-scale space-time correlation map through hierarchical feature learning, and generating a high-dimensional representation of an engineering structure state; historical accident case data is used as a supervision signal, a hybrid expert model is used for performing multi-task training on high-dimensional representation, and the contribution weight of each monitoring index to the safety risk is obtained; combining real-time environment parameters and structural response characteristics to construct a dynamic threshold adjustment model, adaptively updating an early warning threshold according to a risk probability, and screening out key risk factors of which the contribution weights are greater than the updated threshold; and on the basis of spatial and temporal distribution characteristics, through graph neural network node association reasoning, multi-source early warning information is fused to generate a graded early warning result.

The invention discloses an electromechanical equipment health assessment and early warning method based on multi-mode dynamic perception, and belongs to the field of intelligent operation and maintenance of electromechanical equipment. The problems that in the prior art, a single physical quantity cannot comprehensively reflect the equipment state and a traditional signal processing algorithm cannot adapt to the equipment degradation mode change are solved, a panoramic sensing system covering multiple physical fields such as vibration, temperature and noise is constructed through a multi-mode sensor network and a dynamic weight fusion algorithm, and the multi-physical-field multi-physical-field panoramic sensing method is applied to the multi-physical-field multi-physical-field panoramic sensing system. The problem of isolated island of traditional single-dimensional monitoring information is solved; through a physical-depth mixed feature extraction architecture, combining interpretable engineering features with abstract features extracted by a deep neural network to form a health assessment model with mechanism transparency and mode generalization ability; through deep integration of the digital twin platform and the RPA technology, the manual inspection frequency and workload are reduced, the fault recognition accuracy is promoted to increase year by year, and continuously optimized intelligent operation and maintenance ecology is formed.

The invention relates to the field of knowledge graph completion, provides a knowledge graph completion method based on multi-modal visual angle perception and a deep neural network, and aims to solve the problems of weak multi-modal information expression ability, rough fusion mode and insufficient structural reasoning ability in the prior art. According to the method, structure information, text description and visual image information of an entity in a knowledge graph are obtained, structure, text and image modal input is constructed respectively, and a graph neural network, a pre-training language model and a visual encoder are adopted for feature coding; weighted fusion and semantic enhancement of multi-modal features are realized through a visual angle fusion mechanism and hierarchical attention processing; cross-modal contrast learning is introduced to improve modal consistency; and carrying out triple reasoning by using a uniform Transform encoder, and verifying a completion result by scores. According to the method, multi-modal semantics are effectively integrated, the entity representation capability and the triple prediction accuracy are improved, the model robustness is enhanced, and the method is suitable for application scenes such as intelligent question answering and recommendation systems and has remarkable practical value and popularization prospects.

The invention relates to an intelligent water service pipe network monitoring method based on Internet of Things fusion, and aims to solve the problems in heterogeneous sensor data accurate acquisition, consistent processing, efficient anomaly recognition and trend prediction. According to the core technical scheme, the method comprises the steps that deployment of multiple types of sensors is optimized, standardized calibration is implemented, efficient collection and local preprocessing of original data are achieved through a wireless communication protocol, and data uniformity and reliability are guaranteed through data normalization, noise suppression and abnormal value elimination; performing historical operation trend and short-term fluctuation feature extraction and conventional trend prediction by adopting space-time mixed feature perception and a deep neural network, and integrating an adaptive anomaly detection and correction mechanism to realize emergency response and cause explanation; and finally, an analysis result is fed back to an early warning and resource scheduling system, and the model is periodically optimized. According to the scheme, the sensing precision, intelligent analysis and abnormal response capability of the operation data of the water service pipe network are remarkably improved.

The invention relates to the technical field of electroencephalogram signal processing, and discloses an electroencephalogram emotion recognition method and system based on a deep neural network. The method comprises the following steps: collecting and preprocessing a multi-channel EEG signal; constructing a graph data structure, extracting multi-domain features by taking electroencephalogram channels as nodes, and constructing a self-adaptive dynamic adjacency matrix; constructing a graph convolution long and short-term memory network, learning spatial features by GNN, and extracting time dependence by LSTM; enhancing emotion capture by using a multi-scale time-frequency feature fusion method in combination with STF and CWT; constructing global topological information of an FCN brain extraction region in combination with brain network features; and outputting alertness and other emotion indexes by means of the classification model. According to the method, graph structure learning and time sequence modeling are combined, EEG signal emotion recognition is optimized, and personalized adaptation and emotion recognition accuracy is improved.

The invention relates to the technical field of Internet of Things anomaly identification, in particular to an Internet of Things anomaly traffic identification method and system based on a deep neural network. The method comprises the following steps: collecting communication data of each piece of IoT equipment in real time from an edge gateway of the Internet of Things; preprocessing the collected communication data, and constructing a multi-dimensional feature vector; based on a convolutional neural network and a bidirectional long-short-term memory network, performing time sequence feature extraction and anomaly discrimination on the multi-dimensional feature vector to output a traffic anomaly probability; and comparing the abnormal probability output by the depth time sequence modeling neural network with a dynamic threshold value, and if the abnormal probability exceeds a preset threshold value, determining that the traffic is abnormal. A gating mechanism is introduced into a bidirectional long-short-term memory layer, a gating coefficient is calculated at a time step level, the influence weight of time step information on final output is dynamically adjusted, feature expression of key time steps is strengthened, noise or irrelevant information is suppressed, and the sensitivity of a model to time sequence data is improved.

The invention provides a heavy truck battery compartment guiding method and system based on visual perception. The method and system are used for automatic battery replacement operation in a complex industrial environment. According to the system, a multi-camera fusion visual perception platform is constructed, a plurality of industrial cameras arranged on the ground or ceiling of a battery swap station are used for collecting local images of different visual angles of a battery compartment, and a complete visual field image is generated through feature matching and image splicing. A battery compartment is coarsely positioned by adopting a YOLO series model, a bounding box region is extracted, pixel-level contour segmentation is realized by introducing SAM, and the complex background and multi-interference environment recognition capability is enhanced. And after segmentation, calculating a minimum enclosing rectangle of the battery compartment, obtaining a center coordinate and a deviation angle, and transmitting a pose parameter to an upper computer control system. According to the method, the defects of the laser radar are avoided, image processing, the deep neural network and multi-view information are fused, the recognition precision and stability are improved, the battery replacement efficiency and the unmanned level of the electric heavy truck can be remarkably improved, and reliable support is provided for green traffic.

The invention relates to the technical field of wind power equipment monitoring, and discloses a wind power gear box intelligent fault early warning method and system based on machine learning. The method comprises the steps that multi-source monitoring data such as vibration signals, temperature data and oil analysis data of the wind power gear box are acquired, and multi-scale operation characteristics are extracted through time-frequency conjoint analysis; key fault sensitive features are determined through an adaptive feature selection algorithm, and a dynamic fault feature weight matrix is constructed in combination with a historical fault case library; multi-modal data fusion is adopted to generate an enhanced fault feature set, and modal decomposition is carried out on the enhanced fault feature set to obtain a trend component and a fluctuation component; a fault evolution feature space is constructed by using a deep neural network based on two components, then a fault development mode is identified by using a time sequence mode matching algorithm, and finally a graded early warning signal is generated according to a matching degree with a preset mode, so that fault features can be comprehensively captured, and safe operation of a wind power gear box is ensured.

The invention provides a cellular network flow space-time prediction method and system based on a hybrid neural network, and belongs to the technical field of intelligent communication. The method adopts a layered deep neural network architecture, and comprises a data embedding layer, a space-time coding layer, a feature fusion layer and an output layer. The data embedding layer maps a historical traffic sequence, cross-domain external data and metadata into high-dimensional features; the space-time coding layer is used for respectively fusing one-dimensional causal convolution and a Mama neural network to extract multi-scale time features and densely connecting convolution and a multi-head attention mechanism to capture multi-scale space features through time and space modeling branches; the feature fusion layer realizes adaptive weighted fusion of spatial-temporal features, cross-domain features and metadata features by using a gating fusion mechanism; and the output layer performs linear transformation on the fusion features to generate a final prediction result. According to the method, the spatial-temporal dynamic capture of the service traffic is accurate, the prediction curve is highly fit with the true value, and the accurate prediction of the multi-service traffic of the cellular network is realized.

The invention relates to the technical field of transformer monitoring, and discloses a comprehensive online transformer monitoring system which comprises a sensor layer, an edge computing layer, a cloud platform layer and a communication module. The cloud platform layer comprises a data warehouse, a big data processing engine, a comprehensive diagnosis engine, a model training engine and a system management module, the edge calculation layer is in communication connection with the cloud platform layer through a communication module, the comprehensive diagnosis engine integrates a deep neural network and a knowledge graph inference engine, and cross validation of data driving and knowledge guiding is achieved; a model training engine utilizes historical data and online incremental data to continuously optimize a model, and a dynamic knowledge graph updates a fault rule through a real-time diagnosis result and expert feedback, so that the system can adapt to novel faults and complex working conditions, and the diagnosis accuracy and adaptability are greatly improved.

According to the method, multi-modal data such as voice, images, texts, GIS and Internet of Things sensing are fused, and deep neural network prediction, reinforcement learning scheduling optimization and rule engine compliance check are combined; the intelligent vehicle and material dispatching method and system are applied to multiple scenes such as emergency material storage depots, fire-fighting emergency command, urban disaster response, traffic accidents and medical first aid. The system is interconnected and intercommunicated with an intelligent emergency material storage cloud platform, a city brain, Beidou navigation, intelligent fire fighting and other external platforms, and supports one-key issuing, path optimization, traffic signal linkage and whole-course return closed loop. Compared with the prior art, the method has the advantages that unification of multi-modal situation awareness, data-driven optimal scheduling and expert knowledge constraints is realized, the response time is remarkably shortened, the resource utilization rate is improved, and compliance safety is ensured.

The invention discloses a PINN-based high-precision hydrodynamic numerical simulation method and system, and the method comprises the steps: firstly building a computational domain, setting reasonable geometric parameters and boundary conditions, and constructing a dimensionless Navier-Stokes control equation set; then designing a deep neural network architecture with space-time coordinate input and flow field variable output, and adopting a loss function combining physical constraint and data driving; the core innovation lies in providing a timing sequence sensing RAR-D adaptive sampling strategy, dividing a time domain into a plurality of time frames, performing residual error evaluation in each frame, constructing a probability density function related to residual errors, and balancing priority sampling and overall coverage of a high residual error region; adam and L-BFGS optimizers are adopted to carry out network training, the weight of a loss function is dynamically adjusted, and a sampling point set is periodically updated; and finally, the solution precision is verified through multi-dimensional flow field visualization analysis. Therefore, the prediction precision of the complex flow field is effectively improved, and the calculation efficiency is remarkably improved.

The invention discloses an unmanned aerial vehicle autonomous maneuvering game decision-making method, and belongs to the technical field of maneuvering decision-making, and the method can be realized through the following steps: 1, constructing a single-agent three-degree-of-freedom position intelligent controller, building an unmanned aerial vehicle three-degree-of-freedom motion model, and carrying out the reinforcement learning of a game environment; 2, constructing a game maneuvering decision algorithm and a maneuvering game decision framework based on a three-degree-of-freedom position controller; step 3, based on a game multi-agent training process of an improved near-end strategy optimization algorithm, initializing a strategy network and a value network of each agent, and processing high-dimensional state features by combining the self-learning ability of reinforcement learning and a deep neural network to form a maneuvering strategy set which can be selected by the unmanned aerial vehicle in an adversarial maneuvering decision; and step 4, after training in the reinforcement learning game environment, inputting the observation state of each agent into the trained strategy neural network, and realizing a game maneuvering decision-making task in the unmanned aerial vehicle maneuvering game scene by maneuvering cooperation with fusion among different aerial carrier radars.

The invention discloses a marine environment real-time monitoring and early warning system based on machine learning, and relates to the technical field of machine learning. Comprising the steps that an ocean multi-source sensing module collects ocean environment data in real time through a sensor and a combined collection scheme; the multi-source feature extraction module performs time domain, change rate and frequency domain feature analysis on the data to construct a unified multi-dimensional feature vector; the multi-model fusion prediction module outputs a marine environment state vector through dynamic weighting and deviation correction based on a parallel learning architecture of a deep neural network, a long-short-term memory network and a one-dimensional convolutional neural network; and the ocean risk identification and early warning module generates graded and classified early warning information through double study and judgment of a sea condition classifier and an abnormal event detector. According to the method, comprehensive acquisition, deep feature mining, high-precision prediction and accurate early warning of marine environment data are realized, the problems of low prediction precision, risk identification lag and the like in the prior art are effectively solved, and reliable guarantee is provided for marine operation safety.

The invention belongs to the technical field of aero-engine state monitoring and intelligent fault diagnosis, and discloses a multi-modal information fusion bearing fault diagnosis method based on self-supervised learning. The method comprises the following steps: firstly, through mask reconstruction self-supervision pre-training, extracting stable feature representation insensitive to mask disturbance from an unlabeled multi-modal signal, and dynamically updating each modal feature reference point by using an index moving average algorithm; in a downstream fault diagnosis task, a multi-modal joint decision model comprising a pre-training encoder, a single-modal classifier and a fusion classifier is constructed, and adaptive weighted fusion of multi-modal decision is realized through contribution degree calculation based on a cooperative game Shapley value in combination with a deviation degree of modal features and a reference point. According to the method, the dependence of the deep neural network on fault labeling data is effectively reduced, the accuracy and robustness of the diagnosis system in a multi-modal signal diagnosis scene are improved through a dynamic fusion mechanism, and the method is suitable for industrial scenes with limited sample label resources.

The invention discloses a GPU cluster scheduling strategy optimization system based on deep reinforcement learning, which comprises a simulation environment layer, a reinforcement learning layer and a strategy evaluation layer, and is characterized in that the simulation environment layer is used for providing a real and credible GPU cluster scheduling environment, reproducing a core mechanism of actual cluster scheduling and simultaneously providing controllable experiment conditions; comparative evaluation and iterative optimization of strategies are facilitated; the reinforcement learning layer converts a GPU cluster scheduling problem into a Markov decision process based on a deep neural network, and obtains an optimal scheduling strategy by applying a reinforcement learning strategy; and the strategy evaluation layer counts each key index, compares and analyzes a plurality of scheduling strategies, and visually displays an analysis result to realize optimization of the GPU cluster scheduling strategy. The system solves the time sequence short view problem of a traditional scheduler, so that the scheduling decision can consider the influence on the future, global optimization instead of local optimization is realized, and the overall resource utilization efficiency is improved.

The invention relates to the technical field of water supply pipeline detection, and discloses an underground water supply pipeline health grade evaluation and risk prediction method, which comprises the following steps: sensor arrangement: arranging a flow sensor, a pressure sensor and a sonic sensor at key positions of an underground water supply pipeline; and data acquisition: acquiring signals of the sensor in real time through a data acquisition module, wherein the signals comprise flow, pressure and sound wave signals. Preprocessing the data: carrying out preprocessing such as denoising and normalization on the collected signals; and multi-source data fusion: inputting flow, pressure and sound wave signals into a deep neural network model, and performing feature extraction and fusion analysis. And health level assessment: assessing the health level of the pipeline based on the output result of the deep neural network model. And risk prediction: predicting abnormal working conditions possibly occurring in the future and risk levels of the abnormal working conditions by analyzing the current pipeline state and historical data. And abnormal positioning: accurately positioning an abnormal position in combination with the propagation time of the sensor signal and a positioning model of the deep neural network.

A deep neural network(s) (DNN) may be used to detect objects from sensor data of a three dimensional (3D) environment. For example, a multi-view perception DNN may include multiple constituent DNNs or stages chained together that sequentially process different views of the 3D environment. An example DNN may include a first stage that performs class segmentation in a first view (e.g., perspective view) and a second stage that performs class segmentation and / or regresses instance geometry in a second view (e.g., top-down). The DNN outputs may be processed to generate 2D and / or 3D bounding boxes and class labels for detected objects in the 3D environment. As such, the techniques described herein may be used to detect and classify animate objects and / or parts of an environment, and these detections and classifications may be provided to an autonomous vehicle drive stack to enable safe planning and control of the autonomous vehicle.

The invention discloses an automobile seat framework machining defect detection method based on machine vision, and particularly relates to the technical field of defect detection. The method comprises the following steps: constructing a multi-angle image acquisition and edge reflection modeling module aiming at complex defects such as weld joint pseudo soldering, microcracks, hole site deviation and collapse deformation, extracting weld joint continuity, edge integrity and hole site geometric consistency characteristics by using a deep neural network, and generating a structural feature vector; defect type recognition and credibility scoring are completed through small sample anomaly modeling and Gaussian mixture model classification, sub-pixel-level coordinate labeling of defect positions is achieved in combination with a Gaussian fitting algorithm, a defect positioning map is output, traceability analysis and severity grading are conducted based on historical data comparison, and the defect positioning accuracy is improved. The method is suitable for industrial online detection and quality closed-loop control.

A system is disclosed for encoding a data string of a first modality into a hierarchical tokenized representation for processing by a text-based deep neural network (DNN) trained on a second modality. The data string comprises multiple units, each having one or more attributes. Each attribute is represented in the tokenized string as a sequence of hierarchical tokens, with a first hierarchical token encoding one or more most significant bits and a subsequent hierarchical token encoding one or more less significant bits. The DNN processes the data string bidirectionally, across the sequence of units and within the token hierarchy, to select tokens that capture attribute information. The selected hierarchical tokens output by the DNN from a representation of the original data string that preserves attribute detail while enabling cross-modal processing using models trained on text.

A robot control method based on tactile prediction pre-training comprises the following steps: acquiring and generating a human playing data set consisting of three-channel image tensors in an offline stage, and training a constructed conditional diffusion model comprising a tactile encoder, a tactile decoder and an action and visual encoder; in the online stage, the trained conditional diffusion model is integrated into a standard imitation learning strategy network, and an action instruction of the robot is generated according to the state of the robot, the current visual features and the tactile feature vectors extracted by the imitation learning strategy network. According to the method, a specific agent task is completed by training a deep neural network model, that is, a future tactile signal sequence is predicted according to historical information and future action intentions; the model is enabled to characterize generic haptic features contacting physical dynamic laws for further migration into downstream robot control tasks.

The invention is applicable to the field of intelligent audio adjustment, and provides an immersive audio-video follow-up adjustment method and system, and the method comprises the steps: constructing a multi-dimensional perception system, and collecting multi-source information in real time; carrying out fusion processing on the collected multi-source information based on a deep neural network model, mining a dynamic mapping relation between a user state and the video content through space-time correlation analysis, and identifying a user interaction intention and an emotional tone and a space scene attribute of the video content; according to a fusion processing result, calling a dynamic parameter adjustment engine, and generating an audio parameter adjustment scheme in real time; a user experience feedback closed loop is constructed, a visual attention area of a user is collected through eye movement tracking equipment, and personalized adjustment preference parameters are generated; according to the method and the device, the audio effect is accurately matched with the user state and the audio and video content, the naturalness and the adaptability of immersive experience are remarkably improved, universality and individual differences are considered, and the audio experience which is more suitable for scenes and needs of the user is brought to the user.

The invention discloses a multi-modal deep neural network model, system and method based on continuous learning. The multi-modal deep neural network model comprises a data acquisition and preprocessing module used for acquiring multi-modal data of a crop growth environment; the feature extraction module is used for extracting key agricultural features; the multi-modal information fusion module is used for effectively fusing the extracted key agricultural features; the knowledge continuous learning module is used for memorizing and storing the crop growth mode to a crop growth mode library and applying a model parameter self-adaptive updating strategy; the intelligent decision-making module is used for performing crop management decision-making based on the fusion features; and the effect evaluation and feedback module is used for evaluating the decision effect. According to the invention, the problem of knowledge forgetting of the existing AI system is solved, and the adaptability and decision accuracy of the intelligent agricultural system are improved.

The invention belongs to the technical field of drainage pipeline detection, and particularly relates to a voiceprint recognition detection method for internal defects of a drainage pipeline, and the method comprises the following steps: S1, collecting sound signals in the pipeline through an acoustic sensor array; s2, preprocessing the collected sound signals, wherein the preprocessing comprises noise filtering, signal enhancement and segmentation processing; s3, extracting time domain, frequency domain and time-frequency domain features of the sound signals, and constructing voiceprint fingerprints; s4, establishing a defect classification model based on the deep neural network, and identifying different types of pipeline defects; s5, carrying out confidence evaluation on the detection result, and determining the position of the defect in the pipeline; s6, outputting a detection result and carrying out graded alarm; according to the method, various defect forms of cracks, blockage, damage and the like of different degrees of the drainage pipeline can be recognized, the recognition accuracy of the internal defects of the drainage pipeline can reach 95% or above through multi-dimensional voiceprint feature extraction and a deep learning algorithm, and continuous monitoring and real-time alarming can be achieved.

The invention relates to the field of building construction safety, in particular to a risk prediction method and system for building construction. Aiming at the defects of multi-source data isolated analysis, dynamic risk response lagging, insufficient prediction precision and the like in the prior art, a unified analysis base is formed by constructing a space-time fusion data space and integrating multi-dimensional dynamic data such as structure micro-deformation monitoring, environmental parameters, three-dimensional live-action scanning, personnel positioning, a building information model and the like; based on a deep neural network architecture, designing a multi-modal feature extraction mechanism to quantify the coupling risk, and generating a partition risk probability distribution diagram; and in combination with a construction stage characteristic matching security policy library, implementing a three-level early warning mechanism and an automatic avoidance instruction. A closed-loop optimization mechanism is introduced, model parameters and decision threshold values are dynamically adjusted through actual accident feedback, and continuous evolution of a prediction system is achieved. According to the method, the active prevention and control capacity of compound accidents such as collapse and high-altitude falling is remarkably improved, and a self-adaptive intelligent protection system is constructed for a construction site.

An offshore wind turbine integral coupling fatigue calculation method based on artificial intelligence belongs to the technical field of offshore wind power engineering, is used for solving the problem of efficient and high-precision evaluation of the fatigue life of an offshore wind turbine, and is characterized in that key environment parameter vectors influencing structural response and a data set of corresponding fatigue damage labels are acquired; training a deep neural network model by using the data set; the deep neural network model outputs corresponding fatigue damage per unit time in response to a central point parameter of an environment working condition block in an input long-term joint probability distribution diagram of the wind power site; according to the method, the defects that a traditional time domain simulation method is high in calculation cost and long in period are overcome, the calculation efficiency is improved by a plurality of orders of magnitude while the precision is guaranteed, and a powerful tool is provided for rapid design and optimization of the offshore wind turbine.

The invention is applicable to the technical field of medical image processing and mixed reality, and provides a laparoscopic surgery mixed reality navigation method based on deep learning and dynamic point tracking, which comprises the following steps: dynamically registering a three-dimensional model containing kidney, tumor and vessel with an initial frame of a laparoscope through a mixed reality alignment technology; the method comprises the following steps: constructing an operating forceps motion sensing model based on a time sequence deep neural network, realizing real-time control and parameter locking of a three-dimensional model pose, dynamically updating a two-dimensional feature point set by adopting a multi-feature-point combined tracker, constructing a candidate feature combination through a cross-quadrant sampling strategy, and constructing an operating forceps motion sensing model; a candidate feature combination is generated through a four-quadrant division and cross-regional sampling strategy, an optimal camera pose parameter is generated in combination with a re-projection error and pose continuity constraint, and an operation video is dynamically covered with a semitransparent three-dimensional model. The method can significantly enhance the spatial perception capability of the kidney anatomical structure, reduce the registration error of the kidney in the three-dimensional integrated kidney structure model and the laparoscope video, and improve the navigation precision.

The invention provides a construction method and system of a rock-soil shear strength parameter prediction model, and relates to the technical field of model construction.The construction method comprises the steps that CT scanning data of a real rock-soil sample is obtained and preprocessed, and an irregular three-dimensional particle set for geometric modeling is obtained; performing particle surface roughness modeling analysis on the three-dimensional particle body set to obtain a surface roughness coefficient set of the three-dimensional particle body set; performing particle size cumulative distribution function segmentation processing and fractal dimension control on the surface roughness coefficient set to obtain a structure grading sample set; constructing a THMC multi-field coupling model based on the structure grading sample set to obtain a working condition particulate matter physical response parameter set; and performing a simulation experiment on the working condition particle physical response parameter set, and performing deep neural network modeling processing based on an experiment result to obtain a strength response model capable of predicting the cohesive force and the internal friction angle of the rock-soil body under any working condition input. According to the invention, the prediction efficiency and accuracy are significantly improved.