73004 results about "Visual perception" patented technology

The invention belongs to the technical field of bridge diagnosis, and discloses a bridge crack intelligent diagnosis system based on multi-modal data fusion. By fusing multi-source data such as visual images, sound wave detection and vibration signals, comprehensive perception and characterization of crack features are realized; constructing a bridge crack characteristic spectrum diagram by adopting a cross-modal feature extraction and heterogeneous feature coding technology; generating a crack evolution situation map based on space-time correlation analysis and knowledge graph construction; the robustness of the system in a complex environment is improved through environmental adaptability feature enhancement and multi-scale characterization; constructing a bridge safety risk hypergraph in combination with multi-dimensional risk analysis and multi-agent collaborative diagnosis; analyzing and revealing a crack evolution mechanism by applying a causal relationship; and finally, through dynamic fusion and uncertainty quantification, a crack intelligent diagnosis comprehensive report is generated. According to the system, the limitation of traditional single-mode diagnosis is broken through, and dynamic prediction and accurate risk assessment of fracture evolution are realized.

The invention belongs to the technical field of visual special effects, and discloses an AI visual special effect dynamic generation system fusing multi-modal perception. Through cooperative work of six core modules of multi-modal input processing, importance analysis, parameter configuration, parameterized rendering, parameter optimization and rendering and output, deep fusion of special effects and contents is realized. An image sequence, audio data and scene parameters can be processed at the same time, a multi-modal feature data set is constructed, a scene key visual area is scientifically recognized, a visual importance distribution map is generated, and the special effect parameter configuration and rendering process is guided. An improved neural radiation field technology and a physical constraint model are adopted to ensure the consistency and reality of the special effect at different visual angles; and a multi-dimensional quality evaluation and parameter automatic optimization mechanism is introduced, so that the visual expressive force and the artistic value of the special effect are guaranteed. The creation threshold is remarkably reduced, the cooperative expression ability of the special effect and the content is improved, and the special effect becomes a powerful tool for enhancing the narration and enhancing the emotion.

The invention discloses a high-precision image processing method and system based on illumination adaptive compensation, and relates to the technical field of computer vision and image processing, and the method comprises the steps: inputting an original image, and dividing the image into a high-frequency edge layer, an intermediate-frequency texture layer and a low-frequency illumination layer through a multi-scale residual network; acquiring illumination intensity, color temperature and scene categories in real time by using an ambient light sensor and a scene semantic segmentation model, and generating dynamic compensation parameters; carrying out dynamic range expansion on a low-frequency illumination layer based on a physical illumination model, and adjusting the weight of highlight suppression and dark area enhancement through a self-adaptive S-shaped exposure curve; a double-branch generative adversarial network is adopted, noise suppression and super-resolution reconstruction are carried out on the high-frequency layer, and texture detail enhancement is carried out on the intermediate-frequency layer; aligning the data of the depth camera and the infrared sensor with the visible light image through a cross-modal fusion module; and performing tone mapping on the fused image based on human visual characteristics, and outputting an enhanced image with a high dynamic range and reserved details.

The invention relates to the technical field of camera linkage alarm, and discloses a camera linkage alarm method and system for intelligent environment monitoring, and the method comprises the steps: synchronously collecting the video stream data of a plurality of cameras and the multi-parameter monitoring data of an environment sensor; executing multi-path feature analysis and cross-modal feature fusion to obtain environment-vision joint features; environment scene self-adaptive classification is executed, and environment-vision joint features are analyzed through an anomaly judgment model to obtain an abnormal event judgment result; executing multi-camera collaborative verification and vision-environment data association analysis to obtain multi-dimensional abnormal event description information; and selecting a multi-camera linkage response strategy and coordinating the plurality of cameras to carry out three-dimensional monitoring on the abnormal area to obtain a linkage response execution result, so that a false alarm mode can be identified and an abnormal judgment rule can be dynamically adjusted, continuous optimization of the performance of the plurality of cameras is realized, and the false alarm rate and the missing report rate of the plurality of cameras in long-term operation are reduced.

The invention discloses a welded pipe surface defect detection system, particularly relates to the technical field of metal pipe surface quality detection, and is used for solving the problem of defect misjudgment and missing detection caused by mixed reflection interference under single light source irradiation in the existing visual detection technology. An annular light source is adopted for time-sharing pulse triggering through a light source control module, reflected light images at different angles are synchronously collected, a feature extraction module constructs a diffuse reflection intensity ratio and mirror reflection angle distribution matrix to generate a three-dimensional reflection feature spectrum, and reflection anomaly characterization of a defect area is enhanced; the area positioning module screens candidate areas and inhibits interference by combining strength ratio circumferential deviation degree and reflection angle gradient change, and the distortion correction module compensates geometric distortion errors based on curvature radius and station movement parameters, filters pseudo defects of abnormal time sequence fluctuation, and improves the accuracy of the distortion correction. And the defect judgment module utilizes a gradient-gray scale space coupling classification model to distinguish the types of cracks, scratches and corrosion, and finally judges the defect authenticity in combination with reflection characteristic deviation vector superposition.

A multi-modal information tagging method, apparatus and device, and a storage medium and a product. An information tagging effect is effectively improved by means of determining visual feature information of visual information by means of a multi-modal tagging system, performing multi-modal fusion processing on the basis of the visual feature information, the visual information, recognized text information and descriptive text information to obtain image-text fusion features, determining image-text correlation information between the visual information and both the recognized text information and the descriptive text information, on the basis of the image-text fusion features and the image-text correlation information, determining a tagging result for information to be tagged, and performing multidimensional information tagging on the basis of multi-modal information fusion and cross-modal correlations.

The invention discloses a target recognition and grabbing posture planning system for a collaborative robot, and belongs to the technical field of mechanical arms. According to material posture information provided by a sensing module, the optimal grabbing posture is intelligently matched from a preset grabbing strategy library by fusing mechanical arm movement track parameters and target material physical characteristics; the initial accuracy of the grabbing scheme is ensured, in the grabbing process, the camera continuously collects the material poses in real time, and the offset is accurately calculated by comparing the real-time poses with the expected poses. Once material deviation is detected, a visual and force closed-loop adjusting mechanism is triggered immediately, a force-position hybrid control model is utilized, position deviation is synchronously corrected, and grabbing force parameters are dynamically adjusted, so that the grabbing stability and precision are remarkably improved, the grabbing failure rate is effectively reduced, manual intervention and reset time are greatly shortened, and the grabbing efficiency is improved. Therefore, the production efficiency is comprehensively improved.

The invention provides an industrial robot autonomous collaborative decision-making method and system based on multi-modal sensing and a medium, and belongs to the technical field of industrial robot intelligent control. The method comprises the steps of performing cross-modal space-time alignment to eliminate data space-time differences by collecting visual, tactile and auditory information, realizing multi-modal feature fusion in combination with a dynamic weight adjustment mechanism and an attention calculation model, and generating a joint decision strategy through a deep learning optimization model. The system dynamically allocates sensor weights according to task types, introduces a multi-objective optimization mechanism of energy consumption, precision and safety, and sets a fault-tolerant rule to automatically recover the weights or recalibrate the sensors. According to the method, the problems of rigid data fusion and single optimization dimension in traditional multi-modal decision making are solved, and the precision, the response speed and the environmental adaptability of collaborative operation of the industrial robot are remarkably improved.

The invention discloses a campus green space ownership perception assessment method and system based on multi-modal learning, and the method specifically comprises the steps: inputting the output results of a visual feature coding network and an auditory feature coding network into an audio-visual modal feature fusion module for fusion processing, and obtaining an environment joint representation; inputting the physiological response data set and the psychological assessment data set into a physiological and psychological collaborative encoder for processing to obtain a physiological and psychological joint representation; inputting the environment joint characterization and the physiological and psychological joint characterization into a global fusion module for deep fusion to obtain a final fusion feature; and inputting the final fusion feature into a multi-task prediction channel for processing, and training and optimizing in combination with a loss function to obtain an environment comfort comprehensive scoring result and an explanatory decision basis. According to the invention, comprehensive assessment of campus green space perception is realized, the accuracy and scientificity of assessment are improved, and decision support is provided for optimization of campus space design.

The invention discloses a stainless steel surface defect detection method based on machine vision, and relates to the field of material defect detection.The stainless steel surface defect detection method comprises the steps that stainless steel surface images are collected, the collected multispectral surface images are subjected to image fusion, and a multispectral composite image is generated; performing detail enhancement on the low-resolution image through a super-resolution reconstruction algorithm to obtain a high-resolution image set; positioning a defect area position from the high-resolution image set through a defect detection algorithm, and obtaining a defect position data set; extracting a historical image defect feature set and a real-time image defect feature set from the defect position data set, and constructing a defect classification model according to the historical image defect feature set; inputting the real-time image defect feature set into a defect classification model, and performing defect classification and evaluation to obtain a defect classification data set; and generating and distributing a defect detection report. By combining the multispectral imaging algorithm, the super-resolution reconstruction algorithm and the defect classification model, the automation, precision and efficiency of stainless steel surface defect detection are improved.

The invention relates to the technical field of unmanned aerial vehicle control, in particular to an unmanned aerial vehicle autonomous obstacle avoidance decision-making method and system based on multi-source sensor fusion, and the method comprises the steps: achieving the time-space synchronization of a laser radar, a visual camera and a millimeter-wave radar through timestamp alignment and coordinate mapping, and constructing a dynamic obstacle grid map; fusing multi-source data based on a dynamic Bayesian network, and dynamically adjusting the confidence coefficient weight of the sensor in combination with the environment illumination intensity and the barrier surface material; and adopting a reinforcement learning model to generate an incremental obstacle avoidance strategy, and triggering a grading response instruction according to the risk assessment grade. The problem of fusion errors caused by spatial-temporal asynchronization of multi-source sensor data is solved, and the real-time obstacle avoidance success rate of dynamic obstacles is increased.

In some embodiments, a computer system changes a visual prominence of a respective virtual object in response to detecting a threshold amount of overlap between a first virtual object and a second virtual object. In some embodiments, a computer system changes a visual prominence of a respective virtual object based on a change in spatial location of a first virtual object with respect to a second virtual object. In some embodiments, a computer system applies visual effects to representations of physical objects, virtual environments, and / or physical environments. In some embodiments, a computer system changes a visual prominence of a virtual object relative to a three-dimensional environment based on display of overlapping objects of different types in the three-dimensional environment. In some embodiments, a computer system changes a level of opacity of a first virtual object overlapping a second virtual object in response to movement of the first virtual object.

The invention relates to the technical field of poultry breeding monitoring, and discloses a chicken flock state inspection monitoring system and method. The method comprises the following steps: firstly, collecting chicken flock visual images, sound signals, environment temperature and humidity and individual activity track data, and constructing a multi-modal data set through labeling and preprocessing; different modal data features are extracted and fused; training a self-supervised contrast learning model to generate a discrimination model, and optimizing hyper-parameters in combination with a genetic algorithm; collecting data in real time, calculating a health state probability, generating an abnormal score, and dynamically updating an early warning threshold value; and if the abnormal score exceeds a threshold value, grading early warning and abnormal positioning are carried out. The system comprises a data acquisition and preprocessing module, a feature extraction module, a feature fusion module and the like. According to the method, the health of the chicken flocks is accurately monitored by using multi-modal data, dynamic early warning and model adaptive optimization are realized, the breeding benefits are improved, and the disease risk is reduced.

The invention provides a reconstruction method of a three-dimensional reconstruction model based on two-dimensional Gaussian splashing, which comprises the following steps: S1, carrying out sparse reconstruction on an input image sequence through a multi-view stereoscopic vision algorithm to generate an initial sparse three-dimensional point cloud and a corresponding camera pose parameter; s2, inputting an improved two-dimensional Gaussian radiation field by using the sparse three-dimensional point cloud and the camera pose as information; s3, dynamically screening a visible anchor point subset based on the current view angle parameter, and generating a rendered image through a differentiable rendering pipeline; s4, calculating a loss function of the rendering image of the training track and the input image to optimize a reconstruction scene; and S5, starting a special visualization tool, and inputting a rendering result. According to the method, by introducing a trimmable anchor point parameterization framework and a multi-scale feature fusion mechanism, light-weight and high-precision three-dimensional scene modeling is achieved, and the problems that traditional 2D Gaussian sputtering is insufficient in multi-view geometric consistency, storage overhead and weak texture region reconstruction and an existing 2D Gaussian splashing method is insufficient in self-adaptive mechanism are solved.

SOLUTION: A semi-supervised medical image segmentation method based on a visual language model includes the steps of: obtaining a medical image; inputting an unlabeled image and a text description into a visual language model, and obtaining a text-guided mask based on obtained dense image embedding and text embedding; inputting a labeled image into a student model, and calculating supervised loss by using obtained labeled image prediction; respectively inputting the unlabeled image into the student model and a teacher model to obtain unlabeled image prediction and a pseudo label, merging the text-guided mask with the pseudo label, and calculating semi-supervised loss by using the merged pseudo label and unlabeled image prediction; and performing medical image segmentation by using a trained student model on the basis of the supervised loss and the semi-supervised loss.EFFECT: A target segmentation region can be accurately identified by using advantages of text descriptions.SELECTED DRAWING: Figure 1

The invention discloses an intelligent driving multi-sensor fusion data processing system, which belongs to the technical field of fusion data processing and comprises a data preprocessing unit, a data fusion unit and a data post-processing unit. The data preprocessing unit normalizes the original data of the laser radar, the camera, the millimeter wave radar and the ultrasonic sensor through a standardization, cleaning, noise reduction and calibration synchronization module; the feature level fusion module deeply digs the characteristics of each sensor, and fuses geometric, visual, motion and close-range obstacle features by using a deep neural network; the decision-making level fusion module generates a driving instruction through weighted voting and fuzzy logic reasoning through classification and situation evaluation; and the data post-processing unit combines the vehicle and road condition optimization instruction, evaluates the risk, and stores the data feedback optimization system. The system can improve the sensing precision and decision reliability, enhances the expansion adaptability of the system, and provides guarantee for safe and efficient operation of intelligent driving.

The invention discloses a historical block scene three-dimensional reconstruction method and system based on Gaussian sputtering, and the method comprises the steps: collecting a historical block video sequence through a lightweight panorama camera, extracting a multi-frame panorama, and generating an image data set through a projection converter; monocular depth and normal estimation is carried out through a pre-training visual model, and a prior depth and normal graph data set of a historical block scene is constructed; sparse reconstruction is carried out on the multi-view image data set based on the SfM technology, initial point cloud and camera pose information are acquired, and a Gaussian ellipsoid is optimized in combination with prior depth and normal information; dynamically calculating the geometric width estimation value of the street, and guiding and adjusting the adaptive density of the Gaussian ellipsoids of the vertical surfaces on the two sides; rendering the optimized Gaussian ellipsoid through an improved rasterization renderer; and designing a multi-modal loss function and a regularization mechanism to optimize reconstruction and rendering results. According to the method, high-fidelity three-dimensional reconstruction of the historical block scene is realized, and the adaptability of the Gaussian sputtering method to the complex block scene is enhanced.

The invention provides an early warning analysis method based on intelligent vision and a server, and the method comprises the steps: obtaining a multi-mode video stream containing a visible light and infrared thermal imaging image sequence through a vision collection device in a monitoring region, and carrying out the spatial-temporal feature extraction of the multi-mode video stream; the method comprises the steps of generating dynamic behavior sequence characteristics including a target object moving track, posture change and thermodynamic distribution characteristics, analyzing the dynamic behavior sequence characteristics through a preset abnormal behavior judgment model in a multi-dimensional matching mode, judging whether the target object triggers abnormal behavior characteristics or not, and if yes, generating a graded early warning signal in combination with an association weight. In addition, according to the spatial distribution and the time length of the abnormal behavior characteristics, the parameters of the acquisition equipment and the coverage range of the monitoring area are dynamically adjusted, and the subsequent video stream anomaly detection precision is optimized, so that intelligent and accurate early warning analysis is realized, and the security efficiency is improved.

The invention relates to the technical field of voice semantics, can be applied to business scenes of financial science and technology, medical health, poster design and the like, and discloses a visual sense generation method and device based on semantic association modeling, equipment and a medium. Generating a demand text containing theme and style parameters; semantic features in the demand text are extracted, semantic association weights are constructed, and element layout coordinates are optimized in combination with spatial distribution constraints; and encoding the layout information into a control matrix, fusing the control matrix with the initial noise, adjusting a noise reduction process through an encoding and decoding network, and generating target visual content highly matched with the semantic meaning of the user instruction. According to the method, the layout optimization function is constructed, the diffusion model is guided to focus the semantic salient region in space, language model output and the visual generation process are closely combined, structured response and space mapping of user semantic requirements are achieved, and the expression consistency and personalized adaptation capacity of visual content generation are improved.

The invention relates to the field of defect detection, in particular to a PCB defect detection method and system based on image recognition. The method comprises the following steps: collecting a multidirectional PCB detection image, carrying out pixel-level registration correction and adaptive pixel stability compensation, and constructing a space-time stability compensation image sequence; performing reverse pyramid structure division on the space-time stability compensation image sequence, performing normalized similarity probability calculation, and constructing an initial region classification result; based on an initial region classification result, depth image visual analysis is carried out, pseudo defect comprehensive elimination optimization is carried out, and a pseudo defect purification high-confidence image is constructed; pCB connection defect identification is carried out on the pseudo defect purification high-confidence image, global defect point distribution marking is carried out, and a defect point space distribution diagram is constructed. According to the invention, high-credibility, high-precision and high-closed-loop PCB defect detection is realized.

A system and method for adaptive image and video processing using a Persistent Cognitive Machine (PCM) architecture with visual strategy caching. The system receives degraded input media and extracts degradation fingerprints to query a PCM-based visual strategy cache containing previously successful processing strategies. When matching cached strategies are found above a relevance threshold, they are retrieved and applied directly. When no match exists, the input is processed through transform-domain networks to generate new strategies. A pattern synthesizer combines multiple strategies for complex degradation types. The system evaluates processing effectiveness using a feedback controller and stores successful strategies in the hierarchical cache. This cognitive approach enables real-time processing with continuously improving performance as the cache learns from successful patterns. The adaptive architecture eliminates redundant processing while maintaining high-quality output, making it suitable for diverse imaging and video applications requiring efficient enhancement capabilities with superior performance over traditional methods.

The invention discloses a video super-resolution reconstruction method and system, and relates to the technical field of video restoration processing, and the method comprises the steps: collecting a to-be-reconstructed video frame sequence and a reference frame sequence; extracting a dense optical flow field between the reference frame and the target frame; performing geometric alignment on the target frame to the reference frame according to the dense optical flow field to obtain a motion consistency feature; performing feature extraction on the video frame sequence through a parameterized residual scaling module; inputting the extracted features into a bidirectional propagation module to process forward and backward image sequences respectively, extracting time sequence forward features and time sequence reverse features, and fusing the features to obtain detail features; carrying out adaptive fusion on the motion consistency features and the detail features, and sending the fused features into a reconstruction network to obtain deep visual features; pixel-level adaptive reconstruction is realized according to the deep visual features, and a super-resolution video sequence is obtained; according to the method, the feature space consistency is kept, and meanwhile, the feature matching precision in a complex motion scene is remarkably improved.

The invention relates to the technical field of intelligent assessment and decision making, in particular to a robot dynamic risk assessment and decision making system and method based on multi-modal perception, and the system comprises a multi-modal sensor module which is used for collecting environment vision, acoustics, mechanics and position data in real time; the edge calculation unit is used for carrying out space-time alignment and feature fusion on the sensor data; the dynamic risk assessment model is used for integrating the environment uncertainty quantification module and the robot state prediction module based on a reinforcement learning framework; the decision execution interface is used for outputting a risk level and obstacle avoidance, speed reduction and shutdown instructions; by integrating visual, acoustic, mechanical and position multi-source sensor data and the like, the system can comprehensively capture various risk factors in a complex dynamic environment, so that the defect that a traditional single sensor system is insufficient in sensing dimension is overcome, and the system is particularly suitable for terrains and weather conditions with variable regions.

The invention discloses an underwater robot autonomous obstacle avoidance and path planning system based on a multi-modal sensor, particularly relates to the field of underwater robot navigation, solves the problems of multi-modal sensing and path planning in a complex environment, and unifies the feature space of a multi-source heterogeneous sensor based on a physical field correction mode of an acousto-optic fluctuation rule. Fusion deviation caused by physical property difference of sonar and visual data is overcome, and obstacle characterization precision and dynamic environment adaptability are remarkably improved; a dynamic confidence decision-making mechanism is combined with a path curvature-moment constraint model, the environmental perception credibility and the robot motion performance are synchronously fused into a path generation process, the feasibility of motion control is ensured while the geometric collision risk is avoided, and the contradiction between the safety and the performability in path planning is solved; the global path optimization eliminates the hidden danger of local path sudden change through iterative smoothing under double constraints of physical field and dynamics, and forms an optimal navigation scheme considering obstacle avoidance efficiency, energy consumption and motion stability.

The invention provides a printing piece defect detection method and system based on machine vision, and relates to the technical field of machine vision, and the method comprises the steps: determining an optimal detection scale through image enhancement processing, multi-scale gradient pyramid construction and mutual information calculation, extracting key points through a curvature value, and carrying out the shape discrimination. And finally, generating a laser etching compensation path based on defect characteristics and performing layered compensation processing. According to the method, the automobile part surface printing flaws can be accurately identified, the compensation strategy is adaptively generated according to the defect types, and the defect repairing precision and efficiency are improved.

A ground visual question-answering method based on dynamic dual-level visual information fusion includes using a dual-level multiscale network, which is divided into language-guided pixel-level features and region-level features. These two scale branches are combined to predict the final textual answer and ground answer. Furthermore, a question-guided dynamic region-level feature localization network is proposed to locate visual information guided by the question and adaptively assign masks of different sizes to ground answers, thereby enhancing the accuracy of locating and segmenting small targets. Additionally, a cross-modal aggregation module is designed to fuse features from both levels, enhancing the fusion of pixel-level and region-level features to improve the segmentation effect of ground answer masks' edges. The ground visual question-answering system built by the language-guided adaptive dual-level feature fusion network in this invention can effectively improve the accuracy of the entire model while answering questions and generating answer ground masks simultaneously.

The invention discloses a global dynamic optimization system for an ultra-high-definition glass-based display screen. The operation process of the system specifically comprises the following steps: acquiring a real-time state data set of the display screen; generating an initial optimization parameter set based on a preset optimization strategy and the user behavior model; capturing a user interaction signal and an environment change signal in real time; generating a dynamic correction coefficient set according to the user interaction signal and the environment change signal; performing global parameter fusion based on the initial optimization parameter set and the dynamic correction coefficient set to generate a target optimization instruction set; and feeding back an optimization effect evaluation table based on the optimization effect. The method has the following advantages and effects: collaborative optimization and thermodynamic balance of global display parameters are realized, the system can balance visual experience improvement and thermal diffusion suppression requirements in real time through multi-dimensional data fusion and global parameter collaborative calculation, and the system can improve the visual experience while enhancing local contrast and optimizing color rendition. And actively inhibiting the temperature rise of the screen through thermodynamic equilibrium constraint.

A long video understanding method based on iterative hierarchical key frame selection comprises the following steps: firstly, carrying out hierarchical frame sampling on an input video to obtain hierarchical visual features, and then carrying out a key frame query module on the Nth-layer visual features of a video frame and an input problem text to obtain a key frame query result; video key frame query is carried out in combination with context semantics to generate query vectors, whether the query vectors are enough to generate answers to the input questions is predicted, if not, the query key frames are updated in the (N + 1) th layer of visual features with the higher frame rate, and the input question texts are combined with the context semantics to carry out iterative query of the key frames again; and inputting the inquired key frame and the instruction or the question into a multi-mode large model to generate an understanding result. According to the method, the video frames are queried and the associated frames are screened out based on the user input problem, so that the performance and efficiency of long video understanding are improved, and the method has wide application prospects in scenes such as entertainment, security and education.

The invention relates to the field of electric power monitoring, and discloses an electric power monitoring system and method fusing image recognition and data analysis, and the method comprises the steps: carrying out the visual angle coverage modeling of a target equipment group through a multi-type visual collection unit disposed at a transformer substation and a power distribution terminal; performing cross-frame fine-grained texture differential analysis on the equipment state image sequence, and constructing an image event time window in combination with synchronous disturbance characteristics of multi-source monitoring parameters; based on the high-vigilance candidate frame set, fusing the image structure variability index and the operation data multi-dimensional deviation vector by using a feature encoder, and constructing a multi-modal state coupling feature tensor; map mapping is carried out on the potential fault evolution trend, and semantic association is established between structural nodes with abnormal attributes in the image and frequently fluctuating parameter indexes in the monitoring data; and combining a node interference path in the local fault association subgraph with fault precursor distribution induced in a historical accident sample. The method has the advantage that the operation safety is improved.

The invention discloses a portal crane grab bucket control system and method based on multi-sensor fusion, and particularly relates to the technical field of portal crane grab bucket control. Image acquisition equipment and multiple types of sensors are arranged in a portal crane operation area, a multi-dimensional input data set under a unified time sequence is constructed, an optimized visual detection model and an attention mechanism are combined, high-precision recognition and abnormity judgment of the grab bucket state are achieved, and the system not only can automatically plan a grabbing path and a posture adjusting instruction, but also can automatically adjust the grabbing posture of the grab bucket. And control parameters can be dynamically optimized according to the grabbing effect and pose feedback, the grab bucket recognition accuracy, the control stability and the system intelligence level are remarkably improved, and particularly higher robustness and reliability are shown in the small-size, complex-pose or multi-target operation environment.