130440results about "Image enhancement" patented technology

A system and method are disclosed for generating hyperspectral images from multi-modal sensor data including RGB, LiDAR, thermal, and near-infrared inputs. Training data includes hyperspectral images and corresponding multi-modal measurements. Spectral band grouping is performed based on correlation coefficients. A multi-modal decomposition network with cross-modal attention mechanisms generate reconstructed hyperspectral images by fusing complementary sensor information. A fine-tuning network creates reconstructed RGB images. A comprehensive quality assurance system analyzes spectral consistency, cross-modal coherence, and fusion artifacts to generate quality metrics. Missing data compensation strategies handle corrupted sensor inputs using information from other modalities. The system includes temporal integration for video sequences and multi-resolution processing for different sensor resolutions. Quality metrics guide network weight adjustments to improve reconstruction accuracy while maintaining robustness to sensor failures and environmental variations.

Provided is a road crack detection method, a medium and a product. The lightweight YOLO-MCS road crack detection model is constructed based on an improved yolov8 network. A method of improving the yolov8 network includes: replacing a feature extraction network backbone with a lightweight convolutional neural network MobileNetV3, and embedding a Coordinate Attention Mechanism (CA) module in the lightweight convolutional neural network MobileNetV3; adding a small target detection layer and a Squeeze and Excitation (SE) module at a neck end; and introducing a loss function of power Intersection over Union (IoU) into a head prediction structure. The road crack detection method overcomes the problem that the existing detection algorithm has low detection precision for small cracks and is difficult to be applied to edge devices with limited computing resources.

Disclosed in the present invention is a salient contour matching-based method for target measurement in a severe imaging environment. The method specifically comprises: (1) acquiring a binocular image of a target; (2) establishing a global-local joint constraint-based background light estimation model, and removing a scattering effect of a medium in an imaging environment to obtain a restored left eye image and a restored right eye image; (3) learning an original image, and on the basis of a residual between a network reconstructed image and the original image, obtaining target localization prediction maps of the left eye image and the right eye image; and (4) respectively extracting contour lines of the target in the left eye image and the right eye image, constructing feature matching descriptors of contour points, performing stereo matching on the two sets of contour lines by minimizing matching cost, and performing three-dimensional reconstruction on the contour lines in light of calibrated intrinsic and extrinsic parameters to complete the measurement of a key size. According to the present invention, the key sizes of different targets in a severe environment can be accurately measured, thereby providing an effective solution for the problem of measuring the sizes of targets in a severe environment.

The invention discloses a visible light and infrared image fusion method based on cross-modal dynamic collaboration. The method comprises the following steps: respectively extracting texture detail features of a visible light image and thermal radiation features of an infrared image through a visible light encoder and an infrared encoder; spatial alignment and channel complementarity optimization of cross-modal features are realized by using a heterogeneous attention collaboration module; and performing layered fusion on deep semantics and shallow detail features through a dynamic gating multi-scale decoder to generate a high-resolution fusion image. According to the method, the problems of feature dislocation, detail loss and unreasonable fusion weight distribution caused by modal difference in the prior art are solved, the detail fidelity, the thermal target saliency and the complex scene adaptability of the fusion image can be remarkably improved, and a high-robustness fusion result is provided for low-illumination environment perception and multi-modal target recognition.

The invention discloses a high-precision image processing method and system based on illumination adaptive compensation, and relates to the technical field of computer vision and image processing, and the method comprises the steps: inputting an original image, and dividing the image into a high-frequency edge layer, an intermediate-frequency texture layer and a low-frequency illumination layer through a multi-scale residual network; acquiring illumination intensity, color temperature and scene categories in real time by using an ambient light sensor and a scene semantic segmentation model, and generating dynamic compensation parameters; carrying out dynamic range expansion on a low-frequency illumination layer based on a physical illumination model, and adjusting the weight of highlight suppression and dark area enhancement through a self-adaptive S-shaped exposure curve; a double-branch generative adversarial network is adopted, noise suppression and super-resolution reconstruction are carried out on the high-frequency layer, and texture detail enhancement is carried out on the intermediate-frequency layer; aligning the data of the depth camera and the infrared sensor with the visible light image through a cross-modal fusion module; and performing tone mapping on the fused image based on human visual characteristics, and outputting an enhanced image with a high dynamic range and reserved details.

The present application relates to a weld seam surface defect detection method and system. The weld seam surface defect detection method comprises: performing multi-angle and multi-surface acquisition of target surface images; then, reconstructing normal maps of the target surface images by means of a high-performance algorithm, and clarifying normal features of defects; and finally, on the basis of the surface normal features, aiming at transverse texture defects and height mutation defects, respectively designing a transverse texture defect detection algorithm based on two stages and rotated rectangle extraction and a height mutation defect detection algorithm based on adaptive dual-threshold segmentation. The present application overcomes texture noise and pseudo-defect interference of ground surfaces, effectively solves the problems of difficulty in feature extraction and positioning of ground surfaces of steel rail weld seams, and has the system operating efficiency superior to that of existing detection methods, thus satisfying requirements of actual production.

Disclosed are a high-performance loosely-coupled multi-modal data fusion system for a smart driving environmental perception system and a vehicle-mounted device, comprising: a fusion detection model based on a modality-independent feature interaction strategy, which is configured for converting a LiDAR point cloud, a camera image, and a millimeter-wave radar point cloud into a unified bird's-eye view representation, and performing multi-modal fusion; and a fusion tracking model based on a motion-appearance feature cascaded coupling data association strategy, which is configured for performing subsequent trajectory tracking and matching according to multi-modal fusion feature information. A VoD data set and a K-Radar data set are selected for training, verifying, and testing the comprehensive performance of the models, and a TensorRT accelerated inference model is applied, then quantized, and deployed to a vehicle-mounted computational testing platform. The present invention is compatible with mainstream sensor deployment solutions, and achieves the efficient complementary fusion of multi-source heterogeneous sensor information, significantly improving the reliability, accuracy, and adaptability of vehicle-mounted perception systems, thereby effectively responding to extreme operating conditions such as complex traffic scenarios and inclement weather.

The present invention provides a facial recognition system using deep learning methodologies while integrating privacy-preserving capabilities. This system employs convolutional neural networks (CNNs) to extract and classify facial features, ensuring high accuracy in recognition tasks. Moreover, the system addresses privacy concerns by incorporating techniques such as facial feature encryption and anonymization, thereby enhancing user privacy and data security. This invention is applicable across various domains, including security, surveillance, access control, and personalized services, where facial recognition is utilized while preserving individual privacy.

The present invention provides an automatic intelligent inspection system for the equipment, facilities and surrounding environment along a railway line, including an unmanned aerial vehicle (UAV), a movable ground base station, a remote server and a working computer, wherein the working computer includes an image processing module that is configured to detect an obtained image by using a deep learning network model trained with a database in advance, obtain any object that is suspected to involve a defect by analysis, and transmit the object for manual review while calculating for the specific geographic coordinate information of the defect, report for early warning after the defect is confirmed by the manual review, inform the operation and maintenance personnel, and store and record the defect. The present invention further provides a method for inspection by using the automatic intelligent inspection system for the equipment, facilities and surrounding environment along a railway.

The invention relates to a high-voltage equipment defect detection method based on deep learning and multispectral image fusion, and relates to the technical field of electric power high-voltage equipment state detection. The method comprises the following steps: acquiring an ultraviolet image, an infrared image and a visible light image of the surface of the high-voltage equipment; carrying out image pixel feature-based fusion processing on the ultraviolet image, the infrared image and the visible light image through an image fusion method; establishing a high-voltage equipment defect detection model, and training the high-voltage equipment defect detection model by using the fused image data to obtain a high-voltage equipment defect identification model based on the YOLO-STrans multispectral fusion network; and inputting the ultraviolet image, the infrared image and the visible light image of the outer surface of the power high-voltage equipment into a high-voltage equipment defect identification model to obtain a fault identification result of the to-be-detected power high-voltage equipment. The method can improve the recognition precision of the extremely early insulation degradation and temperature anomaly defects of the surface of the high-voltage power equipment.

The present invention relates to an adaptive sensing-based lightweight monitoring method for a fine crack in a complex background region. The method comprises the following steps: step S1, on the basis of region division, performing automatic acquisition of crack information, wherein PTZ camera sensors are used to automatically perform block-wise acquisition on crack regions; step S2, performing an adaptive complex scale calibration process, using a multi-scale template matching algorithm to adaptively correct distortion information of all regions, and performing real-scale conversion from pixel precision; step S3, constructing a lightweight crack segmentation network to process data processed in step S2; and step S4, by means of a quantitative crack-tracking algorithm based on Euclidean distance similarity classification, performing real-time monitoring on each piece of crack dynamic information. Compared with the prior art, the present invention has advantages such as achieving efficient, accurate, and online monitoring and analysis of cracks.

The invention discloses a building digital twinning three-dimensional reconstruction method and system based on a large model, and relates to the technical field of building digital twinning and three-dimensional modeling fusion, and the method comprises the steps: laying multi-source equipment in a building, collecting building multi-angle data, and carrying out type distinguishing and structured preprocessing. An adaptive deep network model is constructed and trained to identify building features, and the robustness of the model is improved by adopting a multi-type enhancement strategy. Point cloud splicing and coordinate unification are realized by using a fusion algorithm, and twin model updating and synchronization are realized based on a multi-dimensional threshold. According to the method, high-quality input is established for a depth model; building structure feature recognition has the advantages of robustness and precision; and the twinborn model has dynamic updatable capability. The three parts form a complete closed loop, the technical bottlenecks of a traditional reconstruction method in precision, stability and renewability are finally broken through, and a new building digital twinning three-dimensional modeling path facing a complex scene is achieved.

The invention relates to the field of semiconductor packaging material defect detection, in particular to a semiconductor packaging material defect detection method based on deep learning, which comprises the following steps: acquiring a surface image, and extracting a two-dimensional contour and a feature point set; preprocessing the image, and separating a packaging material main body area; constructing a two-dimensional defect identification model based on Transform, and outputting a two-dimensional detection result; scanning suspected and unknown defect areas to obtain three-dimensional point cloud data, and extracting geometric and texture features; fusing two-dimensional and three-dimensional data through a space-time alignment model; utilizing the multi-modal fusion model to output defect positions and types; and evaluating the defect importance based on the material node connectivity and the stress distribution, and generating a visual detection report. According to the invention, high-precision detection of semiconductor packaging material defects is realized, the defect identification rate, the positioning precision and the detection efficiency are improved through multi-modal data fusion and a deep learning model, and a visual report can be generated based on material structure quantification defect importance.

The invention relates to the technical field of LED display, solves the problem that the existing LED display defect detection and parameter adjustment technology is lack of multi-modal information fusion and intelligent process control capability and is difficult to meet the quality control requirement of a high-precision display product, and provides an LED display defect prediction and process adjustment method and system based on multi-modal fusion. The method comprises the following steps: performing multi-modal data fusion processing on optical image data, electrical test data and thermal infrared imaging data corresponding to a to-be-tested LED display screen to obtain fused data; inputting the fused data into a pre-trained defect recognition model to obtain a defect recognition result; according to a process parameter adjustment strategy corresponding to the defect identification result, adjusting the original process parameter to obtain a target process parameter; and according to the target process parameters, process flow correction processing is carried out, and a qualified LED display screen is produced. According to the method, the defect identification precision is improved, and the quality control requirement of high-precision LED display screen production is met.

The present invention relates to the technical field of stomatology. Provided is an auxiliary dental implant generation method based on a diffusion model. The method in the present invention comprises: acquiring oral CBCT image data of historical patients, preprocessing the oral CBCT image data of the historical patients to obtain a CBCT image dataset, using the CBCT image dataset to train a multi-task segmentation network, and using the segmentation network to obtain an intraoral tissue segmentation result; using the intraoral tissue segmentation result to train detection networks from the three dimensions of a cross-sectional plane, a coronal plane and a sagittal plane, respectively; using the detection networks to obtain detection results in the three directions of the cross-sectional plane, the coronal plane and the sagittal plane; fusing the detection results in the three directions of the cross-sectional plane, the coronal plane and the sagittal plane, and using a majority voting algorithm to construct a three-dimensional bounding box, so as to acquire an edentulous area; and using the intraoral segmentation result and the edentulous area as prompt information to guide, by means of an iterative process, a network to generate a post-implantation effect. The implantation effect obtained by the present invention is highly accurate, thereby providing a more precise auxiliary tool for stomatology.

The invention provides a reconstruction method of a three-dimensional reconstruction model based on two-dimensional Gaussian splashing, which comprises the following steps: S1, carrying out sparse reconstruction on an input image sequence through a multi-view stereoscopic vision algorithm to generate an initial sparse three-dimensional point cloud and a corresponding camera pose parameter; s2, inputting an improved two-dimensional Gaussian radiation field by using the sparse three-dimensional point cloud and the camera pose as information; s3, dynamically screening a visible anchor point subset based on the current view angle parameter, and generating a rendered image through a differentiable rendering pipeline; s4, calculating a loss function of the rendering image of the training track and the input image to optimize a reconstruction scene; and S5, starting a special visualization tool, and inputting a rendering result. According to the method, by introducing a trimmable anchor point parameterization framework and a multi-scale feature fusion mechanism, light-weight and high-precision three-dimensional scene modeling is achieved, and the problems that traditional 2D Gaussian sputtering is insufficient in multi-view geometric consistency, storage overhead and weak texture region reconstruction and an existing 2D Gaussian splashing method is insufficient in self-adaptive mechanism are solved.

SOLUTION: A semi-supervised medical image segmentation method based on a visual language model includes the steps of: obtaining a medical image; inputting an unlabeled image and a text description into a visual language model, and obtaining a text-guided mask based on obtained dense image embedding and text embedding; inputting a labeled image into a student model, and calculating supervised loss by using obtained labeled image prediction; respectively inputting the unlabeled image into the student model and a teacher model to obtain unlabeled image prediction and a pseudo label, merging the text-guided mask with the pseudo label, and calculating semi-supervised loss by using the merged pseudo label and unlabeled image prediction; and performing medical image segmentation by using a trained student model on the basis of the supervised loss and the semi-supervised loss.EFFECT: A target segmentation region can be accurately identified by using advantages of text descriptions.SELECTED DRAWING: Figure 1

The invention discloses a machine vision-based resistor disc defect online detection system and a grading method, relates to the technical field of industrial machine vision detection, and solves the defect problems in the aspects of multi-scale defect dynamic perception, cross-level feature interaction and process adaptive optimization in the prior art. According to the scheme, metal reflection interference is inhibited through Retinex illumination correction and a combined denoising model; adopting a deformable convolution kernel and cavity space pyramid pooling to realize gradient entropy driving dynamic sensing of the multi-scale defect; constructing a bidirectional cross-layer attention network to realize early fusion of high-resolution details and high-level semantics; modeling local-global feature physical association based on a graph attention network and a self-supervised message passing mechanism; integrating reinforcement learning and a memristor random calculation unit to form a closed-loop parameter optimization system; according to the method, the multi-scale defect detection precision, the cross-modal feature fusion efficiency and the system adaptive capacity under complex working conditions are remarkably improved.

The invention discloses a historical block scene three-dimensional reconstruction method and system based on Gaussian sputtering, and the method comprises the steps: collecting a historical block video sequence through a lightweight panorama camera, extracting a multi-frame panorama, and generating an image data set through a projection converter; monocular depth and normal estimation is carried out through a pre-training visual model, and a prior depth and normal graph data set of a historical block scene is constructed; sparse reconstruction is carried out on the multi-view image data set based on the SfM technology, initial point cloud and camera pose information are acquired, and a Gaussian ellipsoid is optimized in combination with prior depth and normal information; dynamically calculating the geometric width estimation value of the street, and guiding and adjusting the adaptive density of the Gaussian ellipsoids of the vertical surfaces on the two sides; rendering the optimized Gaussian ellipsoid through an improved rasterization renderer; and designing a multi-modal loss function and a regularization mechanism to optimize reconstruction and rendering results. According to the method, high-fidelity three-dimensional reconstruction of the historical block scene is realized, and the adaptability of the Gaussian sputtering method to the complex block scene is enhanced.

The invention relates to the field of defect detection, in particular to a PCB defect detection method and system based on image recognition. The method comprises the following steps: collecting a multidirectional PCB detection image, carrying out pixel-level registration correction and adaptive pixel stability compensation, and constructing a space-time stability compensation image sequence; performing reverse pyramid structure division on the space-time stability compensation image sequence, performing normalized similarity probability calculation, and constructing an initial region classification result; based on an initial region classification result, depth image visual analysis is carried out, pseudo defect comprehensive elimination optimization is carried out, and a pseudo defect purification high-confidence image is constructed; pCB connection defect identification is carried out on the pseudo defect purification high-confidence image, global defect point distribution marking is carried out, and a defect point space distribution diagram is constructed. According to the invention, high-credibility, high-precision and high-closed-loop PCB defect detection is realized.

A system and method for adaptive image and video processing using a Persistent Cognitive Machine (PCM) architecture with visual strategy caching. The system receives degraded input media and extracts degradation fingerprints to query a PCM-based visual strategy cache containing previously successful processing strategies. When matching cached strategies are found above a relevance threshold, they are retrieved and applied directly. When no match exists, the input is processed through transform-domain networks to generate new strategies. A pattern synthesizer combines multiple strategies for complex degradation types. The system evaluates processing effectiveness using a feedback controller and stores successful strategies in the hierarchical cache. This cognitive approach enables real-time processing with continuously improving performance as the cache learns from successful patterns. The adaptive architecture eliminates redundant processing while maintaining high-quality output, making it suitable for diverse imaging and video applications requiring efficient enhancement capabilities with superior performance over traditional methods.

The invention discloses a polyethylene plastic hollow plate defect detection method and system, and relates to the technical field of nondestructive testing, the system is composed of a plurality of functional modules, and the system comprises: a multi-mode sensing module for collecting multi-source data including a hollow plate surface image, three-dimensional morphology data and an ultrasonic reflection signal; the historical database construction module is used for performing space-time alignment and feature level fusion on the multi-source data to generate a composite defect feature matrix; collecting ultrasonic signal waveforms of known defects, extracting characteristic parameters, and establishing a historical waveform library; calculating a characteristic parameter classification range of each type of defects based on a historical waveform library; judging whether the detection waveform parameter falls into a classification range corresponding to the processing noise or not, and if so, rejecting the signal; otherwise, keeping; and the defect area identification module is used for dividing the surface of the hollow plate into uniform grids based on the surface image of the hollow plate, and counting the density of the residual ultrasonic detection sources in each grid.

The disclosure discloses a surface defect detection method, system, equipment, and terminal, comprising: S1, LBP operator: before comparing the benchmark image with the actual shot image, a LBP texture feature extraction algorithm is first used for pre-processing; S2, Sift feature-point matching: adding a Sift feature-point matching algorithm to calculate key feature points in the image and compare; S3, defect detection: when the local feature points of the shot image are successfully matching with a certain image in the benchmark image library, a detailed comparison will be made and complete defect detection. The disclosure integrates various image processing methods in advance without any setting by users. After running the system with one click, it can automatically perform detection, greatly reducing personnel training costs. The disclosure has simple structure and low cost. The basic structure only needs a computer, camera, and light source, making it easy to use and with highly mobile.

The invention discloses a construction site safety risk intelligent early warning system and method based on BIM and big data analysis, relates to the technical field of building engineering construction safety, and solves the problem that it is difficult to transmit construction site multi-source data which is collected and preprocessed in real time in real time and carry out space mapping with a BIM model. A rule engine is difficult to carry out initial early warning; a machine learning model is difficult to analyze time series data, predict collapse risks and identify dangerous behaviors; a risk prediction model is difficult to construct and is difficult to integrate into a BIM model; and pushing and closed-loop management are difficult to carry out on the risk early warning information. According to the method, the multi-source data is collected at the construction site, the digital twinborn scene is constructed by mapping the multi-source data to the BIM model by means of space-time alignment, the multi-source data is analyzed and processed by applying technologies such as a rule engine and a machine learning algorithm, and the result is integrated to the BIM model, so that visual risk monitoring and early warning are realized.

The invention relates to the technical field of welding defect identification, and discloses a welding defect identification method and system based on a molten pool image. According to the method, a multispectral high-speed camera is used for collecting a molten pool dynamic image sequence in the welding process, after multi-scale morphological filtering preprocessing is conducted, a fusion feature vector is extracted through a depth separable convolutional network, and then the fusion feature vector is input into a defect classification model adopting a heterogeneous graph neural network architecture to obtain a defect probability distribution matrix. Then, constructing a dynamic sparse optimization model to position defects, generating a defect space coordinate set, and finally, outputting welding defect types and position information through hierarchical verification framework processing. According to the method, the problems of welding image noise interference, complex defect characteristics and the like are effectively solved, the accuracy and reliability of welding defect identification are improved, and powerful technical support is provided for welding quality control.

An example operation includes one or more of logging user actions with respect to placement of objects of content on a user interface including respective content types of the objects of content, training an artificial intelligence (AI) model to learn location preferences for a content type on the user interface based on the logged user actions including the respective content types, receiving a request to open an object on the user interface with the content type, determining a display location on the user interface for the object based on execution of the AI model on the content type, and displaying the object at the determined display location on the user interface.

The invention relates to the technical field of PCB detection, and discloses a PCB defect detection method and system, and the method comprises the steps: collecting multispectral imaging data through an image collection module, and generating an original image data set; the defect analysis server receives the synchronous imaging data to construct a three-dimensional surface topology matrix; in combination with the original image data set and the real-time imaging data, performing multi-scale decomposition on the three-dimensional surface topological matrix, extracting texture features, positioning a defect region, outputting defect type space distribution features through a layered recognition model, and updating the original image data set; and dynamically calibrating the detection parameters according to the feature categories. The system comprises an image acquisition module group, a data transmission module, a three-dimensional modeling module, a defect identification module and a parameter calibration module. According to the scheme, the accuracy, comprehensiveness and efficiency of defect detection are improved, and the detection requirements of modern PCB production are met.

Disclosed are methods and apparatus for qualifying a photolithographic reticle. A reticle inspection tool is used to acquire images at different imaging configurations from each of a plurality of pattern areas of a test reticle. A reticle near field for each of the pattern areas of the test reticle is recovered based on the acquired images from each pattern area of the test reticle. A lithography model is applied to the reticle near field for the test reticle to simulate a plurality of test wafer images, and the simulated test wafer images are analyzed to determine whether the test reticle will likely result in an unstable or defective wafer.

An agricultural vehicle may include a propulsion system, a steering system, and a vehicle controller. An agricultural vehicle may include a camera sensor having a camera field of view (CFOV), a light detection and ranging (LiDAR) sensor having a LiDAR field of view (LFOV), and an imaging controller in operable communication with the camera sensor and the LiDAR sensor. The imaging controller may include a processor and at least one non-transitory computer-readable storage medium having instructions store thereon that, when executed by the at least one processor cause the imaging controller to, at least, receive image data, segment the image data, fuse LiDAR data and the image data, create a fused instance including depth information; and provide at least the fused instance to the vehicle controller, wherein the vehicle controller is configured to provide at least one navigational command based at least partially on the fused instance.

Systems and methods are disclosed for classifying objects using electro-optical and synthetic aperture radar images through multi-modal feature alignment and fusion. A computing system acquires and preprocesses image data, then aligns features across modalities using a multi-modal alignment engine. A cross-modal attention fusion network extracts and integrates complementary information using transformer-based attention mechanisms. A modality-specific feature extraction framework processes EO and SAR images through specialized branches, ensuring optimal feature representation. An adaptive fusion decision system dynamically determines the best fusion strategy based on image quality and confidence scores. A self-supervised consistency controller enforces alignment between EO and SAR features using contrastive learning. The fused representations are processed by a neural network to generate object classifications. This system improves accuracy and robustness in environments where one modality may be degraded or missing, enhancing applications such as remote sensing, surveillance, and autonomous navigation.