Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

19884 results about "Image resolution" patented technology

Image resolution is the detail an image holds. The term applies to raster digital images, film images, and other types of images. Higher resolution means more image detail. Image resolution can be measured in various ways. Resolution quantifies how close lines can be to each other and still be visibly resolved. Resolution units can be tied to physical sizes (e.g. lines per mm, lines per inch), to the overall size of a picture (lines per picture height, also known simply as lines, TV lines, or TVL), or to angular subtense. Line pairs are often used instead of lines; a line pair comprises a dark line and an adjacent light line. A line is either a dark line or a light line. A resolution of 10 lines per millimeter means 5 dark lines alternating with 5 light lines, or 5 line pairs per millimeter (5 LP/mm). Photographic lens and film resolution are most often quoted in line pairs per millimeter.

System and Method for Multi-Modal Hyperspectral Image Generation with Cross-Modal Attention and Adaptive Quality Assurance

A system and method are disclosed for generating hyperspectral images from multi-modal sensor data including RGB, LiDAR, thermal, and near-infrared inputs. Training data includes hyperspectral images and corresponding multi-modal measurements. Spectral band grouping is performed based on correlation coefficients. A multi-modal decomposition network with cross-modal attention mechanisms generate reconstructed hyperspectral images by fusing complementary sensor information. A fine-tuning network creates reconstructed RGB images. A comprehensive quality assurance system analyzes spectral consistency, cross-modal coherence, and fusion artifacts to generate quality metrics. Missing data compensation strategies handle corrupted sensor inputs using information from other modalities. The system includes temporal integration for video sequences and multi-resolution processing for different sensor resolutions. Quality metrics guide network weight adjustments to improve reconstruction accuracy while maintaining robustness to sensor failures and environmental variations.
Owner:ATOMBEAM TECH INC

Visible light and infrared image fusion method based on cross-modal dynamic collaboration

The invention discloses a visible light and infrared image fusion method based on cross-modal dynamic collaboration. The method comprises the following steps: respectively extracting texture detail features of a visible light image and thermal radiation features of an infrared image through a visible light encoder and an infrared encoder; spatial alignment and channel complementarity optimization of cross-modal features are realized by using a heterogeneous attention collaboration module; and performing layered fusion on deep semantics and shallow detail features through a dynamic gating multi-scale decoder to generate a high-resolution fusion image. According to the method, the problems of feature dislocation, detail loss and unreasonable fusion weight distribution caused by modal difference in the prior art are solved, the detail fidelity, the thermal target saliency and the complex scene adaptability of the fusion image can be remarkably improved, and a high-robustness fusion result is provided for low-illumination environment perception and multi-modal target recognition.
Owner:ZHEJIANG SCI-TECH UNIV

High-precision image processing method and system based on illumination adaptive compensation

The invention discloses a high-precision image processing method and system based on illumination adaptive compensation, and relates to the technical field of computer vision and image processing, and the method comprises the steps: inputting an original image, and dividing the image into a high-frequency edge layer, an intermediate-frequency texture layer and a low-frequency illumination layer through a multi-scale residual network; acquiring illumination intensity, color temperature and scene categories in real time by using an ambient light sensor and a scene semantic segmentation model, and generating dynamic compensation parameters; carrying out dynamic range expansion on a low-frequency illumination layer based on a physical illumination model, and adjusting the weight of highlight suppression and dark area enhancement through a self-adaptive S-shaped exposure curve; a double-branch generative adversarial network is adopted, noise suppression and super-resolution reconstruction are carried out on the high-frequency layer, and texture detail enhancement is carried out on the intermediate-frequency layer; aligning the data of the depth camera and the infrared sensor with the visible light image through a cross-modal fusion module; and performing tone mapping on the fused image based on human visual characteristics, and outputting an enhanced image with a high dynamic range and reserved details.
Owner:SHANXI UNIV

Resistor disc defect online detection system and grading method based on machine vision

The invention discloses a machine vision-based resistor disc defect online detection system and a grading method, relates to the technical field of industrial machine vision detection, and solves the defect problems in the aspects of multi-scale defect dynamic perception, cross-level feature interaction and process adaptive optimization in the prior art. According to the scheme, metal reflection interference is inhibited through Retinex illumination correction and a combined denoising model; adopting a deformable convolution kernel and cavity space pyramid pooling to realize gradient entropy driving dynamic sensing of the multi-scale defect; constructing a bidirectional cross-layer attention network to realize early fusion of high-resolution details and high-level semantics; modeling local-global feature physical association based on a graph attention network and a self-supervised message passing mechanism; integrating reinforcement learning and a memristor random calculation unit to form a closed-loop parameter optimization system; according to the method, the multi-scale defect detection precision, the cross-modal feature fusion efficiency and the system adaptive capacity under complex working conditions are remarkably improved.
Owner:NANYANG GOLDEN CROWN IND CO LTD

AI-based leak detection and localization system in water distribution infrastructures

A system for AI-supported leak detection and localization in water distribution infrastructures, consisting of: a large number of distributed sensor nodes mounted along a water pipe, each sensor node comprising the following: a pressure sensor configured to measure local hydraulic pressure fluctuations within the pipeline with a resolution of at least 0.01 bar; a flow sensor configured to measure the volume flow within the pipeline with an accuracy of at least ±0.5% of the measured value; an acoustic sensor configured to detect vibration signatures caused by leaks in a frequency range between 50 Hz and 20 kHz; an embedded microcontroller with integrated analog-to-digital conversion circuitry for digitizing sensor outputs; a wireless communication module configured to transmit time-synchronized sensor data to a cloud-based processing platform; and a local energy subsystem with a rechargeable battery and an optional circuit for generating photovoltaic energy; the cloud-based processing platform includes an artificial intelligence engine that comprises the following: a data acquisition module configured to receive and decode the transmitted sensor data and to perform time alignment; a supervised learning module that is trained on historical data of flagged leaks and non-leaks to classify incoming sensor patterns; an unsupervised learning module configured to detect anomalies by modeling normal operating baselines of the pipeline; and a topology-aware localization module configured to determine leak coordinates using the topology of the pipeline network, modeling the propagation of hydraulic waves, and estimating the arrival time difference from multi-node acoustic detections; and wherein the system is configured to provide real-time leak alerts and georeferenced visualization via a remote monitoring interface.
Owner:KULKARNI TANAY HASLET

Intelligent image signal processing method and system based on multi-modal fusion

The invention provides an intelligent image signal processing method and system based on multi-modal fusion. According to the invention, a multi-mode input signal is received, is divided into a spatial distribution feature extraction region and a dynamic change trajectory capture region, and is decomposed into a penetrability feature layer and a substance reflection feature layer; carrying out association mapping on missing pixel information in the dynamic change trajectory capture region and energy distribution of the penetrability feature layer to generate enhanced dynamic trajectory data, identifying a determined reflection mode in the substance reflection feature layer, and carrying out frequency domain superposition on corresponding frequency band response and the spatial distribution feature extraction region; generating a composite spatial feature, then constructing a multi-modal joint optimization model, then adjusting the contribution ratio of the two data, and generating a fused image signal; the technical scheme provided by the invention not only solves the problems of detail loss, artifact generation and poor dynamic adaptability caused by single-mode limitation, but also improves the spatial resolution and tracking precision of the image signal.
Owner:BEIJING ZHAOKE HENGXING SCI & TECH CO LTD

Intelligent evaluation system for warping degree of PCB (Printed Circuit Board) by fusing visual positioning and multi-mode sensing

InactiveCN120351870AImage enhancementImage analysisControl cellElectronics manufacturing
The invention relates to the technical field of intelligent detection in the electronic manufacturing industry, in particular to a PCB warping degree intelligent evaluation system integrating visual positioning and multi-modal sensing, which comprises a multi-modal sensing unit, a visual positioning unit, an intelligent evaluation engine and a closed-loop control unit, the multi-modal sensing unit integrates laser displacement, infrared thermal imaging and strain sensors to acquire three-dimensional deformation, temperature and stress data; the visual positioning unit realizes sub-pixel-level positioning by using a high-resolution industrial camera and a feature point matching algorithm, and compensates vibration errors; the intelligent evaluation engine fuses data based on a time-space synchronization protocol, predicts a thermal deformation trend through an improved multi-modal convolutional neural network, and dynamically adjusts a qualified threshold value; and the closed-loop control unit executes sorting and rechecking according to an evaluation result, and optimizes warping and leveling parameters. According to the system, multi-dimensional accurate detection and intelligent control are realized, the PCB warping degree detection accuracy is effectively improved, the process can be dynamically optimized according to the production working condition, and the equipment fault risk is reduced.
Owner:FUJIAN FUQIANG PRECISION PRINTED CIRCUIT BOARD CO LTD

Medical image segmentation method and device based on spatial perception and frequency domain information

According to the medical image segmentation method and device based on spatial perception and frequency domain information, the precision and robustness of medical image segmentation are effectively improved by combining frequency domain information guidance and a multi-head state spatial perception technology. Frequency domain transformation is performed on a medical image, high-frequency and low-frequency components of the image are separated by using a multi-scale decomposition technology, and low-frequency features are extracted to obtain global information. By introducing a learnable noise filtering mechanism, noise and irrelevant background information in a frequency domain are suppressed, so that the model can be focused on a lesion area more accurately. A multi-head perception visual state space module is designed on a bottleneck layer, lesion features of different scales are captured through a multi-scale adaptive feature fusion mechanism, and the capability of segmenting small-size lesions and complex structures is enhanced. A context focusing attention mechanism is introduced into jump connection, fusion of global information and local details is further enhanced, and the accuracy of a segmentation result is ensured; and finally, recovering a high-resolution segmented image through a decoder.
Owner:XIAMEN UNIV OF TECH

Super-resolution image enhancement system and method based on variational mode decomposition algorithm

The invention discloses a super-resolution image enhancement system and method based on a variational mode decomposition algorithm. The system comprises an adaptive decomposition module, an enhancement processing module, a fusion module and an optimization module. The adaptive decomposition module receives low-resolution image signals, generates modal component signals containing different frequency band characteristics, and outputs modal quantity parameter signals according to image frequency domain energy distribution. The enhancement processing module comprises a high-frequency enhancement unit and a low-frequency reconstruction unit, and generates a high-frequency enhancement signal and a low-frequency reconstruction signal. And the fusion module receives the modal quantity parameter signal, the high-frequency enhanced signal and the low-frequency reconstructed signal, and performs spatial adaptive weighted fusion on the high-frequency signal and the low-frequency signal through a dynamic weight coefficient to generate an initial high-resolution signal. And the optimization module carries out adaptive nonlinear filtering processing on the initial high-resolution signal. The super-resolution image enhancement system based on the variational mode decomposition algorithm can solve the problem that the prior art is difficult to adapt to a complex image structure.
Owner:GUANGZHOU SPARKLE TECH CO LTD

Method and system for estimating forest carbon storage

The present invention relates to a method and system for estimating forest carbon storage that combines artificial intelligence algorithms and multimodal remote sensing data. This approach comprehensively utilizes laser radar satellites, multi- / hyperspectral satellites, radar satellites, high-resolution optical imagery, etc. A hybrid technical system is employed for different forest coverage areas, resulting in high-precision forest carbon storage mapping with a resolution of 10 meters and area coverage. This provides technical support and assurance for assessing global forest carbon storage and supporting forestry carbon sequestration transactions.
Owner:GREEN DATA TECH LTD

Image-fused end-side cloud collaborative intelligent fire-fighting fire monitoring system

The invention discloses an end-side cloud collaborative intelligent fire-fighting fire monitoring system based on image fusion, and relates to the technical field of intelligent fire-fighting, the system is composed of a plurality of functional modules, and the system comprises a multi-modal image fusion module which generates a dynamic scanning priority map based on prior data, distinguishes a natural heat source from an abnormal fire by using a dual-light fusion algorithm, and sends an image fusion result to a cloud server; a scanning area is divided according to the thermal risk grade, and the thermal imaging resolution is dynamically adjusted; the distributed edge computing module is used for carrying out space-time synchronization on cross-modal data through a multi-modal feature alignment network, and carrying out dynamic allocation on a CUDA core and CPU resources through adaptive computing scheduling; an improved artificial bee colony algorithm is adopted, the bandwidth of the multi-sensor data flow is dynamically allocated through a time-sharing multiplexing protocol, and three-dimensional path planning is carried out; and the end-side cloud collaborative decision module constructs a federated learning driven model sharing network, and each edge node trains a lightweight YOLOv5s pruning model based on local data.
Owner:HANGZHOU ZIPENG TECH CO LTD

Methods for increasing resolution of spatial analysis

Provided herein are methods for capturing an analyte from a first region of interest of a biological sample on a substrate, where the biological sample comprises the first region of interest and a second region, and where the method includes contacting the second region with a sealant in order to create a hydrophobic seal thereby preventing an interaction between an analyte from the second region with a capture domain of a capture probe.
Owner:10X GENOMICS INC

Remote sensing sewage area identification method and system based on graph structure and multi-stage enhancement

The invention relates to the technical field of remote sensing image recognition, in particular to a remote sensing sewage area recognition method and system based on a graph structure and multi-stage enhancement. The method comprises the steps of performing data preprocessing and representation enhancement on an acquired remote sensing image; performing sewage salient region preliminary screening on the enhanced remote sensing image, including abnormal enhancement mapping construction based on local statistical distribution; pollution candidate graph extraction based on spatial structure prior driving; enhancing the response of the stable region based on a structure consistency enhancing mechanism of the polluted region; high-precision segmentation and identification of the sewage area comprises the following steps: constructing a multi-resolution residual pyramid structure; carrying out fine-grained boundary structure modeling and uncertainty suppression; generating a sewage distribution probability graph and optimizing structural consistency; according to the method, the multi-resolution residual pyramid structure is constructed, image context information under different perception scales is fully mined, and the sensitivity and edge integrity of the model to a sewage area under a complex texture background are remarkably enhanced.
Owner:YANTAI UNIV +1

Defect identifying and marking system for concrete member

The invention relates to the technical field of concrete member detection, and discloses a concrete member defect identification and labeling system, which comprises an image acquisition equipment matching module, a defect feature analysis module and a real-time labeling regulation and control module, and a defect classification priority judgment module capable of being additionally arranged. The image acquisition equipment matching module calculates and matches the optimal equipment through the adaptive characteristic value based on the image resolution, the equipment acquisition precision, the working distance and the illumination compensation parameter; the defect feature analysis module performs quantitative analysis on features such as textures, crack forms and hole distribution of zoning images by using algorithms such as multi-scale image segmentation and frequency domain transformation; the real-time labeling regulation and control module dynamically adjusts the labeling position according to the defect position offset, the size change rate and the illumination fluctuation parameters; and the defect classification priority judgment module divides defect grades according to crack width, hole density and the like. The system improves the automation level and accuracy of concrete member defect detection, and is suitable for constructional engineering member quality detection.
Owner:HANGZHOU DADI ENG TESTING TECH CO LTD

High-temporal-spatial-resolution refined flow field reconstruction method, device, equipment and medium

The invention discloses a high-temporal-spatial-resolution refined flow field reconstruction method, device and equipment and a medium, and relates to the technical field of ocean current reconstruction, and the method comprises the steps: carrying out the normalization and temporal-spatial alignment of satellite remote sensing, buoy observation and numerical simulation data; based on the alignment data, performing rehearsal on the unstructured nested grid through an FVCOM model, and then dynamically encrypting the grid according to the flow field gradient and generating a background flow field; inputting the background flow field into a PINN-GAN combined framework, and outputting a refined flow field through physical constraint loss and double-discriminator adversarial training; and scheduling a calculation task by adopting a heterogeneous accelerator, verifying the reconstructed refined flow field in real time, and performing feedback optimization. Through generation of the background flow field and refinement reconstruction, the ocean current flow field with high temporal-spatial resolution can be reconstructed efficiently and accurately.
Owner:SUN YAT SEN UNIV

Amphibious unmanned aerial vehicle river sediment concentration real-time monitoring method based on underwater light field imaging and cross-modal fusion

The invention discloses an amphibious unmanned aerial vehicle riverway sediment concentration real-time monitoring method based on underwater light field imaging and cross-modal fusion, and relates to the technical field of riverway sediment monitoring. Comprising the following steps: acquiring aerial multispectral data and preprocessing the aerial multispectral data; an integrated polarized light field camera is carried on an amphibious unmanned aerial vehicle to capture underwater light field data, and underwater three-dimensional light field information is reconstructed and sediment scattering characteristics are extracted through an optical model and a lightweight deep learning network; the air multispectral data and sediment scattering characteristics are fused through space-time alignment and an attention mechanism, a sediment concentration prediction model is generated, and then a spatial distribution diagram of the river sediment concentration is output; and carrying out real-time monitoring and early warning on the river sediment concentration according to the spatial distribution diagram of the river sediment concentration through edge calculation and cloud collaboration architecture. The method is combined with an advanced deep learning algorithm, high-resolution silt concentration inversion can be realized, and the method has real-time performance and adapts to a complex water body environment.
Owner:ZHENGZHOU UNIV

Sparse finite angle CBCT reconstruction method and system based on residual diffusion and storage medium

PendingCN120510295AImage enhancementImage analysisLow contrastStripe Artifact
The invention discloses a sparse finite angle CBCT reconstruction method and system based on residual diffusion and a storage medium, and the method comprises the steps: carrying out the CBCT sparse finite angle scanning of a to-be-detected target, and obtaining sparse projection data; fDK reconstruction is carried out on the sparse projection data to obtain an initial CBCT image; generating a first optimized CBCT image from the initial CBCT image through an image pre-training network; through the first optimized CBCT image and the sparse projection data, using the trained residual diffusion model to determine a residual image of the to-be-detected target; summing the first optimized CBCT image of the to-be-detected target and the residual image of the to-be-detected target to obtain a second optimized CBCT image of the to-be-detected target, and the second optimized CBCT image is a final CBCT reconstruction image. According to the method, the problems of stripe artifacts and low-contrast tissue annihilation under limited angle scanning are solved, the large-view CBCT reconstruction resolution is improved, and the radiation dose is reduced.
Owner:SOUTHWEST MEDICAL UNIV

Self-adaptive nonlinear image enhancement method and system for low-illumination scene of mobile terminal

The invention provides a self-adaptive nonlinear image enhancement method and system for a low-light scene of a mobile terminal, and relates to the technical field of image enhancement, and the method comprises the steps: carrying out the image preprocessing and noise reduction, and carrying out the graying and noise suppression of an input color image through a local variance self-adaptive algorithm; adaptive down-sampling is carried out, and the down-sampling proportion is dynamically adjusted according to the image resolution and the content complexity, so that the processing efficiency is improved; brightness adaptive enhancement is carried out, and the overall brightness of the image is rapidly improved by adopting an Otsu method and a lookup table; contrast nonlinear enhancement: enhancing image details and contrast in combination with a Laplace operator and local mean adjustment; and color restoration: restoring the resolution through bilinear interpolation and performing weighted fusion to realize natural color reconstruction. And finally, a high-quality image of which the brightness, the contrast ratio and the color are remarkably improved is output. According to the invention, the recognition accuracy and processing efficiency of the low-illumination image are improved.
Owner:GUANGDONG POLYTECHNIC NORMAL UNIV

Aircraft skin defect multi-scale detection system and method based on improved YOLOv11

The invention relates to the technical field of aircraft skin defect detection, and discloses an improved YOLOv11-based aircraft skin defect multi-scale detection system and method. Extracting multi-scale features of the input image through HMSB; the HMSB is composed of a plurality of parallel sub-networks, each sub-network independently processes input images with different resolutions, and a lightweight Transform encoder is adopted to extract multi-scale features; the multi-scale features are adaptively fused through DFFM; the DFFM calculates the attention weight of each scale feature through a gating mechanism to realize self-adaptive weighted fusion of the multi-scale features; the defects are classified and positioned through SDH, and a detection result is output; the SDH comprises detection branches customized for various defect types, and each branch adopts a deformable convolution and a Transform decoder to improve the positioning precision of irregular defects. According to the invention, through hierarchical multi-scale feature processing and a dynamic adaptive fusion mechanism, the performance bottleneck of a traditional method in detection of tiny and irregular defects is solved.
Owner:CIVIL AVIATION FLIGHT UNIV OF CHINA

Tablet computer image super-resolution enhancement method based on generative adversarial network

The invention relates to the technical field of image super-resolution enhancement, in particular to a tablet computer image super-resolution enhancement method based on a generative adversarial network. The method comprises the following steps: collecting an image through a tablet computer, and carrying out regional illumination component calculation on the image to obtain detailed illumination component data; secondly, quantizing the motion out-of-focus fuzzy degree based on the illumination data, generating track fuzzy intensity sensing data, performing 3D modeling by combining the data, and estimating the distortion trend of the image; then, a shooting error is eliminated by using rendering visual angle distortion correction, a more real visual angle effect is generated, and super-resolution enhancement is performed on the image by using a generative adversarial network, and image details are improved. And finally, designing automatic firmware based on the super-resolution enhanced data, and embedding the automatic firmware into a tablet computer control system. According to the method, the image super-resolution enhancement technology is optimized, so that the image super-resolution enhancement technology is more perfect.
Owner:GUANGDONG OUDULIFANG TECH CO LTD

Traditional picture repairing method fusing low-resolution prior and efficient visual selection

The invention belongs to the technical field of digital restoration of computer vision and cultural heritage, and particularly relates to a traditional picture restoration method fusing low-resolution prior and efficient visual selection, which comprises the following steps: constructing a multi-source image data set, taking images in the multi-source image data set as high-resolution images, preprocessing the high-resolution images to obtain low-resolution images, and carrying out high-resolution priori and high-efficiency visual selection on the low-resolution images. The high-resolution image and the low-resolution image are respectively masked to generate simulated damage mask images, and the simulated damage mask images comprise a regular damage mask image and an irregular damage mask image; taking the multi-source image data set and the preprocessed multi-source image data set as training data, and training a multi-source image model; the dual-stage repair network comprises a coarse repair network and a fine repair network; according to the method, the problems of structural semantic loss, high priori information dependency and insufficient global and local coordination when an existing image restoration method is used for processing a complex scene and a large-range missing region are solved.
Owner:NORTHWEST UNIV

High-fidelity three-dimensional reconstruction method for mirror reflection plane

A high-fidelity three-dimensional reconstruction method for a specular reflection plane comprises the steps of decomposing pixel colors into diffuse reflection and specular reflection components based on a 3D Gaussian sphere, introducing a dynamic reflection ratio parameter and a spherical harmonic function coefficient to respectively represent two reflection characteristics, and simulating light multi-reflection behaviors through weight fusion of cumulative projection and a reflection ratio map. Secondly, in combination with monocular inverse depth calibration, depth smoothing constraint of color gradient weighting and edge mutual exclusion loss, geometric consistency is enhanced, and artifacts are suppressed; a progressive multi-resolution training strategy is further adopted, low resolution is gradually optimized to complete resolution, reflection parameters are activated in stages, 3D Gaussian sphere overgrowth and floating artifacts are inhibited, and efficiency and precision are balanced. According to the method, the reconstruction fidelity of the specular reflection scene is remarkably improved while the real-time rendering advantage of the 3DGS is reserved, and the method is suitable for the high-precision modeling fields of virtual reality, augmented reality and the like.
Owner:TSINGHUA SHENZHEN INTERNATIONAL GRADUATE SCHOOL

Medical image super-resolution reconstruction method based on multi-level attention guidance

The invention discloses a medical image super-resolution reconstruction method based on multi-level attention guidance, and the method comprises the following steps: S10, constructing a deep learning network model based on a generative adversarial network architecture, which comprises a generator and a discriminator; the generator is based on an improved U-Net architecture, a hierarchical attention module and a dual-path feature processing module are configured in an encoder and a decoder of the generator, the hierarchical attention module adopts different attention strategies according to network levels to consider structure and texture, and the dual-path feature processing module separates and processes low-frequency and high-frequency information; the generator further comprises a multi-level feature fusion module for integrating the multi-scale features of the decoder, and an attention guide up-sampling module for final enhancement and dimension raising. The discriminator adopts a spectrum normalization U-Net architecture and uses multi-scale features for matching; s20, training the network model by adopting a composite loss function comprising pixels, adversarial, perception and total variation loss; and S30, inputting the low-resolution image into the trained model, and outputting a high-resolution image. According to the method, through deep fusion of multi-level attention and multi-scale feature processing, the image restoration quality can be remarkably improved, the texture detail definition can be enhanced, the anatomical structure accuracy can be ensured, and the noise robustness can be improved.
Owner:XIAMEN UNIV

Medical image computer-aided analysis method based on deep learning

The invention relates to the field of artificial intelligence, in particular to a medical image computer-aided analysis method based on deep learning, and aims to solve the problems that an existing medical image analysis method is low in high-resolution image processing efficiency, insufficient in tiny focus recognition precision, weak in model generalization ability and insufficient in multi-modal image fusion. According to the method, a lightweight multi-scale feature extraction network is constructed to improve the high-resolution image processing efficiency, a fine-grained lesion recognition module is introduced to improve the detection precision of a tiny lesion, and a self-adaptive regularization strategy is adopted to enhance the model generalization ability. And a multi-modal deep fusion mechanism is designed to make full use of complementary information of different modal images. According to the invention, medical image analysis which is more efficient, more accurate, higher in generalization ability and capable of effectively fusing multi-modal information can be realized, so that clinical application of deep learning in the field of medical images is promoted.
Owner:BEIJING KEPTON PHARM TECH DEV CO LTD

Medical image segmentation method based on high-resolution modal guidance and cross-modal boundary perception

The invention discloses a medical image segmentation method based on high-resolution modal guidance and cross-modal boundary perception, and the method comprises the steps: carrying out the data preprocessing and enhancement of multi-contrast magnetic resonance imaging data, obtaining a boundary mask through a Canny operator and a Dilatation operation, constructing a multi-modal low-resolution data set, and carrying out the recognition of the multi-modal low-resolution data set; meanwhile, a high-resolution T2f modal data set is reserved, and the data set is divided into a training set, a verification set and a test set; a segmentation model is constructed, and the segmentation model comprises a high-resolution mode-guided double-encoder architecture module, a cross-level attention collaboration mechanism module, and a segmentation branch and boundary prediction branch decoder module; designing a training strategy of joint optimization of boundary contour detection and region segmentation, training the segmentation model by using a training set, and storing optimal model parameters on a verification set; and carrying out model performance verification in the test set, and segmenting a to-be-tested medical image by using the verified segmentation model.
Owner:BEIJING INST OF TECH

Remote sensing image semantic segmentation method based on CNN-Transform-SAM dynamic collaboration and scene adaptation

The invention discloses a remote sensing image semantic segmentation method based on CNN-Transform-SAM dynamic collaboration and scene adaptation, and a constructed remote sensing image segmentation network comprises a scene attribute analysis module, a dynamic backbone decision module, a CNN-Transform expert sub-network, a cross-modal feature calibration module, a multi-modal prompt generator and an SAM adaptive general sub-network. And all the modules realize dynamic collaboration through data interaction. Wherein the scene attribute analysis module analyzes image resolution, spectrum and target scale attributes, the dynamic backbone decision-making module matches the optimal feature extractor according to the image resolution, spectrum and target scale attributes, the CNN-Transform expert sub-network generates small target enhanced adaptive masks through multi-scale interaction and up-sampling refinement, the cross-modal feature calibration module optimizes the masks and semantic distribution to generate alignment masks, and the cross-modal feature calibration module outputs the alignment masks. And the multi-modal prompt generator generates a multi-modal optimization prompt set based on the alignment mask, and guides the SAM adaptive universal sub-network to complete segmentation. The method effectively solves the problems of poor small target segmentation, fuzzy boundary and lack of remote sensing exclusive semantic priori in the prior art.
Owner:HOHAI UNIV

Diffusion-based multiple-modality image fusion

An image-guided diffusion network has two Convolution Neural Networks (CNNs). A RGB image and an IR image are concatenated with a Gaussian noise image and input to a denoising neural network that merges information from the RGB and IR images as noise is removed over many iterations. Then an enhancement neural network up-samples for Super Resolution (SR) and convolutes to generate a condition vector that controls Global Feature Modulation (GFM) at three convolution layers to generate a SRGFM enhanced fusion image. Timesteps are embedded using adaptive group normalization blocks within Adaptive Bottleneck Residual (ABR) blocks in the denoising network, which is a UNet having many levels of ABRs, and in the enhancement network before feature modulation. Global image features are detected by triple convoluting the image input to the enhancement network to generate the condition vector that controls feature modulation blocks at three layers of convolution.
Owner:HONG KONG APPLIED SCI & TECH RES INST

Intelligent planning method for space monitoring of unmanned aerial vehicle

The invention discloses an intelligent planning method for space monitoring of an unmanned aerial vehicle. The method comprises the steps that intelligent path allocation is realized by constructing a task demand priority matrix; the method comprises the following steps: firstly, collecting geographical, climate and environmental parameters of a monitoring area, quantifying regional complexity and color features of a monitoring target by combining high-resolution image data with a neural network model, and generating a priority matrix according to task importance, change frequency and risk level; a Dijkstra algorithm is adopted to plan an initial flight path giving consideration to priority and flight limitation, a path complexity index is calculated, and the index comprehensively considers a target priority weight, a task detouring coefficient and a path relaxation degree; and finally, dividing a monitoring area into height layers according to a path complexity index threshold value, performing height layer adjustment on the initial path, and generating a dynamic flight path containing height layer switching, thereby realizing efficient resource allocation and accurate risk prevention and control in a complex monitoring scene.
Owner:BEIJING JUNDE SPACETIME TECH CO LTD

Method and system for automatically identifying wafer internal defect image of 3D stacked chip

The invention discloses an automatic identification method and system for a wafer internal defect image of a 3D stacked chip, and belongs to the technical field of semiconductor manufacturing and detection. According to the method, optical, X-ray and ultrasonic image data are synchronously acquired based on a multi-modal imaging technology, imaging parameters are dynamically adjusted to adapt to different wafer levels and material characteristics, multi-modal features are extracted in combination with layered filtering and denoising, multi-resolution registration and a self-supervised deep learning method, and micron-sized defects are positioned by using an attention mechanism. And further constructing a defect-process parameter correlation model through reinforcement learning, generating a closed-loop process optimization instruction, and transmitting the closed-loop process optimization instruction to an execution system. The system comprises a multi-modal imaging module, a noise suppression module, a deep learning analysis module and a process optimization module, and supports edge computing deployment. According to the invention, the internal defect detection efficiency and precision of the multi-layer stacked chip are significantly improved, real-time closed-loop control of detection-analysis is realized, the wafer manufacturing quality risk is reduced, and the method is suitable for intelligent defect detection of an advanced packaging production line.
Owner:WUHAN XIN MICROELECTRONICS TECH CO LTD

Multi-modal remote sensing semantic segmentation method and system for learning frequency domain fusion

The invention discloses a multi-modal remote sensing semantic segmentation method and system for learning frequency domain fusion. The method comprises the following steps: respectively extracting multi-scale features of two modal input images by adopting a double-branch encoder; sequentially executing frequency domain decoupling and fusion, mutual information constraint-based feature optimization and low-frequency guided cross-modal fusion processing on each scale feature to generate a fused semantic feature; and performing up-sampling and feature refining on the fused features through a decoder, and outputting a full-resolution segmentation prediction map. According to the multi-modal remote sensing image semantic segmentation method, modal sharing information and specific details are effectively separated through frequency domain decoupling, feature representation is optimized through mutual information constraint, adaptive feature fusion is achieved in combination with an attention mechanism, and the accuracy and robustness of multi-modal remote sensing image semantic segmentation are remarkably improved.
Owner:NORTHEAST FORESTRY UNIV