Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1370 results about "Image restoration" patented technology

Image Restoration is the operation of taking a corrupt/noisy image and estimating the clean, original image. Corruption may come in many forms such as motion blur, noise and camera mis-focus. Image restoration is performed by reversing the process that blurred the image and such is performed by imaging a point source and use the point source image, which is called the Point Spread Function (PSF) to restore the image information lost to the blurring process.

Face image restoration method based on state space model

The present application discloses a face image restoration method based on a state space model, which includes inputting the to-be-restored face image to a restoration model to obtain a restored face image; the restoration model includes an encoder and a decoder; the encoder sequentially includes a first image fusion module, a first multi-scale state space module, a second image fusion module, a second multi-scale state space module, a third image fusion module, and a third multi-scale state space module; the decoder sequentially includes a fourth multi-scale state space module, a first multi-scale attention fusion module, a fifth multi-scale state space module, a second multi-scale attention fusion module, a sixth multi-scale state space module, and a third multi-scale attention fusion module. This method ensures the consistency of face semantic information while restoring the detailed texture, especially low quality face images in real degraded scenes can achieve better restoration results.
Owner:NANJING UNIV OF POSTS & TELECOMM

Self-adaptive underwater image enhancement method and system based on Retinex theory and Mamba

The invention provides a self-adaptive underwater image enhancement method and system based on a Retinex theory and Mama, and relates to the technical field of underwater image enhancement, and the method comprises the steps: taking an original underwater image and a corresponding illumination priori image as input, obtaining illumination factor mapping through feature splicing, a first convolution layer, a multi-scale channel aggregation module layer and a second convolution layer, and obtaining an illumination priori image; performing Hadamard product operation on the illumination factor mapping and an original image to obtain a basic enhanced image; the multi-scale degradation features of the basic enhanced image are extracted step by step through an encoder, the spatial resolution is recovered through jump connection of a decoder, the illumination-texture relevance is enhanced through selective state space modeling of a WLMama bottleneck module, and finally a high-quality underwater image enhancement result is generated. According to the method, the mathematical representation system of the optical characteristics of the water body is established, the model can adaptively adjust the chromaticity compensation intensity, and image restoration under the constraint of the physical characteristics of the underwater scene is realized.
Owner:HARBIN INST OF TECH AT WEIHAI

Traditional picture repairing method fusing low-resolution prior and efficient visual selection

The invention belongs to the technical field of digital restoration of computer vision and cultural heritage, and particularly relates to a traditional picture restoration method fusing low-resolution prior and efficient visual selection, which comprises the following steps: constructing a multi-source image data set, taking images in the multi-source image data set as high-resolution images, preprocessing the high-resolution images to obtain low-resolution images, and carrying out high-resolution priori and high-efficiency visual selection on the low-resolution images. The high-resolution image and the low-resolution image are respectively masked to generate simulated damage mask images, and the simulated damage mask images comprise a regular damage mask image and an irregular damage mask image; taking the multi-source image data set and the preprocessed multi-source image data set as training data, and training a multi-source image model; the dual-stage repair network comprises a coarse repair network and a fine repair network; according to the method, the problems of structural semantic loss, high priori information dependency and insufficient global and local coordination when an existing image restoration method is used for processing a complex scene and a large-range missing region are solved.
Owner:NORTHWEST UNIV

Medical image super-resolution reconstruction method based on multi-level attention guidance

The invention discloses a medical image super-resolution reconstruction method based on multi-level attention guidance, and the method comprises the following steps: S10, constructing a deep learning network model based on a generative adversarial network architecture, which comprises a generator and a discriminator; the generator is based on an improved U-Net architecture, a hierarchical attention module and a dual-path feature processing module are configured in an encoder and a decoder of the generator, the hierarchical attention module adopts different attention strategies according to network levels to consider structure and texture, and the dual-path feature processing module separates and processes low-frequency and high-frequency information; the generator further comprises a multi-level feature fusion module for integrating the multi-scale features of the decoder, and an attention guide up-sampling module for final enhancement and dimension raising. The discriminator adopts a spectrum normalization U-Net architecture and uses multi-scale features for matching; s20, training the network model by adopting a composite loss function comprising pixels, adversarial, perception and total variation loss; and S30, inputting the low-resolution image into the trained model, and outputting a high-resolution image. According to the method, through deep fusion of multi-level attention and multi-scale feature processing, the image restoration quality can be remarkably improved, the texture detail definition can be enhanced, the anatomical structure accuracy can be ensured, and the noise robustness can be improved.
Owner:XIAMEN UNIV

Bad weather image restoration method based on multi-modal state space model

The invention discloses a bad weather image restoration method based on a multi-modal state space model, and belongs to the technical field of computer vision. In order to solve the problem that an existing unified bad weather image restoration method has limitations in the aspects of global receptive field and computational efficiency, the unified restoration of various bad weather images is realized by designing a parallel multi-mode encoder and an adapter to generate comprehensive prompts containing degeneration semantics. Through parallel connection of a state space module and a local context sensing module of a double-attention mechanism, simultaneous capture of global long-range dependence and local detailed features is realized. Experiments show that the method is high in generalization ability, high in processing speed and low in calculation complexity, and can show good adaptive capacity on a plurality of bad weather image removal tasks.
Owner:TAIYUAN UNIVERSITY OF TECHNOLOGY

Image restoration method and device and storage medium

The invention discloses an image restoration method, an image restoration device and a storage medium, which are used for improving the structure restoration precision and the detail restoration capability of image restoration. The method comprises the following steps: acquiring multi-dimensional inertial data in real time; performing frequency domain analysis on the multi-dimensional inertial data by adopting sliding window short-time Fourier transform to obtain vibration intensity; if the vibration intensity does not exceed the preset threshold value, acquiring an image; calculating a definition index of the image; determining whether the image is a blurred image according to a preset definition standard and the definition index of the image; if the image is judged to be a blurred image, dividing the blurred image into a motion blurred image and a focusing blurred image; respectively constructing point spread function models of the motion blurred image and the focusing blurred image; performing deconvolution processing or depth reconstruction on the blurred image through a point spread function model to obtain a clear image; and recalculating the definition index of the clear image, and if the definition index does not exceed the definition threshold, triggering reacquisition or switching the repair model to execute secondary repair.
Owner:SHENZHEN SEICHITECH TECHN CO LTD

Waste plastic classification method and system based on visual identification

The invention discloses a waste plastic classification method and system based on visual identification, and particularly relates to the technical field of plastic classification. Reflection suppression is realized through an industrial camera equipped with a polarization filter and a multi-angle cross polarization light source, and the structure and color characteristics of a shielded area are effectively restored by combining brightness equalization, reflection area detection and image restoration technologies; and then semantic segmentation and target classification are completed by using an improved deep neural network model, a control signal is generated based on an identification result, and an execution mechanism is driven to realize accurate sorting of multiple types of plastics, so that the identification robustness and the sorting efficiency of the system under a complex illumination condition are improved.
Owner:CHENGFA GREEN RING PLASTIC IND (HEBEI) CO LTD

Plateau mountain road disaster identification method and system based on multi-source remote sensing image restoration and super-resolution reconstruction

The invention discloses a plateau mountain road disaster identification method and system based on multi-source remote sensing image restoration and super-resolution reconstruction. The method comprises the following steps: acquiring and preprocessing a multi-source remote sensing image of a plateau mountain region, and extracting landform measurement parameters based on a digital elevation model; a super-resolution reconstruction network fusing deformable convolution and Transform is constructed, and a low-resolution image is reconstructed by using constraint training of a composite loss function containing geomorphic measurement parameters; performing feature extraction and adaptive weighted fusion on the preprocessed image and the reconstructed high-resolution image; based on the fused image, utilizing a multi-task deep learning model to identify landslide, debris flow and roadbed subsidence disasters along the highway; and carrying out morphological optimization and boundary refinement under GIS constraint on an identification result, and outputting a disaster thematic map. According to the invention, the precision and reliability of road disaster identification in a complex terrain environment are effectively improved.
Owner:KUNMING UNIV OF SCI & TECH

Picture editing method and system based on multi-modal condition adaptation

The invention provides a picture editing method and system based on multi-modal condition adaptation, and the method comprises the steps: obtaining a first text vector: obtaining a picture description corresponding to a picture through processing, processing the picture description through an editor, and obtaining a first text vector; obtaining a first text vector based on the picture information; a second text vector acquisition step: processing the used editing instruction to obtain a second text vector based on the editing instruction; a fusion feature acquisition step: fusing the first text vector and the second text vector through weight to obtain a fusion feature; an image potential feature code acquisition step; in the image editing step, the injected condition information is received, meanwhile, the received potential features and potential noise of the image are denoised, and the image desired by the user is gradually generated in the iterative denoising process under the guidance of the received condition information; and an image restoration step. According to the invention, the stability, controllability and accuracy of image editing can be improved.
Owner:SHENZHEN EMDOOR DIGITAL TECH

Improved underwater image enhancement method

The invention discloses an improved underwater image enhancement method. The method comprises the following steps of lightweight downsampling and feature extraction; performing multi-stage attention enhancement and feature optimization; multi-path feature reconstruction is carried out; and performing multi-stage output fusion and image restoration. According to the method, a UNet + + model is introduced into the field of underwater image enhancement for the first time, standard convolution of a down-sampling layer is replaced by lightweight convolution, a three-stage attention mechanism of local noise suppression, space-channel collaborative optimization and global color cast compensation is cascaded after each layer of lightweight convolution, and a multi-level enhancement result is generated. And finally fusing and outputting through a weighted average strategy. And through lightweight convolution replacement, the model parameter quantity and the calculation complexity are remarkably reduced, and the calculation efficiency is improved. Through a three-stage attention mechanism, typical degradation problems of suspended particle noise, edge blur, color distortion and the like of the underwater image are accurately repaired. According to the method, the common artifact problems of light spots and the like and the excessive smoothness problem in the existing method are solved.
Owner:DALIAN UNIV

Bronze ware ornamentation pattern digital restoration method based on image enhancement technology

The invention discloses a bronze ware ornamentation and pattern digital restoration method based on an image enhancement technology, and relates to the technical field of image restoration, and the method comprises the steps: building a space mapping matrix; extracting multi-modal data features by using the surface state of the topological insulator, and registering a joint data volume; forming a super-resolution image through super-resolution reconstruction; obtaining a material degradation coefficient by using a wavelet finite element method and a graph neural network; generating an adversarial network by utilizing physical constraints, and generating an embarrassment repairing result; a material sensing three-dimensional model is constructed by adopting a wavelet packet decomposition and neural radiation field fusion technology, texture mapping is dynamically adjusted based on a graphene Moire effect, and virtual-real fusion is performed through holographic waveguide AR; by combining advanced technologies such as a metamaterial lens, micro-distance laser scanning, a topological insulator film, a graphene heterojunction and a nerve radiation field, high-precision three-dimensional digital restoration and repair of bronze cultural relics are realized, and immersive augmented reality display experience is provided.
Owner:JIANGXI INST OF FASHION TECH

Lightweight super-resolution reconstruction method based on multi-scale feature extraction and parallel cavity coordinate attention

The invention discloses a lightweight super-resolution reconstruction method based on multi-scale feature extraction and parallel cavity coordinate attention. The lightweight super-resolution reconstruction method comprises the following steps: constructing a shallow feature extraction sub-network for remote sensing image super-resolution reconstruction; constructing a deep feature extraction sub-network for remote sensing image super-resolution reconstruction; constructing an image restoration and reconstruction self-sub-network for remote sensing image super-resolution reconstruction; constructing a remote sensing image super-resolution reconstruction network; generating a training set, a verification set and a test set; training a remote sensing image super-resolution reconstruction network; reconstructing remote sensing image resolution; according to the method, multi-scale feature extraction, a parallel cavity coordinate attention mechanism and depth separable convolution are combined, so that the effect and the quality of super-resolution reconstruction are improved while relatively low calculation cost is kept; the problems of detail loss, high calculation complexity, insufficient utilization of multi-scale features and the like when complex textures and high-frequency details are processed in an existing reconstruction technology are solved.
Owner:INST OF EARTH ENVIRONMENT CHINESE ACAD OF SCI

Remote-sensing hyperspectral image super-resolution reconstruction method based on hypergraph neural network

The present invention relates to the technical field of image restoration, and in particular to a remote-sensing hyperspectral image super-resolution reconstruction method based on a hypergraph neural network, comprising: S1, acquiring a hyperspectral image, and preprocessing the hyperspectral image to obtain a training set and a verification set; S2, constructing a hypergraph neural network; S3, using training images in the training set to construct a three-layer hypergraph, and on the basis of the three-layer hypergraph, constructing hypergraph operators corresponding to the training images; S4, using the training images and the hypergraph operators corresponding to the training images to train the hypergraph neural network, and using a loss function to iterate network parameters of the hypergraph neural network, to obtain a trained hypergraph neural network; and S5, inputting, to the trained hypergraph neural network, low-resolution hyperspectral images to be reconstructed for reconstruction to obtain a high-resolution hyperspectral image. The present invention has an excellent reconstruction result.
Owner:CHANGCHUN INST OF OPTICS FINE MECHANICS & PHYSICS CHINESE ACAD OF SCI

Rapid construction method and system for wireless channel knowledge map

The present invention discloses a rapid construction method and system for a wireless channel knowledge map. The present invention uses image restoration technology to construct a channel knowledge map, and, by means of recovering a corresponding pixel value in an image matrix, predicts channel knowledge of a specific position, so that channel related knowledge of a user equipment at any position in a target area can be acquired. By means of combining the similarity of an image restoration problem and a channel knowledge map construction problem, and using a Laplacian pyramid frequency band decomposition framework, an input environment map can be decomposed at different frequencies. According to the characteristics of different frequency components, a corresponding sub-network is designed for feature extraction, and finally, the channel knowledge map is reconstructed by means of inverse operation of the Laplacian pyramid. The wireless channel knowledge map construction method provided by the present invention not only implements higher construction precision at lower computational complexity, but also has strong generalization ability for various wireless communication scenarios.
Owner:SOUTHEAST UNIV

Image restoration method based on automatic evaluation and dynamic optimization and related equipment

The invention relates to the technical field of computer vision and artificial intelligence, in particular to an image restoration method based on automatic evaluation and dynamic optimization and related equipment. The method comprises the following steps: acquiring a to-be-restored image and a corresponding restoration area; performing restoration processing on the to-be-restored image to generate an initial restoration result; performing automatic quality evaluation on the initial repair result by using a multi-modal large model in combination with an anomaly detection rule base to obtain an evaluation result; based on the evaluation result, if it is judged that the repair quality does not reach the standard, an intelligent adjustment tool chain is called to carry out targeted optimization on the initial repair result, and an optimized repair result is generated; and repeatedly executing the quality evaluation and optimization steps on the optimized repair result until the repair quality reaches the standard, and forming a closed-loop processing flow. The method has the effects of improving the restoration quality in a complex scene in an image restoration technology, improving the image restoration efficiency and increasing an automatic closed-loop processing mechanism.
Owner:深圳市睿观信息科技有限公司

Image restoration method based on gated Fourier convolution residual error and multi-head attention mechanism

The invention discloses an image restoration method based on a gated Fourier convolution residual error and a multi-head attention mechanism, and the method is characterized in that the method specifically comprises the steps: collecting a damaged image as a data set, carrying out the preprocessing, and dividing the data set into a training set and a test set according to a set proportion; constructing an LGFCDANet network, wherein the network comprises a coarse recovery network and a fine recovery network; carrying out adversarial training on the LGFCDANet network to obtain a trained LGFCDANet network, and testing the trained LGFCDANet network by adopting a test set; and carrying out image restoration by adopting the trained network. The invention aims to enhance the understanding and recovery capability of the model on image details, thereby improving the restoration effect and enhancing the dynamic adjustment capability on the color and texture of a special area.
Owner:WUXI UNIV

Facial-image restoration method based on state space model

Disclosed in the present invention is a facial-image restoration method based on a state space model. The method comprises: inputting into a restoration model a facial image to be restored, so as to obtain a restored facial image, wherein the restoration model comprises an encoder and a decoder, the encoder sequentially comprising a first image fusion module, a first multi-scale state space module, a second image fusion module, a second multi-scale state space module, a third image fusion module and a third multi-scale state space module, and the decoder sequentially comprising a fourth multi-scale state space module, a first multi-scale attention fusion module, a fifth multi-scale state space module, a second multi-scale attention fusion module, a sixth multi-scale state space module and a third multi-scale attention fusion module. The method restores details and textures while ensuring the consistency of facial semantic information, and can achieve a better restoration effect particularly for a low-quality facial image in a real degradation scenario.
Owner:NANJING UNIV OF POSTS & TELECOMM

Optical fiber transmission image restoration method and device based on complex amplitude regulation metasurface diffraction device

The invention discloses an optical fiber transmission image recovery method and device based on a complex amplitude regulation metasurface diffraction device, and the method comprises the steps: obtaining the complex amplitude distribution of each diffraction layer through the training of a diffraction neural network, designing a corresponding metasurface array, and preparing a cascaded metasurface diffraction device with a complex amplitude regulation function, deploying a cascade metasurface diffraction device to the far end of the multimode optical fiber and performing complex amplitude modulation on emergent circularly polarized light to realize high-resolution or high-sampling-rate image recovery; or an optical fiber transmission inverse matrix is solved by using an analytical method, and a corresponding metasurface array is designed, so that the single-layer metasurface diffraction device with a complex amplitude regulation and control function is prepared; and deploying the single-layer metasurface diffraction device to the far end of the few-mode optical fiber and carrying out complex amplitude modulation on emergent circularly polarized light to realize low-resolution or low-sampling-rate image recovery. Miniaturization of a multimode optical fiber imaging system can be realized, and the image recovery quality is effectively improved based on complex amplitude modulation of the metasurface diffraction device.
Owner:ZHEJIANG UNIV

Hyperspectral image restoration method and device based on cyclic decoupling model

The invention relates to a hyperspectral image restoration method and device based on a cyclic decoupling model. The method comprises the following steps: constructing a hyperspectral image hybrid degradation mathematical model according to pre-introduced descriptive factors; deducing a plurality of solving targets by using the hyperspectral image mixed degradation mathematical model; constructing a hyperspectral image restoration network with a cyclic decoupling structure, designing a plurality of sub-loss functions based on the plurality of solving targets, and training the hyperspectral image restoration network according to the plurality of sub-loss functions to obtain a trained hyperspectral image restoration network; and restoring an image to be restored according to the trained hyperspectral image restoration network. By adopting the method, the denoising and defect information complementation of the hyperspectral image can be realized at the same time, and the image quality is greatly improved.
Owner:NAT UNIV OF DEFENSE TECH

Generative de-noising device training and controllable generation method based on diffusion model distillation

The invention provides a training method of a generative denoising device and an image controllable generation and restoration method. The training method comprises the following steps: taking a pre-trained diffusion model as a teacher diffusion model; initializing a generative denoising device, a score model and a discriminator; obtaining a noiseless signal, and obtaining a noisy signal and Gaussian noise in combination with a generative denoising device; obtaining effective noise intensity and effective noise signals according to the noisy signals and the Gaussian noise; estimating a data score by using a teacher diffusion model according to the effective noise intensity, the effective noise signal and the noisy signal; according to the noisy signal, estimating a model score by using a score model; calculating and optimizing the gradient of learnable parameters of the generative denoising device; and according to the noisy signal, the data score, the model score and the optimized generative de-noising device, calculating de-noising score matching of the score model and adversarial loss of the discriminator, and optimizing the score model and the discriminator. And realizing image controllable generation and image restoration based on the generative de-noising device.
Owner:SHANGHAI JIAOTONG UNIV

Ancient textile image restoration system based on artificial intelligence

The invention discloses an ancient textile image restoration system based on artificial intelligence. The system comprises a multi-source image acquisition module, a damaged area detection module, a pattern generation module, a color restoration module, a texture synthesis module and a multi-scale fusion module. The system introduces a wavelet guidance-frequency domain attention mechanism and a rotation invariant Haar wavelet basis function to realize accurate identification and classification of a damaged area; a saliency-guided wavelet decomposition control and self-adaptive threshold denoising method is combined, so that the perception capability of slant textures and edge details is improved; the texture synthesis module constructs a hierarchical modeling strategy fusing Gram style loss, Wasserstein style loss and a total variation regular term, and realizes generation of high-quality textures with unified styles and smooth edges; the system can be widely applied to cultural relic digital repair and display scenes.
Owner:NINGXIA HUI AUTONOMOUS REGION MUSEUM

Coral reef remote sensing image multi-modal feature generation and restoration method and system

The invention provides a coral reef remote sensing image multi-modal feature generation and restoration method and system, and relates to the technical field of remote sensing image restoration, and the method comprises the steps: obtaining coral reef image data based on a multi-source sensor, and carrying out the preprocessing; performing image morphological feature and spectral feature extraction on the preprocessed coral reef image data by using a convolutional neural network, and establishing a feature database; carrying out weighted fusion on the multi-source features based on a feature combination network, generating comprehensive feature expressions, and storing the comprehensive feature expressions into a feature database; the coral reef image to be restored is matched with the feature database, and guidance parameters are generated; and inputting the guidance parameters into the generative adversarial network, and performing pixel-level reconstruction on the missing region of the coral reef image to be restored. According to the method, a complete closed-loop system is constructed, multi-source information scheduling, pixel-level guide reconstruction and semantic feedback verification are covered, image information can be supplemented, ecological information can be reasonably reconstructed, and a high-quality data basis is provided for subsequent classification, monitoring and protection work.
Owner:CHINA AERO GEOPHYSICAL SURVEY & REMOTE SENSING CENT FOR LAND & RESOURCES

Image signal processing system and processing method

The invention discloses an image signal processing system and method, and relates to the technical field of image signal processing, and the method comprises the steps: extracting structural features of a collected original image signal, and generating a region classification mask; predicting a processing path of each region according to the region classification mask; according to the processing path, performing corresponding compression operation on each area, and embedding corresponding structure identification information in compressed data; and during decoding, enhancement processing is performed on the structure key area according to the structure identification information, so that the image restoration quality is improved. The continuous adjustment of the channel reservation number and the quantization step size is realized, and the fidelity control capability of a complex structure region is enhanced. And the image restoration quality and the detail retention effect are improved, and a closed-loop optimization process between compression and enhancement is constructed.
Owner:HANGKE QUALITY TESTING (XIAN) TECH CO LTD

Continuous learning-based severe weather image sharpening method

The invention discloses a severe weather image sharpening method based on continuous learning, and the method comprises the steps: 1, carrying out the preprocessing of an image data set under various severe weather conditions, including image pairing and multi-task division; 2, dividing the image restoration network into two parts of feature projection and output projection, designing a degradation sensing module for extracting degradation specific information output by the feature projection under different weather conditions, and establishing background supervision and degradation supervision by adopting a multi-teacher model for guiding learning of a student model; and 3, establishing respective optimization targets for the student model and the teacher model, inputting pairing data of different weather removal tasks, and optimizing the student network by a multilateral distillation normal form, thereby obtaining an optimal model with integrated image severe weather removal capability. According to the method, different types of severe weather images continuously acquired in a real scene can be dealt with, and the implementation effect of an image restoration network in a resource-limited scene is improved.
Owner:UNIV OF SCI & TECH OF CHINA

Image segmentation method and system

The invention discloses an image segmentation method and system, and relates to the technical field of image segmentation. According to the image segmentation method, to-be-segmented laryngoscope medical image data is obtained and input into a pre-trained image segmentation model for preliminary segmentation processing, and a laryngoscope structure segmentation image is generated and comprises a plurality of laryngoscope segmentation areas and corresponding segmentation data sets; performing comprehensive analysis to obtain a structure segmentation perception index of each throat segmentation region, performing analysis to obtain a plurality of low-confidence throat regions, and inputting the low-confidence throat regions into an image restoration model in combination with a segmentation data set of a set annular adjacent throat segmentation region for analysis to obtain an enhanced segmentation data set of each enhanced throat region; according to the method, the laryngoscope structure segmentation image is updated through the enhanced segmentation data set of each enhanced laryngoscope region to obtain the structured laryngoscope tissue segmentation image, so that the enhanced regions have the consistency of pixel levels, and the segmentation precision and clinical availability are effectively guaranteed.
Owner:THE 980TH HOSPITAL OF THE CHINESE PEOPLES LIBERATION ARMY JOINT LOGISTICS SUPPORT FORCE

Space adaptive blind image restoration method and device based on CLIP enhancement

The invention relates to the technical field of image processing, and provides a spatial adaptive blind image restoration method and device based on CLIP enhancement, and the method employs a blind image restoration network, can effectively utilize the powerful image-text understanding and correlation capability of a CLIP model under the condition that the specific degradation type and degree of a to-be-restored image are not required to be known in advance, and improves the restoration efficiency of the to-be-restored image. Therefore, the to-be-restored image is effectively restored. A blind image recovery network is combined with an encoder-decoder structure, a prompt enhancement module is introduced, a spatial dynamic prompt graph is dynamically generated according to local features of a to-be-recovered image through a spatialization prompt generation module, differentiated and targeted guide information is provided for different areas of the to-be-recovered image, spatial heterogeneous degradation is effectively processed, and the recovery efficiency of the to-be-recovered image is improved. And local details are better reserved. Meanwhile, a gating mechanism is introduced through a gating network, the influence intensity of the spatial dynamic prompt graph on fusion features can be dynamically adjusted, and then more flexible and more intelligent feature fusion and repair control are achieved.
Owner:泉州职业技术大学

Image generation method, image generation device, electronic equipment and storage medium

The embodiment of the invention provides an image generation method, an image generation device, electronic equipment and a storage medium, and belongs to the technical field of image processing. The method comprises the following steps: acquiring an image generation prompt word and carrying out style understanding according to the image generation prompt word to obtain a scene style feature; performing scene expansion on the image generation prompt word according to the scene style feature to obtain a scene expansion word; performing scene arrangement according to the scene expansion word to obtain scene features; performing information fusion according to the scene style features, the scene expanding words and the scene features to obtain scene description information; performing image generation according to the scene description information to obtain a preliminary image; and performing image restoration according to the initial image and the scene description information to obtain a target image. The image generation method and device can be applied to business systems needing a large number, such as financial science and technology and medical health care, and the image generation efficiency and precision can be improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Image restoration method and device, medium and equipment

The invention discloses an image restoration method and device, a medium and equipment, and relates to the technical field of image processing. In order to solve the problem that useful information is lost in the transmission process of a deep network, an improved gating residual module is provided. Wherein the residual sub-module is embedded with a multi-scale frequency refining module which is provided for solving the problem that a fuzzy reconstructed image is caused by the fact that a traditional convolutional network suppresses high-frequency detail information, and the multi-scale frequency refining module dynamically obtains a low-pass filter from original input features through average pooling and feature folding operation; and low-frequency and high-frequency feature maps are separated through convolution operation, and spliced features rich in high-frequency information are obtained after weighting. According to the module, input features are down-sampled to three different scales through global average pooling operation, after the different scales are subjected to the same frequency refining operation, the features of each scale are restored into the input scale through a bilinear interpolation method, and after elements are added one by one, output features are obtained.
Owner:LISHUI UNIV

Image restoration and generation method based on conditional generative adversarial network

The invention provides an image restoration and generation method based on a conditional generative adversarial network, and the method comprises the steps: a camera APP obtains contour key point data of a user figure proportion through carrying out the high-resolution feature extraction of an input image, carries out the three-dimensional reconstruction of a waist line and a shoulder breadth size, and obtains a contour key point data of a user figure proportion; generating an initial feature mapping graph containing wrinkle density distribution and local deformation amplitude; according to the initial feature mapping graph, adopting a region segmentation technology to separate a body contour from a clothing region, extracting a texture stretching degree and contact point stress distribution, determining a distribution condition of clothing and body contact points, and generating a segmentation result for dynamic adjustment; and for the to-be-optimized detail area list, performing enhancement processing on the texture stretching degree of the contact points of the clothes and the body and the stress distribution of the contact points, obtaining wrinkle layer depth data of a local area, and generating an optimized image layer.
Owner:GUANGZHOU GOMO SHIJI TECH CO LTD

Video generation method and device, electronic equipment, storage medium and program product

The embodiment of the invention discloses a video generation method and device, electronic equipment, a computer readable storage medium and a computer program product, and the method comprises the steps: generating a rough three-dimensional world of a target scene formed by a three-dimensional Gaussian ball set, and automatically searching a multi-angle offset view angle at the same coordinate position as a new view angle. According to the method, a multi-view-angle combined repairing mechanism is realized, geometric and semantic consistency of image data among different view angles is ensured, consistency of scene structures, textures and semantic information at different observation angles is realized, and a continuous, coherent and high-quality three-dimensional world is constructed. According to the method, the problem of multi-view inconsistency in a traditional method is solved, the new view image quality under large view conversion is improved, the image quality problems of floating objects, artifacts, structural distortion and the like in the image are eliminated, the generated image is more stable and real, the spatial continuity is improved, and the immersion and exploration experience of a user are enhanced.
Owner:北京极佳视界科技有限公司