174 results about "Demosaicing" patented technology

The invention discloses a combined denoising and demosaicing method for a low-exposure original image under low light, and the method is divided into two stages: in the first stage, introducing a high and low frequency fusion module based on wavelet transform, and generating relatively clean pseudo long exposure data to reduce noise; and in the second stage, through a color space attention subnet, image reconstruction is carried out by using the pseudo long exposure data generated in the first stage, the color is recovered, and texture details are enhanced. In addition, the invention also provides a wavelet loss function to balance detail recovery and noise suppression, and discusses the influence of three different training strategies on the performance of the model. Experimental results show that the method provided by the invention is superior to most advanced algorithms in the aspects of quantitative indexes, color accuracy, detail retention and the like.

The invention discloses an ultra-high-speed imaging device based on acousto-optic filtering modulation. The ultra-high-speed imaging device comprises a spectrum modulation system, a spectrum imaging system and a data processing system. The spectrum modulation system utilizes an acousto-optic tunable filter (AOTF) to dynamically modulate broadband continuous spectrum light, narrow-band illumination light which rapidly changes along with time is generated, and time information of a dynamic scene is effectively mapped to a spectrum dimension. And the spectral imaging system images the spectral coded dynamic scene to the hyperspectral camera to realize acquisition of spectral space-time information. The data processing system performs spectral crosstalk correction, channel separation and demosaicing reconstruction on the acquired original mosaic image, and recovers a time sequence image according to a spectrum-time mapping relation, thereby realizing single-shot superspeed imaging in a dynamic process. The device has the advantages of being simple and compact in structure, flexible in time window, high in imaging fidelity and the like, and has wide application prospects in the fields of rapid dynamics such as microfluidics, laser processing and ultrafast physics.

The invention provides an array image demosaicing method based on dynamic convolution and adaptive coding, which relates to the technical field of image processing, and comprises the following steps: acquiring single-channel original image data and a corresponding color filtering array arrangement type identifier; converting the arrangement type identifier into a multi-dimensional physical feature vector, and inputting the multi-dimensional physical feature vector into a feature processor of a neural network model to generate a weighting coefficient vector; carrying out weighted combination on the plurality of special arrangement transformation matrixes through a weighting coefficient vector to obtain a transformation component, adding the transformation component and a basic convolution kernel parameter to obtain a dynamic convolution kernel parameter, and carrying out directional modulation on a specific spatial position of the dynamic convolution kernel parameter based on a direction weight component in a multi-dimensional physical feature vector; and performing convolution operation on the original image data by using the dynamic convolution kernel parameters, extracting multi-scale features, reconstructing image features, and outputting multi-channel color image data, so that the method can be adaptive to different color filter array types, and the demosaicing precision and generalization capability are improved.

Apparatuses, systems, and techniques to process image data. In at least one embodiment, a neural network is trained to perform demosaicing of two-dimensional image data obtained from an image sensor.

The invention discloses a high-quality multispectral demosaicing method based on residual error guidance, belongs to the technical field of image restoration, and aims to solve the problems that a large amount of high-frequency information is not effectively processed and RGB image chromaticity channel restoration is insufficient. The method comprises the following steps: step 1, designing nine-channel multispectral optical filter array arrangement; step 2, interpolating a dense sampling channel image; 3, preliminarily reconstructing a sparse sampling channel image; and 4, further restoring the sparse sampling channel image by using a residual interpolation method. According to the demosaicing method based on residual guidance, when pixels of other channels are reconstructed, interpolation is carried out on residual values, and the problems of key detail reservation, fuzziness and detail loss are emphasized. And the mutual influence between different spectrum channels is considered, so that more accurate color restoration is realized, and the visual perception and the practical application value of the image are improved. The reconstructed image is excellent in the aspect of recovering the chromaticity channel of the RGB image, and the real effect of the reconstructed image is closer to that of the original image.

The invention discloses a snapshot multispectral camera demosaicing method and device based on a binary tree coating array, and the method comprises the steps: extracting a plurality of single-spectrum mosaic images according to a multispectral original image and a spectrum, and carrying out the estimation of a pseudo panchromatic estimation image according to the multispectral original image; calculating a difference value between each spectral band sparse pseudo panchromatic estimation image and the original spectral band sparse image, and calculating difference values at all pixel positions; adding the difference image after filtering interpolation with the pseudo panchromatic estimation image to obtain a demosaicing reconstruction result based on the pseudo panchromatic estimation image; and enhancing the spatial high-frequency information of the binary tree low-node spectral band image based on the binary tree high-node spectral band image by using the color and spatial correlation between adjacent spectral bands. According to the method, the problem of artifacts caused by weak spectrum correlation of the wide spectrum distribution optical filter can be solved, the artifacts of the reconstructed image are reduced, and the spatial resolution capability of the demosaiced image is improved.

Disclosed is imaging system with image sensor; pose-tracking means; and processor(s) configured to capture a sequence of images to determine corresponding poses of the image sensor with respect to which images are captured, wherein when capturing image, the processor(s) is configured to perform demosaicing on image data; identify static region(s) in the image(s); obtain new image data to determine a new pose of image sensor; reproject image(s) from a corresponding pose of image sensor with respect to which image(s) is captured to new pose of image sensor, wherein static region(s) in the image(s) is reprojected to generate reprojected static region(s); and generate a new image corresponding to the new image data, by performing temporal reconstruction of static region(s) in the new image that corresponds to the static region(s) of the image(s), based on the reprojected static region(s) of the reprojected image(s).

The invention provides an interpolation method and device for a RAW image in a tetrabayer format and electronic equipment. The interpolation method comprises the following steps: acquiring the RAW image in the tetrabayer format; gradient information of the current pixel point is calculated; calculating a weight factor of the current pixel point according to the gradient information; and calculating a G channel value, a G-R color difference value and a G-B color difference value of the current pixel point by using the weight factor so as to obtain an RGB channel value of the current pixel point and output an RGB image. Gradient information of a current pixel point is calculated, and then a weight factor is calculated, so that edge information of the image can be obtained; the RGB channel value of the current pixel point is calculated through the weight factor, an image conversion result with small noise in a flat area and clear details in an edge area can be obtained, an existing demosaicing algorithm is not needed, conversion from the RAW image in the tetrabayer format to the RGB image is achieved, the image quality is guaranteed, and the image conversion efficiency is improved. The problem of how to convert the RAW image in the tetrabayer format into the high-quality color image is solved.

The present application discloses an image reconstruction method, an apparatus, a device, a medium, and a product. According to the image reconstruction method in the embodiments of the present application, all Swin Transformer modules of an encoding module are connected by means of a patch merging layer; all Swin Transformer modules of a decoding module are connected by means of a patch expanding layer; the encoding module and the decoding module are symmetrical in structure; and finally, an upsampled feature map is input into a reconstruction module so as to obtain an RGB image by means of conversion. By constructing a network on the basis of a U-Net structure, the present solution is able to restore a corresponding high-resolution RGB image from a feature map, and interpolate missing values and defective pixels in a RAW image captured by an event camera while performing demosaicing, thereby obtaining a high-quality RGB image. Moreover, the use of Swin Transformer architecture as a feature extractor allows for the effective capturing of long-range dependencies, and ensures that consistency of local and global information is maintained.

Disclosed is an imaging system with image sensor and processor(s). The image sensor has a plurality of photo-sensitive cells and a colour filter array. The processor(s) is configured to read out unprocessed colour data from those photo-sensitive cells that correspond to the colour filters of the at least three different colours; generate coarse depth data by processing data read out from at least one of: those photo-sensitive cells that correspond to the colour filters that allow the at least one infrared wavelength to pass through the PDAF photo-sensitive cells; perform interpolation and demosaicking on the unprocessed colour data and the coarse depth data, using at least one neural network, to generate a full-resolution colour data and a full-resolution depth data; and reproject the full-resolution colour data from a given camera pose to a given eye pose of a user, by utilising the full-resolution depth data.

The invention provides an image processing model training method and device, an image processing method and device, equipment and a medium, and relates to the technical field of image processing, and the training method comprises the steps: obtaining a sample image of a first format and a reference image of a second format; performing position coding on the sample image by adopting a coding network in the image processing model to obtain a coding feature map; adopting a demosaicing network in an image processing model to carry out demosaicing processing on the coded feature map to obtain an output feature map; fusing the coding feature map and the output feature map to obtain a fused feature map; and training an image processing model based on the fused feature map and the reference image. Therefore, position coding is introduced in the modeling stage, the performance and effect of the model can be improved, and the quality of the finally generated image in the second format is improved.

The invention discloses an image subgradient constrained dual-camera snapshot spectral imaging system and an imaging method, and relates to the field of spectral imaging, in particular to an image subgradient constrained dual-camera snapshot spectral imaging method. The method aims at the technical bottleneck that a traditional spectral imaging system cannot be suitable for a dynamic scene and a low-illumination environment due to low time resolution and limited light utilization rate, and the problem that an existing SCSI system is poor in reconstruction accuracy of a decoding algorithm due to the fact that the compression ratio of space-spectral information is too high or information complementarity is insufficient. The method comprises the following steps: 1, obtaining a preprocessed broadband filter array RAW image and an SD-CASSI compressed encoding image Y; 2, obtaining a demosaiced multiband image; 3, obtaining a coarse estimation spectrum image; 4, calculating the subgradient of the three-dimensional total variation function f3DTV (.) at the roughly estimated spectral image, wherein the subgradient represents the spatial characteristics of the spectral image; and 5, iteratively solving a spectral image recovery problem by using an optimization algorithm to reconstruct a spectral image.

Disclosed is a joint denoising and demosaicking method for a color RAW image guided by a monochrome image. The method comprises: constructing a synthetic image dataset of a monochrome-color binocular camera system for training and testing of network modules; constructing an aligned guidance image generation module by utilizing a structural correlation between a monochrome image and a color image, using a clean grayscale image corresponding to the RAW image as supervision, and training the aligned guidance image generation module by using a perceptual loss function to generate a high-quality aligned guidance image; using the generated aligned guidance image to guide the joint denoising and demosaicking process of the color RAW image; and training a guided denoising and demosaicking module ensure the accuracy of the color of the denoising and demosaicking result while accurately transferring the guidance image structure.

An imaging system includes an image sensor, a wobulator employed to perform sub-pixel shifts; and processor(s) configured to: obtain, in a cycle, two or three sub-images from the image sensor; control the wobulator to perform, during said cycle, one or two sub-pixel shifts, wherein step sizes of sub-pixel shifts vary within at least one of: same cycle, different cycles, wherein at least one of step sizes is X pixel, wherein X is a fraction lying between 0 and 1, at least one other of step sizes is Y pixels, wherein Y is an integer lying in a range from 1 to Z, Z being equal to a number of pixels of same colour lying along a direction of sub-pixel shift in a smallest repeating M×N array (204a-b) in the image sensor; and process the two or three sub-images to generate image(s).

The image demosaicing method comprises the following steps: determining a red image pixel value, a green image pixel value and a blue image pixel value for a red pixel of a Bayer unit, such that each of the first weighted sum, the second weighted sum, and the third weighted sum of the red image pixel value, the green image pixel value, and the blue image pixel value is equal to the respective sensor pixel value. The first weighted sum is equal to the red sensor pixel value output by the red pixel. The second weighted sum is equal to an average value of green sensor pixel values output by green pixels of the Bayer unit. The third weighted sum is equal to a blue sensor pixel value output by a blue pixel of the Bayer cell. The method further includes outputting a demosaiced image having an RGB triple at a position in the demosaiced image corresponding to a position of the red pixel, the RGB triple including a red image pixel value, a green image pixel value, and a blue image pixel value.

This disclosure provides a demosaicing device and a demosaicing method for image sensor. The method includes capturing a panchromatic image by using a pixel array including switchable pixels and clear pixels, where the panchromatic image is captured when the switchable pixels and the clear pixels are under a clear state. The method includes capturing a chromic image by using the pixel array when the switchable pixels are under a color state and the clear pixels are under the clear state. The method includes performing a weighted average calculation and a signal subtraction on the chromic image and the panchromatic image to generate first resolution chromic images. A resolution of the first resolution chromic images is the same as a resolution of the panchromatic image and the chromic image. The method includes fusing the first resolution chromic images with the panchromatic image to generate demosaiced chromic images.

Disclosed are systems and techniques for image demosaicing with minimal artifacts. The techniques include computing a color value within a first color space for a first pixel of a plurality of pixels based at least on color values within the first color space of a first group of neighboring pixels of the first pixel and computing a first chrominance value within a second color space for the first pixel based at least on the computed color value within the first color space. The techniques include computing a luminance value within the second color space for the first pixel based at least on the first chrominance value within the second color space and converting the luminance value within the second color space and the first chrominance value within the second color space to an output pixel value within a third color space.

A method for generating a digital zoom image by using generative AI may comprise the steps of: acquiring a multi-frame input; performing demosaicing and denoising on the multi-frame input, wherein a denoising intensity is adjusted to be weaker as the number of a plurality of frames included in the multi-frame input increases; acquiring a base image by merging the plurality of frames on which the demosaicing and denoising have been performed; and acquiring a zoomed image by performing super-resolution processing on the base image.

The invention belongs to the field of solid surface temperature shape measurement, and provides a three-dimensional shape and surface temperature synchronous measurement method. Comprising the steps of three-color mask three-dimensional imaging system setting, test environment building, spectral response coefficient calibration, three-color image acquisition, color channel separation, demosaicing hole interpolation, color crosstalk correction, optical flow estimation, three-dimensional coordinate acquisition, three-dimensional grid model generation, temperature evaluation and data fusion. According to the method, the multi-view information is simulated by using the single camera through the three-color mask, the equipment cost is reduced, the temperature is evaluated by using the brightness information of different color channels while multi-view three-dimensional reconstruction is performed on the same data through the multi-view information under the three-color mask, and the result of synchronously monitoring the temperature and the shape is achieved.

The present disclosure provides methods, apparatuses, systems, and computer-readable mediums for demosaicing images by an apparatus. A method includes obtaining, from a plurality of sensors of the apparatus, a plurality of mosaic images, concatenating each image of the plurality of mosaic images with encoded embeddings of the corresponding mosaic pattern of the sensor of the plurality of sensors that captured the image of the plurality of mosaic images, providing the concatenated plurality of mosaic images to a machine learning model, and acquiring, from the machine learning model, a plurality of demosaiced images corresponding to the plurality of mosaic images. Each sensor of the plurality of sensors has a corresponding mosaic pattern from among a plurality of mosaic patterns.

A method of constructing a dictionary of kernels for blending in multi-frame processing (MFP) includes generating, for each ground truth (GT) image in a set of GT images represented in a full color space, a corresponding feature matrix by generating a set of synthetic raw images represented in a color filter mosaic space, performing demosaicing and registration operations on each of the synthetic raw images to generate a corresponding registered image, choosing a set of patches in each registered image, the location of each patch in one registered image coinciding with the location of a corresponding patch in each other registered image, generating, for each patch, a corresponding pixel value matrix containing pixel values of each color channel of each pixel included in the corresponding patch, and extracting features from the pixel value matrices and generating the feature matrix corresponding to the GT image based on the extracted features.

The invention relates to a method (200) for enriching a raw image (IMBP) of a scene on the basis of one or more secondary raw images (IMBS1-IMBSl) of the scene, the method (200) comprising an enrichment phase (210) for enriching the primary raw image (IMBP) and providing an enriched raw image (IMBE), the enrichment phase (210) comprising, for at least one pattern, referred to as the target pattern, of the primary raw image (IMBP), the following steps: - identifying (212), in at least one secondary raw image (IMBS1-IMBSk), a pattern corresponding to the target pattern; and adjusting (216,218) at least one value of the target pattern according to one or more values of identified corresponding patterns. The invention also relates to a method for demosaicing a raw image, to an image processing method, to an image acquisition method, to a computer program, to a device, to a system and to a vehicle implementing such a demosaicing method.

Provided in the present disclosure is an image signal processing method. The method comprises denoising and demosaicing processing, the denoising and demosaicing processing comprising: inputting raw data into a preset image processing model, wherein the raw data comprises a RAW domain image, ISO sensitivity data and LSC data, and the image processing model is an AI model for simultaneously performing denoising processing and demosaicing processing on the RAW domain image; and acquiring a result image outputted by the image processing model, wherein the resolution of the result image is higher than the resolution of the RAW domain image. Further provided in the present disclosure are an electronic device and a computer-readable storage medium.

An image demosaicing method includes determining, for a red pixel of a Bayer unit, a red image-pixel value, a green image-pixel value, and a blue image-pixel value such that each of a first, a second, and a third weighted sum of the red, the green, and the blue image-pixel values equals a respective sensor-pixel value. The first weighted sum equals a red sensor-pixel value output by the red pixel. The second weighted sum equals an average of a green sensor-pixel values output by green pixels of the Bayer unit. The third weighted sum equals a blue sensor-pixel value output by a blue pixel of the Bayer unit. The method also includes outputting a demosaiced image having, at a location in the demosaiced image corresponding to a location of the red pixel, an RGB triplet that includes the red image-pixel value, the green image-pixel value, and the blue image-pixel value.

An apparatus, system, and method are provided for processing an output of a color camera device such that the color camera device can be used to measure color consistency and resolution of an optical system. The processing includes converting an output of the color camera to an XYZ color space using a conversion matrix. A conversion matrix is generated by capturing color images of light of three different wavelength ranges and colorimeter measurements. The processing further includes overcoming the demosaicing effect of the color camera to measure the resolution of the optical system using the optical test target displayed by the optical system. The optical test target has a consistent appearance in the direction of uniformity. A resolution is determined based on a one-dimensional image generated by performing a mathematical operation in a direction of uniformity.

The invention discloses a video processing method and device, and relates to the technical field of video processing. The method comprises the steps of obtaining a to-be-processed video; dividing an image in the video to be processed according to a preset moment node to obtain a frame image at each moment; and inputting the frame image at each moment into the trained residual branch model for image processing to obtain a video processing result. Compared with the prior art, the method has the advantages that the corresponding processing branches are set for decoupling of video processing, noise reduction, fusion and demosaicing, and connection is performed through the residual structure, so that the processing logic relationship among the processing branches is defined, the functions of the trained residual branch model are more comprehensive, and the robustness of the residual branch model is improved. According to the method, noise reduction, demosaicing and fusion tasks in the video can be processed, processing of HDR type and NonHDR type videos is considered at the same time, and the problem that in a related method, processing models are independently set for different tasks, and universality is poor is solved.

The invention discloses an unmanned aerial vehicle detection method and device based on polarization information enhancement and polarization attention characteristics, a medium and equipment, and the method comprises the steps: carrying out the multi-channel splitting and demosaicing of an infrared polarization mosaic image through a polarization decoding student network, and generating a multi-dimensional polarization information graph; carrying out feature extraction on the multi-dimensional polarization information graph based on a YOLOv8 backbone network, and outputting preliminary features; and inputting the initial feature into a polarization attention feature network, generating a target positioning feature, and inputting the target positioning feature into a detection head to obtain an unmanned aerial vehicle detection result. Multi-dimensional polarization information can be obtained from the polarization mosaic image through the polarization decoding student network, and the contrast between the target and the background is improved by using different polarization information; preliminary features of the multi-dimensional polarization information are obtained through a YOLOv8 backbone network, the preliminary features are processed through a polarization attention feature network, and accurate detection of an unmanned aerial vehicle target is achieved on the multi-dimensional polarization information with the contrast ratio remarkably improved.

This disclosure provides systems, methods, and devices for image signal processing that support improved demosaicing of color image signals. In a first aspect, an image processing method includes receiving a first image frame and a second image frame. The method may also include determining a first demosaiced image frame by applying a first demosaicking process to the first image frame, and determining a second demosaiced image frame by applying a second demosaicking process to the first image frame based on the second image frame. A blending weight may be determined based on the first image frame and the second image frame, and a blended image frame may be determined by combining pixel values from corresponding portions of the first demosaiced image frame and the second demosaiced image frame according to the blending weight. Other aspects and features are also claimed and described.

Disclosed are systems and circuits for image demosaicing with minimal artifacts. The circuits are to compute a color value within a first color space for a first pixel of a plurality of pixels based at least on color value within the first color space of a first group of neighboring pixels of the first pixel and compute a first chrominance value within a second color space for the first pixel based at least on the computed color value within the first color space. The circuits are also to compute a luminance value within the second color space for the first pixel based at least on the first chrominance value within the second color space and convert the luminance value within the second color space and the first chrominance value within the second color space to an output pixel value within a third color space.

Methods and systems for providing a real time light weight non-Bayer color filter array (CFA) artificial intelligence (AI) demosaic through an architecture which leverages position dependent interpolation, position aware gradient, and light weight AI demosaic model are provided. The methods include position dependent interpolation and position aware gradient such that maximum information is preserved for efficient training of light weight deep neural network (DNN). The methods include producing high quality demosaic output from non-Bayer CFA image data without suffering from loss of details, texture and resolution power while maintaining low inference time.