143 results about "Color filter array" patented technology

The invention provides an array image demosaicing method based on dynamic convolution and adaptive coding, which relates to the technical field of image processing, and comprises the following steps: acquiring single-channel original image data and a corresponding color filtering array arrangement type identifier; converting the arrangement type identifier into a multi-dimensional physical feature vector, and inputting the multi-dimensional physical feature vector into a feature processor of a neural network model to generate a weighting coefficient vector; carrying out weighted combination on the plurality of special arrangement transformation matrixes through a weighting coefficient vector to obtain a transformation component, adding the transformation component and a basic convolution kernel parameter to obtain a dynamic convolution kernel parameter, and carrying out directional modulation on a specific spatial position of the dynamic convolution kernel parameter based on a direction weight component in a multi-dimensional physical feature vector; and performing convolution operation on the original image data by using the dynamic convolution kernel parameters, extracting multi-scale features, reconstructing image features, and outputting multi-channel color image data, so that the method can be adaptive to different color filter array types, and the demosaicing precision and generalization capability are improved.

Each smallest repeating unit (SRU) in a colour filter array has a first sub-unit (FSU) and a second sub-unit (SSU). For a first sub-image, first image data is read out from photo-sensitive cells that correspond to FSUs of SRUs lying in a row (R1-R3) or column, and by skipping reading out from photo-sensitive cells that correspond to SSUs of a first predefined percent (FPP) of the SRUs, while reading out the first image data from photo-sensitive cells that correspond to SSUs of a remainder of the SRUs. For a second sub-image, second image data is read out from photo-sensitive cells that correspond to FSUs of the FPP, whilst skipping reading out from photo-sensitive cells that correspond to FSUs of the remainder, and by skipping reading out from photo-sensitive cells that correspond to the SSUs of the SRUs. Sub-pixel shift is performed between the sub-images. Image(s) are then generated from the sub-images.

Systems and techniques are described for image signal processor motion detection. In various examples, first image data including pixel values may be generated, where each pixel value is associated with a respective color tag of a color filter array. A first set of the pixel values corresponding to a first block may be determined. A second set of pixel values may be determined based on a respective pixel value of the first set and the respective color tag associated with that respective pixel value. A first intensity value associated with the first block may be determined based on the second set of pixel values. A second intensity value associated with a reference block may be determined. A comparison value representing a difference between the first intensity value and the second intensity value may be determined. A signal indicating detected motion may be sent based on the comparison value.

An electrically-controllable color filter array based on a phase-change material, and an artificial vision system. The filter array includes a plurality of color filter units; each of the color filter units includes a metal layer, a bottom transparent conductive layer, a chalcogenide phase-change material layer, and a top transparent conductive layer; the red, green and blue filter function of each of the color filter units is adjusted according to the thickness of the bottom transparent conductive layer and the top transparent conductive layer; in the color filter units arranged in the array; the state transition of the chalcogenide phase-change material layer in each of the color filter units is realized by adjusting an electric pulse applied to the bit line and the word line where the electric pulse is present.

Embodiments of image sensors and methods of fabrication are provided herein. In some embodiments, a device includes: a substrate having a dielectric layer disposed atop the substrate; a pillar disposed within the dielectric layer; and a plurality of voids arranged in an array within the dielectric layer, wherein the pillar is disposed between adjacent voids of the plurality of voids. A two-dimensional array of color filters can be disposed atop the substrate having respective voids of the plurality of voids disposed between adjacent color filters and having the pillar disposed between adjacent voids and between diagonally disposed color filters of the array of color filters. A plurality of photoelectric elements can be disposed in the substrate and correspond to and be disposed beneath individual color filters of the array of color filters.

The invention discloses a self-adaptive brightness control method and system for an optical toning film of a color filter array, and relates to the technical field of photoelectron, and the method comprises the following steps: obtaining characteristic data of display content and ambient light data, and selecting target color band configuration in combination with a preset filtering spectrum band; according to the target ribbon configuration, applying a control signal to the optical toning film to obtain a spectrum correction coefficient; the display content is divided into a plurality of areas, a brightness demand matrix is generated, a corrected local brightness target is obtained in combination with the spectrum correction coefficient, meanwhile, driving data of the micro LED array is solved, and a backlight driving matrix is obtained; the micro LED array performs beam shaping according to the backlight driving matrix, and outputs a target picture in combination with the color filter array and the pixel driving unit; dynamically generating a color correction matrix according to the transmission state of the optical toning film of the target picture and the backlight light field distribution; according to the invention, the problems of brightness balance and color deviation are solved through micro LED partition driving and optical color matching film regulation and control.

Disclosed is an imaging system with an image sensor and processor(s). The image sensor has a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor; a colour filter array with colour filters of at least three different colours; and a polarisation mask with polarisation filters arranged on an optical path of at most a first predefined percent of the colour filters. The processor(s) is / are configured to: read out image data from the image sensor; and process the image data to generate at least one of: a full-resolution colour image, a full-resolution polarisation image, a high-dynamic range (HDR) image.

A CMOS image sensor includes a unit pixel array including a photodiode array, a color filter array, a micro-lens array, and a grid isolation structure laterally separating adjacent color filters. The grid isolation structure includes a first low-n grid, a second low-n grid underlying the first low-n grid, and a metal grid within the second low-n grid, the first low-n grid being narrower than the second low-n grid. The color filter array includes color filter matrixes, all color filter matrixes have the same arrangement pattern. Sizes of color filters in each color filter matrix vary depending on locations of the color filters in the color filter matrix. In an edge portion, a distance between a center of a color filter matrix and a center of a corresponding unit pixel matrix in plan view varies depending on a location of the unit pixel matrix in the CMOS image sensor.

An electronic device includes: memory; a color filter array (CFA); an image sensor operatively connected to the CFA, the image sensor being configured to capture a plurality of images respectively having a plurality of measured spectral densities in a plurality of spectral bands; and a processor operatively connected to the at least one memory and the image sensor, wherein the at least one processor is configured to: measure a plurality of crosstalk values in a plurality of pixels and in a plurality of K channels of the plurality of images (the K represents a number of pixels per a color of the CFA), estimate a plurality of spectral-crosstalk values by applying an estimation function to the plurality of crosstalk values, and control to store, in at least one of the memory, the image sensor, or the processor, the estimated plurality of spectral-crosstalk values.

A light field imaging device and method are provided. The device can include a diffraction grating assembly receiving a wavefront from a scene and including one or more diffraction gratings, each having a grating period along a grating axis and diffracting the wavefront to generate a diffracted wavefront. The device can also include a pixel array disposed under the diffraction grating assembly and detecting the diffracted wavefront in a near-field diffraction regime to provide light field image data about the scene. The pixel array has a pixel pitch along the grating axis that is smaller than the grating period. The device can further include a color filter array disposed over the pixel array to spatio-chromatically sample the diffracted wavefront prior to detection by the pixel array. The device and method can be implemented in backside-illuminated sensor architectures. Diffraction grating assemblies for use in the device and method are also disclosed.

In an example implementation, a method includes a color filter array including a plurality of cells arranged according to a spatially repeating pattern. Each of the cells includes a color filter element having a first area and an optically transparent element having a second area, where the first plane is smaller than the second area. The color filter array is configured to receive light from an environment of the device, filter at least a portion of the light using the unit, and transmit at least a portion of the filtered light to an image sensor.

An electrophoretic display device includes a pixel structure and a color filter array. In the pixel structure, an area of a blue pixel electrode is less than an area of a red pixel electrode, and the area of the blue pixel electrode is less than an area of a green pixel electrode. In the color filter array, areas of red, green, and blue filter units are all substantially the same and the red, green, and blue filter units are overlapped with the red, green, and blue pixel electrodes respectively. A ratio of the area of the red filter unit to the area of the red pixel electrode is RFF; a ratio of the area of the green filter unit to the area of the green pixel electrode is GFF; a ratio of the area of the blue filter unit to the area of the blue pixel electrode is BFF, and BFF>RFF≥GFF.

Methods, systems, and devices for wireless communication are described. A first network entity may receive control signaling from a second network entity indicating an image mask representing a color filter array for generating a mosaic image at the second network entity. A first network entity may receive a first image from a second network entity over a wireless communication channel, and the first image may be a single-layer image comprising a mosaic pattern according to a color filter array. The first network entity may generate a second image based on the first image and the image mask, and the second image may include a plurality of layers associated with a color of the second image.

An electrically-controllable color filter array based on a phase-change material, and an artificial vision system. The filter array includes a plurality of color filter units; each of the color filter units includes a metal layer, a bottom transparent conductive layer, a chalcogenide phase-change material layer, and a top transparent conductive layer; the red, green and blue filter function of each of the color filter units is adjusted according to the thickness of the bottom transparent conductive layer and the top transparent conductive layer; in the color filter units arranged in the array; the state transition of the chalcogenide phase-change material layer in each of the color filter units is realized by adjusting an electric pulse applied to the bit line and the word line where the electric pulse is present.

The invention provides an image sensor and a crosstalk amount reducing method thereof, the image sensor comprises a pixel array structure, and the pixel array structure is an array composed of a plurality of pixels; a photoelectric conversion structure; the color filter array comprises at least two color filter units with different colors, the color filter units with different pigments correspond to different spectrum channels, one color filter unit corresponds to at least two spectrum channels with different light sensitivities, and the other color filter unit corresponds to at least two spectrum channels with different light sensitivities. The color filter array is located in the light incidence direction of the pixel array structure, the pixel array structure is located between the photoelectric conversion structure and the color filter array and is connected with the photoelectric conversion structure, and the color filter array is located in the light incidence direction of the pixel array structure. Wherein after photoelectric signal conversion is completed, photoelectric signals, close to purity, of the pixels are obtained through operation.

An image sensor includes a pixel array including a plurality of unit pixels configured to receive light of a color filter array having a first color pattern of size k×l arranged therein, where k and l are natural numbers of 3 or more, the image sensor configured to generate first image data including the first color pattern and an image signal processor (ISP) configured to generate second image data including a second color pattern of size p×q, by remosaicing the first image data, where p and q are natural numbers of 2 or more, where a size of the second color pattern is smaller than a size of the first color pattern, and the image sensor is configured to transmit the second image data an application processor that is external to the image sensor.

An image sensor includes a pixel array and a color filter array covering the pixel array, where the color filter array includes a plurality of color filter elements, the plurality of color filter elements include at least one first color filter element and at least one second color filter element, each first color filter element includes a basic color filter and an extended color filter, and each second color filter element includes a plurality of basic color filters. A color of the extended color filter is different from a color of the basic color filter. An optical signal passing through the basic color filter is at least for imaging, and an optical signal passing through the extended color filter is for spectral measurement.

A photographic film is formed by combining panchromatic black and white emulsion with a color filter array to produce a full color image using only black and white film and processing.

Near infrared imaging is highly complementary to color imaging having a wide range of applications. For example, in health applications, the near infrared can provide biomolecular information on tissue that is not apparent under visual examination nor from the inspection of color images of tissue. Thus, there is utility in viewing both visible color and near infrared images in combination. Described herein are methods to perform visible and near infrared imaging as well as hybrid visible color and near infrared imaging with a single conventional color filter array RGB sensor. The methods automatically provide spatially co-registered color and near infrared images and the methods can be used as the basis for a multispectral or hyperspectral imaging system.

A color electro-optic display includes a layer of electro-optic material having a light-transmissive electrode on a viewing side, an array of pixel electrodes on an opposite side, and a color filter array (CFA) on the viewing side. The pixel electrodes drive selected portions of the electro-optic material between white and black optical states. The CFA includes an array of pixels, each of which has at least three color filter elements. Each color filter element is aligned with a different one of the pixel electrodes such that the color of any color filter element is visible when the adjacent portion of the electro-optic material is driven to the white optical state, and not visible when driven to the black optical state. The colors of the color filter elements have the same lightness or a lightness difference no greater than 10L* to substantially eliminate visible CFA texture patterns in displayed images.

Methods and systems for providing a real time light weight non-Bayer color filter array (CFA) artificial intelligence (AI) demosaic through an architecture which leverages position dependent interpolation, position aware gradient, and light weight AI demosaic model are provided. The methods include position dependent interpolation and position aware gradient such that maximum information is preserved for efficient training of light weight deep neural network (DNN). The methods include producing high quality demosaic output from non-Bayer CFA image data without suffering from loss of details, texture and resolution power while maintaining low inference time.

A color filter layer array and a color electrophoretic display having the color filter layer array, the color filter layer array comprising a plurality of first color resist, a plurality of second color resist and a plurality of third color resist. The first color resist individually has a first color. The second color resist individually has a second color. The third color resist individually has a third color. The reflectivity of the third color resist is greater than the reflectivity of the first color resist and the reflectivity of the second color resist. The first color resist is continuously arranged in a first diagonal direction and a second diagonal direction, and the third color resist is not continuously arranged in the second diagonal direction. By interleaving the first color resist and the second color resist, the color resist arrangement regularity of the color filter layer array is reduced, and the stripe pattern of the first color resist and the second color resist in the white picture can be avoided.

The present invention discloses a moiré-based pose estimation system and method, including: an image preprocessing module for processing an image with a screen as the main body captured by a camera to extract an effective central region and moiré features; a position estimation module for selecting interest points on the preprocessed image, calculating the estimated distance from the camera to the points on the screen corresponding to each interest point, and finally calculating the relative position between the camera and the screen according to the multilateration method; and an attitude estimation module for calculating and estimating the relative attitude between the camera and the screen based on the camera optical axis and roll angle measurement. The present invention utilizes the moiré formed by the superposition of the color filter array at the front end of the camera and the screen projection pixels, and can realize the six-degree-of-freedom relative pose estimation between the camera and the screen without relying on visual markers.

The application provides an image sensor and an imaging device. The image sensor comprises a microlens array, a color filter array and a photosensitive pixel array. The microlens array comprises a plurality of first lens units and at least one second lens unit. The color filter array comprises a plurality of first color filter units and at least one second color filter unit. The transmittance of the first color filter units is different from that of the second color filter units. The first lens units are arranged correspondingly to the first color filter units, and the second lens units are arranged correspondingly to the second color filter units. The photosensitive pixel array comprises a plurality of pixel units. The first color filter units cover at least one pixel unit, and the second color filter units cover at least one pixel unit. Light signals passing through the first lens units and the first color filter units form first electric signals. Light signals passing through the second lens units and the second color filter units are used to form at least second electric signals. An image signal is formed based on the first electric signals and the second electric signals.

This invention provides an image reconstruction method, an image sensor, and a terminal device. The method includes: acquiring a color filter array image collected by the image sensor; acquiring a high-frequency image and a low-frequency image based on the color filter array image; for each pixel in the high-frequency image, acquiring the region feature fusion weight and distance feature fusion weight corresponding to that pixel; for each pixel in the high-frequency image, acquiring the mixing weight corresponding to that pixel based on the region feature fusion weight and distance feature fusion weight; and fusing the high-frequency image and the low-frequency image based on the mixing weight corresponding to each pixel in the high-frequency image to generate a reconstructed image. This invention can improve the image quality noise and false colors in the edge areas while ensuring the clarity of details in the central region of the image, thereby significantly improving the overall image reconstruction quality.

A method includes obtaining a ground truth image and generating multiple image frames using the ground truth image, a modeled optical blur, and a modeled global motion. The method also includes generating multiple mosaic image frames using the image frames and a color filter array and generating multiple raw input image frames using the mosaic image frames and a noise model associated with at least one imaging sensor. The method further includes providing the raw input image frames to a multi-frame processing pipeline in order to generate synthetic training data. In addition, the method includes training a machine learning-based image processing engine using the ground truth image and the synthetic training data.

The color filter array includes multiple first color resist, multiple second color resists, and second color resists third color resists. The first color resist have a first color. The second color resists have a second color different from the first color. The third color resists have a third color different from the first color and second color. A reflectance of the third color resists is greater than a reflectance of the first color resists and a reflectance of the second color resists, the first color resists are continuously arranged along a first diagonal direction and a second diagonal direction, and the third color resists are not arranged along the second diagonal direction continuously.

An aspect of the present disclosure provides an information processing apparatus, an information processing system, an information processing method, and an information processing program which can suppress a decrease in a recognition rate of recognition processing even in a case where recognition processing is performed using data of a partial region of image data.An information processing apparatus includes a reading unit that sets a readout pixel as a part of a pixel region in which a plurality of pixels is arranged in a two-dimensional array, and controls reading out of a pixel signal from the pixel included in the pixel region; and a setting unit that sets the readout pixel on the basis of color filter array information of the pixel region.

The present application relates to the field of endoscope imaging, in particular to a single-channel filtering demosaicing method and system for endoscope images; the horizontal direction local gradient intensity and the vertical direction local gradient intensity of green pixels in a color filter array image are calculated, the green pixels are adaptively interpolated according to the difference between the horizontal direction local gradient intensity and the vertical direction local gradient intensity, and an initial green channel is obtained; the pixels in the initial green channel are subjected to bilateral filtering, and a filtered green channel is obtained; based on the filtered green channel, residual interpolation is used to respectively reconstruct a red channel and a blue channel, and a demosaiced image is obtained; the present application reduces the risk of false color and noise amplification, has the characteristics of strong edge preservation ability, high overall color restoration precision, simple algorithm and easy hardware implementation.

The invention relates to a compressed sensing hyperspectral-full Stokes polarization double-layer metasurface device, and the device comprises a multispectral color filter array layer which comprises a plurality of different color filters and is designed by taking the minimum similarity of the transmission spectrums of the different color filters as a target; the broadband polarization routing metasurface layer comprises a plurality of metasurface atoms, and each metasurface atom generates differential phase response to light in different polarization states. The wavelength and polarization state of incident light can be synchronously modulated in the visible light range, hyperspectral and full-polarization information is obtained at the same time in combination with a reconstruction algorithm, and compared with a traditional color filter imaging scheme, the light energy utilization efficiency is remarkably improved, complex polarization optical elements are avoided, and the system size and weight are reduced.