54results about "Color television" patented technology

To provide a method, a system, and a device for equipping ACT (Adaptive color Transform) between coding and decoding of images / videos.SOLUTION: The method for processing a video executes the conversion between a current video unit of a video and a bit stream of the video. The bit stream is based on a format rule and the format rule stipulates whether or not a first flag is included in the bit stream. The first flag shows whether or not a second flag of SPS (Sequence Parameter Set) stipulates that ACT (Adaptive Color Transform) for the current video unit mode is invalid.SELECTED DRAWING: Figure 17

A device may be configured to signal downsampling offset information for coded video in a phase indication information message. A device may be configured to receive the phase indication information message. The phase indication message may apply to a current cropped decoded picture and persist for all subsequent pictures of a current layer in output order with the same cropped picture width and cropped picture height as the current cropped decoded picture until a picture in the current layer with an associated phase indication information message and the same cropped picture width and cropped picture height as the current cropped decoded picture is output and follows the current picture in output order.

Controlling integral energy of a light pulse in a hyperspectral, fluorescence, and laser mapping imaging system is disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system includes an electromagnetic sensor for sensing energy emitted by the emitter. The system includes a controller configured to synchronize timing of the emitter and the image sensor. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of a hyperspectral emission, a fluorescence emission, or a laser mapping pattern.

The present invention discloses an image compression method, apparatus, intelligent terminal, and computer-readable storage medium. The method includes: obtaining a target image and determining reference pixel points corresponding to each target pixel point in the target image; for each target pixel point, determining the pixel difference between the target pixel point and its corresponding reference pixel point; determining point compression data corresponding to each target pixel point according to the pixel differences corresponding to the target pixel points; and compressing each target pixel point according to the point compression data corresponding to each target pixel point to obtain image compression data of the target image. The present invention aims to transmit only the difference as compression data when the pixel difference between the pixel value of the target pixel point and the reference value belongs to a preset compression threshold range, greatly reducing the amount of data transmitted, improving the compression rate, without losing the image resolution and bit depth, and completely restoring the original image, which is convenient for users.

Near infrared imaging is highly complementary to color imaging having a wide range of applications. For example, in health applications, the near infrared can provide biomolecular information on tissue that is not apparent under visual examination nor from the inspection of color images of tissue. Thus, there is utility in viewing both visible color and near infrared images in combination. Described herein are methods to perform visible and near infrared imaging as well as hybrid visible color and near infrared imaging with a single conventional color filter array RGB sensor. The methods automatically provide spatially co-registered color and near infrared images and the methods can be used as the basis for a multispectral or hyperspectral imaging system.

To provide a method and apparatus for interaction between an intra prediction mode and a block differential pulse-code modulation mode.SOLUTION: A method of video decoding performed in a video decoder includes: a step 900 of determining whether a first block associated with a second block is coded with a block differential pulse code modulation (BDPCM) mode; a step 902 of associating, in response to determining that the first block is coded with the BDPCM mode (Yes in 900), the first block with an intra prediction mode value based on a BDPCM directional flag; a step 904 of determining an inter prediction mode value for the second block using the intra prediction mode value associated with the first block; and a step 906 of reconstructing the second block using the determined intra prediction mode value.SELECTED DRAWING: Figure 9

A method, system, and bitstream syntax are described for entropy modeling of latent features in image and video coding using a combination of probability density functions. Using high-level syntax elements, an encoder can signal a multi-distribution entropy model to a compliant decoder using syntax elements indicating the number of one or more PDFs used, an identifier for each PDF used in a list of available PDFs, the number of PDF parameters for each PDF, and which PDF parameters are shared between two or more PDFs used.

An image sensor includes a pixel array including a plurality of unit pixels configured to receive light of a color filter array having a first color pattern of size k×l arranged therein, where k and l are natural numbers of 3 or more, the image sensor configured to generate first image data including the first color pattern and an image signal processor (ISP) configured to generate second image data including a second color pattern of size p×q, by remosaicing the first image data, where p and q are natural numbers of 2 or more, where a size of the second color pattern is smaller than a size of the first color pattern, and the image sensor is configured to transmit the second image data an application processor that is external to the image sensor.

Near infrared imaging is highly complementary to color imaging having a wide range of applications. For example, in health applications, the near infrared can provide biomolecular information on tissue that is not apparent under visual examination nor from the inspection of color images of tissue. Thus, there is utility in viewing both visible color and near infrared images in combination. Described herein are methods to perform visible and near infrared imaging as well as hybrid visible color and near infrared imaging with a single conventional color filter array RGB sensor. The methods automatically provide spatially co-registered color and near infrared images and the methods can be used as the basis for a multispectral or hyperspectral imaging system.

Methods, systems, and apparatus for implementing adaptive color transform (ACT) during picture / video encoding and decoding are described. An example method of video processing includes, for conversion between a video including a block and a bitstream of the video, determining that a size of the block is greater than a maximum allowable size for an ACT mode, and performing the conversion based on the determination, wherein, in response to the size of the block being greater than the maximum allowable size for the ACT mode, the block is partitioned into a plurality of sub-blocks, and wherein each of the plurality of sub-blocks shares a same prediction mode, and the ACT mode is enabled at the sub-block level.

In some aspects, a device may receive, from a pixel array of a camera, a first image. The device may configure, based at least in part on the first image, a setting of a filter. The filter may be included within a filter array that is arranged within the camera in association with the pixel array. The device may cause the pixel array to capture a second image. Numerous other aspects are described.

A color filter structure includes multiple color filter groups. Each color filter group includes multiple color filters. For each color filter group, the multiple color filters transmit light of preset wavelength bands, and each color filter corresponding to a respective preset wavelength band. At least two of the preset wavelength bands correspond to a common color channel.

Disclosed are an image decoding and encoding method, a method for transmitting a bitstream, and a medium. An image decoding method performed by a decoding device according to the present document comprises the steps of: acquiring a block-based delta pulse code modulation (BDPCM) flag of a current block; acquiring a BDPCM direction flag of the current block based on a BDPCM flag indicating that BDPCM is applied to the current block; and storing, as an intra prediction mode of the current block, an intra prediction mode of a prediction direction derived on the basis of the BDPCM direction flag.

Methods for implementing Adaptive Color Transformation (ACT) during image / video encoding and decoding are described. Example methods for video processing include, for a conversion between a video comprising blocks and a video bitstream, determining that the block size is greater than the maximum allowed size of the ACT mode, and performing the conversion based on this determination, wherein, in response to the block size being greater than the maximum allowed size of the ACT mode, the block is divided into multiple sub-blocks, and wherein each of the multiple sub-blocks shares the same prediction mode, and the ACT mode is enabled at the sub-block level.

A method for processing images acquired by a multi-spectral RGB-NIR (red / green / blue / near infra-red) sensor includes receiving a RGB-NIR digital image from a multi-spectral RGB-NIR sensor, interpolating an NIR contribution to each R, G and B pixel value, wherein an NIR image is obtained, subtracting the NIR contribution from each R, G and B pixel value in the RGB-NIR digital image wherein a decontaminated RGB-NIR image is obtained, constructing a red, green and blue (RGB) Bayer image from the decontaminated RGB-NIR image, and processing the Bayer image wherein a full color image is obtained. The RGB-NIR digital image includes red (R) pixels, green (G) pixels, blue (B) pixels, and NIR pixels, and every other row in the RGB-NIR digital image includes NIR pixels that alternate with green pixels, and every other row in the RGB-NIR digital image includes green pixels that alternate with red and blue pixels.

To provide systems and methods for signaling downsampling offset information in video coding.SOLUTION: In a system, a device (video image decoding device 600) configured to signal downsampling offset information for coded video in a phase indication information message receives the phase indication information message to be applied to a current cropped decoded picture and persists for all subsequent pictures of a current layer in output order with the same cropped picture width and cropped picture height as the current cropped decoded picture until a picture in the current layer with an associated phase indication information message and the same cropped picture width and cropped picture height as the current cropped decoded picture is output and follows the current picture in output order.SELECTED DRAWING: Figure 11

Controlling integrated energy of light pulses in a laser mapping imaging system is disclosed. A system is disclosed that includes an emitter for emitting pulses of electromagnetic radiation and an image sensor including an array of pixels for sensing reflected electromagnetic radiation. The system includes an electromagnetic sensor for sensing energy emitted by the emitter. The system includes a controller configured to synchronize timing of the emitter and the image sensor. The system causes at least a portion of the pulses of electromagnetic radiation emitted by the emitter to be a laser mapping pattern.

An optical system includes a multispectral sensor; an optical filter including a plurality of optical channels that is disposed over the multispectral sensor; and a lens that is disposed over the optical filter. The lens is configured to direct first light that originates from a scene to the optical filter. The optical filter is configured to pass one or more portions of the first light to the multispectral sensor. The multispectral sensor is configured to generate, based on the one or more portions of the first light, spectral data associated with the scene.

A method for optimizing alignment of X different types of pixels on a sensor array for performance of N different camera tasks, where X and N are integers greater than 1, includes obtaining an output of each of the X types of pixels on the sensor array for an input image, evaluating a quality of the output for each of the N different camera tasks, and obtaining an optimal pixel alignment pattern by adjusting potential pixel alignment patterns for performance of the N different camera tasks according to a user-determined balance of priorities among the N camera tasks.

Disclosed are an image decoding and encoding apparatus and an apparatus for transmitting a bitstream. An image decoding method performed by a decoding device according to the present document comprises the steps of: acquiring a block-based delta pulse code modulation (BDPCM) flag of a current block; acquiring a BDPCM direction flag of the current block based on a BDPCM flag indicating that BDPCM is applied to the current block; and storing, as an intra prediction mode of the current block, an intra prediction mode of a prediction direction derived on the basis of the BDPCM direction flag.

To provide a pixel array that minimizes noise according to color channels of pixels by arranging phase detection pixels evenly, and an image sensor including the pixel array.SOLUTION: The pixel array according to the present invention includes a plurality of pixel groups, and each of the pixel groups includes a plurality of sub pixels arranged in a (m)×(n) matrix (m and n denote a natural number of at least 2) and also includes a plurality of color pixels formed to sense light of different wavelength bands. Each of the color pixels has the same number of phase detection pixels.SELECTED DRAWING: Figure 2

An optical system includes a multispectral sensor; an optical filter including a plurality of optical channels that is disposed over the multispectral sensor; and a lens that is disposed over the optical filter. The lens is configured to direct first light that originates from a scene to the optical filter. The optical filter is configured to pass one or more portions of the first light to the multispectral sensor. The multispectral sensor is configured to generate, based on the one or more portions of the first light, spectral data associated with the scene.

Methods, systems, and devices are described for implementing adaptive color transform (ACT) during picture / video encoding and decoding. An example method of video processing includes, for a conversion between a video and a bitstream of the video, determining that a size of a block is greater than a maximum allowed size of an ACT mode, and performing the conversion based on the determining, wherein, in response to the size of the block being greater than the maximum allowed size of the ACT mode, the block is split into a plurality of sub-blocks, and wherein each of the plurality of sub-blocks shares a same prediction mode and the ACT mode is enabled at a sub-block level.

An image decoding method performed by a decoding device according to the present document comprises the steps of: acquiring a block-based delta pulse code modulation (BDPCM) flag for a current block; on the basis of the BDPCM flag indicating that BDPCM is applied to the current block, acquiring a BDPCM direction flag for the current block; and storing, as an intra-prediction mode of the current block, an intra-prediction mode of a prediction direction derived on the basis of the BDPCM direction flag.

A data processing device (101) for a medical observation apparatus (102) for observing an object (106) under non-white light illumination (108) is configured to access (110) a first and second color input image (112a, 112b) representing the object (106) under non-white light illumination (108), wherein the first color input image (112a) is recorded in a first spectrum (114) and the second color input image (112b) is recorded in a second spectrum (116) different from the first spectrum (114), to access (118) a third color input image (112c) representing the object (106) under white light illumination (120), and to determine (122), based on the first, second and third color input image (112a, 112b, 112c), a color transformation function (124) that maps colors (126a, 126b) of corresponding regions (128a, 128b) in the first and second color input image (112a, 112b) onto a color (126c) of a corresponding region (128c) in the third color input image (112c). Advantageously, the third color input image (112c) requiring white light illumination needs to be taken only once and does not have to be repeated once the color transformation function is determined. The invention further relates to a medical observation apparatus (102), a computer-implemented method and an observation method.

A multi-aperture imaging system comprising a first camera with a first sensor that captures a first image and a second camera with a second sensor that captures a second image, the two cameras having either identical or different FOVs. The first sensor may have a standard color filter array (CFA) covering one sensor section and a non-standard color CFA covering another. The second sensor may have either Clear or standard CFA covered sections. Either image may be chosen to be a primary or an auxiliary image, based on a zoom factor. An output image with a point of view determined by the primary image is obtained by registering the auxiliary image to the primary image.

Provided are a spectral filter, and an image sensor and an electronic device including the spectral filter. The spectral filter includes: a first metal reflective layer; a second metal reflective layer provided above the first metal reflective layer; a plurality of cavities provided between the first and second metal reflective layers, the plurality of cavities including first patterns corresponding to different center wavelengths; and a plurality of lower pattern films provided below the first metal reflective layers, the plurality of lower pattern films including second patterns corresponding to the different center wavelengths.

The present disclosure relates to a filter structure, a shooting method, a device, a terminal, and a storage medium. The filter structure includes a plurality of filter unit groups, and each filter unit group includes a plurality of filters; in each filter unit group, the plurality of filters are used to transmit light in a plurality of set wavelength bands, and the plurality of filters correspond to the plurality of set wavelength bands one by one; among the plurality of set wavelength bands, at least two set wavelength bands correspond to the same set channel. In this filter structure, a plurality of set wavelength bands with a narrower wavelength range are set, which can meet different requirements and improve the user experience.

An imaging sensor (60) includes a first circuit (62) and a second circuit (64). The first circuit (62) acquires first pixel data and outputs the first pixel data from the imaging sensor (60) as conventionally processed image data, wherein the first pixel data is data of conventional gain pixels. The second circuit (64) acquires second pixel data and performs normalization processing on the second pixel data to obtain first normalized pixel data, wherein the second pixel data is data of low gain pixels; if the conventionally processed image data is not saturated, the first normalized pixel data is output from the imaging sensor (60) as conventionally processed image data, and if the conventionally processed image data is saturated, the second normalized pixel data is clipped from the first normalized pixel data and output from the imaging sensor (60) as conventionally processed image data.

An image decoding method performed by a decoding device according to the present document comprises the steps of: acquiring a block-based delta pulse code modulation (BDPCM) flag for a current block; on the basis of the BDPCM flag indicating that BDPCM is applied to the current block, acquiring a BDPCM direction flag for the current block; and storing, as an intra-prediction mode of the current block, an intra-prediction mode of a prediction direction derived on the basis of the BDPCM direction flag.