512 results about "Tone mapping" patented technology

A system and process for generating High Dynamic Range (HDR) video is presented which involves first capturing a video image sequence while varying the exposure so as to alternate between frames having a shorter and longer exposure. The exposure for each frame is set prior to it being captured as a function of the pixel brightness distribution in preceding frames. Next, for each frame of the video, the corresponding pixels between the frame under consideration and both preceding and subsequent frames are identified. For each corresponding pixel set, at least one pixel is identified as representing a trustworthy pixel. The pixel color information associated with the trustworthy pixels is then employed to compute a radiance value for each pixel set to form a radiance map. A tone mapping procedure can then be performed to convert the radiance map into an 8-bit representation of the HDR frame.

A data structure defining a high dynamic range image comprises a tone map having a reduced dynamic range and HDR information. The high dynamic range image can be reconstructed from the tone map and the HDR information. The data structure can be backwards compatible with legacy hardware or software viewers. The data structure may comprise a JFIF file having the tone map encoded as a JPEG image with the HDR information in an application extension or comment field of the JFIF file, or a MPEG file having the tone map encoded as a MPEG image with the HDR information in a video or audio channel of the MPEG file. Apparatus and methods for encoding or decoding the data structure may apply pre- or post correction to compensate for lossy encoding of the high dynamic range information.

Techniques for creating a High Dynamic Range (HDR) image within a consumer grade digital camera from a series of images of a scene captured at different exposure levels, and displaying the HDR image on the camera's built-in display, are provided. The approach employs mixing images of the series to incorporate both scene shadow and highlight details, and the removing of “ghost” image artifacts appearing in the mixed HDR image resulting from movement in the scene over the time the series images are captured. The low computational resource utilization of the present invention's image mixing and ghost removal processing operations, along with the present invention's ability to commence image mixing and ghost removal prior to the acquisition of all series images, can significantly reduce the time required to generate and display a tone mapped HDR image.

Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and / or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.

An adaptive image tone mapping curve based on perceptual preference guidelines is generated as a sigmoidal function, in which the sigmoidal function parameters (slope and shift) are determined by original image statistics. Tone curves generated for different images each have a smooth sigmoidal shape, so that the tone mapping process does not change the image histogram shape drastically. The sigmoidal function has the form: <math-cwu id="MATH-US-00001"> <number>1< / number> t it ( x ) = 100 1 + exp it ( - alpha it ( x / 100 - beta ) ) , <mathematica-file id="MATHEMATICA-00001" file="US20020171852A1-20021121-M00001.NB" / > <image id="EMI-M00001" wi="216.027" he="18.96615" file="US20020171852A1-20021121-M00001.TIF" imf="TIFF" ti="MF" / > < / math-cwu> where alpha is the slope parameter and beta is the shift parameter. The input value x in the sigmoidal function varies in the range [0, 100], because the tone curve is generated on an L* scale, which has values from 0 to 100. The sigmoidal tone curve calculation can be implemented efficiently using simple arithmetic operations by pre-calculating and storing various factors used in the calculation of alpha and beta and by pre-generating a pair of fixed tone curves with two extreme slopes and interpolating between the curves.

For two or more versions of a video with different spatial, temporal or SNR resolution, scalability can be achieved by generating a base layer and an enhancement layer. When a version of a video is available that has higher color bit depth than can be displayed, a common solution is tone mapping. A more efficient compression method is proposed for the case where the two or more versions with different color bit depth use different color encoding. The present invention is based on joint inter-layer prediction among the available color channels. Thus, color bit depth scalability can also be used where the two or more versions with different color bit depth use different color encoding. In this case the inter-layer prediction is a joint prediction based on all color components. Prediction may also include color space conversion and gamma correction.

A method of HDR image processing and manipulation, including the steps of displaying a first control element for loading of multiple files containing pixel values of differently exposed LDR images, and metadata information including exposure times of the LDR images, displaying thumbnails of the LDR images sorted by the exposure times, displaying a second control element for automatic creation of a camera response function using the pixel values and the exposure times, displaying a first setting element for acquisition of an overall contrast and a set of values determining a first mapping function, and displaying a third control element for construction and displaying of an HDR radiance map by contrast reduction and tone mapping adjustment.

An apparatus, method, computer useable medium, and processor programmed to automatically generate tone mapping curves in a digital camera based on image metadata are described. Rather than having a static tone mapping curve for all images, the curve can be varied automatically based on, e.g., the brightness histogram of the image. In one embodiment, a certain percentage of the least bright pixels and a certain percentage of the brightest pixels can be disregarded, while the remaining pixels can be linearly stretched to encompass the original range of brightness values. Based on the distribution of the resultant stretched brightness histogram, slopes for the low end (S0) and high end (S1) of the tone mapping curve can be independently determined, and the tone mapping curve can be automatically generated. The improved, automatically generated tone mapping curve may be able to lift shadows more aggressively and / or increase the dynamic range of the image.

Video processing techniques and pipelines that support capture, distribution, and display of high dynamic range (HDR) image data to both HDR-enabled display devices and display devices that do not support HDR imaging. A sensor pipeline may generate standard dynamic range (SDR) data from HDR data captured by a sensor using tone mapping, for example local tone mapping. Information used to generate the SDR data may be provided to a display pipeline as metadata with the generated SDR data. If a target display does not support HDR imaging, the SDR data may be directly rendered by the display pipeline. If the target display does support HDR imaging, then an inverse mapping technique may be applied to the SDR data according to the metadata to render HDR data for display. Information used in performing color gamut mapping may also be provided in the metadata and used to recover clipped colors for display.

Tone mapping a high dynamic range (HDR) image is performed by obtaining a log-norm luminance component based on a normalized logarithm of the HDR image. The log-norm luminance component is flattened (tone-compressed) using incrementally-spaced adaptation levels, which are increasingly blurrier representations of the log-norm luminance component, weighted by a diminishing factor. Visual cues are restored by injecting a proportion of values of the log-norm luminance component, applying histogram tail clipping, and applying a sigmoid curve mapping, to create a restored luminance component. A tone-compressed image is obtained by mapping luminance of the HDR image using the restored luminance component and adjusting saturation of the mapped HDR image.

The present invention relates to a method capable of real-time implementable local tone mapping of high dynamic range images. In one embodiment, the present invention relates to a method capable of accomplishing real-time local tone mapping of high dynamic range images so that they have clear details without, for example, halo artifacts when viewed on standard display devices. In another embodiment, the present invention relates to a method capable of accomplishing real-time local tone mapping of high dynamic range images so that they have clear details without, for example, halo artifacts when viewed on standard display devices where such a method utilizes, in part, a modified Reinhard operator.

A system and process for generating High Dynamic Range (HDR) video is presented which involves first capturing a video image sequence while varying the exposure so as to alternate between frames having a shorter and longer exposure. The exposure for each frame is set prior to it being captured as a function of the pixel brightness distribution in preceding frames. Next, for each frame of the video, the corresponding pixels between the frame under consideration and both preceding and subsequent frames are identified. For each corresponding pixel set, at least one pixel is identified as representing a trustworthy pixel. The pixel color information associated with the trustworthy pixels is then employed to compute a radiance value for each pixel set to form a radiance map. A tone mapping procedure can then be performed to convert the radiance map into an 8-bit representation of the HDR frame.

A method for processing high dynamic range (HDR) images by selecting preferred tone mapping operators and gamut mapping algorithms based on scene classification. Scenes are classified into indoor scenes, outdoor scenes, and scenes with people, and tone mapping operators and gamut mapping algorithms are selected on that basis. Prior to scene classification, the multiple images taken at various exposure values are fused into a low dynamic range (LDR) image using an exposure fusing algorithm, and scene classification is performed using the fused LDR image. Then, the HDR image generated from the multiple images are tone mapped into a LDR image using the selected tone mapping operator and then gamut mapped to the color space of the output device such as printer.

The invention discloses a system and a method for processing image data using an image signal processor. Disclosed embodiments provide for a an image signal processing system (32) that includes back-end pixel processing unit (120) that receives pixel data after being processed by at least one of a front-end pixel processing unit (80) and a pixel processing pipeline (82). In certain embodiments, the back-end processing unit (120) receives luma / chroma image data and may be configured to apply face detection operations, local tone mapping, bright, contrast, color adjustments, as well as scaling. Further, the back-end processing unit (120) may also include a back-end statistics unit (2208) that may collect frequency statistics. The frequency statistics may be provided to an encoder (118) and may be used to determine quantization parameters that are to be applied to an image frame.

A method for tone mapping high dynamic range images for display on low dynamic range displays wherein high dynamic range images are first accessed. The high dynamic range images are divided the into different regions such that each region is represented by a matrix, where each element of the matrix is a weight or probability of a pixel value. An exposure of each region is determined or calculated by estimating an anchor point in each region such that most pixels in each region are mapped to mid grey and the anchor points are adjusted to a key of the images to preserve overall brightness. The regions are then placed or mapped to zones and exposure values are applied to the regions responsive to the weight or probability. The regions are fused together to obtain a final tone mapped image.

This is generally directed to systems and methods for local tone mapping of high dynamic range (“HDR”) images. For example, a HDR image can have its larger dynamic range mapped into the smaller dynamic range of a display device. In some embodiments, to perform the local tone mapping, a RGB to Y converter can be used to convert the input image signal to a luminance signal in the YCgCo color space, a shape adaptive filter can be used to separate the luminance signal into its illumination and reflectance components, contrast compression can be applied to the illumination component, image sharpening can be applied to the reflectance component, and the processed illumination and reflection components can be used to calculate a processed RGB signal. The dynamic range of the processed RGB signal can then be mapped into the dynamic range of the display device.

The ratio between coding quality on the one hand and coding rate on the other hand is increased. To this end, a global predictor and a local predictor are used in combination. The global predictor derives a global tone-mapping function based on a statistical analysis of pairs of values of co-located samples in the first tone-mapped version and the second version of the picture, and applies the global tone-mapping function onto the first tone-mapped version of the picture. The local predictor locally derives a locally varying tone-mapping function based on a statistical analysis of values of co-located samples in the second version of the picture and the globally predicted reference picture in units of sub-portions into which the globally predicted reference picture and the second version of the picture are partitioned, and applies the locally varying tone-mapping function onto the globally predicted reference picture.

An adaptive image tone mapping curve based on perceptual preference guidelines is generated as a sigmoidal function, in which the sigmoidal function parameters (slope and shift) are determined by original image statistics. Tone curves generated for different images each have a smooth sigmoidal shape, so that the tone mapping process does not change the image histogram shape drastically. The sigmoidal function has the form: t⁢(x)=1001+exp⁢(-α⁢(x / 100-β)),where α is the slope parameter and β is the shift parameter. The input value x in the sigmoidal function varies in the range [0, 100], because the tone curve is generated on an L* scale, which has values from 0 to 100. The sigmoidal tone curve calculation can be implemented efficiently using simple arithmetic operations by pre-calculating and storing various factors used in the calculation of α and β and by pre-generating a pair of fixed tone curves with two extreme slopes and interpolating between the curves.

Techniques and tools for high dynamic range (HDR) image rendering and generation. An HDR image generating system performs motion analysis on a set of lower dynamic range (LDR) images and derives relative exposure levels for the images based on information obtained in the motion analysis. These relative exposure levels are used when integrating the LDR images to form an HDR image. An HDR image rendering system tone maps sample values in an HDR image to a respective lower dynamic range value, and calculates local contrast values. Residual signals are derived based on local contrast, and sample values for an LDR image are calculated based on the tone-mapped sample values and the residual signals. User preference information can be used during various stages of HDR image generation or rendering.

An image processing method for processing image data comprises the steps of obtaining scanpath data corresponding to original image data, determining regions of interest for the original image data based on the obtained scanpath data, and mapping tone values of the original image data corresponding to each region of interest in order to obtain tone-mapped image data.

A method of local tone mapping of a high dynamic range (HDR) image is provided that includes dividing a luminance image of the HDR image into overlapping blocks and computing a local tone curve for each block, computing a tone mapped value for each pixel of the luminance image as a weighted sum of values computed by applying local tone curves of neighboring blocks to the pixel value, computing a gain for each pixel as a ratio of the tone mapped value to the value of the pixel, and applying the gains to corresponding pixels in the HDR image. A weight for each value is computed based on distance from the pixel to the center point of the block having the local tone curve applied to compute the value and the intensity difference between the value of the pixel and the block mean pixel value.

Tone mapping a high dynamic range (HDR) image is performed by obtaining a log-norm luminance component based on a normalized logarithm of the HDR image. The log-norm luminance component is flattened (tone-compressed) using incrementally-spaced adaptation levels, which are increasingly blurrier representations of the log-norm luminance component, weighted by a diminishing factor. Visual cues are restored by injecting a proportion of values of the log-norm luminance component, applying histogram tail clipping, and applying a sigmoid curve mapping, to create a restored luminance component. A tone-compressed image is obtained by mapping luminance of the HDR image using the restored luminance component and adjusting saturation of the mapped HDR image.

Various embodiments provide tone mapping of images and video from one dynamic range to an available dynamic range of a display device while preserving or enhancing image details. According to one embodiment, an enhanced tone mapping module is configured to decrease a luminance of an image or video from a high dynamic range to a standard dynamic range. Conversely, according to one embodiment, an enhanced inverse tone mapper to increase a luminance of an image or video from a standard dynamic range to a high dynamic range.

A dynamic tone mapping technique is presented that produces a local tone map for a sub-image of a wide-angle, high dynamic range (HDR), which is used in rendering the sub-image for display. The technique generally involves first computing a global tone map of the wide-angle, HDR image in advance of rendering the sub-image. The global tone map is then used during rendering to compute a local tone map based on the average luminance and contrast of the pixels of the sub-image. In addition, the sub-image can be tone mapped as part of the rendering of a sequence of sub-images during a viewer-executed panning and / or zooming session. In this case, the local tone maps can be kept from changing too rapidly by adding a hysteresis feature to smooth out the intensity changes between successive sub-images.

A method for brightness and contrast enhancement includes computing a luminance histogram of a digital image, computing first distances from the luminance histogram to a plurality of predetermined luminance histograms, estimating first control point values for a global tone mapping curve from predetermined control point values corresponding to a subset of the predetermined luminance histograms selected based on the computed first distances, and interpolating the estimated control point values to determine the global tone mapping curve. The method may also include dividing the digital image into a plurality of image blocks, and enhancing each pixel in the digital image by computing second distances from a pixel in an image block to the centers of neighboring image blocks, and computing an enhanced pixel value based on the computed second distances, predetermined control point values corresponding to the neighboring image blocks, and the global tone mapping curve.

A method of producing a compressed video data stream (12) by compressing a stream of relatively high dynamic range video frames (2). A bilateral filter (3) extracts a base frame (4) with luminance information. The base frame (4) and the original frame (2) are used to provide a detail frame (5) with chroma information. A tone mapping operation (6) is selected (7, 11) and applied to the base frame to generate a relatively low dynamic range base frame (8), which is then compressed (9). The detail frame (5) is compressed separately. Final frame data (12) is then created, consisting of the compressed relatively low dynamic range base frame, the compressed detail frame, and stored information in respect of the tone mapping operation that had been applied to the base frame.

An image processing method and apparatus for obtaining a wide dynamic range image, the method including: obtaining a plurality of low dynamic range images having different exposure levels for a same scene; generating motion map representing whether motion occurred, depending on brightness ranks of the plurality of low dynamic range images; obtaining weights for the plurality of low dynamic range images; generating a weight map by combining the weights and the motion map; and generating a wide dynamic range image by fusing the plurality of low dynamic range images and the weight map. According to the image processing method and apparatus, it is possible to accurately detect motion area using a rank map, obtain a wide dynamic range image at a higher operation speed, and reduce a possibility that a phenomenon such as color warping occurs by directly combining images without using a tone mapping process.

The invention discloses a real-time drafting and displaying method of highly dynamic scope image, which comprises the following steps: 1) remaining highly dynamic scope information when drafting scene; 2) calculating the average brightness of image; filtering the brightness of image according to the threshold; generating new image with high-brightness filtered area; proceeding two-dimensional Gauss fuzzy for new image; generating glow effect; 3) mapping color tone of image with highly dynamic scope information; displaying the image with highly dynamic scope information to display in the low dynamic scope; keeping details as many as possible; 4) generating final image after do alpha mixing the color tone mapped image and fuzzy image. The invention reduces the calculation quantity, which satisfies the drafting need with good practical value.

A technique is provided for generating sharp, well-exposed, color images from low-light images. A series of under-exposed images is acquired. A mean image is computed and a sum image is generated each based on the series of under-exposed images. Chrominance variables of pixels of the mean image are mapped to chrominance variables of pixels of the sum image. Chrominance values of pixels within the series of under-exposed images are replaced with chrominance values of the sum image. A set of sharp, well-exposed, color images is generated based on the series of under-exposed images with replaced chrominance values.