121 results about "Tone mapping" patented technology

To employ low resolution, noisy tone mapping operations for high resolution images, at least one raw image frame is converted to a first image at a higher resolution and a second image at a lower resolution. Tone mapping is applied to the second image to derive a third image at the lower resolution. Histogram matching and regularization are performed to determine a lookup table approximating histogram matching of the second image to the third image. A global gain map is derived based on luma for the first image and the lookup table. A local gain map is derived by up-sampling and denoising residual differences between the third image and the lookup table applied to the second image. Based on the global gain map and the local gain map, a total gain map is determined for tone mapping the first image to produce a fourth image at the first resolution.

The invention discloses a night enhanced imaging and dynamic denoising method for an automobile data recorder, relates to the technical field of vehicle-mounted image processing and computational photography, and is used for solving the problems of insufficient brightness and too strong noise of night videos of the automobile data recorder under a low-illumination condition. Estimating the zero-mean Gaussian noise intensity of a read link and the Poisson noise intensity increasing along with the brightness in the same frame, converting the zero-mean Gaussian noise intensity and the Poisson noise intensity into brightness equivalent parameters, and introducing a unified control function G as the scale reference of all enhancement and noise reduction links; defining a sharing priori H and carrying out unified constraint in dense optical flow, depth time sequence denoising and local tone mapping; and in combination with the motion mask and the background model, performing differential space-time denoising and proportional write-back, and in cooperation with motion blur detection, spatial variation motion kernel and constrained deconvolution and multi-frame detail recharge, obtaining target brightness and outputting an RGB frame after proportional write-back.

A computing system for generating a gain map-based enhanced High Dynamic Resolution (HDR) image receives an HDR image comprising a plurality of pixels, each pixel having one or a plurality of brightness values for each of a plurality of color components, applies at least a first tone mapping algorithm to each pixel in the HDR image, generates a gain map using the HDR image and the SDR image, generates a gain map-based enhanced HDR image based on the SDR image and the gain map, and generates an output based on the gain map-based enhanced HDR image.

The invention relates to the technical field of augmented reality, in particular to a 24-solar-term astronomical space-time presentation method and system based on mixed reality. The method comprises the following steps: firstly, reading augmented reality scene initialization data, configuring virtual scene parameters, and executing three-dimensional scene registration to generate a registration matrix; executing visual tracking by collecting an image stream, and generating a viewpoint transformation matrix; the system performs real-time sky semantic segmentation on an image stream to generate a binarized sky mask, and constructs an augmented reality rendering pipeline: synthesizing registration and viewpoint matrix calculation rendering operators, using the sky mask as an Alpha mask to perform pixel-level fusion of a virtual starry sky and a real sky, and combining sparse point clouds to perform depth occlusion synthesis, so as to obtain an augmented reality rendering pipeline. An atmospheric optical coloring model and a dynamic volume particle system are loaded for environmental atmosphere enhancement; and optical consistency fusion of a virtual image and a real environment is further realized through HDR luminosity alignment and tone mapping, and finally high-fidelity augmented reality superposition is realized.

The embodiment of the invention provides an image processing method, electronic equipment, a storage medium and a program product. The image processing method comprises the following steps: determining the original pixel brightness of a current image according to image data to be processed; dividing the original pixel brightness into a plurality of data branches; obtaining a histogram corresponding to the original pixel brightness of each data branch; determining a tone mapping curve of each data branch based on a tone mapping model and the histogram; fusing the tone mapping curve of each data branch to obtain a fusion curve; obtaining target pixel brightness corresponding to the original pixel brightness based on the fusion curve; and determining target image data corresponding to the to-be-processed image data based on the original pixel brightness and the target pixel brightness. According to the scheme of the embodiment, automatic tone mapping is realized, and the flexibility and the adaptability of tone mapping are improved.

This disclosure provides systems, methods, and devices for machine learning techniques that support image processing for use in a vehicle assistance system. In one aspect, a method is provided that includes receiving a first image frame captured from a camera positioned on a vehicle. The method further includes determining, based on the first image frame, a probability value that the first image frame depicts at least a portion of a windshield wiper blade. A time filter is determined based on the probability value, and an output image frame is determined by tone mapping a second image frame according to the time filter. Other aspects and features are also claimed and described.

In some examples, the method for tone mapping a high dynamic range (HDR) image to a lower dynamic range image (TDR) comprises obtaining a luminous intensity image based on the HDR image, processing the luminous intensity image using a feature extractor network, whereby to generate a feature map, processing the feature map using at least one neural network module of multiple neural network modules, obtaining a tone mapping operator based on an output of the at least one neural network module of the multiple neural network modules, and applying the tone mapping operator to the HDR image, whereby to obtain the TDR image, wherein the tone mapping operator comprises a tone mapping curve.

The invention relates to a tone mapping method and device, electronic equipment and a storage medium. According to the method, a first logical operation unit, a second logical operation unit, a third logical operation unit and a lookup table of a field programmable logic gate array are matched with one another. Specifically, by inputting the Y channel median value into the lookup table, the Y channel value adjustment coefficient can be directly obtained, and exponential operation between the Y channel median value and the Y channel value adjustment coefficient does not need to be carried out. By inputting the ratio of the Y channel value of each pixel stretched to the full domain to the median value of the Y channel of each pixel stretched to the full domain into the lookup table, the compression value of the Y channel can be directly obtained, and exponential operation of the ratio and the compression value of the Y channel is not needed, so that the data processing efficiency is improved, and the operation resources are saved.

The invention provides a halo suppression method and device during tone mapping, equipment, a medium and a product, and relates to the technical field of image processing. The halo suppression method during tone mapping comprises the following steps: acquiring a dynamic range compression curve of an image to be processed; calculating the target probability of each pixel point based on the pixel value of each pixel point in the to-be-processed image; the target probability represents the probability of whether the pixel point belongs to halo; based on the target probability of each pixel point, correcting the initial brightness value of the pixel point to obtain an updated brightness value of each pixel point; wherein the probability that the pixel point belongs to the halo is positively correlated with the amplification of the updated brightness value obtained by correction relative to the initial brightness value; and determining a respective mapping brightness value from the dynamic range compression curve based on the updated brightness value of each pixel point to obtain an output image.

Provided is an electronic device for, and method of, displaying an image, the electronic device including: a display; at least one processor; and memory storing one or more instructions that, when individually or collectively executed by the at least one processor, may cause the electronic device to: obtain an on-pixel ratio (OPR) based on input image data, determine a target luminance based on the OPR and a display set luminance, perform HDR tone mapping, using the target luminance, on the input image data, and control the display to display an image corresponding to the input image data on which HDR tone mapping is performed.

One embodiment provides a method comprising determining multi-dimensional metadata corresponding to an input image, and determining ambient light information indicative of an ambient light level in a surrounding environment of a display device. The multi-dimensional metadata includes a distribution function of pixels in the input image. The method further comprises determining one or more gains to adaptively compensate for the ambient light level in the surrounding environment based on the ambient light information. The method further comprises generating a tone mapping function based on the multi-dimensional metadata and the one or more gains, and applying the tone mapping function to the input image to generate a tone mapped image that is adaptively compensated for the ambient light level in the surrounding environment. The tone mapped image is provided to the display device for presentation.

The application discloses a method and related device for image processing, obtaining a first feature map and a second feature map, the first feature map is used for describing high-frequency detail features of a target image, and the second feature map is used for describing low-frequency structural features of the target image, and the first feature map and the second feature map have the same size. The first feature map is subjected to first convolution processing to obtain a first enhancement result, and the second feature map is subjected to second convolution processing to obtain a second enhancement result. The first enhancement result and the second enhancement result are fused to obtain a first fusion result, and the first fusion result is used for generating an enhanced image of the target image. In the application, the high-frequency detail features and the low-frequency structural features of the target image are subjected to convolution processing respectively, wherein the convolution processing of the high-frequency detail features can optimize the detail features of the image, the convolution processing of the low-frequency structural features can optimize the tone mapping of the image, and through the fusion of the two different types of convolution results, the quality of image enhancement can be improved.

Various implementations provide unvarnished video based on adjusting camera parameters according to environmental modeling. Environmental characteristics may be determined based on modeling a physical environment from sensor data captured via one or more sensors. For example, this may involve determining ambient light source optical characteristics, ambient surface optical characteristics, 3D mapping of the environment, user behavior, prediction of optical characteristics of light entering the camera, and the like. The method may involve determining camera parameters of an image captured via an image sensor based on environmental characteristics. For example, the method may determine exposure, gain, tone mapping, color balance, noise reduction, sharpness enhancement. The method may determine camera parameters based on user information (e.g., user preferences, user activity, etc.). The method may involve providing a transparent video of the physical environment based on the determined camera parameters.

The present invention relates generally to the field of video processing, and more specifically to high dynamic range (HDR) video and image processing. In particular, the present invention relates to determining one or more curve parameters of a tone mapping curve. For example, a device (encoder or decoder) can obtain a high dynamic range (HDR) video frame and metadata associated with the HDR video frame. The device can also obtain a pair of anchor points from the HDR video frame and the metadata. The pair of anchor points includes a first anchor point and a second anchor point of the tone mapping curve. Furthermore, the device can generate the one or more curve parameters of the tone mapping curve from the pair of anchor points.

Tone mapping methods and apparatus provide for receipt by a backend device may of metadata and an HDR image from a frontend device and the generation of a mapping curve based on feature parameters of the mapping curve included in the metadata. Tone mapping on the HDR image can be performed based on the mapping curve. The feature parameters of the mapping curve are determined by the frontend device based on a luminance distribution status of the HDR image. In this way, the mapping curve parameters are determined based on the luminance distribution status of the HDR image so that design of the mapping curve is more flexible, and display effect of the HDR image can be effectively improved.

Methods and systems for dynamic range conversion and display mapping of standard dynamic range (SDR) images onto high dynamic range (HDR) displays are described. Given an SDR input image, a processor generates an intensity (luminance) image and optionally a base layer image and a detail layer image. A first neural network uses the intensity image to predict statistics of the SDR image in a higher dynamic range. These predicted statistics together with the original image statistics of the input image are used to derive an optimal tone-mapping curve to map the input SDR image onto an HDR display. Optionally, a second neural network, using the intensity image and the detail layer image, can generate a residual detail layer image in a higher dynamic range to enhance the tone-mapping of the base layer image into the higher dynamic range.

Obtaining a processed spherical image includes obtaining a first luminance thumbnail image for a first hemispherical input image, obtaining a second luminance thumbnail image for a second hemispherical input image, obtaining a first distortion correcting weight map, obtaining a second distortion correcting weight map, obtaining, as an aggregate weighted mean value for the input spherical image, an aggregate of a first normalized weighted mean value for the first luminance thumbnail image and a second normalized weighted mean value for the second luminance thumbnail image, obtaining at least one of a target exposure value, a target aggregate gain value, or a region of interest ratio value in accordance with the aggregate weighted mean value, and obtaining the processed spherical image from the input spherical image in accordance with at least one of the target exposure value, the target aggregate gain value, or the region of interest ratio value.

A method is disclosed comprising modifying a color correction function intended to correct the initial chroma components of a current image to obtain normalized corrected chroma components to avoid clipping of the initial chroma components while maintaining saturation and preserving hue.

An image processing method includes obtaining a target picture and an initial tone mapping curve of the target picture, determining a plurality of interpolation points based on luminance information and / or dynamic metadata of the target picture, and determining a spline function that passes through the plurality of interpolation points, where the spline function is smoothly connected to the initial tone mapping curve at at least one of the plurality of interpolation points the initial tone mapping curve is modified based on the spline function to obtain a modified tone mapping curve of the target picture; and tone mapping is performed on the target picture based on the modified tone mapping curve. This image processing apparatus enables a display device to vividly and realistically reproduce a scene in a real world.

An encoder, decoder, system and method for determining tone mapping curve parameters. The present invention relates generally to the field of video processing, and more particularly to high dynamic range (HDR) video and image processing. In particular, the invention relates to determining one or more curve parameters of a tone mapping curve. For example, a device (encoder or decoder) may acquire a high dynamic range (HDR) video frame and metadata associated with the HDR video frame. The device also obtains a pair of anchor points based on the HDR video frame and the metadata. The pair of anchor points includes a first anchor point and a second anchor point of the tone mapping curve. Further, the device may generate the one or more curve parameters of the tone mapping curve based on the pair of anchor points.

Obtaining a processed spherical image includes obtaining a first luminance thumbnail image for a first hemispherical input image, obtaining a second luminance thumbnail image for a second hemispherical input image, obtaining a first distortion correcting weight map, obtaining a second distortion correcting weight map, obtaining, as an aggregate weighted mean value for the input spherical image, an aggregate of a first normalized weighted mean value for the first luminance thumbnail image and a second normalized weighted mean value for the second luminance thumbnail image, obtaining at least one of a target exposure value, a target aggregate gain value, or a region of interest ratio value in accordance with the aggregate weighted mean value, and obtaining the processed spherical image from the input spherical image in accordance with at least one of the target exposure value, the target aggregate gain value, or the region of interest ratio value.

An image enhancement method and an electronic device are disclosed. The image enhancement method includes the following steps. An original image is divided into multiple image blocks. A statistical data of each of the image blocks is calculated, and at least one index is obtained according to the statistical data of the each of the image blocks. A final tone mapping curve of the each of the image blocks is obtained based on multiple predefined tone mapping curves according to the at least one index of the each of the image blocks. Afterwards, the original image is adjusted according to the final tone mapping curve of the each of the image blocks to obtain an enhanced image.

This disclosure provides systems, methods, and devices for machine learning techniques that support image processing for use in a vehicle assistance system. In one aspect, a method is provided that includes receiving a first image frame captured from a camera positioned on a vehicle. The method further includes determining, based on the first image frame, a probability value that the first image frame depicts at least a portion of a windshield wiper blade. A time filter is determined based on the probability value, and an output image frame is determined by tone mapping a second image frame according to the time filter. Other aspects and features are also claimed and described.

Specific syntax elements define a neural-network post-filter characteristics (NNPFC) supplemental enhancement information (SEI) message carrying information related to a tone mapping operation that can be applied as a post filter to the decoded image. This NNPFC SEI message may comprise information representative of the colour volume resulting from the tone mapping operation, information representative of characteristics of a target display and information representative of adaptation parameters, related to the adaptation of the luminance level, quality level and the energy adaptation level that result from the tone mapping operation are provided. The information representative of the colour volume resulting from the tone mapping operation may also be carried using a second SEI message. An encoding method, a decoding method, an encoding apparatus and a decoding apparatus are described.

A method for estimating tone mapping parameters is disclosed. A first tone mapping parameter representative of a white level offset is obtained (S500) for a standard dynamic range current picture. Then, the obtained first tone mapping parameter is compared (S502) with a corresponding first tone mapping parameter obtained for a previous picture. Finally, second tone mapping parameters are updated (S504, S506) for the standard dynamic range current picture responsive to the comparing, wherein the second tone mapping parameters comprise pairs of values representative of a tone mapping output fine tuning function.

A display method and an electronic device. In the present application, when displaying a picture, an electronic device can acquire a capture environment illuminance of the picture, a brightness of a first grayscale of the picture in a capture environment, and the current viewing environment brightness. On the basis of the capture environment illuminance, a display screen brightness in the capture environment, and the current viewing environment brightness, the electronic device can determine a brightness of the first grayscale of the picture displayed on a display screen in a viewing environment. When displaying the picture, on the basis of the determined brightness of the first grayscale of the picture in the viewing environment, the electronic device sets a brightness corresponding to each grayscale value in the picture. In addition, the electronic device can also acquire a brightness compression curve of a high dynamic range region in the picture, and perform tone mapping on the basis of the brightness compression curve to restore the brightness contrast of pixel points in the high dynamic range region in the picture. Thus, a picture displayed by an electronic device has a higher contrast in a highlight region and is more realistic.

The application discloses an ultra-high-definition video decoding and distribution system supporting AVS3 and double VIVID, and particularly relates to the technical field of digital video processing, and comprises a code stream receiving and analyzing module, a double VIVID metadata tightly coupled processing module, a metadata synchronous extraction module and an intelligent distribution interface module. The coding standard of a heterogeneous input code stream is automatically identified through a feature fingerprint database, and the TLV format and a differentiated embedding strategy are used to realize the tight coupling and synchronization of HDR Vivid and Audio Vivid metadata and video frames. In combination with a priority buffer queue and a PTS matching technology, the metadata is accurately extracted at a decoding end, and finally adaptive tone mapping and protocol conversion distribution are executed according to terminal EDID feedback. The application solves the problems of difficult multi-source heterogeneous stream identification, low double VIVID metadata and video frame synchronization accuracy and poor terminal adaptation, and ensures the consistency of the immersive experience of ultra-high-definition audio and video under different distribution links.

The invention discloses a high dynamic range video tone mapping method, device and equipment, and the method comprises the steps: carrying out the display preprocessing of a target high dynamic range video frame image, and obtaining a linear light image; processing the linear light image by using a Retinex algorithm to obtain an illumination image; estimating a reflection map according to the illumination map by using an illumination reflection theory; converting the illumination image to a frequency domain, and performing spectral analysis to obtain a first radial average power spectrum; converting the reflectogram into a frequency domain, and performing spectral analysis to obtain a second radial average power spectrum; determining homomorphic filtering parameters according to the first radial average power spectrum and the second radial average power spectrum; processing the linear light image by using an illumination reflection model, and converting an obtained processed time domain signal into a frequency domain to obtain a processed frequency domain signal; and performing filtering processing on the processed frequency domain signal according to the homomorphic filtering parameter, and performing tone mapping on an obtained filtering result. According to the invention, detail loss and visual distortion are avoided.

The application belongs to the technical field of image processing, and discloses an image processing method and device based on an event camera, equipment and a medium. The method comprises the following steps: acquiring event data of a blurred image collected by an event camera; constructing an initial PINN model, embedding an event generation equation in the initial PINN model; inputting the event data into the PINN model to obtain a predicted luminance value, performing self-supervision of a time derivative based on the predicted luminance value and an actual luminance value, introducing a Tikhonov regularization constraint condition to optimize the PINN model, and determining an optimized PINN model; inputting event data of an image to be processed into the optimized PINN model to obtain log luminance values of three color channels of the image to be processed; and converting the log luminance values into a reconstructed image frame by using tone mapping. The method can reduce noise and artifacts of the reconstructed image and improve the quality of the model reconstructed image.

An electronic device according to one embodiment among various embodiments may comprise one or more processors and a memory for storing instructions. The instructions are executed by the one or more processors and can instruct the electronic device to: generate one or more pyramid images obtained from an input image by changing the resolution thereof; obtain local histogram information and global histogram information on the basis of a first pyramid image from among the one or more pyramid images; use the one or more pyramid images so as to perform an image signal processing operation, thereby obtaining a first image; and obtain a second image by performing local tone-mapping and global tone-mapping on the first image on the basis of the local histogram information and the global histogram information. Other various embodiments are possible.