13 results about "Inverse tone mapping" patented technology

The present application relates to a kind of high dynamic range illumination estimation method, device and storage medium, utilize the spatiotemporal generation prior of video generation model, by constructing "in-video drawing" task, from ordinary low dynamic range video sequence, restore time sequence consistent and physically realistic high dynamic range environment map.The input video is applied mask and combined with specific text prompt, guide model to generate virtual light probe containing surrounding environment reflection information in picture center;Variational autoencoder of high dynamic range perception is constructed, by introducing learnable tone mapping and inverse tone mapping adapter, so that video diffusion model can directly understand and output high dynamic range illumination characteristics in logarithmic domain latent space.The present application can output high-quality dynamic high dynamic range environment sequence, when processing dynamic scene, fast camera motion and complex occlusion, it has stronger robustness, applicable to augmented reality, virtual object implantation and scene relighting etc.Application.

The invention relates to a high-dynamic-range illumination estimation method and device and a storage medium, and aims to recover a physically real high-dynamic-range environment map with consistent time sequence from a common low-dynamic-range video sequence by utilizing space-time generation prior of a video generation model and constructing a video interior drawing task. Applying a mask to an input video, and guiding the model to generate a virtual optical probe containing surrounding environment reflection information in the center of a picture in combination with a specific text prompt; a high dynamic range perception variational auto-encoder is constructed, and a learnable tone mapping and inverse tone mapping adapter is introduced to enable a video diffusion model to directly understand and output high dynamic range illumination features in a logarithm domain submerged space. According to the method, a high-quality dynamic high-dynamic range environment sequence can be output, higher robustness is achieved when dynamic scenes, rapid camera motion and complex shielding are processed, and the method is suitable for application such as augmented reality, virtual object implantation and scene re-illumination.

The invention relates to a scene brightness determination method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: acquiring a first SDR image and a second SDR image shot for a target scene; performing inverse tone mapping processing on the first SDR image to obtain a first HDR image, and performing inverse tone mapping processing on the second SDR image to obtain a second HDR image; and determining the actual brightness of the target scene based on the first shooting parameter of the first SDR image, the second shooting parameter of the second SDR image, the brightness of the first HDR image and the brightness of the second HDR image. By adopting the method, the actual brightness of the shooting scene can be accurately determined.

One embodiment provides a computer-implemented method that includes employing a de-banding process based on image statistics in a dynamic range conversion system, including high dynamic range (HDR) to standard dynamic range (SDR) tone mapping (TM) process or SDR-to-HDR inverse tone mapping (ITM) process. A computing device performs the de-banding process in post-processing during a determination of one or more initial ITM explicit polynomial curve coefficients. One or more parameters of a weighing function of the one or more initial ITM explicit curve coefficients are utilized as one or more controlling knots for balancing a de-banding effect and preserving local detail.

This invention provides a method and apparatus for preserving the original colors of textures. The method includes: acquiring texture data of a target to be rendered; performing an inverse tone mapping transformation on the texture data whose original colors need to be preserved to obtain inverse tone-mapped texture data; applying the inverse tone-mapped texture data to the target to be rendered; and tone mapping the inverse tone-mapped texture data to a low dynamic range in a high dynamic range pipeline. This invention performs an inverse tone mapping transformation on the texture data whose original colors need to be preserved without modifying the high dynamic range rendering pipeline itself. This eliminates the need for artists to modify textures during the high dynamic range rendering process, significantly saving manpower and time. Moreover, it only affects the transformation of texture data throughout the rendering process, without altering the overall rendering flow, thus ensuring that the target to be rendered can effectively enable glow effects and guaranteeing the realism of the rendered target.

The invention provides a method for inverse tone mapping, the method being performed by: obtaining (42) a gain function of a first inverse tone mapping function, referred to as an initial gain function; if (43) an analysis of a current image shows that at least one pixel of the current image having a luminance value at least equal to a predetermined percentage of luminance values (TH1) of the pixels of the current image has an expanded luminance value resulting from the application of the first ITM function to the current image which is higher than a target value, applying (45) to the current image a second ITM function, the second ITM function corresponding to the first inverse tone mapping function in which the gain function has been replaced by a modified gain function derived from the initial gain function in which the gain provided by the initial gain function is attenuated by an attenuation function, the attenuation function being weighted by a weighting factor controlling the intensity of the attenuation, the weighting factor depending on a statistical distribution of luminance values between the maximum luminance value in a histogram of the current image and the luminance value depending on the predetermined percentage.

The invention discloses a video inverse tone mapping highlight reconstruction method and system and a storage medium. The method comprises the following steps: inputting an SDR video frame into an HDR preliminary reconstruction network to obtain an initial HDR video frame; obtaining HDR domain features by using a domain feature enhancement network; obtaining potential features corresponding to the SDR video frames by using a diffusion model; and performing feature domain alignment and mask feature fusion on the potential feature and the HDR domain feature by using a domain alignment network to obtain a domain alignment feature and a mask fusion feature, and generating an HDR video frame according to the domain alignment feature and the mask fusion feature. According to the method and the system disclosed by the invention, the HDR video preliminary reconstruction is firstly carried out on the input SDR video, then the detail enhancement is carried out on the HDR video subjected to the preliminary reconstruction, and the diffusion model is introduced to carry out targeted fine adjustment on the HDR domain features, so that the detail recovery effect of inverse tone mapping in a high-brightness and overexposure region is improved, and the HDR video is obtained.

This disclosure provides a method for inverse tone mapping, the method comprising: obtaining (41) a histogram of a low dynamic range image, referred to as an LDR image; obtaining (42) an ITMO function, thereby allowing pixel values ​​of a high dynamic range image, referred to as an HDR image, to be obtained from pixel values ​​of the LDR image and a gain function dependent on the pixel values ​​of the LDR image; applying a search process using the obtained histogram to identify regions of the LDR image that produce bright areas in the HDR image when the ITMO function is applied to the LDR image, thereby using information representing the bright areas to determine when to modify the gain function to ensure that the HDR image complies with at least one predefined light energy constraint.

The invention discloses an inverse tone mapping method and system based on source representation learning, a terminal and a storage medium. The method comprises the following steps: acquiring an SDR video frame; based on a preset source representation dictionary, performing inverse tone mapping on the SDR video frame by using a video inverse tone mapping model based on source representation learning, and predicting to obtain an HDR video frame; and outputting the HDR video frame. According to the method, the source representation dictionary which is more accurate in learning and high in interpretability is constructed, the source representation dictionary is used for guiding the video inverse tone mapping model based on source representation learning to convert SDR videos of different sources, HDR videos with higher quality are generated, and the reconstruction quality of the HDR videos under the multi-dimensional condition is improved.

This application provides an image processing method, apparatus, and device. The method includes: acquiring a first image and display parameters of a display device, wherein the first image is a standard dynamic range (SDR) image and the display device is a high dynamic range (HDR) device; adjusting the brightness and saturation of the first image according to the display parameters to obtain a second image, wherein the display parameters include at least: display peak brightness (DPL) and / or backlight percentage. In the above process, by using an inverse tone mapping method based on brightness and saturation adjustment, the SDR image is converted into an HDR image that matches the HDR device, thus optimizing the display effect of the SDR image on the HDR device.

This invention discloses a method, apparatus, and device for generating halo effects on a mobile device, comprising: acquiring an original image and extracting highlight regions from the original image to obtain highlight image attachments; performing inverse tone mapping on the highlight image attachments to obtain high dynamic range (HDR) brightened image attachments; performing multiple downsampling on the brightened image attachments to generate multiple downsampled image attachments with different resolutions; performing blurring processing on the brightened image attachments and each downsampled image attachment to obtain corresponding multiple blurred image attachments; upsampling and superimposing each blurred image attachment to generate a HDR halo composite attachment; performing tone mapping processing on the halo composite attachment to obtain a standard dynamic range (SDR) standard halo attachment; and superimposing the standard halo attachment with the original image based on the highlight image attachment to obtain the halo result image. This method can balance the visual realism of the halo effect with real-time processing performance under limited computing power.

A method comprising: obtaining (40) picture data in a first dynamic range; determining (41) a first function allowing the picture data to be mapped from the first dynamic range to a second dynamic range; signaling (42) metadata in the video data, the metadata allowing a second function to be obtained, the second function corresponding to an approximate version of the first function; determining (43) a third function from the first function and the second function such that applying the second function to intermediate data is equivalent to applying the first function to the picture data in the first dynamic range, the intermediate data is generated by applying the third function to the picture data in the first dynamic range; and signaling (44) data representing the intermediate data in the video data.

The invention discloses a video inverse tone mapping method and system, terminal equipment and a medium, and relates to the technical field of video image processing. The method comprises the following steps: converting a video frame SDR image to be reconstructed from an RGB color space to an ICtCp color space, and decoupling the video frame SDR image into a brightness channel and a chrominance channel; performing brightness hierarchical mapping processing on the brightness channel to obtain an HDR image brightness channel after dynamic range expansion; performing chromaticity mapping processing on the chromaticity channel to obtain an HDR image chromaticity channel after color gamut expansion; and combining the two channels and converting the two channels to an RGB color space to obtain a reconstructed HDR image. Brightness and chromaticity decoupling is realized based on the ICtCp space, light weight and processing precision are considered, end side deployment is adapted, the dynamic range and color gamut of the video are effectively expanded, highlight and dark part details are recovered, and the visual effect is improved.