35 results about "High-dynamic-range video" patented technology

The invention relates to the technical field of communication, discloses a mining intelligent voice and video interactive communication method and system, and aims to solve the problems of poor audio and video signal quality, low bandwidth utilization rate, lack of semantic understanding and interaction lag in a complex mine environment. The method comprises the following steps: acquiring an original signal through an intrinsic safety type audio and video terminal; voice enhancement is carried out by adopting sound source orientation estimation and a deep complex network; reconstructing a high dynamic range video based on the physical imaging model; realizing audio and video semantic alignment and key event extraction by using a lightweight spatial-temporal feature fusion network; the bandwidth is dynamically allocated by combining the event confidence coefficient and the channel state, and high / common priority data is transmitted in a graded manner; and ground and underground real-time communication is realized through a bidirectional interaction channel. According to the invention, the signal availability, the bandwidth efficiency and the emergency response capability are remarkably improved, and high-stability, low-delay and high-fidelity communication is guaranteed.

Implementations relate to providing HDR video formats with low dynamic range compatibility. In some implementations, a method includes obtaining a first video including first frames having a first dynamic range and a second video including corresponding second frames having a second dynamic range that is different than the first dynamic range. A recovery map track is generated, including a recovery map frame for each first frame and corresponding second frame, the recovery map frame encoding differences in luminances between portions of the first frame and corresponding second frame. The first video and recovery map track are provided in a video container that is readable to display the first video or to display a derived video based on applying the recovery map track to the first video. The derived video includes derived frames that have a dynamic range different than the first dynamic range.

For meeting the future demand of high quality yet economically feasible high dynamic range video program creation, the inventor proposes a method of in a video camera (201) setting a video camera capturing mode of specifying output pixel luminances in one or more graded versions of output video sequences of images, comprising: —an operator of the video camera moving to at least two positions (Pos1, Pos2) in a scene which have a different illumination compared to each other, and capturing at least one high dynamic range image (o_ImHDR) for each of those at least two positions of the scene; —a color composition director analyzing for each of the at least two positions the captured at least one high dynamic range image to determine a region of maximum brightness, and determining at least one of an iris setting, a shutter time, and an analog gain setting for the camera; —capturing for each position of one of the at least two positions (Pos1, Pos2) a respective master capturing (RW) using the at least one of an iris setting, a shutter time setting, and an analog gain setting for the camera, and keeping iris, shutter time and analog gain settings constant for later capturing in at least the corresponding position; —determining at least a respective first graded image (ODR) for the respective master capturing, which consists of mapping by a respective luminance allocation function (FL_M) of digital numbers of the master capturing to nit values of the first graded image (ODR), by the color composition director establishing a shape of such luminance allocation function; and —storing the respective luminance allocation functions (Fs1, Fs2) for the at least two positions, or parameters uniquely defining these functions, in respective memory locations (221, 222) of the camera.

Embodiments of the present application provide a video data processing method, a video coding method, a device, a medium and equipment, wherein the method comprises: obtaining metadata of a video frame in a high dynamic range video; obtaining display parameters of a display device; determining a mapping curve corresponding to the video frame according to the display parameters and the metadata; the mapping curve is used to represent a mapping relationship between a source color intensity value in an electrical signal space and a mapping result value; wherein an extended upper limit value of the mapping result value in the mapping curve is determined according to the display parameters and the metadata. Embodiments of the present application can effectively improve the display effect of the HDR video frame.

The invention discloses a video quality detection method, a video quality detection device, video quality detection equipment and a medium, and relates to the technical field of computer vision, a reference video and a distorted video are preprocessed and converted into a target image frame sequence, and then a multi-level feature map composed of original features, shallow layer features and deep layer features of a pixel domain is extracted frame by frame; and calculating image quality evaluation indexes at each feature level, splicing to form a multi-dimensional quality perception feature vector, inputting the multi-dimensional quality perception feature vector into a quality regression network to obtain single-frame quality data, and performing aggregation mean processing to output video overall quality data. Therefore, the comprehensive feature coverage from the pixel level to the semantic level is realized by utilizing the original information of the pixel domain, the shallow detail texture and the deep semantic information, and the credibility of the detection result is guaranteed through the interpretability and effectiveness of the image quality evaluation index. The method is efficient and accurate, can be widely applied to scenes of high-dynamic-range video coding optimization, streaming media service quality monitoring and the like, and provides a reliable quality basis.

The present invention relates generally to the field of video processing, and more specifically to high dynamic range (HDR) video and image processing. In particular, the present invention relates to determining one or more curve parameters of a tone mapping curve. For example, a device (encoder or decoder) can obtain a high dynamic range (HDR) video frame and metadata associated with the HDR video frame. The device can also obtain a pair of anchor points from the HDR video frame and the metadata. The pair of anchor points includes a first anchor point and a second anchor point of the tone mapping curve. Furthermore, the device can generate the one or more curve parameters of the tone mapping curve from the pair of anchor points.

This application relates to the field of communication technology and discloses a method and system for intelligent voice and video interactive communication in mining, aiming to solve the problems of poor audio and video signal quality, low bandwidth utilization, lack of semantic understanding, and interaction lag in the complex environment of mines. The method includes: acquiring raw signals through an intrinsically safe audio and video terminal; performing voice enhancement using sound source orientation estimation and a depth complex network; reconstructing high dynamic range video based on a physical imaging model; achieving audio and video semantic alignment and key event extraction using a lightweight spatiotemporal feature fusion network; dynamically allocating bandwidth based on event confidence and channel state, and transmitting high / ordinary priority data in a tiered manner; and achieving real-time communication between the ground and underground via a two-way interactive channel. This application significantly improves signal availability, bandwidth efficiency, and emergency response capabilities, ensuring highly stable, low-latency, and high-fidelity communication.

Methods, computer systems, and computer-storage media are provided for facilitating implementation of high dynamic range display technology in a remote desktop environment. In embodiments, graphical data is obtained, at a video driver of a remote desktop server, for presenting in association with a remote desktop client device. The graphical data is provided to a high dynamic range (HDR) video encoder, logically separated from the video driver, based on an indication to use the HDR video encoder to encode. Thereafter, the graphical data is encoded via the HDR video encoder, and such encoded graphical data is provided to a remote access protocol stack in a terminal service of the remote desktop server for transmitting the encoded graphical data to the remote desktop client device associated with the HDR monitor.

To provide a method, an apparatus, a computer program, and a computer program-based device for deriving and signaling a chroma QP (QPc) for high dynamic range (HDR) content.SOLUTION: Quantization parameter signaling mechanisms for both standard dynamic range (SDR) and HDR content in video coding are described using two approaches. The first approach is to send the user-defined Qpc table directly in the high-level syntax. This leads to more flexible and efficient QP control for future codec development and video content coding. A second approach is to signal the luma and chroma QPs independently. This eliminates the need for a Qpc table and eliminates the dependency of the chroma quantization parameter on the luma QP.SELECTED DRAWING: Figure 5A

An encoder, decoder, system and method for determining tone mapping curve parameters. The present invention relates generally to the field of video processing, and more particularly to high dynamic range (HDR) video and image processing. In particular, the invention relates to determining one or more curve parameters of a tone mapping curve. For example, a device (encoder or decoder) may acquire a high dynamic range (HDR) video frame and metadata associated with the HDR video frame. The device also obtains a pair of anchor points based on the HDR video frame and the metadata. The pair of anchor points includes a first anchor point and a second anchor point of the tone mapping curve. Further, the device may generate the one or more curve parameters of the tone mapping curve based on the pair of anchor points.

A display device includes circuitry configured to transmit, to a reproduction device, display-capability information representing performance characteristics of the display device. The circuitry receives video data from the reproduction device that includes brightness-characteristic information and information of a master video when the display-capability information represents a display performance of the video data. The circuitry displays an image of the received video data in accordance with brightness designated by the received information, and adjusts the image brightness based on the display device's performance. When the master video is high-dynamic-range (HDR) video data, the circuitry recognizes the HDR content and displays the image in accordance with brightness characteristics of the master video.

The application discloses a kind of multi-exposure image fusion's HDR video generation method and system.Firstly, multi-exposure image capture is realized by double camera acquisition module, then the multi-exposure image data collected is frame synchronized and data preprocessed by processing unit.Afterwards, the HDR video is generated based on multi-exposure image fusion's HDR video generation network, and the video stream generated by HDR video generation network will be transmitted to the push stream module, and the generated HDR video is output in different formats according to the demand by the push stream module.The application adopts the strategy of taking any exposure time image as reference, realizes the generation of high dynamic range video through high frame rate low exposure and intermittent medium-high exposure image acquisition, and can flexibly adapt to various scenes, and is not affected by exposure time on the frame rate of generated video.

The invention discloses a high dynamic range video tone mapping method, device and equipment, and the method comprises the steps: carrying out the display preprocessing of a target high dynamic range video frame image, and obtaining a linear light image; processing the linear light image by using a Retinex algorithm to obtain an illumination image; estimating a reflection map according to the illumination map by using an illumination reflection theory; converting the illumination image to a frequency domain, and performing spectral analysis to obtain a first radial average power spectrum; converting the reflectogram into a frequency domain, and performing spectral analysis to obtain a second radial average power spectrum; determining homomorphic filtering parameters according to the first radial average power spectrum and the second radial average power spectrum; processing the linear light image by using an illumination reflection model, and converting an obtained processed time domain signal into a frequency domain to obtain a processed frequency domain signal; and performing filtering processing on the processed frequency domain signal according to the homomorphic filtering parameter, and performing tone mapping on an obtained filtering result. According to the invention, detail loss and visual distortion are avoided.

Methods and apparatus are provided for color space inference in high dynamic range video, such as in the SL-HDR1 video standard. In one embodiment, an encoder sends information including standard dynamic range video and metadata contained in a supplemental enhancement information message to indicate the color space included in the video. In another embodiment, a decoder parses the bitstream and infers values ​​from the data in the supplemental enhancement information message to inform the decoder of the color space included in the video. The high dynamic range signal is reconstructed based on the standard dynamic range data and the values ​​inferred from the metadata.

To mitigate some problems of pixel color mapping used in SLHDR type of HDR video decoding, we teach a high dynamic range video encoding circuit (300) configured to encode a high dynamic range image (IM HDR) having a first maximum pixel luminance (PB CI) with a second image (Im LWRDR) having a lower dynamic range and a corresponding lower second maximum pixel luminance (PB C2), the second image being functionally encoded as a luminance mapping function (400) for a decoder to apply to pixel luminances (Y PQ) of the high dynamic range image to obtain corresponding pixel luminances (PO) of the second image, the encoder comprising a data formatter (304) configured to output the high dynamic range image and metadata (MET) encoding the luminance mapping function (400) to a video communication medium (399), the functional encoding of the second image being further based on a color lookup table (CL(Y PQ)) encoding a multiplier constant (B) for all possible values of pixel luminances of the high dynamic range image, and the formatter being configured to output this color lookup table in the metadata, characterized in that the high dynamic range video encoding circuit comprises a gain determination circuit (302) configured to determine luminance gain values (G PQ) quantifying a ratio of output image luminances equal to a luminance position of a correct normalized luminance position divided by output luminances of luminances of pixels of the high dynamic range image, wherein the high dynamic range video encoding circuit comprises a color lookup table determination circuit (303) configured to determine the color lookup table (CL(Y PQ)) based on values of the luminance gain values for various luminances of pixels present in the high dynamic range image. Similarly, we teach how to embody the same principles in a SLHDR type of video decoder.

An example device for encoding high dynamic range (HDR) video data includes a memory configured to store video data, and one or more processors implemented in circuitry and configured to compute a histogram for an image of the video data, the image represented in a linear light format, encode values of the histogram for the image represented in the linear light format, and encode the image. Data for the histogram can be represented in a variable array of size 2 10 x18 bits. The device can encode codewords for representing values of bins for the histogram, where the codewords can be selected from a set of codewords for a PQ10 format of an HDR image. The bins of the histogram can represent ranges of unequal widths.

The invention relates to an HDR video decoding method, electronic equipment, a storage medium and a program product. The method is applied to a video display device, and can comprise the following steps: acquiring an original HDR video, and decoding the original HDR video to obtain a decoded video, the dynamic range of the decoded video being lower than the high dynamic range; and correcting the dynamic range of the decoded video through a pre-trained dynamic range correction model to obtain a corrected video, the dynamic range of the corrected video being a high dynamic range. According to the technical scheme, high-dynamic-range video display can be achieved on various types of video display devices, the display quality of video pictures is remarkably improved, and the visual experience of a user can be improved.

Methods and systems for stereoscopic 3D video are described. Input HDR stereoscopic views in a first codeword representation are merged together by a first merging function to generate an input merged view to optimize a reshaping operation which generates a reshaped merged view in a second codeword representation and associated composer metadata. The reshaped merged view may be split and re-merged by a second frame packing function to optimize video encoding efficiency of an output coded bitstream based on the reshaped merged view. In a decoder, after extracting the reshaped merged view from the coded bitstream, a composer function applies the composer metadata to the decoded reshaped merge view to generate an output merged view in the first codeword representation. Then it generates output HDR stereoscopic views based on the output merged view.

The invention discloses a high dynamic range video reconstruction method and system based on a hybrid expert system. The method comprises the following steps: acquiring an SDR video to be processed and decoding the SDR video into a continuous SDR image frame sequence; degeneration features used for representing insufficient image quality are extracted frame by frame from the SDR image frame sequence through a degeneration coding network, and the degeneration features are coded; generating a probabilistic weight vector corresponding to each SDR image in the SDR image frame sequence through a routing network based on the degradation codes output by the degradation coding network; on the basis of the probabilistic weight vector, feature enhancement and feature weighted fusion after enhancement are carried out on SDR images in the SDR image frame sequence frame by frame by integrating a video frame enhancement network of a plurality of parallel expert sub-networks, and a preliminary HDR video frame sequence is formed; performing highlight area repairing on the preliminary HDR video frame sequence frame by frame through a highlight area repairing network to obtain a target HDR video frame sequence; and coding and packaging the target HDR video frame sequence to obtain a reconstructed HDR video file.

Methods and systems for multi-step display mapping and metadata reconstruction for high dynamic range (HDR) images are described. In an encoder, given an HDR input image with input HDR metadata in a first dynamic range, an intermediate, base layer image in a second dynamic range is constructed based on the input image. In a decoder, using base-layer metadata, the input HDR metadata, and dynamic range characteristics of a target display, a processor generates reconstructed metadata which when used in combination with the base layer image allow a display mapping process to map the base layer image to the target display as if it was mapping directly the HDR image to the target display.

A raw high dynamic range (HDR) video having a first intensity level range and a test HDR video having a second intensity level range that is less than the first intensity level range may be received. A measure of structural fidelity of one or more test frames of the test HDR video is calculated relative to corresponding one or more original frames of the original HDR video using a combination of a plurality of per-scale structural fidelity maps, and the structural fidelity is calculated based on operation of the human vision system using a contrast sensitivity function. An HDR video structural fidelity score is determined based on a measure that tests structural fidelity of one or more frames of the HDR video.

The present application relates to a kind of single exposure Raw video HDR reconstruction method and system, belong to computer vision and image processing technical field.The method comprises: obtaining single exposure bayer format Raw video sequence;Channel decomposition parallel alignment module is constructed, and input frame is decomposed into full channel flow, red blue channel flow and double green channel flow three parallel branches, using the physical characteristics that red blue channel is not easy to saturate in highlight area and green channel high signal-to-noise ratio, respectively, different feature extraction and alignment are carried out;Exposure complementary mask guided repair module is constructed, by calculating overexposure mask and dividing timing complementary area, using normal exposure information of adjacent frame in complementary area to repair the overexposure area of current frame;Multi-stream features are fused using cross attention mechanism, and high dynamic range video frame is reconstructed by combining mask guided color loss.The present application effectively solves the problem of highlight overflow and dark noise without alternating exposure, avoids ghosting artifacts, and significantly improves the reconstruction quality of HDR video.

Methods for encoding and decoding video data. One method includes receiving video data, the video data composed of a plurality of image frames, each image frame including a plurality of pixels. The method includes determining, for each image frame, a rotation matrix, determining, for each image frame, at least one of a scaling factor and an offset factor, and determining, for each image frame, a reshaping function based on one or more values of each of the plurality of pixels. The method includes generating an output image for each image frame by applying the rotation matrix, the reshaping function, and the at least one of the scaling factor and the offset factor to the respective image frame. The rotation matrix is applied to each pixel of the plurality of pixels for the respective image frame before the reshaping function is applied to the respective image frame.

This disclosure provides a video display method and apparatus. The method includes: acquiring video data of a target video and determining a first display brightness for displaying the target video based on the video data, wherein the target video includes a high dynamic range (HMR) video; correcting the first display brightness based on a screen brightness curve to obtain a second display brightness, wherein the screen brightness curve is a brightness correction curve for a display screen used to display the target video; mapping the second display brightness based on a pre-configured first lookup table to obtain a target display brightness, so that the target display brightness matches the HMR of the target video; and displaying the target video on a display screen based on the target display brightness. By adjusting the screen characteristics of the display device, the screen of the display device can accurately match the HMR video, protecting the information source of the video and improving the video playback effect.

The invention relates to a video processing method and device, equipment, a storage medium and a program product. According to one embodiment of the invention, the method comprises the following steps: detecting memory colors in multiple frames of initial HDR images contained in an HDR video in response to an obtained HDR video to be processed; in response to the memory color detected in any initial HDR image of the multiple frames of initial HDR images, performing color reconstruction on the memory color in any initial HDR image based on a predetermined color mapping relationship; and generating a target HDR video corresponding to the to-be-processed HDR video based on each frame of HDR image subjected to color reconstruction in the multiple frames of initial HDR images and each frame of initial HDR image which is not subjected to color reconstruction in the multiple frames of initial HDR images. It can be ensured that the color reconstruction result conforms to the inherent cognitive habit of the user for the memory color, and the requirements of different display scenes are met.

A video format detector receives a video signal in one of a plurality of possible video formats and generates a detected format. A cumulative distribution function generator generates a cumulative distribution function curve from components of the video signal, and a feature detector generates one or more feature vectors from the cumulative distribution function curve. A video classifier accepts the one or more feature vectors from the feature detector and generates a prediction of the video format in which the video signal was generated based at least in part on the received feature vectors.

In a cloud-based system for encoding high dynamic range (HDR) video, a computing node is assigned to be a dispatcher node, segmenting the input video into scenes and generating a scene to segment allocation to be used by other computing nodes. The scene to segment allocation process includes one or more iterations with an initial random assignment of scenes to computing nodes, followed by a refined assignment based on optimizing the allocation cost across all the computing nodes. Methods to generate scene-based forward and backward reshaping functions to optimize video coding and improve the coding efficiency of reshaping-related metadata are also examined.

Disclosed is a video transport method including receiving high dynamic range (HDR) video content comprising HDR images; performing HDR mastering for HDR images according to HDR mastering parameters; transforming an input colour space of each HDR image amongst HDR images into a transport colour space, and transporting HDR images having transport colour space. Herein, transforming an input colour space of HDR images into transport colour space is performed by: plotting colour component values (CCVs) of pixels in a first HDR image amongst a given set of HDR images, across a multi-dimensional colour space; identifying a bounding box corresponding to the first HDR image, wherein the bounding box encloses CCVs of two or more colour components represented in multi-dimensional colour space; determining a transformation to be applied to input colour space of the given set of HDR images; applying transformation to each HDR image in given set of HDR images.

The invention relates to a single-exposure Raw video HDR reconstruction method and system, and belongs to the technical field of computer vision and image processing. The method comprises the following steps: acquiring a Raw video sequence in a single exposure Bayer format; a channel decomposition parallel alignment module is constructed, an input frame is decomposed into three parallel branches of a full channel flow, a red and blue channel flow and a double-green channel flow, and differential feature extraction and alignment are respectively performed by utilizing the physical characteristics that the red and blue channel is not easy to saturate in a highlight area and the green channel is high in signal-to-noise ratio; constructing an exposure complementary mask guide repair module, calculating an overexposure mask and dividing a time sequence complementary region, and repairing an overexposure region of the current frame by using normal exposure information of an adjacent frame in the complementary region; and utilizing a cross attention mechanism to fuse multi-stream features, and combining with mask guide color loss to reconstruct a high dynamic range video frame. According to the method, the problems of highlight overflow and dark noise are effectively solved under the condition that alternate exposure is not needed, ghosting artifacts are avoided, and the reconstruction quality of an HDR video is remarkably improved.