Effective electro-optic transfer function (EOTF) curve for Standard Dynamic Range (SDR) content
By using modified EOTF curves and Rec.2020 color space to process SDR content, the problem of the encoder being unable to distinguish between the differences between human vision and display presentation was solved, resulting in improved encoding efficiency and image quality, while reducing encoding bit usage and network bandwidth requirements.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-06-07
- Publication Date
- 2026-04-03
AI Technical Summary
Existing encoders cannot effectively distinguish the difference between human perception of image brightness and display presentation when encoding images or videos, resulting in the waste of valuable bits in high-brightness areas. Furthermore, existing EOTF curves such as SMPTE Rec.709 are not suitable for SDR content, limiting the granularity and realism of images.
A modified EOTF curve (such as SMPTE Rec.2084) is used to cover only 100 nits required for SDR content and is encoded with 8-bit precision. Combined with the Rec.2020 color space, it is used to preprocess SDR content to improve encoding efficiency and image quality and prevent striping.
Reduce bit usage during encoding (approximately 7%), improve image quality, maintain or enhance the realism and immersiveness of displayed images, reduce network bandwidth requirements, and provide image presentations that are more in line with human perception.
Smart Images

Figure CN116195252B_ABST
Abstract
Description
Background Technology
[0001] The human eye perceives images or image brightness differently than television and / or display devices present them. The human eye may notice greater differences between lower and higher ranges of values. An encoder that encodes an image or video may not be aware of this difference between human perception and how a television and / or display device presents the image. Before encoding, an image or video is converted into a digital system that an encoder uses to encode it. Encoders can treat all values equally, and therefore, they can encode low-brightness or high-brightness areas in a similar manner. Consequently, an encoder may waste valuable bits in high ranges (e.g., bright areas of an image) where differences in an image or video are imperceptible to an individual. Summary of the Invention
[0002] This summary is provided to present a selection of concepts in a simplified form, which will be further described in the detailed description below. This summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
[0003] An example implementation relates to a system. This system may include one or more processors; a memory in electronic communication with the one or more processors; and instructions stored in the memory, executable by the one or more processors to: receive standard dynamic range (SDR) content; convert the SDR content to modified SDR content using a modified electro-optical transfer function (EOTF) curve to convert non-linear color values of the SDR content into optical output values in the modified SDR content; send the modified SDR content to an encoder to generate encoded data by encoding the modified SDR content using 8 bits; and transmit the encoded data.
[0004] Another example implementation involves a method. This method may include receiving standard dynamic range (SDR) content. This method may include converting the SDR content to modified SDR content using a modified electro-optical transfer function (EOTF) curve to convert the non-linear color values of the SDR content into optical output values in the modified SDR content. This method may include sending the modified SDR content to an encoder to generate encoded data by encoding the modified SDR content using 8 bits. This method may include transmitting the encoded data.
[0005] Another example implementation involves a computer-readable medium storing instructions executable by a computer device. The computer-readable medium may include at least one instruction for causing the computer device to receive standard dynamic range (SDR) content. The computer-readable medium may include at least one instruction for causing the computer device to convert the SDR content into modified SDR content using a modified electro-optical transfer function (EOTF) curve, thereby converting the non-linear color values of the SDR content into optical output values in the modified SDR content. The computer-readable medium may include at least one instruction for causing the computer device to send the modified SDR content to an encoder to generate encoded data by encoding the modified SDR content using 8 bits. The computer-readable medium may include at least one instruction for causing the computer device to transmit the encoded data.
[0006] Additional features and advantages will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practice of the teachings herein. The features and advantages of this disclosure may be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims. The features of this disclosure will become more fully apparent from the following description and the appended claims, or may be learned by practice of this disclosure as described below. Attached Figure Description
[0007] To describe in detail the ways in which the above and other features of this disclosure can be obtained, a more specific description will be given by reference to the specific implementations shown in the accompanying drawings. For better understanding, the same elements are indicated by the same reference numerals throughout the various drawings. While some drawings may be schematic or exaggerated representations of concepts, at least some drawings may be drawn to scale. Understanding these drawings describes some example implementations, which will be described and explained with additional specificity and detail using the drawings, wherein:
[0008] Figure 1 An example system for transmitting SDR content, according to an implementation of this disclosure, is shown.
[0009] Figure 2A and Figure 2B An example method for transferring SDR content from a device to a client device for display, according to an implementation of this disclosure, is shown.
[0010] Figure 3 An example diagram of the transformation of pixel values using a modified EOTF curve according to an implementation of this disclosure is shown.
[0011] Figure 4 An example diagram of a transformation graph of pixel values using a transfer function at a client device is shown according to an implementation of this disclosure.
[0012] Figure 5 This illustrates specific components that may be included within a computer system. Detailed Implementation
[0013] This disclosure generally relates to standard dynamic range (SDR) content. The human eye perceives an image or image brightness differently than television and / or display devices present an image. The human eye may notice greater differences between values in the lower range and values in the higher range. For example, an individual is more sensitive to the darker parts of an image and may notice an equal amount of difference between the darker parts and the brighter parts of the image.
[0014] An encoder that encodes an image or video may not be aware of the difference between human perception of an image and how a television and / or display device presents it. Before encoding, an image or video is converted into a digital system that the encoder uses to encode it. Encoders can treat all values equally, and therefore, they can encode low-brightness or high-brightness areas in a similar way. Consequently, the encoder may waste valuable bits in a high range of areas (e.g., bright areas of an image) where differences are not perceptible to an individual.
[0015] Different electro-optical transfer function (EOTF) curves, defined by the Society of Motion Picture and Television Engineers (SMPTE) standards, can be used to transform images or videos before encoding. Currently, for all Standard Dynamic Range (SDR) content, as defined in the SMPTE standard, the EOTF curve SMPTE Rec.709 is used, which is inconsistent with human perception of images. SDR content covers up to 100 nits, where 1 nit is a unit of luminance, equal to 1 candela per square meter (cd / m²). The SMPTE Rec.709 EOTF curve uses an 8-bit color depth, which limits the granularity of darker content in SDR images or videos.
[0016] For High Dynamic Range (HDR) content, a new type of EOTF curve, SMPTE Rec.2084, is used, which, as defined in the SMPTE standard, aligns with human perception of images. HDR content covers up to 10,000 nits and uses 10-bit encoding. This allows the EOTF SMPTE Rec.2084 curve to create video images with an increased luminance range, enabling the upper limit of scene exposure to still provide realism and presence in the video image without requiring heavy compression. While the EOTF SMPTE Rec.2084 curve is more consistent with human perception, it is specifically designed for HDR content and not suitable for SDR content.
[0017] The apparatus and method may use a modified SMPTE Rec.2084 EOTF curve in such a way that the modified EOTF curve covers only the 100 nits required for SDR content, while encoding with 8-bit precision without displaying stripes. This disclosure includes several practical applications that provide benefits and / or resolve problems associated with improving the transmission of SDR content to client devices for display on a monitor.
[0018] This device and method can improve the quality of images transmitted with SDR content. The device and method can also preserve encoded bits during the encoding of SDR content, and thus reduce the network bandwidth requirements for streaming SDR content. The modified EOTF curve can make encoding more efficient by achieving the same or better image quality while using fewer bits during encoding (e.g., a 7% reduction in bits).
[0019] In this way, the device and method can reduce the bit rate used to encode SDR content while maintaining or improving the quality of the displayed image by preventing striping while encoding at a lower bit rate. Therefore, the device and method can provide SDR content that can be consistent with human perception of images.
[0020] Now for reference Figure 1 The diagram illustrates a system 100 for transmitting SDR content 10 from one or more devices 102 to one or more client devices 106 via a network 104 for display on a display 30. Device 102 may receive SDR content 10 from multiple content providers, such as game developers, application developers, television content publishers, and / or any third-party content publishers. Device 102 may host SDR content 10 or otherwise provide SDR content 10 to one or more client devices 106.
[0021] SDR content 10 may include, but is not limited to, images and / or videos. In one implementation, SDR content 10 may include images or videos of game content for digital games. In another implementation, SDR content 10 may include images or videos of movies and / or programs. In yet another implementation, SDR content 10 may include still images.
[0022] Multiple devices 102 and multiple client devices 106 can communicate with each other directly or indirectly through network 104. Network 104 may include one or more networks and may use one or more communication platforms or technologies suitable for transmitting data. Network 104 may refer to any data link capable of transmitting electronic data between devices and / or modules of system 100. Network 104 may refer to a hardwired network, a wireless network, or a combination of hardwired and wireless networks. In one or more implementations, network 104 includes a cellular network.
[0023] Device 102 and / or client device 106 may include any mobile or fixed computer device capable of connecting to network 104. Device 102 and / or client device 106 may include, for example, mobile devices such as mobile phones, smartphones, personal digital assistants (PDAs), tablets, or laptops. Additionally or alternatively, device 102 and / or client device 106 may include one or more non-mobile devices such as desktop computers, server devices, or other non-portable devices. Additionally or alternatively, device 102 and / or client device 106 may include gaming devices, mixed reality or virtual reality devices, music devices, televisions, navigation systems, or cameras, or any other device with wired and / or wireless connectivity to one or more other devices. In one or more implementations, device 102 and / or client device 106 refers to a dedicated gaming device (e.g., a handheld gaming device) or video game console communicating with display 30. Device 102 and / or client device 106 may include the following combinations Figure 3 The described features and functions.
[0024] Components of precoding component 12, encoder 18, decoder 22, and / or color processing component 26 may include hardware, software, or both. For example, components of precoding component 12, encoder 18, decoder 22, and / or color processing component 26 may include one or more instructions stored on a computer-readable storage medium and executable by a processor of one or more computing devices. When executed by one or more processors, the computer-executable instructions of one or more computing devices (e.g., precoding component 12, encoder 18, decoder 22, and / or color processing component 26) may perform one or more methods described herein. Alternatively, components of precoding component 12, encoder 18, decoder 22, and / or color processing component 26 may include hardware, such as a dedicated processing device for performing a particular function or group of functions. Additionally or alternatively, components of precoding component 12, encoder 18, decoder 22, and / or color processing component 26 may include a combination of computer-executable instructions and hardware.
[0025] Client device 106 may send a request to receive SDR content 10 from device 102 or otherwise access SDR content 10 for presentation on display 30. In one implementation, SDR content 10 may be streamed from device 102 to client device 106. In one or more implementations, one or more client devices in client device 106 may include display 30 on which a graphical user interface (e.g., the screen of a mobile device) is displayed. Additionally, or alternatively, one or more client devices in client device 106 may be communicatively coupled (e.g., wired or wireless) to display 30 on which a graphical user interface is displayed to provide content display.
[0026] One example use case could include client device 106 requesting a streaming movie or program to be displayed on display 30. Another example use case could include client device 106 requesting streaming game content for a digital game to be displayed on display 30.
[0027] Device 102 may include a precoding component 12 that can receive SDR content 10 requested by client device 106 and identify that the SDR content 10 is in SDR format. For example, the SDR content 10 may be encoded using Rec.709. In one implementation, device 102 may be a game console, and the precoding component 12 may be hardware in the game console's display pipeline. In another implementation, device 102 may be a personal computer, and the precoding component 12 may be hardware in a graphics processing unit (GPU) pipeline.
[0028] The pre-encoding component 12 can select a modified EOTF curve 14 to convert the SDR content 10 from the non-linear color values provided with the SDR content 10 to optical output values. Therefore, the pre-encoding component 12 can select the modified EOTF curve 14 for preprocessing the SDR content 10 before encoding, instead of using the SMPTE Rec.709 EOTF curve for preprocessing the SDR content 10 before encoding.
[0029] The modified EOTF curve 14 can provide an efficient mapping from a range of luminance values containing as few as 8 bits of digital code values to 100 candela per square meter (cd / m²), where 1 nit equals 1 cd / m². Thus, the modified EOTF curve 14 can be limited to the 100 nits required for SDR content. The modified EOTF curve 14 also allows encoding with 8-bit precision without displaying banding. Banding can comprise lines between different color regions of an image. The modified EOTF curve 14 allows encoding with 8-bit precision while maintaining smooth gradations from one color to different colors in an image. By combining the use of the Rec.709 color space (which is a smaller color space relative to the International Telecommunication Union (ITU) Recommendation 2020 color space, also known as Rec.2020) with the additional grayscale provided by the modified EOTF curve 14, banding in SDR images can be prevented. Using the modified EOTF curve 14 can provide SDR images with increased realism and presence, and therefore provide images that are more consistent with human perception. The modified EOTF curve 14 can represent a digital system that closely matches how humans respond to light intensity. Therefore, the modified EOTF curve 14 can be a quantization function that simulates human perception for use with SDR video and images.
[0030] The pre-encoding unit 12 can use a modified EOTF curve 14 to convert SDR content 10 into modified SDR content 16. The pre-encoding unit 12 can use the modified EOTF curve 14 to transform pixel input values for the captured SDR content 10 into pixel output values for the modified SDR content 16. For example, SDR content 10 can be represented in 8 bits, and pixel input values can be values in the range of 0 to 255. The pre-encoding unit 12 can send or otherwise transmit the modified SDR content 16 to the encoder 18. The encoder 18 can encode the modified SDR content 16 using 8 bits and can save the encoded data 20. For example, the encoded data 20 can be saved in MP4 format or any other container format to allow streaming over the Internet.
[0031] Device 102 can transmit encoded data 20 to client device 106. For example, device 102 can stream encoded data 20 to client device 106 via network 104. Since encoding is performed using 8 bits, the amount of network bandwidth required to transmit encoded data 20 can be reduced. By using a modified EOTF curve 14, the same or better image quality can be achieved using fewer bits during encoding. For example, when using the modified EOTF curve 14, 7% fewer bits can be used during the encoding process.
[0032] Decoder 22 can receive and decode encoded data 20. Decoder 22 can identify that encoded data 20 uses a modified EOTF curve 14, and can decode encoded data 20 into decoded modified SDR content 16. In implementation, metadata 24 can be transmitted along with encoded data 20 as sideband data to provide information that the modified EOTF curve 14 is used. For example, this information may include custom information for the modified EOTF curve 14. Decoder 22 can use metadata 24 to identify that the modified EOTF curve 14 is used, and can provide decoded modified SDR content 16 in response to identifying that the modified EOTF curve 14 is used.
[0033] In another implementation, additional information can be specified in the encoded data 20, indicating that the modified EOTF curve 14 is used. For example, the encoded data 20 can be an Advanced Video Coding (AVC) stream (also known as H.264) or an Efficient Video Coding (HEVC) stream (also known as H.265), and additional information can be specified in the H.264 or HEVC stream. By adding additional information to the encoded data 20, the encoded data 20 may not conform to the specifications for the encoded data 20. The decoder 22 can be designed to recognize non-conforming encoded data 20. For example, by adding additional information about the modified EOTF curve 14 to the H.264 or HEVC stream, the H.264 or HEVC stream may not conform to the specifications for H.264 and HEVC streams. The decoder 22 can recognize non-conforming H.264 or HEVC streams and can use the non-conforming H.264 or HEVC stream to identify that the modified EOTF curve 14 is used. Decoder 22 responds to the use of the EOTF curve 14 that identifies the modification to provide decoded modified SDR content 16 for non-compliant H.264 or HEVC streams.
[0034] Decoder 22 provides the decoded modified SDR content 16 to color processing unit 26. Color processing unit 26 converts the modified SDR content 16 into standard format SDR content 28. Color processing unit 26 applies a transfer function to the decoded modified SDR content 16. The transfer function can receive pixel values of the decoded modified SDR content 16 as input and convert the received pixel values for the modified SDR content 16 into standard format pixel values. Display 30 can operate in a specified viewing environment. For example, display 30 can be designed to present video SDR content in Rec.709 format. In this way, color processing unit 26 can convert the pixel values of the modified SDR content 16 into Rec.709 format pixel values and convert the output SDR content 28 into Rec.709 format.
[0035] In implementation, the modified EOTF curve 14 can provide the relationship between the non-linear color values provided to the display device and the linear color values generated by the display device. In this way, the color processing unit 26 can directly use the modified EOTF curve 14 and can convert the decoded modified SDR content 16 into linear light information for display on the display 30.
[0036] Display 30 can display SDR content 28. The SDR content 28 displayed on display 30 can better match human perception of images. SDR content 28 can have more visual information presented in images and / or videos because a modified EOTF curve 14 is used compared to the SMPTERec.709 EOTF curve. For example, SDR content 28 can provide realism in darker areas of an image. Furthermore, SDR content 28 may not have the banding that appears in images or videos.
[0037] Exemplary use cases may include a user using a 3G cellular network to stream game data for a digital game for display on a client device 106. Images or videos of the game data may include SDR content 10. By using a modified EOTF curve 14 on the SDR content 10 in the game data, the user can still receive good image quality on the display 30 even if bandwidth for the 3G cellular network is limited.
[0038] Another example use case could be using a modified EOTF curve 14 on a still image. Compared to the amount of information lost when using the SMPTERec.709 EOTF curve, the amount of visual information (e.g., details in the image) lost during the compression and transmission of the still image to the client device 106 using the modified EOTF curve 14 can be reduced. Thus, a still image using the modified EOTF curve 14 can correspond to what the human eye typically sees.
[0039] While the examples above use the SMPTE Rec.709 EOTF curve, the most common gamma curve used with SDR video, other standards can be used for images, such as, but not limited to, ProPhoto RGB, Adobe RGB, and / or sRGB. System 100 and the modified EOTF curve 14 can also be used with other standards for SDR content.
[0040] In this way, system 100 can be used to achieve better compression in terms of image quality by providing improved image quality at a lower bit rate. Therefore, system 100 can be used to reduce the amount of bandwidth required to transmit video or images while optimizing image quality.
[0041] Now for reference Figure 2A and Figure 2B The exemplary method 200 can be performed by device 102 ( Figure 1 ) and client device 106 ( Figure 1 ) to be used to transmit SDR content 10 ( Figure 1 (See below for reference) Figure 1 We will discuss the actions of method 200 using the framework.
[0042] At 202, method 200 may include receiving SDR content 202. The precoding component 12 of device 102 may receive SDR content 10 requested by client device 106. SDR content 10 may include video or images. For example, SDR content 10 may include, but is not limited to, images or videos for game content for digital games, videos for movies, videos and / or still images for programs.
[0043] At 204, method 200 may include converting SDR content to modified SDR content using a modified EOTF curve. Precoding component 12 may use the modified EOTF curve 14 to convert SDR content 10 to modified SDR content 16. Precoding component 12 may use the modified EOTF curve 14 to transform pixel input values for captured Rec.709 SDR content 10 to pixel output values for modified SDR content 16. For 8-bit content, the pixel input values of the modified EOTF curve 14 can be in the range of 0 to 255. Therefore, precoding component 12 may choose to use the modified EOTF curve 14 for preprocessing SDR content 10 before encoding, instead of using the SMPTE Rec.709 EOTF curve for preprocessing SDR content 10 before encoding.
[0044] The modified EOTF curve 14 can provide an efficient mapping from a range of luminance values containing as few as 8 bits of digital code values to 100 candela per square meter (cd / m²), where 1 nit equals 1 cd / m². Thus, the modified EOTF curve 14 can be constrained to the 100 nits required for SDR content. The modified EOTF curve 14 allows encoding with 8-bit precision without displaying stripes. Stripes can comprise lines between different color regions of an image. The modified EOTF curve 14 allows encoding with 8-bit precision while maintaining smooth gradations from one color to different colors in the image. Using the modified EOTF curve 14 can provide SDR images with increased realism and presence, and therefore provide images that are more in line with human perception. For example, the modified EOTF curve 14 can increase the level of granularity in the darker areas of SDR content 10. Users may not perceive the banding in SDR content 10 because the granularity of the proposed EOTF curve 14 is almost twice that of the EOTF SMPTERec.2084 curve, and HDR content uses the Rec.2020 color space, which covers three times the space of the SDR color space Rec.709. Furthermore, the modified EOTF curve 14 reduces the amount of visual information lost in SDR content 10 during compression. Therefore, the modified EOTF curve 14 can represent a digital system that closely matches how humans respond to light intensity.
[0045] At 206, method 200 may include sending modified SDR content to the encoder. Precoding component 12 may send or otherwise transmit the modified SDR content 16 to encoder 18.
[0046] At 208, method 200 may include saving encoded data. Encoder 18 can generate encoded data by encoding the modified SDR content 16 using 8 bits, and can save the encoded data 20. For example, the encoded data 20 can be saved in MP4 format or any other container format to allow streaming over the Internet.
[0047] At 210, method 200 may include transmitting encoded data. Device 102 may transmit encoded data 20 to client device 106. For example, device 102 may stream encoded data 20 to client device 106 via network 104 in response to receiving a request from client device 106 to access SDR content 10. Since encoding is performed using 8 bits, the amount of network bandwidth required to transmit encoded data 20 can be reduced compared to the amount of network bandwidth required to transmit encoded data using 10 bits.
[0048] At 212, method 200 may include receiving encoded data for presentation on a display. Decoder 22 on client device 106 may receive and decode encoded data 20.
[0049] At 214, method 200 may include identifying that the encoded data uses a modified EOTF curve. Decoder 22 may identify that the encoded data 20 uses a modified EOTF curve 14 and may decode the encoded data 20 into decoded modified SDR content 16. In an implementation, metadata 24 may be transmitted along with the encoded data 20 as sideband data. Metadata 24 may provide customized information about the modified EOTF curve 14. Decoder 22 may use metadata 24 to identify that the modified EOTF curve 14 is used and may provide decoded modified SDR content 16 in response to identifying that the modified EOTF 14 is used. In another implementation, the encoded data 20 may include additional information added to the encoded data 20 indicating that the modified EOTF curve 14 is used. By adding additional information to the encoded data 20, the encoded data 20 may not conform to the specification for the encoded data 20. Decoder 22 can use non-compliant encoded data 20 to identify that a modified EOTF curve 14 has been used, and in response to identifying that a modified EOTF curve 14 has been used, it can provide decoded modified SDR content 16 for non-compliant encoded data 20.
[0050] At 216, method 200 may include decoding the encoded data into modified SDR content. Decoder 22 may decode the encoded data 20 into modified SDR content 16.
[0051] At 218, method 200 may include converting modified SDR content into standard format SDR content. Decoder 22 may provide the decoded modified SDR content 16 to color processing unit 26. Color processing unit 26 may convert the modified SDR content 16 into standard format SDR content 28. Color processing unit 26 may apply a transfer function to the decoded modified SDR content 16. The transfer function may receive pixel values of the decoded modified SDR content 16 as input and may convert the received pixel values for the modified SDR content into pixel values in standard format. For 8-bit content, the pixel input value of the transfer function may be in the range of 0 to 255, and the pixel output value of the transfer function may be in the range of 0 to 255. Display 30 may operate in a specified viewing environment. For example, display 30 may be designed to present SDR content 28 in Rec.709 format, and color processing unit 26 may convert modified SDR content 16 into Rec.709 format SDR content 28.
[0052] At 220, method 200 may include transmitting SDR content for presentation on a display. Color processing unit 26 may transmit SDR content 28 for presentation on display 30, and display 30 may present SDR content 28. The SDR content 28 presented on display 30 may be more consistent with human perception of an image. SDR content 28 may present more visual information in images and / or videos because a modified EOTF curve 14 is used compared to using the SMPTE Rec.709 EOTF curve. For example, SDR content 28 may provide realism in darker areas of an image. Furthermore, SDR content 28 may not have the banding that appears in images or videos.
[0053] Method 200 can reduce the bit rate used to encode SDR content 10 while maintaining or improving the quality of the displayed image by preventing striping. Thus, method 200 can be used to display SDR content 28, which is consistent with human perception of images or videos.
[0054] Now for reference Figure 3 Figure 300 shows the modified EOTF curve 14 before encoding. Figure 1 Example transformation of pixel values. In this example, Rec.709 is used to transform the captured SDR content 10 ( Figure 1The X-axis represents the pixel input value 302, which is used for the SDR content 10 for the red, green, or blue channels. The SDR content 10 can be represented in 8 bits, and the pixel input value 302 can be in the range of 0 to 255. The Y-axis represents the pixel output value 304, which, after transformation, is used for the modified SDR content 16 (…). Figure 1 The modified EOTF curve 14 is calculated. The pixel output value 304 can range from 0 to 255. Curve 306 shows the pixel output value 304 for the modified SDR content 16 and the pixel input value 302 for the captured SDR content 10. For example, the precoding component 12 ( Figure 1 The modified EOTF curve 14 can be used to transform the pixel input value 302 for the captured SDR content 10 into the pixel output value 304 for the modified SDR content 16.
[0055] Now for reference Figure 4 Figure 400 illustrates the use of client device 106 after the decoding process. Figure 1 Example transformation of pixel values of the transfer function at ) to ensure that video or image displays at 30 ( Figure 1 The image is correctly displayed on the left (in the center). The X-axis represents the pixel input value 402 of the decoded image using the modified EOTF curve 14 for the transfer function. The pixel input value 402 can range from 0 to 255. For example, the pixel input value 402 can come from the decoded modified SDR content 16. The Y-axis represents the pixel output value 404 of the SDR content 28 calculated by the transfer function. The pixel output value 404 can range from 0 to 255 and can be converted according to standard SDR values. In this example, the pixel output value 404 of the SDR content 28 is in Rec.709 format. Curve 406 shows the pixel output value 404 for SDR content 28 and the pixel input value 402 for the modified SDR content 16. For example, the color processing unit 26 can use the transfer function to convert the pixel input value 402 for the modified SDR content 16 into a Rec.709 format pixel output value for the SDR content 28.
[0056] Figure 5 Specific components that may be included within a computer system 500 are shown. One or more computer systems 500 may be used to implement the various devices, components, and systems described herein.
[0057] Computer system 500 includes processor 501. Processor 501 can be a general-purpose single-chip or multi-chip microprocessor (e.g., an advanced RISC (Reduced Instruction Set Computer) machine (ARM)), a special-purpose microprocessor (e.g., a digital signal processor (DSP)), a microcontroller, a programmable gate array, etc. Processor 501 can be referred to as a central processing unit (CPU). Although in Figure 5 The computer system 500 shows only a single processor 501, but in alternative configurations, a combination of processors (e.g., ARM and DSP) can be used.
[0058] Computer system 500 also includes memory 503 that is in electronic communication with processor 501. Memory 503 can be any electronic component capable of storing electronic information. For example, memory 503 can be random access memory (RAM), read-only memory (ROM), disk storage media, optical storage media, flash memory devices in RAM, on-board memory included in the processor, erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, etc., as well as combinations thereof.
[0059] Instruction 505 and data 507 may be stored in memory 503. Instruction 505 may be executable by processor 501 to implement some or all of the functions disclosed herein. Execution of instruction 505 may involve using data 507 stored in memory 503. Any example of the various examples of modules and components described herein may be implemented in part or in whole as instruction 505 stored in memory 503 and executed by processor 501. Any example of the various examples of data described herein may be data 507 stored in memory 503 and used during the execution of instruction 505 by processor 501.
[0060] The computer system 500 may also include one or more communication interfaces 509 for communicating with other electronic devices. The communication interfaces 509 may be based on wired communication technology, wireless communication technology, or both. Some examples of communication interfaces 509 include Universal Serial Bus (USB), Ethernet adapters, and wireless adapters operating according to the Institute of Electrical and Electronics Engineers (IEEE) 802.11 wireless communication protocol. Wireless communication adapter and infrared (IR) communication port.
[0061] Computer system 500 may also include one or more input devices 511 and one or more output devices 513. Some examples of input devices 511 include keyboards, mice, microphones, remote control devices, buttons, joysticks, trackballs, touchpads, and light pens. Some examples of output devices 513 include speakers and printers. A particular type of output device typically included in computer system 500 is a display device 515. Display devices 515 used with the embodiments disclosed herein can utilize any suitable image projection technology, such as liquid crystal displays (LCDs), light-emitting diodes (LEDs), gas plasma, electroluminescence, etc. A display controller 517 may also be provided for converting data 507 stored in memory 503 into text, graphics, and / or moving images (as applicable) displayed on display device 515.
[0062] The various components of the computer system 500 can be coupled together via one or more buses, which may include power buses, control signal buses, status signal buses, data buses, etc. For clarity, Figure 5 The various buses are described as a bus system 519.
[0063] Unless specifically described as implemented in a particular manner, the techniques described herein can be implemented in hardware, software, firmware, or any combination thereof. Any features described as modules, components, etc., can also be implemented together in an integrated logic device or separately as discrete but interoperable logic devices. If implemented in software, the described techniques can be implemented at least in part by a non-transient processor-readable storage medium comprising instructions that, when executed by at least one processor, perform one or more methods described herein. Instructions can be organized into routines, programs, objects, components, data structures, etc., which can perform specific tasks and / or implement specific data types, and can be combined or distributed as needed in various embodiments.
[0064] Computer-readable media can be any available medium accessible by a general-purpose or special-purpose computer system. A computer-readable medium storing computer-executable instructions is a non-transitory computer-readable storage medium (device). A computer-readable medium carrying computer-executable instructions is a transmission medium. Therefore, for example, but not limited to, embodiments of this disclosure may include at least two distinct types of computer-readable media: a non-transitory computer-readable storage medium (device) and a transmission medium.
[0065] As used herein, a non-transient computer-readable storage medium (device) may include RAM, ROM, EbEPROM, CD-ROM, solid-state drive (SSD) (e.g., RAM-based), flash memory, phase-change memory (PCM), other types of memory, other optical disc storage devices, disk storage devices or other magnetic storage devices, or any other medium that may be used to store desired program code components in the form of computer-executable instructions or data structures and that may be accessed by a general-purpose or special-purpose computer.
[0066] The steps and / or actions of the methods described herein may be interchanged without departing from the scope of the claims. In other words, unless the correct operation of the described methods requires a specific order of steps or actions, the order and / or use of specific steps and / or actions may be modified without departing from the scope of the claims.
[0067] The term "determine" encompasses a wide variety of actions; therefore, "determine" can include accounting, calculation, processing, deriving, investigating, searching (e.g., looking in a table, database, or other data structure), ascertaining, etc. Furthermore, "determine" can include receiving (e.g., receiving information), accessing (e.g., accessing data in storage), etc. Additionally, "determine" can include resolving, selecting, choosing, establishing, etc.
[0068] The articles “a,” “an,” and “the” are intended to indicate the presence of one or more elements described above. The terms “comprising,” “including,” and “having” are intended to be inclusive, meaning that other elements besides those listed may be present. Furthermore, it should be understood that references to “one implementation” or “one embodiment” in this disclosure are not intended to be construed as excluding the existence of additional implementations that also include the described features. For example, any element described with respect to an implementation herein may be combined with any element of any other implementation described herein. Therefore, as will be understood by those skilled in the art as covered by the implementations of this disclosure, the numbers, percentages, ratios, or other values described herein are intended to include that value, as well as other values that are “about” or “approximately” to the described values. The described values should be interpreted broadly enough to include values that are at least sufficiently close to the described values to perform the desired function or achieve the desired result. The described values include at least the variations expected in a suitable manufacturing or production process and may include values within 5%, 1%, 0.1%, or 0.01% of the described values.
[0069] In view of this disclosure, those skilled in the art will recognize that equivalent constructions do not depart from the spirit and scope of this disclosure, and various changes, substitutions, and alternatives can be made to the implementations disclosed herein without departing from the spirit and scope of the invention. Equivalent structures, including functional “method plus function” clauses, are intended to cover structures described herein that perform the described functions, including structural equivalents that operate in the same manner and equivalent structures that provide the same functionality. The applicant’s explicit intent is not to invoke “method plus function” or other “functional requirements” with respect to any claim, except for claims where “method plus function” occurs concurrently with the associated functionality. Every addition, deletion, and modification to the implementation that falls within the meaning and scope of the claims will be included by the claims.
[0070] This disclosure may be embodied in other specific forms without departing from its spirit or characteristics. The described embodiments are to be considered illustrative rather than restrictive. Therefore, the scope of this disclosure is indicated by the appended claims rather than by the foregoing description. Modifications within the meaning and equivalent scope of the claims should be included within their scope.
Claims
1. A system for transmitting standard dynamic range (SDR) content, comprising: One or more processors; A memory that is in electronic communication with the one or more processors; as well as Instructions, which are stored in the memory, and which are executable by the one or more processors to: Receive standard dynamic range (SDR) content; The SDR content is converted to modified SDR content using a modified electro-optical transfer function (EOTF) curve, in order to convert the non-linear color values of the SDR content into optical output values in the modified SDR content. The modified EOTF curve covers the 100 nits required for the SDR content, while being encoded with 8-bit precision without displaying the stripes in the SDR content; The modified SDR content is sent to the encoder to generate encoded data by using 8-bit encoding of the modified SDR content; The encoded data is transmitted to the client device via streaming over a network; At the client device, the encoded data is decoded into the modified SDR content, wherein the modified SDR content is based on the modified EOTF curve; At the client device, the modified SDR content is converted into standard format SDR content; The SDR content in the standard format is transmitted at the client device for presentation on a display.
2. The system of claim 1, wherein the modified EOTF curve is constrained to 100 nits.
3. The system of claim 1, wherein the modified EOTF curve provides additional grayscale.
4. The system of claim 1, wherein while encoding the modified SDR content in 8 bits, the modified EOTF curve improves the image quality of the SDR content.
5. The system of claim 1, wherein the modified EOTF curve increases the level of granularity in the darker portions of the SDR content.
6. The system of claim 1, wherein the instructions are further executable by the one or more processors on the client device to: The modified EOTF curve is identified by accessing the metadata associated with the encoded data.
7. The system according to claim 1, The standard format therein corresponds to the specified viewing environment of the display.
8. A method for transmitting standard dynamic range (SDR) content, comprising: Receive standard dynamic range (SDR) content; The SDR content is converted to modified SDR content using a modified electro-optical transfer function (EOTF) curve, in order to convert the non-linear color values of the SDR content into optical output values in the modified SDR content. The modified EOTF curve covers the 100 nits required for the SDR content, while being encoded with 8-bit precision without displaying the stripes in the SDR content; The modified SDR content is sent to the encoder to generate encoded data by using 8-bit encoding of the modified SDR content; as well as The encoded data is transmitted to the client device via streaming over a network; At the client device, the encoded data is decoded into the modified SDR content, wherein the modified SDR content is based on the modified EOTF curve; At the client device, the modified SDR content is converted into standard format SDR content; The SDR content in the standard format is transmitted at the client device for presentation on a display.
9. The method of claim 8, wherein the modified EOTF curve is constrained to 100 nits.
10. The method of claim 8, wherein the modified EOTF curve provides additional grayscale.
11. The method of claim 8, wherein while encoding the modified SDR content in 8 bits, the modified EOTF curve improves the image quality of the SDR content.
12. The method of claim 8, wherein the modified EOTF curve increases the level of granularity in the darker portions of the SDR content.
13. The method of claim 8, further comprising: The client device identifies that the encoded data uses the modified EOTF curve by accessing the metadata associated with the encoded data.
14. The method of claim 8, wherein the standard format corresponds to a specified viewing environment of the display.
15. A non-transient computer-readable medium storing instructions executable by a computer device, the instructions comprising: At least one instruction is provided to cause the computer device to receive standard dynamic range (SDR) content; At least one instruction is provided to cause the computer device to convert the SDR content into modified SDR content using a modified electro-optical transfer function (EOTF) curve, so as to convert the non-linear color values of the SDR content into optical output values in the modified SDR content. The modified EOTF curve covers the 100 nits required for the SDR content, while being encoded with 8-bit precision without displaying the stripes in the SDR content; At least one instruction is provided to cause the computer device to send the modified SDR content to an encoder to generate encoded data by using 8-bit encoding of the modified SDR content; At least one instruction is provided to cause the computer device to transmit the encoded data to a client device via a network through streaming; At least one instruction is provided to cause the computer device at the client device to decode the encoded data into the modified SDR content, wherein the modified SDR content is based on the modified EOTF curve; At least one instruction is provided to cause the computer device at the client device to convert the modified SDR content into SDR content in a standard format. At least one instruction is provided to cause the computer device to transmit the SDR content in the standard format at the client device for presentation on a display.
16. The computer-readable medium of claim 15, wherein the modified EOTF curve is constrained to 100 nits and provides additional grayscale, while improving the image quality of the SDR content while encoding the modified SDR content in 8 bits.
Citation Information
Patent Citations
Conversion method and conversion apparatus
CN105493490A
Content mapping using extended color range
CN107077726A