Image processing method and device, electronic device and storage medium

Abstract

The present application provides a picture processing method and device, an electronic device and a storage medium, the method comprising: collecting a cloud server rendered picture in a high dynamic range imaging HDR format, wherein EDID data is written into the system of the cloud server, the EDID data comprising parameter information and HDR capability information of the display, and the system renders the cloud server rendered picture in HDR mode; encoding the cloud server rendered picture, and streaming the encoded data to a terminal, so as to realize the application of HDR technology to the cloud server.

Description

Technical Field

[0001] The present invention relates to the field of cloud computing, and in particular to a picture processing method and device, electronic equipment and storage medium. Background Art

[0002] With the advancement of technology, more and more consumer devices have begun to support HDR (High Dynamic Range Imaging) display technology. For example, modern 4K TVs, professional monitors, smartphones, and tablets all have HDR display capabilities. When users watch videos or play games on these devices, they can enjoy high-quality HDR effects with high brightness, rich colors, and delicate details, which significantly improves the user's visual experience.

[0003] Although HDR technology has been widely used in local devices, it cannot be implemented in cloud servers because cloud servers usually do not have actual display connections. Implementing HDR functions in cloud servers will bring huge market potential. For example, users can enjoy high-quality HDR content on any device through cloud computers, cloud phones, cloud games and other technologies, which will greatly improve the user experience in scenarios such as remote office, cloud games, and remote design. In view of this, how to apply HDR technology to cloud servers so that users can enjoy high-quality HDR content through cloud servers has become a technical problem that needs to be solved urgently. Summary of the invention

[0004] In view of the technical problems existing in the prior art, the embodiments of the present application provide a picture processing method and device, an electronic device and a storage medium.

[0005] In a first aspect, an embodiment of the present application provides a picture processing method, including:

[0006] Capturing a cloud server rendered image in a high dynamic range imaging (HDR) format, wherein EDID data is written into the cloud server system, the EDID data including parameter information and HDR capability information of the display, and the system renders the cloud server rendered image in HDR mode;

[0007] The cloud server rendering image is encoded, and the encoded data is pushed to the terminal.

[0008] In a second aspect, an embodiment of the present application further provides a picture processing device, including:

[0009] A collection unit is used to collect a cloud server rendering picture in a high dynamic range imaging HDR format, wherein EDID data is written into the system of the cloud server, and the EDID data includes parameter information and HDR capability information of the display, and the system renders the cloud server rendering picture in HDR mode;

[0010] The streaming unit is used to encode the cloud server rendering picture and stream the encoded data to the terminal.

[0011] In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the image processing method described in the first aspect are executed.

[0012] In a fourth aspect, an embodiment of the present application further provides an electronic device, comprising: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the storage medium through the bus, and the processor executes the machine-readable instructions to perform the steps of the picture processing method described in the first aspect.

[0013] In the above solution, EDID data including the parameter information and HDR capability information of the display is written into the system of the cloud server, which can simulate a display supporting HDR function connected to the cloud server. In this way, the system will think that a real display supporting HDR function has been connected, which enables the system to turn on HDR mode and provide HDR quality content presentation for applications running on the cloud server and supporting HDR function, that is, rendering the desktop screen / application screen in HDR format, and then pushing the stream to the terminal through the processing processes such as acquisition, encoding, and streaming. The terminal can restore and display the HDR content, thereby realizing the application of HDR technology to the cloud server. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 A schematic diagram of a flow chart of an embodiment of a picture processing method provided in an embodiment of the present application;

[0015] Figure 2 A schematic diagram of the structure of an embodiment of a picture processing device provided in an embodiment of the present application;

[0016] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0017] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the drawings in the present application only serve the purpose of explanation and description and are not used to limit the scope of protection of the present application. In addition, it should be understood that the schematic drawings are not drawn in real proportion. The flowchart used in this application shows the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowchart can be implemented out of sequence, and the steps without logical context can be reversed in order or implemented simultaneously. In addition, those skilled in the art can add one or more other operations to the flowchart under the guidance of the content of the present application, or remove one or more operations from the flowchart.

[0018] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0019] It should be noted that the term "comprising" will be used in the embodiments of the present application to indicate the existence of the features declared thereafter, but does not exclude the addition of other features.

[0020] Reference Figure 1 FIG. 1 is a flow chart of a method for processing a picture provided by an embodiment of the present application, the method comprising:

[0021] S10, collecting a cloud server rendering picture in a high dynamic range imaging HDR format, wherein EDID data is written into the system of the cloud server, the EDID data including parameter information and HDR capability information of the display, and the system renders the cloud server rendering picture in HDR mode;

[0022] In this embodiment, it should be noted that EDID (Extended Display Identification Data) data is written into the system of the cloud server to simulate an HDR display, so that the system can think that a display supporting the HDR function has been connected, thereby turning on the HDR mode. This method effectively bypasses the limitation of the lack of actual displays in the cloud computing environment and realizes the application of HDR image processing capabilities in a virtualized environment. The parameter information of the display in the EDID data includes resolution and refresh rate, and the HDR capability information includes supported HDR standards, color space and brightness range, etc. This information enables the system to identify the HDR capability of the display and adjust the image output accordingly. If EDID data is written into the system of the cloud server, the HDR output capability will be enabled, so that all applications that can support the HDR function (such as games, video playback software, design software, etc.) will be rendered and processed in HDR mode in the cloud server. In other words, by simulating the EDID data of the HDR display, the cloud server can have HDR processing capabilities, so that HDR content can be generated and transmitted in the cloud. In the cloud server, all applications that support the HDR function output HDR format image signals after the GPU completes the application screen rendering in HDR mode. The system can capture these HDR signals output by the GPU in real time through video acquisition tools (such as NVIDIA NVENC hardware accelerator) configured in the cloud server. The acquisition process ensures that all key information of the HDR signal is preserved, including color depth, brightness range and contrast.

[0023] S11, encoding the cloud server rendering image, and streaming the encoded data to the terminal.

[0024] In this embodiment, through a simulated HDR display, the cloud server-rendered image in HDR format can be encoded and streamed to the terminal. In this way, the user will be able to experience HDR images with high contrast, rich colors and delicate brightness, which significantly improves the visual effect, especially when watching HDR videos or playing HDR games.

[0025] In the picture processing method provided in the embodiment of the present application, EDID data including parameter information and HDR capability information of the display is written into the system of the cloud server, which can simulate a display supporting HDR function connected to the cloud server. In this way, the system will think that a real display supporting HDR function has been connected, which enables the system to turn on HDR mode and provide HDR quality content presentation for applications running on the cloud server and supporting HDR function, that is, rendering the desktop screen / application screen in HDR format, and then pushing the stream to the terminal through the processing processes such as acquisition, encoding, and streaming. The terminal can restore and display the HDR content, thereby realizing the application of HDR technology to the cloud server.

[0026] Based on the aforementioned method embodiment, the EDID data may be written into a preset hardware module of the cloud server, and the preset hardware module is used to simulate an HDR display.

[0027] In this embodiment, it should be noted that the IPMI (Intelligent Platform Management Interface) tool or script can be used to write EDID data to a specific hardware module of the cloud server through the IPMI interface. This module can be inserted into the HDMI port of the graphics card to simulate an HDR display. After writing, the system will automatically read the EDID data and assume that a real display that supports HDR function has been connected. Once the system reads the EDID data, the system will automatically enable HDR output capability, which means that all content that can support HDR function will be rendered and processed in HDR mode in the cloud server.

[0028] Based on the aforementioned method embodiment, the encoding process may use a HEVC encoder, and HDR metadata may be embedded in the encoded data, wherein the HDR metadata includes a MaxCLL value and a MaxFALL value.

[0029] In this embodiment, it should be noted that the collected HDR signal is uncompressed raw data and is bulky. In order to transmit efficiently, it needs to be compressed and encoded. The HEVC encoder can be used to compress HDR content. The HEVC encoder has high compression efficiency and can significantly reduce the data volume while retaining high image quality. During the encoding process, the HDR content can be processed using the BT.2020 color space and PQ (Perceptual Quantizer) curve to ensure color accuracy and consistency. BT.2020 provides a wider color gamut support, and the PQ curve optimizes the human eye's perception of brightness. In addition, 10-bit or 12-bit color depth can be used during encoding to support higher dynamic range and richer color expression.

[0030] In addition, during the encoding process, HDR-related metadata can also be embedded, including MaxFALL (MaximumFrame Average Light Level, the maximum value of the frame average brightness) and MaxCLL (MaximumContentLightLevel, the maximum brightness of the content) values. These metadata ensure that when the content is decoded and displayed, accurate brightness and color adjustments can be made based on the embedded HDR metadata, and the brightness and contrast of the HDR image can be correctly restored, so that the brightness and color performance of the picture are consistent with the original content. Furthermore, through the optimization of dynamic range and contrast, the terminal can provide a consistent HDR visual experience in different display environments.

[0031] Based on the aforementioned method embodiment, the bit rate range used in the streaming process may include (15 Mbps, 25 Mbps).

[0032] In this embodiment, it should be noted that the encoded HDR content is pushed to the terminal through the network. Adaptive bitrate streaming (ABR) technology can be configured in the cloud server to dynamically adjust the bitrate of the push stream to a value within (15Mbps, 25Mbps) according to the current network conditions to balance image quality and transmission efficiency. The push streaming protocol can use HLS (HTTP Live Streaming, a streaming media transmission protocol based on HTTP) or DASH (Dynamic Adaptive Streaming over HTTP, an adaptive bitrate streaming media transmission protocol based on HTTP) to ensure stable streaming media transmission in different network environments.

[0033] In addition, during the streaming process, the system can monitor network bandwidth and latency in real time and dynamically adjust transmission parameters to ensure smooth transmission of HDR content. Specifically, when bandwidth is limited, the system can prioritize the core features of HDR content (such as brightness and color) and appropriately reduce resolution or frame rate to maintain a smooth viewing experience.

[0034] In this embodiment, the HEVC encoder is used to efficiently compress the HDR content, and the BT.2020 color space and PQ curve are used for processing, which can ensure that the visual effects of the HDR content are retained to the maximum extent during the transmission process. In addition, combined with the adaptive bitrate streaming technology, the system can dynamically adjust the transmission parameters under different network conditions to ensure the smooth push of HDR content.

[0035] Reference Figure 2 FIG. 1 is a schematic diagram of a structure of a picture processing device provided in an embodiment of the present application, the device comprising:

[0036] The acquisition unit 20 is used to acquire a cloud server rendering picture in a high dynamic range imaging HDR format, wherein EDID data is written into the system of the cloud server, and the EDID data includes parameter information and HDR capability information of the display, and the system renders the cloud server rendering picture in HDR mode;

[0037] The streaming unit 21 is used to encode the cloud server rendering image and stream the encoded data to the terminal.

[0038] The image processing device provided in the embodiment of the present application has EDID data including parameter information and HDR capability information of the display written into the system of the cloud server, which can simulate a display supporting HDR function connected to the cloud server. In this way, the system will think that a real display supporting HDR function has been connected, which enables the system to turn on HDR mode and provide HDR quality content presentation for applications running on the cloud server and supporting HDR function, that is, rendering the desktop screen / application screen in HDR format, and then pushing the stream to the terminal through the processing processes such as acquisition, encoding, and streaming. The terminal can restore and display the HDR content, thereby realizing the application of HDR technology to the cloud server.

[0039] Based on the aforementioned device embodiment, the EDID data may be written into a preset hardware module of the cloud server, and the preset hardware module is used to simulate an HDR display.

[0040] Based on the aforementioned device embodiment, the encoding process may use a HEVC encoder, and HDR metadata may be embedded in the encoded data, wherein the HDR metadata includes a MaxCLL value and a MaxFALL value.

[0041] Based on the aforementioned device embodiment, the bit rate range used in the streaming process may include (15 Mbps, 25 Mbps).

[0042] The picture processing device provided in the embodiment of the present application has an implementation process that is consistent with the picture processing method provided in the embodiment of the present application, and the effect that can be achieved is also the same as the picture processing method provided in the embodiment of the present application, which will not be repeated here.

[0043] In summary, traditional cloud computing environments usually cannot implement HDR functions due to the lack of actually connected displays. This solution successfully enables cloud servers to have HDR processing capabilities by simulating the EDID data of the display, overcoming the display limitations in the cloud computing environment. In addition, HDR content has a large amount of data, and the transmission process requires high bandwidth and is easily affected by network fluctuations. This solution solves the transmission bottleneck problem of HDR content by using HEVC encoding and adaptive bitrate streaming technology, ensuring that high-quality HDR content transmission can be achieved under different network conditions. Finally, not all users' terminals support HDR functions, especially in the use scenarios of cloud computers / cloud phones / cloud games, where users may use a variety of different displays, and the HDR function support of these displays varies. This solution ensures that different terminals can restore consistent HDR visual effects under various display conditions through precise HDR metadata processing and display optimization technology. This not only improves the user experience, but also provides technical support for the cross-device popularization of HDR content. Through these specific implementations, the terminal can fully restore and display HDR content, thereby realizing the application of HDR technology in cloud servers.

[0044] like Figure 3 As shown, an electronic device provided by an embodiment of the present application includes: a processor 30, a memory 31 and a bus 32, wherein the memory 31 stores machine-readable instructions executable by the processor 30, and when the electronic device is running, the processor 30 communicates with the memory 31 through the bus 32, and the processor 30 executes the machine-readable instructions to perform the steps of the above-mentioned image processing method.

[0045] Specifically, the memory 31 and the processor 30 can be general-purpose memories and processors, which are not specifically limited here. When the processor 30 runs the computer program stored in the memory 31, the image processing method can be executed.

[0046] Corresponding to the above-mentioned picture processing method, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned picture processing method are executed.

[0047] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A picture processing method, characterized in that: include: Capturing a cloud server rendered image in a high dynamic range imaging (HDR) format, wherein EDID data is written into the cloud server system, the EDID data including parameter information and HDR capability information of the display, and the system renders the cloud server rendered image in HDR mode; The cloud server rendering image is encoded, and the encoded data is pushed to the terminal.

2. The method according to claim 1, characterized in that The EDID data is written into a preset hardware module of the cloud server, and the preset hardware module is used to simulate an HDR display.

3. The method according to claim 1 or 2, characterized in that The encoding process uses a HEVC encoder, and HDR metadata is embedded in the encoded data, wherein the HDR metadata includes a MaxCLL value and a MaxFALL value.

4. The method according to claim 3, characterized in that The bit rate range used in the streaming process includes (15Mbps, 25Mbps).

5. A picture processing device, characterized in that: include: A collection unit is used to collect a cloud server rendering picture in a high dynamic range imaging HDR format, wherein EDID data is written into the system of the cloud server, and the EDID data includes parameter information and HDR capability information of the display, and the system renders the cloud server rendering picture in HDR mode; The streaming unit is used to encode the cloud server rendering picture and stream the encoded data to the terminal.

6. The device according to claim 5, characterized in that The EDID data is written into a preset hardware module of the cloud server, and the preset hardware module is used to simulate an HDR display.

7. The device according to claim 5 or 6, characterized in that The encoding process uses a HEVC encoder, and HDR metadata is embedded in the encoded data, wherein the HDR metadata includes a MaxCLL value and a MaxFALL value.

8. The device according to claim 7, characterized in that The bit rate range used in the streaming process includes (15Mbps, 25Mbps).

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the picture processing method according to any one of claims 1 to 4 are executed.

10. An electronic device, characterized in that: include: A processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the storage medium via the bus, and the processor executes the machine-readable instructions to perform the steps of the picture processing method according to any one of claims 1 to 4.

Images