Output picture correction method, apparatus and storage medium

Abstract

The application provides an output picture correction method, device and storage medium, wherein the method comprises the following steps: sending a test image to a target display device to instruct the target display device to display the test image; acquiring color analysis data of an output picture of the target display device when the test image is displayed; generating tone mapping data corresponding to the target display device according to target color data corresponding to the color analysis data and the test image, wherein the tone mapping data is used to represent a mapping relationship between original color values of the test image and corrected color values, and the corrected color values are used to drive the target display device to output an image meeting the target color data; and correcting the output picture of the target display device by using the tone mapping data. The application realizes automatic correction of the display device according to the test image, so that the display device can output target colors, the stability of the output picture is improved, and the display effect of the display device is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display processing, and in particular to an output picture correction method, device and storage medium. BACKGROUND

[0002] High Dynamic Range Imaging (HDRI or HDR for short) is a set of techniques used in computer graphics and cinematography to achieve a greater dynamic range of exposure (i.e. a greater range of light and dark values) than ordinary digital imaging techniques. The goal of high dynamic range imaging is to correctly represent the wide range of luminances in the real world, from direct sunlight to the darkest shadows.

[0003] At present, there are more and more Android devices, televisions, and television boxes on the market, all of which support the playing of HDR videos, but the playing effects of different display devices are uneven, such as invisible dark places, unclear overexposed bright places, and light or dark mid-gray. Moreover, when the screen brightness of the playing device changes, the overall playing picture effect may also change, resulting in unstable picture display effect of the HDR video. Therefore, how to improve the picture display effect of the display device has become a technical problem to be solved. SUMMARY

[0004] The main purpose of the embodiments of the present application is to provide an output picture correction method, device and storage medium, which automatically corrects the effect of a display device according to a test image, so that the display device can output target colors, improves the stability of the output picture, and improves the display effect of the display device.

[0005] In a first aspect, the embodiments of the present application provide an output picture correction method, comprising: sending a test image to a target display device to instruct the target display device to display the test image; obtaining color analysis data of an output picture of the target display device when displaying the test image; generating tone mapping data corresponding to the target display device according to target color data corresponding to the test image and the color analysis data, the tone mapping data being used to represent a mapping relationship between original color values of the test image and corrected color values, the corrected color values being used to drive the target display device to output an image conforming to the target color data; and correcting the output picture of the target display device by using the tone mapping data.

[0006] In an embodiment, the test image includes a pure color image; and the sending of the test image to the target display device to instruct the target display device to display the test image includes: if the target display device is loaded with a preset player, sending a plurality of pure color images of different colors to the target display device to instruct the preset player to play the plurality of pure color images.

[0007] In an embodiment, the test image comprises a video image; and the sending the test image to the target display device to instruct the target display device to display the test image comprises sending a preset video image to the target display device to instruct the target display device to play the preset video image.

[0008] In an embodiment, the test image comprises a first test image of different colors at the same brightness and / or a second test image of the same color at different brightness.

[0009] In an embodiment, the obtaining color analysis data of an output picture of the target display device when displaying the test image comprises sending a collection instruction to a preset color analyzer, the collection instruction being used to instruct the color analyzer to collect the output picture of the target display device when displaying the test image, so that the color analyzer obtains the color analysis data of the output picture; and receiving the color analysis data returned by the color analyzer.

[0010] In an embodiment, the generating tone mapping data corresponding to the target display device according to the target color data corresponding to the color analysis data and the test image comprises determining difference information between the color analysis data and the target color data; determining a corrected color value used to drive the target display device to output the target color data according to the difference information; and generating the tone mapping data corresponding to the target display device according to a mapping relationship between an original color value of the test image and the corrected color value.

[0011] In an embodiment, the color analysis data comprises output chrominance of the output picture; and the generating tone mapping data corresponding to the target display device according to the target color data corresponding to the color analysis data and the test image comprises determining chrominance difference information between the output chrominance and target chrominance in the target color data; determining a corrected chrominance value used to drive the target display device to output the target chrominance according to the chrominance difference information; and determining a mapping relationship between an original chrominance value of the test image and the corrected chrominance value to obtain chrominance mapping data corresponding to the target display device, the tone mapping data comprising the chrominance mapping data.

[0012] In an embodiment, the color analysis data comprises output brightness of the output picture; and the generating the tone mapping data corresponding to the target display device according to the target color data corresponding to the color analysis data and the test image comprises: determining brightness difference information between the output brightness and target brightness in the target color data; determining a brightness information loss amount of the target display device according to the brightness difference information; compensating an original brightness value corresponding to the output brightness according to the brightness information loss amount to obtain a corrected brightness value; and generating brightness mapping data corresponding to the target display device according to a mapping relationship between the original brightness value of the test image and the corrected brightness value, wherein the tone mapping data comprises the brightness mapping data.

[0013] In an embodiment, the correcting the output picture of the target display device by using the tone mapping data comprises: sending the tone mapping data to the target display device to instruct the target display device to play image information to be processed according to the tone mapping data.

[0014] In an embodiment, before the sending the test image to the target display device, the method further comprises: determining a current screen brightness of the target display device, and obtaining a test image corresponding to the target display device under the current screen brightness.

[0015] In a second aspect, an embodiment of the present application provides an image data processing method, comprising: obtaining image data to be processed; obtaining tone mapping data adapted to a target display device, wherein the tone mapping data is obtained by using the method in any of the above aspects; and controlling the target display device to play the processed image data according to the tone mapping data.

[0016] In a third aspect, an embodiment of the present application provides an output picture correction apparatus, comprising:

[0017] a sending module configured to send a test image to a target display device to instruct the target display device to display the test image;

[0018] a obtaining module configured to obtain color analysis data of an output picture of the target display device when displaying the test image;

[0019] a generating module configured to generate tone mapping data corresponding to the target display device according to target color data corresponding to the color analysis data and the test image, wherein the tone mapping data is used to represent a mapping relationship between an original color value of the test image and a corrected color value, and the corrected color value is used to drive the target display device to output a picture meeting the target color data;

[0020] a correction module, configured to correct an output picture of the target display device by using the tone mapping data.

[0021] In an embodiment, the test image comprises a pure color image; and the sending module is configured to send a plurality of pure color images of different colors to the target display device to instruct a preset player of the target display device to play the plurality of pure color images, if the target display device is loaded with the preset player.

[0022] In an embodiment, the test image comprises a video image; and the sending module is configured to send a preset video image to the target display device to instruct the target display device to play the preset video image.

[0023] In an embodiment, the test image comprises a first test image of different colors at the same brightness and / or a second test image of the same color at different brightness.

[0024] In an embodiment, the obtaining module is configured to send a collection instruction to a preset color analyzer, the collection instruction being used to instruct the color analyzer to collect an output picture of the target display device when displaying the test image, so that the color analyzer obtains color analysis data of the output picture; and the color analysis data returned by the color analyzer is received.

[0025] In an embodiment, the generating module is configured to determine difference information between the color analysis data and the target color data; determine a corrected color value for driving the target display device to output the target color data according to the difference information; and generate tone mapping data corresponding to the target display device according to a mapping relationship between original color values of the test image and the corrected color value.

[0026] In an embodiment, the color analysis data comprises output chrominance of the output picture; and the generating module is configured to determine chrominance difference information between the output chrominance and target chrominance in the target color data; determine a corrected chrominance value for driving the target display device to output the target chrominance according to the chrominance difference information; and determine a mapping relationship between original chrominance values of the test image and the corrected chrominance value to obtain chrominance mapping data corresponding to the target display device, wherein the tone mapping data comprises the chrominance mapping data.

[0027] In an embodiment, the color analysis data includes output brightness of the output picture; the generating module is configured to determine brightness difference information between the output brightness and target brightness in the target color data; determine a brightness information loss amount of the target display device according to the brightness difference information; compensate an original brightness value corresponding to the output brightness according to the brightness information loss amount to obtain a corrected brightness value; generate brightness mapping data corresponding to the target display device according to a mapping relationship between the original brightness value of the test image and the corrected brightness value, and the tone mapping data includes the brightness mapping data.

[0028] In an embodiment, the correcting module is configured to send the tone mapping data to the target display device to instruct the target display device to play image information to be processed according to the tone mapping data.

[0029] In an embodiment, the system further includes a determining module configured to determine a current screen brightness of the target display device before sending the test image to the target display device, and acquire a test image corresponding to the target display device under the current screen brightness.

[0030] In a fourth aspect, an embodiment of the present application provides an output picture correcting system, including a server, a color analyzer and a display device, the display device being within a collection range of the color analyzer; wherein the server is configured to send a test image to the display device; the display device is configured to display the test image; the color analyzer is configured to collect an output picture of the display device when displaying the test image according to a collection instruction sent by the server, and perform color analysis on the output picture to obtain color analysis data of the output picture; the server is further configured to receive the color analysis data returned by the color analyzer, and generate tone mapping data corresponding to the display device according to target color data corresponding to the test image and the color analysis data, the tone mapping data being used to represent a mapping relationship between original color values of the test image and corrected color values, the corrected color values being used to drive the display device to output an image meeting the target color data; and the output picture of the display device is corrected by using the tone mapping data.

[0031] In a fifth aspect, an embodiment of the present application provides an electronic device, including:

[0032] at least one processor; and

[0033] a memory connected with the at least one processor in communication;

[0034] The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the electronic device to perform the method in any of the preceding aspects.

[0035] In a sixth aspect, an embodiment of the present application provides a cloud device, comprising:

[0036] at least one processor; and

[0037] a memory in communication with the at least one processor;

[0038] The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the cloud device to perform the method in any of the preceding aspects.

[0039] In a seventh aspect, an embodiment of the present application provides a computer readable storage medium, and the computer readable storage medium stores computer execution instructions, and when a processor executes the computer execution instructions, the method in any of the preceding aspects is implemented.

[0040] In an eighth aspect, an embodiment of the present application provides a computer program product, comprising a computer program, and when a processor executes the computer program, the method in any of the preceding aspects is implemented.

[0041] The output picture correction method, device and storage medium provided by the embodiments of the present application can evaluate the relationship between the output color of the display device and the target color by sending a test image to the target display device and analyzing the color of the output picture of the display device based on the test image, determine the tone mapping relationship of the display device that can output the target color, generate the tone mapping data corresponding to the display device, and correct the display picture of the display device by using the tone mapping data. In this way, the effect of the display device is automatically corrected according to the test image, the display device can output the target color, the stability of the output picture is improved, and the display effect of the display device is improved. BRIEF DESCRIPTION OF DRAWINGS

[0042] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0043] Figure 1 A structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0044] Figure 2 A schematic diagram of an output picture correction system provided by an embodiment of the present application;

[0045] Figure 3 An architecture schematic diagram of an output picture correction system provided by an embodiment of the present application;

[0046] Figure 4 A flow schematic diagram of an output picture correction method provided by an embodiment of the present application;

[0047] Figure 5 A current luminance mapping curve of a luminance test of a linear domain provided by an embodiment of the present application;

[0048] Figure 6 A contrast schematic diagram of output pictures before and after correction for a display device provided by an embodiment of the present application;

[0049] Figure 7 A flow schematic diagram of an output picture correction method provided by an embodiment of the present application;

[0050] Figure 8 A flow schematic diagram of an output picture correction method provided by an embodiment of the present application;

[0051] Figure 9 A flow schematic diagram of an image data processing method provided by an embodiment of the present application;

[0052] Figure 10 An interaction timing diagram of an output picture correction method provided by an embodiment of the present application;

[0053] Figure 11 A structure schematic diagram of an output picture correction device provided by an embodiment of the present application;

[0054] Figure 12 A structure schematic diagram of a cloud device provided by an embodiment of the present application.

[0055] The specific embodiments of the present application have been shown through the above-described drawings, and will be described in more detail hereinafter. These drawings and the written description are not intended to restrict the scope of the present application by any means, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0056] The exemplary embodiments will be described in detail herein with reference to the attached drawings. The same reference numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all the embodiments consistent with the present application.

[0057] The term "and / or", used herein to describe the association relationship of associated objects, specifically indicates that there can be three relationships, for example, A and / or B can represent: A exists alone, A and B exist together, and B exists alone.

[0058] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant national and regional laws, regulations and standards, and provide corresponding operation portal for user to choose authorization or refusal.

[0059] In order to clearly describe the technical solutions of the embodiments of the present application, first, the terms involved in the present application are explained:

[0060] HDR: High Dynamic Range, high dynamic range, refers to the image containing the brightness level and / or dark details beyond the capacity of traditional image system.

[0061] HDRI: High Dynamic Range Imaging, high dynamic range imaging, high dynamic range imaging provides content creators with a wider range of tonal range, extending the range from the darkest to the brightest in the image. This can be used to display more realistic images, which have higher contrast, darker dark and brighter bright.

[0062] CIE: International Commission on illumination, International Commission on illumination.

[0063] CIE 1931 color space: CIE 1931 color space.

[0064] PQ: Perceptual quantizer, perceptual quantizer.

[0065] LUT: Look Up Table, display lookup table.

[0066] xyY: A color space, Y takes the value of Y in the three stimulus values, indicating brightness, and x, y reflects the chromaticity characteristics of color.

[0067] PC: Personal Computer, personal computer.

[0068] OpenGL: Open Graphics Library, is a cross-language, cross-platform application programming interface for rendering two-dimensional, three-dimensional vector graphics.

[0069] XYZ space: a color space, in 1931 CIE, on the basis of RGB (a color mode) system, using three imaginary primary colors X, Y, Z to establish a new color system.

[0070] As Figure 1 shown, the embodiment provides an electronic device 1, comprising: at least one processor 11 and a memory 12, Figure 1 The processor 11 and the memory 12 are connected through the bus 10. The memory 12 stores instructions executable by the processor 11, and the instructions are executed by the processor 11 to enable the electronic device 1 to execute all or part of the processes of the method in the following embodiments, so as to automatically correct the effect of the display device according to the test image, enable the display device to output the target color, improve the stability of the output picture, and improve the display effect of the display device.

[0071] In an embodiment, the electronic device 1 can be a mobile phone, a tablet computer, a notebook computer, a desktop computer, or a large-scale computing system composed of multiple computers.

[0072] High dynamic range imaging, in computer graphics and cinematography, is a set of techniques used to achieve a greater exposure dynamic range (i.e. a greater contrast ratio) than ordinary digital imaging techniques. The goal of high dynamic range imaging is to correctly represent the wide range of luminances in the real world, from direct sunlight to the darkest shadows.

[0073] There are more and more Android devices, televisions, and television boxes on the market, all of which support the playback of HDR videos, but the effects of different display devices are uneven, such as invisible dark places, unclear bright places, and grayish or dark situations. And when the screen brightness of the playback device changes, the overall picture effect may also change, resulting in unstable picture display effect of the HDR video. Therefore, how to improve the picture display effect of the display device has become a technical problem to be solved.

[0074] To solve the above problems, the embodiment of the present application provides a display device correction scheme, which sends a test image to a target display device, evaluates the relationship between the output color of the display device and the target color based on the color analysis of the output picture of the display device to the test image, determines the tone mapping relationship of the display device that can output the target color, generates the tone mapping data corresponding to the display device, and corrects the display picture of the display device by using the tone mapping data. In this way, the effect of the display device is automatically corrected according to the test image, the display device can output the target color, the stability of the output picture is improved, and the display effect of the display device is improved.

[0075] Figure 2 A display device correction system 200 provided by the embodiment of the present application includes a server 210, a display device 220 and a color analyzer 230, and the display device 220 is within the collection range of the color analyzer 230. Wherein:

[0076] The server 210 is configured to send a test image to the display device 220. The server 210 can be a data platform providing display device 220 correction service, such as a tone mapping curve correction platform. The server 210 can also be a local terminal device, such as a PC terminal with tone mapping curve correction function. In actual scenarios, a tone mapping curve correction platform can have multiple servers 210, Figure 2 Take one server 210 as an example.

[0077] The display device 220 is configured to display the test image. The display device 220 can be a smart TV, a TV set-top box, a computer, a mobile phone, a tablet and the like used by a user when logging in to a tone mapping curve correction platform, and the display device 220 can also have multiple, Figure 2 Take one display device 220 as an example.

[0078] The display device 220 can include a processor and a memory, and the display device 220 can be realized by the above-mentioned electronic device. When the display device 220 does not have a processor and a memory, such as a single display, the display can have an external smart device, such as a set-top box.

[0079] The display device 220 and the server 210 can transmit information through the Internet, so that the display device 220 can access the data on the server 210. The display device 220 and / or the server 210 can be realized by the electronic device 1.

[0080] The color analyzer 230 is configured to collect the output picture of the display device 220 when displaying the test image according to the collection instruction sent by the server 210, and perform color analysis on the output picture to obtain the color analysis data of the output picture.

[0081] Server 210 is also used to receive color analysis data returned by color analyzer 230, and generate tone mapping data corresponding to display device 220 based on the color analysis data and the target color data corresponding to the test image. The tone mapping data is used to characterize the mapping relationship between the original color values ​​and the corrected color values ​​of the test image. The corrected color values ​​are used to drive display device 220 to output an image that conforms to the target color data. The tone mapping data is used to correct the output image of display device 220.

[0082] The display device 220 correction scheme of this application embodiment can be deployed on server 210, on display device 220, or partially on server 210 and partially on display device 220. The choice can be made based on actual needs in a real-world scenario, and this embodiment does not impose any limitations.

[0083] When the correction scheme for display device 220 is deployed entirely or partially on server 210, the call interface can be opened to display device 220 to provide algorithm support for display device 220.

[0084] The method provided in this application embodiment can be implemented by electronic device 1 executing corresponding software code, and is achieved through data interaction with server 210. Electronic device 1 can be a local terminal device. When the method runs on server 210, it can be implemented and executed based on a cloud interaction system, which includes server 210 and client devices.

[0085] The output image correction method of this application embodiment can be applied to any field that requires image playback.

[0086] like Figure 3 The diagram shown illustrates the scene architecture of an output image correction system 200 provided in the application embodiment. The system mainly consists of a PC-based control console, a display device 220 application, and a color analyzer 230. The PC implements the functions of the aforementioned server.

[0087] PC version:

[0088] The color and brightness test data module uses a three-dimensional array to record the RGB color values ​​or brightness grayscale values ​​(grayscale values ​​are used when RGB values ​​are equal) required for the test data. These RGB color values ​​or grayscale values ​​can be expanded according to measurement accuracy requirements, increasing the amount of test image data. Alternatively, the same data or different datasets can be used for testing under different screen brightness conditions. The PC will then send this test data to the display device 220 for display.

[0089] In an embodiment, the test data, i.e., the test image, can be a test video corresponding to the color and brightness test data. The color and brightness test data can be generated in a video format and then sent to the display device 220 for playing and displaying, so as to test different display schemes of the display device 220.

[0090] The management module is configured to manage the sending of the test data, the video playing progress control, the data communication, the calling of the color analyzer 230, the generation of the tone mapping data, the sending of the tone mapping data, and the like.

[0091] The first communication module is configured to establish a connection with the display device 220, send instructions for color display, and control the progress, and the like.

[0092] The tone mapping data generation module is configured to generate the tone mapping data according to a preset algorithm.

[0093] The color analyzer 230 driving module is configured to call the color analyzer 230 to collect the chrominance and brightness and the like output by the display device 220.

[0094] The display device 220 includes:

[0095] The color and brightness display module is configured to display any RGB color on the screen. For example, the RGB color can be displayed on the screen through an openGL interface.

[0096] In an embodiment, the color and brightness display module can include a video playing module configured to play the test video or the test image sent by the PC and feed back the playing progress.

[0097] The second communication module is configured to support the connection with the PC, receive the instructions sent by the PC in real time, respond to the instructions, and feed back to the PC.

[0098] The tone mapping data refers to the description data of the tone and brightness that need to be adjusted. The tone mapping can be described in various ways, for example, the tone and brightness can be described through a LUT.

[0099] The tone mapping data using module is configured to apply the tone mapping data to complete the adjustment of the tone and brightness of the display device 220. The adjustment can be realized in a software form, such as through OpenGL, or through the interface interaction of the system layer to modify the display mapping of the system.

[0100] The color analyzer 230 is connected with the PC and can be driven by the PC. When the output picture of the display device 220 is collected, the color analyzer 230 can be aligned with the display picture of the display device 220 to realize fast collection of the color tone and brightness corresponding to the output color of the display device 220. The PC can directly read the color analysis data from the color analyzer 230 to realize automatic collection and feedback.

[0101] Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features in the embodiments can be combined with each other without conflict. In addition, the sequence of steps in each method embodiment is only an example and is not strictly limited.

[0102] Please refer to Figure 4 , which is an output picture correction method of an embodiment of the present application. The method can be executed by the electronic device 1 shown in Figure 1 , and can be applied to the application scenario of the output picture correction system shown in Figures 2-3 to automatically correct the effect of the display device according to the test image, so that the display device can output the target color, improve the stability of the output picture, and improve the display effect of the display device. In this embodiment, the PC is taken as an example of the execution end. The method includes the following steps.

[0103] Step 401: Send a test image to a target display device to instruct the target display device to display the test image.

[0104] In this step, the test image is image data used to test the display effect of the display device. The RGB color value or the brightness gray scale value (the gray scale value in the case of RGB equality) required in the test process can be recorded using a three-dimensional array. The RGB color value or the gray scale value here can be expanded according to the measurement accuracy requirement to increase the data amount of the test image. The same test data or different data sets can also be used for testing under different screen brightness conditions of the display device. The PC will distribute the data of these test images to the target display device for display. The target display device refers to the display device that is determined to be corrected for display effect, such as a television device that needs to be corrected. In the actual scenario, there can be multiple display devices connected with the PC. Each display device can correspond to different test images, and the picture correction is performed on different display devices in a targeted manner to improve the correction accuracy.

[0105] In an embodiment, step 401 can specifically include: if the target display device is loaded with a preset player, sending multiple pure color images of different colors to the target display device to instruct the preset player to play the multiple pure color images.

[0106] In the embodiment, the output picture correction function can be loaded on the target display device in the form of an application program, and the target display device can be controlled by a preset player to play a picture, so that the format of the test image of the PC terminal is flexible, and the test image can include a pure color image. Taking a television device as an example, assuming that the television device is loaded with a preset player, the PC terminal can be informed, and the PC terminal can distribute a plurality of pure color images prepared in advance to the television device as test images, and instruct the television device to play the pure color images on a full screen or a partial screen. The pure color image can display an output picture of the same color in a wide range, and is beneficial to collect more comprehensive output effects of the television device.

[0107] In an embodiment, the step 401 can specifically include: sending a preset video image to the target display device, to instruct the target display device to play the preset video image.

[0108] In the embodiment, the test data can also be directly converted into a preset video image to adapt to the playing format of the target display device, to facilitate the target display device to play smoothly. The preset video image is suitable for a scenario in which the target display device is loaded with a preset player, and therefore the test image can also include a video image. The preset video image is adapted to a video format that can be played by the target display device, to reduce the operation of installing the preset player by a user, and to improve user experience.

[0109] In an embodiment, the test image includes a first test image of different colors under the same brightness.

[0110] In the embodiment, for the chromaticity correction process of the display device, the target display device needs to display as many colors as possible at the same brightness, the richer the colors tested, the more accurate the correction result. Therefore, the first test image is used to represent the performance of different colors at the same brightness, and the PC sends a plurality of first test images to the target display device to instruct the target display device to play the plurality of first test images, so that the target display device can display as many colors as possible at the same brightness. The first test image can be expanded according to the measurement accuracy requirement. The first test image of different RGB colors can be sent to the display device in a matrix form to evaluate the output performance of each color value. For example, the first test image includes the original RGB value representing the color, and the first test image can be a 3*3 matrix, and the elements of the matrix are composed of the values of R, G and B, wherein the value range of R is (0-255), the value range of G is (0-255), and the value range of B is (0-255). According to a certain sampling ratio, corresponding values are extracted from the value range of R, G and B at a predetermined interval to form the elements of the color matrix. In this way, the first test image can represent colors in different color gamuts, and the output picture of the display device in different colors can be evaluated.

[0111] In an embodiment, the test image further includes a second test image of the same color at different brightness.

[0112] In the embodiment, the second test image is used for brightness correction of the target display device. For brightness correction, the output performance of the target display device for the same color at different screen brightness needs to be known. The finer the brightness level is divided, the richer the output brightness performance of the display device obtained by testing, and the more accurate the correction result is. In the actual scene, the PC can send a plurality of second test images of a single color at different brightness to the target display device to instruct the target display device to play the plurality of second test images for evaluating the brightness output performance.

[0113] In an embodiment, before step 401, further comprising: determining the current screen brightness of the target display device, and obtaining the test image corresponding to the target display device at the current screen brightness.

[0114] In the embodiment, the output picture correction process can be for the target display device at a specific screen brightness. Therefore, the PC can determine the current screen brightness of the target display device, and then obtain the test image corresponding to the target display device at the current screen brightness. In this way, the test image corresponds to the model of the display device and the current screen brightness, so that the output picture performance of the display device can be obtained more accurately, and the output picture can be corrected more accurately.

[0115] In an embodiment, the PC can issue a brightness adjustment instruction to the target display device to instruct the target display device to adjust the screen to a specified brightness, which is the current screen brightness. In this way, the PC can flexibly configure test images of different display devices under different screen brightnesses, thereby improving the automation and flexibility of the correction process.

[0116] Step 402: Obtain color analysis data of the output picture of the target display device when displaying the test image.

[0117] In this step, the target display device outputs a corresponding picture according to its own hardware resources during the playing of the test image. The output picture is limited by the hardware conditions of the target display device, and thus may differ from the original expected color effect of the test image, resulting in image distortion. Therefore, the output picture needs to be corrected. The correction process requires color analysis data of the output picture. The color analysis data is used to represent the performance of the output picture in the color space, and can include the chroma and brightness of the output picture.

[0118] For example, the test image is a red image, and the original RGB value of red is issued to the target display device. The target display device maps the original RGB value of red according to its original tone mapping curve, and the output picture is dark red. The color analysis data will include the chroma and corresponding brightness of the dark red output picture.

[0119] In an embodiment, step 402 can specifically include: sending a collection instruction to a preset color analyzer, the collection instruction being used to instruct the color analyzer to collect the output picture of the target display device when displaying the test image, so that the color analyzer obtains the color analysis data of the output picture. The color analysis data returned by the color analyzer is received.

[0120] In this embodiment, the color analysis data of the output picture can be obtained by a color analyzer. First, the color analyzer is aimed at the target display device. The PC issues a collection instruction to the color analyzer, instructing the color analyzer to collect the output picture during the display of the test image by the target display device, and analyze the corresponding color analysis data. The PC can directly read the color analysis data from the color analyzer, or the color analyzer can automatically return the color analysis data.

[0121] Step 403: Generate tone mapping data corresponding to the target display device according to the color analysis data and the target color data corresponding to the test image.

[0122] In this step, the tone mapping data is used to represent the mapping relationship between the original color value of the test image and the corrected color value, and the corrected color value is used to drive the target display device to output an image conforming to the target color data. The original color value is the color value possessed by the test image itself, which is the input color value of the target display device. Generally, the color data of the test image is stored in the original color value. Taking the RGB color space as an example, assuming that the target color data is color A, and the original color value of color A corresponding to the test image is (R0, G0, B0), and the corrected color value is (R1, G1, B1), which means that when the target display device is input with the corrected color value (R1, G1, B1), the target display device can make the output picture display as color A.

[0123] In actual scenarios, due to the hardware and software resources of the target display device, when the original color value (R0, G0, B0) of color A is directly input to the target display device, the target display device cannot accurately output color A, and there is often a color error, such as outputting a dark color A1. Therefore, it is necessary to correct it so that the target display device can accurately output color A. Then, the color analysis data of color A1 can be compared with the target color data of color A to determine the corresponding relationship between them, and then the corrected color value (R1, G1, B1) is determined, and the tone mapping data corresponding to the target display device is generated.

[0124] In an embodiment, step 403 can specifically include: determining the difference information between the color analysis data and the target color data. According to the difference information, the corrected color value for driving the target display device to output the target color data is determined. According to the mapping relationship between the original color value of the test image and the corrected color value, the tone mapping data corresponding to the target display device is generated.

[0125] In the embodiment, the color analysis data of the multiple test images can be drawn into a color curve, and the target color data can be a standard gamut, such as a P3 gamut of a CIE 1931 color space (a kind of wide gamut standard) as a standard gamut. The color curve of the output picture of the target display device is compared with the P3 gamut, and then the difference information between the two is determined, which is the difference information between the color analysis data and the target color data. Taking color A as an example, according to the difference information, the adjustment amount required for adjusting the original color value (R0, G0, B0) to the corrected color value (R1, G1, B1) when the target display device outputs color A can be determined, and the adjustment amount is the mapping relationship between the original color value (R0, G0, B0) and the corrected color value (R1, G1, B1) corresponding to color A. The above data statistics are performed for each color to be tested, and the tone mapping data corresponding to each color to be tested is obtained. In this way, by evaluating the difference between the output color of the display device and the target color, the mapping relationship between the original RGB value and the corrected RGB value is determined, and the tone mapping data corresponding to the display device is generated.

[0126] In an embodiment, the color analysis data includes the output chroma of the output picture. Step 303 can specifically include: determining the chroma difference information between the output chroma and the target chroma in the target color data. According to the chroma difference information, the corrected chroma value for driving the target display device to output the target chroma is determined. The mapping relationship between the original chroma value and the corrected chroma value of the test image is determined to obtain the chroma mapping data corresponding to the target display device, and the tone mapping data includes the chroma mapping data.

[0127] In the embodiment, for the chroma evaluation process of the display device, the color analysis data includes but is not limited to the output chroma of the output picture. The output chroma can be encoded by using a CIE LUV model. The LUV model is proposed by the International Commission on Illumination in 1976, and is obtained by a simple transformation of the CIE XYZ space, which has visual uniformity. The three variables of LUV represent the brightness (L) of the pixel, and the chroma represented by “U” and “V”. The target color data is the color data corresponding to the test image, and the target chroma is the chroma that the display device is expected to output for a specific test image, such as a standard chroma of a CIE 1931 color space as the target chroma. The average chroma difference ΔUV can be calculated as the chroma difference information according to the comparison between the UV value (output chroma) of the collected output picture color set (the color set includes multiple color nodes) and the standard UV value of the CIE 1931 color space. For example, ΔUV can be calculated by using the following formula:

[0128] ΔUV = sqrt(pow(U - standard_U, 2) + pow(V - standard_V, 2)) Equation (1)

[0129] Wherein, U represents the chroma U value of the collected target display device output picture, V represents the chroma V value of the collected target display device output picture, standard_U represents the standard U value of the CIE1931 color space, standard_V represents the standard V value of the CIE1931 color space. Sqrt() represents the square root calculation function, pow() represents the power function calculation.

[0130] In an embodiment, the chroma difference information represents the output color deviation degree of the target display device to the color node, and the color value correction can be performed on the color node with large color deviation when the color deviation is large, such as when ΔUV is greater than a preset threshold. The output chroma can be represented by the xyY value of the output picture of the target display device. The closest corrected xyY value to the target color data is estimated by using a preset algorithm based on the collected xyY value. The preset threshold can be set based on actual needs, such as 0.005. For example, the original chroma value of the target chroma B is (x0, y0, Y0), and the original chroma value is the input chroma value of the target display device when the target chroma is tested. It has a standard UV value corresponding to the CIE1931 color space. When the original chroma value (x0, y0, Y0) is input to the target display device, the output chroma of the output picture is dark, and the output chroma is (x', y', Y'). The chroma difference information ΔUV of the target display device to the output picture of the target chroma B is greater than 0.005, which indicates that the output color deviation of the target display device to the target chroma B is large and needs to be corrected. A preset algorithm can be used to iteratively estimate the chroma value (x1, y1, Y1) corresponding to the RGB value that can make the target display device output the closest target chroma B. The chroma value (x1, y1, Y1) is the corrected chroma value. In this way, the original chroma value and the corrected chroma value of each chroma with large output color deviation are calculated, and the mapping relationship between the original chroma value and the corrected chroma value is used to generate the correct chroma mapping data LUT corresponding to the target display device.

[0131] In an embodiment, the color analysis data includes output luminance of the output picture. Step 303 can further include: generating tone mapping data corresponding to the target display device according to the target color data corresponding to the test image according to the color analysis data, including: determining luminance difference information between the output luminance and target luminance in the target color data. According to the luminance difference information, determining the luminance information loss amount of the target display device. According to the luminance information loss amount, compensating the original luminance value corresponding to the output luminance to obtain a corrected luminance value. According to the mapping relationship between the original luminance value and the corrected luminance value of the test image, generating luminance mapping data corresponding to the target display device, and the tone mapping data includes the luminance mapping data.

[0132] In the embodiment, the original luminance value is the input luminance value of the target display device in the testing process of the target luminance. For the correction process of the luminance, the color analysis data includes but is not limited to the output luminance of the output picture. The luminance loss information of the display device can be determined according to the difference between the output luminance and the target luminance. The original luminance value of the current input is compensated based on the luminance loss information to obtain the input luminance value corresponding to the display of the target luminance as the corrected luminance value. The luminance mapping data is generated according to the mapping relationship between the original luminance value and the corrected luminance value of the test image. Here, the original luminance value refers to the input luminance value of the target display device in the testing process of the target luminance.

[0133] In an embodiment, it is assumed that the target luminance set to be tested includes a plurality of luminance nodes, each luminance node representing a luminance, and the color analysis data includes output luminance analysis data of the plurality of luminance nodes. Each luminance node in the target luminance set is corrected.

[0134] In an embodiment, for the data of a luminance node i, the input pixel value of the luminance node i can be included in the luminance node data. The input luminance value of the luminance node i is calculated by the following formula:

[0135] Yi = Kr * Ri + Kg * Kg * Gi + Kb * Bi Formula (2)

[0136] Wherein Yi is the input luminance value of the current luminance node i (that is, the original luminance value of the luminance node i), Ri is the R color value of the luminance node i, Gi is the G color value of the luminance node i, Bi is the B color value of the luminance node i, Kr is the coefficient corresponding to the Ri color value, Kg is the coefficient corresponding to the Gi color value, and Kb is the coefficient corresponding to the Bi color value, wherein Kr = 0.229, Kg = 0.6917, and Kb = 0.0793.

[0137] Then the output brightness value of the brightness node i is read from the color analysis data, so that the input and output brightness values of each brightness node of the target display device are obtained, and then the input and output brightness mapping curve of the target display device output picture is determined according to the input and output brightness values of each brightness node, the slope and compression factor of the curve are analyzed, and the contrast and performance of low brightness, medium gray and high brightness are determined.

[0138] As shown in Figure 5 , the linear domain brightness test is performed to show that the horizontal axis is the input brightness value of the target display device, the value range is (0, 10000) units of nit, it is assumed that the PQ curve defined by HDR10 (a kind of HDR encoding format, which refers to the protocol and standard for transmitting HDR content between television and video equipment) is the standard brightness curve, and the vertical axis is the output brightness value actually tested and collected on the target display device, the value range is (0, 10000), and the unit is nit, wherein the brightness nodes with brightness values of 0.04, 0.18, 0.53, 1.21, 2.43, 4.47, 7.76, 13, 21, 32, 50, 75, 113, 166, 244, 356, 516, 747, 1078, 1556, 2246, 3246, 4704, 6843, 10000 are the test objects.

[0139] The compression factor refers to the ratio between the output range and the input range of each brightness interval. It can be divided into low brightness, medium gray and high brightness. Low brightness refers to a brightness interval with low brightness, medium gray refers to a brightness interval with medium brightness, and high brightness refers to a brightness interval with high brightness. For example, one division method is to divide 0-0.005 (i.e. 0-50 nit) in the linear domain as the low brightness interval, 0.005-0.04 (i.e. 50-400 nit) as the medium gray interval, and 0.07 or above (i.e. 700 nit or above) as the high brightness interval. The ranges here are not fixed values, and similar methods can be used to extend or modify the intervals for evaluation.

[0140] Based on the current brightness mapping curve of the linear domain brightness test as shown in Figure 5 , the slope and compression factor of the curve are analyzed to determine the contrast and performance of low brightness, medium gray and high brightness. For each brightness node that needs to be corrected, the brightness information loss amount of the target display device is calculated according to the mapping value as shown in Figure 5 , and then the information loss of the brightness node is compensated respectively to obtain the final brightness mapping data. For example Figure 5If the input luminance value 0.04 nit is the same as the output luminance value 0.04 nit for a luminance node 1 (0.04, 0.04), it indicates that the target display device has no loss in output for the luminance node 1, i.e., the corresponding luminance information loss amount is 0, and the luminance node 1 can not be corrected, and the original input luminance value can be directly used as the corrected luminance value. If the input luminance value is different from the output luminance value for a luminance node 2, it indicates that the target display device has a loss in output for the luminance node 2, and the luminance information loss amount between the input luminance value and the output luminance value of the luminance node 2 is determined, and then the input luminance value (i.e., the original luminance value) is compensated to obtain a corrected luminance value, which can make the target display device output the target luminance corresponding to the luminance node 2 when the corrected luminance value is input into the target display device. The mapping relationship between the original luminance value and the corrected luminance value is determined based on this, and the LUT of the luminance mapping data corresponding to the target display device is generated.

[0141] In an embodiment, in the process of compensating the original luminance value corresponding to the output luminance, the amount of luminance value to be compensated can be determined according to the actual demand, and the compensation can be performed gradually to achieve a more practical output effect.

[0142] In an embodiment, the peak luminance actually displayed by the display device generally has certain limitations. If the value range of the current luminance mapping curve is relatively large, the luminance mapping curve can be adjusted according to the characteristics of the display device, and the luminance mapping curve can be adjusted according to the characteristics of the display device. Figure 5 For example, since the value range of the luminance curve defined by HDR10 is 0-10000 nits, the luminance range is large, and part of the luminance range in HDR10 can be adjusted, and the target luminance curve can be compressed. For example, the luminance performance of 0-1000 nits in HDR10 can be focused on, and the performance above 1000 nits can be weakened. In addition, if the peak luminance of the device is only 800, and the luminance exceeding 800 cannot be displayed, the target curve of 0-1000 nits can be multiplied by a certain coefficient, for example, multiplied by 0.8 as a reference curve, to correspond to the ability of the 800 nit device. The adjustment coefficient in the above example is only for illustration, and is not limited to this value. In actual scenarios, the luminance range to be corrected can be adjusted flexibly according to actual demands.

[0143] Step 404: correcting the output picture of the target display device by using the tone mapping data.

[0144] In this step, the corrected tone mapping data more accurately represents the mapping relationship between the input tone and the output tone of the target display device, so that the output picture of the target display device can be corrected based on the corrected tone mapping data, the effect of the display device is automatically corrected according to the test image, the target color can be output by the display device, the stability of the output picture is improved, and the display effect of the display device is improved.

[0145] In an embodiment, step 404 can specifically include: sending the tone mapping data to the target display device to instruct the target display device to play the image information to be processed according to the tone mapping data.

[0146] In this embodiment, the corrected tone mapping data LUT can be pushed to the display device end, so that the target display device plays the image information to be processed according to the corrected tone mapping data, improves the color effect of the image information playing picture, and improves the stability of the output picture of the display device.

[0147] The tone mapping data can also be stored on the server, and the display device can update the latest tone mapping data by displaying the device model to update the mapping data when needed.

[0148] The output picture correction method described above sends a test image to a target display device, analyzes the color of the output picture of the display device based on the test image, evaluates the relationship between the output color and the target color of the display device, determines the tone mapping relationship of the display device that can output the target color, generates tone mapping data corresponding to the display device, and corrects the display picture of the display device using the tone mapping data. In this way, the effect of the display device is automatically corrected according to the test image, the target color can be output by the display device, the stability of the output picture is improved, and the display effect of the display device is improved.

[0149] Specifically, by automatically using a color analyzer, the chrominance and luminance set of the display device are measured, and the measured data are evaluated and compared with the P3 color gamut of the CIE1931 color space in terms of chrominance, and compared with the PQ curve in terms of luminance, and the tone mapping image effect of the display device is evaluated by an algorithm. Based on the image effect evaluation result, the chrominance difference is evaluated, and the corrected LUT is used to adjust the chrominance. By evaluating the contrast of low brightness, middle gray, and high brightness of the luminance mapping curve, and comparing it with the standard PQ curve, the corresponding luminance mapping curve is automatically generated and sent to the display device for HDR image effect adjustment to achieve good playing effect.

[0150] As Figure 6As shown, the contrast before and after the output picture correction of the display device using the scheme of the embodiment of the present application is shown, it can be seen that the light and dark dynamic range of the output picture of the display device before correction is small, the picture tone is relatively dark, and some relatively dark tone information cannot be presented, resulting in loss of dark details, such as the subtitle "Huh." which cannot be presented in the output picture before correction. The light and dark dynamic range of the output picture after correction is relatively large, not only can relatively bright colors be presented, but also some relatively dark tone information can be presented, such as the subtitle "Huh." which can be clearly presented, improving the fidelity effect of the output picture.

[0151] In addition, the embodiment of the present application supports higher precision chroma test and luminance curve test by expanding the test data set. It supports adjusting the display brightness of the display device screen and performing the above evaluation and correction multiple times to achieve the purpose of optimizing the HDR playback effect under various screen brightnesses.

[0152] Please refer to Figure 7 which is an output picture correction method of an embodiment of the present application. The method can be executed by the electronic device 1 shown in Figure 1 and can be applied to the application scenario of the output picture correction system shown in Figures 2-3 to automatically correct the effect of the display device according to the test image, so that the display device can output target colors, improve the stability of the output picture, and improve the display effect of the display device. The present embodiment takes a PC terminal as an execution end as an example. Compared with the foregoing embodiment, the present embodiment takes the chroma correction of the output picture of the display device as an example. The method includes the following steps:

[0153] Step 701: Determine the current screen brightness of the target display device and obtain the test image corresponding to the target display device under the current screen brightness. For details, refer to the related description of step 401 in the foregoing embodiment.

[0154] Step 702: Send the test image to the target display device to instruct the target display device to display the test image. The test image includes a first test image of different colors under the same brightness. For details, refer to the related description of step 401 in the foregoing embodiment.

[0155] Step 703: Send a collection instruction to a preset color analyzer, the collection instruction being used to instruct the color analyzer to collect the output picture of the target display device when displaying the first test image, so that the color analyzer obtains the color analysis data of the output picture.

[0156] Step 704: Receive the color analysis data returned by the color analyzer. The color analysis data includes the output chroma of the output picture.

[0157] Step 705: determining chroma difference information between the output chroma and the target chroma in the target color data.

[0158] Step 706: determining a corrected chroma value for driving the target display device to output the target chroma according to the chroma difference information.

[0159] Step 707: determining a mapping relationship between the original chroma value and the corrected chroma value of the first test image, to obtain chroma mapping data corresponding to the target display device, and the tone mapping data includes the chroma mapping data.

[0160] Step 708: sending the chroma mapping data to the target display device, to instruct the target display device to play the image information to be processed according to the chroma mapping data.

[0161] The various steps of the output picture correction method of the embodiment can be referred to the related descriptions of the above-mentioned embodiments, which will not be repeated here.

[0162] Please refer to Figure 8 , which is an output picture correction method of an embodiment of the present application. The method can be executed by the electronic device 1 shown in Figure 1 , and can be applied to the application scenarios of the output picture correction system shown in Figures 2-3 , to automatically correct the effect of the display device according to the test image, so that the display device can output the target color, improve the stability of the output picture, and improve the display effect of the display device. The present embodiment takes the PC end as an example, and compared with the foregoing embodiments, the present embodiment takes the brightness correction of the display device output picture as an example. The method includes the following steps:

[0163] Step 801: determining the current screen brightness of the target display device, and obtaining the test image corresponding to the target display device under the current screen brightness.

[0164] Step 802: sending the test image to the target display device, to instruct the target display device to display the test image, and the test image includes a second test image of the same color under different brightness.

[0165] Step 803: sending a collection instruction to a preset color analyzer, the collection instruction being used to instruct the color analyzer to collect the output picture of the target display device when displaying the second test image, so that the color analyzer obtains color analysis data of the output picture.

[0166] Step 804: receiving the color analysis data returned by the color analyzer. The color analysis data includes the output brightness of the output picture.

[0167] Step 805: determining brightness difference information between the output brightness and the target brightness in the target color data.

[0168] Step 806: determining the luminance information loss amount of the target display device according to the luminance difference information.

[0169] Step 807: compensating the original luminance value corresponding to the output luminance according to the luminance information loss amount, to obtain a corrected luminance value.

[0170] Step 808: generating luminance mapping data corresponding to the target display device according to the mapping relationship between the original luminance value and the corrected luminance value of the second test image, and the tone mapping data includes the luminance mapping data.

[0171] Step 809: sending the luminance mapping data to the target display device, to instruct the target display device to play the image information to be processed according to the luminance mapping data.

[0172] The various steps of the output picture correction method of the embodiment can be referred to the related descriptions of the above embodiments, which will not be repeated here.

[0173] Please refer to Figure 9 , which is an image data processing method of an embodiment of the present application. The method can be executed by the electronic device 1 shown in Figure 1 , and can be applied to the application scenario of the output picture correction system shown in Figures 2-3 , to automatically correct the effect of the display device according to the test image, so that the display device can output the target color, improve the stability of the output picture, and improve the display effect of the display device. The embodiment takes the display device as an execution end for example, and the method includes the following steps:

[0174] Step 901: obtaining image data to be processed.

[0175] In this step, the image data to be processed is image data that needs to be played by the display device, such as video data, television programs, etc. specified by the user for playing.

[0176] Step 902: obtaining tone mapping data adapted to the target display device, and the tone mapping data is obtained by the method of any of the above embodiments.

[0177] In this step, the tone mapping data can include chrominance mapping data and luminance mapping data. The tone mapping data can be pushed to the display device by the PC end, or stored in the service end. When the display device needs to be used, the latest tone mapping data can be obtained by updating the mapping data through the display device model from the service end. For details, please refer to the related descriptions in the above embodiments.

[0178] Step 903: controlling the target display device to play the processed image data according to the tone mapping data.

[0179] In this step, the display device can apply the chroma mapping data and the luminance mapping data to modify the chroma and luminance of the image data to be processed, to obtain an output picture, and improve the color rendering effect of the output picture of the display device. Here, the tone mapping data can be used when software decoding the image data to be processed, for example, adjusting the corresponding chroma and luminance through OpenGL. It can also be used on the system side of the display device, for example, through a system interface or a system adjustment tool.

[0180] The various steps of the image data processing method of the embodiment can be referred to the related descriptions of the above embodiments, which will not be repeated here.

[0181] Please refer to Figure 10 , which is an interactive timing diagram of the output picture correction method of an embodiment of the present application. The method can be interactively executed by the PC side, the display device 220 and the color analyzer 230 in the output picture correction system shown in Figure 3 , to automatically correct the effect of the display device 220 according to the test image, so that the display device 220 can output the target color, improve the stability of the output picture, and improve the display effect of the display device 220. The embodiment takes the case where the test image is a solid color image as an example, and details the signaling interaction in the specific application scenario. The method includes the following steps:

[0182] Step S1: The PC side instructs the display device 220 to install a preset player application program for testing on the display device 220.

[0183] Step S2: The PC side starts a communication module server (service) and starts the preset player application program installed on the display device 220, instructs the display device 220 to adjust the current screen brightness, for example, to adjust the screen brightness to 50% of the maximum brightness, and transmits the IP (Internet Protocol) address to the display device 220.

[0184] Step S3: The display device 220 adjusts the current screen brightness to 50% of the maximum brightness, and sends a socket connection request to the PC side according to the received IP address, to establish a network connection with the PC side.

[0185] Step S4: The PC side sends an initialization instruction to the color analyzer 230, to initialize the color analyzer 230, so that the color analyzer 230 is aligned with the output picture of the display device 220, and the chroma and luminance values can be read from the color analyzer 230 in real time subsequently.

[0186] Step S5: The PC side iterates through the preset color and luminance test data (i.e., test image), and sequentially sends the RGB values corresponding to the color nodes in the LUT table to the display device 220.

[0187] Step S6: The display device 220 displays the corresponding color and gray scale on the screen according to the received RGB value of each color node.

[0188] Step S7: The display device 220 notifies the PC end that the test data has been displayed.

[0189] Step S8: The PC end reads the output chroma and output luminance of the display device 220 collected by the color analyzer 230 and records them.

[0190] Step S9: Steps S5-S8 are repeated, and the PC end obtains the output chroma and output luminance of the display device 220 for all color nodes.

[0191] Step S10: The PC end compares the output chroma UV value of the collected color node with the standard UV value of the CIE1931 color space, calculates the average ΔUV value for evaluation, and performs color correction based on the data of each color node.

[0192] For example, formula (1) can be used to calculate ΔUV. When the color deviation ΔUV of a color node is large, the xyY value corresponding to the similar RGB value is estimated by iteration using the collected xyY value, and the LUT of the correct RGB chroma mapping data is generated. For details, see the related description of step 403 in the foregoing embodiments.

[0193] Step S11: For luminance mapping, the PC end traverses the luminance data of the foregoing color nodes and performs luminance correction for each color node.

[0194] Specifically, for example, the input pixel value of color node i is taken out, and formula (2) is used to calculate the luminance component Yi as the input luminance value of color node i. Then the output luminance value of the luminance node i is read from the color analysis data, and then the input-output luminance mapping curve corresponding to the output picture of the target display device 220 can be determined according to the input luminance value and the output luminance value of each color node, the slope and compression factor of the curve are analyzed to determine the contrast and performance of low brightness, medium gray, and high brightness. The luminance information loss of each color node is calculated according to the mapping value in the curve by traversing the foregoing color nodes. The information loss of the color node is compensated to obtain the corrected luminance mapping data. For details, see the related description of step 403 in the foregoing embodiments.

[0195] Step S12: The PC end pushes the generated chroma mapping data LUT and luminance mapping data to the display device 220 end. The data can also be stored on the server, and the display device 220 can update the latest data by updating the display device 220 model from the server to complete the update of the mapping data.

[0196] Step S13: The display device 220 applies the chrominance mapping data and the luminance mapping data to modify the chrominance and luminance of the output picture. Here, the tone mapping data can be used when software decoding the image data to be processed, for example, adjusting the corresponding chrominance and luminance through OpenGL. It can also be used on the system side of the display device 220, for example, through the system interface, system adjustment tool.

[0197] After the entire adjustment process is completed, the screen brightness of the display device 220 can be adjusted, and then the test correction process of the above steps S3-S13 is performed in sequence to obtain the tone mapping data under the current screen brightness and apply it. After the display device 220 applies the corrected tone mapping data to adjust the output picture, the output picture can be evaluated again to confirm whether the effect meets the expectation, and secondary adjustment can also be supported.

[0198] In an embodiment, if the test image is a video image, the color analysis data collection process can replace the above steps S5-S9 with the following steps:

[0199] Step S51: The PC side iterates the corresponding test video, and downloads the test video to the display device 220 side, and specifies the device side to play to the specified progress position.

[0200] Step S61: The display device 220 plays the test video, performs playback display, and plays to the corresponding progress position according to the received playback progress position.

[0201] Step S71: The display device 220 notifies the PC side that the test video has been displayed.

[0202] Step S81: The PC side reads the output chrominance and output luminance of the display device 220 collected by the color analyzer 230, and records.

[0203] Step S91: Steps S51-S81 are looped to collect the output chrominance and output luminance of all color nodes corresponding to the test video.

[0204] The output picture correction method described above controls and generates tone mapping data by algorithm at the PC end, and respectively contains color and brightness. The PC end installs a preset player application to the display device 220 end, establishes a network connection, sequentially issues test data values to the display device 220 end, the display device 220 end displays the corresponding test data, and feeds back to the PC end. The PC end collects the chroma and brightness by the color analyzer 230 and records them down, then generates the final chroma mapping data and brightness mapping data according to the related algorithm, and exports them to the display device 220 end for application, so as to adjust the chroma and brightness of the output picture of the display device 220, and improve the output picture stability of the display device 220. The effect of automatically evaluating the HDR video playback is realized, and based on the test data, the tone mapping data is directly and efficiently generated and applied to the display device 220 such as a mobile phone, so as to achieve the purpose of optimizing the HDR video playback effect.

[0205] In addition, the embodiment also supports data testing under different screen brightness percentages of the display device 220. When the brightness mapping data is applied, different mapping data is used according to the current screen brightness state, so as to achieve a better correction effect. The whole correction process can directly evaluate the color and brightness mapping according to the formula based on the original test data, and is more objective. The tone mapping can be directly completed on the display device 220, including the adjustment of chroma and brightness, and does not depend on the video content. The tone mapping data precision is adjustable and supports updating. The display device 220 is quickly evaluated and adjusted, and the effect is quickly viewed.

[0206] The steps of the output picture correction method described above can be referred to the related description of the above embodiment, which will not be repeated here.

[0207] Please refer to Figure 11 which is an output picture correction device 1100 of an embodiment of the present application. The device can be applied to Figure 1 the electronic device 1 shown in the figure, and can be applied to Figures 2-3 the application scenario of the output picture correction system shown in the figure, so as to automatically correct the display device according to the test image, so that the display device can output the target color, improve the stability of the output picture, and improve the display effect of the display device. The device comprises a sending module 1101, an acquisition module 1102, a generation module 1103 and a correction module 1104, and the functions and principles of each module are as follows:

[0208] The sending module 1101 is configured to send a test image to a target display device to instruct the target display device to display the test image.

[0209] The acquisition module 1102 is configured to acquire color analysis data of an output picture of the target display device when displaying the test image.

[0210] The generating module 1103 is configured to generate tone mapping data corresponding to the target display device according to the target color data corresponding to the color analysis data and the test image, the tone mapping data being used to represent a mapping relationship between original color values of the test image and corrected color values, the corrected color values being used to drive the target display device to output an image conforming to the target color data.

[0211] The correcting module 1104 is configured to correct the output picture of the target display device by using the tone mapping data.

[0212] In an embodiment, the test image includes a pure color image. The sending module 1101 is configured to send a plurality of pure color images of different colors to the target display device to instruct a preset player of the target display device to play the plurality of pure color images, if the target display device is loaded with the preset player.

[0213] In an embodiment, the test image includes a video image. The sending module 1101 is configured to send a preset video image to the target display device to instruct the target display device to play the preset video image.

[0214] In an embodiment, the test image includes a first test image of different colors at the same brightness and / or a second test image of the same color at different brightnesses.

[0215] In an embodiment, the acquiring module 1102 is configured to send a collection instruction to a preset color analyzer, the collection instruction being used to instruct the color analyzer to collect an output picture of the target display device when displaying the test image, so that the color analyzer obtains color analysis data of the output picture. The color analysis data returned by the color analyzer is received.

[0216] In an embodiment, the generating module 1103 is configured to determine difference information between the color analysis data and the target color data. According to the difference information, a corrected color value used to drive the target display device to output the target color data is determined. The tone mapping data corresponding to the target display device is generated according to a mapping relationship between the original color values of the test image and the corrected color values.

[0217] In an embodiment, the color analysis data includes an output chroma of the output picture. The generating module 1103 is configured to determine chroma difference information between a target chroma in the target color data and the output chroma. According to the chroma difference information, a corrected chroma value used to drive the target display device to output the target chroma is determined. A mapping relationship between an original chroma value of the test image and the corrected chroma value is determined to obtain chroma mapping data corresponding to the target display device, and the tone mapping data includes the chroma mapping data.

[0218] In an embodiment, the color analysis data includes an output luminance of the output picture. The generating module 1103 is configured to determine luminance difference information between the output luminance and a target luminance in the target color data. According to the luminance difference information, the amount of luminance information loss of the target display device is determined. According to the amount of luminance information loss, the original luminance value corresponding to the output luminance is compensated to obtain a corrected luminance value. According to the mapping relationship between the original luminance value and the corrected luminance value of the test image, the luminance mapping data corresponding to the target display device is generated, and the tone mapping data includes the luminance mapping data.

[0219] In an embodiment, the correcting module 1104 is configured to send the tone mapping data to the target display device to instruct the target display device to play the image information to be processed according to the tone mapping data.

[0220] In an embodiment, the method further includes: a determining module configured to determine the current screen luminance of the target display device before sending the test image to the target display device, and obtain the test image corresponding to the target display device under the current screen luminance.

[0221] The detailed description of the output picture correcting apparatus 1100 is described above in the description of the related method steps in the embodiments, and the implementation principle and technical effects are similar, which will not be described here in detail.

[0222] Figure 12 A structural schematic diagram of a cloud device 120 is provided for the exemplary embodiments of the present application. The cloud device 120 can be used to run the method provided in any of the above embodiments. As shown in the figure, the cloud device 120 can include a memory 1204 and at least one processor 1205, Figure 12 The processor 1205 can be a central processing unit (CPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or another digital or analog circuitry as Figure 12 In an embodiment, the processor 1205 is taken as an example.

[0223] The memory 1204 is configured to store computer programs and can be configured to store various data to support the operation on the cloud device 120. The memory 1204 can be an object storage (OSS).

[0224] The memory 1204 can be realized by any type of volatile or non-volatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0225] The processor 1205 is coupled with the memory 1204 and configured to execute computer programs in the memory 1204 to implement the solutions provided by any of the above method embodiments, and the specific functions and technical effects that can be achieved are not repeated here.

[0226] Further, as Figure 12 The cloud device further includes a firewall 1201, a load balancer 1202, a communication component 1206, a power supply component 1203, and other components. Figure 12 Some components are only schematically shown in the figure, and it does not mean that the cloud device only includes Figure 12 the components shown in the figure.

[0227] In an embodiment, the communication component 1206 in the above Figure 12 is configured to facilitate wired or wireless communication between the device where the communication component 1206 is located and other devices. The device where the communication component 1206 is located can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, LTE (Long Term Evolution, short for LTE), 5G, or the like mobile communication network, or a combination thereof. In an example embodiment, the communication component 1206 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an example embodiment, the communication component 1206 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0228] In an embodiment, the power supply component 1203 in the above Figure 12 provides power for various components of the device where the power supply component 1203 is located. The power supply component 1203 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device where the power supply component is located.

[0229] The embodiments of the present application also provide a computer readable storage medium, which stores computer execution instructions, and when the processor executes the computer execution instructions, the method of any of the above embodiments is implemented.

[0230] The embodiment of the present application further provides a computer program product comprising a computer program which, when executed by a processor, implements the method of any of the preceding embodiments.

[0231] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other manners. For example, the embodiments of the device described above are merely schematic, and the division of the modules is merely a logical function division, and there can be another division manner in actual implementation. For example, a plurality of modules or features can be combined or integrated into another system, or some features can be ignored or not executed.

[0232] The integrated module implemented in the form of a software functional module can be stored in a computer readable storage medium. The software functional module stored in the storage medium includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the methods of the embodiments of the present application.

[0233] It should be understood that the processor can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), or the like. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the methods disclosed in the present application can be directly embodied as the execution of the hardware processor, or the combination of hardware and software modules in the processor. The memory can include a high-speed RAM (Random Access Memory, RAM) memory, and can also include a nonvolatile memory NVM (Nonvolatile memory, NVM), such as at least one disk memory, and can also be a U disk, a mobile hard disk, a read-only memory, a disk or an optical disk, etc.

[0234] The aforementioned storage medium can be realized by any type of volatile or nonvolatile storage devices or a combination thereof, such as a Static Random-Access Memory (SRAM), an Electrically Erasable Programmable read only memory (EEPROM), an Erasable Programmable Read-Only Memory (EPROM), a Programmable read-only memory (PROM), a Read-Only Memory (ROM), a magnetic storage, a flash memory, a magnetic disk or an optical disk. The storage medium can be any available medium that can be accessed by a general or special purpose computer.

[0235] An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. Of course, the storage medium can be a part of the processor. The processor and the storage medium can be located in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the storage medium can exist as discrete components in the electronic device or the host device.

[0236] It should be noted that, in the present document, the terms "comprising", "containing" or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or apparatus that comprises a list of elements does not include only those elements, but can also include other elements not expressly listed or inherent to such process, method, article or apparatus. Without more limitations, an element defined by the phrase "comprising a" does not exclude the existence of additional identical elements in the process, method, article or apparatus that includes the element.

[0237] The above-mentioned sequence numbers of the embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0238] Through the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned example method can be realized by means of software and a necessary general hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product in essence or in the form of a contribution to the prior art. The computer software product is stored in a storage medium (such as a ROM / RAM, a magnetic disk, an optical disk), and includes a plurality of instructions for causing a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the method of each embodiment of the present application.

[0239] In the technical solutions of the present application, the collection, storage, use, processing, transmission, provision and disclosure of user data and other information involved in the processing comply with the relevant legal regulations and do not violate public order and good customs.

[0240] The above is only a preferred embodiment of the present application, and does not limit the patent scope of the present application, and any equivalent structure or equivalent process transformation using the content of the specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. An output picture correction method, characterized by, The method comprises: determining the current screen brightness of a target display device, and obtaining a test image corresponding to the target display device under the current screen brightness; sending the test image to the target display device to instruct the target display device to display the test image; obtaining color analysis data of an output picture of the target display device when displaying the test image; generating tone mapping data corresponding to the target display device according to target color data corresponding to the color analysis data and the test image; the tone mapping data is used to represent a mapping relationship between original color values of the test image and corrected color values; the corrected color values are used to drive the target display device to output an image meeting the target color data; the test image comprises a first test image of different colors under the same brightness and / or a second test image of the same color under different brightness; the first test image is represented in a matrix form, and elements of the matrix are composed of corresponding values extracted from the value ranges of R, G and B according to a certain sampling ratio and every interval of a preset value; the value range of R is (0~255), the value range of G is (0~255), and the value range of B is (0~255); correcting the output picture of the target display device by using the tone mapping data; the color analysis data comprises output chroma of the output picture; the generation of the tone mapping data corresponding to the target display device according to the target color data corresponding to the color analysis data and the test image comprises: determining chroma difference information between the output chroma and target chroma in the target color data; determining corrected chroma values for driving the target display device to output the target chroma according to the chroma difference information; determining a mapping relationship between original chroma values of the test image and the corrected chroma values to obtain chroma mapping data corresponding to the target display device; the tone mapping data comprises the chroma mapping data; the color analysis data comprises output brightness of the output picture; the generation of the tone mapping data corresponding to the target display device according to the target color data corresponding to the color analysis data and the test image comprises: determining brightness difference information between the output brightness and target brightness in the target color data; determining a brightness information loss amount of the target display device according to the brightness difference information; compensating original brightness values corresponding to the output brightness according to the brightness information loss amount to obtain corrected brightness values; generating brightness mapping data corresponding to the target display device according to a mapping relationship between the original brightness values of the test image and the corrected brightness values; the tone mapping data comprises the brightness mapping data.

2. The method of claim 1, wherein, the obtaining of the color analysis data of the output picture of the target display device when displaying the test image comprises: sending a collection instruction to a preset color analyzer, the collection instruction being used to instruct the color analyzer to collect an output picture of the target display device when displaying the test image, so that the color analyzer obtains color analysis data of the output picture; receiving the color analysis data returned by the color analyzer.

3. The method of claim 1, wherein, generating tone mapping data corresponding to the target display device according to target color data corresponding to the color analysis data and the test image, including: determining difference information between the color analysis data and the target color data; determining corrected color values for driving the target display device to output the target color data according to the difference information; generating tone mapping data corresponding to the target display device according to a mapping relationship between original color values of the test image and the corrected color values.

4. An image data processing method characterized by, including: obtaining image data to be processed; obtaining tone mapping data adapted to a target display device, the tone mapping data being obtained by the method of any one of claims 1-3; controlling the target display device to play the processed image data according to the tone mapping data.

5. An output picture correction system characterized by comprising: including: a server, a color analyzer and a display device, the display device being within the collection range of the color analyzer; wherein: the server is configured to determine a current screen brightness of a target display device, obtain a test image corresponding to the target display device under the current screen brightness, and send the test image to the display device; the test image includes a first test image of different colors under the same brightness and / or a second test image of the same color under different brightness; the first test image is represented in a matrix form, and the elements of the matrix are composed of corresponding values extracted from the value ranges of R, G and B at a certain sampling ratio and every interval of a preset value; the value range of R is (0-255), the value range of G is (0-255), and the value range of B is (0-255); the display device is configured to display the test image; the color analyzer is configured to collect an output picture of the display device when displaying the test image according to a collection instruction sent by the server, and perform color analysis on the output picture to obtain color analysis data of the output picture; the server is further configured to receive the color analysis data returned by the color analyzer, and generate tone mapping data corresponding to the display device according to target color data corresponding to the color analysis data and the test image; the tone mapping data is used to represent a mapping relationship between original color values of the test image and corrected color values; the corrected color values are used to drive the display device to output an image conforming to the target color data; and the output picture of the display device is corrected by using the tone mapping data; the color analysis data includes output chroma of the output picture; and the server is further configured to: determine chroma difference information between the output chroma and target chroma in the target color data; According to the chrominance difference information, a corrected chrominance value for driving the target display device to output the target chrominance is determined; A mapping relationship between the original chrominance value of the test image and the corrected chrominance value is determined to obtain chrominance mapping data corresponding to the target display device, wherein the tone mapping data includes the chrominance mapping data; The color analysis data includes output luminance of the output picture; the server further comprises: determining luminance difference information between the output luminance and target luminance in the target color data; According to the luminance difference information, determining the luminance information loss amount of the target display device; According to the luminance information loss amount, compensating the original luminance value corresponding to the output luminance to obtain a corrected luminance value; According to the mapping relationship between the original luminance value of the test image and the corrected luminance value, generating luminance mapping data corresponding to the target display device, wherein the tone mapping data includes the luminance mapping data.

6. An electronic device, comprising: comprise: at least one processor; and a memory connected in communication with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to cause the electronic device to perform the method of any one of claims 1-4.

7. A cloud device, characterized by comprise: at least one processor; and a memory connected in communication with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to cause the electronic device to perform the method of any one of claims 1-4.

8. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer executable instructions, and when the processor executes the computer executable instructions, the method of any one of claims 1-4 is realized.

Images