A method, related apparatus, device, and storage medium for color correction.
By using a memory card to acquire sampled video footage in offline scenarios and generating a target lookup table, the latency problem in LED display color calibration was solved, achieving efficient and robust color calibration results.
Patent Information
- Application Number
- CN202211193106.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-28
- Publication Date
- 2025-11-14
- Estimated Expiration
- 2042-09-28
AI Technical Summary
In existing LED display color correction solutions, the use of SDI signals to transmit images results in latency issues, leading to low system robustness.
In offline scenarios, sampled video footage is acquired via a memory card, a target lookup table is generated, and an image acquisition device is electrically connected to the target display screen via a synchronous phase-locked Genlock signal generator to generate a more accurate target lookup table for color correction.
It achieves stable and efficient color correction in offline scenarios, generates a more accurate target lookup table, and improves the color correction effect.
Smart Images

Figure CN116546176B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the fields of virtual production technology and display technology, and in particular to a color correction method, related apparatus, device and storage medium. Background Technology
[0002] In recent years, light-emitting diode (LED) displays have become increasingly popular due to their energy-saving, environmentally friendly, and high-efficiency advantages. However, due to LED degradation and changes in environmental factors such as temperature, LED displays can experience color decay, leading to increasingly larger color deviations over time. Therefore, the necessity of color calibration for LED displays is becoming increasingly prominent.
[0003] In the relevant color calibration scheme, firstly, sampling points from the standard color map are projected onto the LED display screen one by one online. Then, the color blocks displayed on the LED display screen are photographed using a camera. Finally, a look-up table (LUT) is constructed based on the sampled color blocks and the standard color map. The LUT can then be used to calibrate the color of the LED display screen.
[0004] After the camera captures the color blocks displayed on the LED screen, it needs to transmit the corresponding image to the terminal device via a serial digital interface (SDI) signal. However, the inventors discovered that the current solution has at least the following problems: using SDI signals to transmit the image introduces a delay, requiring a significant amount of time to match the delay, resulting in low system robustness. Summary of the Invention
[0005] This application provides a method, related apparatus, device, and storage medium for color correction. On one hand, shooting and sampling video footage in offline scenarios eliminates latency issues, resulting in greater stability, efficiency, and robustness. On the other hand, the memory card supports higher-precision data storage, which improves the color correction effect.
[0006] In view of this, this application provides a color correction method, comprising:
[0007] Obtain the original source video, which includes multiple original video frames. Each original video frame includes at least one color patch, and each color patch in the original video frame corresponds to an original code value in a standard color map.
[0008] Control the target display screen to play the original source video;
[0009] The material sampling video is obtained by the memory card from the image acquisition device. The material sampling video is the original material video captured by the image acquisition device and displayed on the target display screen. The material sampling video includes multiple sampling video frames. Each sampling video frame includes at least one color block. Each color block in the sampling video frame corresponds to a sampling code value in the display color.
[0010] Based on the original source video and the sampled source video, a target lookup table is generated. The target lookup table is used to reflect the mapping relationship between the display colors of the target display screen and the standard color map.
[0011] Based on the target lookup table, perform color correction on the image data to be displayed on the target screen.
[0012] This application also provides a color correction method, including:
[0013] Obtain a standard color map, which includes T sampling points, each sampling point corresponding to a raw code value in the standard color map, where T is an integer greater than 1;
[0014] Based on the original code value corresponding to each sampling point, the target display screen is controlled to play multiple color block images. Each color block image displays K color blocks, and each color block in the color block image corresponds to a sampling code value in the displayed color. K is an integer greater than 1.
[0015] Multiple target sampling images are acquired by an image acquisition device. The image acquisition device and the target display screen are electrically connected to a synchronous phase-locked Genlock signal generator. The Genlock signal generator is used to lock the image acquisition device and the target display screen at the same frequency.
[0016] Based on multiple target sampling images and multiple color block images, a target lookup table is generated. The target lookup table is used to reflect the mapping relationship between the display colors of the target display screen and the standard color map.
[0017] Based on the target lookup table, perform color correction on the image data to be displayed on the target screen.
[0018] This application also provides a color correction device, comprising:
[0019] The acquisition module is used to acquire the original source video, which includes multiple original video frames, each original video frame includes at least one color block, and each color block in the original video frame corresponds to an original code value in a standard color map.
[0020] The control module is used to control the target display screen to play the original source video.
[0021] The acquisition module is also used to acquire the material sampling video captured by the image acquisition device through the memory card. The material sampling video is obtained by the image acquisition device capturing the original material video displayed on the target display screen. The material sampling video includes multiple sampling video frames, each sampling video frame includes at least one color block, and each color block in the sampling video frame corresponds to a sampling code value in the display color.
[0022] The generation module is used to generate a target lookup table based on the original source video and the sampled source video. The target lookup table is used to reflect the mapping relationship between the display colors of the target display screen and the standard color map.
[0023] The calibration module is used to perform color calibration on the image data to be displayed on the target display screen according to the target lookup table.
[0024] In one possible design, in another implementation of another aspect of the embodiments of this application,
[0025] The acquisition module is specifically used to acquire a standard color map, which includes T sampling points, each sampling point corresponding to a raw code value in the standard color map, where T is an integer greater than 1;
[0026] Based on the original code value corresponding to each sampling point in the standard color map, T color blocks are generated, where each color block has a one-to-one correspondence with each sampling point;
[0027] For each color block, generate the corresponding original video frame;
[0028] The original source video is generated based on the original video frame corresponding to each color block.
[0029] In one possible design, in another implementation of another aspect of the embodiments of this application,
[0030] The acquisition module is specifically used to acquire a standard color map, which includes T sampling points, each sampling point corresponding to a raw code value in the standard color map, where T is an integer greater than 1;
[0031] Based on the original code value corresponding to each sampling point in the standard color map, T color blocks are generated, where each color block has a one-to-one correspondence with each sampling point;
[0032] Divide the T color blocks into at least two color block groups, where each color block group includes K color blocks, and the K sampling points corresponding to the K color blocks are adjacent in the standard color map, where K is an integer greater than 1;
[0033] For each color patch group, generate the corresponding original video frame for each color patch group;
[0034] The original source video is generated based on the original video frames corresponding to each color block group.
[0035] In one possible design, in another implementation of another aspect of the embodiments of this application,
[0036] The generation module is also used to generate T identification information based on each sampling point in the standard color map, wherein the identification information in the T identification information is used to identify the sampling point;
[0037] The generation module is also used to generate target recognition information corresponding to each color block group based on T recognition information.
[0038] The acquisition module is specifically used to generate the original video frame corresponding to each color block group and its corresponding target recognition information.
[0039] In one possible design, in another implementation of another aspect of the embodiments of this application,
[0040] The acquisition module is also used to generate a target lookup table based on the original source video and the sampled source video, and then obtain the color palette corresponding to the target color gamut. The color palette includes N sampled color blocks, each of which corresponds to a standard code value, where N is an integer greater than 1.
[0041] The control module is also used to control the target display screen to play N source color block images according to the standard code value corresponding to each sampled color block;
[0042] The acquisition module is also used to acquire N sampled color block images captured by the image acquisition device, wherein the N sampled color block images are obtained by the image acquisition device capturing N material color block images displayed on the target display screen;
[0043] The acquisition module is also used to determine the color deviation value based on N sampled color block images and N source color block images;
[0044] The correction module is also used to perform a step of color correction on the image data to be displayed on the target display screen according to the target lookup table if the color deviation value is less than or equal to the deviation value threshold.
[0045] In one possible design, in another implementation of another aspect of the embodiments of this application,
[0046] The acquisition module is specifically used to construct N sets of comparison images based on N sampled color block images and N source color block images. Each set of comparison images includes sampled color block images and source color block images with corresponding relationships.
[0047] For each of the N sets of comparison images, obtain the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image. The sampled color coordinates are obtained by converting the sampled code value of the sampled color block image, and the standard color coordinates are obtained by converting the standard code value.
[0048] For each of the N sets of comparison images, the target deviation value is calculated based on the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image.
[0049] The color deviation value is determined based on the target deviation value of each of the N sets of comparison images.
[0050] In one possible design, in another implementation of another aspect of the embodiments of this application,
[0051] The generation module is also used to generate N identification information based on each sampled color block, wherein the identification information in the N identification information is used to identify the sampled color block;
[0052] The control module is specifically used to control the target display screen to play N material color block images and N recognition information based on the standard code value corresponding to each sampled color block and the corresponding recognition information.
[0053] In one possible design, in another implementation of another aspect of the embodiments of this application,
[0054] The acquisition module is also used to acquire the standard code values corresponding to the M sampled extreme value color blocks, where M is an integer greater than or equal to 1;
[0055] The control module is also used to control the target display screen to play M material color block images according to the standard code value corresponding to each sample extreme value color block;
[0056] The acquisition module is also used to acquire M sample color block images captured by the image acquisition device, wherein the M sample color block images are obtained by the image acquisition device capturing M material color block images displayed on the target display screen;
[0057] The acquisition module is specifically used to determine the color deviation value based on N sampled color block images, M sampled color block images, N source color block images, and M source color block images.
[0058] In one possible design, in another implementation of another aspect of the embodiments of this application,
[0059] The acquisition module is specifically used to construct (N+M) sets of comparison images based on N sampled color block images, M sampled color block images, N source color block images, and M source color block images. Each set of comparison images includes sampled color block images and source color block images with corresponding relationships.
[0060] For each group of comparison images in the (N+M) groups of comparison images, obtain the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image. The sampled color coordinates are obtained by converting the sampled code value of the sampled color block image, and the standard color coordinates are obtained by converting the standard code value.
[0061] For each of the (N+M) sets of comparison images, the target deviation value is calculated based on the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image.
[0062] The color deviation value is determined based on the target deviation value of each group of comparison images in the (N+M) groups of comparison images.
[0063] In one possible design, in another implementation of another aspect of the embodiments of this application,
[0064] The generation module is also used to generate M identification information based on the standard code value corresponding to each sample extreme value color block, wherein the identification information in the M identification information is used to identify the standard code value;
[0065] The control module is specifically used to control the target display screen to play M material color block images and M recognition information based on the standard code value corresponding to each sample extreme value color block and the corresponding recognition information.
[0066] In one possible design, in another implementation of another aspect of the embodiments of this application, the color correction device further includes an update module;
[0067] The control module is also used to control the target display screen to play multiple color block images according to the original code value corresponding to each sampling point in the standard color map if the color deviation value is greater than the deviation value threshold. Each color block image displays at least one color block.
[0068] The acquisition module is also used to acquire multiple target sampling images captured by the image acquisition device. The image acquisition device and the target display screen are electrically connected to the synchronous phase-locked Genlock signal generator, which is used to lock the image acquisition device and the target display screen at the same frequency.
[0069] The update module is used to update the target lookup table based on multiple target sample images and multiple color block images.
[0070] In one possible design, in another implementation of another aspect of the embodiments of this application, the color correction device further includes an output module;
[0071] The output module is used to output a color calibration report, which includes at least one of the following: a first color deviation value, a second color deviation value, the improvement in color calibration effect, the estimated position of the white point, the color gamut estimation result, the gamma correction diagram, and the lookup table transformation diagram.
[0072] The first color deviation value represents the color deviation value before color calibration;
[0073] The second color deviation value represents the color deviation value after color calibration.
[0074] The improvement in color calibration effect indicates the degree of change in color deviation value between before and after color calibration.
[0075] The estimated position of the white dot represents the color coordinates corresponding to the white dot;
[0076] The color gamut estimation result represents the estimated color gamut size before and after color calibration, as well as the comparison result between the color gamut before and after color calibration and the standard color map space;
[0077] The gamma correction chart represents a simulation of the gamma curve of the target display screen before and after color calibration.
[0078] The lookup table transformation diagram represents a color direction change diagram presented in three dimensions.
[0079] This application also provides a color correction device, comprising:
[0080] The acquisition module is used to acquire a standard color map, which includes T sampling points, each sampling point corresponding to a raw code value in the standard color map, where T is an integer greater than 1;
[0081] The control module is used to control the target display screen to play multiple color block images according to the original code value corresponding to each sampling point. Each color block image displays K color blocks, and each color block in the color block image corresponds to a sampling code value in the displayed color. K is an integer greater than 1.
[0082] The acquisition module is also used to acquire multiple target sampling images captured by the image acquisition device. The image acquisition device and the target display screen are electrically connected to the synchronous phase-locked Genlock signal generator, which is used to lock the image acquisition device and the target display screen at the same frequency.
[0083] The generation module is used to generate a target lookup table based on multiple target sample images and multiple color block images. The target lookup table is used to reflect the mapping relationship between the display colors of the target display screen and the standard color map.
[0084] The calibration module is used to perform color calibration on the image data to be displayed on the target display screen according to the target lookup table.
[0085] In one possible design, in another implementation of another aspect of the embodiments of this application, the color correction device further includes an update module;
[0086] The acquisition module is also used to generate a target lookup table based on multiple target sampled images and multiple color block images, and then obtain the color palette corresponding to the target color gamut. The color palette includes N sampled color blocks, each sampled color block corresponds to a standard code value, and N is an integer greater than 1.
[0087] The control module is also used to control the target display screen to play N source color block images according to the standard code value corresponding to each sampled color block;
[0088] The acquisition module is also used to acquire N sampled color block images captured by the image acquisition device, wherein the N sampled color block images are obtained by the image acquisition device capturing N material color block images displayed on the target display screen;
[0089] The acquisition module is also used to determine the color deviation value based on N sampled color block images and N source color block images;
[0090] The update module is used to update the target lookup table if the color deviation value is greater than the deviation value threshold.
[0091] In one possible design, in another implementation of another aspect of the embodiments of this application, the color correction device further includes an output module;
[0092] The output module is used to output a color calibration report, which includes at least one of the following: lookup table iteration count, first color deviation value, second color deviation value, color calibration effect improvement, white point estimation position, color gamut estimation result, gamma correction diagram, and lookup table transformation diagram.
[0093] The lookup table iteration count indicates the number of times the target lookup table is updated;
[0094] The first color deviation value represents the color deviation value before color calibration;
[0095] The second color deviation value represents the color deviation value after color calibration.
[0096] The improvement in color calibration effect indicates the degree of change in color deviation value between before and after color calibration.
[0097] The estimated position of the white dot represents the color coordinates corresponding to the white dot;
[0098] The color gamut estimation result represents the estimated color gamut size before and after color calibration, as well as the comparison result between the color gamut before and after color calibration and the standard color map space;
[0099] The gamma correction chart represents a simulation of the gamma curve of the target display screen before and after color calibration.
[0100] The lookup table transformation diagram represents a color direction change diagram presented in three dimensions.
[0101] In another aspect, this application provides a computer device including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the methods described above.
[0102] Another aspect of this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the methods described above.
[0103] Another aspect of this application provides a computer program product, including a computer program that, when executed by a processor, implements the methods described above.
[0104] As can be seen from the above technical solutions, the embodiments of this application have the following advantages:
[0105] This application provides a method for color correction. A terminal device pre-generates an original source video, which is then played on a target display screen by the terminal device. Simultaneously, an image acquisition device records the original source video played on the target display screen, thus obtaining a sampled source video. The sampled source video is stored on a memory card. The terminal device imports the sampled source video into the memory card and generates a target LUT based on the sampled source video and the original source video for color correction on the target display screen. This method supports the use of a memory card to transmit sampled source videos in offline scenarios. On one hand, shooting sampled source videos offline does not involve latency issues, thus it is more stable and efficient, and has higher robustness. On the other hand, the memory card supports storing data with higher precision, therefore, it can generate a more precise target LUT, which is beneficial for improving the color correction effect. Attached Figure Description
[0106] Figure 1 This is a schematic diagram of an implementation environment for the color correction method in this application.
[0107] Figure 2 This is a schematic diagram of a standard color map in an embodiment of this application;
[0108] Figure 3 This is a flowchart illustrating the color correction method in an embodiment of this application;
[0109] Figure 4 This is a schematic diagram comparing the original code value and the sampled code value in an embodiment of this application;
[0110] Figure 5 This is a schematic diagram illustrating the generation of a target LUT based on online or offline sampling in an embodiment of this application;
[0111] Figure 6 This is a schematic diagram illustrating the generation of an original video frame based on a single color block in an embodiment of this application;
[0112] Figure 7 This is a schematic diagram of generating an original video frame based on multiple color blocks in an embodiment of this application;
[0113] Figure 8 This is another schematic diagram illustrating the generation of original video frames based on multiple color blocks in an embodiment of this application;
[0114] Figure 9 This is another schematic diagram illustrating the generation of original video frames based on multiple color blocks in an embodiment of this application;
[0115] Figure 10 This is a schematic diagram of a color swatch in an embodiment of this application;
[0116] Figure 11 This is a flowchart illustrating the calculation of the target deviation value in an embodiment of this application;
[0117] Figure 12 This is a flowchart illustrating the iterative optimization of the target LUT in an embodiment of this application;
[0118] Figure 13 This is a schematic diagram of a process for calculating the color gamut in an embodiment of this application;
[0119] Figure 14 This is a schematic diagram of a gamma correction image in an embodiment of this application;
[0120] Figure 15 This is a schematic diagram of the lookup table transformation diagram in an embodiment of this application;
[0121] Figure 16 This is another flowchart illustrating the color correction method in an embodiment of this application;
[0122] Figure 17 This is a schematic diagram of a color correction device in an embodiment of this application;
[0123] Figure 18 This is another schematic diagram of the color correction device in the embodiments of this application;
[0124] Figure 19 This is a schematic diagram of the structure of a terminal device in an embodiment of this application. Detailed Implementation
[0125] This application provides a method, related apparatus, device, and storage medium for color correction. On one hand, shooting and sampling video footage in offline scenarios eliminates latency issues, resulting in greater stability, efficiency, and robustness. On the other hand, the memory card supports higher-precision data storage, which improves the color correction effect.
[0126] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “corresponding,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0127] Light-emitting diode (LED) virtual production is a technology convergence that allows film shooting to use LED displays instead of green screens. Combined with game engines, LED displays can directly show real-time backgrounds and visual effects on set. Virtual production using LED displays, cameras, and real-time graphics rendering makes film and television production more convenient. Virtual production technology allows for the creation of grand scenes and special effects that are difficult to achieve with live-action sets at a lower cost, and it has already been widely used in many films.
[0128] Understandably, film virtualization production based on LED backdrops (i.e., LED virtualization) refers to using high-performance, small-pitch LED displays as backdrops. Through a real-time rendering engine and a multi-screen synchronized real-time rendering method, along with a camera internal and external parameter synchronization system, high-quality 3D scenes are rendered onto the LED backdrop. The real-time rendering engine then adjusts and synchronizes with on-site lighting, scene machinery, and other filming equipment. The footage is directly shot by the camera, and then the actual actor performances and props are composited with the LED backdrop in real time. This achieves a new "what you see is what you get" film production method.
[0129] Generally, due to LED degradation and changes in ambient temperature and other factors, the deterioration of LED display performance is difficult to prevent. Disassembling and transporting an already installed LED display back to the factory for calibration is extremely cumbersome. Therefore, this application proposes a hardware and software co-operated color calibration method that can be used in virtual manufacturing based on LED displays. Furthermore, a color calibration verification method is designed to verify the accuracy of the calibration results. If inaccurate, the color calibration process will iterate according to certain rules until a better result is achieved.
[0130] The method provided in this application can be applied to... Figure 1 The illustrated implementation environment includes a terminal device 110, an image acquisition device 120, and a target display screen 130. The terminal device 110 and the target display screen 130 can establish a communication connection via wired or wireless means, allowing the terminal device 110 to control the target display screen 130 to display corresponding content. The image acquisition device 120 is fixed on a tripod and aimed at the target display screen 130 for image acquisition. For online scenarios, the image acquisition device 120 can transmit the data stream to a capture card via a serial digital interface (SDI) or a high-definition multimedia interface (HDMI), and then the capture card transmits the data stream to the terminal device 110. The capture card can be built into or external to the terminal device 110. For offline scenarios, the image acquisition device 120 stores the acquired data in a memory card, and the terminal device 110 reads the data from the memory card to its local storage via a card reader.
[0131] The terminal device 110 involved in this application includes, but is not limited to, computers, mobile phones, smart voice interaction devices, smart home appliances, vehicle terminals, and aircraft. The client is deployed on the terminal device 110 and can run on the terminal device 110 via a browser or as a standalone app. This application encapsulates the color correction and color verification functions into independent software, allowing it to run on the terminal device 110 independently of a specific system. Simultaneously, the terminal device 110 has open interfaces, high compatibility, and is not dependent on a specific system.
[0132] The image acquisition device 120 involved in this application includes, but is not limited to, cameras, camcorders, scanners, and devices with shooting capabilities (e.g., mobile phones, tablets, etc.). Typically, certain specific models of image acquisition devices 120 can be selected for color calibration of the target display screen 130. Furthermore, the image acquisition device 120 and the target display screen 130 can be locked under the same genlock signal generator, enabling the terminal device 110 to obtain the image captured by the image acquisition device 120 and gain control of the game engine and the target display screen 130.
[0133] The acquisition card involved in this application is mainly a capture device that captures analog signals such as photoelectric, video, and audio signals from the outside world and digitizes them before importing them into the terminal device 110 for digital processing. There are many types of acquisition cards, including high-definition acquisition cards and standard-definition acquisition cards. They can also be divided into high-speed serial computer expansion bus standard (Peripheral Component Interconnect Express, PCIe) acquisition cards and universal serial bus (USB) acquisition cards.
[0134] The target display screen 130 involved in this application can be an LED display screen. The LED display screen is an electronic display screen composed of an LED dot matrix, which changes the form of the displayed content, such as text, animation, images, and videos, by turning red and green LED beads on and off in real time. It uses a modular structure for component display control. It mainly consists of a display module, a control system, and a power supply system. The display module is composed of an LED dot matrix that emits light; the control system regulates the on / off state of the area to change the content displayed on the screen; and the power supply system converts the input voltage and current to meet the needs of the display screen.
[0135] Given that this application involves some technical terms, explanations will be provided below for ease of understanding.
[0136] (1) Look-up table (LUT): This is a relatively common color conversion method. It uses a text record of a LUT with a certain precision. When a certain precision color sampling value is input into the system, the corresponding output value can be calculated from the difference in the table. Compared to some mathematical conversions, LUTs can achieve more complex, non-linear conversions. The LUT itself does not perform calculations; it only needs to find the corresponding output value for each input value. Compared to calculation-based conversions, this look-up-and-output method greatly saves computational power and is suitable for use in some real-time systems.
[0137] (2) Standard Color Chart: The standard color chart, also known as a "picture format LUT," represents the information in the LUT in image form. For easier understanding, please refer to [link to relevant documentation]. Figure 2 , Figure 2 This is a schematic diagram of a standard color map in an embodiment of this application. As shown in the figure, taking a 32*32*32 precision LUT as an example, it includes 32768 sampling points, representing the color change of these sampling points after color processing. A1 is used to indicate the 32*32*32 precision standard color map. A2 is used to indicate a lattice, and the standard color map indicated by A1 includes 32 lattices. A3 is used to indicate a sampling point in a lattice. In the standard color map indicated by A1, the sampling point in the upper left corner of the first lattice represents pure black with a code value of (0,0,0). The sampling point in the lower right corner of the last lattice represents pure white with a code value of (1,1,1). The last sampling point in the first row of the first lattice represents pure red with a code value of (1,0,0). The first sampling point in the first row of the last lattice represents pure green with a code value of (0,0,1).
[0138] (3) Color Checker: This refers to a color reproduction chart. Under one standard, it can consist of 24 color samples to mimic common colors in real life. Understandably, under other standards, it may consist of other numbers of color samples; this is not limited here. Each color in the color checker has a corresponding code value in a different color gamut. This application may use the color checker as a criterion for color correction.
[0139] (4) Universal color standard (standard Red Green Blue, sRGB) and Rec.709 color space: Rec.709, also known as International Telecommunication Union Broadcast Television (ITU.BT) 709, BT.709, or ITU709, is a standard developed by ITU-R for image coding and signal characteristics of high-definition television.
[0140] In this system, the color coordinates for red are [0.6400, 0.3300], for green [0.3000, 0.6000], for blue [0.1500, 0.0600], and for white [0.3127, 0.3290]. BT.709 is identical to sRGB in the International Commission on Illumination (CIE) standards. sRGB is a standard RGB color space used in monitors, printers, and the Internet. However, this color space is somewhat narrow for LED displays that support a wide color gamut.
[0141] (5) Color coordinates: that is, the coordinates of color. Color coordinates are one of the important contents of colorimetry. Measuring the color coordinates of a light source is one of the important methods for studying the characteristics of the light source, and it has wide application significance. The basic principle of color coordinate measurement is to calculate based on the spectral distribution of the light source according to the basic rules of color coordinates.
[0142] (6) Color difference formula: In order to further improve the visual consistency of industrial color difference evaluation, CIE proposed a new color difference evaluation formula in 2000, and it was officially recommended by CIE in 2001. It is called CIE2000 color difference formula, abbreviated as "CTEDE2000", and its color difference symbol is ΔE.
[0143] Based on the above introduction, the color correction method in this application will be described below using an offline scenario as an example. Please refer to [link / reference]. Figure 3 The color correction method in this application embodiment includes:
[0144] 210. Obtain the original source video, wherein the original source video includes multiple original video frames, each original video frame includes at least one color block, and each color block in the original video frame corresponds to an original code value in a standard color map.
[0145] In one or more embodiments, the terminal device acquires raw video footage, wherein the raw video footage is a video segment pre-generated according to the display resolution of the target display screen. The raw video footage includes multiple raw video frames, each displaying at least one color patch. Each color patch corresponds to a raw code value in a standard color map. The standard color map is derived from a standard color map; assuming the standard color map includes 32,768 sampling points, then the standard color map includes 32,768 raw code values. Each sampling point has a raw code value, and a corresponding color patch can be generated based on the raw code value.
[0146] 220. Control the target display screen to play the original source video;
[0147] In one or more embodiments, after the terminal device establishes a communication connection with the target display screen, it can control the target display screen to play the original source video.
[0148] 230. Obtain the sampled video footage captured by the image acquisition device through the memory card. The sampled video footage is obtained by the image acquisition device capturing the original video footage displayed on the target display screen. The sampled video footage includes multiple sampled video frames. Each sampled video frame includes at least one color block. Each color block in the sampled video frame corresponds to a sample code value in the displayed color.
[0149] In one or more embodiments, while the original source video is playing on the target display screen, an image acquisition device captures images of the target display screen to obtain a sample video. The image acquisition device then stores the sample video to a memory card. Since the sample video is captured by the image acquisition device, it comprises multiple sample video frames.
[0150] Specifically, the number of sampled video frames in the source video is equal to the number of original video frames in the original source video. Each sampled video frame includes at least one color patch, and the number of color patches in the sampled video frame is equal to the number of color patches in the original video frame. Based on this, the terminal device identifies the sampled video frames in the source video to obtain the sampling code value corresponding to each color patch in the sampled video frame.
[0151] 240. Based on the original source video and the sampled source video, generate a target lookup table, which reflects the mapping relationship between the display colors of the target screen and the standard color map;
[0152] In one or more embodiments, the position of each color patch in a standard color map can be determined based on the original source video. The sampled code value of each color patch displayed on the target display screen can be determined based on the sampled source video.
[0153] Specifically, for ease of understanding, let's take a standard color map with a precision of 32*32*32 as an example. This means the standard color map consists of 32 lattices, and each lattice contains 32*32 sampling points. Taking the first sampling point of the first lattice as an example, a color patch corresponding to the original code value can be generated based on this sampling point. Therefore, the position of the sampling point corresponding to each color patch in the standard color map has a mapping relationship with the position of each color patch in the sampled video footage, thus obtaining the target LUT.
[0154] For example, please refer to Table 1, which is a schematic of a target LUT.
[0155] Table 1
[0156] 0 0 0 0.0041358 0.0093148 0.0254127 0 0 1 -0.00960541 0.0176697 0.0415344 0 0 2 -0.0192108 0.0353394 0.0830688 0 0 3 -0.0288239 0.053009 0.124634 0 0 4 -0.0384216 0.0706787 0.166138 0 0 5 -0.0480042 0.0883179 0.207642 0 0 6 -0.0576477 0.106018 0.249268 0 0 7 -0.0672607 0.123657 0.290771 0 0 8 -0.0768433 0.141357 0.332275 0 0 9 -0.0864258 0.158936 0.373779 0 0 10 -0.0960083 0.176636 0.415283 0 0 11 -0.105652 0.194214 0.456787 0 0 12 -0.115295 0.212036 0.498535 0 0 13 -0.124878 0.229736 0.540039 0 0 14 -0.134521 0.247314 0.581543 0 0 15 -0.144043 0.264893 0.623047 0 0 16 -0.153687 0.282715 0.664551 0 0 17 -0.16333 0.300293 0.706055 0 0 18 -0.172852 0.317871 0.747559 0 0 19 -0.182495 0.335693 0.789062 0 0 20 -0.192017 0.353271 0.830566 0 0 21 -0.20166 0.37085 0.87207 0 0 22 -0.211304 0.388428 0.913574 0 0 23 -0.220825 0.40625 0.955078 0 0 24 -0.230591 0.424072 0.99707 0 0 25 -0.240234 0.44165 1.03906 0 0 26 -0.249756 0.459473 1.08008 0 0 27 -0.259277 0.477051 1.12207 0 0 28 -0.269043 0.494629 1.16309 0 0 29 -0.278564 0.512207 1.20508 0 0 30 -0.288086 0.529785 1.24609 0 0 31 -0.297852 0.547852 1.28809
[0157] Understandably, the target LUT can be in SPI3D format. The three dimensions on the left represent the position of the sampling point corresponding to the color patch in the standard color map. The three dimensions on the right represent the sampling code value of the color patch in the source video. The sampling code value is represented as a floating-point number.
[0158] It should be noted that in practical applications, the target LUT may only include the three dimensions on the right. The three dimensions on the right can be directly represented as the sampled code values, or the three dimensions on the right can be directly represented as the inverted (i.e., the result of the inversion) of the sampled code values. This is only an illustration and should not be construed as a limitation of this application.
[0159] Further, please refer to Figure 4 , Figure 4 This is a schematic diagram comparing the original code values and sampled code values in an embodiment of this application. As shown in the figure, the original code values can be represented as the code values of the game engine, including red (R), green (G), and blue (B) code values. The sampled code values can be represented as the code values of the sampled image, including R, G, and B code values. The standard color map is generated by uniformly using a certain number of sampling points in each dimension of a hexahedron with three sides equal to 1 (for example, 32768 sampling points if the precision is 32). The X, Y, and Z position parameters of each sampling point in the three-dimensional coordinate system represent the R, G, and B code values, respectively. The original code values are displayed and processed on the target display screen, and then these colors are captured by an image acquisition device to obtain the sampled code values. The original code values and the sampled code values are compared one by one to generate the target LUT.
[0160] 250. Based on the target lookup table, perform color correction on the image data to be displayed on the target screen.
[0161] In one or more embodiments, after obtaining the target LUT, the terminal device can find the corresponding output value for each input value in the image data based on the target LUT. This achieves the purpose of color correction for the image data to be displayed on the target screen.
[0162] It should be noted that some LUTs are stored in portable network graphics (PNG) image format, which uses 8-bit integer data with a sampling precision of 16*16*16. The target LUT provided in this application, however, can be stored in a high dynamic range image format (OpenEXR, EXR) or file format, and supports floating-point calculations, thus improving precision.
[0163] For easier understanding, please refer to Figure 5 , Figure 5This is a schematic diagram illustrating the generation of a target LUT based on online or offline sampling in an embodiment of this application. As shown, the terminal device runs a game engine and projects a standard color map onto the target display screen. In the online sampling scheme, the image acquisition device transmits the captured data stream to the terminal device via SDI, and the terminal device determines the sampling code value in the image based on the data stream. In the offline scheme, the image acquisition device stores the captured video in a memory card, and the terminal device reads the memory card to obtain the video and determines the sampling code value in the image. Based on this, the target LUT is generated by comparing the original code value and the code value used.
[0164] This application provides a color correction method. This method supports the use of memory cards to transfer sampled video footage in offline scenarios. Firstly, shooting sampled video footage offline eliminates latency issues, making it more stable, efficient, and robust. Secondly, memory cards support storing higher-precision data, thus enabling the generation of higher-precision target LUTs, which improves the color correction effect.
[0165] Optionally, in the above Figure 3 Based on the corresponding embodiments, in another optional embodiment provided by this application, obtaining the original source video may specifically include:
[0166] Obtain a standard color map, which includes T sampling points, each sampling point corresponding to a raw code value in the standard color map, where T is an integer greater than 1;
[0167] Based on the original code value corresponding to each sampling point in the standard color map, T color blocks are generated, where each color block has a one-to-one correspondence with each sampling point;
[0168] For each color block, generate the corresponding original video frame;
[0169] The original source video is generated based on the original video frame corresponding to each color block.
[0170] In one or more embodiments, a method for constructing original source video is described. As can be seen from the foregoing embodiments, taking a standard color map with a resolution of 32*32*32 as an example, the standard color map includes 32768 sampling points. That is, the standard color map includes 32768 raw code values. Therefore, each sampling point corresponds to one raw code value in the standard color map.
[0171] Specifically, for ease of understanding, please refer to Figure 6 , Figure 6This is a schematic diagram illustrating the generation of an original video frame based on a single color patch in an embodiment of this application. As shown in the figure, B1 indicates a lattice in the standard color map. B21 indicates sampling point A in the lattice. B22 indicates color patch A generated based on the original code value corresponding to sampling point A. B31 indicates sampling point B in the lattice. B32 indicates color patch B generated based on the original code value corresponding to sampling point B. B41 indicates sampling point C in the lattice. B42 indicates color patch C generated based on the original code value corresponding to sampling point C. B51 indicates sampling point D in the lattice. B52 indicates color patch D generated based on the original code value corresponding to sampling point D.
[0172] Based on this, color block A is used as the content displayed in original video frame 1. Color block B is used as the content displayed in original video frame 2. Color block C is used as the content displayed in original video frame 3. Color block D is used as the content displayed in original video frame 4. These original video frames are used to construct the original source video.
[0173] Secondly, this application provides a method for constructing original source video. Considering that SDI or HDMI can only transmit data in integer form, and taking SDI signals as an example, the content color gamut of SDI signals only supports Rec.709 and Rec.2020, which wastes the wide color gamut supported by the image acquisition device itself. Therefore, constructing original source video for offline sampling enables the generation of a more accurate target LUT, which is beneficial for improving color correction. Using code values supports a wide color gamut, making it suitable for modern films and high dynamic range content.
[0174] Optionally, in the above Figure 3 Based on the corresponding embodiments, in another optional embodiment provided by this application, obtaining the original source video may specifically include:
[0175] Obtain a standard color map, which includes T sampling points, each sampling point corresponding to a raw code value in the standard color map, where T is an integer greater than 1;
[0176] Based on the original code value corresponding to each sampling point in the standard color map, T color blocks are generated, where each color block has a one-to-one correspondence with each sampling point;
[0177] Divide the T color blocks into at least two color block groups, where each color block group includes K color blocks, and the K sampling points corresponding to the K color blocks are adjacent in the standard color map, where K is an integer greater than 1;
[0178] For each color patch group, generate the corresponding original video frame for each color patch group;
[0179] The original source video is generated based on the original video frames corresponding to each color block group.
[0180] In one or more embodiments, another method for constructing the original source video is described. As can be seen from the foregoing embodiments, taking a standard color map with a resolution of 32*32*32 as an example, the standard color map includes 32768 sampling points. That is, the standard color map includes 32768 raw code values. Therefore, each sampling point corresponds to one raw code value in the standard color map.
[0181] Specifically, for ease of understanding, please refer to Figure 7 , Figure 7 This is a schematic diagram illustrating the generation of an original video frame based on multiple color blocks in an embodiment of this application. As shown in the figure, C1 indicates a lattice in the standard color map. C21 indicates sampling point A in the lattice. C22 indicates color block A generated based on the original code value corresponding to sampling point A. C31 indicates sampling point B in the lattice. C32 indicates color block B generated based on the original code value corresponding to sampling point B. C41 indicates sampling point C in the lattice. C42 indicates color block C generated based on the original code value corresponding to sampling point C. C51 indicates sampling point D in the lattice. C52 indicates color block D generated based on the original code value corresponding to sampling point D.
[0182] As can be seen, sampling points A, B, C, and D are adjacent in the standard color chart. Optionally, adjacent sampling points may be located in the same column of the standard color chart. Alternatively, adjacent sampling points may be located in multiple adjacent columns of the standard color chart. Or, adjacent sampling points may be located in multiple adjacent rows of the standard color chart. No limitation is imposed here.
[0183] Taking K as an example, color blocks A, B, C, and D can be considered as the same color block group. Based on this, color blocks A, B, C, and D can be displayed as the content of the same original video frame.
[0184] Understandably, if the number of color blocks in the original video frame is less than K, pure black blocks can be used to fill the gaps, so that the number of color blocks and their positions in each original video frame are consistent, thus facilitating the extraction and recognition of color blocks.
[0185] It should be noted that, generally speaking, the more color blocks displayed in an original video frame, the more efficient the color calibration. However, in practical applications, the resolution and size of the target display screen also need to be considered.
[0186] Secondly, this application provides another method for constructing the original source video. Using this method, since each original video frame displays multiple color blocks, the sampling code values corresponding to multiple color blocks can be identified simultaneously, thereby improving color calibration efficiency. At the same time, since the color blocks in the same original video frame originate from the same color block group, and the colors of the color blocks within the same color block group are similar, color interference between the various color blocks in the original video frame is reduced.
[0187] Optionally, in the above Figure 3 Based on the corresponding embodiments, another optional embodiment provided in this application may further include:
[0188] Based on each sampling point in the standard color map, generate T identification information, where the identification information in the T identification information is used to identify the sampling point;
[0189] Based on T pieces of identification information, generate the target identification information corresponding to each color block group;
[0190] For each color patch group, generate the corresponding original video frame for each color patch group, which may include:
[0191] For each color block group and its corresponding target recognition information, generate the original video frame corresponding to each color block group.
[0192] In one or more embodiments, a method for indicating the original code value using identification information is described. As described in the foregoing embodiments, taking a standard color map with a precision of 32*32*32 as an example, the standard color map includes 32768 sampling points. Based on this, corresponding identification information can be generated for each sampling point. One approach is to generate the corresponding identification information based on the position of each sampling point in the standard color map. Another approach is to generate the corresponding identification information based on the original code value of each sampling point. The identification information is used to uniquely identify the sampling point.
[0193] Specifically, the following will use two examples to illustrate how to generate raw video frames.
[0194] Example 1;
[0195] For easier understanding, please refer to Figure 8 , Figure 8This is another schematic diagram illustrating the generation of an original video frame based on multiple color blocks in an embodiment of this application. As shown in the figure, D1 indicates a lattice in the standard color map. D21 indicates sampling point A in the lattice. D22 indicates color block A generated based on the original code value corresponding to sampling point A. D23 indicates QR code A generated based on sampling point A. D31 indicates sampling point B in the lattice. D32 indicates color block B generated based on the original code value corresponding to sampling point B. D33 indicates QR code B generated based on sampling point B. D41 indicates sampling point C in the lattice. D42 indicates color block C generated based on the original code value corresponding to sampling point C. D43 indicates QR code C generated based on sampling point C. D51 indicates sampling point D in the lattice. D52 indicates color block D generated based on the original code value corresponding to sampling point D. D53 indicates QR code D generated based on sampling point D.
[0196] Color blocks A, B, C, and D belong to the same color block group. QR codes A, B, C, and D represent the target recognition information corresponding to this color block group.
[0197] Example 2;
[0198] For easier understanding, please refer to Figure 9 , Figure 9 This is another schematic diagram illustrating the generation of an original video frame based on multiple color blocks in an embodiment of this application. As shown in the figure, E1 indicates a lattice in the standard color map. E21 indicates sampling point A in the lattice. E22 indicates color block A generated based on the original code value corresponding to sampling point A. E31 indicates sampling point B in the lattice. E32 indicates color block B generated based on the original code value corresponding to sampling point B. E41 indicates sampling point C in the lattice. E42 indicates color block C generated based on the original code value corresponding to sampling point C. E51 indicates sampling point D in the lattice. E52 indicates color block D generated based on the original code value corresponding to sampling point D. E6 indicates target recognition information.
[0199] Among them, color block A, color block B, color block C and color block D are in the same color block group.
[0200] It should be noted that target identification information can be represented not only in the form of QR codes, but also in the form of numbers, barcodes, graphics, etc., without limitation here.
[0201] Furthermore, this application embodiment provides a method for indicating the original code value using identification information. Using the above method, for each color block displayed in the original video frame, the identification information corresponding to the color block is also displayed. Based on this, after recording the sampled video, the sampling point corresponding to each color block can be determined by identifying the identification information displayed on the sampled video frame. This avoids the situation where the sampled video and the original video are out of sync, resulting in a mismatch between the sampling code value and the sampling point position. Thus, a stable and accurate sampling effect can be achieved.
[0202] Optionally, in the above Figure 3 Based on the corresponding embodiments, in another optional embodiment provided by this application, after generating the target lookup table according to the original source video and the sampled source video, it may further include:
[0203] Obtain the color palette corresponding to the target color gamut, wherein the color palette includes N sampled color blocks, each sampled color block corresponds to a standard code value, and N is an integer greater than 1;
[0204] Based on the standard code value corresponding to each sampled color block, control the target display screen to play N source color block images;
[0205] Acquire N sampled color block images captured by an image acquisition device, wherein the N sampled color block images are obtained by the image acquisition device capturing N source color block images displayed on the target display screen;
[0206] Determine the color deviation value based on N sampled color patch images and N source color patch images;
[0207] If the color deviation value is less than or equal to the deviation value threshold, then the step of color correction of the image data to be displayed on the target display screen is performed according to the target lookup table.
[0208] In one or more embodiments, a method for determining whether optimization is needed based on color calibration results is described. As can be seen from the foregoing embodiments, after obtaining the target LUT, the target LUT can be applied to the on-screen process. At this time, the color of the target display screen is in a calibrated state. Based on this, the sampled code value can be obtained by resampling using a color swatch, and the color deviation value can be calculated by comparing the sampled code value with the standard code value corresponding to the color swatch.
[0209] Specifically, the operator can specify a target color gamut (e.g., sRGB to obtain other color gamuts), and then obtain the color palette corresponding to that target color gamut. Please refer to [link / reference]. Figure 10 , Figure 10This is a schematic diagram of a color palette in an embodiment of this application. As shown in the figure, the color palette includes 24 sampled color blocks (i.e., N = 24), where each sampled color block has a corresponding standard code value. Since the number of sampled color blocks included in the color palette is relatively small, an online sampling method can be adopted. Based on this, a corresponding material color block image can be generated according to each standard code value, thereby obtaining N material color block images, and controlling the target display screen to play N material color block images. Similarly, an image acquisition device captures each material color block image displayed on the target display screen to obtain N sampled color block images.
[0210] Understandably, based on N sampled color patches and N source color patches, a color deviation value can be calculated. If the color deviation value is less than or equal to a deviation threshold, then the target LUT can be used for color correction. If the color deviation value is greater than the deviation threshold, then iterative optimization of the target LUT is necessary.
[0211] Secondly, this application provides a method for determining whether optimization is needed based on color calibration results. Using this method, after obtaining the target LUT, the target LUT is applied to the on-screen process. That is, the color calibration effect of the target LUT is verified using the colors provided by the color palette. If the color deviation value is small, it is determined that the target LUT will be used for color correction. Otherwise, an optimization algorithm is used to iteratively update the target LUT to achieve a better color calibration effect.
[0212] Optionally, in the above Figure 3 Based on the corresponding embodiments, in another optional embodiment provided by this application, the color deviation value is determined according to N sampled color patch images and N source color patch images, which may specifically include:
[0213] Based on N sampled color block images and N source color block images, construct N sets of comparison images, where each set of comparison images includes sampled color block images and source color block images with corresponding relationships;
[0214] For each of the N sets of comparison images, obtain the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image. The sampled color coordinates are obtained by converting the sampled code value of the sampled color block image, and the standard color coordinates are obtained by converting the standard code value.
[0215] For each of the N sets of comparison images, the target deviation value is calculated based on the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image.
[0216] The color deviation value is determined based on the target deviation value of each of the N sets of comparison images.
[0217] In one or more embodiments, a method for calculating color deviation values is described. As can be seen from the foregoing embodiments, N source color block images can be generated based on a color swatch, and N sample color block images can be captured using an image acquisition device. There is a one-to-one correspondence between the source color block images and the sample color block images. The following will use any set of comparison images as an example for illustration.
[0218] For easier understanding, please refer to Figure 11 , Figure 11 This is a flowchart illustrating the calculation of the target deviation value in an embodiment of this application, as shown in the figure. Specifically:
[0219] In step F1, N material color block images (i.e., the images corresponding to the sampled color blocks in the color palette) are captured by an image acquisition device and displayed on the target display screen, thereby obtaining N sampled color block images. Based on this, each sampled color block image can be identified to obtain the corresponding sampling code value.
[0220] In step F2, each sampled code value is converted to a color space to obtain the coordinates of the color on the color palette in CIExy (e.g., CIExy1931), that is, the sampled color coordinates corresponding to the sampled color patch image. It can be seen that the sampled color coordinates are the color coordinates obtained from actual sampling. Similarly, each standard code value is converted to a color space to obtain the coordinates of the color on the color palette in CIExy (e.g., CIExy1931), that is, the standard color coordinates corresponding to the source color patch image. It can be seen that the standard color coordinates are the color coordinates of the standard color on the color palette.
[0221] In step F3, for the same set of comparison images, assume that the sampled color coordinates are (x1, y1) and the standard color coordinates are (x2, y2).
[0222] One approach is to calculate the target deviation between the sampled color patch image and the source color patch image as follows:
[0223] E = |x1 - x2| + |y1 - y2|; Equation (1)
[0224] Where E represents the target deviation value. |·| indicates taking the absolute value.
[0225] Another method is to use the color difference formula CIEDE2000 to calculate the target deviation value between the sampled color block image and the source color block image.
[0226] Based on this, after obtaining the target deviation value of each of the N sets of comparison images, the average of the N target deviation values can be used as the color deviation value.
[0227] Furthermore, this application provides a method for calculating color deviation values. Using this method, an image acquisition device is used to capture the colors of a color swatch displayed on a target display screen, and color space conversion is performed to obtain the standard color coordinates and sampled color coordinates corresponding to the colors on the color swatch. Based on this, the color deviation value between the color of the color swatch displayed on the target display screen and the color of the color swatch itself can be calculated. This provides a feasible approach for implementing the solution.
[0228] Optionally, in the above Figure 3 Based on the corresponding embodiments, another optional embodiment provided in this application may further include:
[0229] For each sampled color patch, N identification information are generated, where the identification information in the N identification information is used to identify the sampled color patch;
[0230] Based on the standard code value corresponding to each sampled color block, control the target display screen to play N source color block images, which may specifically include:
[0231] Based on the standard code value and corresponding recognition information of each sampled color block, control the target display screen to play N material color block images and N recognition information.
[0232] In one or more embodiments, a method for indicating standard code values using identification information is described. As can be seen from the foregoing embodiments, taking a color palette comprising N sampled color blocks as an example, for each sampled color block, one approach is to generate corresponding identification information based on the position of each sampled color block in the color palette. Another approach is to generate corresponding identification information based on the standard code value of each sampled color block.
[0233] Specifically, based on the standard code value corresponding to each sampled color block, the target display screen is controlled to play the corresponding source color block image. Furthermore, the identification information corresponding to each sampled color block is sent to the target display screen, so that the target display screen displays the identification information corresponding to that sampled color block when playing the source color block image.
[0234] It should be noted that the identification information can be represented in the form of QR codes, numbers, barcodes, graphics, etc., and no specific restrictions are imposed here.
[0235] Furthermore, this application embodiment provides a method for indicating standard code values using identification information. Using this method, corresponding identification information is also displayed for each sampled color block in the color palette. Based on this, after capturing the sampled color block image, the sampled color block corresponding to the color palette can be determined by identifying the identification information displayed on the sampled color block image. This avoids situations where the sampled code value does not correspond to the sampled color block due to asynchrony between the sampled color block image and the source color block image. Thus, a stable and accurate sampling effect can be achieved.
[0236] Optionally, in the above Figure 3 Based on the corresponding embodiments, another optional embodiment provided in this application may further include:
[0237] Obtain the standard code values corresponding to M sampled extreme value color patches, where M is an integer greater than or equal to 1;
[0238] Based on the standard code value corresponding to each sample extreme value color block, control the target display screen to play M material color block images;
[0239] Acquire M sample color block images captured by an image acquisition device, wherein the M sample color block images are obtained by the image acquisition device capturing M source color block images displayed on the target display screen;
[0240] Based on N sampled color patches and N source color patches, determine the color deviation value, which may include:
[0241] Determine the color deviation value based on N sampled color patch images, M sampled color patch images, N source color patch images, and M source color patch images.
[0242] In one or more embodiments, a method for verification using sampled extreme value color blocks is described. As can be seen from the foregoing embodiments, M sampled extreme value color blocks can also be set, and the M sampled extreme value color blocks include, but are not limited to, pure red (i.e., standard code value (1,0,0)) color blocks, pure green (i.e., standard code value (0,1,0)) color blocks, pure blue (i.e., standard code value (0,0,1)) color blocks, pure black (i.e., standard code value (0,0,0)) color blocks, and pure white (i.e., standard code value (0,0,0)) color blocks.
[0243] Specifically, operators can use a color swatch and M sampled extreme value color blocks for verification. Each sampled extreme value color block has a corresponding standard code value. Based on this, a corresponding source color block image can be generated according to each standard code value, thus obtaining M source color block images, and controlling the target display screen to play the M source color block images. Similarly, an image acquisition device captures the source color block images displayed on the target display screen to obtain M sampled color block images.
[0244] Understandably, based on (N+M) sampled color patches and (N+M) source color patches, a color deviation value can be calculated. If the color deviation value is less than or equal to a deviation threshold, then the target LUT can be used for color correction. If the color deviation value is greater than the deviation threshold, then iterative optimization of the target LUT is required.
[0245] Furthermore, this application embodiment provides a method for verification using sampled extreme value color blocks. Through this method, using sampled extreme value color blocks can calculate the maximum display capability of the target display screen under current settings, thereby achieving a better verification effect.
[0246] Optionally, in the above Figure 3 Based on the corresponding embodiments, in another optional embodiment provided by this application, the color deviation value is determined according to N sampled color patch images, M sampled color patch images, N source color patch images, and M source color patch images. Specifically, this may include:
[0247] Based on N sampled color block images, M sampled color block images, N source color block images, and M source color block images, construct (N+M) sets of comparison images, where each set of comparison images includes sampled color block images and source color block images with corresponding relationships;
[0248] For each group of comparison images in the (N+M) groups of comparison images, obtain the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image. The sampled color coordinates are obtained by converting the sampled code value of the sampled color block image, and the standard color coordinates are obtained by converting the standard code value.
[0249] For each of the (N+M) sets of comparison images, the target deviation value is calculated based on the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image.
[0250] The color deviation value is determined based on the target deviation value of each group of comparison images in the (N+M) groups of comparison images.
[0251] In one or more embodiments, a method for calculating color deviation values is described. As can be seen from the foregoing embodiments, N source color block images can be generated based on N sampled color blocks, and N sampled color block images can be captured by an image acquisition device. There is a one-to-one correspondence between the source color block images and the sampled color block images. The following explanation will use any set of comparison images as an example.
[0252] Specifically, M source color block images (i.e., images corresponding to the M sampled extreme value color blocks) are captured and displayed on the target screen using an image acquisition device, thus obtaining M sampled color block images. Based on this, each sampled color block image can be identified to obtain the corresponding sampling code value. Then, each sampling code value and standard code value are converted to a color space. That is, converted to a CIExy (e.g., CIExy1931) chromaticity diagram to obtain the sampling color coordinates corresponding to each sampled color block image and the standard color coordinates corresponding to the source color block image. Finally, the target deviation value of each group of (N+M) sets of comparison images can be calculated using equation (1) or the color difference formula CIEDE2000. Based on this, the average value of the (N+M) target deviation values can be used as the color deviation value.
[0253] It is understood that, based on (N+M) target deviation values, other methods can also be used to calculate the color deviation value. The use of the average value method here is merely illustrative and should not be construed as a limitation of this application.
[0254] Furthermore, this application embodiment provides a method for calculating color deviation values. Using the above method, an image acquisition device captures a preset color displayed on a target display screen, and color space conversion is used to obtain the standard color coordinates and sampled color coordinates corresponding to the preset color. Based on this, the color deviation value between the preset color displayed on the target display screen and the preset color can be calculated. This provides a feasible method for implementing the solution.
[0255] Optionally, in the above Figure 3 Based on the corresponding embodiments, another optional embodiment provided in this application may further include:
[0256] Based on the standard code value corresponding to each sample extreme value color block, M identification information are generated, where the identification information in the M identification information is used to identify the standard code value;
[0257] Based on the standard code value corresponding to each sampled extreme value color block, control the target display screen to play M source color block images, which may specifically include:
[0258] Based on the standard code value corresponding to each sample extreme value color block and the corresponding recognition information, control the target display screen to play M material color block images and M recognition information.
[0259] In one or more embodiments, a method for indicating standard code values using identification information is described. As can be seen from the foregoing embodiments, taking M sampled extreme value color patches as an example, based on this, for each sampled extreme value color patch, one approach is to generate corresponding identification information based on the order in which each sampled extreme value color patch appears. Another approach is to generate corresponding identification information based on the standard code value of each sampled extreme value color patch.
[0260] Specifically, based on the standard code value corresponding to each sampled extreme value color block, the target display screen is controlled to play the corresponding material color block image. In addition, the identification information corresponding to each sampled extreme value color block is sent to the target display screen, so that the target display screen displays the identification information corresponding to the sampled extreme value color block when playing the material color block image corresponding to the sampled extreme value color block.
[0261] It should be noted that the identification information can be represented in the form of QR codes, numbers, barcodes, graphics, etc., and no specific restrictions are imposed here.
[0262] Furthermore, this application embodiment provides a method for indicating standard code values using identification information. Through this method, corresponding identification information is also displayed for each sampled extreme value color block. Based on this, after capturing the sampled color block image, the corresponding sampled extreme value color block can be determined by identifying the identification information displayed on the sampled color block image. This avoids the situation where the sampled code value does not correspond to the sampled extreme value color block due to asynchrony between the sampled color block image and the source color block image. Thus, a stable and accurate sampling effect can be achieved.
[0263] Optionally, in the above Figure 3 Based on the corresponding embodiments, another optional embodiment provided in this application may further include:
[0264] If the color deviation value is greater than the deviation value threshold, the target display screen is controlled to play multiple color block images according to the original code value corresponding to each sampling point in the standard color image, wherein each color block image displays at least one color block.
[0265] Multiple target sampling images are acquired by an image acquisition device. The image acquisition device and the target display screen are electrically connected to a synchronous phase-locked Genlock signal generator. The Genlock signal generator is used to lock the image acquisition device and the target display screen at the same frequency.
[0266] The target lookup table is updated based on multiple target sample images and multiple color block images.
[0267] In one or more embodiments, an iterative optimization method for a target LUT is described. As can be seen from the foregoing embodiments, if the color deviation value exceeds a deviation threshold, further iterative optimization of the target LUT is required. It is understood that the iterative optimization process for the target LUT requires online sampling. Before online sampling, the image acquisition device and the target display screen should be electrically connected to a Genlock signal generator, whereby the Genlock signal generator is used to lock the image acquisition device and the target display screen at the same frequency.
[0268] Specifically, the terminal device can control the target display screen to emit the raw code values of each sampling point according to the standard color map, that is, play several color block images. Each color block image displays at least one color block, and each color block corresponds to the raw code value of a sampling point. An image acquisition device captures these color block images, thereby obtaining multiple target sampling images. Based on this, the image acquisition device outputs the target sampling images to the terminal device in real time. The terminal device generates a new LUT based on the target sampling images and the color block images, and updates the target LUT with the new LUT, that is, it realizes the update of the target LUT.
[0269] For easier understanding, please refer to Figure 12 , Figure 12 This is a flowchart illustrating an iterative optimization of the target LUT in an embodiment of this application, as shown in the figure. Specifically:
[0270] In step G1, for the sampling phase, the terminal device identifies the sampling code value corresponding to the sampling point.
[0271] In step G2, for the verification phase, it is determined whether the Genlock signal generator is locked during the first color calibration. If it is locked, the calculation of the target LUT can be performed. Furthermore, the color deviation value can be calculated, the color gamut of the current color calibration system can be estimated, and the white point of the current color calibration system can be estimated during the verification phase.
[0272] In step G3, based on the relationship between the color deviation value and the deviation threshold, it is determined whether the color calibration result is satisfactory. If satisfactory, proceed to step G5. If not satisfactory, proceed to step G4.
[0273] In step G4, an optimization algorithm is used to iteratively calculate the target LUT.
[0274] In step G5, a color calibration report can be output for the feedback phase. Based on the color calibration report, operators can also modify the target LUT to some extent through post-processing methods for the LUT.
[0275] In step G6, for the calculation phase, the target LUT is calculated, or the target LUT is updated.
[0276] In step G7, the target LUT is applied to the on-screen process.
[0277] Furthermore, this application embodiment provides an iterative optimization method for the target LUT. Using this method, if the color deviation value is still large after color correction using the target LUT, the target LUT can be continuously updated to further improve the color correction effect.
[0278] Optionally, in the above Figure 3 Based on the corresponding embodiments, another optional embodiment provided in this application may further include:
[0279] Output a color calibration report, which includes at least one of the following: first color deviation value, second color deviation value, color calibration effect improvement, white point estimation position, color gamut estimation result, gamma correction chart, and lookup table transformation chart;
[0280] The first color deviation value represents the color deviation value before color calibration;
[0281] The second color deviation value represents the color deviation value after color calibration.
[0282] The improvement in color calibration effect indicates the degree of change in color deviation value between before and after color calibration.
[0283] The estimated position of the white dot represents the color coordinates corresponding to the white dot;
[0284] The color gamut estimation result represents the estimated color gamut size before and after color calibration, as well as the comparison result between the color gamut before and after color calibration and the standard color map space;
[0285] The gamma correction chart represents a simulation of the gamma curve of the target display screen before and after color calibration.
[0286] The lookup table transformation diagram represents a color direction change diagram presented in three dimensions.
[0287] In one or more embodiments, a method for generating a color calibration report based on color calibration results is described. As can be seen from the foregoing embodiments, a color calibration report can be output after color calibration, allowing operators to understand the system's technical data. If certain colors are out of color gamut or overexposed, it means that the image acquisition device did not capture certain colors displayed on the target screen. If there are problems with the configuration of the image acquisition device or the target screen, the color calibration result will be unsatisfactory. In this case, suggestions for the display brightness of the camera image acquisition device and the target screen can be provided to the operator. The operator can modify the configuration of the color calibration system according to the prompts.
[0288] Specifically, the following section will introduce the color calibration report generated based on the offline sampling method.
[0289] (1) First color deviation value;
[0290] Before using the target LUT for color calibration, control the target display screen to show N sampled color patches on the color chart, or control the target display screen to show M extreme sampled color patches and N sampled color patches on the color chart. Then, use an image acquisition device to capture the image to calculate the sampled code value corresponding to each color patch. Then, perform color space conversion on each sampled code value and the standard code value. Finally, the color deviation value before calibration can be calculated using equation (1) or the color difference formula CIEDE2000.
[0291] (2) Second color deviation value;
[0292] After color calibration using the target LUT, control the target display screen to show N sampled color patches on the color chart, or control the target display screen to show M extreme sampled color patches and N sampled color patches on the color chart. Then, use an image acquisition device to capture the image to calculate the sampled code value corresponding to each color patch. Then, perform color space conversion on each sampled code value and the standard code value. Finally, the color deviation value after calibration can be calculated using equation (1) or the color difference formula CIEDE2000.
[0293] (3) Improvement in color correction effect;
[0294] The color correction improvement indicates the degree of change in color deviation between before and after color correction. That is, it compares the current color deviation value with the previous color deviation value. One method is to directly subtract the previous color deviation value from the current one. Another method is to take the absolute value of the subtraction and then use the ratio of this absolute value to the previous color deviation value as the color correction improvement. Alternatively, other methods can be used to calculate the color correction improvement.
[0295] It is understandable that the improvement in color correction effect can be expressed as a numerical value or a percentage; no specific limitation is made here.
[0296] (4) Color gamut estimation results;
[0297] For easier understanding, please refer to Figure 13 , Figure 13 This is a flowchart illustrating the calculation of color gamut in an embodiment of this application. As shown in the figure, in step H1, the R-value, G-value, and B-value are determined by an image acquisition device based on the captured sample color patch image. In step H2, the R-value, G-value, and B-value are converted to a color space to obtain the coordinates of the three points on the CIExy (e.g., CIExy1931) chromaticity diagram. In step H3, the display color gamut diagram of the target display screen is plotted. Based on the display color gamut diagram, the estimated color gamut size before and after color calibration can be determined, as well as the comparison result between the color gamut before and after color calibration and the standard color space.
[0298] It should be noted that because image acquisition devices do not undergo precise color calibration, the data they obtain cannot be used as a reference between image acquisition devices. However, an image acquisition device can compare its data with previously obtained data to provide an estimated color gamut size and compare the changes before and after calibration using the target LUT. Image acquisition devices typically use a "color gamut" defined by the device manufacturer. The code values acquired by the image acquisition device can be converted to a standard color gamut through coordinate transformation, and the corresponding color coordinates can be obtained.
[0299] (5) Estimating the position of the white dot;
[0300] By combining the color gamut diagram of the target display screen, the color coordinates of the white point in the color gamut diagram can be determined.
[0301] Specifically, acquiring the white point requires displaying a pure white image on the target display screen. Then, the aperture of the image acquisition device is controlled to adjust the brightness to a state where it is not overexposed (i.e., the bit value does not overflow). Sampling is then performed to obtain the color coordinates of the white point. Therefore, the color coordinates can be converted to color temperature using the following method:
[0302] n = (x - 0.3320) / (0.1858 - y);
[0303] CCT=437*n^3+3601*n^2+6861*n+5517;
[0304] Where CCT represents correlated color temperature (CCT). x represents the x-axis under CIExy (e.g., CIExy1931). y represents the y-axis under CIExy (e.g., CIExy1931). n represents an intermediate variable.
[0305] (6) Gamma correction diagram;
[0306] For easier understanding, please refer to Figure 14 , Figure 14 This is a schematic diagram of a gamma correction diagram in an embodiment of this application. As shown in the figure, the diagram illustrates the simulated gamma curves of the target display screen before and after color calibration. The horizontal axis represents the code value, and the vertical axis represents the brightness, with the unit being nits.
[0307] (7) Lookup table transformation diagram;
[0308] For easier understanding, please refer to Figure 15 , Figure 15 This is a schematic diagram of a lookup table transformation diagram in an embodiment of this application. As shown in the figure, the lookup table transformation diagram represents a color direction change diagram presented in three dimensions. Based on this, operators can understand the color bias through the lookup table transformation diagram. In practical applications, operators are allowed to zoom in, zoom out, rotate, and perform other operations on the lookup table transformation diagram.
[0309] It should be noted that the color calibration report may also include parameter adjustment suggestions for the screen controller and image acquisition equipment. Since sometimes the image acquisition equipment cannot completely capture the content displayed on the screen, adjustment suggestions can be provided to the operator, informing them which color differences have not been recorded.
[0310] It should be noted that the color calibration report may also include a sampled lattice diagram of the standard color map after calibration. One approach is to stitch the sampled code values together to form a sampled standard color map in a two-dimensional manner. Another approach is to represent the tendency of color changes in a three-dimensional manner.
[0311] Secondly, this application provides a method for generating a color calibration report based on color correction results. This method provides a color calibration report after calibration is completed, allowing operators to understand the calibration process and facilitating adjustments.
[0312] Based on the above introduction, the color correction method in this application will be described below using an online scenario as an example. Please refer to [link / reference]. Figure 3 The color correction method in this application embodiment includes:
[0313] 310. Obtain a standard color map, wherein the standard color map includes T sampling points, each sampling point corresponds to a raw code value in the standard color map, and T is an integer greater than 1;
[0314] In one or more embodiments, taking a standard color map with a precision of 32*32*32 as an example, the standard color map includes 32768 sampling points. That is, the standard color map includes 32768 raw code values. Therefore, each sampling point corresponds to one raw code value in the standard color map.
[0315] 320. Based on the original code value corresponding to each sampling point, control the target display screen to play multiple color block images, wherein each color block image displays K color blocks, and each color block in the color block image corresponds to a sampling code value in the displayed color, where K is an integer greater than 1;
[0316] In one or more embodiments, the terminal device can control the target display screen to emit the raw code values of each sampling point according to a standard color map, that is, to play a number of color block images. Each color block image displays at least two color blocks, and each color block corresponds to the raw code value of one sampling point.
[0317] 330. Acquire multiple target sampling images captured by an image acquisition device, wherein the image acquisition device and the target display screen are electrically connected to a synchronous phase-locked Genlock signal generator, and the Genlock signal generator is used to lock the image acquisition device and the target display screen at the same frequency.
[0318] In one or more embodiments, the image acquisition device and the target display screen are each electrically connected to a Genlock signal generator, wherein the Genlock signal generator is used to lock the image acquisition device and the target display screen at the same frequency. Based on this, the image acquisition device captures these color block images to obtain multiple target sample images.
[0319] It's important to note that when using online sampling for color calibration, system latency can affect the correspondence between the color patch image and the target sample image. Typically, the latency is within 10 frames and remains stable within a certain range. The system latency can be determined by comparing the time the signal is sent and the time it is received. Therefore, in subsequent color calibration, a time offset is added to each color read, and the display time difference between the current color and the next color is also increased to obtain the correct color correspondence.
[0320] 340. Based on multiple target sampling images and multiple color block images, generate a target lookup table, wherein the target lookup table is used to reflect the mapping relationship between the display colors of the target display screen and the standard color diagram;
[0321] In one or more embodiments, the position of each color block in a standard color map can be determined based on the color block image. The sampling code value displayed on the target display screen for each color block can be determined based on the target sampling image.
[0322] Specifically, for ease of understanding, let's take a standard color map with a precision of 32*32*32 as an example. This means the standard color map consists of 32 lattices, and each lattice contains 32*32 sampling points. Taking the first sampling point of the first lattice as an example, a color patch corresponding to the original code value can be generated based on this sampling point. Therefore, the position of the sampling point corresponding to each color patch in the standard color map has a mapping relationship with the position of each color patch in the target sampled image, thus obtaining the target LUT.
[0323] 350. Based on the target lookup table, perform color correction on the image data to be displayed on the target screen.
[0324] In one or more embodiments, after obtaining the target LUT, the terminal device can find the corresponding output value for each input value in the image data based on the target LUT. This achieves the purpose of color correction for the image data to be displayed on the target screen.
[0325] This application provides a color correction method. This method supports data stream transmission via SDI or HDMI in online scenarios. Furthermore, by utilizing multiple color blocks displayed in each original video frame, the sampling code values corresponding to multiple color blocks can be identified simultaneously, thereby improving color correction efficiency.
[0326] Optionally, in the above Figure 16 Based on the corresponding embodiments, in another optional embodiment provided by this application, after generating the target lookup table according to multiple target sampling images and multiple color block images, it may further include:
[0327] Obtain the color palette corresponding to the target color gamut, wherein the color palette includes N sampled color blocks, each sampled color block corresponds to a standard code value, and N is an integer greater than 1;
[0328] Based on the standard code value corresponding to each sampled color block, control the target display screen to play N source color block images;
[0329] Acquire N sampled color block images captured by an image acquisition device, wherein the N sampled color block images are obtained by the image acquisition device capturing N source color block images displayed on the target display screen;
[0330] Determine the color deviation value based on N sampled color patch images and N source color patch images;
[0331] If the color deviation value is greater than the deviation value threshold, the target lookup table is updated.
[0332] In one or more embodiments, an iterative optimization method for the target lookup table is described. As can be seen from the foregoing embodiments, after obtaining the target LUT, it can be applied to the on-screen process. At this time, the color of the target display screen is in a calibrated state. Based on this, the sampled code value can be obtained by resampling using a color palette. By comparing the sampled code value with the standard code value corresponding to the color palette, the color deviation value is calculated.
[0333] Specifically, the operator can specify a target color gamut (e.g., sRGB or other color gamuts) and then obtain the color palette corresponding to that target color gamut. Optionally, the color palette can be used together with M sampled extreme value color patches for verification. Each sampled color patch has a corresponding standard code value, and each sampled extreme value color patch also has a corresponding standard code value. Based on this, a corresponding source color patch image can be generated according to each standard code value, thus obtaining several source color patch images, and controlling the target display screen to play these source color patch images. Similarly, an image acquisition device captures images of each source color patch displayed on the target display screen to obtain the corresponding sampled color patch images.
[0334] Understandably, the color deviation value can be calculated based on N sampled color patches and N source color patches. Alternatively, it can be calculated based on (N+M) sampled color patches and (N+M) source color patches. If the color deviation value is less than or equal to a deviation threshold, then the target LUT can be used for color correction. If the color deviation value is greater than the deviation threshold, an optimization algorithm is used to iterate over the target LUT.
[0335] Secondly, this application provides an iterative optimization method for the target lookup table. Using this method, if the color deviation value is still large after color correction using the target LUT, the target LUT can be continuously updated to further improve the color correction effect.
[0336] Optionally, in the above Figure 16 In addition to the corresponding embodiments, another optional embodiment provided in this application further includes:
[0337] Output a color calibration report, which includes at least one of the following: lookup table iteration count, first color deviation value, second color deviation value, color calibration effect improvement, white point estimation position, color gamut estimation result, gamma correction graph, and lookup table transformation graph.
[0338] The lookup table iteration count indicates the number of times the target lookup table is updated;
[0339] The first color deviation value represents the color deviation value before color calibration;
[0340] The second color deviation value represents the color deviation value after color calibration.
[0341] The improvement in color calibration effect indicates the degree of change in color deviation value between before and after color calibration.
[0342] The estimated position of the white dot represents the color coordinates corresponding to the white dot;
[0343] The color gamut estimation result represents the estimated color gamut size before and after color calibration, as well as the comparison result between the color gamut before and after color calibration and the standard color map space;
[0344] The gamma correction chart represents a simulation of the gamma curve of the target display screen before and after color calibration.
[0345] The lookup table transformation diagram represents a color direction change diagram presented in three dimensions.
[0346] In one or more embodiments, a method for generating a color calibration report based on color correction results is described. As can be seen from the foregoing embodiments, a color calibration report can be output after color calibration is completed, allowing operators to understand the system's technical data.
[0347] Specifically, the following section will introduce the color calibration report generated based on online sampling.
[0348] (1) First color deviation value;
[0349] (2) Second color deviation value;
[0350] (3) Improvement in color correction effect;
[0351] (4) Color gamut estimation results;
[0352] (5) Estimating the position of the white dot;
[0353] (6) Gamma correction diagram;
[0354] (7) Lookup table transformation diagram;
[0355] (8) Number of lookup table iterations;
[0356] The lookup table iteration count represents the number of times the target LUT is updated. Optionally, post-processing suggestions can also be provided.
[0357] It should be noted that the first color deviation value, the second color deviation value, the improvement in color correction effect, the estimated position of the white point, the color gamut estimation result, the gamma correction diagram, and the lookup table transformation diagram have been introduced in the previous embodiments, and will not be repeated here.
[0358] Secondly, this application provides a method for generating a color calibration report based on color correction results. This method provides a color calibration report after calibration is completed, allowing operators to understand the calibration process and facilitating adjustments.
[0359] The color correction device in this application is described in detail below. Please refer to [link / reference]. Figure 17 , Figure 17 This is a schematic diagram of one embodiment of the color correction device in this application. The color correction device 40 includes:
[0360] The acquisition module 410 is used to acquire the original source video, wherein the original source video includes multiple original video frames, each original video frame includes at least one color block, and each color block in the original video frame corresponds to an original code value in a standard color map.
[0361] Control module 420 is used to control the target display screen to play the original source video.
[0362] The acquisition module 410 is also used to acquire the material sampling video captured by the image acquisition device through the memory card. The material sampling video is obtained by the image acquisition device capturing the original material video displayed on the target display screen. The material sampling video includes multiple sampling video frames, each sampling video frame includes at least one color block, and each color block in the sampling video frame corresponds to a sampling code value in the display color.
[0363] The generation module 430 is used to generate a target lookup table based on the original source video and the sampled source video. The target lookup table is used to reflect the mapping relationship between the display colors of the target display screen and the standard color map.
[0364] The calibration module 440 is used to perform color calibration on the image data to be displayed on the target display screen according to the target lookup table.
[0365] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application,
[0366] The acquisition module 410 is specifically used to acquire a standard color map, wherein the standard color map includes T sampling points, each sampling point corresponds to a raw code value in the standard color map, and T is an integer greater than 1;
[0367] Based on the original code value corresponding to each sampling point in the standard color map, T color blocks are generated, where each color block has a one-to-one correspondence with each sampling point;
[0368] For each color block, generate the corresponding original video frame;
[0369] The original source video is generated based on the original video frame corresponding to each color block.
[0370] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application,
[0371] The acquisition module 410 is specifically used to acquire a standard color map, wherein the standard color map includes T sampling points, each sampling point corresponds to a raw code value in the standard color map, and T is an integer greater than 1;
[0372] Based on the original code value corresponding to each sampling point in the standard color map, T color blocks are generated, where each color block has a one-to-one correspondence with each sampling point;
[0373] Divide the T color blocks into at least two color block groups, where each color block group includes K color blocks, and the K sampling points corresponding to the K color blocks are adjacent in the standard color map, where K is an integer greater than 1;
[0374] For each color patch group, generate the corresponding original video frame for each color patch group;
[0375] The original source video is generated based on the original video frames corresponding to each color block group.
[0376] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application,
[0377] The generation module 430 is also used to generate T identification information based on each sampling point in the standard color map, wherein the identification information in the T identification information is used to identify the sampling point;
[0378] The generation module 430 is also used to generate target recognition information corresponding to each color block group based on T recognition information;
[0379] The acquisition module 410 is specifically used to generate the original video frame corresponding to each color block group and the corresponding target recognition information.
[0380] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application,
[0381] The acquisition module 410 is also used to generate a target lookup table based on the original source video and the source sample video, and then obtain the color palette corresponding to the target color gamut. The color palette includes N sampled color blocks, each sampled color block corresponds to a standard code value, and N is an integer greater than 1.
[0382] The control module 420 is also used to control the target display screen to play N material color block images according to the standard code value corresponding to each sampled color block;
[0383] The acquisition module 410 is also used to acquire N sampled color block images captured by the image acquisition device, wherein the N sampled color block images are obtained by the image acquisition device capturing N material color block images displayed on the target display screen;
[0384] The acquisition module 410 is also used to determine the color deviation value based on the N sampled color block images and the N source color block images;
[0385] The calibration module 440 is also used to perform a step of color correction on the image data to be displayed on the target display screen according to the target lookup table if the color deviation value is less than or equal to the deviation value threshold.
[0386] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application,
[0387] The acquisition module 410 is specifically used to construct N sets of comparison images based on N sampled color block images and N source color block images. Each set of comparison images includes sampled color block images and source color block images with corresponding relationships.
[0388] For each of the N sets of comparison images, obtain the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image. The sampled color coordinates are obtained by converting the sampled code value of the sampled color block image, and the standard color coordinates are obtained by converting the standard code value.
[0389] For each of the N sets of comparison images, the target deviation value is calculated based on the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image.
[0390] The color deviation value is determined based on the target deviation value of each of the N sets of comparison images.
[0391] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application,
[0392] The generation module 430 is also used to generate N identification information based on each sampled color block, wherein the identification information in the N identification information is used to identify the sampled color block;
[0393] The control module 420 is specifically used to control the target display screen to play N material color block images and N identification information based on the standard code value and corresponding identification information of each sampled color block.
[0394] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application,
[0395] The acquisition module 410 is also used to acquire the standard code values corresponding to the M sampled extreme value color blocks, where M is an integer greater than or equal to 1;
[0396] The control module 420 is also used to control the target display screen to play M material color block images according to the standard code value corresponding to each sample extreme value color block;
[0397] The acquisition module 410 is also used to acquire M sample color block images captured by the image acquisition device, wherein the M sample color block images are obtained by the image acquisition device capturing M material color block images displayed on the target display screen;
[0398] The acquisition module 410 is specifically used to determine the color deviation value based on N sampled color block images, M sampled color block images, N source color block images, and M source color block images.
[0399] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application,
[0400] The acquisition module 410 is specifically used to construct (N+M) sets of comparison images based on N sampled color block images, M sampled color block images, N source color block images and M source color block images. Each set of comparison images includes sampled color block images and source color block images with corresponding relationships.
[0401] For each group of comparison images in the (N+M) groups of comparison images, obtain the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image. The sampled color coordinates are obtained by converting the sampled code value of the sampled color block image, and the standard color coordinates are obtained by converting the standard code value.
[0402] For each of the (N+M) sets of comparison images, the target deviation value is calculated based on the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image.
[0403] The color deviation value is determined based on the target deviation value of each group of comparison images in the (N+M) groups of comparison images.
[0404] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application,
[0405] The generation module 430 is also used to generate M identification information based on the standard code value corresponding to each sample extreme value color block, wherein the identification information in the M identification information is used to identify the standard code value;
[0406] The control module 420 is specifically used to control the target display screen to play M material color block images and M recognition information based on the standard code value corresponding to each sample extreme value color block and the corresponding recognition information.
[0407] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application, the color correction device further includes an update module 450;
[0408] The control module 420 is also used to control the target display screen to play multiple color block images according to the original code value corresponding to each sampling point in the standard color map if the color deviation value is greater than the deviation value threshold, wherein each color block image displays at least one color block.
[0409] The acquisition module 410 is also used to acquire multiple target sampling images acquired by the image acquisition device, wherein the image acquisition device and the target display screen are electrically connected to the synchronous phase-locked Genlock signal generator, and the Genlock signal generator is used to lock the image acquisition device and the target display screen at the same frequency.
[0410] The update module 450 is used to update the target lookup table based on multiple target sampling images and multiple color block images.
[0411] Optionally, in the above Figure 17 Based on the corresponding embodiments, in another embodiment of the color correction device 40 provided in this application, the color correction device further includes an output module 460;
[0412] The output module 460 is used to output a color calibration report, wherein the color calibration report includes at least one of the following: a first color deviation value, a second color deviation value, the improvement of color calibration effect, the estimated position of white point, the color gamut estimation result, the gamma correction diagram, and the lookup table transformation diagram;
[0413] The first color deviation value represents the color deviation value before color calibration;
[0414] The second color deviation value represents the color deviation value after color calibration.
[0415] The improvement in color calibration effect indicates the degree of change in color deviation value between before and after color calibration.
[0416] The estimated position of the white dot represents the color coordinates corresponding to the white dot;
[0417] The color gamut estimation result represents the estimated color gamut size before and after color calibration, as well as the comparison result between the color gamut before and after color calibration and the standard color map space;
[0418] The lookup table transformation diagram represents a color direction change diagram presented in three dimensions.
[0419] The color correction device in this application is described in detail below. Please refer to [link / reference]. Figure 18 , Figure 18 This is a schematic diagram of another embodiment of the color correction device in this application. The color correction device 50 includes:
[0420] The acquisition module 510 is used to acquire a standard color map, wherein the standard color map includes T sampling points, each sampling point corresponds to a raw code value in the standard color map, and T is an integer greater than 1;
[0421] The control module 520 is used to control the target display screen to play multiple color block images according to the original code value corresponding to each sampling point. Each color block image displays K color blocks, and each color block in the color block image corresponds to a sampling code value in the displayed color, where K is an integer greater than 1.
[0422] The acquisition module 510 is also used to acquire multiple target sampling images acquired by the image acquisition device, wherein the image acquisition device and the target display screen are electrically connected to the synchronous phase-locked Genlock signal generator, and the Genlock signal generator is used to lock the image acquisition device and the target display screen at the same frequency.
[0423] The generation module 530 is used to generate a target lookup table based on multiple target sampling images and multiple color block images. The target lookup table is used to reflect the mapping relationship between the display colors of the target display screen and the standard color diagram.
[0424] The calibration module 540 is used to perform color calibration on the image data to be displayed on the target display screen according to the target lookup table.
[0425] Optionally, in the above Figure 18 Based on the corresponding embodiments, in another embodiment of the color correction device 50 provided in this application, the color correction device 50 further includes an update module 550;
[0426] The acquisition module 510 is also used to generate a target lookup table based on multiple target sampled images and multiple color block images, and then obtain the color palette corresponding to the target color gamut. The color palette includes N sampled color blocks, each sampled color block corresponds to a standard code value, and N is an integer greater than 1.
[0427] The control module 520 is also used to control the target display screen to play N material color block images according to the standard code value corresponding to each sampled color block;
[0428] The acquisition module 510 is also used to acquire N sampled color block images captured by the image acquisition device, wherein the N sampled color block images are obtained by the image acquisition device capturing N material color block images displayed on the target display screen;
[0429] The acquisition module 510 is also used to determine the color deviation value based on N sampled color block images and N source color block images;
[0430] The update module 550 is used to update the target lookup table if the color deviation value is greater than the deviation value threshold.
[0431] Optionally, in the above Figure 18 Based on the corresponding embodiments, in another embodiment of the color correction device 50 provided in this application, the color correction device 50 further includes an output module 560;
[0432] Output module 560 is used to output a color calibration report, wherein the color calibration report includes at least one of the following: lookup table iteration count, first color deviation value, second color deviation value, color calibration effect improvement, white point estimation position, color gamut estimation result, gamma correction diagram, and lookup table transformation diagram;
[0433] The lookup table iteration count indicates the number of times the target lookup table is updated;
[0434] The first color deviation value represents the color deviation value before color calibration;
[0435] The second color deviation value represents the color deviation value after color calibration.
[0436] The improvement in color calibration effect indicates the degree of change in color deviation value between before and after color calibration.
[0437] The estimated position of the white dot represents the color coordinates corresponding to the white dot;
[0438] The color gamut estimation result represents the estimated color gamut size before and after color calibration, as well as the comparison result between the color gamut before and after color calibration and the standard color map space;
[0439] The lookup table transformation diagram represents a color direction change diagram presented in three dimensions.
[0440] This application also provides a terminal device, such as... Figure 19 As shown, for ease of explanation, only the parts related to the embodiments of this application are shown. For specific technical details not disclosed, please refer to the method section of the embodiments of this application. In the embodiments of this application, a computer is used as an example for illustration:
[0441] Figure 19 This is a block diagram illustrating a portion of the structure of a computer associated with the terminal device provided in an embodiment of this application. (Reference) Figure 19 The computer includes components such as a radio frequency (RF) circuit 610, a memory 620, an input unit 630, a display unit 640, a sensor 650, an audio circuit 660, a wireless fidelity (WiFi) module 670, a processor 680, and a power supply 690. Those skilled in the art will understand that... Figure 19 The computer structure shown does not constitute a limitation on the computer and may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0442] The following is combined with Figure 19 A detailed introduction to the various components of a computer:
[0443] RF circuit 610 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and processes it with processor 680; additionally, it transmits uplink data to the base station. Typically, RF circuit 610 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier (LNA), a duplexer, etc. Furthermore, RF circuit 610 can also communicate wirelessly with networks and other devices. The aforementioned wireless communication can use any communication standard or protocol, including but not limited to Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), etc.
[0444] The memory 620 can be used to store software programs and modules. The processor 680 executes various computer functions and data processing by running the software programs and modules stored in the memory 620. The memory 620 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the computer (such as audio data, telephone directory, etc.). In addition, the memory 620 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.
[0445] The input unit 630 can be used to receive input numerical or character information, and to generate key signal inputs related to user settings and function control of the computer. Specifically, the input unit 630 may include a touch panel 631 and other input devices 632. The touch panel 631, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel 631), and drive the corresponding connection devices according to a pre-set program. Optionally, the touch panel 631 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to the processor 680, and can also receive and execute commands sent by the processor 680. In addition, the touch panel 631 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 631, the input unit 630 may also include other input devices 632. Specifically, other input devices 632 may include, but are not limited to, one or more of the following: a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), a mouse, and a joystick.
[0446] Display unit 640 can be used to display information input by the user or information provided to the user, as well as various menus of the computer. Display unit 640 may include a display panel 641, optionally configured as a liquid crystal display (LCD), organic light-emitting diode (OLED), or similar form. Further, a touch panel 631 may cover the display panel 641. When the touch panel 631 detects a touch operation on or near it, it transmits the information to the processor 680 to determine the type of touch event. Subsequently, the processor 680 provides corresponding visual output on the display panel 641 based on the type of touch event. Although in Figure 19 In this embodiment, the touch panel 631 and the display panel 641 are two separate components to realize the input and output functions of the computer. However, in some embodiments, the touch panel 631 and the display panel 641 can be integrated to realize the input and output functions of the computer.
[0447] The computer may also include at least one sensor 650, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 641 according to the ambient light level, and the proximity sensor can turn off the display panel 641 and / or the backlight when the computer is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used for applications that recognize the computer's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition functions (such as pedometers, taps), etc. Other sensors that may be configured in the computer, such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.
[0448] Audio circuit 660, speaker 661, and microphone 662 provide an audio interface between the user and the computer. Audio circuit 660 converts received audio data into electrical signals and transmits them to speaker 661, where speaker 661 converts them into sound signals for output. On the other hand, microphone 662 converts collected sound signals into electrical signals, which are received by audio circuit 660, converted into audio data, and then output to processor 680 for processing. The audio data is then transmitted via RF circuit 610 to, for example, another computer, or output to memory 620 for further processing.
[0449] WiFi is a short-range wireless transmission technology. A computer using a WiFi module 670 can help users send and receive emails, browse web pages, and access streaming media, providing wireless broadband internet access. Although Figure 19WiFi module 670 is shown, but it is understood that it is not an essential component of a computer and can be omitted as needed without changing the essence of the invention.
[0450] Processor 680 is the control center of the computer, connecting various parts of the computer through various interfaces and lines. It performs various computer functions and processes data by running or executing software programs and / or modules stored in memory 620, and by calling data stored in memory 620. Optionally, processor 680 may include one or more processing units; optionally, processor 680 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the aforementioned modem processor may also not be integrated into processor 680.
[0451] The computer also includes a power supply 690 (such as a battery) that supplies power to various components. Optionally, the power supply can be logically connected to the processor 680 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system.
[0452] Although not shown, the computer may also include a camera, Bluetooth module, etc., which will not be described in detail here.
[0453] The steps performed by the terminal device in the above embodiments can be based on this Figure 19 The terminal device structure is shown.
[0454] This application also provides a computer device, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, it implements the steps of the methods described in the foregoing embodiments.
[0455] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the methods described in the foregoing embodiments.
[0456] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the methods described in the foregoing embodiments.
[0457] It is understood that in the specific embodiments of this application, data such as user information are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0458] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0459] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between apparatuses or units through some interfaces, and may be electrical, mechanical, or other forms.
[0460] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0461] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0462] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a server or terminal device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing computer programs, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0463] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.
Claims
1. A method for color correction, characterized in that, include: Obtain the original source video, wherein the original source video includes multiple original video frames, each original video frame includes at least one color block, and each color block in the original video frame corresponds to an original code value in a standard color map; Control the target display screen to play the original source video; The material sampling video is obtained by the memory card from the image acquisition device. The material sampling video is obtained by the image acquisition device capturing the original material video displayed on the target display screen. The material sampling video includes multiple sampling video frames, each sampling video frame includes at least one color block, and each color block in the sampling video frame corresponds to a sampling code value in the display color. Based on the original source video and the sampled source video, a target lookup table is generated, wherein the target lookup table is used to reflect the mapping relationship between the display color of the target display screen and the standard color map; According to the target lookup table, the image data to be displayed on the target display screen is color corrected.
2. The method according to claim 1, characterized in that, The acquisition of the original source video includes: Obtain a standard color map, wherein the standard color map includes T sampling points, each sampling point corresponds to a raw code value in the standard color map, and T is an integer greater than 1; Based on the original code value corresponding to each sampling point in the standard color map, T color blocks are generated, wherein each color block has a one-to-one correspondence with each sampling point; For each color patch, generate the corresponding original video frame for each color patch; The original source video is generated based on the original video frame corresponding to each color block.
3. The method according to claim 1, characterized in that, The acquisition of the original source video includes: Obtain a standard color map, wherein the standard color map includes T sampling points, each sampling point corresponds to a raw code value in the standard color map, and T is an integer greater than 1; Based on the original code value corresponding to each sampling point in the standard color map, T color blocks are generated, wherein each color block has a one-to-one correspondence with each sampling point; The T color blocks are divided into at least two color block groups, wherein each color block group includes K color blocks, and the K sampling points corresponding to the K color blocks are adjacent in the standard color diagram, wherein K is an integer greater than 1; For each color patch group, generate the original video frame corresponding to each color patch group; The original source video is generated based on the original video frames corresponding to each color block group.
4. The method according to claim 3, characterized in that, The method further includes: Based on each sampling point in the standard color map, T identification information is generated, wherein the identification information in the T identification information is used to identify the sampling point; Based on the T recognition information, generate target recognition information corresponding to each color block group; The step of generating the original video frame corresponding to each color patch group includes: For each color block group and the corresponding target recognition information, generate the original video frame corresponding to each color block group.
5. The method according to claim 1, characterized in that, After generating the target lookup table based on the original source video and the sampled source video, the method further includes: Obtain the color palette corresponding to the target color gamut, wherein the color palette includes N sampled color blocks, each sampled color block corresponds to a standard code value, and N is an integer greater than 1; Based on the standard code value corresponding to each sampled color block, control the target display screen to play N material color block images; The image acquisition device acquires N sampled color block images, wherein the N sampled color block images are obtained by the image acquisition device capturing the N source color block images displayed on the target display screen; Based on the N sampled color patch images and the N source color patch images, determine the color deviation value; If the color deviation value is less than or equal to the deviation value threshold, then the step of color correction of the image data to be displayed on the target display screen according to the target lookup table is executed.
6. The method according to claim 5, characterized in that, The step of determining the color deviation value based on the N sampled color patch images and the N source color patch images includes: Based on the N sampled color block images and the N source color block images, N sets of comparison images are constructed, wherein each set of comparison images includes sampled color block images and source color block images with corresponding relationships; For each of the N sets of comparison images, obtain the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image. The sampled color coordinates are obtained by converting the sampled code value of the sampled color block image, and the standard color coordinates are obtained by converting the standard code value. For each of the N sets of comparison images, the target deviation value is calculated based on the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image. The color deviation value is determined based on the target deviation value of each of the N sets of comparison images.
7. The method according to claim 5, characterized in that, The method further includes: Based on each sampled color patch, N identification information are generated, wherein the identification information in the N identification information is used to identify the sampled color patch; The step of controlling the target display screen to play N source color block images based on the standard code value corresponding to each sampled color block includes: Based on the standard code value and corresponding identification information corresponding to each sampled color block, the target display screen is controlled to play N material color block images and the N identification information.
8. The method according to claim 5, characterized in that, The method further includes: Obtain the standard code values corresponding to M sampled extreme value color patches, where M is an integer greater than or equal to 1; Based on the standard code value corresponding to each sample extreme value color block, control the target display screen to play M material color block images; Acquire M sampled color block images captured by the image acquisition device, wherein the M sampled color block images are obtained by the image acquisition device capturing the M source color block images displayed on the target display screen; The step of determining the color deviation value based on the N sampled color patch images and the N source color patch images includes: The color deviation value is determined based on the N sampled color patch images, the M sampled color patch images, the N source color patch images, and the M source color patch images.
9. The method according to claim 8, characterized in that, The step of determining the color deviation value based on the N sampled color patch images, the M sampled color patch images, the N source color patch images, and the M source color patch images includes: Based on the N sampled color block images, the M sampled color block images, the N source color block images, and the M source color block images, construct (N+M) sets of comparison images, wherein each set of comparison images includes sampled color block images and source color block images with corresponding relationships; For each group of comparison images in the (N+M) groups of comparison images, obtain the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image, wherein the sampled color coordinates are obtained based on the sampled code value of the sampled color block image, and the standard color coordinates are obtained based on the standard code value. For each of the (N+M) sets of comparison images, the target deviation value is calculated based on the sampled color coordinates corresponding to the sampled color block image and the standard color coordinates corresponding to the source color block image. The color deviation value is determined based on the target deviation value of each group of comparison images in the (N+M) groups of comparison images.
10. The method according to claim 8, characterized in that, The method further includes: Based on the standard code value corresponding to each sample extreme value color block, M identification information are generated, wherein the identification information in the M identification information is used to identify the standard code value; The step of controlling the target display screen to play M source color block images based on the standard code value corresponding to each sampled extreme value color block includes: Based on the standard code value corresponding to each sample extreme value color block and the corresponding identification information, the target display screen is controlled to play M material color block images and the M identification information.
11. The method according to any one of claims 5 to 10, characterized in that, The method further includes: If the color deviation value is greater than the deviation value threshold, then according to the original code value corresponding to each sampling point in the standard color map, the target display screen is controlled to play multiple color block images, wherein each color block image displays at least one color block; Multiple target sampling images acquired by the image acquisition device are obtained, wherein the image acquisition device and the target display screen are respectively electrically connected to a synchronous phase-locked Genlock signal generator, and the Genlock signal generator is used to lock the image acquisition device and the target display screen at the same frequency; The target lookup table is updated based on the multiple target sample images and the multiple color block images.
12. The method according to claim 1, characterized in that, The method further includes: Output a color calibration report, wherein the color calibration report includes at least one of the following: a first color deviation value, a second color deviation value, the improvement of color calibration effect, the estimated position of white point, the color gamut estimation result, the gamma correction chart, and the lookup table transformation chart; The first color deviation value represents the color deviation value before color calibration; The second color deviation value represents the color deviation value after color calibration; The improvement in color calibration effect refers to the degree of change in color deviation value between before and after color calibration. The estimated position of the white dot represents the color coordinates corresponding to the white dot; The color gamut estimation result represents the estimated color gamut size before and after color calibration, as well as the comparison result between the color gamut before and after color calibration and the standard color map space; The gamma correction diagram represents a simulated view of the gamma curve of the target display screen before and after color calibration. The lookup table transformation diagram represents a color direction change diagram presented in three dimensions.
13. A color correction device, characterized in that, include: The acquisition module is used to acquire the original source video, wherein the original source video includes multiple original video frames, each original video frame includes at least one color block, and each color block in the original video frame corresponds to an original code value in a standard color map; The control module is used to control the target display screen to play the original video footage; The acquisition module is further configured to acquire the material sampling video captured by the image acquisition device through the memory card, wherein the material sampling video is obtained by the image acquisition device capturing the original material video displayed on the target display screen, the material sampling video includes multiple sampling video frames, each sampling video frame includes at least one color block, and each color block in the sampling video frame corresponds to a sampling code value in the display color; The generation module is used to generate a target lookup table based on the original source video and the sampled source video, wherein the target lookup table is used to reflect the mapping relationship between the display color of the target display screen and the standard color map; The calibration module is used to perform color calibration on the image data to be displayed on the target display screen according to the target lookup table.
14. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 12.
15. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 12.
16. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 12.
Citation Information
Patent Citations
Imaging device and method of processing imaging result in imaging device
CN101272507A
Method and device for adjusting picture colors of electronic equipment
CN112530382A