Color calibration method and device, computer device and computer readable storage medium

Abstract

The application relates to a color calibration method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: acquiring first pictures corresponding to a first color space, which are respectively generated based on pure colors; converting the brightness of each first picture from the first color space to a second color space to obtain each second picture in the second color space, so as to display each second picture through a display device; acquiring shooting pictures corresponding to a third color space, which are obtained by shooting each second picture displayed by the display device; converting each shooting picture from the third color space to the first color space to obtain shooting color information corresponding to each shooting picture in the first color space; determining color calibration information based on the difference between each shooting color information and standard color information of the first color space; and the color calibration information is used for color calibration of a to-be-calibrated picture. The method can accurately determine the color calibration information used for calibrating the color of a picture.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a color calibration method and device, computer equipment, storage medium and computer program product. BACKGROUND

[0002] With the development of computer technology, the camera equipment for shooting and the display equipment for displaying information are more and more popular. Users can display the images or videos obtained by shooting through the display equipment to enlarge the images or videos, so as to facilitate users to watch or perform related operations.

[0003] However, the color ranges corresponding to different shooting equipment and display equipment are different, so when the display equipment is used to display the images obtained by the shooting equipment, the color of the images displayed by the display equipment and the color of the images generated by the shooting equipment are obviously different. SUMMARY

[0004] Therefore, it is necessary to provide a color calibration method, device, computer equipment, computer readable storage medium and computer program product, which can effectively calibrate the color of the shot picture.

[0005] In a first aspect, the present application provides a color calibration method. The method comprises:

[0006] obtaining a first picture respectively generated based on each pure color, the first picture corresponding to a first color space;

[0007] converting the brightness of each first picture from the first color space to a second color space to obtain each second picture in the second color space, so as to display each second picture through a display equipment;

[0008] obtaining a shot picture obtained by shooting each second picture displayed by the display equipment, the shot picture corresponding to a third color space;

[0009] converting each shot picture from the third color space to the first color space to obtain the shot color information corresponding to each shot picture in the first color space;

[0010] determining color calibration information based on the difference between each shot color information and the standard color information of the first color space; the color calibration information is used for color calibration of a to-be-calibrated picture.

[0011] In a second aspect, the present application further provides a color calibration device. The device comprises:

[0012] The acquisition module is configured to acquire a first picture respectively generated based on each pure color, the first picture corresponding to a first color space;

[0013] The display module is configured to convert the brightness of each first picture from the first color space to a second color space to obtain each second picture in the second color space, and display each second picture through a display device.

[0014] The shooting module is configured to acquire a shooting picture obtained by shooting each second picture displayed by the display device, the shooting picture corresponding to a third color space.

[0015] The conversion module is configured to convert each shooting picture from the third color space to the first color space to obtain shooting color information corresponding to each shooting picture in the first color space.

[0016] The determination module is configured to determine color calibration information based on a difference between each shooting color information and standard color information of the first color space, the color calibration information being used for color calibration of a to-be-calibrated picture.

[0017] In an embodiment, the display module is further configured to respectively perform encoding processing on the brightness of each first picture in the first color space to obtain an encoding signal corresponding to the second color space, respectively perform decoding processing on each encoding signal in the second color space to obtain each second picture in the second color space, and display each second picture through the display device.

[0018] In an embodiment, the shooting module is further configured to shoot each second picture displayed by the display device through a camera corresponding to the third color space, and receive a shooting picture obtained by shooting of the camera in real time.

[0019] In an embodiment, the conversion module is further configured to respectively perform key point sampling processing on each shooting picture to obtain a key point corresponding to each shooting picture, determine intermediate color information corresponding to each shooting picture based on original color information of each key point corresponding to the corresponding shooting picture for each shooting picture, and respectively convert each intermediate color information to the first color space to obtain shooting color information corresponding to each shooting picture in the first color space.

[0020] In an embodiment, the conversion module is further configured to determine a center point of each shooting picture, perform sampling processing in a plurality of directions with each center point as an origin to obtain a sampling point, and take each center point and each sampling point as a key point corresponding to the corresponding shooting picture.

[0021] In one embodiment, the conversion module is further configured to perform luminance conversion processing on the intermediate color information to obtain intermediate color information with linear luminance; and perform color conversion processing on the intermediate color information with linear luminance to obtain the corresponding shooting color information of the shooting picture in the first color space.

[0022] In one embodiment, the conversion module is further configured to obtain a luminance mapping relationship, the luminance mapping relationship representing a conversion relationship between the original type and the linear type of luminance; and convert the luminance of the intermediate color information from the original type to the linear type by using the luminance mapping relationship to obtain the intermediate color information with linear luminance.

[0023] In one embodiment, the device further comprises:

[0024] The calibration module is configured to perform calibration processing on the original picture generated based on each pure color in the next round by using the color calibration information.

[0025] The return module is configured to return the picture obtained by the calibration processing as a first picture, and return to the step of converting the luminance of each first picture from the first color space to the second color space and continue to execute until the color calibration information of the next round is obtained.

[0026] The screening module is configured to screen the color calibration information meeting the calibration condition from the color calibration information obtained in each round as target calibration information; and the target calibration information is used for color calibration on the picture to be calibrated.

[0027] In one embodiment, the picture to be calibrated is a virtual scene picture, and the device further comprises:

[0028] The calibration module is configured to calibrate the virtual scene picture by using the target calibration information to obtain a calibrated picture; and the calibrated picture corresponds to the first color space.

[0029] The display module is further configured to convert the luminance of the calibrated picture from the first color space to the second color space, so as to display the virtual display picture converted to the second color space by using the display device.

[0030] The shooting module is further configured to obtain a fusion picture obtained by simultaneously shooting the virtual display picture and the real scene, the fusion picture corresponding to a third color space.

[0031] The conversion module is further configured to convert the fusion picture from the third color space to the first color space to obtain a target scene picture.

[0032] In an embodiment, the real scene includes a real prop; and the photographing module is further configured to

[0033] The camera obtains a fusion picture which is synthesized by simultaneously capturing the virtual display picture and the real prop placed in front of the virtual display picture.

[0034] In an embodiment, the pure colors include red, green, blue and white, the first color space is a standard red-green-blue color space, the second color space is a perceptual quantization color space, the display device is a light-emitting diode display screen, the third color space is a color space corresponding to a camera used to capture the second pictures, and the standard color information includes information about standard red, standard green, standard blue and standard white in the standard red-green-blue color space.

[0035] In a third aspect, the present application provides a computer device. The computer device includes a memory and a processor. The memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0036] obtaining first pictures respectively generated based on pure colors, the first pictures corresponding to a first color space;

[0037] converting the brightness of each of the first pictures from the first color space to a second color space to obtain second pictures in the second color space, so as to display each of the second pictures by using a display device;

[0038] obtaining photographing pictures obtained by photographing each of the second pictures displayed by the display device, the photographing pictures corresponding to a third color space;

[0039] converting each of the photographing pictures from the third color space to the first color space to obtain photographing color information respectively corresponding to each of the photographing pictures in the first color space;

[0040] determining color calibration information based on the difference between each of the photographing color information and standard color information of the first color space, the color calibration information being used for color calibration of a to-be-calibrated picture.

[0041] obtaining first pictures respectively generated based on pure colors, the first pictures corresponding to a first color space;

[0042] The brightness of each of the first images is converted from the first color space to the second color space to obtain each of the second images in the second color space, so as to display each of the second images through the display device;

[0043] Acquire captured images obtained by capturing each of the second images displayed on the display device, wherein the captured images correspond to a third color space;

[0044] Each of the captured images is converted from the third color space to the first color space to obtain the captured color information corresponding to each of the captured images in the first color space;

[0045] Based on the difference between the captured color information and the standard color information of the first color space, color calibration information is determined; the color calibration information is used to perform color calibration on the image to be calibrated. Fifthly, this application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, performs the following steps:

[0046] Obtain the first image generated based on each pure color, and the first image corresponds to the first color space;

[0047] The brightness of each of the first images is converted from the first color space to the second color space to obtain each of the second images in the second color space, so as to display each of the second images through the display device;

[0048] Acquire captured images obtained by capturing each of the second images displayed on the display device, wherein the captured images correspond to a third color space;

[0049] Each of the captured images is converted from the third color space to the first color space to obtain the captured color information corresponding to each of the captured images in the first color space;

[0050] Based on the difference between the captured color information and the standard color information of the first color space, color calibration information is determined; the color calibration information is used to perform color calibration on the image to be calibrated. The aforementioned color calibration method, apparatus, computer equipment, storage medium, and computer program product acquire first images generated based on each pure color, each first image corresponding to a first color space. The brightness of each first image is converted from the first color space to a second color space to obtain second images in the second color space, enabling the display device to accurately present the color information of each second image and avoiding color differences caused by the display device directly displaying the first image. Alternatively, images are acquired by capturing each second image displayed on the display device, each image corresponding to a third color space. Each captured image is converted from the third color space to the first color space to obtain the captured color information corresponding to each captured image in the first color space. This allows for accurate determination of color calibration information based on the difference between the captured color information and the standard color information of the first color space, enabling accurate color calibration of the image to be calibrated. This ensures that the images displayed on different devices maintain color consistency, effectively reducing color differences caused by images displayed on different devices. Attached Figure Description

[0051] Figure 1 This is a diagram illustrating the application environment of the color calibration method in one embodiment;

[0052] Figure 2 This is a flowchart illustrating a color calibration method in one embodiment;

[0053] Figure 3 This is a flowchart illustrating the steps of selecting color calibration information that meets the calibration conditions as target calibration information in one embodiment.

[0054] Figure 4 This is a flowchart illustrating the color calibration method in another embodiment;

[0055] Figure 5 This is a schematic diagram of the brightness conversion curve of the sRGB color space in one embodiment;

[0056] Figure 6 This is a schematic diagram of the PQ curve in one embodiment;

[0057] Figure 7 This is a schematic diagram of the logc color space in one embodiment;

[0058] Figure 8 This is a schematic diagram of the sRGB color space in one embodiment;

[0059] Figure 9This is a comparative illustration of the captured images obtained with and without calibration of the target color image in one embodiment;

[0060] Figure 10 This is a flowchart illustrating the color calibration method in another embodiment;

[0061] Figure 11 This is a structural block diagram of a color calibration device in one embodiment;

[0062] Figure 12 This is a structural block diagram of the color calibration device in another embodiment;

[0063] Figure 13 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0064] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0065] The embodiments of this application can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart transportation, and assisted driving. For example, it can be applied to the field of artificial intelligence (AI) technology, where AI is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results. In other words, AI is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new kind of intelligent machine that can react in a way similar to human intelligence. AI studies the design principles and implementation methods of various intelligent machines, enabling them to have the functions of perception, reasoning, and decision-making. The solutions provided in the embodiments of this application relate to color calibration methods for artificial intelligence, which are specifically described through the following embodiments.

[0066] The color calibration method provided in this application embodiment can be applied to, for example... Figure 1In the application environment shown, terminal 102 communicates with server 104 via a network. A data storage system can store the data that server 104 needs to process. The data storage system can be integrated on server 104 or placed in the cloud or on another server. Both terminal 102 and server 104 can independently execute the color calibration method provided in this embodiment. Terminal 102 and server 104 can also work together to execute the color calibration method provided in this embodiment. When terminal 102 and server 104 work together to execute the color calibration method provided in this embodiment, terminal 102 acquires a first image generated based on each pure color, the first image corresponding to a first color space, and transmits the first image to server 104. Server 104 converts the brightness of each first image from the first color space to a second color space to obtain second images in the second color space, which are then displayed on a display device. Terminal 102 takes a picture of each second image displayed on the display device and transmits the captured image to server 104; the captured image corresponds to a third color space. Server 104 converts each captured image from the third color space to the first color space, obtaining the captured color information corresponding to each image in the first color space. Based on the difference between the captured color information and the standard color information in the first color space, server 104 determines color calibration information and returns it to terminal 102; the color calibration information is used to perform color calibration on the image to be calibrated. Terminal 102 can be, but is not limited to, various desktop computers, laptops, smartphones, tablets, smart voice interaction devices, smart home appliances, vehicle terminals, aircraft, etc. Applications can run on terminal 102, including communication applications, audio / video applications, and image processing applications. Server 104 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0067] It should be noted that the quantities of "multiple" mentioned in the embodiments of this application all refer to the quantity of "at least two".

[0068] In one embodiment, such as Figure 2 As shown, a color calibration method is provided, which is applied to... Figure 1 Computer equipment (computer equipment can be) Figure 1 Taking a terminal or server as an example, the following steps are included:

[0069] Step S202: Obtain the first image generated based on each pure color, which corresponds to the first color space.

[0070] Pure color refers to a single color. Specifically, pure color can be the three primary colors, as well as white, which is composed of the three primary colors: red, green, and blue.

[0071] Color is the human eye's perception of different frequencies of light. A color space, also known as a "color gamut," refers to the range of colors that a particular color model can represent. In color theory, various color models are established to represent a color using one-dimensional, two-dimensional, three-dimensional, or even four-dimensional coordinate systems. The range of colors defined by this coordinate system is called the color space. Examples of color spaces include RGB, CMYK, and Lab color spaces, but are not limited to these. Different devices may use different color models, thus displaying their respective images through their respective color spaces. An image is the picture presented on a device, such as a picture captured by a terminal or displayed on a device. The first image is the picture presented through the color range defined by the first color space.

[0072] Specifically, the computer device can generate a first image corresponding to each different pure color based on the first color space, thus obtaining a first image corresponding to each pure color.

[0073] In one embodiment, the terminal can generate a first image corresponding to a pure color based on a first color space, and the first image corresponds to the first color space. For different pure colors, the terminal generates a corresponding image for each pure color based on the first color space, thus obtaining a first image corresponding to each pure color.

[0074] Step S204: Convert the brightness of each first image from the first color space to the second color space to obtain each second image in the second color space, so as to display each second image through the display device.

[0075] The second color space differs from the first color space. The second color space is the color space used by the display device to present the color information of the image; that is, the display device uses the second color space to present the color information of the image. The second image is a picture presented using the second color space.

[0076] Hue, chroma (also called color intensity or saturation), and lightness are known as the three elements of color. Color information includes hue, chroma, and lightness. Hue refers to the appearance of a color, a name that accurately represents a particular hue, such as rose red, orange, or lemon yellow. Color chroma refers to the vividness or saturation of a color; it indicates the proportion of colored components in the color. The greater the proportion of colored components, the higher the color chroma; the smaller the proportion, the lower the color chroma. Lightness refers to the brightness or darkness of a color. Different colored objects produce varying degrees of lightness or darkness due to differences in the amount of light they reflect.

[0077] Specifically, the computer equipment needs to display the first image corresponding to each pure color through the display device, and the display device needs to present the color information of the image through the second color space.

[0078] The first and second color spaces define lightness differently. When converting from the first color space to the second color space, the color information of the image remains unchanged, but the lightness information of the image will change. The color information of an image refers to the hue and saturation of the colors, while the lightness information is the brightness of the colors.

[0079] The computer device converts the brightness of each first image from a first color space to a second color space. It then redefines the brightness of each first image using the second color space of the display device, obtaining the corresponding brightness of each first image in the second color space. This results in the various second images displayed in the second color space.

[0080] Step S206: Obtain the captured images obtained by taking pictures of each second screen displayed on the display device, and the captured images correspond to the third color space.

[0081] The third color space differs from both the first and second color spaces. The first, second, and third color spaces each represent a different range of colors.

[0082] The third color space is the color space used by a shooting device to display the color information of an image. In other words, the shooting device uses the third color space to display the color information of the captured image. The captured image is presented using the third color space.

[0083] Specifically, the computer device displays various second screens through a display device, and takes pictures of each second screen displayed by the camera to obtain corresponding captured images. The camera presents the color information of the captured images through a third color space, so the camera corresponds to the third color space, and the images captured by the camera also correspond to the third color space.

[0084] Step S208: Convert each captured image from the third color space to the first color space to obtain the captured color information corresponding to each captured image in the first color space.

[0085] Specifically, the computer equipment converts each captured image from the third color space to the first color space, so as to convert the color information corresponding to each captured image from the third color space to the first color space, thereby obtaining the captured color information corresponding to each captured image in the first color space.

[0086] Step S210: Based on the difference between each captured color information and the standard color information of the first color space, determine color calibration information; this color calibration information is used to perform color calibration on the image to be calibrated.

[0087] Specifically, the first color space defines standard color information, which includes at least one of standard red color information, standard green color information, standard blue color information, and standard white color information.

[0088] The computer equipment acquires standard color information in a first color space and compares it with the color information captured in various photographs to determine the differences between them. Based on these differences, the computer equipment determines corresponding color calibration information. This color calibration information is used to perform color calibration on the image to be calibrated, converting the calibrated image into one that the display device can display, ensuring that the image displayed on the device maintains color consistency with the image to be calibrated.

[0089] In one embodiment, the method further includes: calibrating the virtual scene image using color calibration information to obtain a calibration image; the calibration image corresponds to a first color space; converting the brightness of the calibration image from the first color space to a second color space, so as to display the virtual display image converted to the second color space through a display device; acquiring a fused image obtained by simultaneously capturing the virtual display image and the real scene, the fused image corresponding to a third color space; and converting the fused image from the third color space to the first color space to obtain the target scene image.

[0090] In this embodiment, a first image generated based on each pure color is acquired, corresponding to a first color space. The brightness of each first image is converted from the first color space to a second color space to obtain second images in the second color space. This allows the display device to accurately present the color information of each second image, avoiding color differences caused by the display device directly displaying the first image. Captured images obtained by photographing each second image displayed on the display device are acquired, corresponding to a third color space. Each captured image is converted from the third color space to the first color space to obtain the captured color information corresponding to each captured image in the first color space. Based on the difference between the captured color information and the standard color information of the first color space, color calibration information can be accurately determined. This allows for accurate color calibration of the image to be calibrated, ensuring color consistency across images displayed on different devices and effectively reducing color differences caused by images displayed on different devices.

[0091] In one embodiment, the brightness of each first image is converted from a first color space to a second color space to obtain each second image in the second color space, and then displayed on a display device, including:

[0092] The brightness of each first image in the first color space is encoded to obtain the corresponding encoded signal in the second color space; each encoded signal is decoded in the second color space to obtain each second image in the second color space; and each second image is displayed through a display device.

[0093] Specifically, the computer device determines the brightness of each first image in a first color space and encodes each brightness separately to convert it to a second color space, obtaining the encoded signals corresponding to each brightness in the first color space in the second color space. The computer device can then decode each encoded signal in the second color space to obtain the brightness in the second color space. By replacing the brightness in each first image with the corresponding brightness in the second color space, the computer device obtains the second images in the second color space. The computer device can then display the second images via a display device. Furthermore, the computer device can transmit the second images in the second color space to the display device, which receives and displays them.

[0094] In one embodiment, the display device may display each of the second screens sequentially.

[0095] In this embodiment, the brightness of each first image in the first color space is encoded to obtain the corresponding encoded signal in the second color space. Each encoded signal is then decoded in the second color space to obtain each second image in the second color space. This allows the brightness to be converted from the first color space to the second color space through encoding and decoding of the brightness information, thereby converting the brightness of the first image into a brightness that the display device can display within its color range. This enables the display device to accurately control the brightness of the displayed image and ensures that the display effect of the second image displayed by the display device is consistent with that of the generated first image, avoiding significant color differences.

[0096] In one embodiment, acquiring captured images obtained by capturing images of each second screen displayed on the display device includes:

[0097] The camera captures images of each second screen displayed on the display device and receives the captured images in real time. The camera corresponds to a third color space.

[0098] The camera can be a standalone camera device or a camera installed in a terminal and dependent on the terminal for operation.

[0099] Specifically, the computer device can use a camera to capture images of each second screen displayed on the display device, and receive the captured images in real time. The camera presents the color information of the captured images using a third color space; therefore, the camera corresponds to the third color space, and the images captured by the camera correspond to the third color space.

[0100] In one embodiment, the display device can sequentially display various second screens. After each second screen is displayed, the computer device can capture a picture of the displayed second screen using a camera to obtain the corresponding captured image. The captured image is transmitted to the computer device in real time.

[0101] In one embodiment, when the computer device is a terminal, the terminal can take pictures of each second screen displayed on the display device using its own camera, and receive the pictures in real time. Alternatively, the terminal can take pictures of each second screen displayed on the display device using the camera of another device, and receive the pictures in real time.

[0102] In one embodiment, the computer device can be connected to a camera via a data cable to transmit the images captured by the camera in real time.

[0103] In this embodiment, the camera corresponds to the third color space. The camera captures images of each second screen displayed on the display device and receives the captured images in real time to improve processing efficiency.

[0104] In one embodiment, each captured image is converted from a third color space to a first color space to obtain the captured color information corresponding to each captured image in the first color space, including:

[0105] Keypoint sampling is performed on each captured image to obtain the keypoints corresponding to each captured image. For each captured image, the intermediate color information corresponding to each captured image is determined based on the original color information of each keypoint corresponding to the captured image. The intermediate color information is converted to the first color space to obtain the captured color information corresponding to each captured image in the first color space.

[0106] Specifically, for each captured frame, the computer device performs keypoint sampling processing on the frame to collect multiple keypoints from the frame, obtaining multiple keypoints corresponding to each frame. The computer device determines the original color information of each keypoint in its respective frame, and calculates the intermediate color information corresponding to that frame based on the original color information of multiple keypoints in the frame.

[0107] The captured image presents color information through a third color space. This color information includes chromatic aspects; therefore, the original color information corresponding to key points in the captured image is presented through this third color space. Intermediate color information is determined based on the original color information of the key points, and thus also corresponds to the third color space. The computer device converts each intermediate color information from the third color space to the first color space to obtain its corresponding captured color information. Using the same processing method, the computer device can obtain the captured color information corresponding to each captured image.

[0108] In one embodiment, for each captured image, based on the original color information of each key point corresponding to the captured image, the intermediate color information corresponding to each captured image is determined, including: for each captured image, the original color information of each key point corresponding to the captured image is averaged to obtain the average color information corresponding to each captured image, and the average color information corresponding to the captured image is used as the intermediate color information of the captured image.

[0109] In this embodiment, keypoint sampling is performed on each captured image to obtain keypoints corresponding to each image. For each captured image, based on the original color information of each keypoint, intermediate color information is determined. Determining the intermediate color information of the captured image using color information from multiple keypoints is more reliable and avoids the lack of universality in the processing results due to single data. Each intermediate color information is converted to a first color space to obtain the captured color information corresponding to each captured image in the first color space. Based on the difference between the captured color information in the first color space and the standard color information in the first color space, color calibration information that can calibrate the captured color information to the standard color information is accurately determined.

[0110] In one embodiment, keypoint sampling processing is performed on each captured frame to obtain keypoints corresponding to each captured frame, including:

[0111] Determine the center point of each captured image; perform sampling processing in multiple directions with each center point as the origin to obtain each sampling point; use each center point and each sampling point as the key point corresponding to the captured image.

[0112] Specifically, the computer device can determine the center point of the captured image, which is a key point at the center of the captured image. The computer device can determine multiple directions in the captured image with the center point as the origin, and perform sampling processing in each of the multiple directions to obtain at least one sampling point in each direction. Furthermore, the computer device can determine multiple scattering directions in the captured image with the center point as the origin, and collect at least one point in each scattering direction to obtain sampling points in each scattering direction.

[0113] The computer device uses the center point of the captured image and the corresponding sampling points in each direction as the key points of the captured image.

[0114] In one embodiment, the center point of each captured image corresponds to multiple directions that are the same. For example, the center point of each captured image corresponds to 8 scattering directions, such as due north, due east, and 45 degrees south of north of the center point, but is not limited to these.

[0115] In this embodiment, the center point of each captured image is determined, and sampling is performed in multiple directions with each center point as the origin to obtain sampling points in different directions, ensuring the consistency of each sampling point in the directional dimension. Each center point and each sampling point is used as a key point corresponding to the captured image, making the color information of the collected multiple key points more reliable. Therefore, the results obtained from subsequent processing using the original color information of multiple key points are more reliable, effectively avoiding the problem of inaccurate color calibration information due to inaccurate color information of a single key point.

[0116] In one embodiment, each intermediate color information is converted to a first color space to obtain the shooting color information corresponding to each captured image in the first color space, including:

[0117] The intermediate color information is converted to obtain the intermediate color information with linear brightness; the intermediate color information with linear brightness is converted to obtain the shooting color information corresponding to each shooting scene in the first color space.

[0118] Specifically, the brightness corresponding to each intermediate color information is of the original type, and the brightness of the original type is used for storage and data transmission. However, in actual processing, the brightness of the linear type is used for screen display, calculation processing, etc., so the computer device needs to convert the brightness of the intermediate color information from the original type to the linear type.

[0119] Primitive and linear types are two different representations of brightness. Primitive type refers to the storage format corresponding to the brightness when the image is stored, while linear type refers to the display format of the image brightness when it is displayed. Primitive type brightness refers to the value of the brightness in a certain storage format when the image is stored, such as the value corresponding to the brightness stored as an 8-bit integer. Linear type brightness refers to the actual brightness presented by the image when it is displayed.

[0120] The computer equipment determines the brightness corresponding to each intermediate color information and performs brightness conversion processing on each brightness to convert each brightness from the original type to the linear type, thus obtaining each intermediate color information with linear brightness.

[0121] The captured image corresponds to color information in the third color space. Therefore, the original color information corresponding to the key points in the captured image is the color information in the third color space. Intermediate color information is determined based on the original color information of the key points, and thus also corresponds to the third color space. The computer device performs color conversion processing on each intermediate color information with linear brightness, converting each intermediate color information from the third color space to the first color space, obtaining the captured color information corresponding to each captured image in the first color space. This captured color information is the color information in the first color space, and the brightness of this captured color is linear.

[0122] It is understandable that color information remains unchanged during brightness conversion, and brightness does not change during color conversion.

[0123] In this embodiment, the intermediate color information undergoes brightness conversion processing to obtain intermediate color information with linear brightness, which converts the brightness under the storage format into brightness that can be used for data calculation. The intermediate color information with linear brightness is then subjected to color conversion processing to transform it from the third color space to the first color space, accurately obtaining the shooting color information corresponding to each captured image in the first color space. By first performing brightness conversion and then color conversion on the brightness-converted color information, data in the third color space can be accurately mapped to the first color space.

[0124] In one embodiment, the intermediate color information is subjected to brightness conversion processing to obtain intermediate color information with linear brightness, including:

[0125] Obtain the brightness mapping relationship, which represents the conversion relationship between the original type and the linear type of brightness; through the brightness mapping relationship, convert the brightness of each intermediate color information from the original type to the linear type, and obtain each intermediate color information with linear brightness.

[0126] Specifically, computer devices store conversion relationships between different brightness types, such as the conversion relationship between primitive and linear types. This conversion relationship between primitive and linear types is called a brightness mapping relationship. Primitive brightness types are used for storage and data transmission, while linear brightness types are used for actual screen display and computational processing.

[0127] The computer device can determine the luminance corresponding to each intermediate color information, and the luminance corresponding to each intermediate color information is of the original type. The computer device needs to convert the luminance of the original type into a linear type so that the linear type luminance can be used to participate in the determination of color calibration information. The computer device can obtain the luminance mapping relationship and perform conversion processing on each intermediate color information separately through the luminance mapping relationship to convert the original type of luminance of each intermediate color information into a linear type, so as to obtain each intermediate color information with linear luminance.

[0128] In this embodiment, the brightness mapping relationship represents the conversion relationship between the original type and the linear type of brightness. Through the brightness mapping relationship, the brightness of each intermediate color information can be converted from the original type to the linear type, thereby converting the brightness under the storage format into the brightness that can be used for data calculation, so that the brightness of the intermediate color information can be used to participate in the calculation, thereby combining the brightness dimension to more accurately determine the color calibration information.

[0129] In one embodiment, such as Figure 3 As shown, the method also includes:

[0130] Step S302: The original images generated based on each pure color in the next round are calibrated using color calibration information.

[0131] Specifically, after determining the color calibration information, the computer device proceeds to the next round of processing. In this next round, the computer device generates corresponding original images for different pure colors based on the first color space, resulting in original images for each pure color. The computer device can then calibrate each original image using the color calibration information to obtain calibrated images.

[0132] Step S304: Take the image obtained from the calibration process as the first image, return to the step of converting the brightness of each first image from the first color space to the second color space and continue to execute until the color calibration information for the next round is obtained.

[0133] Specifically, the computer device uses each image obtained from the calibration process as a first image, converts the brightness of each first image from a first color space to a second color space, and obtains second images in the second color space, which are then displayed on a display device. The computer device acquires images by taking pictures of each second image displayed on the display device; these images correspond to a third color space. The computer device converts each captured image from the third color space back to the first color space, obtaining the captured color information corresponding to each captured image in the first color space. Based on the difference between the captured color information and the standard color information in the first color space, the computer device determines the color calibration information, thus obtaining the color calibration information for the next round. Following the same processing method, the computer device can obtain the color calibration information determined in each round.

[0134] It is understood that the specific processing steps for determining color calibration information can be found in the above embodiments, and will not be repeated here.

[0135] In one embodiment, the computer device may stop when the number of iterations reaches a preset number, thereby obtaining a preset number of color calibration information.

[0136] Step S306: Select color calibration information that meets the calibration conditions from the color calibration information obtained in each round as target calibration information; the target calibration information is used to perform color calibration on the image to be calibrated.

[0137] The calibration conditions can be such that the difference between the captured color information in the first color space and the standard color information in the first color space is less than a difference threshold, or the color calibration information that minimizes the difference between the captured color information in the first color space and the standard color information in the first color space is selected from multiple color calibration information.

[0138] Specifically, the computer equipment acquires preset calibration conditions, matches the color calibration information obtained in each round with the calibration conditions, filters out the color calibration information that meets the calibration conditions, and uses the color calibration information that meets the calibration conditions as the target calibration information.

[0139] In this embodiment, the computer device can use the color calibration information from each round to calibrate the original images generated based on each pure color. The computer device uses each image obtained from the calibration process as a first image, converts the brightness of each first image from a first color space to a second color space, and obtains each second image in the second color space, which is then displayed through a display device. Captured images are obtained by taking pictures of each second image displayed on the display device; these captured images correspond to a third color space. Each captured image is converted from the third color space to the first color space, obtaining the captured color information corresponding to each captured image in the first color space. The computer device calculates the difference between each captured color information and the standard color information in the first color space, obtaining the difference corresponding to each round of color calibration information. The computer device can then select the color calibration information corresponding to the smallest difference from the various differences as the target calibration information.

[0140] Alternatively, the computer equipment calculates the difference between each captured color information and the standard color information in the first color space, obtaining the difference corresponding to the color calibration information for each round. Each difference is then compared to a difference threshold, and color calibration information with differences less than the threshold is selected as the target calibration information.

[0141] This target calibration information is used to perform color calibration on the image to be calibrated. After calibration, the image is converted to a different color space for display on a display device. This ensures that the image captured by the camera on the display device has the same color as the image to be calibrated, avoiding significant color differences caused by displays on different devices.

[0142] In this embodiment, color calibration information is used to calibrate the original images generated based on each pure color in the next round, thereby readjusting the color information of each original image. The image obtained after calibration is taken as the first image. The step of converting the brightness of each first image from the first color space to the second color space is returned and executed until the color calibration information for the next round is obtained. This determines whether the difference between the captured color information obtained from processing on a series of different devices after calibration and the standard color information has decreased. From the color calibration information obtained in each round, color calibration information that meets the calibration conditions is selected as target calibration information. This allows for the selection of color calibration information that minimizes or reduces the difference between the captured color information and the standard color information as the final calibration information, resulting in more accurate target calibration information. This target calibration information is used to perform color calibration on the image to be calibrated, converting the calibrated image to a different color space for display on a display device. This ensures that the captured image obtained by the camera from the displayed image maintains color consistency with the image to be calibrated, avoiding significant color differences caused by displays on different devices.

[0143] In one embodiment, such as Figure 4 As shown, the image to be calibrated is a virtual scene image, and the method further includes:

[0144] Step S402: The virtual scene image is calibrated using the target calibration information to obtain a calibration image, which corresponds to the first color space.

[0145] Specifically, the image to be calibrated is an image that presents color information through a first color space. The first color space refers to a preset color range, meaning the image to be calibrated presents color information through this predefined color range. The image to be calibrated is a virtual scene image, meaning it presents color information through the first color space. The computer device can calibrate the virtual scene image using target calibration information to obtain a calibrated image. Further, the computer device can determine the color information corresponding to the virtual scene image and calibrate that color information using the target calibration information to obtain a calibrated image. For example, if the target calibration information is represented by calibration coefficients and the color information of the virtual scene image is represented by color values, then the calibration coefficients and each color value of the virtual scene image are multiplied respectively, and the resulting color value is used to replace the corresponding color value in the virtual scene image to obtain the calibrated image.

[0146] Step S404: Convert the brightness of the calibration screen from the first color space to the second color space, so as to display the virtual display screen after conversion to the second color space through the display device.

[0147] Specifically, if the computer equipment needs to display the calibration screen through the display device, and the display device needs to present the color information of the screen through the second color space, then the brightness of the calibration screen needs to be converted from the first color space to the second color space.

[0148] The computer equipment converts the brightness of the calibration image from the first color space to the second color space, redefining the brightness of the calibration image using the second color space of the display device to obtain the corresponding brightness of the calibration image in the second color space. By replacing the brightness of the calibration image in the first color space with the corresponding brightness in the second color space, a virtual display image is obtained. The computer equipment then displays this virtual display image through the display device.

[0149] Step S406: Obtain the fused image obtained by simultaneously capturing the virtual display screen and the real scene, and the fused image corresponds to the third color space.

[0150] Specifically, the computer device displays a virtual image through a display device, which is placed within a real-world scene. The computer device simultaneously captures images of both the display device and the real-world scene using a camera, resulting in a merged image. Since the camera uses a third color space to represent the color information of the captured image, the camera corresponds to this third color space, and the merged image captured by the camera also corresponds to this third color space.

[0151] Step S408: Convert the merged image from the third color space to the first color space to obtain the target scene image.

[0152] Specifically, the computer device converts the merged image from a third color space to a first color space, thereby converting the color information corresponding to the merged image from the third color space to the first color space, and obtaining the shooting color information of the merged image in the first color space. The computer device then replaces the color information in the merged image with the shooting color information corresponding to the first color space to obtain the target scene image.

[0153] In this embodiment, the virtual scene image is calibrated using target calibration information to obtain a calibration image; the calibration image corresponds to a first color space; the brightness of the calibration image is converted from the first color space to a second color space, so that the virtual display image after conversion to the second color space is displayed on a display device; a fused image obtained by simultaneously capturing the virtual display image and the real scene is acquired, and the fused image corresponds to a third color space; the fused image is converted from the third color space to the first color space to obtain the target scene image, so that the images displayed on different devices can maintain consistency in color, thereby effectively reducing the color difference caused by displaying images on different devices.

[0154] In one embodiment, the real-world scene includes real-world props; acquiring the fused image obtained by simultaneously capturing the virtual display and the real-world scene includes:

[0155] The image is a composite image created by simultaneously capturing the virtual display screen and the real-world props placed in front of the virtual display screen using a camera.

[0156] Among them, real-life props are real props and physical props in real scenes.

[0157] Specifically, the computer device presents a virtual display image through a display device, and places real-world props in front of the virtual display image. The computer device simultaneously captures and photographs the presented virtual display image and the placed real-world props through a camera, resulting in a merged image.

[0158] In this embodiment, a fused image is obtained by simultaneously capturing the virtual display screen and the real-world props placed in front of the virtual display screen using a camera. After the real-world props and the virtual screen are merged, they can coexist in the same screen and space, thus cleverly combining virtual information with the real environment.

[0159] In one embodiment, each pure color includes red, green, blue, and white. The first color space is the standard red-green-blue color space, the second color space is the perceptual quantization color space, the display device is a light-emitting diode display screen, and the third color space is the color space corresponding to the camera that captures each second image. The standard color information includes relevant information about standard red, standard green, standard blue, and standard white in the standard red-green-blue color space.

[0160] Specifically, each pure color includes red, green, blue, and white. The first color space is the Standard Red Green Blue (sRGB) color space. The second color space is the Perceptual Quantizer (PQ) color space, and the display device is a Light-Emitting Diode (LED) display. The third color space is the color space corresponding to the camera that captures each second frame. The third color space can be a logarithmic color space, such as the LogC color space. Standard color information includes information related to standard red, standard green, standard blue, and standard white in the Standard Red Green Blue color space.

[0161] A computer device acquires first images generated based on red, green, blue, and white, each corresponding to a first color space. The brightness of each first image is converted from the first color space to a second color space, resulting in second images in the second color space. These second images, corresponding to red, green, blue, and white respectively, are displayed on a display device. Images are captured of the second images displayed on the LED display screen, corresponding to red, green, blue, and white respectively, resulting in images corresponding to red, green, blue, and white, each corresponding to a third color space. These images are converted from the third color space to the first color space, yielding the captured color information for each image in the first color space, thus obtaining the captured color information for red, green, blue, and white respectively. Based on the differences between the captured color information for red and standard red, green and standard green, blue and standard blue, and white and standard white, color calibration information is determined that can calibrate red, green, blue, and white to standard red, standard green, standard blue, and standard white.

[0162] It is understood that the specific processing procedures for color space conversion and color calibration information determination for each image corresponding to red, green, blue, and white can be found in the processing of the above embodiments, and will not be repeated here.

[0163] In this embodiment, a first image generated based on red, green, blue, and white is obtained. The brightness of the first image corresponding to red, green, blue, and white is converted from the first color space to the second color space to obtain each second image in the second color space. This enables the LED screen to accurately present the color information of each second image and avoids the color differences caused by the LED screen directly displaying the first image. The camera captures images of the second frames corresponding to red, green, blue, and white displayed on the LED screen. These images are then converted from a third color space to a first color space, yielding the captured color information for red, green, blue, and white in the first color space. Based on the differences between the captured color information for each of these colors and the standard red, green, blue, and white in the first color space, accurate color calibration information can be determined to calibrate red, green, blue, and white to standard red, green, blue, and white. This allows for accurate color calibration of red, green, blue, white, and other colors composed of these colors in the image. This ensures that color differences caused by different devices such as the terminal, LED screen, and camera are effectively canceled out, maintaining color consistency across different display devices and significantly reducing color variations caused by displaying images from different devices.

[0164] In one embodiment, a color calibration method is provided, wherein the terminal may be a computer, the display device may be an LED screen, and the camera may be a camera, including:

[0165] (1) The computer outputs four colors: red, green, blue and white.

[0166] Computers use the sRGB color space to display color information. By outputting the four pure colors (red, green, blue, and white) in the sRGB color space separately, sRGB images are generated for each pure color. The definition of sRGB encoding is as follows:

[0167]

[0168] Where L is the image brightness normalized to the range of 0-1, representing the actual brightness during image display. V is the generated encoded signal, meaning V is the value corresponding to the actual brightness stored as an 8-bit integer. sRGB encoded signals are typically stored as 8-bit integers, i.e., round(V*255). L is linear data used for display, and V is used for brightness storage.

[0169] The sRGB decoding function is defined as:

[0170]

[0171] The sRGB brightness conversion curve is as follows Figure 5 As shown, the sRGB brightness conversion curve defines the brightness changes in an sdr (Standard Dynamic Range) display.

[0172] (2) The LED screen needs to be set to PQ color space data to display color information, that is, the sRGB color space is converted to PQ color space.

[0173] The computer-generated sRGB image needs to be projected onto the LED screen to control the brightness of each LED in the LED screen, thereby displaying each sRGB image on the LED screen. Therefore, the brightness of the computer-generated sRGB image needs to be converted to the PQ color space.

[0174] The PQ conversion formula is as follows:

[0175]

[0176] Where m1 = 2610 / 16384, m2 = 2523 / 4096 × 128, c1 = 3424 / 4096, c2 = 2431 / 4096 × 32, c3 = 2392 / 4096 × 32.

[0177] PQ curve as follows Figure 6 As shown, the PQ curve defines how the values ​​of a display, from 0.0001 to 10000 cd / m2, are distributed in the range of 0 to 1 to control the actual brightness of the LED display screen through the PQ color space.

[0178] The PQ conversion formula can convert the luminance information of an sRGB image into luminance information in the PQ color space, thus displaying the content generated by the luminance information in the PQ color space on the LED screen; that is, the luminance L of the sRGB image is converted into the corresponding V in the PQ color space, the V in the PQ color space is converted into the corresponding L in the PQ color space, and the L corresponding to the PQ color space is displayed on the LED screen.

[0179] The purpose of converting the brightness information of an sRGB image to the PQ color space is as follows: Ordinary sRGB data can only represent a range of 0-1 during transmission, which is the SDR color space. However, actual brightness variations are very large. After conversion to PQ color space, a color information range that can represent up to 10,000 nits of brightness can be obtained, greatly enhancing the actual display effect. At the same time, a color space that can specifically represent screen brightness information is obtained, and changes in the PQ space can be linearly reflected in screen brightness.

[0180] (3) Use a camera (also called a video camera) to capture the images displayed on the LED screen and record the captured image data in RAW format.

[0181] The camera captures the content displayed on the LED screen and transmits the captured images to a computer in real time via a data cable, resulting in real-time RAW format footage. Different cameras have different data recording formats; here, we take the Arri camera as an example. The Arri camera records data in logc RAW format, and color variations can be made using the corresponding curve and color gamut information from the logc format.

[0182] The encoding equation for the LogC curve is shown below:

[0183]

[0184] Where cut = 0.010591, a = 5.555556, c = 0.247190, d = 0.385537, e = 5.367655, f = 0.092809.

[0185] The decoding equation for the LogC curve is shown below:

[0186]

[0187] (4) Connect RAW format data to the computer in real time via data cable and capture card.

[0188] The computer receives real-time RAW data from the camera and needs to parse and convert it back to sRGB color space. The aforementioned encoding / decoding formula can be used to restore the real-time RAW data to sRGB color space. In other words, the RAW format image is converted to the sRGB color space to obtain the corresponding colors in that space. RAW data is the data information generated before the sensor processes and produces the image.

[0189] Specifically, the center point of the real-time RAW format captured image, along with eight sampling points in eight directions around the center point, are collected to obtain the color values ​​of nine sampling points. These nine color values ​​are then weighted and averaged to obtain the average value. Following the same processing method, the average values ​​for red, green, blue, and white are obtained. The luminance (V) of the RAW format color values ​​is converted to linear luminance (L). During this luminance conversion, the color values ​​remain unchanged. The average value of the four corresponding colors (red, green, blue, and white) under linear luminance (L) is multiplied by the color conversion matrix to obtain the color values ​​of red, green, blue, and white in the sRGB color space, thus yielding the captured colors in the sRGB color space.

[0190] The conversion matrix between LogC and sRGB can be preset: restoring raw data to sRGB color space requires considering two aspects: the conversion of the brightness curve and the conversion of colors. Both LogC and sRGB define the coordinates of red, green, blue, and white points in the XYZ color space. Using the four coordinates in the two color spaces, the color conversion matrix between the two color spaces can be calculated.

[0191] like Figure 7 The diagram shows the wide color gamut corresponding to ALEXA and the coordinates of standard red, green, blue, and white in the logc color space. The dots and asterisks in the diagram represent different colors; smaller dots and asterisks indicate lighter colors, and closer dots and asterisks indicate more similarity in color. The endpoints of the triangles represent the coordinates of red, green, and blue, such as Red (0.6840, 0.3130), Green (0.2210, 0.8480), and Blue (0.0861, -0.1020). The white circle represents the coordinates of white, such as White [0.3127, 0.3290 (D65)].

[0192] like Figure 8 The image shows the wide color gamut corresponding to Recently.709, namely the sRGB color space, and the coordinates of standard red, green, blue and white in the sRGB color space. For example, Red (0.640, 0.330), Green (0.300, 0.600), Blue (0.150, 0.060), and White [0.3127, 0.3290 (D65)].

[0193] pass Figure 7 and Figure 8 The coordinates of the red, green, blue, and white points in the graph can be used to calculate the logc to srgb color conversion matrix, which is:

[0194] [1.61747146, -0.53724802, -0.08022302]

[0195] -0.07057393, 1.33458262, -0.26400745

[0196] -0.02110524, -0.22698252, 1.24808776]

[0197] After obtaining the curve information and the (logc-srgh) color conversion matrix, the color of the real-time data obtained from the shooting can be converted to obtain the shooting color information in the srgb space.

[0198] (5) Calculate the difference between the captured color and the target color to obtain the color calibration matrix.

[0199] Obtain the standard colors in the sRGB color space, namely standard red, standard green, standard blue, and standard white. Calculate the difference between the captured color and the target color to obtain the color calibration matrix. This involves creating a 3x3 matrix F from the data corresponding to the pure colors (red, green, and blue) in the sRGB color space after conversion.

[0200]

[0201] I = F -1 S = I × W / max(W) RGB ),

[0202] Among them, S R =I*WR / max(WRGB), S G =I*WG / max(WRGB), S B = I*WB / max(WRGB)

[0203] Where W represents white, W = [W R W G W B ], max(W RGB ) indicates [W R W G W B The maximum value in ].

[0204] Scale matrix F using the calculated scaling factor S to obtain matrix F1. Then calculate the inverse matrix of matrix F1, which is CalibrationMX, as shown below:

[0205]

[0206] CalibrationMX = F1 -1

[0207] (6) Filtering the color calibration matrix

[0208] The computer output image undergoes a color matrix overlay process, with steps 1-6 automatically repeated multiple times to reduce errors. The color calibration matrix corresponding to the image with colors closest to the standard color is selected as the final color calibration matrix. This final color calibration matrix is ​​then used for the original source material.

[0209] Before converting the sRGB color space to the PQ color space in (2), multiply the four colors (red, green, blue, and white) output by the computer in (1) by the color calibration matrix for calibration. After calibration, convert the sRGB color space to the PQ color space again and continue. Repeating steps 1-6 three times will yield a more accurate color calibration matrix.

[0210] (7) Application of color calibration matrix

[0211] The final color calibration matrix is ​​used as the target calibration matrix, i.e., the target calibration information. Since red, blue, green and white are calibrated, the captured color information is consistent with the color information output by the computer. Therefore, all other colors composed of these four colors can also be consistent with the color information output by the computer after being calibrated by the target calibration information.

[0212] The target calibration matrix is ​​multiplied by the computer's output image and displayed on an LED screen. A camera simultaneously captures the display on the LED screen and the actual props placed in front of it, generating raw footage which is then exported. The exported raw footage is then converted to the correct color space on a computer to obtain the corresponding colors in the sRGB color space, thus yielding the target footage.

[0213] like Figure 9 As shown, target A is the color information of the target color image displayed on the computer. The target calibration matrix is ​​[1.40454,-0.00453979,0.0659411,0;-0.082085,1.05607,-0.0145155,0;

[0214] -0.0388996,0.0335672,1.15484;0,0,0,0,1]

[0215] If the target color image is not calibrated, the image displayed on the LED screen and captured by the arri camera is uncalibrated (B).

[0216] The target color image is displayed on an LED screen via a target calibration matrix, and the captured image obtained through an ARRI camera is calibration C. The ARRI camera was used for shooting at an aperture of f / 22, ISO 800, and white balance 6500. Figure 9 As can be seen, after calibrating the target color image, the color of the captured image obtained by the camera can be consistent with the color of the target color image. That is, color calibration can avoid color differences caused by different devices.

[0217] In this embodiment, data can be calibrated quickly in real time, and the accuracy of calibration can be further improved by iterating through the data. Furthermore, even when different white balance pairs are adjusted for the actual shooting camera, as long as the color calibration matrix is ​​calculated correctly, the original color of the LED screen under the correct white balance can be quickly restored. This embodiment focuses on the color space conversion of the LogC format stored by Arri cameras; different camera storage formats will have different color spaces. When using different cameras, different color space conversion matrices and curves can be used to calibrate different camera pairs. Common cameras also include Sony's SLog, Canon's CLog, GoPro's ProTune, Panasonic's V-Log, and RED's Log3G10, etc.

[0218] The color calibration method in this embodiment can be applied to virtual production scenes. The required equipment includes a computer with a game engine, an LED screen, a front-screen backdrop, and a live camera. Virtual production refers to a series of computer-aided production and visual filmmaking methods. A game engine refers to the core components of some pre-written, editable computer game systems or interactive real-time image applications. An LED screen is a large LED screen in the virtual production shooting location used to display virtual content generated by the game engine. A front-screen backdrop refers to physical props placed in front of the LED screen. A live camera is a live camera in virtual production that simultaneously captures the merged image of the LED screen and the front-screen backdrop. When the color calibration method in this embodiment is applied to a virtual production scene, the game engine in the computer can output four colors—red, green, blue, and white—and execute the steps (1)-(6) above to obtain the target calibration matrix. It is understood that the camera used in the virtual production scene processing is the live camera.

[0219] After obtaining the target calibration matrix, the computer outputs the game scene image generated by the game engine. The game scene image is then calibrated using the target calibration matrix to obtain the calibrated image. The game scene image and the calibrated image correspond to the sRGB color space.

[0220] The computer transmits the calibration image to the LED screen, which then converts the brightness of the calibration image from the sRGB color space to the PQ color space and displays the virtual image after the conversion.

[0221] The on-site camera simultaneously captures the virtual display and the scene set on the screen, generating a corresponding fused image. This fused image corresponds to the third color space used by the on-site camera. The specific type of the third color space is determined by the on-site camera, and different cameras may use different color spaces.

[0222] Understandably, when multiple game scene frames generated by the game engine exist, the above steps can be followed to obtain a merged image corresponding to each frame of the game scene. The virtual display image corresponding to the foreground scenery of each frame of the game scene can be different, and can be set according to requirements.

[0223] The on-site camera can export the merged frames to a computer. The computer then converts the exported merged frames from the third color space to the sRGB color space, obtaining the corresponding target game frames. The target game video is then generated by merging these target game frames.

[0224] Alternatively, the camera can export the merged frames as raw material, then convert the raw material to sRGB color space, and finally merge the target game frames to generate the target game video.

[0225] In this embodiment, virtual production is an area where the real and digital worlds blend. It combines virtual reality and augmented reality with computer-generated imagery (CGI) and game engine technology, allowing production staff to see scenes unfold before them as if these scenes were actually composited and filmed on real-world locations. On the shooting set of the virtual production scene, LED screens are used to display virtual content, and actual props are placed in front of the LED screens. Cameras on-site in the virtual production scene simultaneously capture the merged images of the LED screens and the set in front of them, thereby generating videos that combine virtual and reality, such as game videos.

[0226] Traditional virtual production scenarios fail to consider the differences in color gamut between game scene images generated by computer game engines, game scene images displayed on screens, and content displayed on screens captured by cameras. In other words, they fail to consider the differences in color gamut caused by the differences in color spaces used by different devices, resulting in severe color distortion in the final generated images or videos.

[0227] In this embodiment, the images generated by the game engine (red, green, blue, and white) are converted to a different color space and displayed on the LED screen. The corresponding images are then captured by a live camera, yielding their respective color information. Based on the differences between the captured color information of red, green, blue, and white in the first color space and the standard red, green, blue, and white in the first color space, target calibration information is accurately determined to calibrate red, green, blue, and white to standard red, green, blue, and white. This target calibration information allows for color calibration of red, green, blue, and white in the image. Furthermore, since other colors can be composed of mixtures of red, green, blue, and white, the target calibration information can also effectively calibrate other colors composed of these colors, effectively canceling out color differences caused by different devices such as the computer game engine, the LED screen, and the live camera.

[0228] The game scene images generated by the game engine are calibrated in real time and quickly using a target calibration matrix. After color space conversion, the images are displayed on an LED screen. This ensures that the merged image, created by the on-site camera capturing the scene on the LED screen and the scene set in front of the screen, includes the game scene, and the colors of the game scene in this merged image are consistent with those of the game scene generated by the game engine. In other words, by calibrating the LED screen colors, the images captured by the on-site camera and the input image on the LED screen (which is the image generated by the game engine) are consistent in color, avoiding color differences caused by different devices.

[0229] Furthermore, the images captured by the on-site camera are first exported and then converted to a color space. By exporting the original material first, the resolution of the original material is reduced due to the limited amount of data transmitted when the data is transmitted directly, resulting in a higher quality target game video.

[0230] In one embodiment, such as Figure 10 As shown, a color calibration method is provided, including:

[0231] The terminal generates a corresponding first image based on each pure color, and the first image corresponds to the first color space.

[0232] The terminal transmits each first image to the display device, which corresponds to the second color space.

[0233] The display device converts the brightness of each first image from the first color space to the second color space, that is, it encodes the brightness of each first image in the first color space to obtain the corresponding encoded signal in the second color space; and it decodes each encoded signal in the second color space to obtain each second image in the second color space.

[0234] The display device sequentially displays each of the second screens.

[0235] The camera captures images of each of the second screens displayed sequentially on the display device, and transmits the captured images to the terminal in real time via a data cable. The camera and the captured images correspond to the third color space.

[0236] The terminal determines the center point of each captured image and performs sampling processing in multiple directions with each center point as the origin to obtain each sampling point; each center point and each sampling point are used as the key points corresponding to the captured images.

[0237] For each captured image, the terminal determines the intermediate color information corresponding to each captured image based on the original color information of each key point in the corresponding captured image.

[0238] Furthermore, the terminal performs brightness conversion processing on each intermediate color information to obtain intermediate color information with linear brightness; obtains the brightness mapping relationship, which represents the conversion relationship between the original type and the linear type of brightness; through the brightness mapping relationship, the brightness of each intermediate color information is converted from the original type to the linear type to obtain intermediate color information with linear brightness.

[0239] Furthermore, the terminal performs color conversion processing on the intermediate color information of the linear brightness type to obtain the shooting color information corresponding to each captured image in the first color space.

[0240] Next, the terminal determines color calibration information based on the difference between each captured color information and the standard color information in the first color space. This color calibration information can calibrate each captured color information to the standard color information.

[0241] Next, the terminal uses color calibration information to calibrate the original images generated based on each pure color in the next round.

[0242] Furthermore, the terminal takes the image obtained from the calibration process as the first image, returns to the step of converting the brightness of each first image from the first color space to the second color space, and continues to execute until the color calibration information for the next round is obtained.

[0243] Next, the terminal selects the color calibration information that meets the calibration conditions from the color calibration information obtained in each round as the target calibration information.

[0244] Next, the terminal calibrates the virtual scene image using the target calibration information to obtain a calibration image; the calibration image corresponds to the first color space.

[0245] Furthermore, the terminal transmits the calibration image to the display device; the display device converts the brightness of the calibration image from the first color space to the second color space, and displays the virtual display image after conversion to the second color space.

[0246] Next, the camera simultaneously captures the virtual display screen and the real-world props placed in front of the virtual display screen, generating a corresponding fused image, which corresponds to the third color space.

[0247] Furthermore, the terminal converts the merged image from the third color space to the first color space to obtain the target scene image.

[0248] In this embodiment, a first image generated based on each pure color is acquired. The first image corresponds to a first color space. The brightness of each first image is converted from the first color space to a second color space to obtain second images in the second color space. This allows the display device to accurately present the color information of each second image, avoiding color differences caused by the display device directly displaying the first image. Captured images obtained by photographing each second image displayed on the display device are acquired. These captured images correspond to a third color space. Each captured image is converted from the third color space to the first color space to obtain the captured color information corresponding to each captured image in the first color space. Based on the difference between the captured color information and the standard color information of the first color space, color calibration information can be accurately determined. This allows for accurate color calibration of the image to be calibrated, ensuring color consistency across different devices and effectively reducing color differences caused by displaying images on different devices. Under lossless color conditions, the captured color information corresponding to each pure color is completely consistent with the standard color information. However, different devices use different color spaces to present color information, resulting in color differences when displaying the same image on different devices. The color difference between the captured color information and the standard color information corresponding to each pure color is the color difference between different devices. The color calibration information determined based on the color difference between the captured color information and the standard color information can accurately calibrate the captured color information corresponding to the pure color to the standard color information. Other colors composed of multiple pure colors can also be calibrated through this color calibration information, so that the image captured by the camera is consistent with the color information of the first image.

[0249] The original images generated based on each pure color in the next round are calibrated using color calibration information to readjust the color information of each original image. The resulting image is used as the first image, and the process of converting the brightness of each first image from the first color space to the second color space is repeated until the color calibration information for the next round is obtained. This determines whether the difference between the captured color information obtained from processing on a series of different devices after calibration and the standard color information has decreased. From the color calibration information obtained in each round, color calibration information that meets the calibration conditions is selected as the target calibration information. This allows for the selection of color calibration information that minimizes or reduces the difference between the captured color information and the standard color information, resulting in more accurate target calibration information.

[0250] The virtual scene image is calibrated using target calibration information to obtain a calibrated image in the first color space. The brightness of the calibrated image is then converted from the first color space to the second color space, and the converted virtual image is displayed on a display device. A camera simultaneously captures the virtual image and real-world props placed in front of it, generating a fused image in the third color space. This fused image is then converted from the third color space to the first color space to obtain the target scene image. This ensures that the color information of the virtual scene in the fused image captured by the camera is consistent with the color information of the virtual scene output by the terminal. In other words, the color information of the virtual scene in the fused image is the same as that of the uncalibrated virtual scene, ensuring color consistency across different devices and effectively reducing color differences caused by displaying images on different devices.

[0251] Furthermore, by simultaneously capturing the virtual display screen and the real-world props placed in front of the virtual display screen using a camera, a fused image is generated. This allows the real-world props and the virtual screen to coexist in the same screen and space, thus cleverly combining virtual information with the real environment to obtain images or videos that combine virtual and reality.

[0252] It should be understood that although the steps in the flowcharts of the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0253] Based on the same inventive concept, this application also provides a color calibration apparatus for implementing the color calibration method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, the specific limitations in one or more color calibration apparatus embodiments provided below can be found in the limitations of the color calibration method described above, and will not be repeated here.

[0254] In one embodiment, such as Figure 11 As shown, a color calibration device 1100 is provided, including: an acquisition module 1102, a display module 1104, an image capture module 1106, a conversion module 1108, and a determination module 1110, wherein:

[0255] The acquisition module 1102 is used to acquire the first image generated based on each pure color, and the first image corresponds to the first color space.

[0256] Display module 1104 is used to convert the brightness of each first image from the first color space to the second color space to obtain each second image in the second color space, so as to display each second image through a display device.

[0257] The shooting module 1106 is used to acquire the captured images obtained by shooting each second screen displayed on the display device, and the captured images correspond to the third color space.

[0258] The conversion module 1108 is used to convert each captured image from the third color space to the first color space to obtain the captured color information corresponding to each captured image in the first color space.

[0259] The determination module 1110 is used to determine color calibration information based on the difference between each captured color information and the standard color information of the first color space; the color calibration information is used to perform color calibration on the image to be calibrated.

[0260] In this embodiment, a first image generated based on each pure color is acquired, corresponding to a first color space. The brightness of each first image is converted from the first color space to a second color space to obtain second images in the second color space. This allows the display device to accurately present the color information of each second image, avoiding color differences caused by the display device directly displaying the first image. Captured images obtained by photographing each second image displayed on the display device are acquired, corresponding to a third color space. Each captured image is converted from the third color space to the first color space to obtain the captured color information corresponding to each captured image in the first color space. Based on the difference between the captured color information and the standard color information of the first color space, color calibration information can be accurately determined. This allows for accurate color calibration of the image to be calibrated, ensuring color consistency across images displayed on different devices and effectively reducing color differences caused by images displayed on different devices.

[0261] In one embodiment, the display module 1104 is further configured to encode the brightness of each first image in a first color space to obtain an encoded signal in a corresponding second color space; decode each encoded signal in the second color space to obtain each second image in the second color space; and display each second image through a display device.

[0262] In this embodiment, the brightness of each first image in the first color space is encoded to obtain the corresponding encoded signal in the second color space. Each encoded signal is then decoded in the second color space to obtain each second image in the second color space. This allows the brightness to be converted from the first color space to the second color space through encoding and decoding of the brightness information, thereby converting the brightness of the first image into a brightness that the display device can display within its color range. This enables the display device to accurately control the brightness of the displayed image and ensures that the display effect of the second image displayed by the display device is consistent with that of the generated first image, avoiding significant color differences.

[0263] In one embodiment, the shooting module 1106 is further configured to take pictures of each second screen displayed on the display device through the camera, and receive the captured images obtained by the camera in real time, wherein the camera corresponds to a third color space.

[0264] In this embodiment, the camera corresponds to the third color space. The camera captures images of each second screen displayed on the display device and receives the captured images in real time to improve processing efficiency.

[0265] In one embodiment, the conversion module 1108 is further configured to perform key point sampling processing on each captured image to obtain key points corresponding to each captured image; for each captured image, based on the original color information of each key point corresponding to the corresponding captured image, determine the intermediate color information corresponding to each captured image; and convert each intermediate color information to the first color space to obtain the captured color information corresponding to each captured image in the first color space.

[0266] In this embodiment, keypoint sampling is performed on each captured image to obtain keypoints corresponding to each image. For each captured image, based on the original color information of each keypoint, intermediate color information is determined. Determining the intermediate color information of the captured image using color information from multiple keypoints is more reliable and avoids the lack of universality in the processing results due to single data. Each intermediate color information is converted to a first color space to obtain the captured color information corresponding to each captured image in the first color space. Based on the difference between the captured color information in the first color space and the standard color information in the first color space, color calibration information that can calibrate the captured color information to the standard color information is accurately determined.

[0267] In one embodiment, the conversion module 1108 is further configured to determine the center point of each captured image; perform sampling processing in multiple directions with each center point as the origin to obtain each sampling point; and use each center point and each sampling point as the key point corresponding to the corresponding captured image.

[0268] In this embodiment, the center point of each captured image is determined, and sampling is performed in multiple directions with each center point as the origin to obtain sampling points in different directions, ensuring the consistency of each sampling point in the directional dimension. Each center point and each sampling point is used as a key point corresponding to the captured image, making the color information of the collected multiple key points more reliable. Therefore, the results obtained from subsequent processing using the original color information of multiple key points are more reliable, effectively avoiding the problem of inaccurate color calibration information due to inaccurate color information of a single key point.

[0269] In one embodiment, the conversion module 1108 is further configured to perform brightness conversion processing on each intermediate color information to obtain each intermediate color information with linear brightness; and to perform color conversion processing on each intermediate color information with linear brightness to obtain the shooting color information corresponding to each shooting image in the first color space.

[0270] In this embodiment, the intermediate color information undergoes brightness conversion processing to obtain intermediate color information with linear brightness, which converts the brightness under the storage format into brightness that can be used for data calculation. The intermediate color information with linear brightness is then subjected to color conversion processing to transform it from the third color space to the first color space, accurately obtaining the shooting color information corresponding to each captured image in the first color space. By first performing brightness conversion and then color conversion on the brightness-converted color information, data in the third color space can be accurately mapped to the first color space.

[0271] In one embodiment, the conversion module 1108 is further configured to obtain a brightness mapping relationship, which represents the conversion relationship between the original type and the linear type of brightness; through the brightness mapping relationship, the brightness of each intermediate color information is converted from the original type to the linear type to obtain each intermediate color information with linear brightness.

[0272] In this embodiment, the brightness mapping relationship represents the conversion relationship between the original type and the linear type of brightness. Through the brightness mapping relationship, the brightness of each intermediate color information can be converted from the original type to the linear type, thereby converting the brightness under the storage format into the brightness that can be used for data calculation, so that the brightness of the intermediate color information can be used to participate in the calculation, thereby combining the brightness dimension to more accurately determine the color calibration information.

[0273] In one embodiment, such as Figure 12 As shown, the device also includes a calibration module 1112, a return module 1114, and a screening module 1116, wherein,

[0274] The calibration module 1112 is used to calibrate the original images generated based on each pure color in the next round using color calibration information.

[0275] The return module 1114 is used to take the image obtained from the calibration process as the first image, return the step of converting the brightness of each first image from the first color space to the second color space and continue to execute until the color calibration information of the next round is obtained.

[0276] The filtering module 1116 is used to filter out the color calibration information that meets the calibration conditions from the color calibration information obtained in each round as the target calibration information; the target calibration information is used to perform color calibration on the screen to be calibrated.

[0277] In this embodiment, color calibration information is used to calibrate the original images generated based on each pure color in the next round, thereby readjusting the color information of each original image. The image obtained after calibration is taken as the first image. The step of converting the brightness of each first image from the first color space to the second color space is returned and executed until the color calibration information for the next round is obtained. This determines whether the difference between the captured color information obtained from processing on a series of different devices after calibration and the standard color information has decreased. From the color calibration information obtained in each round, color calibration information that meets the calibration conditions is selected as target calibration information. This allows for the selection of color calibration information that minimizes or reduces the difference between the captured color information and the standard color information as the final calibration information, resulting in more accurate target calibration information. This target calibration information is used to perform color calibration on the image to be calibrated, converting the calibrated image to a different color space for display on a display device. This ensures that the captured image obtained by the camera from the displayed image maintains color consistency with the image to be calibrated, avoiding significant color differences caused by displays on different devices.

[0278] In one embodiment, the image to be calibrated is a virtual scene image. The calibration module 1112 is further configured to calibrate the virtual scene image using target calibration information to obtain a calibration image; the calibration image corresponds to a first color space.

[0279] The display module 1104 is also used to convert the brightness of the calibration screen from the first color space to the second color space, so as to display the virtual display screen after conversion to the second color space through the display device;

[0280] The shooting module 1106 is also used to acquire the fused image obtained by simultaneously shooting the virtual display screen and the real scene, and the fused image corresponds to the third color space;

[0281] The conversion module 1108 is also used to convert the merged image from the third color space to the first color space to obtain the target scene image.

[0282] In this embodiment, the virtual scene image is calibrated using target calibration information to obtain a calibration image; the calibration image corresponds to a first color space; the brightness of the calibration image is converted from the first color space to a second color space, so that the virtual display image after conversion to the second color space is displayed on a display device; a fused image obtained by simultaneously capturing the virtual display image and the real scene is acquired, and the fused image corresponds to a third color space; the fused image is converted from the third color space to the first color space to obtain the target scene image, so that the images displayed on different devices can maintain consistency in color, thereby effectively reducing the color difference caused by displaying images on different devices.

[0283] In one embodiment, the real scene includes real-world props; the shooting module 1106 is also used to acquire a fused image synthesized by simultaneously capturing the virtual display screen and the real-world props placed in front of the virtual display screen through a camera.

[0284] In this embodiment, a fused image is obtained by simultaneously capturing the virtual display screen and the real-world props placed in front of the virtual display screen using a camera. After the real-world props and the virtual screen are merged, they can coexist in the same screen and space, thus cleverly combining virtual information with the real environment.

[0285] In one embodiment, each pure color includes red, green, blue, and white. The first color space is the standard red-green-blue color space, the second color space is the perceptual quantization color space, the display device is a light-emitting diode display screen, and the third color space is the color space corresponding to the camera that captures each second image. The standard color information includes relevant information about standard red, standard green, standard blue, and standard white in the standard red-green-blue color space.

[0286] In this embodiment, a first image generated based on red, green, blue, and white is obtained. The brightness of the first image corresponding to red, green, blue, and white is converted from the first color space to the second color space to obtain each second image in the second color space. This enables the LED screen to accurately present the color information of each second image and avoids the color differences caused by the LED screen directly displaying the first image. The camera captures images of the second frames corresponding to red, green, blue, and white displayed on the LED screen. These images are then converted from a third color space to a first color space, yielding the captured color information for red, green, blue, and white in the first color space. Based on the differences between the captured color information for each of these colors and the standard red, green, blue, and white in the first color space, accurate color calibration information can be determined to calibrate red, green, blue, and white to standard red, green, blue, and white. This allows for accurate color calibration of red, green, blue, white, and other colors composed of these colors in the image. This ensures that color differences caused by different devices such as the terminal, LED screen, and camera are effectively canceled out, maintaining color consistency across different display devices and significantly reducing color variations caused by displaying images from different devices.

[0287] Each module in the aforementioned color calibration device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of a computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0288] In one embodiment, a computer device is provided, which may be a terminal or a server. Taking a terminal as an example, its internal structure diagram can be as follows: Figure 13 As shown, the computer device includes a processor, memory, input / output interfaces, a communication interface, a display unit, and an input device. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When executed by the processor, the computer program implements a color calibration method. The display unit of the computer device is used to form a visually visible image. It can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.

[0289] Those skilled in the art will understand that Figure 13 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0290] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.

[0291] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.

[0292] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0293] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0294] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0295] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0296] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A color calibration method, characterized in that, The method includes: Obtain the first image generated based on each pure color, and the first image corresponds to the first color space; The brightness of each of the first images is converted from the first color space to the second color space to obtain each of the second images in the second color space, so as to display each of the second images through the display device; Acquire captured images obtained by capturing each of the second images displayed on the display device, wherein the captured images correspond to a third color space; Each of the captured images is converted from the third color space to the first color space to obtain the captured color information corresponding to each of the captured images in the first color space; Based on the difference between the captured color information and the standard color information of the first color space, color calibration information is determined; the color calibration information is used to perform color calibration on the image to be calibrated.

2. The method according to claim 1, characterized in that, The step of converting the brightness of each of the first images from a first color space to a second color space to obtain each of the second images in the second color space, and displaying each of the second images through a display device, includes: The brightness of each of the first images in the first color space is encoded to obtain the corresponding encoded signal in the second color space. Each of the encoded signals is decoded in the second color space to obtain each second image in the second color space; The second screen is displayed on the display device.

3. The method according to claim 1, characterized in that, The step of acquiring the captured images obtained by capturing each of the second screens displayed on the display device includes: The camera captures images of each of the second images displayed on the display device and receives the captured images in real time. The camera corresponds to a third color space.

4. The method according to claim 1, characterized in that, The step of converting each of the captured images from the third color space to the first color space to obtain the captured color information corresponding to each of the captured images in the first color space includes: Each of the captured images is sampled for key points to obtain the key points corresponding to each captured image. For each captured image, based on the original color information of each key point corresponding to the captured image, the intermediate color information corresponding to each captured image is determined. Each of the intermediate color information is converted to the first color space to obtain the shooting color information corresponding to each of the shooting images in the first color space.

5. The method according to claim 4, characterized in that, The step of performing keypoint sampling processing on each of the captured images to obtain keypoints corresponding to each captured image includes: Determine the center point of each captured image; Sampling is performed in multiple directions with each center point as the origin to obtain each sampling point; Each of the aforementioned center points and each of the aforementioned sampling points will be used as the key points corresponding to the respective captured images.

6. The method according to claim 4, characterized in that, The step of converting each of the intermediate color information to the first color space to obtain the shooting color information corresponding to each of the shooting images in the first color space includes: The intermediate color information is subjected to brightness conversion processing to obtain intermediate color information with linear brightness. The intermediate color information with linear brightness is subjected to color conversion processing to obtain the shooting color information corresponding to each shooting image in the first color space.

7. The method according to claim 6, characterized in that, The step of performing brightness conversion processing on each of the intermediate color information to obtain intermediate color information with linear brightness includes: Obtain the brightness mapping relationship, which represents the conversion relationship between the original type and the linear type of brightness; By using the brightness mapping relationship, the brightness of each intermediate color information is converted from the original type to a linear type, resulting in intermediate color information with linear brightness.

8. The method according to any one of claims 1 to 7, characterized in that, The method further includes: The original images generated in the next round based on each of the pure colors are calibrated using the color calibration information. The image obtained from the calibration process is taken as the first image. The process returns to the step of converting the brightness of each first image from the first color space to the second color space and continues until the color calibration information for the next round is obtained. From the color calibration information obtained in each round, color calibration information that meets the calibration conditions is selected as target calibration information; the target calibration information is used to perform color calibration on the image to be calibrated.

9. The method according to claim 8, characterized in that, The image to be calibrated is a virtual scene image, and the method further includes: The virtual scene image is calibrated using the target calibration information to obtain a calibrated image; the calibrated image corresponds to the first color space. The brightness of the calibration image is converted from the first color space to the second color space, so that the virtual display image converted to the second color space is displayed through the display device; Acquire a fused image obtained by simultaneously capturing the virtual display screen and the real scene, wherein the fused image corresponds to a third color space; The merged image is converted from the third color space to the first color space to obtain the target scene image.

10. The method according to claim 9, characterized in that, The real-world scene includes real-world props; the acquisition of the fused image obtained by simultaneously capturing the virtual display and the real-world scene includes: The image is a composite image obtained by simultaneously capturing the virtual display screen and the real-world props placed in front of the virtual display screen using a camera.

11. The method according to any one of claims 1 to 7, characterized in that, The pure colors include red, green, blue, and white. The first color space is the standard red-green-blue color space, the second color space is the perceptual quantization color space, the display device is a light-emitting diode display screen, and the third color space is the color space corresponding to the camera that captures each of the second images. The standard color information includes relevant information about standard red, standard green, standard blue, and standard white in the standard red-green-blue color space.

12. A color calibration device, characterized in that, The device includes: The acquisition module is used to acquire the first image generated based on each pure color, and the first image corresponds to the first color space; The display module is used to convert the brightness of each of the first images from the first color space to the second color space to obtain each of the second images in the second color space, so as to display each of the second images through the display device; The shooting module is used to acquire the captured images obtained by shooting each of the second images displayed on the display device, and the captured images correspond to a third color space; The conversion module is used to convert each of the captured images from the third color space to the first color space to obtain the captured color information corresponding to each of the captured images in the first color space. The determining module is used to determine color calibration information based on the difference between each of the captured color information and the standard color information of the first color space; the color calibration information is used to perform color calibration on the image to be calibrated.

13. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 11.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 11.

15. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 11.

Images