Color temperature alignment method of video picture and related device

Abstract

The invention discloses a color temperature alignment method of a video picture and a related device, and belongs to the technical field of image processing. The method comprises the following steps: acquiring at least one first video acquired by at least one first camera and a reference video acquired by a reference camera, wherein the at least one first camera and the reference camera are located in the same physical environment; and performing relative color temperature compensation on the at least one first video based on the relative color temperature deviation corresponding to the at least one first camera, so that the color temperature of the video picture of the at least one first video after the relative color temperature compensation is consistent with the color temperature of the video picture of the reference video, the relative color temperature deviation is the actual color temperature deviation of the corresponding first camera relative to the reference camera; and outputting the at least one first video after the relative color temperature compensation and the reference video. According to the invention, the color temperatures of the video pictures of the cameras in the same physical environment are aligned, so that the color tone of the video pictures can be kept consistent when the video pictures of the cameras are displayed on the same screen.

Description

[0001] This application claims priority to Chinese patent application No. 202310734436.2, filed on June 20, 2023, entitled “A method for aligning color temperature of multiple cameras”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of image processing technology, and in particular to a method for aligning the color temperature of a video image and a related device. Background Art

[0003] With the popularity of online meetings, the effect and experience of meetings are becoming more and more important. Local meetings generally use multiple cameras or multi-cameras to carry out various intelligent director application scenarios. However, due to the obvious differences in white balance effects of different cameras, the video images output by the cameras look inconsistent. In particular, when the video images output by multiple cameras are displayed on the same screen, the color tone effects of each video image on the screen are different, which seriously affects the meeting experience. Therefore, a method for color temperature alignment of video images is urgently needed.

[0004] In the related art, a new color temperature curve is obtained by weighted averaging the standard color temperature curves built into multiple cameras, and all cameras use the weighted averaged color temperature curve to perform white balance, thereby ensuring that the color temperatures of the video images output by multiple cameras are aligned. However, although this method can effectively align the color temperatures between different cameras, it has poor scalability. If a new camera needs to be added, the standard color temperature curves of all cameras need to be weighted averaged again, which increases the workload and calculation amount. Summary of the invention

[0005] The present application provides a method and a related device for aligning the color temperature of a video screen, which can keep the color temperature of multiple video screens consistent, and can add new cameras, with good scalability. The technical solution is as follows:

[0006] In a first aspect, a method for color temperature alignment of a video screen is provided, the method comprising: acquiring at least one first video and a reference video, the at least one first video being a video captured by at least one first camera, the reference video being a video captured by a reference camera, and the at least one first camera and the reference camera being located in the same physical environment; performing relative color temperature compensation on the at least one first video based on relative color temperature deviations corresponding to the at least one first camera, so that the color temperature of the video screen of the at least one first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, the relative color temperature deviation being the actual color temperature deviation of the corresponding first camera relative to the reference camera; and outputting the at least one first video and the reference video after relative color temperature compensation.

[0007] By performing relative color temperature compensation on the at least one first camera, the color temperature of the video screen of the at least one video is aligned to the color temperature of the reference video, that is, the color temperature of the video screen of the at least one first video after relative compensation is consistent with the color temperature of the video screen of the reference camera, so that the at least one first video and the reference video have consistent color tones when displayed on the same screen, which is more in line with the viewing effect of the human eye. That is to say, when multiple cameras or multi-cameras are used in a single physical environment to perform a variety of intelligent directing application scenarios, although the white balance effects of different cameras are obviously different, after using this method, when the video screens output by multiple cameras in a single physical environment are displayed on the same screen, the color tone effects of each video screen on the screen are consistent, which can improve the viewing experience of the single physical environment.

[0008] Multiple cameras are deployed in the same physical environment, one of the multiple cameras is used as a reference camera, and the other cameras except the reference camera are used as the at least one first camera. The reference camera can be any one of the multiple cameras, but due to the difference between the imaging sensors of the cameras, the color temperature of the video images captured by each of the multiple cameras is quite different. At this time, the reference camera can be the camera whose video images captured by the multiple cameras are closest to human eye habits. Of course, in actual applications, the reference camera can also be determined according to other methods, and this application does not limit this.

[0009] The physical environment refers to the environment of the physical location of the camera, such as the decoration environment and light source type of the physical location of the camera. Multiple cameras being located in the same physical environment means that the decoration environment of the physical location of the multiple cameras is the same, the light source type used in the physical location of the multiple cameras is the same, etc. For example, the multiple cameras can be located in the same physical space. The physical space can be a conference room, a large press conference, a party, etc., and this application does not limit the physical environment.

[0010] Optionally, before performing relative color temperature compensation on the at least one first video based on the relative color temperature deviation corresponding to the at least one first camera, the method further includes: acquiring at least one first image and a first reference image, the at least one first image being an image captured by the at least one first camera, the first reference image being an image captured by the reference camera, and the image content of the at least one first image and the first reference image being the same; determining the color temperature of each first image in the at least one first image and the color temperature of the first reference image; determining the color temperature deviation of the at least one first image relative to the first reference image based on the color temperature of the at least one first image and the color temperature of the first reference image, to obtain the relative color temperature deviation corresponding to the at least one first camera.

[0011] After the at least one first camera and the reference camera capture images with the same image content, the relative color temperature deviation corresponding to each of the at least one first camera is determined by using the images with the same image content, so that the accuracy of the relative color temperature deviation can be improved, thereby ensuring that more targeted and accurate relative color temperature compensation can be performed on the at least one first camera later.

[0012] The relative color temperature deviation may be a deviation value with positive or negative signs, or may be an absolute deviation value without positive or negative signs. In the case where the relative color temperature deviation is a deviation value with positive or negative signs, for each of the at least one first camera, the color temperature of the first image captured by the first camera is subtracted from the color temperature of the first reference image to obtain the color temperature deviation of the first image relative to the first reference image, and the color temperature deviation is determined as the relative color temperature deviation corresponding to the first camera. In the case where the relative color temperature deviation is an absolute deviation value without positive or negative signs, for each of the at least one first camera, the absolute deviation value of the color temperature of the first image captured by the first camera and the color temperature of the first reference image is directly determined, and the absolute deviation value is determined as the relative color temperature deviation corresponding to the first camera.

[0013] Optionally, before determining the color temperature of each first image in the at least one first image and the color temperature of the first reference image, the method further includes: performing an affine transformation on the at least one first image based on the at least one first image and the first reference image, so that the distortion and visual direction of the at least one first image after the affine transformation are respectively consistent with the distortion and visual direction of the first reference image.

[0014] If the distance between the at least one first camera and the reference camera is greatly different, the distortion and visual direction of the image content of the at least one first image and the first reference image may be different. Therefore, based on the at least one first image and the first reference image, an affine transformation is performed on the at least one first image, so that the distortion and visual direction of the at least one first image after the affine transformation are respectively consistent with the distortion and visual direction of the first reference image, thereby eliminating the difference in distortion and visual direction and improving the accuracy of the determined relative color temperature deviation.

[0015] Affine transformation is the superposition of two simple transformations, namely linear transformation and translation transformation, and affine transformation includes scaling, translation, rotation, reflection, shearing, etc. The at least one first image may be scaled, translated, rotated, reflected, sheared, etc. relative to the first reference image, so that the distortion and visual direction of the at least one first image are respectively consistent with the distortion and visual direction of the first reference image.

[0016] Optionally, before performing relative color temperature compensation on the at least one first video based on the relative color temperature deviation corresponding to the at least one first camera, the method further includes: based on the first light source type and the identifier of the at least one first camera, obtaining the relative color temperature deviation corresponding to the at least one first camera from the stored correspondence between the light source type, the camera identifier and the relative color temperature deviation, wherein the first light source type is the type of light source used in the physical environment in which the at least one first camera is located.

[0017] Due to manufacturing errors of the imaging sensors of the cameras and other reasons, the color temperatures of the images obtained by these cameras in the same real environment may be different when shooting the same area, that is, the actual color temperatures of these cameras may be different. However, in some cases, the trends of the actual color temperature curves of these cameras under different types of light sources may be the same. In this case, each of the at least one first camera corresponds to a relative color temperature deviation, and the at least one first video can be directly compensated for relative color temperature based on the relative color temperature deviations corresponding to the at least one first camera. In other cases, the trends of the actual color temperature curves of these cameras under different types of light sources may be different. In this case, it is necessary to obtain the relative color temperature deviations corresponding to the at least one first camera from the corresponding relationship between the stored light source type, camera identifier and relative color temperature deviation based on the first light source type and the identifier of the at least one first camera, so as to perform relative color temperature compensation on the at least one first video, which can adapt to the conditions of different light sources in different physical environments and is more targeted for color temperature alignment of the video screen.

[0018] Optionally, before obtaining the relative color temperature deviation corresponding to the at least one first camera from the stored correspondence between the light source type, camera identifier and relative color temperature deviation based on the first light source type and the identifier of the at least one first camera, the method also includes: determining the relative color temperature deviation of the at least one first camera under multiple light sources; and storing the types of the multiple light sources, the identifier of the at least one first camera and the relative color temperature deviation of the at least one first camera under the multiple light sources in the correspondence between the light source type, camera identifier and relative color temperature deviation.

[0019] Optionally, determining the relative color temperature deviation of the at least one first camera under multiple light sources includes: acquiring at least one second image and a second reference image, the at least one second image being an image captured by the at least one first camera under a target light source, the second reference image being an image captured by the reference camera under the target light source, the target light source being any one of the multiple light sources, and the at least one second image and the second reference image having the same image content; determining the color temperature of each second image in the at least one second image and the color temperature of the second reference image; determining the color temperature deviation of the at least one second image relative to the second reference image based on the color temperature of the at least one second image and the color temperature of the second reference image, to obtain the relative color temperature deviations corresponding to the at least one first camera under the target light source.

[0020] By determining the relative color temperature deviation corresponding to each light source of the at least one first camera, and then storing it in the correspondence between the light source type, the camera identifier and the relative color temperature deviation, when performing relative color temperature compensation, the relative color temperature deviation of the camera under the light source can be obtained directly based on the light source type and camera identifier in the current physical environment, and relative color temperature compensation can be performed on the at least one first video quickly and accurately.

[0021] Optionally, the method also includes: receiving at least one second video, the at least one second video being a video captured by at least one second camera respectively, the color temperature of the video screen of the at least one second video being consistent, the at least one second camera being located in the same physical environment, and the physical environment in which the at least one second camera is located is different from the physical environment in which the at least one first camera is located; performing reverse absolute color temperature compensation on the at least one second video based on the absolute color temperature deviation corresponding to the reference camera, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video, the absolute color temperature deviation being the color temperature deviation of the reference camera relative to a calibration chart of a standard color; and outputting the at least one second video after reverse absolute color temperature compensation.

[0022] By performing reverse absolute color temperature compensation on the at least one second video, the color temperature of the at least one second video received can be consistent with the video image of the reference video when displayed in the first physical environment where the reference camera is located, which conforms to the viewing effect of the human eye. Therefore, when multiple cameras or multi-cameras are used in multiple physical environments to perform various intelligent directing application scenarios, although the white balance effects of different cameras are obviously different, and the light source types of different physical environments are different, after using this method, when the video images output by multiple cameras in multiple physical environments are displayed on the same screen, the color tone effects of each video image on the screen are consistent, which can improve the viewing experience in multiple physical environments.

[0023] The standard color calibration chart can be a white calibration chart of a standard color temperature (i.e., 4000K-4500K), or a calibration chart of other colors of a standard color temperature. Moreover, the shape of the calibration chart can be square, circular, etc., which is not limited in this application.

[0024] The absolute color temperature deviation of the reference camera is a deviation value with positive and negative signs, and the absolute color temperature deviation is the deviation obtained by subtracting the color temperature of the calibration chart of the standard color from the actual color temperature of the reference camera. At this time, for each second video in the at least one second video, the color temperature of the second video is added to the absolute color temperature deviation of the reference camera to obtain a second video after reverse absolute color temperature compensation, and the color temperature of the video screen of the second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video.

[0025] The absolute color temperature deviation of the reference camera is an absolute value of the deviation without positive or negative signs. At this time, for each second video in the at least one second video, if the color temperature of the video screen of the second video is greater than the color temperature of the video screen of the reference video, the color temperature of the second video is subtracted from the absolute color temperature deviation corresponding to the reference camera to obtain the second video after reverse absolute color temperature compensation, and the color temperature of the video screen of the second video after reverse absolute color temperature compensation is consistent with the color temperature of the reference video; if the color temperature of the video screen of the second video is less than the color temperature of the video screen of the reference video, the color temperature of the second video is added to the absolute color temperature deviation of the reference camera to obtain the second video after reverse absolute color temperature compensation, and the color temperature of the video screen of the second video after reverse absolute color temperature compensation is consistent with the color temperature of the reference video.

[0026] Optionally, after acquiring at least one first video and a reference video, the method further includes: performing absolute color temperature compensation on the at least one first video based on the absolute color temperature deviation corresponding to the at least one first camera, so that the video picture of the at least one first video after absolute color temperature compensation is consistent with the color temperature of a calibration chart of a standard color, and the absolute color temperature deviation corresponding to the at least one first camera is the actual color temperature deviation of the corresponding first camera relative to the calibration chart; performing absolute color temperature compensation on the reference video based on the absolute color temperature deviation corresponding to the reference camera, so that the color temperature of the video picture of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart, and the absolute color temperature deviation corresponding to the reference camera is the color temperature deviation of the reference camera relative to the calibration chart; and sending the at least one first video after absolute color temperature compensation and the reference video after absolute color temperature compensation.

[0027] By performing absolute color temperature compensation on the at least one first video and the reference video, the color temperature of the at least one first video and the reference video is made consistent with the color temperature of the calibration chart of the standard color. In this way, when the at least one first video and the reference video are sent to the second physical environment for display, based on the absolute color temperature deviation of the reference camera in the second physical environment, the at least one first video and the reference video are reversely compensated for absolute color temperature, so that the color temperatures of the at least one first video and the reference video are consistent with the color temperature of the reference video in the second physical environment, so that the color temperatures of videos from different physical environments are consistent when displayed on the same display device, which conforms to the viewing effect of the human eye. Therefore, when multiple cameras or multi-cameras are used in multiple physical environments to perform multiple intelligent directing application scenarios, although the white balance effects of different cameras are obviously different, and the light source types of different physical environments are different, after using this method, when the video images output by multiple cameras in multiple physical environments are displayed on the same screen, the color tone effects of each video image on the screen are consistent, which can improve the viewing experience of multiple physical environments.

[0028] The absolute color temperature deviation is a deviation value with positive and negative signs, and the absolute color temperature deviation is the deviation obtained by subtracting the color temperature of the calibration chart of the standard color from the actual color temperature of the corresponding first camera. At this time, for each first camera of the at least one first camera, the color temperature of the first video captured by the first camera is subtracted from the absolute color temperature deviation corresponding to the first camera to obtain the first video after absolute color temperature compensation, and the color temperature of the video screen of the first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart. Similarly, for the reference camera, the color temperature of the reference video captured by the reference camera is subtracted from the absolute color temperature deviation corresponding to the reference camera to obtain the reference video after absolute color temperature compensation, and the color temperature of the video screen of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart.

[0029] The absolute color temperature deviation is an absolute value of the deviation without a positive or negative sign. At this time, for each of the at least one first camera, if the actual color temperature of the first camera is greater than the color temperature of the calibration chart of the standard color, the color temperature of the first video captured by the first camera is subtracted from the absolute color temperature deviation corresponding to the first camera to obtain the first video after absolute color temperature compensation, and the color temperature of the video screen of the first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart; if the actual color temperature of the first camera is less than the actual color temperature of the calibration chart, the color temperature of the first video captured by the first camera is added to the absolute color temperature deviation corresponding to the first camera to obtain the first video after absolute color temperature compensation, and the color temperature of the video screen of the first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart. Similarly, for the benchmark camera, if the actual color temperature of the benchmark camera is greater than the color temperature of the calibration chart of the standard color, the color temperature of the benchmark video captured by the benchmark camera is subtracted from the absolute color temperature deviation corresponding to the benchmark camera to obtain the benchmark video after absolute color temperature compensation, and the color temperature of the video screen of the benchmark video after absolute color temperature compensation is consistent with the color temperature of the calibration chart; if the actual color temperature of the benchmark camera is less than the actual color temperature of the calibration chart, the color temperature of the benchmark video captured by the benchmark camera is added to the absolute color temperature deviation corresponding to the benchmark camera to obtain the benchmark video after absolute color temperature compensation, and the color temperature of the video screen of the benchmark video after absolute color temperature compensation is consistent with the color temperature of the calibration chart.

[0030] Optionally, the method further includes: acquiring a reference image, wherein the reference image is an image obtained by photographing the calibration chart with a target camera, and the target camera is any one of the at least one first camera and the benchmark camera; determining the color temperature of the reference image; determining the deviation between the color temperature of the reference image and the color temperature of the calibration chart, and obtaining an absolute color temperature deviation corresponding to the target camera.

[0031] In a second aspect, a method for color temperature alignment of a video picture is provided, the method comprising:

[0032] Collect the first video;

[0033] Based on the relative color temperature deviation, relative color temperature compensation is performed on the first video so that the color temperature of the video screen of the first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the relative color temperature deviation is an actual color temperature deviation of the first camera relative to the reference camera, the reference video is a video captured by the reference camera, and the first camera and the reference camera are located in the same physical environment;

[0034] Output the first video after relative color temperature compensation.

[0035] Optionally, before performing relative color temperature compensation on the first video based on the relative color temperature deviation, the method further includes:

[0036] Based on a first light source type and an identifier of the first camera, the relative color temperature deviation is obtained from a stored correspondence between the light source type, the camera identifier, and the relative color temperature deviation, where the first light source type is a type of light source used in a physical environment where the first camera is located.

[0037] By establishing a correspondence between the light source type, the camera identifier and the relative color deviation, and obtaining the relative color temperature deviation corresponding to the at least one first camera from the stored correspondence, the at least one first camera can adapt to different light sources in different physical environments, and the color temperature alignment of the video picture is more targeted.

[0038] Optionally, the method further comprises:

[0039] Based on the absolute color temperature deviation, absolute color temperature compensation is performed on the first video so that the video picture of the first video after absolute color temperature compensation is consistent with the color temperature of a calibration chart of a standard color, wherein the absolute color temperature deviation is an actual color temperature deviation of the first camera relative to the calibration chart;

[0040] The first video after absolute color temperature compensation is sent.

[0041] In a third aspect, a method for color temperature alignment of a video picture is provided, the method comprising:

[0042] Determine a relative color temperature deviation corresponding to at least one first camera, where the relative color temperature deviation is an actual color temperature deviation of the at least one first camera relative to a reference camera, and the at least one first camera and the reference camera are located in the same physical environment;

[0043] Sending the respective corresponding relative color temperature deviations to the at least one first camera, so that each of the at least one first camera performs relative color temperature compensation on the respective captured first video based on the respective corresponding relative color temperature deviations, so as to ensure that the color temperature of the video screen of the first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the reference video is the video captured by the reference camera.

[0044] Optionally, the method further comprises:

[0045] Determining relative color temperature deviations of the at least one first camera under a plurality of light sources respectively;

[0046] storing the types of the multiple light sources, the identifier of the at least one first camera, and the relative color temperature deviations of the at least one first camera under the multiple light sources respectively in the correspondence between the light source type, the camera identifier, and the relative color temperature deviation;

[0047] The corresponding relationship is sent to the at least one first camera.

[0048] Optionally, the method further comprises:

[0049] Receiving at least one second video, wherein the at least one second video is a video captured by at least one second camera, the color temperature of the video screen of the at least one second video is consistent, the at least one second camera is located in the same physical environment, and the physical environment in which the at least one second camera is located is different from the physical environment in which the at least one first camera is located;

[0050] Based on the absolute color temperature deviation corresponding to the reference camera, reverse absolute color temperature compensation is performed on the at least one second video, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the absolute color temperature deviation is the color temperature deviation of the reference camera relative to the calibration chart of the standard color;

[0051] The at least one second video after inverse absolute color temperature compensation is output.

[0052] Optionally, the method further comprises:

[0053] Determine an absolute color temperature deviation corresponding to the at least one first camera and an absolute color temperature deviation corresponding to the reference camera, wherein the absolute color temperature deviation is a color temperature deviation of the corresponding camera relative to a calibration chart of a standard color;

[0054] The respective corresponding absolute color temperature deviations are sent to the at least one first camera and the reference camera.

[0055] Optionally, the method further comprises:

[0056] A reference image is obtained, where the reference image is an image obtained by shooting a calibration chart with a target camera, where the target camera is any one of the at least one first camera and the reference camera. A color temperature of the reference image is determined, and then a deviation between the color temperature of the reference image and the color temperature of the calibration chart is determined to obtain an absolute color temperature deviation corresponding to the target camera.

[0057] In a fourth aspect, a color temperature alignment device for a video screen is provided, wherein the color temperature alignment device for a video screen has a function of implementing the color temperature alignment method for a video screen in the first aspect, the second aspect, or the third aspect. The color temperature alignment device for a video screen includes at least one module, and the at least one module is used to implement the color temperature alignment method for a video screen provided in the first aspect, the second aspect, or the third aspect.

[0058] In a fifth aspect, a color temperature alignment device is provided, the color temperature alignment device comprising a processor and a memory, the memory being used to store a computer program for executing the color temperature alignment method of the video picture provided in the first aspect. The processor is configured to execute the computer program stored in the memory to implement the color temperature alignment method of the video picture described in the first aspect.

[0059] Optionally, the color temperature alignment device may further include a communication bus, and the communication bus is used to establish a connection between the processor and the memory.

[0060] In a sixth aspect, a camera is provided, the camera comprising a processor and a memory, the memory being used to store a computer program for executing the color temperature alignment method of the video picture provided in the second aspect. The processor is configured to execute the computer program stored in the memory to implement the color temperature alignment method of the video picture described in the second aspect.

[0061] Optionally, the camera may further include a communication bus, and the communication bus is used to establish a connection between the processor and the memory.

[0062] In a seventh aspect, a video processing device is provided, the video processing device comprising a processor and a memory, the memory being used to store a computer program for executing the color temperature alignment method of the video picture provided in the third aspect. The processor is configured to execute the computer program stored in the memory to implement the color temperature alignment method of the video picture described in the third aspect.

[0063] Optionally, the video processing device may further include a communication bus, and the communication bus is used to establish a connection between the processor and the memory.

[0064] In an eighth aspect, a computer-readable storage medium is provided, wherein the storage medium stores instructions, and when the instructions are executed on a computer, the computer executes the steps of the method for color temperature alignment of a video image as described in the first aspect, the second aspect or the third aspect.

[0065] In a ninth aspect, a computer program product comprising instructions is provided. When the instructions are executed on a computer, the computer executes the steps of the method for color temperature alignment of video images as described in the first aspect, the second aspect or the third aspect.

[0066] In other words, a computer program is provided, which, when executed on a computer, enables the computer to execute the steps of the method for color temperature alignment of video images described in the first aspect, the second aspect or the third aspect.

[0067] The technical effects obtained in the above-mentioned second to ninth aspects are similar to the technical effects obtained by the corresponding technical means in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] Figure 1 It is a structural diagram of an implementation environment provided by an embodiment of the present application;

[0069] Figure 2 is a schematic diagram of another implementation environment provided by an embodiment of the present application;

[0070] Figure 3 is a structural schematic diagram of a computer device provided in an embodiment of the present application;

[0071] Figure 4 It is a flow chart of a method for color temperature alignment of a video screen provided in an embodiment of the present application;

[0072] Figure 5 is an actual color temperature curve diagram of multiple cameras provided in an embodiment of the present application;

[0073] Figure 6 is a schematic diagram of obtaining a captured image provided by an embodiment of the present application;

[0074] Figure 7 is a flow chart of another method for color temperature alignment of a video screen provided in an embodiment of the present application;

[0075] Figure 8 It is a structural schematic diagram of a color temperature alignment device for a video screen provided in an embodiment of the present application;

[0076] Fig. 9 It is a structural schematic diagram of another video picture color temperature alignment device provided in an embodiment of the present application;

[0077] Fig.10 It is a structural schematic diagram of another video screen color temperature alignment device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0078] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0079] Before explaining in detail the color temperature alignment method of the video picture provided by the embodiment of the present application, the terms, application scenarios and implementation environment involved in the embodiment of the present application are first introduced.

[0080] First, the terms involved in the embodiments of the present application are introduced.

[0081] Color temperature: It is a physical quantity used to define the color of a light source. That is, when an absolute black body is heated to a certain temperature and the color of the light it emits is the same as the color of the light emitted by a certain light source, the heating temperature of this absolute black body is called the color temperature of the light source, or color temperature for short. Its unit is K (Kelvin). An absolute black body is an object that absorbs all energy of any wavelength radiated onto its surface at any temperature. The heating temperature of an absolute black body starts from absolute zero (-273°C).

[0082] For example, the color of the light emitted by a 100W bulb is the same as the color of an absolute black body at 2527°C, so the color temperature of the light emitted by this bulb is (2527+273)K=2800K. That is, the color temperature of this bulb is 2800K.

[0083] White balance: Under different light source color temperature conditions, the camera's internal color circuit is adjusted to offset the color cast in the image captured by the camera, making it closer to the visual habits of the human eye. White balance can also be simply understood as the standard white captured by the camera lens under any light source color temperature condition, which is adjusted by the color circuit so that the image remains white.

[0084] Since the colors of objects illuminated by light sources of different color temperatures will be different, the camera will record the color of the object truthfully when shooting. However, the human eye can restore the color of objects illuminated by light sources of different color temperatures to their original colors. For example, a white picture under yellow light is still seen as white by the eye. Therefore, when shooting, the camera needs to use white balance technology to restore the color of the object to its original color, so that when the human eye looks at the picture, it will feel that the picture is in line with human eye habits.

[0085] Color temperature curve: used to record the correspondence between color temperature and white balance correction parameters. The white balance correction parameters include the white balance correction parameters of the R channel and the white balance correction parameters of the B channel. The horizontal coordinate of the color temperature curve is the white balance correction parameter of the R channel, denoted as RGain, and RGain = Gmean / Rmean; the vertical coordinate is the white balance correction parameter of the B channel, denoted as BGain, and BGain = Gmean / Bmean. Among them, Rmean is the average value of the R channel, Bmean is the average value of the B channel, and Gmean is the average value of the G channel. In order to record the correspondence between color temperature and white balance correction parameters, there is also a coordinate system in which the horizontal coordinate is the color temperature and the vertical coordinate is RGain. In this way, when performing a white balance operation, the color temperature of the image can be used as the horizontal coordinate to query the RGain of the vertical coordinate, and then the queried RGain can be used as the horizontal coordinate to query the BGain of the vertical coordinate. The queried RGain and BGain are used as white balance correction parameters of the image, and then white balance correction is performed on the image.

[0086] Secondly, the application scenarios involved in the embodiments of the present application are introduced.

[0087] With the popularity of online meetings, the effect and experience of meetings are becoming more and more important. Local meetings generally use multiple cameras or multi-cameras to carry out various intelligent director application scenarios. In order to make the video images output by the camera more in line with human eye habits, a standard color temperature curve is usually configured in the camera to facilitate the camera to perform white balance processing. However, due to the obvious differences in the white balance effects of different models of cameras, the video images output by the camera look inconsistent. In particular, when the video images output by multiple cameras are displayed on the same screen, the color tone effects of each video image on the screen are different, which seriously affects the meeting experience.

[0088] For example, in the same conference room, although a single camera has automatic white balance or intelligent white balance technology, the color temperature curves of different models of imaging sensors vary greatly, and the actual color temperature curves of the same model of imaging sensors also vary greatly due to production defects and other issues. Therefore, even for the same conference scene, the video images shot by different models of cameras will differ greatly in color temperature and hue, resulting in inconsistent conference images in the same conference room. For another example, in different conference rooms, due to the differences in lighting, decoration environment and camera models between multiple conference rooms, the color temperature effects under different cameras vary even more. Therefore, when conducting an online meeting and multiple remote images are displayed on the same screen, the hue effects of each video image on the screen will be different, seriously affecting the meeting experience in different conference rooms.

[0089] Based on this, an embodiment of the present application provides a method for color temperature alignment of video images, which can perform color temperature alignment on video images of multiple cameras in the same conference room and video images of multiple cameras in different conference rooms, so that when the video images output by multiple cameras are displayed on the same screen, the color tone effects of each video image on the screen are consistent.

[0090] It should be noted that the above is introduced by taking a conference room as an example. In practical applications, the color temperature alignment method of the video picture provided by the embodiment of the present application can also be applied to other scenes, such as large-scale press conferences, evening parties, etc.

[0091] Finally, the implementation environment involved in the embodiments of the present application is introduced.

[0092] Figure 1 This is a schematic diagram of the structure of an implementation environment provided by the embodiment of the present application. Figure 1 The implementation environment includes a multi-camera, which includes a plurality of cameras 101 and a main control 102. The plurality of cameras 101 are all connected in communication with the main control 102, and the communication connection is a wired connection or a wireless connection. In other words, the plurality of cameras 101 share the same main control.

[0093] The camera 101 includes a lens and an imaging sensor for providing a video image. The multiple cameras 101 are deployed in the same physical environment. Each camera 101 is used to capture the physical environment and send the captured video to the main control 102.

[0094] The multiple cameras 101 include at least one first camera and a reference camera. The video captured by the at least one first camera is called at least one first video, and the video captured by the reference camera is called a reference video. Figure 1 The number of cameras 101 is only used as an example and is not intended to limit the multi-camera provided in the embodiment of the present application. The physical environment in which the multiple cameras 101 are located may be a conference room, a large press conference, a party, etc., and the embodiment of the present application does not limit the physical environment.

[0095] The main control 102 is used to receive videos from each camera 101, including a first video from at least one first camera and a reference video from a reference camera. Based on the relative color temperature deviation corresponding to the at least one first camera, relative color temperature compensation is performed on the at least one first video, so that the color temperature of the video screen of the at least one first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, and the relative color temperature deviation is the actual color temperature deviation of the corresponding first camera relative to the reference camera. Then, the main control 102 outputs the at least one first video after relative color temperature compensation and the reference video.

[0096] In some embodiments, the main control 102 can also perform absolute color temperature compensation on the videos captured by the multiple cameras 101 and send them to other physical environments for display. That is, based on the absolute color temperature deviation corresponding to at least one first camera, absolute color temperature compensation is performed on at least one first video, so that the video picture of at least one first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart of the standard color. Based on the absolute color temperature deviation corresponding to the reference camera, absolute color temperature compensation is performed on the reference video, so that the color temperature of the video picture of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart. Then, at least one first video after absolute color temperature compensation and the reference video after absolute color temperature compensation are sent. Among them, the absolute color temperature deviation is the color temperature deviation of the corresponding camera relative to the calibration chart.

[0097] In other embodiments, the main control 102 can also receive videos in other physical environments and display them together with the videos captured by the multiple cameras 101. That is, at least one second video is received, the at least one second video is a video captured by at least one second camera, the color temperature of the video screen of the at least one second video is consistent, the at least one second camera is located in the same physical environment, and the physical environment where the at least one second camera is located is different from the physical environment where the at least one first camera is located; based on the absolute color temperature deviation corresponding to the reference camera, the at least one second video is reversely compensated for absolute color temperature, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video. Then, the at least one second video after reverse absolute color temperature compensation is output.

[0098] The camera 101 can be any camera, and the main control 102 can be any controller with image processing function.

[0099] It should be noted that the implementation environment described in the embodiments of the present application is for more clearly illustrating the technical solutions of the embodiments of the present application, and does not constitute a limitation on the technical solutions provided in the embodiments of the present application. A person of ordinary skill in the art can know that with the evolution of the system architecture, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0100] Figure 2 This is a schematic diagram of another implementation environment provided by the embodiment of the present application. Figure 2 , the implementation environment includes multiple cameras 201 and a video processing device 202. The camera 201 includes a lens, an imaging sensor, and a main control. That is, each camera 201 in the multiple cameras 201 has an independent main control. The main controls of the multiple cameras 201 are respectively connected to the video processing device 202 for communication, and the communication connection is a wired connection or a wireless connection.

[0101] The camera 201 is used to provide video images. The multiple cameras 201 are deployed in the same physical environment. The multiple cameras 201 include at least one first camera and a reference camera. The video captured by the at least one first camera is called at least one first video, and the video captured by the reference camera is called a reference video. Figure 2 The number of cameras 201 is only used as an example and is not intended to limit the number of cameras provided in the embodiment of the present application. The physical environment in which the multiple cameras 201 are located may be a conference room, a large press conference, a party, etc., and the embodiment of the present application does not limit the physical environment.

[0102] In this implementation environment, the color temperature alignment of the video image can be performed in two implementation methods, which will be introduced below.

[0103] In a first implementation, each camera 201 is used to capture the physical environment and send the captured video to a video processing device 202. The video processing device 202 is used to receive videos from each camera 101, including a first video from at least one first camera and a reference video from a reference camera. Based on the relative color temperature deviation corresponding to the at least one first camera, relative color temperature compensation is performed on the at least one first video, so that the color temperature of the video screen of the at least one first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, and the relative color temperature deviation is the actual color temperature deviation of the corresponding first camera relative to the reference camera. Then, the video processing device 202 outputs the at least one first video after relative color temperature compensation and the reference video.

[0104] In some embodiments, the video processing device 202 can also perform absolute color temperature compensation on the videos captured by the multiple cameras 201 and send them to other physical environments for display. That is, based on the absolute color temperature deviation corresponding to at least one first camera, the at least one first video is absolutely color temperature compensated so that the video picture of the at least one first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart of the standard color. Based on the absolute color temperature deviation corresponding to the reference camera, the reference video is absolutely color temperature compensated so that the color temperature of the video picture of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart. Then, the video processing device 202 sends the at least one first video after absolute color temperature compensation and the reference video after absolute color temperature compensation. The absolute color temperature deviation is the color temperature deviation of the corresponding camera relative to the calibration chart.

[0105] In a second implementation, the video processing device 202 is used to determine the relative color temperature deviation corresponding to at least one first camera, and then the video processing device 202 sends the relative color temperature deviation corresponding to each first camera to the at least one first camera. For each first camera in at least one first camera among the multiple cameras 201, the first camera can perform relative color temperature compensation on the first video collected by itself through its own main control based on its corresponding relative color temperature deviation, so as to ensure that the color temperature of the first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video. Then, the first camera outputs the first video after relative color temperature compensation.

[0106] In some embodiments, the video processing device 202 is also used to determine the absolute color temperature deviation corresponding to at least one first camera and the absolute color temperature deviation corresponding to the reference camera, and then the video processing device 202 sends the absolute color temperature deviation corresponding to each of the at least one first camera and the reference camera. For each camera in the multiple cameras 201, the camera can be a first camera or a reference camera. The camera can perform absolute color temperature compensation on the video collected by itself through its own main control based on its corresponding absolute color temperature deviation, so that the video screen of the video after absolute color temperature compensation is consistent with the color temperature of the calibration chart of the standard color. The video processing device 202 can also send the videos after absolute color temperature compensation of the multiple cameras 201 to other physical environments for display.

[0107] In other embodiments, for the above two implementations, the video processing device 202 can also receive videos in other physical environments and display them together with the videos captured by the multiple cameras 201. That is, at least one second video is received, the at least one second video is a video captured by at least one second camera, the color temperature of the video screen of the at least one second video is consistent, the at least one second camera is located in the same physical environment, and the physical environment of the at least one second camera is different from the physical environment of the at least one first camera; based on the absolute color temperature deviation corresponding to the reference camera, the at least one second video is reversely compensated for absolute color temperature, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video. Then, the at least one second video after reverse absolute color temperature compensation is output.

[0108] The camera 201 may be any type of camera, such as a monocular camera, a binocular camera, a multi-camera (ie, a multi-camera), etc.

[0109] The video processing device 202 can be an independent server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms, or a cloud computing service center.

[0110] Those skilled in the art should understand that the above-mentioned camera 201 and video processing device 202 are only examples, and other existing or future devices that may appear, if applicable to the embodiments of the present application, should also be included in the protection scope of the embodiments of the present application and are included here by reference.

[0111] It should be noted that the system architecture described in the embodiments of the present application is for the purpose of more clearly illustrating the technical solutions of the embodiments of the present application, and does not constitute a limitation on the technical solutions provided in the embodiments of the present application. A person of ordinary skill in the art can know that with the evolution of the system architecture, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0112] Please refer to Figure 3 , Figure 3 is a schematic diagram of a computer device according to an embodiment of the present application. The computer device may be Figure 2 The video processing device 202 shown in FIG. The computer device includes at least one processor 301 , a communication bus 302 , a memory 303 and at least one communication interface 304 .

[0113] The processor 301 may be a general-purpose central processing unit (CPU), a network processor (NP), a microprocessor, or may be one or more integrated circuits for implementing the solution of the present application, such as an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above-mentioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.

[0114] The communication bus 302 is used to transmit information between the above components. The communication bus 302 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0115] The memory 303 may be a read-only memory (ROM), a random access memory (RAM), an electrically erasable programmable read-only memory (EEPROM), an optical disc (including a compact disc read-only memory (CD-ROM), a compressed optical disc, a laser disc, a digital versatile disc, a Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 303 may exist independently and be connected to the processor 301 via the communication bus 302. The memory 303 may also be integrated with the processor 301.

[0116] The communication interface 304 uses any transceiver-like device for communicating with other devices or communication networks. The communication interface 304 includes a wired communication interface and may also include a wireless communication interface. Among them, the wired communication interface may be, for example, an Ethernet interface. The Ethernet interface may be an optical interface, an electrical interface, or a combination thereof. The wireless communication interface may be a wireless local area network (WLAN) interface, a cellular network communication interface, or a combination thereof, etc.

[0117] As an example, the processor 301 may include one or more CPUs, such as Figure 3 CPU0 and CPU1 are shown in the figure.

[0118] As an example, a computer device may include multiple processors, such as Figure 3 301 and processor 305 shown in FIG. Each of these processors may be a single-core processor or a multi-core processor. A processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (such as computer program instructions).

[0119] In some embodiments, the computer device may further include an output device and an input device. The output device communicates with the processor 301 and may display information in a variety of ways. For example, the output device may be a liquid crystal display (LCD), a light emitting diode (LED) display device, a cathode ray tube (CRT) display device, or a projector. The input device communicates with the processor 301 and may receive user input in a variety of ways. For example, the input device may be a mouse, a keyboard, a touch screen device, or a sensor device.

[0120] In some embodiments, the memory 303 is used to store the program code 310 for executing the solution of the present application, and the processor 301 can execute the program code 310 stored in the memory 303. The program code 310 may include one or more software modules, and the computer device may implement the following by the processor 301 and the program code 310 in the memory 303. Figure 4 or Figure 7 The embodiment provides a method for aligning the color temperature of a video image.

[0121] Next, the color temperature alignment method of the video picture provided by the embodiment of the present application is explained in detail.

[0122] Figure 4 This is a flow chart of a method for color temperature alignment of a video screen provided by an embodiment of the present application. This method can be applied not only to the above Figure 1 In the implementation environment shown in the figure, it can also be applied to the above Figure 2 The execution subject of this method can be the above Figure 1 The master control shown can also be Figure 2 For the convenience of description, the above Figure 1 The master control and Figure 2 The video processing devices shown are collectively referred to as color temperature alignment devices. Figure 4 , the method comprises the following steps.

[0123] Step 401: Acquire at least one first video and a reference video, wherein the at least one first video is a video captured by at least one first camera, and the reference video is a video captured by a reference camera, and the at least one first camera and the reference camera are located in the same physical environment.

[0124] Multiple cameras are deployed in the same physical environment, one of the multiple cameras is used as a reference camera, and the other cameras except the reference camera are used as the at least one first camera. The reference camera can be any one of the multiple cameras, but in other embodiments, due to the difference between the imaging sensors of the cameras, the color temperature of the video images captured by each camera in the multiple cameras is quite different. In this case, the reference camera can be the camera whose video images captured by the multiple cameras are closest to human eye habits. Of course, in actual applications, the reference camera can also be determined according to other methods, and the embodiments of the present application do not limit this.

[0125] For example, three cameras are deployed in a conference room, namely, camera X, camera Y, and camera Z. Camera X, camera Y, and camera Z respectively shoot the same area in the conference room. Assuming that the video image shot by camera X is closer to human eye habits than the video images shot by camera Y and camera Z, camera X is set as the reference camera, and camera Y and camera Z are set as the first cameras.

[0126] The at least one first camera acquires an area in the physical environment within its respective shooting fields to obtain at least one first video, and the reference camera acquires an area in the physical environment within its own shooting fields to obtain a reference video. The at least one first camera and the reference camera send the videos they acquire to the color temperature alignment device, so that the color temperature alignment device can obtain at least one first video and one reference video.

[0127] The physical environment refers to the environment of the physical location of the camera, such as the decoration environment and light source type of the physical location of the camera. Multiple cameras being located in the same physical environment means that the decoration environment of the physical location of the multiple cameras is the same, the light source type used in the physical location of the multiple cameras is the same, etc. For example, the multiple cameras can be located in the same physical space. The physical space can be a conference room, a large press conference, a party, etc., and the embodiments of the present application do not limit the physical environment.

[0128] Step 402: Based on the relative color temperature deviations respectively corresponding to the at least one first camera, relative color temperature compensation is performed on the at least one first video so that the color temperature of the video screen of the at least one first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, and the relative color temperature deviation is the actual color temperature deviation of the corresponding first camera relative to the reference camera.

[0129] Each camera has a built-in standard color temperature curve, which is determined by the imaging sensor of each camera. However, due to manufacturing errors of the imaging sensor and other reasons, the color temperatures of the images obtained by these cameras when shooting the same area in the same real environment are different, which in turn leads to different final white balance effects, so that users see different effects of the video images output by each camera. Therefore, in order to ensure that the effects of the video images output by each camera in the same physical environment remain consistent, the first videos respectively captured by the at least one first camera can be compensated for relative color temperature based on the actual color temperature deviation of the at least one first camera relative to the reference camera, so that the color temperature of the video image of the at least one first video after relative color temperature compensation is consistent with the color temperature of the video image of the reference video.

[0130] In some embodiments, the relative color temperature deviation is a deviation value with positive and negative signs, and the relative color temperature deviation is the deviation obtained by subtracting the actual color temperature of the reference camera from the actual color temperature of the corresponding first camera. At this time, for each first camera of the at least one first camera, the color temperature of the first video captured by the first camera is subtracted from the relative color temperature deviation corresponding to the first camera to obtain a first video after relative color temperature compensation, and the color temperature of the video screen of the first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video.

[0131] In other embodiments, the relative color temperature deviation is an absolute value of the deviation without a positive or negative sign. At this time, for each of the at least one first camera, if the actual color temperature of the first camera is greater than the actual color temperature of the reference camera, the color temperature of the first video captured by the first camera is subtracted from the relative color temperature deviation corresponding to the first camera to obtain the first video after relative color temperature compensation, and the color temperature of the video screen of the first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video. If the actual color temperature of the first camera is less than the actual color temperature of the reference camera, the color temperature of the first video captured by the first camera is added to the relative color temperature deviation corresponding to the first camera to obtain the first video after relative color temperature compensation, and the color temperature of the video screen of the first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video.

[0132] The relative color temperature deviation corresponding to the at least one first camera can be determined in a variety of ways. For example, the relative color temperature deviation corresponding to the at least one first camera can be determined and stored in an offline manner. Alternatively, the relative color temperature deviation corresponding to the at least one first camera can be determined and stored in an online manner. Taking the online manner as an example, the relative color temperature deviation corresponding to the at least one first camera can be determined according to the following steps (1)-(3).

[0133] (1) Acquire at least one first image and a first reference image, wherein the at least one first image is an image captured by the at least one first camera, the first reference image is an image captured by the reference camera, and the at least one first image and the first reference image have the same image content.

[0134] In some embodiments, each of the at least one first camera can capture a target area in the physical environment to obtain at least one first image, and the reference camera also captures a target area in the physical environment to obtain a first reference image. That is, the at least one first camera and the reference camera capture the same area in the physical environment (or in other words, the at least one first camera and the reference camera have the same shooting field of view), thereby obtaining at least one first image and a first reference image with the same content. Then, the at least one first camera and the reference camera respectively send their captured images to the color temperature alignment device, so that the color temperature alignment device can obtain at least one first image and a first reference image with the same content.

[0135] In other embodiments, the at least one first camera and the reference camera respectively capture partial areas in the physical environment to obtain captured images corresponding to each camera, and the shooting fields of the at least one first camera and the reference camera are the same but not completely the same. At this time, the at least one first camera and the reference camera respectively send their captured images to the color temperature alignment device, so that the color temperature alignment device can extract the same image content from the images captured by each camera, thereby obtaining at least one first image and a first reference image with the same image content.

[0136] Continuing with the above example, assuming that camera X is the reference camera, camera Y and camera Z are the first cameras, camera X, camera Y and camera Z respectively shoot the same area in the conference room (i.e., the shooting fields of camera X, camera Y and camera Z are the same), and obtain reference image X, first image Y and first image Z with the same image content. Alternatively, the shooting fields of camera X, camera Y and camera Z are the same but not completely the same. In this case, camera X, camera Y and camera Z respectively shoot the areas within their respective shooting fields, and then the color temperature alignment device extracts the same image content from the images shot by each camera, thereby obtaining reference image X, first image Y and first image Z with the same image content.

[0137] (2) Determining the color temperature of each first image in the at least one first image and the color temperature of the first reference image.

[0138] If the distance between the at least one first camera and the reference camera is greatly different, the distortion and visual direction of the image content of the at least one first image and the first reference image may be different. Therefore, in some embodiments, before determining the color temperature of each first image in the at least one first image and the color temperature of the first reference image, an affine transformation may be performed on the at least one first image based on the at least one first image and the first reference image, so that the distortion and visual direction of the at least one first image after the affine transformation are respectively consistent with the distortion and visual direction of the first reference image, thereby eliminating the difference in distortion and visual direction and improving the accuracy of the determined relative color temperature deviation.

[0139] Continuing with the above example, assume that camera X is the reference camera, camera Y and camera Z are the first cameras, and the distance between camera Y and camera X is relatively large, resulting in the first image Y captured by camera Y and the first reference image X captured by camera X having different image content distortion and visual direction in the same area. At this time, an affine transformation is performed on the angle of the first image Y relative to the angle of the first reference image X, so that the distortion and visual direction of the first image Y after the affine transformation are respectively consistent with the distortion and visual direction of the first reference image X. Similarly, camera Z also undergoes the above steps, so that the distortion and visual direction of the first image Z after the affine transformation are respectively consistent with the distortion and visual direction of the first reference image X.

[0140] Affine transformation is the superposition of two simple transformations, linear transformation and translation transformation. Affine transformation includes scaling, translation, rotation, reflection, shearing, etc. In the embodiment of the present application, the at least one first image can be scaled, translated, rotated, reflected, sheared, etc. relative to the first reference image, so that the distortion and visual direction of the at least one first image are respectively consistent with the distortion and visual direction of the first reference image.

[0141] (3) Based on the color temperature of the at least one first image and the color temperature of the first reference image, determine the color temperature deviation of the at least one first image relative to the first reference image, and obtain the relative color temperature deviation corresponding to the at least one first camera.

[0142] Based on the above description, the relative color temperature deviation may be a deviation value with positive or negative signs, or may be an absolute deviation value without positive or negative signs. In the case where the relative color temperature deviation is a deviation value with positive or negative signs, for each of the at least one first camera, the color temperature of the first image captured by the first camera is subtracted from the color temperature of the first reference image to obtain the color temperature deviation of the first image relative to the first reference image, and the color temperature deviation is determined as the relative color temperature deviation corresponding to the first camera. In the case where the relative color temperature deviation is an absolute deviation value without positive or negative signs, for each of the at least one first camera, the absolute deviation value of the color temperature of the first image captured by the first camera and the color temperature of the first reference image is directly determined, and the absolute deviation value is determined as the relative color temperature deviation corresponding to the first camera.

[0143] Based on the above description, due to manufacturing errors of the imaging sensors of the cameras and other reasons, the color temperatures of the images obtained by these cameras in the same real environment may be different, that is, the actual color temperatures of these cameras may be different. However, in some embodiments, the trends of the actual color temperature curves of these cameras under different types of light sources may be the same. In this case, the relative color temperature deviations corresponding to the at least one first camera can be directly determined according to the above steps (1)-(3), and then the relative color temperature compensation of the at least one first video can be performed based on the relative color temperature deviations corresponding to the at least one first camera.

[0144] For example, for each of the at least one first camera, the first camera collects images of the same area under different types of light sources for multiple times to obtain multiple images under different light sources, and the actual color temperature curve of the first camera is determined by the multiple images. The actual color temperature curves of other first cameras and the actual color temperature curve of the reference camera are determined in the same way. The actual color temperature curves of these cameras are plotted in the same coordinate system, and it is found that the trends of the actual color temperature curves of these cameras are the same. At this time, the relative color temperature deviations corresponding to the at least one first camera can be directly determined according to the above steps (1)-(3). For example, four cameras are deployed in a conference room. The same area in the conference room is photographed multiple times by these four cameras under different light sources to obtain multiple images under different light sources, and then the actual color temperature curve of each camera is plotted based on the captured images. The actual color temperature curves of these cameras are plotted in Figure 5 In the coordinate system shown. Figure 5 It can be seen that the actual color temperature curves of these cameras have the same trend. At this time, the relative color temperature deviation corresponding to the first camera among these cameras can be directly determined according to the above steps (1)-(3), and then based on the relative color temperature deviations corresponding to the first cameras, relative color temperature compensation is performed on the video captured by the first camera.

[0145] In other embodiments, the trends of the actual color temperature curves of these cameras under different types of light sources may be different. In this case, the relative color temperature deviation of each camera under different types of light sources can be determined, that is, the correspondence between the light source type, the camera identifier and the relative color temperature deviation. In this way, before performing relative color temperature compensation on the at least one first video through the above step 402, the relative color temperature deviation corresponding to the at least one first camera can also be obtained from the correspondence between the stored light source type, the camera identifier and the relative color temperature deviation based on the first light source type and the identifier of the at least one first camera. The first light source type is the type of light source used in the physical environment where the at least one first camera is located. In this way, the relative color temperature compensation can be performed on the at least one first video through the relative color temperature deviation corresponding to the at least one first camera.

[0146] The correspondence between the above-mentioned light source type, camera identification and relative color temperature deviation can be obtained in advance, for example, by receiving it from other devices, or by directly determining it through statistical analysis, which is not limited in this embodiment of the present application.

[0147] When determined through statistical analysis, the relative color temperature deviations of the at least one first camera under multiple light sources can be determined, and the types of the multiple light sources, the identifiers of the at least one first camera, and the relative color temperature deviations of the at least one first camera under the multiple light sources can be stored in the correspondence between the light source type, the camera identifier, and the relative color temperature deviation.

[0148] Light sources mainly refer to devices that provide artificial lighting, such as incandescent lamps, fluorescent lamps, LED lamps, etc. These light sources can be used for lighting in homes, businesses, residences or offices, and the embodiments of the present application do not limit this.

[0149] In some embodiments, the implementation process of determining the relative color temperature deviation of the at least one first camera under multiple light sources includes: acquiring at least one second image and a second reference image, the at least one second image is an image captured by the at least one first camera under a target light source, the second reference image is an image captured by the reference camera under a target light source, the target light source is any one of the multiple light sources, the at least one second image and the second reference image have the same image content, determining the color temperature of each second image in the at least one second image and the color temperature of the second reference image, determining the color temperature deviation of the at least one second image relative to the second reference image based on the color temperature of the at least one second image and the color temperature of the second reference image, and obtaining the relative color temperature deviation of the at least one first camera under the target light source. That is, for each of the multiple light sources, the relative color temperature deviation of the at least one first camera under the light source can be determined in the above manner.

[0150] It should be noted that the implementation process of determining the relative color temperature deviation of the at least one first camera under the target light source is similar to the implementation process of the above steps (1)-(3). For detailed implementation content, please refer to the corresponding description above, which will not be repeated here.

[0151] Step 403: Output at least one first video and a reference video after relative color temperature compensation.

[0152] In an embodiment of the present application, the color temperature alignment device can be connected to a display device. After performing relative color temperature compensation on the at least one first video according to the above steps, the color temperature of the video screen of the at least one first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video. At this time, displaying the at least one first video after relative color temperature compensation and the reference video on the display device can make the display effects of each video screen consistent, thereby improving the viewing experience of video screens from different cameras.

[0153] The display device may be a computer display screen, a mobile phone screen, a projector, etc., which is not limited in the embodiments of the present application.

[0154] The above steps 401-403 are the process of color temperature aligning the video images of each camera in the same physical environment. In other embodiments, the at least one first video and the reference video can be sent to other physical environments for display after absolute color temperature compensation, and the absolute color temperature compensated video sent by other physical environments can also be received. These two situations will be introduced separately below.

[0155] For the convenience of description, the physical environment in which the at least one first camera and the reference camera are located is referred to as a first physical environment, and other physical environments are referred to as second physical environments.

[0156] In the first case, based on the absolute color temperature deviations corresponding to the at least one first camera, absolute color temperature compensation is performed on the at least one first video, so that the video screen of the at least one first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart of the standard color, and the absolute color temperature deviations corresponding to the at least one first camera are the actual color temperature deviations of the corresponding first camera relative to the calibration chart. Based on the absolute color temperature deviation corresponding to the reference camera, absolute color temperature compensation is performed on the reference video, so that the color temperature of the video screen of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart, and the absolute color temperature deviation corresponding to the reference camera is the color temperature deviation of the reference camera relative to the calibration chart. Then, the at least one first video after absolute color temperature compensation and the reference video after absolute color temperature compensation are sent.

[0157] Since the camera types and light source types in different physical environments may be different, the color temperature of the images captured by the cameras in different physical environments may be different, which in turn leads to different final white balance effects. If the video images captured by the cameras in different physical environments are displayed simultaneously, the user will see different video images output by the cameras in different physical environments. Therefore, in order to ensure that the video images output by the cameras in the first physical environment are consistent with the video images output by the cameras in the second physical environment, the first videos respectively captured by the at least one first camera can be compensated for absolute color temperature based on the actual color temperature deviation of the at least one first camera relative to the calibration chart of the standard color, so that the color temperature of the video image of the at least one first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart. It is also possible to perform absolute color temperature compensation on the reference video captured by the reference camera based on the actual color temperature deviation of the reference video relative to the calibration chart of the standard color, so that the color temperature of the video image of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart. That is, the color temperature of the video images captured by each camera in the first physical environment is kept consistent with the color temperature of the calibration chart through absolute color temperature compensation, thereby facilitating alignment with the color temperature of the video images captured by each camera in the second physical environment.

[0158] In some embodiments, the absolute color temperature deviation is a deviation value with positive and negative signs, and the absolute color temperature deviation is the deviation obtained by subtracting the color temperature of the calibration chart of the standard color from the actual color temperature of the corresponding first camera. At this time, for each first camera of the at least one first camera, the color temperature of the first video captured by the first camera is subtracted from the absolute color temperature deviation corresponding to the first camera to obtain the first video after absolute color temperature compensation, and the color temperature of the video screen of the first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart. Similarly, for the reference camera, the color temperature of the reference video captured by the reference camera is subtracted from the absolute color temperature deviation corresponding to the reference camera to obtain the reference video after absolute color temperature compensation, and the color temperature of the video screen of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart.

[0159] In other embodiments, the absolute color temperature deviation is an absolute value of the deviation without a positive or negative sign. At this time, for each of the at least one first camera, if the actual color temperature of the first camera is greater than the color temperature of the calibration chart of the standard color, the color temperature of the first video captured by the first camera is subtracted from the absolute color temperature deviation corresponding to the first camera to obtain the first video after absolute color temperature compensation, and the color temperature of the video screen of the first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart; if the actual color temperature of the first camera is less than the actual color temperature of the calibration chart, the color temperature of the first video captured by the first camera is added to the absolute color temperature deviation corresponding to the first camera to obtain the first video after absolute color temperature compensation, and the color temperature of the video screen of the first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart. Similarly, for the benchmark camera, if the actual color temperature of the benchmark camera is greater than the color temperature of the calibration chart of the standard color, the color temperature of the benchmark video captured by the benchmark camera is subtracted from the absolute color temperature deviation corresponding to the benchmark camera to obtain the benchmark video after absolute color temperature compensation, and the color temperature of the video screen of the benchmark video after absolute color temperature compensation is consistent with the color temperature of the calibration chart; if the actual color temperature of the benchmark camera is less than the actual color temperature of the calibration chart, the color temperature of the benchmark video captured by the benchmark camera is added to the absolute color temperature deviation corresponding to the benchmark camera to obtain the benchmark video after absolute color temperature compensation, and the color temperature of the video screen of the benchmark video after absolute color temperature compensation is consistent with the color temperature of the calibration chart.

[0160] Continuing with the above example, assuming that in conference room A, camera X is used as a reference camera, camera Y and camera Z are first cameras, the absolute color temperature deviation of camera X relative to the calibration chart of the standard color is absolute color temperature deviation X, the absolute color temperature deviation of camera Y relative to the calibration chart is absolute color temperature deviation Y, and the absolute color temperature deviation of camera Z relative to the calibration chart is absolute color temperature deviation Z. Assuming that the above absolute color temperature deviation X, absolute color temperature deviation Y, and absolute color temperature deviation Z are deviation values ​​with positive and negative signs, the color temperature of the reference video X captured by camera X is subtracted from the absolute color temperature deviation X corresponding to camera X to obtain the reference video X after absolute color temperature compensation, and the color temperature of the video screen of the reference video X after absolute color temperature compensation is consistent with the color temperature of the calibration chart. Similarly, the color temperature of the first video Y captured by the camera Y is subtracted from the absolute color temperature deviation Y corresponding to the camera Y to obtain the first video Y after absolute color temperature compensation, and the color temperature of the video screen of the first video Y after absolute color temperature compensation is consistent with the color temperature of the calibration chart; the color temperature of the first video Z captured by the camera Z is subtracted from the absolute color temperature deviation Z corresponding to the camera Z to obtain the first video Z after absolute color temperature compensation, and the color temperature of the video screen of the first video Z after absolute color temperature compensation is consistent with the color temperature of the calibration chart. Then, the reference video X, the first video Y, and the first video Z after absolute color temperature compensation are sent to the conference room B.

[0161] It should be noted that after the absolute color temperature compensation is performed on the reference video captured by the reference camera in the first physical environment and the first video captured by at least one first camera, they can be sent to the second physical environment for display. The process of the second physical environment processing the reference video and the at least one first video respectively is similar to the second case below. Please refer to the relevant content below and will not be discussed in detail here.

[0162] Since the absolute color temperature deviation corresponding to each first camera in the at least one first camera is determined in the same manner, and is also determined in the same manner as the absolute color temperature deviation corresponding to the reference camera, one of the cameras is taken as an example for description below.

[0163] As an example, a reference image is obtained, where the reference image is an image obtained by shooting a calibration chart with a target camera, and the target camera is any one of the at least one first camera and the reference camera. A color temperature of the reference image is determined, and then a deviation between the color temperature of the reference image and the color temperature of the calibration chart is determined to obtain an absolute color temperature deviation corresponding to the target camera.

[0164] The calibration chart is fixed in the first physical environment. The target camera can collect data on the area where the calibration chart is fixed to obtain a collection image corresponding to the target camera. The target camera extracts the area where the calibration chart is located from the collection image to obtain a reference image, and sends the reference image to the color temperature alignment device. Alternatively, the target camera directly sends the collection image to the color temperature alignment device, and the color temperature alignment device extracts the area where the calibration chart is located from the collection image to obtain a reference image. For example, Figure 6 As shown, the calibration chart is a white square chart with a standard color temperature, and the calibration chart is fixed on a wall in the first physical environment. The target camera collects the calibration chart on the wall to obtain a collected image, and then after the above steps, a reference image can be obtained.

[0165] Based on the above description, the absolute color temperature deviation may be a deviation value with positive or negative signs, or may be an absolute deviation value without positive or negative signs. In the case where the absolute color temperature deviation is a deviation value with positive or negative signs, the color temperature of the calibration chart is subtracted from the color temperature of the reference image to obtain the color temperature deviation of the reference image relative to the calibration chart, and the color temperature deviation is determined as the absolute color temperature deviation corresponding to the target camera. In the case where the absolute color temperature deviation is an absolute deviation value without positive or negative signs, the absolute deviation value between the color temperature of the reference image and the color temperature of the calibration chart is directly determined, and the absolute deviation value is determined as the absolute color temperature deviation corresponding to the target camera.

[0166] Continuing with the above example, camera X and camera Y are deployed in conference room A. Camera X is selected as the target camera, and the calibration chart is photographed with camera X to extract the area where the calibration chart is located, and obtain reference image X. Assuming that the absolute color temperature deviation is a deviation value with positive and negative signs, the color temperature of the calibration chart is subtracted from the color temperature of the reference image X to obtain the color temperature deviation of the reference image X relative to the calibration chart, and the color temperature deviation is determined as the absolute color temperature deviation X of the camera X. Camera Y can also be selected as the target camera, and the calibration chart is photographed with camera Y to extract the area where the calibration chart is located to obtain reference image Y. The color temperature of the reference image Y is subtracted from the color temperature of the calibration chart to obtain the color temperature deviation of the reference image Y relative to the calibration chart, and the color temperature deviation is determined as the absolute color temperature deviation Y of the camera Y.

[0167] It should be noted that the calibration chart of the standard color can be a calibration chart of white with a standard color temperature (i.e., 4000K-4500K), or a calibration chart of other colors with a standard color temperature. Moreover, the shape of the calibration chart can be square, circular, etc., which is not limited in the embodiments of the present application.

[0168] In the second case, at least one second video is received, the at least one second video is a video captured by at least one second camera, the color temperature of the video screen of the at least one second video is consistent, the at least one second camera is located in the same physical environment, and the physical environment of the at least one second camera is different from the physical environment of the at least one first camera; based on the absolute color temperature deviation corresponding to the reference camera, the at least one second video is reversely compensated for absolute color temperature, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video, and the absolute color temperature deviation is the color temperature deviation of the reference camera relative to the calibration chart of the standard color. Then, the at least one second video after reverse absolute color temperature compensation is output.

[0169] Based on the above description, the physical environment in which the at least one first camera is located is called the first physical environment, and the physical environment in which the at least one second camera is located is called the second physical environment. Since the video images of each camera in the second physical environment need to be sent to the first physical environment for display, the video images of each camera in the second physical environment need to be absolutely color temperature compensated through the calibration chart, that is, the at least one second video is absolutely color temperature compensated, and the color temperature of the video images of the at least one second video is consistent. Since the video images of each camera in the first physical environment are relatively color temperature compensated, that is, in the above steps 401-403, the color temperature of the video images of at least one first camera in the first physical environment is consistent with the color temperature of the reference camera, so in order to make the video images of each camera in the second physical environment consistent with the color temperature of the video images of each camera in the first physical environment, it is necessary to perform reverse absolute color temperature compensation on the at least one second video based on the absolute color temperature deviation corresponding to the reference camera in the first physical environment, so that the color temperature of the video images of each camera in the second physical environment can be kept consistent with the color temperature of the video images of the reference camera. At this time, the video images of each camera in the first physical environment and the video images of each camera in the second physical environment are displayed with the color temperature of the video image of the reference video in the first physical environment.

[0170] Among them, the absolute color temperature compensation process of the at least one second video is similar to the implementation process of the first case mentioned above. For detailed implementation content, please refer to the corresponding description above, which will not be repeated here.

[0171] In some embodiments, the absolute color temperature deviation of the reference camera is a deviation value with positive and negative signs, and the absolute color temperature deviation is the deviation obtained by subtracting the color temperature of the calibration chart of the standard color from the actual color temperature of the reference camera. At this time, for each second video in the at least one second video, the color temperature of the second video is added to the absolute color temperature deviation of the reference camera to obtain a second video after reverse absolute color temperature compensation, and the color temperature of the video screen of the second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video.

[0172] In other embodiments, the absolute color temperature deviation of the reference camera is an absolute deviation value without positive or negative signs. At this time, for each second video in the at least one second video, if the color temperature of the video screen of the second video is greater than the color temperature of the video screen of the reference video, the color temperature of the second video is subtracted from the absolute color temperature deviation corresponding to the reference camera to obtain the second video after reverse absolute color temperature compensation, and the color temperature of the video screen of the second video after reverse absolute color temperature compensation is consistent with the color temperature of the reference video; if the color temperature of the video screen of the second video is less than the color temperature of the video screen of the reference video, the color temperature of the second video is added to the absolute color temperature deviation of the reference camera to obtain the second video after reverse absolute color temperature compensation, and the color temperature of the video screen of the second video after reverse absolute color temperature compensation is consistent with the color temperature of the reference video.

[0173] Continuing with the above example, assume that camera X in conference room A is the reference camera, camera Y and camera Z are the first cameras, and the captured video images are reference video X, first video Y, and first video Z, respectively. Based on the relative color temperature deviations of camera Y and camera Z relative to camera X, relative color temperature compensation is performed on the first video Y and the first video Z, so that the color temperatures of the video images of the first video Y and the first video Z after relative color temperature compensation are consistent with the color temperature of reference video X. There are cameras C and D in conference room B, and the captured video images are the second video C and the second video D, respectively. Based on the absolute color temperature deviations of camera C and camera D, absolute color temperature compensation is performed on the second video C and the second video D, respectively, so that the color temperatures of the video images of the second video C and the second video D after absolute color temperature compensation are consistent with the color temperature of the calibration chart. Meeting room A receives the second video C and the second video D after absolute color temperature compensation from meeting room B. Assuming that the absolute color temperature deviation of camera X is a deviation value with positive and negative signs, the color temperature of the video screen of the second video C and the second video D is added to the absolute color temperature deviation corresponding to camera X, respectively, to obtain the second video C and the second video D after reverse absolute color temperature compensation. The color temperature of the video screen of the second video C and the second video D after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video X. At this time, the second video C and the second video D can be displayed in meeting room A with the color temperature of the reference video X, that is, the reference video X, the first video Y, the first video Z, the second video C and the second video D are displayed in meeting room A with the same color temperature.

[0174] In an embodiment of the present application, the color temperature alignment device performs relative color temperature compensation on the at least one first video by aligning the color temperature of the at least one first video to the color temperature of the reference video, so that the color temperature of the at least one first video is consistent with the color temperature of the reference video, so that when the at least one first video and the reference video are displayed on the same screen, the color temperature of each video screen can be kept consistent, which is more in line with the viewing effect of the human eye. In other words, when multiple cameras or multi-cameras are used in a single physical environment to perform a variety of intelligent directing application scenarios, although the white balance effects of different cameras are significantly different, after using this method, when the video screens output by multiple cameras in a single physical environment are displayed on the same screen, the color tone effects of each video screen on the screen are consistent, which can improve the viewing experience of the single physical environment.

[0175] In addition, the color temperature alignment device can also align the color temperature of the at least one first video and the reference video in the first physical environment to the color temperature of the standard color calibration chart, so as to perform absolute color temperature compensation on the at least one first video and the reference video, so that the color temperature of the at least one first video and the reference video is consistent with the color temperature of the standard color calibration chart. In this way, when the at least one first video and the reference video are sent to the second physical environment for display, based on the absolute color temperature deviation of the reference camera in the second physical environment, the at least one first video and the reference video are reversely absolutely compensated for the color temperature, so that the color temperature of the at least one first video and the reference video is consistent with the color temperature of the reference video in the second physical environment, or the first physical environment receives at least one second video from the second physical environment, and based on the absolute color temperature deviation of the reference camera in the first physical environment, the at least one second video is respectively reversely absolutely compensated for the color temperature, so that the color temperature of the at least one second video is consistent with the color temperature of the reference video in the first physical environment, so that the color temperature of videos from different physical environments is consistent when displayed on the same screen, which conforms to the viewing effect of the human eye. Therefore, when using multiple cameras or multi-cameras in multiple physical environments to perform various intelligent directing application scenarios, although the white balance effects of different cameras are obviously different, and the light source types of different physical environments are different, after using this method, when the video images output by multiple cameras in multiple physical environments are displayed on the same screen, the color tone effects of each video image on the screen are consistent, which can improve the viewing experience in multiple physical environments.

[0176] Moreover, the relative color temperature deviation of each camera under different types of light sources is determined and stored in the corresponding relationship between the light source type, camera identification and relative color temperature deviation. Through the relative color temperature deviation under different light source types, relative color temperature compensation is performed on each video, which can adapt to different light sources in different physical environments and make the color temperature alignment of the video screen more targeted. In addition, the above method does not require weighted averaging of the color temperature curves of multiple cameras, which can reduce the amount of calculation, and can also add new cameras, with good scalability.

[0177] Figure 7 is a flow chart of another method for color temperature alignment of a video screen provided in an embodiment of the present application. This method can be applied to the above Figure 2 In the implementation environment shown, the execution subject of the method is the above Figure 2 The camera and video processing equipment shown. Please refer to Figure 7 , the method comprises the following steps.

[0178] Step 701: A video processing device determines a relative color temperature deviation corresponding to at least one first camera, where the relative color temperature deviation is an actual color temperature deviation of the at least one first camera relative to a reference camera, and the at least one first camera and the reference camera are located in the same physical environment.

[0179] The relative color temperature deviations corresponding to the at least one first camera can be determined in a variety of ways. For example, the relative color temperature deviations corresponding to the at least one first camera are determined and stored in an offline manner. Alternatively, the relative color temperature deviations corresponding to the at least one first camera are determined and stored in an online manner. Taking the online manner as an example, the process of determining the relative color temperature deviations corresponding to the at least one first camera includes: acquiring at least one first image and a first reference image, the at least one first image is an image captured by at least one first camera, the first reference image is an image captured by a reference camera, and the image content of the at least one first image and the first reference image is the same; determining the color temperature of each first image in the at least one first image and the color temperature of the first reference image; based on the color temperature of the at least one first image and the color temperature of the first reference image, determining the color temperature deviations of the at least one first image relative to the first reference image, and obtaining the relative color temperature deviations corresponding to the at least one first camera.

[0180] If the distance between the at least one first camera and the reference camera is greatly different, the distortion and visual direction of the image content of the at least one first image and the first reference image may be different. Therefore, in some embodiments, before determining the color temperature of each first image in the at least one first image and the color temperature of the first reference image, an affine transformation may be performed on the at least one first image based on the at least one first image and the first reference image, so that the distortion and visual direction of the at least one first image after the affine transformation are respectively consistent with the distortion and visual direction of the first reference image.

[0181] It should be noted that the above content is similar to the relevant content in step 402. For the specific implementation process, please refer to the relevant description in step 402 above, which will not be repeated here.

[0182] Step 702: The video processing device sends the corresponding relative color temperature deviation to the at least one first camera.

[0183] Based on the above description, due to manufacturing errors of the imaging sensors of the cameras and other reasons, the color temperatures of the images obtained by these cameras in the same real environment and the same area may be different, that is, the actual color temperatures of these cameras may be different. However, in some embodiments, the trends of the actual color temperature curves of these cameras under different types of light sources may be the same. In this case, the relative color temperature deviations corresponding to the at least one first camera can be determined directly according to the above steps, and then the relative color temperature deviations corresponding to the at least one first camera can be sent to the at least one first camera.

[0184] In other embodiments, the trends of actual color temperature curves of these cameras under different types of light sources may be different. In this case, the relative color temperature deviations of the at least one first camera under multiple light sources can be determined, and the types of the multiple light sources, the identifiers of the at least one first camera, and the relative color temperature deviations of the at least one first camera under the multiple light sources can be stored in the correspondence between the light source type, the camera identifier and the relative color temperature deviation, and the correspondence is sent to the at least one first camera.

[0185] In some embodiments, the implementation process of determining the relative color temperature deviation of the at least one first camera under multiple light sources includes: acquiring at least one second image and a second reference image, the at least one second image is an image captured by the at least one first camera under a target light source, the second reference image is an image captured by the reference camera under a target light source, the target light source is any one of the multiple light sources, the at least one second image and the second reference image have the same image content, determining the color temperature of each second image in the at least one second image and the color temperature of the second reference image, determining the color temperature deviation of the at least one second image relative to the second reference image based on the color temperature of the at least one second image and the color temperature of the second reference image, and obtaining the relative color temperature deviation of the at least one first camera under the target light source. That is, for each of the multiple light sources, the relative color temperature deviation of the at least one first camera under the light source can be determined in the above manner.

[0186] It should be noted that the above content is similar to the relevant content in step 402. For the specific implementation process, please refer to the relevant description in step 402 above, which will not be repeated here.

[0187] Step 703: For each first camera in the at least one first camera, the first camera captures a first video.

[0188] Step 704: The first camera performs relative color temperature compensation on the captured first video based on its corresponding relative color temperature deviation, so that the color temperature of the video screen of the first video after relative color temperature compensation is consistent with the color temperature of the video screen of a reference video, where the reference video is a video captured by a reference camera, and the first camera and the reference camera are located in the same physical environment.

[0189] Based on the above description, the trends of the actual color temperature curves of the at least one first camera under different types of light sources may be the same or different. In the case where the trends of the actual color temperature curves of these cameras under different types of light sources are the same, the first camera can directly perform relative color temperature compensation on the captured first video based on its corresponding relative color temperature deviation, so that the color temperature of the video screen of the first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video. In the case where the trends of the actual color temperature curves of these cameras under different types of light sources are different, the first camera can obtain the corresponding relative color temperature deviation from the corresponding relationship between the stored light source type, the camera identifier and the relative color temperature deviation based on the first light source type and the identifier of the first camera, and the first light source type is the type of light source used in the physical environment where the first camera is located. Then, based on the obtained relative color temperature deviation, relative color temperature compensation is performed on the captured first video, so that the color temperature of the video screen of the first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video.

[0190] It should be noted that the above content is similar to the relevant content in step 402. For the specific implementation process, please refer to the relevant description in step 402 above, which will not be repeated here.

[0191] Step 705: The first camera outputs a first video after relative color temperature compensation.

[0192] In an embodiment of the present application, the video processing device can be connected to a display device. After performing relative color temperature compensation on the at least one first video according to the above steps, the color temperature of the video screen of the at least one first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video. At this time, displaying the at least one first video after relative color temperature compensation and the reference video on the display device can make the display effects of each video screen consistent, thereby improving the viewing experience of video screens from different cameras.

[0193] The display device may be a computer display screen, a mobile phone screen, a projector, etc., which is not limited in the embodiments of the present application.

[0194] The above steps 701-705 are the process of color temperature aligning the video images of each camera in the same physical environment. In other embodiments, the at least one first video and the reference video can be sent to other physical environments for display after absolute color temperature compensation, and videos from other physical environments can also be received. These two situations will be introduced separately below.

[0195] In the first case, the video processing device determines the absolute color temperature deviation corresponding to the at least one first camera and the absolute color temperature deviation corresponding to the reference camera, and sends the absolute color temperature deviations corresponding to the at least one first camera and the reference camera. The at least one first camera performs absolute color temperature compensation on the first video captured by itself based on the absolute color temperature deviation corresponding to itself, so that the video screen of the at least one first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart of the standard color. The reference camera performs absolute color temperature compensation on the reference video captured by itself based on the absolute color temperature deviation corresponding to itself, so that the color temperature of the video screen of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart. Then, the at least one first camera sends the first video after absolute color temperature compensation to the video processing device, the reference camera sends the reference video after absolute color temperature compensation to the video processing device, and the video processing device sends the at least one first video after absolute color temperature compensation and the reference video after absolute color temperature compensation.

[0196] Since the absolute color temperature deviation corresponding to each camera in the at least one first camera is determined in the same manner, and is also determined in the same manner as the absolute color temperature deviation corresponding to the reference camera, one of the cameras is taken as an example for description below.

[0197] As an example, a reference image is obtained, where the reference image is an image obtained by shooting a calibration chart with a target camera, and the target camera is any one of at least one first camera and a reference camera. A color temperature of the reference image is determined, and then a deviation between the color temperature of the reference image and the color temperature of the calibration chart is determined to obtain an absolute color temperature deviation corresponding to the target camera.

[0198] It should be noted that the above content is similar to the relevant content in step 403. For the specific implementation process, please refer to the relevant description in step 403 above, which will not be repeated here.

[0199] In the second case, the video processing device receives at least one second video, the at least one second video is a video captured by at least one second camera, the color temperature of the video screen of the at least one second video is consistent, the at least one second camera is located in the same physical environment, and the physical environment of the at least one second camera is different from the physical environment of the at least one first camera; based on the absolute color temperature deviation corresponding to the reference camera, the at least one second video is reversely compensated for absolute color temperature, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video. Then, the video processing device outputs the at least one second video after reverse absolute color temperature compensation.

[0200] It should be noted that the above content is similar to the relevant content in step 403. For the specific implementation process, please refer to the relevant description in step 403 above, which will not be repeated here.

[0201] In an embodiment of the present application, the video processing device determines the relative color temperature deviations corresponding to the at least one first camera, and then sends the relative color temperature deviations corresponding to the at least one first camera. The first camera can perform relative color temperature compensation on the first video captured by itself based on its own corresponding relative color temperature deviation to ensure that the color temperature of the first video after relative color temperature compensation is consistent with the color temperature of the reference video, which is more in line with the viewing effect of the human eye. In other words, when multiple cameras or multi-cameras are used in a single physical environment to perform a variety of intelligent directing application scenarios, although the white balance effects of different cameras are significantly different, after using this method, when the video images output by multiple cameras in a single physical environment are displayed on the same screen, the color tone effects of each video image on the screen are consistent, which can improve the viewing experience of a single physical environment.

[0202] In addition, the video processing device may also determine the absolute color temperature deviations corresponding to the at least one first camera and the absolute color temperature deviation corresponding to the reference camera, and then send the respective absolute color temperature deviations to the at least one first camera and the reference camera. The at least one first camera and the reference camera may perform absolute color temperature compensation on the video captured by themselves based on the absolute color temperature deviations corresponding to themselves, so that the at least one first video and the reference video are consistent with the color temperature of the calibration chart of the standard color. In this way, when the at least one first video and the reference video are sent to the second physical environment for display, based on the absolute color temperature deviation of the reference camera in the second physical environment, the at least one first video and the reference video are reversely compensated for absolute color temperature, so that the color temperatures of the at least one first video and the reference video are consistent with the color temperature of the reference video in the second physical environment. Alternatively, the first physical environment receives at least one second video from the second physical environment, and based on the absolute color temperature deviation of the reference camera in the first physical environment, reverse absolute color temperature compensation is performed on the at least one second video, so that the color temperature of the at least one second video is consistent with the color temperature of the reference video in the first physical environment. This ensures that the color temperatures of videos from different physical environments are consistent when displayed on the same screen, which meets the viewing effect of the human eye. Therefore, when using multiple cameras or multi-cameras in multiple physical environments to perform various intelligent directing application scenarios, although the white balance effects of different cameras are obviously different, and the light source types of different physical environments are different, after using this method, when the video images output by multiple cameras in multiple physical environments are displayed on the same screen, the color tone effects of each video image on the screen are consistent, which can improve the viewing experience in multiple physical environments.

[0203] Moreover, the relative color temperature deviation of each camera under different types of light sources is determined and stored in the corresponding relationship between the light source type, camera identification and relative color temperature deviation. Through the relative color temperature deviation under different light source types, relative color temperature compensation is performed on each video, which can adapt to different light sources in different physical environments and make the color temperature alignment of the video screen more targeted. In addition, the above method does not require weighted averaging of the color temperature curves of multiple cameras, which can reduce the amount of calculation, and can also add new cameras, with good scalability.

[0204] Figure 8 is a schematic diagram of the structure of a color temperature alignment device for a video screen provided in an embodiment of the present application. The color temperature alignment device for the video screen can be implemented by software, hardware, or a combination of both to become part or all of a color temperature alignment device. The color temperature alignment device can be Figure 4 The embodiment shown relates to a color temperature alignment device. Figure 8 The device includes: a video acquisition module 801, a first color temperature compensation module 802 and a first output module 803.

[0205] The video acquisition module 801 is used to acquire at least one first video and a reference video, wherein the at least one first video is a video captured by at least one first camera, and the reference video is a video captured by a reference camera, and the at least one first camera and the reference camera are located in the same physical environment;

[0206] A first color temperature compensation module 802 is configured to perform relative color temperature compensation on the at least one first video based on the relative color temperature deviations respectively corresponding to the at least one first camera, so that the color temperature of the video screen of the at least one first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the relative color temperature deviation is an actual color temperature deviation of the corresponding first camera relative to the reference camera;

[0207] The first output module 803 is used to output the at least one first video and the reference video after relative color temperature compensation.

[0208] Optionally, the device further comprises:

[0209] A first image acquisition module, used to acquire at least one first image and a first reference image, wherein the at least one first image is an image acquired by the at least one first camera, the first reference image is an image acquired by the reference camera, and the at least one first image and the first reference image have the same image content;

[0210] a first color temperature determination module, configured to determine the color temperature of each first image in the at least one first image and the color temperature of the first reference image;

[0211] The first color temperature deviation determination module is used to determine the color temperature deviation of the at least one first image relative to the first reference image based on the color temperature of the at least one first image and the color temperature of the first reference image, and obtain the relative color temperature deviation corresponding to the at least one first camera.

[0212] Optionally, the device further comprises:

[0213] An affine transformation module is used to perform affine transformation on the at least one first image based on the at least one first image and the first reference image, so that the distortion and visual direction of the at least one first image after the affine transformation are consistent with the distortion and visual direction of the first reference image respectively.

[0214] Optionally, the device further comprises:

[0215] A color temperature deviation acquisition module is used to acquire the relative color temperature deviation corresponding to the at least one first camera from the stored correspondence between the light source type, the camera identifier and the relative color temperature deviation based on the first light source type and the identifier of the at least one first camera, wherein the first light source type is the type of light source used in the physical environment where the at least one first camera is located.

[0216] Optionally, the device further comprises:

[0217] A second color temperature deviation determination module is used to determine the relative color temperature deviation of the at least one first camera under a plurality of light sources respectively;

[0218] The storage module is used to store the types of the multiple light sources, the identifier of the at least one first camera and the relative color temperature deviation of the at least one first camera under the multiple light sources in the corresponding relationship between the light source type, the camera identifier and the relative color temperature deviation.

[0219] Optionally, the second color temperature deviation determining module is specifically used to:

[0220] Acquire at least one second image and a second reference image, wherein the at least one second image is an image respectively captured by the at least one first camera under a target light source, and the second reference image is an image captured by the reference camera under a target light source, wherein the target light source is any one of a plurality of light sources, and the at least one second image and the second reference image have the same image content;

[0221] determining a color temperature of each of the at least one second image and a color temperature of the second reference image;

[0222] Based on the color temperature of the at least one second image and the color temperature of the second reference image, the color temperature deviation of the at least one second image relative to the second reference image is determined, and the relative color temperature deviation corresponding to the at least one first camera under the target light source is obtained.

[0223] Optionally, the device further comprises:

[0224] A receiving module, configured to receive at least one second video, wherein the at least one second video is a video captured by at least one second camera, the video screens of the at least one second video have a consistent color temperature, the at least one second camera is located in the same physical environment, and the physical environment in which the at least one second camera is located is different from the physical environment in which the at least one first camera is located;

[0225] A second color temperature compensation module is used to perform reverse absolute color temperature compensation on the at least one second video based on the absolute color temperature deviation corresponding to the reference camera, so that the color temperature of the video screen of the at least one second video after the reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video, and the absolute color temperature deviation is the color temperature deviation of the reference camera relative to the calibration chart of the standard color;

[0226] The second output module is used to output the at least one second video after reverse absolute color temperature compensation.

[0227] Optionally, the device further comprises:

[0228] A third color temperature compensation module is used to perform absolute color temperature compensation on the at least one first video based on the absolute color temperature deviations respectively corresponding to the at least one first camera, so that the video picture of the at least one first video after the absolute color temperature compensation is consistent with the color temperature of the calibration chart of the standard color, and the absolute color temperature deviations respectively corresponding to the at least one first camera are the actual color temperature deviations of the corresponding first camera relative to the calibration chart;

[0229] A fourth color temperature compensation module is used to perform absolute color temperature compensation on the reference video based on the absolute color temperature deviation corresponding to the reference camera, so that the color temperature of the video screen of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart, and the absolute color temperature deviation corresponding to the reference camera is the color temperature deviation of the reference camera relative to the calibration chart;

[0230] The sending module is used to send the at least one first video after absolute color temperature compensation and the reference video after absolute color temperature compensation.

[0231] Optionally, the device further comprises:

[0232] A second image acquisition module is used to acquire a reference image, where the reference image is an image obtained by photographing the calibration chart with a target camera, where the target camera is any one of the at least one first camera and the reference camera;

[0233] A second color temperature determination module, used for determining the color temperature of the reference image;

[0234] The third color temperature deviation determination module is used to determine the deviation between the color temperature of the reference image and the color temperature of the calibration chart to obtain the absolute color temperature deviation corresponding to the target camera.

[0235] In an embodiment of the present application, by aligning the color temperature of at least one first video to the color temperature of a reference video, relative color temperature compensation is performed on the at least one first video, so that the color temperature of the at least one first video is consistent with the color temperature of the reference video, so that when the at least one first video and the reference video are displayed on the same screen, the color temperature of each video screen can be kept consistent, which is more in line with the viewing effect of the human eye. In other words, when multiple cameras or multi-cameras are used in a single physical environment to perform a variety of intelligent directing application scenarios, although the white balance effects of different cameras are significantly different, after using this method, when the video screens output by multiple cameras in a single physical environment are displayed on the same screen, the color tone effects of each video screen on the screen are consistent, which can improve the viewing experience of a single physical environment.

[0236] In addition, the color temperature of the at least one first video and the reference video in the first physical environment can be aligned to the color temperature of the calibration chart of the standard color, so as to perform absolute color temperature compensation on the at least one first video and the reference video, so that the color temperature of the at least one first video and the reference video is consistent with the color temperature of the calibration chart of the standard color. In this way, when the at least one first video and the reference video are sent to the second physical environment for display, based on the absolute color temperature deviation of the reference camera in the second physical environment, the at least one first video and the reference video are reversely compensated for absolute color temperature, so that the color temperature of the at least one first video and the reference video is consistent with the color temperature of the reference video in the second physical environment, or the first physical environment receives at least one second video from the second physical environment, and based on the absolute color temperature deviation of the reference camera in the first physical environment, reverse absolute color temperature compensation is performed on the at least one second video, so that the color temperature of the at least one second video is consistent with the color temperature of the reference video in the first physical environment, so that the color temperature of videos from different physical environments is consistent when displayed on the same screen, which meets the viewing effect of the human eye. Therefore, when using multiple cameras or multi-cameras in multiple physical environments to perform various intelligent directing application scenarios, although the white balance effects of different cameras are obviously different, and the light source types of different physical environments are different, after using this method, when the video images output by multiple cameras in multiple physical environments are displayed on the same screen, the color tone effects of each video image on the screen are consistent, which can improve the viewing experience in multiple physical environments.

[0237] Moreover, the relative color temperature deviation of each camera under different types of light sources is determined and stored in the corresponding relationship between the light source type, camera identification and relative color temperature deviation. Through the relative color temperature deviation under different light source types, relative color temperature compensation is performed on each video, which can adapt to different light sources in different physical environments and make the color temperature alignment of the video screen more targeted. In addition, the above method does not require weighted averaging of the color temperature curves of multiple cameras, which can reduce the amount of calculation, and can also add new cameras, with good scalability.

[0238] It should be noted that: the color temperature alignment device for video images provided in the above embodiment only uses the division of the above functional modules as an example when aligning the color temperature of the video images. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the color temperature alignment device for video images provided in the above embodiment and the color temperature alignment method embodiment for video images belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0239] Fig. 9 is a schematic diagram of the structure of another video color temperature alignment device provided in an embodiment of the present application. The video color temperature alignment device can be implemented by software, hardware or a combination of both to form part or all of a camera, and the camera can be any type of camera. Fig. 9 The device includes: a collection module 901, a first color temperature compensation module 902 and an output module 903.

[0240] A collection module 901 is used to collect a first video;

[0241] A first color temperature compensation module 902 is used to perform relative color temperature compensation on the first video based on a relative color temperature deviation, so that the color temperature of the video screen of the first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, the relative color temperature deviation is an actual color temperature deviation of the first camera relative to the reference camera, the reference video is a video captured by the reference camera, and the first camera and the reference camera are located in the same physical environment;

[0242] The output module 903 is used to output the first video after relative color temperature compensation.

[0243] Optionally, the device further comprises:

[0244] The color temperature deviation acquisition module is used to acquire the relative color temperature deviation from the stored correspondence between the light source type, the camera identifier and the relative color temperature deviation based on the first light source type and the identifier of the first camera. The first light source type is the type of light source used in the physical environment where the first camera is located.

[0245] Optionally, the device further comprises:

[0246] A second color temperature compensation module is used to perform absolute color temperature compensation on the first video based on an absolute color temperature deviation, so that the video picture of the first video after absolute color temperature compensation is consistent with the color temperature of a calibration chart of a standard color, and the absolute color temperature deviation is an actual color temperature deviation of the first camera relative to the calibration chart;

[0247] The sending module is used to send the first video after absolute color temperature compensation.

[0248] In an embodiment of the present application, the at least one first camera performs relative color temperature compensation on the at least one first video based on its own relative color temperature deviation, so that the color temperature of the video screen of the first video after relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, so that the at least one first video with the same color temperature as the reference video can be sent. In addition, the at least one first camera and the reference camera can also perform absolute color temperature compensation on the at least one first video and the reference video based on their own corresponding absolute color temperature deviations, so that the color temperature of the video screen of the first video after absolute color temperature compensation is consistent with the color temperature of the calibration chart of standard colors, and the color temperature of the video screen of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart of standard colors, so that the at least one first video and the reference video with the same color temperature as the calibration chart can be sent. In the subsequent process, the color temperature of the video screen can be quickly and accurately aligned.

[0249] It should be noted that: the color temperature alignment device for video images provided in the above embodiment only uses the division of the above functional modules as an example when aligning the color temperature of the video images. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the color temperature alignment device for video images provided in the above embodiment and the color temperature alignment method embodiment for video images belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0250] Fig.10 is a structural diagram of another video picture color temperature alignment device provided in an embodiment of the present application. The video picture color temperature alignment device can be implemented by software, hardware or a combination of both to become part or all of a video processing device. The video processing device can be Figure 3 Computer equipment shown. Fig.10 The device includes: a first color temperature deviation determining module 1001 and a first sending module 1002.

[0251] A first color temperature deviation determining module 1001 is used to determine a relative color temperature deviation corresponding to the at least one first camera, where the relative color temperature deviation is an actual color temperature deviation of the at least one first camera relative to the reference camera, and the at least one first camera and the reference camera are located in the same physical environment;

[0252] The first sending module 1002 is used to send the corresponding relative color temperature deviations to the at least one first camera, so that each of the at least one first camera performs relative color temperature compensation on the first video captured by the respective camera based on the corresponding relative color temperature deviations, so as to ensure that the color temperature of the video screen of the first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, where the reference video is the video captured by the reference camera.

[0253] Optionally, the device further comprises:

[0254] A second color temperature deviation determination module is used to determine the relative color temperature deviation of the at least one first camera under a plurality of light sources respectively;

[0255] A storage module, used to store the types of the multiple light sources, the identifier of the at least one first camera, and the relative color temperature deviations of the at least one first camera under the multiple light sources in a correspondence between the light source type, the camera identifier, and the relative color temperature deviation;

[0256] The second sending module is used to send the corresponding relationship to at least one first camera.

[0257] Optionally, the device further comprises:

[0258] A receiving module, configured to receive at least one second video, wherein the at least one second video is a video captured by at least one second camera, the video screens of the at least one second video have a consistent color temperature, the at least one second camera is located in the same physical environment, and the physical environment in which the at least one second camera is located is different from the physical environment in which the at least one first camera is located;

[0259] a color temperature compensation module, configured to perform reverse absolute color temperature compensation on the at least one second video based on an absolute color temperature deviation corresponding to the reference camera, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the absolute color temperature deviation is a color temperature deviation of a calibration chart of the reference camera relative to a standard color;

[0260] An output module is used to output the at least one second video after reverse absolute color temperature compensation.

[0261] Optionally, the device further comprises:

[0262] A third color temperature deviation determination module is used to determine the absolute color temperature deviation corresponding to the at least one first camera and the absolute color temperature deviation corresponding to the reference camera, where the absolute color temperature deviation is the color temperature deviation of the corresponding camera relative to a calibration chart of a standard color;

[0263] The third sending module is used to send the corresponding absolute color temperature deviations to the at least one first camera and the reference camera.

[0264] In an embodiment of the present application, the video processing device determines the relative color temperature deviations corresponding to the at least one first camera, and then sends the relative color temperature deviations corresponding to the at least one first camera, so that the first camera can quickly and accurately perform relative color temperature compensation on the first video collected by itself based on the relative color temperature deviation corresponding to itself. In addition, the video processing device can also determine the absolute color temperature deviations corresponding to the at least one first camera and the absolute color temperature deviations corresponding to the reference camera, and then send the absolute color temperature deviations to the at least one first camera and the reference camera, so that the at least one first camera and the reference camera can quickly and accurately perform absolute color temperature compensation on the video collected by itself based on the absolute color temperature deviation corresponding to itself. Moreover, the relative color temperature deviation of each camera under different types of light sources is determined, and stored in the corresponding relationship between the light source type, the camera identifier and the relative color temperature deviation. Through the relative color temperature deviations under different light source types, relative color temperature compensation is performed on each video, which can adapt to the conditions of different light sources in different physical environments, and the color temperature alignment of the video screen is more targeted.

[0265] It should be noted that: the color temperature alignment device for video images provided in the above embodiment only uses the division of the above functional modules as an example when aligning the color temperature of the video images. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the color temperature alignment device for video images provided in the above embodiment and the color temperature alignment method embodiment for video images belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0266] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access, or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a digital versatile disc (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)). It is worth noting that the computer-readable storage medium mentioned in the embodiment of the present application may be a non-volatile storage medium, in other words, a non-transient storage medium.

[0267] It should be understood that the "multiple" mentioned herein refers to two or more. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to facilitate the clear description of the technical solution of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like are used to distinguish between the same items or similar items with basically the same functions and effects. Those skilled in the art can understand that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not limit them to be necessarily different.

[0268] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in the embodiments of the present application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0269] The above-mentioned embodiments are provided for the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for aligning the color temperature of a video image, characterized in that: The method comprises: Acquire at least one first video and a reference video, wherein the at least one first video is a video captured by at least one first camera, the reference video is a video captured by a reference camera, and the at least one first camera and the reference camera are located in the same physical environment; Based on the relative color temperature deviations respectively corresponding to the at least one first camera, relative color temperature compensation is performed on the at least one first video, so that the color temperature of the video screen of the at least one first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the relative color temperature deviation is the actual color temperature deviation of the corresponding first camera relative to the reference camera; The at least one first video and the reference video after relative color temperature compensation are output.

2. The method according to claim 1, characterized in that Before performing relative color temperature compensation on the at least one first video based on the relative color temperature deviations respectively corresponding to the at least one first camera, the method further includes: Acquire at least one first image and a first reference image, wherein the at least one first image is an image captured by the at least one first camera, the first reference image is an image captured by the reference camera, and the at least one first image and the first reference image have the same image content; determining a color temperature of each of the at least one first image and a color temperature of the first reference image; Based on the color temperature of the at least one first image and the color temperature of the first reference image, the color temperature deviation of the at least one first image relative to the first reference image is determined, and the relative color temperature deviation corresponding to the at least one first camera is obtained.

3. The method according to claim 2, characterized in that Before determining the color temperature of each of the at least one first image and the color temperature of the first reference image, the method further includes: Based on the at least one first image and the first reference image, an affine transformation is performed on the at least one first image so that the distortion and visual direction of the at least one first image after the affine transformation are respectively consistent with the distortion and visual direction of the first reference image.

4. The method according to claim 1, characterized in that Before performing relative color temperature compensation on the at least one first video based on the relative color temperature deviations respectively corresponding to the at least one first camera, the method further includes: Based on the first light source type and the identifier of the at least one first camera, the relative color temperature deviation corresponding to the at least one first camera is obtained from the stored correspondence between the light source type, the camera identifier and the relative color temperature deviation, wherein the first light source type is a type of light source used in the physical environment where the at least one first camera is located.

5. The method according to claim 4, characterized in that Before acquiring the relative color temperature deviations respectively corresponding to the at least one first camera from the stored correspondences between the light source type, the camera identifier, and the relative color temperature deviation based on the first light source type and the identifier of the at least one first camera, the method further includes: Determining relative color temperature deviations of the at least one first camera under a plurality of light sources respectively; The types of the multiple light sources, the identifier of the at least one first camera, and the relative color temperature deviations of the at least one first camera under the multiple light sources are stored in the correspondence between the light source type, the camera identifier, and the relative color temperature deviation.

6. The method according to claim 5, characterized in that The determining the relative color temperature deviation of the at least one first camera under a plurality of light sources respectively includes: Acquire at least one second image and a second reference image, wherein the at least one second image is an image respectively captured by the at least one first camera under a target light source, the second reference image is an image captured by the reference camera under the target light source, the target light source is any one of the multiple light sources, and the at least one second image and the second reference image have the same image content; determining a color temperature of each of the at least one second image and a color temperature of the second reference image; Based on the color temperature of the at least one second image and the color temperature of the second reference image, the color temperature deviation of the at least one second image relative to the second reference image is determined, and the relative color temperature deviation corresponding to the at least one first camera under the target light source is obtained.

7. The method according to claim 1, characterized in that The method further comprises: Receiving at least one second video, wherein the at least one second video is a video captured by at least one second camera, the color temperature of the video screen of the at least one second video is consistent, the at least one second camera is located in the same physical environment, and the physical environment in which the at least one second camera is located is different from the physical environment in which the at least one first camera is located; Based on the absolute color temperature deviation corresponding to the reference camera, reverse absolute color temperature compensation is performed on the at least one second video, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the absolute color temperature deviation is the color temperature deviation of the reference camera relative to the calibration chart of the standard color; The at least one second video after inverse absolute color temperature compensation is output.

8. The method according to claim 1, characterized in that After obtaining at least one first video and a reference video, the method further includes: Based on the absolute color temperature deviations respectively corresponding to the at least one first camera, absolute color temperature compensation is performed on the at least one first video, so that the video picture of the at least one first video after the absolute color temperature compensation is consistent with the color temperature of a calibration chart of a standard color, and the absolute color temperature deviations respectively corresponding to the at least one first camera are actual color temperature deviations of the corresponding first camera relative to the calibration chart; Based on the absolute color temperature deviation corresponding to the reference camera, absolute color temperature compensation is performed on the reference video so that the color temperature of the video screen of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart, and the absolute color temperature deviation corresponding to the reference camera is the color temperature deviation of the reference camera relative to the calibration chart; The at least one first video after absolute color temperature compensation and the reference video after absolute color temperature compensation are sent.

9. The method according to claim 7 or 8, characterized in that The method further comprises: Acquire a reference image, where the reference image is an image obtained by photographing the calibration chart with a target camera, and the target camera is any one of the at least one first camera and the reference camera; determining a color temperature of the reference image; The deviation between the color temperature of the reference image and the color temperature of the calibration chart is determined to obtain an absolute color temperature deviation corresponding to the target camera.

10. A method for aligning the color temperature of a video image, characterized in that: The method comprises: Collect the first video; Based on the relative color temperature deviation, relative color temperature compensation is performed on the first video so that the color temperature of the video screen of the first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the relative color temperature deviation is an actual color temperature deviation of the first camera relative to the reference camera, the reference video is a video captured by the reference camera, and the first camera and the reference camera are located in the same physical environment; Output the first video after relative color temperature compensation.

11. The method according to claim 10, characterized in that Before performing relative color temperature compensation on the first video based on the relative color temperature deviation, the method further includes: Based on a first light source type and an identifier of the first camera, the relative color temperature deviation is obtained from a stored correspondence between the light source type, the camera identifier, and the relative color temperature deviation, where the first light source type is a type of light source used in a physical environment where the first camera is located.

12. The method according to claim 10, characterized in that The method further comprises: Based on the absolute color temperature deviation, absolute color temperature compensation is performed on the first video so that the video picture of the first video after absolute color temperature compensation is consistent with the color temperature of a calibration chart of a standard color, wherein the absolute color temperature deviation is an actual color temperature deviation of the first camera relative to the calibration chart; The first video after absolute color temperature compensation is sent.

13. A method for aligning the color temperature of a video image, characterized in that: The method comprises: Determine a relative color temperature deviation corresponding to at least one first camera, where the relative color temperature deviation is an actual color temperature deviation of the at least one first camera relative to a reference camera, and the at least one first camera and the reference camera are located in the same physical environment; Sending the respective corresponding relative color temperature deviations to the at least one first camera, so that each of the at least one first camera performs relative color temperature compensation on the respective captured first video based on the respective corresponding relative color temperature deviations, so as to ensure that the color temperature of the video screen of the first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the reference video is the video captured by the reference camera.

14. The method according to claim 13, characterized in that The method further comprises: Determining relative color temperature deviations of the at least one first camera under a plurality of light sources respectively; storing the types of the multiple light sources, the identifier of the at least one first camera, and the relative color temperature deviations of the at least one first camera under the multiple light sources respectively in the correspondence between the light source type, the camera identifier, and the relative color temperature deviation; The corresponding relationship is sent to the at least one first camera.

15. The method according to claim 13, characterized in that The method further comprises: Receiving at least one second video, wherein the at least one second video is a video captured by at least one second camera, the color temperature of the video screen of the at least one second video is consistent, the at least one second camera is located in the same physical environment, and the physical environment in which the at least one second camera is located is different from the physical environment in which the at least one first camera is located; Based on the absolute color temperature deviation corresponding to the reference camera, reverse absolute color temperature compensation is performed on the at least one second video, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the absolute color temperature deviation is the color temperature deviation of the reference camera relative to the calibration chart of the standard color; The at least one second video after inverse absolute color temperature compensation is output.

16. The method according to claim 13, characterized in that The method further comprises: Determine an absolute color temperature deviation corresponding to the at least one first camera and an absolute color temperature deviation corresponding to the reference camera, wherein the absolute color temperature deviation is a color temperature deviation of the corresponding camera relative to a calibration chart of a standard color; The respective corresponding absolute color temperature deviations are sent to the at least one first camera and the reference camera.

17. A device for aligning the color temperature of a video image, characterized in that: The device comprises: A video acquisition module, used to acquire at least one first video and a reference video, wherein the at least one first video is a video captured by at least one first camera, and the reference video is a video captured by a reference camera, and the at least one first camera and the reference camera are located in the same physical environment; A first color temperature compensation module, configured to perform relative color temperature compensation on the at least one first video based on the relative color temperature deviations respectively corresponding to the at least one first camera, so that the color temperature of the video screen of the at least one first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the relative color temperature deviation is an actual color temperature deviation of the corresponding first camera relative to the reference camera; The first output module is used to output the at least one first video and the reference video after relative color temperature compensation.

18. The device according to claim 17, characterized in that The device also includes: A first image acquisition module, used to acquire at least one first image and a first reference image, wherein the at least one first image is an image acquired by the at least one first camera, the first reference image is an image acquired by the reference camera, and the at least one first image and the first reference image have the same image content; a first color temperature determination module, configured to determine the color temperature of each first image in the at least one first image and the color temperature of the first reference image; A first color temperature deviation determination module is used to determine the color temperature deviation of the at least one first image relative to the first reference image based on the color temperature of the at least one first image and the color temperature of the first reference image, and obtain the relative color temperature deviation corresponding to the at least one first camera.

19. The device according to claim 18, characterized in that The device also includes: An affine transformation module is used to perform affine transformation on the at least one first image based on the at least one first image and the first reference image, so that the distortion and visual direction of the at least one first image after the affine transformation are respectively consistent with the distortion and visual direction of the first reference image.

20. The device according to claim 17, characterized in that The device also includes: A color temperature deviation acquisition module is used to acquire the relative color temperature deviation corresponding to the at least one first camera from the stored correspondence between the light source type, the camera identifier and the relative color temperature deviation based on the first light source type and the identifier of the at least one first camera, wherein the first light source type is the type of light source used in the physical environment where the at least one first camera is located.

21. The device according to claim 20, characterized in that The device also includes: A second color temperature deviation determination module, used to determine the relative color temperature deviation of the at least one first camera under a plurality of light sources respectively; The storage module is used to store the types of the multiple light sources, the identifier of the at least one first camera, and the relative color temperature deviation of the at least one first camera under the multiple light sources in the corresponding relationship between the light source type, the camera identifier and the relative color temperature deviation.

22. The device according to claim 21, characterized in that The second color temperature deviation determination module is specifically used for: Acquire at least one second image and a second reference image, wherein the at least one second image is an image respectively captured by the at least one first camera under a target light source, the second reference image is an image captured by the reference camera under the target light source, the target light source is any one of the multiple light sources, and the at least one second image and the second reference image have the same image content; determining a color temperature of each of the at least one second image and a color temperature of the second reference image; Based on the color temperature of the at least one second image and the color temperature of the second reference image, the color temperature deviation of the at least one second image relative to the second reference image is determined, and the relative color temperature deviation corresponding to the at least one first camera under the target light source is obtained.

23. The device according to claim 17, characterized in that The device also includes: A receiving module, configured to receive at least one second video, wherein the at least one second video is a video captured by at least one second camera, the video screens of the at least one second video have a consistent color temperature, the at least one second camera is located in the same physical environment, and the physical environment in which the at least one second camera is located is different from the physical environment in which the at least one first camera is located; A second color temperature compensation module, configured to perform reverse absolute color temperature compensation on the at least one second video based on the absolute color temperature deviation corresponding to the reference camera, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the absolute color temperature deviation is the color temperature deviation of the reference camera relative to a calibration chart of a standard color; The second output module is used to output the at least one second video after reverse absolute color temperature compensation.

24. The device according to claim 17, characterized in that The device also includes: A third color temperature compensation module is used to perform absolute color temperature compensation on the at least one first video based on the absolute color temperature deviations respectively corresponding to the at least one first camera, so that the video picture of the at least one first video after the absolute color temperature compensation is consistent with the color temperature of a calibration chart of a standard color, and the absolute color temperature deviations respectively corresponding to the at least one first camera are actual color temperature deviations of the corresponding first camera relative to the calibration chart; a fourth color temperature compensation module, configured to perform absolute color temperature compensation on the reference video based on the absolute color temperature deviation corresponding to the reference camera, so that the color temperature of the video screen of the reference video after absolute color temperature compensation is consistent with the color temperature of the calibration chart, wherein the absolute color temperature deviation corresponding to the reference camera is the color temperature deviation of the reference camera relative to the calibration chart; The sending module is used to send the at least one first video after absolute color temperature compensation and the reference video after absolute color temperature compensation.

25. The device according to claim 23 or 24, characterized in that The device also includes: A second image acquisition module, used to acquire a reference image, wherein the reference image is an image obtained by photographing the calibration chart with a target camera, wherein the target camera is any one of the at least one first camera and the reference camera; A second color temperature determination module, used to determine the color temperature of the reference image; The third color temperature deviation determination module is used to determine the deviation between the color temperature of the reference image and the color temperature of the calibration chart to obtain the absolute color temperature deviation corresponding to the target camera.

26. A device for aligning the color temperature of a video image, characterized in that: The device comprises: A collection module, used for collecting a first video; A first color temperature compensation module, configured to perform relative color temperature compensation on the first video based on a relative color temperature deviation, so that the color temperature of a video screen of the first video after relative color temperature compensation is consistent with the color temperature of a video screen of a reference video, wherein the relative color temperature deviation is an actual color temperature deviation of the first camera relative to a reference camera, the reference video is a video captured by the reference camera, and the first camera and the reference camera are located in the same physical environment; An output module is used to output the first video after relative color temperature compensation.

27. The device according to claim 26, characterized in that The device also includes: A color temperature deviation acquisition module is used to acquire the relative color temperature deviation from the stored correspondence between the light source type, the camera identifier and the relative color temperature deviation based on the first light source type and the identifier of the first camera, wherein the first light source type is the type of light source used in the physical environment where the first camera is located.

28. The device according to claim 26, characterized in that The device also includes: A second color temperature compensation module is used to perform absolute color temperature compensation on the first video based on an absolute color temperature deviation, so that the video picture of the first video after absolute color temperature compensation is consistent with the color temperature of a calibration chart of a standard color, wherein the absolute color temperature deviation is an actual color temperature deviation of the first camera relative to the calibration chart; A sending module is used to send the first video after absolute color temperature compensation.

29. A device for aligning the color temperature of a video image, characterized in that: The device comprises: A first color temperature deviation determination module is used to determine a relative color temperature deviation corresponding to at least one first camera, where the relative color temperature deviation is an actual color temperature deviation of the at least one first camera relative to a reference camera, and the at least one first camera and the reference camera are located in the same physical environment; The first sending module is used to send the corresponding relative color temperature deviations to the at least one first camera, so that each of the at least one first camera performs relative color temperature compensation on the first video captured by the respective camera based on the corresponding relative color temperature deviation, so as to ensure that the color temperature of the video screen of the first video after the relative color temperature compensation is consistent with the color temperature of the video screen of the reference video, and the reference video is the video captured by the reference camera.

30. The device according to claim 29, characterized in that The device also includes: A second color temperature deviation determination module, used to determine the relative color temperature deviation of the at least one first camera under a plurality of light sources respectively; A storage module, configured to store the types of the plurality of light sources, the identifier of the at least one first camera, and the relative color temperature deviations of the at least one first camera under the plurality of light sources respectively in a correspondence between the light source type, the camera identifier, and the relative color temperature deviation; The second sending module is configured to send the corresponding relationship to the at least one first camera.

31. The device according to claim 29, characterized in that The device also includes: A receiving module, configured to receive at least one second video, wherein the at least one second video is a video captured by at least one second camera, the video screens of the at least one second video have a consistent color temperature, the at least one second camera is located in the same physical environment, and the physical environment in which the at least one second camera is located is different from the physical environment in which the at least one first camera is located; a color temperature compensation module, configured to perform reverse absolute color temperature compensation on the at least one second video based on the absolute color temperature deviation corresponding to the reference camera, so that the color temperature of the video screen of the at least one second video after reverse absolute color temperature compensation is consistent with the color temperature of the video screen of the reference video, wherein the absolute color temperature deviation is the color temperature deviation of the reference camera relative to a calibration chart of a standard color; An output module is used to output the at least one second video after inverse absolute color temperature compensation.

32. The device according to claim 29, characterized in that The device also includes: A third color temperature deviation determination module is used to determine the absolute color temperature deviation corresponding to the at least one first camera and the absolute color temperature deviation corresponding to the reference camera, wherein the absolute color temperature deviation is the color temperature deviation of the corresponding camera relative to a calibration chart of a standard color; The third sending module is used to send the corresponding absolute color temperature deviations to the at least one first camera and the reference camera.

33. A color temperature alignment device, characterized in that: The color temperature alignment device includes a memory and a processor; The memory is used to store a computer program, wherein the computer program includes program instructions; The processor is used to call the computer program to implement the color temperature alignment method of the video picture as described in any one of claims 1 to 9.

34. A camera, characterized in that: The camera includes a memory and a processor; The memory is used to store a computer program, wherein the computer program includes program instructions; The processor is used to call the computer program to implement the color temperature alignment method of the video picture as described in any one of claims 10 to 12.

35. A video processing device, characterized in that: The video processing device includes a memory and a processor; The memory is used to store a computer program, wherein the computer program includes program instructions; The processor is used to call the computer program to implement the color temperature alignment method of the video picture as described in any one of claims 13 to 16.

36. A computer-readable storage medium, characterized in that: The storage medium stores instructions, and when the instructions are executed on the computer, the computer executes the steps of the method according to any one of claims 1 to 16.

Images