Color cast correction method and device for video conference equipment, equipment and storage medium

Abstract

The invention provides a color cast correction method and device for video conference equipment, equipment and a storage medium, and relates to the technical field of image processing, and the method comprises the steps: obtaining a lamp bead working current corresponding to the video conference equipment and the pixel size of at least one image; determining a target distance between the target user and the video conference equipment based on each pixel size; based on the lamp bead working current, the target distance and the color cast value under the target distance, the color deviation degree corresponding to the color cast value under the target distance is determined; the color cast value is an RGB value corresponding to a camera module on the video conference equipment; based on the color deviation degree and the color cast value, a target correction RGB value corresponding to the camera module is determined, and the target correction RGB value is used for conducting color compensation when the camera module counts the automatic white balance information. According to the invention, adaptive compensation of the RGB value of the camera module can be realized, and the overall image effect of the video conference equipment is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of image processing, and particularly to a method, device, equipment and storage medium for correcting color cast of a video conferencing device. Background Art

[0002] As one of the main functions of video conferencing devices, video conferencing is increasingly used. In actual use, when the participants are relatively close to the video conferencing device, the color of the face images presented on the video conferencing device is color-cast, while when the participants are relatively far from the video conferencing device, the color of the face images on the video conferencing device returns to normal.

[0003] In the prior art, generally, the user subjectively judges the image effect and directly modifies the RGB channel values of the video conferencing device for adjustment. However, directly modifying the RGB channel values of the video conferencing device cannot ensure the image effect of each face image at close range, and at the same time causes color cast in the face images at medium and long distances, resulting in a poor overall image effect of the video conferencing device. Summary of the Invention

[0004] The present invention provides a method, device, equipment and storage medium for correcting color cast of a video conferencing device, so as to solve the defect of color cast when the distance from the video conferencing device is relatively close in the prior art, realize the adaptive compensation of the RGB values of the camera module, and improve the overall image effect of the video conferencing device.

[0005] The present invention provides a method for correcting color cast of a video conferencing device, including:

[0006] Obtaining the working current of the lamp beads corresponding to the video conferencing device and the pixel sizes of at least one image;

[0007] Based on each of the pixel sizes, determining the target distance between the target user and the video conferencing device;

[0008] Based on the lamp bead working current, the target distance and the color cast value at the target distance, determining the color deviation degree corresponding to the color cast value at the target distance; the color cast value is the RGB value corresponding to the camera module on the video conferencing device;

[0009] Based on the color deviation degree and the color cast value, determining the target corrected RGB value corresponding to the camera module, and the target corrected RGB value is used for color compensation when the camera module statistically calculates the automatic white balance information.

[0010] According to the method for correcting color cast of a video conferencing device provided by the present invention, the determining of the color deviation degree based on the lamp bead working current, the target distance and the color cast value at the target distance includes:

[0011] Determine the first RGB value of the video conferencing device at the working current of the lamp beads;

[0012] Based on the first RGB value and the target distance, determine the target color influence value of the video conferencing device on the target user;

[0013] Based on the target color influence value, the target distance, and the color deviation value, determine the degree of color deviation corresponding to the color deviation value at the target distance.

[0014] According to the color deviation correction method of the video conferencing device provided by the present invention, the determining the target color influence value of the video conferencing device on the target user based on the first RGB value and the target distance includes:

[0015] Determine the target area of the target image corresponding to the target user in the video conferencing device;

[0016] Based on the first RGB value, the first weight corresponding to the target area, and the second weight corresponding to other areas except the target area in the video conferencing device, determine the first color influence value of the video conferencing device on the target user in the horizontal direction; the horizontal direction is the direction parallel to the display screen of the video conferencing device;

[0017] Based on the preset attenuation ratio, the target distance, and the first color influence value, determine the target color influence value of the video conferencing device on the target user.

[0018] According to the color deviation correction method of the video conferencing device provided by the present invention, the determining the degree of color deviation corresponding to the color deviation value at the target distance based on the target color influence value, the target distance, and the color deviation value includes:

[0019] Obtain a preset distance threshold and a preset color threshold corresponding to the camera module at the preset distance threshold;

[0020] When the target distance is less than the preset distance threshold, based on the preset distance threshold, the preset color threshold, the color deviation value, the target distance, and the target color influence value, determine the degree of color deviation corresponding to the color deviation value at the target distance;

[0021] When the target distance is greater than or equal to the preset distance threshold, determine that the degree of color deviation corresponding to the color deviation value at the target distance is 1.

[0022] According to the color deviation correction method of the video conferencing device provided by the present invention, the determining the target correction RGB value corresponding to the camera module based on the degree of color deviation and the color deviation value includes:

[0023] Obtain the color standard deviation corresponding to the camera module;

[0024] When the target distance is less than the preset distance threshold, determine the target corrected RGB value corresponding to the camera module based on the color cast value, the color deviation degree, and the color standard deviation;

[0025] When the target distance is greater than or equal to the preset distance threshold, determine the color cast value as the target corrected RGB value corresponding to the camera module.

[0026] According to the color cast correction method of the video conferencing device provided by the present invention, the determining the target distance between the target user and the video conferencing device based on each of the pixel sizes includes:

[0027] Obtain the sensor pixel size, lens focal length, and the center coordinates of each of the images in the video conferencing device corresponding to the camera module;

[0028] For each of the pixel sizes, determine the first distance between the user corresponding to the pixel size and the camera module based on the sensor pixel size, the lens focal length, and the pixel size;

[0029] Based on the second distance from the camera module to the video conferencing device and the center coordinates, determine the third distance between the image and the camera module;

[0030] Based on the first distance and the third distance, determine the fourth distance between the user and the video conferencing device;

[0031] Based on each of the fourth distances, determine the target distance between the target user and the video conferencing device.

[0032] According to the color cast correction method of the video conferencing device provided by the present invention, the determining the target distance between the target user and the video conferencing device based on each of the fourth distances includes:

[0033] When the number of the fourth distances is greater than 1, determine the user corresponding to the minimum fourth distance as the target user, and determine the minimum fourth distance as the target distance from the target user to the video conferencing device;

[0034] When the number of the fourth distances is equal to 1, determine the user corresponding to the fourth distance as the target user, and determine the fourth distance as the target distance from the target user to the video conferencing device.

[0035] The present invention also provides a color cast correction device for a video conferencing device, including:

[0036] An acquisition module, configured to acquire the working current of the light beads corresponding to the video conferencing device and the pixel sizes of at least one image;

[0037] A first determination module, configured to determine a target distance between a target user and the video conferencing device based on each of the pixel sizes;

[0038] A second determination module, configured to determine a color deviation degree corresponding to the color cast value at the target distance based on the light bead working current, the target distance, and the color cast value at the target distance; the color cast value is the RGB value corresponding to the camera module on the video conferencing device;

[0039] A color cast correction module, configured to determine a target corrected RGB value corresponding to the camera module based on the color deviation degree and the color cast value, where the target corrected RGB value is used for color compensation when the camera module statistics the automatic white balance information.

[0040] The present invention further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the color cast correction method of the video conferencing device as described in any one of the above is implemented.

[0041] The present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the color cast correction method of the video conferencing device as described in any one of the above is implemented.

[0042] The color cast correction method, device, device, and storage medium of the video conferencing device provided by the present invention, after acquiring the working current of the light beads corresponding to the video conferencing device and the pixel sizes of at least one image, determine the target distance between the target user and the video conferencing device according to each pixel size, and combine the light bead working current, the target distance, and the color cast value at the target distance to determine the color offset degree at the target distance. When the camera module statistics the automatic white balance information, determine the target corrected RGB value according to the color offset degree and the color cast value, comprehensively consider the interference of the target distance and the backlight color of the video conferencing device caused by the light bead working current, and perform adaptive compensation on the RGB value of the camera module, thereby improving the overall image effect of the video conferencing device. Description of the Drawings

[0043] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0044] Figure 1 It is a schematic flowchart of the color cast correction method for a video conferencing device provided by an embodiment of the present invention;

[0045] Figure 2 It is a schematic diagram for determining the target distance provided by an embodiment of the present invention;

[0046] Figure 3 It is an example schematic diagram of the device coordinate system provided by an embodiment of the present invention;

[0047] Figure 4 It is a schematic structural diagram of the color cast correction device for a video conferencing device provided by an embodiment of the present invention;

[0048] Figure 5 It is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. Detailed implementation manners

[0049] To make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below with reference to the accompanying drawings in the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present invention without creative efforts shall fall within the protection scope of the present invention.

[0050] Aiming at the problem of color cast when the distance from the video conferencing device is relatively close in the prior art, the present invention provides a color cast correction method for a video conferencing device, Figure 1 It is a schematic flowchart of the color cast correction method for a video conferencing device provided by an embodiment of the present invention, as Figure 1 shown, the method includes:

[0051] Step 110, obtain the working current of the lamp beads corresponding to the video conferencing device and the pixel sizes of at least one image.

[0052] Specifically, in the application scenario, when the user is relatively close to the video conferencing device, the color of the image presented on the video conferencing device is color-biased. When the user is relatively far from the video conferencing device, the color of the image on the video conferencing device returns to normal. Therefore, by obtaining the pixel size of the image corresponding to the user and further determining the distance between the user and the video conferencing device, based on this distance, it is determined whether the image corresponding to the user on the video conferencing device has a color bias phenomenon. In addition, the backlight color of the video conferencing device is controlled and adjusted by the bead operating current of the LED beads in the device screen. Different bead operating currents correspond to different backlight colors. When the user is relatively close to the video conferencing device, the AWB (Auto White Balance) information counted by the camera module will be interfered by the backlight color of the video conferencing device, resulting in incorrect color temperature calculation, and thus the color of the image presented on the video conferencing device is color-biased. After the user is far away from the video conferencing device for a certain distance, the influence of the backlight color on the color temperature calculation in the camera module is reduced, making the color of the image presented on the video conferencing device return to normal. Therefore, in the embodiments of the present invention, it is also necessary to obtain the bead operating current in the video conferencing device and combine the judgment of the distance and the interference of the backlight color caused by the bead operating current to solve the color bias problem when the user is relatively close to the video conferencing device.

[0053] It should be noted that the camera module generates corresponding scene image data by shooting each user through the camera. After performing face detection and recognition and other processing on the scene image data, the face pixel positions of each face image are determined, and the processed scene image data is sent to the video conferencing device for display. The above image is the face image corresponding to each user in the processed scene image data. In addition, the above pixel size can be understood as the face pixel position of the face image corresponding to each user in the scene image data in the camera module. This face pixel position includes the horizontal direction pixels and the vertical direction pixels of the face image in the scene image data. According to the proportional relationship between this pixel size and the sensor size in the camera module, the distance from the user to the camera module can be determined, and then based on the distance from the user to the camera module, the distance from the user to the video conferencing device can be determined. The sensor size in this camera module is the same as the pixel size of the above scene image data.

[0054] Optionally, the video conferencing device can be a display that is communicatively connected to the camera module and can display the scene image data sent by the camera module. For example, the video conferencing device can be a conference large screen with a screen size of 55 inches or larger than 55 inches.

[0055] Step 120: Based on each of the pixel sizes, determine the target distance between the target user and the video conferencing device.

[0056] Specifically, for the pixel sizes of the images corresponding to each user, based on the pixel sizes, the distances of each user from the video conferencing device can be determined. Different distances result in different degrees of color cast for the images corresponding to each user. Therefore, the distance with the highest degree of color cast is determined from all the distances as the target distance, and the user corresponding to the target distance is taken as the target user. That is, in the video conferencing device, the target image corresponding to the target user has the highest degree of color cast.

[0057] Further, determining the target distance between the target user and the video conferencing device based on the pixel sizes includes:

[0058] Obtain the sensor pixel size, lens focal length corresponding to the camera module, and the central coordinates of each of the images in the video conferencing device;

[0059] For each of the pixel sizes, based on the sensor pixel size, the lens focal length, and the pixel size, determine the first distance from the user corresponding to the pixel size to the camera module;

[0060] Based on the second distance from the camera module to the video conferencing device and the central coordinates, determine the third distance from the image to the camera module;

[0061] Based on the first distance and the third distance, determine the fourth distance between the user and the video conferencing device;

[0062] Based on each of the fourth distances, determine the target distance between the target user and the video conferencing device.

[0063] Specifically, before determining the target distance, it is necessary to construct a device coordinate system corresponding to the video conferencing device, and then determine the central coordinates of each image in the device coordinate system. For example, Figure 2 is an example schematic diagram of the device coordinate system provided by an embodiment of the present invention. As Figure 2 shown, the side length of the video conferencing device is 2c. Taking the midpoint of the upper edge of the video conferencing device as the origin, and constructing the x-axis of the device coordinate system along the horizontal direction where the upper edge is located, and constructing the y-axis of the device coordinate system vertically from the origin perpendicular to the x-axis. The central coordinates (x i , y i ) represent the coordinates of the midpoint of image i in the device coordinate system, where i represents the i-th image in the video conferencing device, and i is an integer greater than or equal to 1. In addition, the origin of the device coordinate system can also be at the center, corners, or any position of the video conferencing device. The embodiment of the present invention does not limit the construction method of the device coordinate system.

[0064] After obtaining the sensor pixel size, lens focal length of the camera module, and the center coordinates of each image in the video conferencing device, for the i-th image, using Equation (1), based on the sensor pixel size, lens focal length in the camera module, and the pixel size of the i-th image, the first distance from user i to the video conferencing device corresponding to this pixel size can be calculated. Equation (1) is:

[0065]

[0066] where OL represents the first distance from user i to the center point of the camera module, FL represents the lens focal length, M represents the number of pixels in the horizontal direction of the sensor pixel size in the camera module, N represents the number of pixels in the vertical direction of the sensor pixel size in the camera module, the sensor pixel size is represented as M*N, FOV l represents the horizontal pixels in the pixel size corresponding to the i-th image, FOV w represents the vertical pixels in the pixel size corresponding to the i-th image, l represents the horizontal direction, and w represents the vertical direction.

[0067] Figure 3 is a schematic diagram for determining the target distance provided by an embodiment of the present invention. As Figure 3 shown, the camera module is disposed above the video conferencing device and coaxially with the video conferencing device. After determining the first distance, the height difference in the y-axis direction between the center point of the camera module and the center coordinates of image i can be determined based on the sum of the second distance from the center point of the camera module to the midpoint of the upper edge of the video conferencing device and the y-axis coordinate of the center coordinates. After determining the center point coordinates and this height difference, according to the Pythagorean theorem, using Equation (2), the third distance between the center coordinates of image i and the center point of the camera module can be calculated. Equation (2) is:

[0068]

[0069] where S(x i ,y i ) represents the third distance between the center coordinates of image i and the center point of the camera module, h represents the second distance from the center point of the camera module to the midpoint of the upper edge of the video conferencing device, and y i +h represents the height difference in the y-axis direction between the center point of the camera module and the center coordinates of image i.

[0070] After determining the first distance and the third distance, according to the Pythagorean theorem, using Equation (3), the fourth distance from user i to the video conferencing device, that is, the fourth distance from user i to the center coordinates of image i, can be calculated. Equation (3) is:

[0071]

[0072] Among them, L(x i , y i ) represents the fourth distance between user i and the video conferencing device.

[0073] After determining the fourth distance between each user and the video conferencing device, the target distance can be determined from all the fourth distances.

[0074] Furthermore, determining the target distance between the target user and the video conferencing device based on each of the fourth distances includes:

[0075] When the number of the fourth distances is greater than 1, the user corresponding to the minimum fourth distance is determined as the target user, and the minimum fourth distance is determined as the target distance from the target user to the video conferencing device;

[0076] When the number of the fourth distances is equal to 1, the user corresponding to the fourth distance is determined as the target user, and the fourth distance is determined as the target distance from the target user to the video conferencing device.

[0077] Specifically, if there is only one user within the shooting range of the camera module, then this user is determined as the target user, and the fourth distance between this user and the video conferencing device is determined as the target distance from this target user to the video conferencing device. If there are multiple users within the shooting range of the camera module, the fourth distances between each user and the video conferencing device can be calculated as above. Since the closer the user is to the video conferencing device, the higher the color cast degree of the corresponding image of this user. Therefore, from multiple fourth distances, the user corresponding to the minimum fourth distance is determined as the target user, and this minimum fourth distance is determined as the target distance from the target user to the video conferencing device. At this time, since this target distance is the smallest, the proportion of the target image corresponding to the target user in the complete display image of the video conferencing device is the largest, and the color cast degree of this target image is the highest. After correcting the complete display image of the video conferencing device based on the color cast degree of this target image, there is a slight over - correction for the color cast degrees of the images corresponding to other users. However, since the proportion of the images corresponding to other users in the complete display image is small, the impact on the overall image effect of the video conferencing device is small and can be ignored. That is, after correcting the color cast of the target image, the overall image effect of the video conferencing device can be improved.

[0078] Step 130: Determine the color deviation degree corresponding to the color cast value at the target distance based on the working current of the lamp bead, the target distance, and the color cast value at the target distance; the color cast value is the RGB value corresponding to the camera module on the video conferencing device.

[0079] Specifically, after determining the target distance and the color cast value at the target distance, the interference of the backlight color caused by the target distance and the working current of the lamp beads can be combined to determine the degree of color deviation corresponding to the color cast value, so as to correct the color cast value according to the degree of color deviation and improve the overall image effect of the video conferencing device.

[0080] Further, determining the degree of color deviation based on the working current of the lamp beads, the target distance, and the color cast value at the target distance includes:

[0081] Determine the first RGB value of the video conferencing device at the working current of the lamp beads;

[0082] Based on the first RGB value and the target distance, determine the target color influence value of the video conferencing device on the target user;

[0083] Based on the target color influence value, the target distance, and the color cast value, determine the degree of color deviation corresponding to the color cast value at the target distance.

[0084] Specifically, by adjusting the working current of different lamp beads in the video conferencing device, the RGB (Red, Green, Blue) values of the image in the video conferencing device change. Among them, the change in the working current of the lamp beads mainly affects the component value of the B channel in the RGB value. The increase in the component value of the B channel will cause the color coordinate to decrease, resulting in an increase in color temperature, and the finally formed RGB value tends to be blue. The corresponding relationship between the working current of the lamp beads and the color coordinate is: Among them, G in (I a ) represents the implicit function when the working current of the lamp bead is I a , represents the implicit function when the color coordinate is , and K represents the influence coefficient of the working current of the lamp bead on the color coordinate. After determining the corresponding relationship between the working current of the lamp bead and the color coordinate, according to the conversion relationship between the color coordinate and the component values of each channel in the RGB value shown in Equation (4), the first RGB value of the video conferencing device at the working current of the lamp bead can be determined. Equation (4) is:

[0085]

[0086] Among them, R 1 represents the component value of the R channel in the first RGB value, G 1 represents the component value of the G channel in the first RGB value, B 1 represents the component value of the B channel in the first RGB value, and the first RGB value can be expressed as T 1 (R 1 , G 1 , B1 )。

[0087] After determining the first RGB value, based on the target distance and the first RGB value, determine the influence value of the backlight color of the video conferencing device at the target distance on the target color when the camera module determines the RGB value. Then, based on the target color influence value, the target distance, and the color cast value, calculate the color deviation degree corresponding to the color cast value at the target distance, so as to correct the color cast value according to the color deviation degree.

[0088] Further, determining the influence value of the video conferencing device on the target user's target color based on the first RGB value and the target distance includes:

[0089] Determine the target area of the target image corresponding to the target user in the video conferencing device;

[0090] Based on the first RGB value, the first weight corresponding to the target area, and the second weight corresponding to other areas except the target area in the video conferencing device, determine the first color influence value of the video conferencing device on the target user in the horizontal direction; the horizontal direction is the direction parallel to the display screen of the video conferencing device;

[0091] Based on the preset attenuation ratio, the target distance, and the first color influence value, determine the influence value of the video conferencing device on the target user's target color.

[0092] Specifically, before determining the target color influence value, it is possible to divide the display area of the video conferencing device along Figure 2 or Figure 3 the x-axis direction shown, and then determine the weights of the influence of each divided area block on the target image. The sum of the weights of the influence of each area block on the target image is 1. For example, taking the number of area blocks obtained after dividing the display area of the video conferencing device as N, where N is an integer greater than or equal to 2, according to the x-axis coordinate in the center coordinates corresponding to the target image, the target area where the target image is located can be determined, and then the first weight of the influence of this target area on the target image is determined as q, and this first weight q is a preset value. When determining the second weight corresponding to other areas except the target area, the closer the distance between this other area and the target area, the greater the value of the second weight corresponding to this other area, that is, the values of the second weights on both sides of the target area decrease in turn.

[0093] After that, according to the x-axis coordinate in the center coordinates corresponding to the target image, determine the target area where the target image is located, and determine the first weight of the influence of the target area on the target image and the second weight of the influence of other areas except the target area on the target image. Using Equation (4), according to the weighted sum of each area block and the first RGB value, it is possible to, in the horizontal direction, that is, inFigure 2 or Figure 3 The first color influence value of the video conferencing device on the target user is determined according to the x-axis direction shown, and Equation (5) is as follows:

[0094]

[0095] Wherein, W(x i ) represents the first color influence value of the video conferencing device on the target user, [-c, c] represents the value range of the x-axis coordinates of the target image, that is, the range of the x-axis in the above device coordinate system, and U(x i ) represents the first weight or the second weight. When traversing each region block, if the current region block is the target region corresponding to the target image, U(x i ) represents the first weight. If the current region block is other regions except the target region, U(x i ( represents the second weight, and x d represents the current x-axis coordinate being traversed.

[0096] After determining the first color influence value, using Equation (6), according to the preset attenuation ratio, the target distance, and the first color influence value, on Figure 2 or Figure 3 the z-axis direction perpendicular to the video conferencing device shown, determine the working current I of the lamp beads a on the backlight color of the video conferencing device, and further determine the target color influence value of the backlight color of the video conferencing device on the target user, that is, on the plane formed by the z-axis direction and the x-axis direction where the target distance is located, determine the target color influence value of the video conferencing device on the RGB value calculated by the camera module. Equation (6) is as follows:

[0097]

[0098] Wherein, T 2 (R 2 , G 2 , B 2 ) represents the target color influence value of the video conferencing device on the target user, t represents the preset attenuation ratio of the first RGB value of the video conferencing device at the working current I of the lamp beads and the target distance L(x a , y i , y i ) on the RGB value calculated by the camera module.

[0099] Further, determining the color deviation degree corresponding to the color cast value at the target distance based on the target color influence value, the target distance, and the color cast value includes:

[0100] Obtain a preset distance threshold and a preset color threshold corresponding to the camera module at the preset distance threshold;

[0101] When the target distance is less than the preset distance threshold, based on the preset distance threshold, the preset color threshold, the color cast value, the target distance, and the target color influence value, determine the degree of color deviation corresponding to the color cast value at the target distance;

[0102] When the target distance is greater than or equal to the preset distance threshold, determine that the degree of color deviation corresponding to the color cast value at the target distance is 1.

[0103] Specifically, after determining the target color influence value, the preset distance threshold and the preset color threshold at the preset distance threshold can be obtained. The preset distance threshold is the distance at which the image corresponding to the user in the video conferencing device has no obvious color cast after multiple tests. That is, when the distance between the user and the video conferencing device is greater than or equal to the preset distance threshold, the image corresponding to the user has no obvious color cast, and when the distance between the user and the video conferencing device is less than the preset distance threshold, the image corresponding to the user has an obvious color cast. At the same time, read the preset color threshold corresponding to the camera module at this preset distance threshold. At this time, there is a corresponding relationship as shown in Equation (7) among the preset distance threshold, the preset color threshold corresponding to the preset distance threshold, the target distance, the color cast value corresponding to the target distance, and the target color influence value. Equation (7) is:

[0104]

[0105] where L 0 represents the preset distance threshold, T 0 (R 0 , G 0 , B 0 ) represents the preset color threshold at the preset distance threshold, P T' (L(x i , y i ), I a ) represents the degree of color deviation corresponding to the color cast value at the target distance, and T'(R', G', B') represents the color cast value.

[0106] According to Equation (7), Equation (8) can be obtained by conversion. That is, when the target distance is greater than or equal to the preset distance threshold, since the image corresponding to the user has no obvious color cast, the degree of color deviation can be determined to be 1. When the target distance is less than the preset distance threshold, since the image corresponding to the user has an obvious color cast, the degree of color deviation can be determined based on the preset distance threshold, the preset color threshold corresponding to the preset distance threshold, the target distance, the color cast value corresponding to the target distance, and the target color influence value. Equation (8) is:

[0107]

[0108] Step 140: Determine the target corrected RGB values corresponding to the camera module based on the color deviation degree and the color cast value, where the target corrected RGB values are used for color compensation when the camera module calculates the auto white balance information.

[0109] Specifically, after determining the color deviation degree at the target distance, the color cast value can be corrected according to the color deviation degree to obtain the corrected target corrected RGB values for color compensation when the camera module calculates the AWB information, so that the target image returns to normal, thereby improving the overall image effect of the video conferencing device.

[0110] Further, the determining the target corrected RGB values corresponding to the camera module based on the color deviation degree and the color cast value includes:

[0111] Obtain the color standard deviation corresponding to the camera module;

[0112] When the target distance is less than the preset distance threshold, determine the target corrected RGB values corresponding to the camera module based on the color cast value, the color deviation degree, and the color standard deviation;

[0113] When the target distance is greater than or equal to the preset distance threshold, determine the color cast value as the target corrected RGB values corresponding to the camera module.

[0114] Specifically, after determining the color deviation degree and obtaining the color standard deviation corresponding to the camera module, using Equation (9), when the target distance is greater than or equal to the preset distance threshold, since the image corresponding to the user has no obvious color cast, the color cast value can be determined as the target corrected RGB values without color compensation. When the target distance is less than the preset distance threshold, since the image corresponding to the user has an obvious color cast, the color cast value can be corrected according to the color deviation degree and the color standard deviation to obtain the corrected target corrected RGB values. When the camera module calculates the AWB information, the corresponding color values can be set as the target corrected RGB values to achieve color compensation. Equation (9) is:

[0115]

[0116] where, T 3 (R 3 ,G 3 ,B 3 ) represents the corrected target corrected RGB values, e represents the color standard deviation corresponding to the RGB values calculated by the camera module m times, and where, T1 j (R j ,G j ,B j) represents the color value calculated by the camera module for the j-th time, represents the color mean value corresponding to the RGB values calculated by the m camera modules, and

[0117] It should be noted that in addition to compensating the RGB values when the camera module statistics AWB information, color compensation can also be performed on the HSV mode of the camera module through the conversion relationship between the RGB values and the HSV mode to correct the color deviation value. In addition, after determining the color deviation degree corresponding to the color deviation value at the target distance, the working current of the lamp bead can also be adjusted based on the color deviation degree to adjust the first RGB value under the working current of the lamp bead, and according to the first RGB value, adjust the backlight color of the video conferencing device under the working current of the lamp bead to affect the camera module statistics AWB information, thereby realizing color compensation for the target image. The embodiments of the present invention do not limit this.

[0118] The color deviation correction method for the video conferencing device provided by the embodiments of the present invention, after obtaining the working current of the lamp bead corresponding to the video conferencing device and the pixel size of at least one image, determines the target distance between the target user and the video conferencing device according to each pixel size, and combines the working current of the lamp bead, the target distance, and the color deviation value at the target distance to determine the color offset degree at the target distance, and when the camera module statistics the automatic white balance information, determines the target correction RGB value according to the color offset degree and the color deviation value, comprehensively considering the interference of the backlight color of the video conferencing device caused by the target distance and the working current of the lamp bead, and performs adaptive compensation on the RGB values of the camera module, thereby improving the overall image effect of the video conferencing device.

[0119] The following describes the color deviation correction device for the video conferencing device provided by the present invention. The color deviation correction device for the video conferencing device described below can be mutually referred to the color deviation correction method for the video conferencing device described above.

[0120] The embodiments of the present invention also provide a color deviation correction device for a video conferencing device, Figure 4 is a schematic structural diagram of the color deviation correction device for the video conferencing device provided by the embodiments of the present invention, as Figure 4 shown, the color deviation correction device 400 for the video conferencing device includes: an acquisition module 410, a first determination module 420, a second determination module 430, and a color deviation correction module 440, where:

[0121] The acquisition module 410 is configured to acquire the working current of the lamp bead corresponding to the video conferencing device and the pixel size of at least one image;

[0122] The first determination module 420 is configured to determine the target distance between the target user and the video conferencing device based on each of the pixel sizes;

[0123] A second determination module 430, configured to determine a color deviation degree corresponding to the color cast value at the target distance based on the bead operating current, the target distance, and the color cast value at the target distance; the color cast value is the RGB value corresponding to the camera module on the video conferencing device;

[0124] A color cast correction module 440, configured to determine a target corrected RGB value corresponding to the camera module based on the color deviation degree and the color cast value, where the target corrected RGB value is used for color compensation when the camera module statistics automatic white balance information.

[0125] The color cast correction device of the video conferencing device provided by the embodiment of the present invention, after obtaining the bead operating current corresponding to the video conferencing device and the pixel size of at least one image, determines the target distance between the target user and the video conferencing device according to each pixel size, and combines the bead operating current, the target distance, and the color cast value at the target distance to determine the color offset degree at the target distance, and when the camera module statistics automatic white balance information, determines the target corrected RGB value according to the color offset degree and the color cast value, comprehensively considers the interference of the backlight color of the video conferencing device caused by the target distance and the bead operating current, adaptively compensates the RGB value of the camera module, and further improves the overall image effect of the video conferencing device.

[0126] Optionally, the first determination module 420 is specifically configured to:

[0127] Obtain the sensor pixel size, the lens focal length corresponding to the camera module, and the center coordinates of each of the images in the video conferencing device;

[0128] For each of the pixel sizes, determine a first distance between the user corresponding to the pixel size and the camera module based on the sensor pixel size, the lens focal length, and the pixel size;

[0129] Based on the second distance from the camera module to the video conferencing device and the center coordinates, determine a third distance between the image and the camera module;

[0130] Based on the first distance and the third distance, determine a fourth distance between the user and the video conferencing device;

[0131] Based on each of the fourth distances, determine the target distance between the target user and the video conferencing device.

[0132] Optionally, the first determination module 420 is specifically configured to:

[0133] When the number of the fourth distances is greater than 1, determine the user corresponding to the minimum fourth distance as the target user, and determine the minimum fourth distance as the target distance from the target user to the video conferencing device;

[0134] When the number of the fourth distances is equal to 1, determine the user corresponding to the fourth distance as the target user, and determine the fourth distance as the target distance from the target user to the video conferencing device.

[0135] Optionally, the second determination module 430 is specifically configured to:

[0136] Determine a first RGB value of the video conferencing device at the working current of the lamp beads;

[0137] Based on the first RGB value and the target distance, determine a target color influence value of the video conferencing device on the target user;

[0138] Based on the target color influence value, the target distance, and the color cast value, determine the degree of color deviation corresponding to the color cast value at the target distance.

[0139] Optionally, the second determination module 430 is specifically configured to:

[0140] Determine a target area of a target image corresponding to the target user in the video conferencing device;

[0141] Based on the first RGB value, a first weight corresponding to the target area, and a second weight corresponding to other areas except the target area in the video conferencing device, determine a first color influence value of the video conferencing device on the target user in the horizontal direction; the horizontal direction is the direction parallel to the display screen of the video conferencing device;

[0142] Based on a preset attenuation ratio, the target distance, and the first color influence value, determine a target color influence value of the video conferencing device on the target user.

[0143] Optionally, the second determination module 430 is specifically configured to:

[0144] Obtain a preset distance threshold and a preset color threshold corresponding to the camera module at the preset distance threshold;

[0145] When the target distance is less than the preset distance threshold, based on the preset distance threshold, the preset color threshold, the color cast value, the target distance, and the target color influence value, determine the degree of color deviation corresponding to the color cast value at the target distance;

[0146] When the target distance is greater than or equal to the preset distance threshold, it is determined that the color deviation degree corresponding to the color cast value at the target distance is 1.

[0147] Optionally, the color cast correction module 440 is specifically configured to:

[0148] Obtain the color standard deviation corresponding to the camera module;

[0149] When the target distance is less than the preset distance threshold, based on the color cast value, the color deviation degree, and the color standard deviation, determine the target corrected RGB value corresponding to the camera module;

[0150] When the target distance is greater than or equal to the preset distance threshold, determine the color cast value as the target corrected RGB value corresponding to the camera module.

[0151] Figure 5 It is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. As Figure 5 shown, the electronic device may include: a processor 510, a communication interface 520, a memory 530, and a communication bus 540. Among them, the processor 510, the communication interface 520, and the memory 530 communicate with each other through the communication bus 540. The processor 510 can call the logical instructions in the memory 530 to execute the color cast correction method of the video conferencing device. The method includes:

[0152] Obtain the working current of the lamp beads corresponding to the video conferencing device and the pixel sizes of at least one image;

[0153] Based on each of the pixel sizes, determine the target distance between the target user and the video conferencing device;

[0154] Based on the lamp bead working current, the target distance, and the color cast value at the target distance, determine the color deviation degree corresponding to the color cast value at the target distance; the color cast value is the RGB value corresponding to the camera module on the video conferencing device;

[0155] Based on the color deviation degree and the color cast value, determine the target corrected RGB value corresponding to the camera module. The target corrected RGB value is used for color compensation when the camera module counts the auto white balance information.

[0156] In addition, when the logical instructions in the above-mentioned memory 530 are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0157] On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program that can be stored on a computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the color cast correction method of the video conferencing device provided by the above-mentioned various methods. The method includes:

[0158] Obtain the working current of the lamp beads corresponding to the video conferencing device and the pixel sizes of at least one image;

[0159] Based on each of the pixel sizes, determine the target distance between the target user and the video conferencing device;

[0160] Based on the lamp bead working current, the target distance, and the color cast value at the target distance, determine the degree of color deviation corresponding to the color cast value at the target distance; the color cast value is the RGB value corresponding to the camera module on the video conferencing device;

[0161] Based on the degree of color deviation and the color cast value, determine the target corrected RGB value corresponding to the camera module. The target corrected RGB value is used for color compensation when the camera module counts the auto white balance information.

[0162] On yet another aspect, the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is implemented to execute the color cast correction method of the video conferencing device provided by the above-mentioned various methods. The method includes:

[0163] Obtain the working current of the lamp beads corresponding to the video conferencing device and the pixel sizes of at least one image;

[0164] Based on each of the pixel sizes, determine the target distance between the target user and the video conferencing device;

[0165] Based on the working current of the lamp beads, the target distance, and the color deviation value at the target distance, determine the degree of color deviation corresponding to the color deviation value at the target distance; the color deviation value is the RGB value corresponding to the camera module on the video conferencing device;

[0166] Based on the degree of color deviation and the color deviation value, determine the target corrected RGB value corresponding to the camera module, and the target corrected RGB value is used for color compensation when the camera module statistics the automatic white balance information.

[0167] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement without creative efforts.

[0168] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution, in essence, or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., including several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0169] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or equivalently replace some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for correcting color cast of a video conferencing device, characterized in that, it includes: Obtaining the working current of the lamp beads corresponding to the video conferencing device and the pixel sizes of at least one image; Based on each of the pixel sizes, determining the target distance between the target user and the video conferencing device; Based on the lamp bead working current, the target distance, and the color cast value at the target distance, determining the degree of color deviation corresponding to the color cast value at the target distance; The color cast value is the RGB value corresponding to the camera module on the video conferencing device; Based on the degree of color deviation and the color cast value, determining the target corrected RGB value corresponding to the camera module, and the target corrected RGB value is used for color compensation when the camera module statistics automatic white balance information.

2. The method for correcting color cast of a video conferencing device according to claim 1, characterized in that, the determining the degree of color deviation based on the lamp bead working current, the target distance, and the color cast value at the target distance includes: Determining the first RGB value of the video conferencing device under the lamp bead working current; Based on the first RGB value and the target distance, determining the target color influence value of the video conferencing device on the target user; Based on the target color influence value, the target distance, and the color cast value, determining the degree of color deviation corresponding to the color cast value at the target distance.

3. The method for correcting color cast of a video conferencing device according to claim 2, characterized in that, the determining the target color influence value of the video conferencing device on the target user based on the first RGB value and the target distance includes: Determining the target area of the target image corresponding to the target user in the video conferencing device; Based on the first RGB value, the first weight corresponding to the target area, and the second weight corresponding to other areas except the target area in the video conferencing device, determining the first color influence value of the video conferencing device on the target user in the horizontal direction; the horizontal direction is the direction parallel to the display screen of the video conferencing device; Based on the preset attenuation ratio, the target distance, and the first color influence value, determining the target color influence value of the video conferencing device on the target user.

4. The method for correcting color cast of a video conferencing device according to claim 2 or 3, characterized in that, the determining the degree of color deviation corresponding to the color cast value at the target distance based on the target color influence value, the target distance, and the color cast value includes: Obtaining a preset distance threshold and a preset color threshold corresponding to the camera module at the preset distance threshold; When the target distance is less than the preset distance threshold, based on the preset distance threshold, the preset color threshold, the color cast value, the target distance, and the target color influence value, determining the degree of color deviation corresponding to the color cast value at the target distance; When the target distance is greater than or equal to the preset distance threshold, determining the degree of color deviation corresponding to the color cast value at the target distance as 1.

5. The color cast correction method for a video conferencing device according to claim 4, wherein, determining the target corrected RGB value corresponding to the camera module based on the color deviation degree and the color cast value includes: obtaining the color standard deviation corresponding to the camera module; when the target distance is less than the preset distance threshold, determining the target corrected RGB value corresponding to the camera module based on the color cast value, the color deviation degree, and the color standard deviation; when the target distance is greater than or equal to the preset distance threshold, determining the color cast value as the target corrected RGB value corresponding to the camera module.

6. The color cast correction method for a video conferencing device according to any one of claims 1-3, wherein, determining the target distance between the target user and the video conferencing device based on each of the pixel sizes includes: obtaining the sensor pixel size, the lens focal length, and the central coordinates of each image in the video conferencing device corresponding to the camera module; for each of the pixel sizes, determining the first distance from the user corresponding to the pixel size to the camera module based on the sensor pixel size, the lens focal length, and the pixel size; determining the third distance from the image to the camera module based on the second distance from the camera module to the video conferencing device and the central coordinates; determining the fourth distance between the user and the video conferencing device based on the first distance and the third distance; determining the target distance between the target user and the video conferencing device based on each of the fourth distances.

7. The color cast correction method for a video conferencing device according to claim 6, wherein, determining the target distance between the target user and the video conferencing device based on each of the fourth distances includes: when the number of the fourth distances is greater than 1, determining the user corresponding to the minimum fourth distance as the target user, and determining the minimum fourth distance as the target distance from the target user to the video conferencing device; when the number of the fourth distances is equal to 1, determining the user corresponding to the fourth distance as the target user, and determining the fourth distance as the target distance from the target user to the video conferencing device.

8. A color cast correction device for a video conferencing device, wherein, comprising: an acquisition module, configured to acquire the working current of the lamp beads corresponding to the video conferencing device and the pixel sizes of at least one image; a first determination module, configured to determine the target distance between the target user and the video conferencing device based on each of the pixel sizes; a second determination module, configured to determine the color deviation degree corresponding to the color cast value at the target distance based on the working current of the lamp beads, the target distance, and the color cast value at the target distance; the color cast value is the RGB value corresponding to the camera module on the video conferencing device; A color cast correction module, configured to determine a target corrected RGB value corresponding to the camera module based on the color deviation degree and the color cast value, where the target corrected RGB value is used for color compensation when the camera module statistically calculates the auto white balance information.

9. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein, when the processor executes the program, it implements the color cast correction method of the video conferencing device according to any one of claims 1-7.

10. A computer-readable storage medium, on which a computer program is stored, wherein, when the computer program is executed by a processor, it implements the color cast correction method of the video conferencing device according to any one of claims 1-7.

Images