Color cast correction method and apparatus for video conferencing device, device, and storage medium

By obtaining the working current of the lamp beads and the image pixel size in the video conferencing device, calculating the target distance and color deviation degree, and performing adaptive compensation of RGB values, the problem of color casting of face images near the device is solved, and the image effect of the video conferencing device is improved.

WO2025107519A1PCT designated stage expired Publication Date: 2025-05-30ZHEJIANG UNIVIEW TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/090916
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-11-24
Filing Date
2024-04-30
Publication Date
2025-05-30

AI Technical Summary

Technical Problem

When the participants are close to the video conferencing equipment, the color of the face image is prone to color cast, resulting in poor image effect. The existing technology adjusts the RGB channel value directly by directly modifying the RGB channel value, but it cannot ensure that the image effect of each face image is consistent, and face images at medium and long distances will also experience color cast.

Method used

By obtaining the working current of the lamp beads of the video conferencing device and the pixel size of the image, determining the target distance between the target user and the device, combining the working current of the lamp beads and target distance, the color deviation degree corresponding to the RGB value of the camera module is calculated, and color compensation is performed during automatic white balance information statistics to achieve adaptive compensation of the RGB value.

Benefits of technology

It effectively solves the problem of color casting of face images when the distance is close, improves the overall image effect of video conferencing equipment, so that face images can maintain normal color at different distances, and improves the visual experience of the meeting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024090916_30052025_PF_FP_ABST
    Figure CN2024090916_30052025_PF_FP_ABST
Patent Text Reader

Abstract

The present invention relates to the technical field of image processing, and provides a color cast correction method and apparatus for a video conferencing device, a device, and a storage medium. The method comprises: acquiring a lamp bead working current corresponding to a video conferencing device and the pixel size of at least one image (110); on the basis of each pixel size, determining a target distance between a target user and the video conferencing device (120); on the basis of the lamp bead working current, the target distance, and a color cast value under the target distance, determining a color deviation degree corresponding to the color cast value under the target distance (130), wherein the color cast value is an RGB value corresponding to a camera module on the video conferencing device; and on the basis of the color deviation degree and the color cast value, determining a target correction RGB value corresponding to the camera module (140), wherein the target correction RGB value is used for performing color compensation when the camera module collects statistics about automatic white balance information.
Need to check novelty before this filing date? Find Prior Art

Description

Color cast correction method, device, equipment and storage medium for video conferencing equipment

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application No. 2023115872134, filed on November 24, 2023, entitled “Color cast correction method, device, equipment and storage medium for video conferencing equipment,” which is incorporated herein by reference in its entirety. Technical Field

[0003] The present disclosure relates to the field of image processing technology, and in particular to a method, apparatus, device, and storage medium for correcting color cast in a video conferencing device. Background Art

[0004] Video conferencing, as one of the primary functions of video conferencing equipment, is increasingly used. In practice, when participants are close to the device, the facial images displayed on the device appear distorted. However, when participants move further away, the facial images return to normal color.

[0005] Related technologies typically adjust the image quality by directly modifying the RGB channel values ​​of video conferencing equipment based on the user's subjective judgment of the image quality. However, directly modifying the RGB channel values ​​of video conferencing equipment cannot ensure the image quality of individual facial images at close range, and can also cause color casts in facial images at medium and long distances, resulting in poor overall image quality for the video conferencing equipment.

[0006] Summary of the Invention

[0007] The present disclosure provides a method, apparatus, device, and storage medium for correcting color cast in video conferencing equipment, which are used to address the color cast defect that occurs when the distance to the video conferencing equipment is close in the related art, realize adaptive compensation of the RGB value of the camera module, and improve the overall image effect of the video conferencing equipment.

[0008] The present disclosure provides a method for correcting color cast of a video conferencing device, comprising:

[0009] Obtaining the operating current of the lamp beads corresponding to the video conferencing device and the pixel size of at least one image;

[0010] determining a target distance between a target user and the video conferencing device based on each of the pixel sizes;

[0011] Determining a degree of color deviation corresponding to the color cast value at the target distance based on the operating current of the lamp bead, the target distance, and the color cast value at the target distance; the color cast value is an RGB value corresponding to the camera module on the video conferencing device;

[0012] Based on the color deviation degree and the color cast value, a target correction RGB value corresponding to the camera module is determined, and the target correction RGB value is used to perform color compensation when the camera module collects statistics of automatic white balance information.

[0013] The present disclosure also provides a color cast correction device for a video conferencing device, comprising:

[0014] An acquisition module configured to acquire a lamp operating current corresponding to the video conferencing device and a pixel size of at least one image;

[0015] a first determining module configured to determine a target distance between a target user and the video conferencing device based on each of the pixel sizes;

[0016] A second determination module is configured to determine a color deviation degree corresponding to the color cast value at the target distance based on the operating current of the lamp bead, the target distance, and the color cast value at the target distance; the color cast value is an RGB value corresponding to the camera module on the video conferencing device;

[0017] The color cast correction module is configured to determine a target correction RGB value corresponding to the camera module based on the color deviation degree and the color cast value, wherein the target correction RGB value is used to perform color compensation when the camera module collects statistics on automatic white balance information.

[0018] The present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the color cast correction method for the video conferencing device described above is implemented.

[0019] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the color cast correction method for the video conferencing device as described in any one of the above is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] FIG1 is a flow chart of a method for correcting color cast in a video conferencing device according to an embodiment of the present disclosure;

[0021] FIG2 is a schematic diagram of determining a target distance according to an embodiment of the present disclosure;

[0022] FIG3 is a schematic diagram of an example of a device coordinate system provided by an embodiment of the present disclosure;

[0023] FIG4 is a schematic structural diagram of a color cast correction device for a video conferencing device provided by an embodiment of the present disclosure;

[0024] FIG5 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] To address the problem of color cast occurring when the distance from a video conferencing device is close in the related art, the present disclosure provides a method for correcting color cast for a video conferencing device. FIG1 is a flow chart of the method for correcting color cast for a video conferencing device provided by an embodiment of the present disclosure. As shown in FIG1 , the method includes:

[0026] Step 110: Obtain the operating current of the lamp beads corresponding to the video conferencing device and the pixel size of at least one image.

[0027] Specifically, in an application scenario, when the user is close to the video conferencing device, the color of the image presented in the video conferencing device appears to be cast, and when the user is farther away from the video conferencing device, the color of the image in the video conferencing device returns to normal. Therefore, by obtaining the pixel size of the image corresponding to the user, the distance between the user and the video conferencing device is further determined, and based on the distance, it is determined whether the image corresponding to the user in the video conferencing device appears to be cast. In addition, the backlight color of the video conferencing device is controlled and adjusted by the operating current of the LED lamp beads in the device screen, and different lamp bead operating currents correspond to different backlight colors. When the user is close to the video conferencing device, the AWB (Auto White Balance) information counted by the camera module will be interfered with by the backlight color of the video conferencing device, resulting in an error in the color temperature calculation, and then the color of the image presented in the video conferencing device appears to be cast. When the user moves away from the video conferencing device for a certain distance, the influence of the backlight color on the color temperature calculation in the camera module is reduced, so that the color of the image presented in the video conferencing device returns to normal. Therefore, in the embodiment of the present disclosure, it is also necessary to obtain the working current of the lamp beads in the video conferencing device, combine the judgment of the distance and the interference of the backlight color caused by the working current of the lamp beads, and solve the color cast problem when the user is close to the video conferencing device.

[0028] It should be noted that the camera module generates corresponding scene image data after photographing each user through the camera. After performing face detection and recognition on the scene image data, the facial pixel position of each facial image is determined, and the processed scene image data is sent to the video conferencing device for display. The above image is the facial image corresponding to each user in the processed scene image data. In addition, the above pixel size can be understood as the facial pixel position of the facial image corresponding to each user in the scene image data in the camera module. The facial pixel position includes the horizontal pixels and vertical pixels of the facial image in the scene image data. Based on the proportional relationship between the pixel size and the sensor size in the camera module, the distance from the user to the camera module can be determined, and then based on the distance from the user to the camera module, the distance from the user to the video conferencing device can be determined. The sensor size in the camera module is the same as the pixel size of the above scene image data.

[0029] Optionally, the video conferencing device may be a display that is communicatively connected to the camera module and can display scene image data sent by the camera module. For example, the video conferencing device may be a large conference screen with a screen size of 55 inches or larger.

[0030] Step 120: Determine a target distance between the target user and the video conferencing device based on each pixel size.

[0031] Specifically, for the pixel size of the image corresponding to each user, the distance of each user from the video conferencing device can be determined based on the pixel size. Different distances result in different degrees of color cast of the image corresponding to each user. Therefore, the distance with the highest degree of color cast is determined from all distances as the target distance, and the user corresponding to the target distance is taken as the target user. That is, in the video conferencing device, the target image corresponding to the target user has the highest degree of color cast.

[0032] Furthermore, determining the target distance between the target user and the video conferencing device based on each pixel size includes:

[0033] Obtaining the sensor pixel size, lens focal length, and center coordinates of each image in the video conferencing device corresponding to the camera module;

[0034] For each pixel size, determining a first distance between the user and the camera module corresponding to the pixel size based on the sensor pixel size, the lens focal length, and the pixel size;

[0035] determining a third distance between the image and the camera module based on a second distance from the camera module to the video conferencing device and the center coordinates;

[0036] determining a fourth distance between the user and the video conferencing device based on the first distance and the third distance;

[0037] Based on all the fourth distances, a target distance between the target user and the video conferencing device is determined.

[0038] Specifically, before determining the target distance, it is necessary to construct a device coordinate system corresponding to the video conferencing device, and then determine the center coordinates of each image in the device coordinate system. For example, FIG2 is an example schematic diagram of a device coordinate system provided by an embodiment of the present disclosure. As shown in FIG2 , the side length of the video conferencing device is 2c, and the midpoint of the upper edge of the video conferencing device is used as the origin. The x-axis of the device coordinate system is constructed along the horizontal direction of the upper edge, and the y-axis of the device coordinate system is constructed from the origin along the vertical direction perpendicular to the x-axis. The center coordinate (x i ,y i) represents the coordinates of the midpoint of image i in the device coordinate system, where i represents the i-th image in the video conferencing device and is an integer greater than or equal to 1. Furthermore, the origin of the device coordinate system may be located at the center, one of the four corners, or any other location of the video conferencing device.

[0039] After obtaining the sensor pixel size, lens focal length, and center coordinates of each image in the video conferencing device corresponding to the camera module, for the i-th image, using formula (1), according to the sensor pixel size, lens focal length, and pixel size of the i-th image in the camera module, the first distance from user i to the video conferencing device corresponding to the pixel size can be calculated. Formula (1) is:

[0040] Where OL represents the first distance from user i to the center point of the camera module, FL represents the focal length of the lens, M represents the number of pixels in the horizontal direction of the sensor pixel size in the camera module, N represents the number of pixels in the vertical direction of the sensor pixel size in the camera module, and the sensor pixel size is expressed as M*N. FOV l Represents the horizontal pixels in the pixel size corresponding to the i-th image, FOV w Represents the vertical pixel in the pixel size corresponding to the i-th image, l represents the horizontal direction, and w represents the vertical direction.

[0041] FIG3 is a schematic diagram of determining the target distance provided by an embodiment of the present disclosure. As shown in FIG3 , the camera module is arranged above the video conferencing device and is coaxially arranged with the video conferencing device. After determining the first distance, the height difference between the center point of the camera module and the center coordinate of the image i in the y-axis direction can be determined based on the second distance from the center point of the camera module to the midpoint of the upper edge of the video conferencing device and the sum of the y-axis coordinates of the center coordinate of the image i. According to the Pythagorean theorem, using formula (2), the third distance between the center coordinate of the image i and the center point of the camera module can be calculated, and formula (2) is:

[0042] Among them, S(x i ,y i ) represents the third distance between the center coordinate of image i and the center point of the camera module, h represents the second distance from the center point of the camera module to the midpoint of the upper edge of the video conferencing device, and y i +h represents the height difference between the center point of the camera module and the center coordinate of image i in the y-axis direction.

[0043] After determining the first and third distances, the fourth distance between user i and the video conferencing device can be calculated using formula (3) according to the Pythagorean theorem, that is, the fourth distance between user i and the center coordinates of image i. Formula (3) is:

[0044] Among them, L(x i ,y i ) represents the fourth distance between user i and the video conferencing device.

[0045] After determining the fourth distance between each user and the video conferencing device, a target distance may be determined from all the fourth distances.

[0046] Furthermore, determining a target distance between the target user and the video conferencing device based on each of the fourth distances includes:

[0047] When the number of the fourth distances is greater than 1, determining a user corresponding to the minimum fourth distance as a target user, and determining the minimum fourth distance as a target distance from the target user to the video conferencing device;

[0048] When the fourth distance is equal to 1, the user corresponding to the fourth distance is determined as the target user, and the fourth distance is determined as the target distance from the target user to the video conferencing device.

[0049] Specifically, if there is only one user within the camera module's shooting range, that user is determined as the target user, and the fourth distance between that user and the video conferencing device is determined as the target distance between the target user and the video conferencing device. If there are multiple users within the camera module's shooting range, the fourth distance between each user and the video conferencing device can be calculated. Because the closer a user is to the video conferencing device, the greater the degree of color cast in the image corresponding to that user. Therefore, from the multiple fourth distances, the user corresponding to the smallest fourth distance is determined as the target user, and this smallest fourth distance is determined as the target distance between the target user and the video conferencing device. At this time, since the target distance is the smallest, the target image corresponding to the target user accounts for the largest proportion in the complete display image of the video conferencing device, and the color cast of the target image is the highest. After correcting the complete display image of the video conferencing device based on the color cast of the target image, there is a slight over-correction in the color cast of the images corresponding to other users. However, since the images corresponding to other users account for a small proportion in the complete display image, the impact on the overall image effect of the video conferencing device is small and can be ignored. That is, after correcting the color cast of the target image, the overall image effect of the video conferencing device can be improved.

[0050] Step 130: Determine the degree of color deviation corresponding to the color cast value at the target distance based on the operating current of the lamp bead, the target distance, and the color cast value at the target distance; the color cast value is the RGB value corresponding to the camera module on the video conferencing device.

[0051] Specifically, after determining the target distance and the color cast value at the target distance, the degree of color deviation corresponding to the color cast value can be determined in combination with the target distance and the interference of the backlight color caused by the working current of the lamp beads, so as to correct the color cast value according to the degree of color deviation and improve the overall image effect of the video conferencing equipment.

[0052] Furthermore, determining the degree of color deviation based on the operating current of the lamp bead, the target distance, and the color deviation value at the target distance includes:

[0053] Determine a first RGB (Red, Green, Blue) value of the video conferencing device under the operating current of the lamp bead;

[0054] determining a target color impact value of the video conferencing device on the target user based on the first RGB value and the target distance;

[0055] Based on the target color impact value, the target distance, and the color cast value, a color deviation degree corresponding to the color cast value at the target distance is determined.

[0056] Specifically, by adjusting the working current of different lamp beads in the video conferencing equipment, the RGB value of the image in the video conferencing equipment changes. Among them, the change of the working current of the lamp beads mainly affects the component value of the B channel in the RGB value. The increase of the component value of the B channel will cause the color coordinates to change. The decrease in color temperature leads to an increase in color temperature, and the final RGB value tends to be blue. The corresponding relationship between the working current of the lamp bead and the color coordinates is: Among them, G in (I a ) indicates that the working current of the lamp is I a The implicit function of The color coordinates are The implicit function of the lamp bead working current is K, which represents the influence coefficient of the lamp bead working current on the color coordinates. After determining the corresponding relationship between the lamp bead working current and the color coordinates, the first RGB value of the video conferencing device under the lamp bead working current can be determined according to the conversion relationship between the color coordinates and the component values ​​of each channel in the RGB value as shown in formula (4). Formula (4) is:

[0057] Among them, R1 represents the component value of the R channel in the first RGB value, G1 represents the component value of the G channel in the first RGB value, B1 represents the component value of the B channel in the first RGB value, and the first RGB value can be expressed as T1(R1, G1, B1).

[0058] After determining the first RGB value, the impact of the backlight color of the video conferencing device on the target color when determining the RGB value of the camera module at the target distance can be determined based on the target distance and the first RGB value. Subsequently, based on the target color impact value, the target distance, and the color cast value, the degree of color deviation corresponding to the color cast value at the target distance is calculated, and the color cast value is corrected based on the degree of color deviation.

[0059] Furthermore, determining the target color impact value of the video conferencing device on the target user based on the first RGB value and the target distance includes:

[0060] Determine a target area of ​​a target image corresponding to the target user in the video conferencing device;

[0061] Determining a first color impact value of the video conferencing device on the target user in a horizontal direction based on the first RGB value, a first weight corresponding to the target area, and second weights corresponding to other areas of the video conferencing device except the target area; the horizontal direction is a direction parallel to the display screen of the video conferencing device, that is, the x-axis direction shown in FIG. 2 or FIG. 3 ;

[0062] A target color impact value of the video conferencing device on the target user is determined based on a preset attenuation ratio, the target distance, and the first color impact value.

[0063] Specifically, before determining the target color impact value, the display area of ​​the video conferencing device can be divided along the x-axis direction shown in Figure 2 or Figure 3, and then the weight of the influence of each divided area block on the target image is determined, and the sum of the weights of the influence of each area block on the target image is 1. For example, taking the number of area blocks obtained after the display area of ​​the video conferencing device is divided as N, N is an integer greater than or equal to 2, according to the x-axis coordinate of the center coordinate corresponding to the target image, the target area where the target image is located can be determined, and then the first weight of the influence of the target area on the target image is determined to be q, and the first weight q is a preset value. When determining the second weight corresponding to other areas other than the target area, the closer the distance between the other area and the target area, the larger the value of the second weight corresponding to the other area, that is, the values ​​of the second weight on both sides of the target area decrease in sequence.

[0064] Afterwards, the target area where the target image is located is determined according to the x-axis coordinate in the center coordinate corresponding to the target image, and the first weight of the influence of the target area on the target image and the second weight of the influence of other areas other than the target area on the target image are determined. Using formula (4), according to the weighted sum of each area block and the first RGB value, the first color influence value of the video conferencing device on the target user can be determined in the horizontal direction, that is, in the x-axis direction shown in Figure 2 or Figure 3. Formula (5) is:

[0065] Among them, W(x i ) represents the first color impact value of the video conferencing device on the target user, [-c, c] represents the value range of the x-axis coordinate, that is, the range of the x-axis in the above device coordinate system, U(x i ) represents the first weight or the second weight, and traverses each area block. If the current area block is the target area corresponding to the target image, U(x i ) represents the first weight. If the current region block is other than the target region, U(x i ) represents the second weight, x d Indicates the current x-axis coordinate of the traversal.

[0066] After determining the first color impact value, using formula (6), according to the preset attenuation ratio, target distance and the first color impact value, the lamp bead operating current I is determined in the z-axis direction perpendicular to the video conferencing device shown in Figure 2 or Figure 3. a The impact of the backlight color of the video conferencing device on the target color of the target user is determined, that is, on the plane formed by the z-axis direction and the x-axis direction where the target distance is located, the target color impact value of the video conferencing device on the RGB value calculated by the camera module is determined. Formula (6) is:

[0067] Among them, T2(R2, G2, B2) represents the impact value of the video conferencing device on the target color of the target user, and t represents the working current I of the video conferencing device when the lamp is working. a The first RGB value and target distance L(x i ,y i ) under the preset attenuation ratio of the influence of the camera module on the RGB value calculation, W(x i ) represents the first color impact value of the video conferencing device on the target user.

[0068] Furthermore, determining the color deviation degree corresponding to the color cast value at the target distance based on the target color impact value, the target distance, and the color cast value includes:

[0069] Obtaining a preset distance threshold and a preset color threshold corresponding to the camera module under the preset distance threshold;

[0070] When the target distance is less than the preset distance threshold, determining a color deviation degree corresponding to the color deviation value at the target distance based on the preset distance threshold, the preset color threshold, the color cast value, the target distance, and the target color influence value;

[0071] When the target distance is greater than or equal to the preset distance threshold, it is determined that the color deviation degree corresponding to the color deviation value at the target distance is 1.

[0072] Specifically, after determining the target color impact value, a preset distance threshold and a preset color threshold under the preset distance threshold can be obtained. The preset distance threshold is the distance at which the image corresponding to the user in the video conferencing device has no obvious color cast, as determined through multiple tests. That is, when the distance between the user and the video conferencing device is greater than or equal to the preset distance threshold, the image corresponding to the user has no obvious color cast, and when the distance between the user and the video conferencing device is less than the preset distance threshold, the image corresponding to the user has obvious color cast. At the same time, the preset color threshold corresponding to the camera module under this preset distance threshold is read. At this time, the preset distance threshold, the preset color threshold corresponding to the preset distance threshold, the target distance, the color cast value corresponding to the target distance, and the target color impact value have a corresponding relationship as shown in formula (7), and formula (7) is:

[0073] Wherein, L0 represents the preset distance threshold, T0(R0, G0, B0) represents the preset color threshold under the preset distance threshold, P T' (L(x i ,y i ),I a ) represents the color deviation degree corresponding to the color cast value at the target distance, T'(R',G',B') represents the color cast value, L(x i ,y i ) is the target distance, and T2(R2, G2, B2) represents the target color impact value of the video conferencing device on the target user.

[0074] According to formula (7), formula (8) can be converted. That is, when the target distance is greater than or equal to the preset distance threshold, since the image corresponding to the user has no obvious color cast, the color deviation degree can be determined to be 1. When the target distance is less than the preset distance threshold, since the image corresponding to the user has obvious color cast, the color deviation degree can be determined based on the preset distance threshold, the preset color threshold corresponding to the preset distance threshold, the target distance, the color cast value corresponding to the target distance, and the target color influence value. Formula (8) is:

[0075] Step 140: Determine a target correction RGB value corresponding to the camera module based on the color deviation degree and the color cast value. The target correction RGB value is used to perform color compensation when the camera module collects statistics on automatic white balance information.

[0076] Specifically, after determining the degree of color deviation at the target distance, the color deviation value can be corrected according to the degree of color deviation to obtain the corrected target RGB value, so as to perform color compensation when the camera module counts the AWB information, so that the target image returns to normal, thereby improving the overall image effect of the video conferencing equipment.

[0077] Furthermore, determining a target corrected RGB value corresponding to the camera module based on the color deviation degree and the color cast value includes:

[0078] Obtaining the color standard deviation corresponding to the camera module;

[0079] When the target distance is less than the preset distance threshold, determining a target correction RGB value corresponding to the camera module based on the color cast value, the color deviation degree, and the color standard deviation;

[0080] When the target distance is greater than or equal to the preset distance threshold, the color cast value is determined as the target correction RGB value corresponding to the camera module.

[0081] Specifically, after determining the degree of color deviation and obtaining the color standard deviation corresponding to the camera module, using formula (9), if the target distance is greater than or equal to the preset distance threshold, since the image corresponding to the user has no obvious color cast, the color cast value can be determined as the target correction RGB value, and no color compensation is required. If the target distance is less than the preset distance threshold, since the image corresponding to the user has obvious color cast, the color cast value can be corrected based on the color cast value, the degree of color deviation, and the color standard deviation to obtain the corrected target correction RGB value. When the camera module counts the AWB information, the corresponding color value can be set as the target correction RGB value to achieve color compensation. Formula (9) is:

[0082] Where T3(R3, G3, B3) represents the corrected target RGB value, e represents the color standard deviation corresponding to the RGB value calculated by the camera module m times, and Among them, T1 j (R j ,G j ,B j ) represents the color value calculated by the j-th camera module, represents the color mean corresponding to the RGB values ​​calculated by the m camera modules, and

[0083] It should be noted that in addition to compensating for RGB values ​​when the camera module calculates AWB information, color compensation can also be performed on the camera module's HSV mode using the conversion relationship between RGB values ​​and the HSV mode to correct color cast. Furthermore, after determining the degree of color deviation corresponding to the color cast value at the target distance, the operating current of the lamp beads can be adjusted based on the degree of color deviation to adjust the first RGB value at the lamp bead operating current. Based on the first RGB value, the impact of the video conferencing device's backlight color on the camera module's AWB information at the lamp bead operating current is adjusted, thereby achieving color compensation for the target image.

[0084] The color cast correction method for a video conferencing device provided in an embodiment of the present disclosure determines the target distance between the target user and the video conferencing device according to each pixel size after obtaining the lamp operating current corresponding to the video conferencing device and the pixel size of at least one image, and determines the degree of color shift at the target distance in combination with the lamp operating current, the target distance, and the color cast value at the target distance. When the camera module counts the automatic white balance information, the target correction RGB value is determined according to the color shift degree and the color cast value. Taking into account the interference of the backlight color of the video conferencing device caused by the target distance and the lamp operating current, the RGB value of the camera module is adaptively compensated, thereby improving the overall image effect of the video conferencing device.

[0085] The color cast correction device for a video conferencing device provided by the present disclosure is described below. The color cast correction device for a video conferencing device described below and the color cast correction method for a video conferencing device described above can be referenced to each other.

[0086] The present disclosure also provides a color cast correction device for a video conferencing device. FIG4 is a schematic structural diagram of the color cast correction device for a video conferencing device provided by the present disclosure. As shown in FIG4 , the color cast correction device 400 for a video conferencing device includes: an acquisition module 410, a first determination module 420, a second determination module 430, and a color cast correction module 440, wherein:

[0087] An acquisition module 410 is configured to acquire a lamp operating current corresponding to the video conferencing device and a pixel size of at least one image;

[0088] A first determination module 420 is configured to determine a target distance between a target user and the video conferencing device based on each of the pixel sizes;

[0089] A second determining module 430 is configured to determine a degree of color deviation corresponding to the color cast value at the target distance based on the operating current of the lamp bead, the target distance, and the color cast value at the target distance; the color cast value is an RGB value corresponding to the camera module of the video conferencing device;

[0090] The color cast correction module 440 is configured to determine a target correction RGB value corresponding to the camera module based on the color deviation degree and the color cast value. The target correction RGB value is used to perform color compensation when the camera module collects statistics on automatic white balance information.

[0091] The color cast correction device for a video conferencing device provided in an embodiment of the present disclosure determines the target distance between the target user and the video conferencing device according to each pixel size after obtaining the lamp operating current corresponding to the video conferencing device and the pixel size of at least one image, and determines the degree of color shift at the target distance in combination with the lamp operating current, the target distance, and the color cast value at the target distance. When the camera module counts the automatic white balance information, the target correction RGB value is determined according to the color shift degree and the color cast value. Taking into account the interference of the backlight color of the video conferencing device caused by the target distance and the lamp operating current, the RGB value of the camera module is adaptively compensated, thereby improving the overall image effect of the video conferencing device.

[0092] Optionally, the first determining module 420 is specifically configured as follows:

[0093] Obtaining the sensor pixel size, lens focal length, and center coordinates of each image in the video conferencing device corresponding to the camera module;

[0094] For each pixel size, determining a first distance between the user and the camera module corresponding to the pixel size based on the sensor pixel size, the lens focal length, and the pixel size;

[0095] determining a third distance between the image and the camera module based on a second distance from the camera module to the video conferencing device and the center coordinates;

[0096] determining a fourth distance between the user and the video conferencing device based on the first distance and the third distance;

[0097] Based on all the fourth distances, a target distance between the target user and the video conferencing device is determined.

[0098] Optionally, the first determining module 420 is specifically configured as follows:

[0099] When the number of the fourth distances is greater than 1, determining a user corresponding to the minimum fourth distance as a target user, and determining the minimum fourth distance as a target distance from the target user to the video conferencing device;

[0100] When the fourth distance is equal to 1, the user corresponding to the fourth distance is determined as the target user, and the fourth distance is determined as the target distance from the target user to the video conferencing device.

[0101] Optionally, the second determining module 430 is specifically configured as follows:

[0102] Determine a first RGB value of the video conferencing device under the operating current of the lamp bead;

[0103] determining a target color impact value of the video conferencing device on the target user based on the first RGB value and the target distance;

[0104] Based on the target color impact value, the target distance, and the color cast value, a color deviation degree corresponding to the color cast value at the target distance is determined.

[0105] Optionally, the second determining module 430 is specifically configured as follows:

[0106] Determine a target area of ​​a target image corresponding to the target user in the video conferencing device;

[0107] Determining a first color impact value of the video conferencing device on the target user in a horizontal direction based on the first RGB value, a first weight corresponding to the target area, and second weights corresponding to other areas of the video conferencing device except the target area; the horizontal direction being a direction parallel to a display screen of the video conferencing device;

[0108] A target color impact value of the video conferencing device on the target user is determined based on a preset attenuation ratio, the target distance, and the first color impact value.

[0109] Optionally, the second determining module 430 is specifically configured as follows:

[0110] Obtaining a preset distance threshold and a preset color threshold corresponding to the camera module under the preset distance threshold;

[0111] When the target distance is less than the preset distance threshold, determining a color deviation degree corresponding to the color deviation value at the target distance based on the preset distance threshold, the preset color threshold, the color cast value, the target distance, and the target color influence value;

[0112] When the target distance is greater than or equal to the preset distance threshold, it is determined that the color deviation degree corresponding to the color deviation value at the target distance is 1.

[0113] Optionally, the color cast correction module 440 is specifically configured as follows:

[0114] Obtaining the color standard deviation corresponding to the camera module;

[0115] When the target distance is less than the preset distance threshold, determining a target correction RGB value corresponding to the camera module based on the color cast value, the color deviation degree, and the color standard deviation;

[0116] When the target distance is greater than or equal to the preset distance threshold, the color cast value is determined as the target correction RGB value corresponding to the camera module.

[0117] FIG5 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. As shown in FIG5 , the electronic device may include: a processor 510, a communications interface 520, a memory 530, and a communication bus 540. The processor 510, the communications interface 520, and the memory 530 communicate with each other via the communication bus 540. The processor 510 may call logic instructions in the memory 530 to execute a color cast correction method for a video conferencing device, which includes:

[0118] Obtaining the operating current of the lamp beads corresponding to the video conferencing device and the pixel size of at least one image;

[0119] determining a target distance between a target user and the video conferencing device based on each of the pixel sizes;

[0120] Determining a degree of color deviation corresponding to the color cast value at the target distance based on the operating current of the lamp bead, the target distance, and the color cast value at the target distance; the color cast value is an RGB value corresponding to the camera module on the video conferencing device;

[0121] Based on the color deviation degree and the color cast value, a target correction RGB value corresponding to the camera module is determined, and the target correction RGB value is used to perform color compensation when the camera module collects statistics of automatic white balance information.

[0122] In addition, the logic instructions in the above-mentioned memory 530 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the relevant technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0123] In another aspect, the present disclosure further provides a computer program product, comprising a computer program that can be stored on a computer-readable storage medium. When the computer program is executed by a processor, the computer can perform the color cast correction method for a video conferencing device provided by the above method, the method comprising:

[0124] Obtaining the operating current of the lamp beads corresponding to the video conferencing device and the pixel size of at least one image;

[0125] determining a target distance between a target user and the video conferencing device based on each of the pixel sizes;

[0126] Determining a degree of color deviation corresponding to the color cast value at the target distance based on the operating current of the lamp bead, the target distance, and the color cast value at the target distance; the color cast value is an RGB value corresponding to the camera module on the video conferencing device;

[0127] Based on the color deviation degree and the color cast value, a target correction RGB value corresponding to the camera module is determined, and the target correction RGB value is used to perform color compensation when the camera module collects statistics of automatic white balance information.

[0128] In another aspect, the present disclosure further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method for correcting color cast of a video conferencing device provided by the above method is implemented. The method includes:

[0129] Obtaining the operating current of the lamp beads corresponding to the video conferencing device and the pixel size of at least one image;

[0130] determining a target distance between a target user and the video conferencing device based on each of the pixel sizes;

[0131] Determining a degree of color deviation corresponding to the color cast value at the target distance based on the operating current of the lamp bead, the target distance, and the color cast value at the target distance; the color cast value is an RGB value corresponding to the camera module on the video conferencing device;

[0132] Based on the color deviation degree and the color cast value, a target correction RGB value corresponding to the camera module is determined, and the target correction RGB value is used to perform color compensation when the camera module collects statistics of automatic white balance information.

[0133] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0134] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus the necessary general hardware platform, or of course, by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the relevant technology can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the method described in each embodiment or certain parts of the embodiment.

[0135] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them. Although the present disclosure has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in each of the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present disclosure.

Claims

1. A method for correcting color cast of a video conferencing device, comprising: Obtaining the lamp bead working current and the pixel size of at least one image corresponding to the video conferencing device; determining a target distance between a target user and a video conferencing device based on each of the pixel sizes; Based on the working current of the lamp bead, the target distance and the color cast value at the target distance, determining the color deviation degree corresponding to the color cast value at the target distance; The color cast value is the RGB value corresponding to the camera module on the video conferencing device; Based on the color deviation degree and the color cast value, a target correction RGB value corresponding to the camera module is determined, and the target correction RGB value is used to perform color compensation when the camera module collects statistics on automatic white balance information.

2. The color cast correction method for video conferencing equipment according to claim 1, wherein: The determining the degree of color deviation based on the lamp bead working current, the target distance and the color deviation value at the target distance includes: Determine a first RGB value of the video conferencing device under the operating current of the lamp bead; Determining a target color impact value of the video conferencing device on the target user based on the first RGB value and the target distance; Based on the target color influence value, the target distance, and the color cast value, a color deviation degree corresponding to the color cast value at the target distance is determined.

3. The color cast correction method for video conferencing equipment according to claim 2, wherein: The determining, based on the first RGB value and the target distance, a target color impact value of the video conferencing device on the target user includes: Determine a target area of ​​a target image corresponding to the target user in the video conferencing device; Based on the first RGB value, the first weight corresponding to the target area and the second weight corresponding to other areas in the video conferencing device except the target area, Determine a first color impact value of the video conferencing device on the target user in a horizontal direction; the horizontal direction is a direction parallel to the display screen of the video conferencing device; A target color impact value of the video conferencing device on the target user is determined based on a preset attenuation ratio, the target distance, and the first color impact value.

4. The color cast correction method for video conferencing equipment according to claim 2 or 3, wherein: The determining, based on the target color impact value, the target distance, and the color cast value, a color deviation degree corresponding to the color cast value at the target distance includes: Obtaining a preset distance threshold and a preset color threshold corresponding to the camera module under the preset distance threshold; When the target distance is less than the preset distance threshold, determining the degree of color deviation corresponding to the color cast value at the target distance based on the preset distance threshold, the preset color threshold, the color cast value, the target distance, and the target color influence value; When the target distance is greater than or equal to the preset distance threshold, it is determined that the color deviation degree corresponding to the color cast value at the target distance is 1.

5. The color cast correction method for video conferencing equipment according to claim 4, wherein: The step of determining a target corrected RGB value corresponding to the camera module based on the color deviation degree and the color cast value includes: Obtaining the color standard deviation corresponding to the camera module; When the target distance is less than the preset distance threshold, determining a target correction RGB value corresponding to the camera module based on the color cast value, the color deviation degree and the color standard deviation; When the target distance is greater than or equal to the preset distance threshold, the color cast value is determined as the target correction RGB value corresponding to the camera module.

6. The color cast correction method for a video conferencing device according to any one of claims 1 to 3, wherein: The determining, based on each pixel size, a target distance between a target user and a video conferencing device comprises: Obtain the sensor pixel size, lens focal length and each of the images corresponding to the camera module the center coordinates of the image in the video conferencing device; For each of the pixel sizes, determining a first distance between the user and the camera module corresponding to the pixel size based on the sensor pixel size, the lens focal length and the pixel size; Determining a third distance between the image and the camera module based on a second distance from the camera module to the video conferencing device and the center coordinates; Determining a fourth distance between the user and the video conferencing device based on the first distance and the third distance; Based on all the fourth distances, a target distance between the target user and the video conferencing device is determined.

7. The color cast correction method for video conferencing equipment according to claim 6, wherein: The step of determining a target distance between a target user and a video conferencing device based on each of the fourth distances includes: In the case where the number of the fourth distances is greater than 1, determining a user corresponding to the minimum fourth distance as a target user, and determining the minimum fourth distance as a target distance from the target user to the video conferencing device; When the number of the fourth distance is equal to 1, the user corresponding to the fourth distance is determined as the target user, and the fourth distance is determined as the target distance from the target user to the video conferencing device.

8. A color cast correction device for a video conferencing device, comprising: An acquisition module configured to acquire a lamp bead operating current corresponding to the video conferencing device and a pixel size of at least one image; A first determination module is configured to determine a target distance between a target user and a video conferencing device based on each of the pixel sizes; A second determination module is configured to determine the color deviation degree corresponding to the color cast value at the target distance based on the working current of the lamp bead, the target distance and the color cast value at the target distance; The color cast value is the RGB value corresponding to the camera module on the video conferencing device value; The color cast correction module is configured to determine a target correction RGB value corresponding to the camera module based on the color deviation degree and the color cast value, wherein the target correction RGB value is used for color compensation when the camera module collects statistics on automatic white balance information.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the color cast correction method for the video conferencing device according to any one of claims 1 to 7 when executing the program.

10. A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the color cast correction method for a video conferencing device according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Image-capture Apparatus And Image-capture Control Method

    CN104065870A

  • Image display effect processing method and device, equipment and storage medium

    CN116962619A

  • Display device with image capture and analysis module

    EP2515526A2

  • Device and method for adjusting object illumination

    EP2565602A1

  • Cellular terminals and other electronic devices and methods that adjust projected video images to compensate for color, brightness, and / or pattern of a display surface

    US20090066857A1