Live broadcast light control method, system and terminal

Abstract

The invention provides a live broadcast light control method, system and terminal wherein the live broadcast light control method is a cyclic light regulation and control process, and during single execution, the method comprises the following steps: collecting a current live broadcast image; dividing the live broadcast image into adjustment areas, and calculating to obtain current brightness values of the adjustment areas; on the basis of the target brightness value corresponding to each adjustment area and in combination with the current brightness value of each adjustment area, brightness differences corresponding to all the adjustment areas are calculated, and if all the brightness differences meet the preset brightness requirement, light regulation and control are stopped; otherwise, the light intensity of the corresponding lamp set is adjusted based on the preset light adjusting strategy, the light adjusting and controlling process is executed again, operation is convenient and fast, manual adjustment by workers is not needed, and the good light effect can be achieved.

Description

Technical Field

[0001] The present application belongs to the field of live broadcasting and relates to a lighting adjustment technology, and in particular to a live broadcast lighting control method, system and terminal. Background Art

[0002] For live broadcasts, the brightness and distribution of lighting have a significant impact on the quality of the broadcast. Generally speaking, the lighting needs to be focused on the face of the main broadcaster, and to ensure the atmosphere and effect of the broadcast, the face needs to have a certain degree of light and dark variation.

[0003] In the existing technology, the method for adjusting live broadcast lighting is usually for staff to manually adjust the brightness of the lights. The operation is complicated and tedious, takes a lot of time, is inefficient, and is greatly affected by the experience of the staff. It is difficult to ensure that the final lighting effect is in the best state.

[0004] Therefore, how to achieve efficient and convenient adjustment of live broadcast lighting is a technical problem that needs to be solved urgently by those skilled in the art. Summary of the Invention

[0005] The purpose of this application is to provide a live broadcast lighting control method, system and terminal, which are used to solve the problem in the prior art that live broadcast scene lighting adjustment requires manual adjustment by staff, the operation is complicated and tedious, and the efficiency is low.

[0006] In a first aspect, the present application provides a live broadcast lighting control method, which is a cyclic lighting control process. When the lighting control process is executed once, the method includes:

[0007] Collect the current live image;

[0008] Divide the live image into adjustment areas, and calculate and obtain the current brightness value of each adjustment area;

[0009] Based on the target brightness value corresponding to each adjustment area and the current brightness value of each adjustment area, the brightness difference corresponding to each adjustment area is calculated respectively. If each brightness difference meets the preset brightness requirement, the light control is stopped; otherwise, the light intensity of the corresponding light group is adjusted based on the preset light control strategy, and the light control process is executed again;

[0010] Among them, each of the adjustment areas includes a first area and a second area, and the method for obtaining the first area and the second area includes: performing face recognition on the live image, obtaining at least one face area, and dividing each face area into a first sub-area and a second sub-area; wherein, the first area is a collection of each of the first sub-areas, and the second area is a collection of each of the second sub-areas.

[0011] In one embodiment of the present application, for any of the face regions, a method for acquiring the first sub-region and the second sub-region includes:

[0012] Obtaining the total number of pixels in the face area and calculating the corresponding half value of the total number of pixels;

[0013] Calculating and obtaining the number of half-frame columns based on the half-value of the total number of pixels, such that each of the consecutive half-frame columns on the first side of the face region is used as the first sub-region and the remaining columns are used as the second sub-region, or each of the consecutive half-frame columns on the second side of the face region is used as the second sub-region and the remaining columns are used as the first sub-region;

[0014] The half-frame column number is the minimum value of the number of consecutive columns on the first side or the second side of the face area, for which the total number of corresponding pixels is not less than half the total number of pixels.

[0015] In one embodiment of the present application, each of the adjustment areas also includes a background area, and a method for obtaining the background area includes: performing face recognition on the live image to obtain each of the face areas; based on each of the face areas, using the remaining area of ​​the live image as the background area.

[0016] In one embodiment of the present application, the method for obtaining each of the face region and the background region includes:

[0017] Performing face detection on the live broadcast image to obtain at least one face frame range;

[0018] Performing image segmentation on each face frame range to obtain corresponding foreground images;

[0019] For any of the foreground images, all corresponding pixels are extracted to form the corresponding face area; after traversing each of the foreground images, all remaining pixels of the live image are extracted to form the corresponding background area.

[0020] In one embodiment of the present application, the brightness value currently corresponding to the first area is a first weighted brightness value; the brightness value currently corresponding to the second area is a second weighted brightness value; the calculation method of the second weighted brightness value is the same as the calculation method of the first weighted brightness value, and the calculation method of the first weighted brightness value includes:

[0021] Obtaining a brightness value of each pixel in each of the first sub-regions, and calculating a brightness average of each of the first sub-regions;

[0022] Calculating a weighted average of the brightness mean values ​​based on the weights of the first sub-regions, and using the weighted average as the first weighted brightness value;

[0023] The current brightness value corresponding to the background area is the background brightness value; the calculation method of the background brightness value includes:

[0024] The brightness value of each pixel in the background area is obtained, and the brightness average of the background area is calculated, so as to use the brightness average as the background brightness value.

[0025] In one embodiment of the present application, the weight of each of the first sub-regions and the weight of each of the second sub-regions are both weights corresponding to each of the facial regions; and a method for obtaining the weight corresponding to each of the facial regions includes:

[0026] Obtaining the width and height of each face frame range to calculate the area of ​​each face frame range;

[0027] Based on a preset Gaussian weight calculation formula and in combination with the area of ​​each face frame range, a weight corresponding to each face region is obtained.

[0028] In one embodiment of the present application, the target brightness value corresponding to the first area is a first target brightness value, and the absolute value of the difference between the first target brightness value and the first weighted brightness value is a first brightness difference; the target brightness value corresponding to the second area is a second target brightness value, and the absolute value of the difference between the second target brightness value and the second weighted brightness value is a second brightness difference; the target brightness value corresponding to the background area is a background target brightness value, and the absolute value of the difference between the background target brightness value and the background brightness value is a background brightness difference; the lighting adjustment strategy includes:

[0029] When the first brightness difference does not meet the brightness requirement, if the first brightness difference is greater than the first step saturation threshold, adjusting the brightness of the first lamp group based on a preset first aggressive step size; otherwise, calculating a first conservative step size based on a preset first minimum step size and in combination with the first brightness difference, and adjusting the brightness of the first lamp group based on the first conservative step size;

[0030] When the second brightness difference does not meet the brightness requirement, if the second brightness difference is greater than a second step size saturation threshold, adjusting the brightness of the second lamp group based on a preset second aggressive step size; otherwise, calculating a second conservative step size based on a preset second minimum step size and in combination with the second brightness difference, and adjusting the brightness of the second lamp group based on the second conservative step size;

[0031] When the background brightness difference does not meet the brightness requirement, if the background brightness difference is greater than the background step saturation threshold, the light brightness of the background light group is adjusted based on the preset background aggressive step; otherwise, based on the preset background minimum step and combined with the background brightness difference, the background conservative step is calculated, and the light brightness of the background light group is adjusted based on the background conservative step.

[0032] In a second aspect, the present application provides a live broadcast lighting control system, comprising an image acquisition module, a brightness analysis module, and a lighting adjustment module;

[0033] The image acquisition module is used to acquire the current live image;

[0034] The brightness analysis module is used to divide the live image into adjustment areas and calculate and obtain the current brightness value of each adjustment area;

[0035] The light adjustment module is connected to each light group and is used to calculate the brightness difference corresponding to each adjustment area based on the target brightness value corresponding to each adjustment area and the current brightness value of each adjustment area. If each brightness difference meets the preset brightness requirement, the light adjustment is stopped; otherwise, the light intensity of the corresponding light group is adjusted based on the preset light adjustment strategy, and the light adjustment process is re-executed;

[0036] Among them, each of the adjustment areas includes a first area and a second area; the brightness analysis module includes a face recognition sub-module; the face recognition sub-module is used to perform face recognition on the live image, obtain at least one face area, and divide each face area into a first sub-area and a second sub-area; wherein, the first area is a collection of each of the first sub-areas, and the second area is a collection of each of the second sub-areas.

[0037] In one embodiment of the present application, each of the adjustment areas further includes a background area, and the face recognition submodule includes a face detection unit, an image segmentation unit, and an extraction unit;

[0038] The face detection unit is configured to perform face detection on the live image to obtain at least one face frame range;

[0039] The image segmentation unit is used to perform image segmentation on each face frame range to obtain corresponding foreground images;

[0040] The extraction unit is used to extract all corresponding pixels of any foreground image to form the corresponding face area; after traversing each foreground image, extract all remaining pixels of the live image to form the corresponding background area.

[0041] In a third aspect, the present application provides a terminal, comprising: a processor and a memory, wherein the memory is communicatively connected to the processor;

[0042] The memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the terminal executes the live broadcast lighting control method as described above.

[0043] As described above, the present application provides a live broadcast lighting control method, system and terminal, which extracts the current brightness of each adjustment area in the live broadcast image, and compares the current brightness with the corresponding preset brightness to obtain the brightness difference between the two. Based on the brightness difference, the light intensity of the corresponding light group is adjusted accordingly according to the preset lighting adjustment strategy, so that each area finally meets the preset brightness requirements, and thus meets the lighting requirements required for live broadcast. It not only achieves good lighting effects, but also is easy to operate, convenient and fast, without the need for manual adjustment by staff, saving a lot of time and cost, and has high industrial application value. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 Shown is a schematic diagram of a live broadcast scene for performing lighting adjustment as described in this application.

[0045] Figure 2 Shown is a flow chart of a live broadcast lighting control method described in an embodiment of the present application.

[0046] Figure 3 Shown is a schematic diagram of a first sub-region and a second sub-region in a face region according to an embodiment of the present application.

[0047] Figure 4 Shown is a flow chart of a method for acquiring the first sub-region and the second sub-region according to an embodiment of the present application.

[0048] Figure 5 Shown is another schematic diagram of a live broadcast scene for performing lighting adjustment as described in this application.

[0049] Figure 6 Shown is a flowchart of a method for obtaining background areas and face areas according to an embodiment of the present application.

[0050] Figure 7 Shown is a schematic diagram of the extraction and recognition results of the face area and background area described in an embodiment of the present application.

[0051] Figure 8 Shown is a flowchart of a first weighted brightness value acquisition method described in an embodiment of the present application.

[0052] Figure 9 Shown is a flow chart of a method for obtaining weights corresponding to each facial region according to an embodiment of the present application.

[0053] Figure 10 Shown is a schematic diagram of a process for adjusting lighting effects based on a preset lighting adjustment strategy according to an embodiment of the present application.

[0054] Figure 11 Shown is a schematic diagram of the live screen effect before and after adjustment based on the live lighting control method described in this application.

[0055] Figure 12 Shown is a structural schematic diagram of a live broadcast lighting control system described in an embodiment of the present application.

[0056] Figure 13 Shown is a structural schematic diagram of a face recognition submodule described in an embodiment of the present application.

[0057] Figure 14 Shown is a structural schematic diagram of a terminal described in an embodiment of the present application.

[0058] Description of Reference Numerals

[0059] 11: First light group; 12: Second light group; 13: Background light group; 51: Image acquisition module; 52: Brightness analysis module; 521: Face recognition submodule; 5211: Face detection unit; 5212: Image segmentation unit; 5213: Extraction unit; 53: Light adjustment module; 60: Terminal; 61: Processor; 62: Memory; 621: Operating system; 622: Application; 63: User interface; 64: Network interface; 65: Bus system. DETAILED DESCRIPTION

[0060] The following describes the embodiments of the present application through specific examples. Those skilled in the art can easily understand other advantages and effects of the present application from the content disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments. The details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other unless they conflict.

[0061] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present application. Therefore, the illustrations only show components related to the present application and are not drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component can be changed at will, and the component layout type may also be more complicated.

[0062] The control of live broadcast lighting has a great impact on the live broadcast effect. In the existing technology, staff often manually adjust the lighting to achieve the desired effect. This is not only complicated and tedious, but also time-consuming. It is also greatly affected by the experience of the staff, resulting in the final lighting effect may not reach the optimal state, thereby affecting the live broadcast effect.

[0063] In response to the technical problems existing in the prior art, the following embodiments of the present application provide a live broadcast lighting control method, system and terminal, which divides the live broadcast image into various adjustment areas and calculates and obtains the current brightness value of each adjustment area, and performs brightness modulation based on the difference between the current brightness value and the corresponding preset brightness, so that each area ultimately meets the preset brightness requirements, thereby forming a preset light and dark effect in each adjustment area to achieve a good lighting effect.

[0064] The following embodiments of the present application provide a live broadcast lighting control method, system and terminal, including but not limited to the lighting effect adjustment applied to multi-person or single-person live broadcasts. The following description will take the lighting effect adjustment when at least one person is live broadcasting as an example.

[0065] In a live broadcast scene, multiple lights are usually set in different directions. This is generally applicable to the lighting scheme of a live broadcast room. Light groups can be set on both sides of the live broadcast personnel to form main light and auxiliary light to create the desired live broadcast effect. In order to facilitate those skilled in the art to understand the lighting control scenario described in this application, for example, Figure 1 As shown, it includes a first light group 11 and a second light group 12. The first light group 11 is used to provide light to the live broadcast personnel on the first side; the second light group 12 is used to provide light to the live broadcast personnel on the second side; the first light group 11 and the second light group 12 provide light in different directions for the live broadcast personnel to form the required live broadcast scene with light and dark changes, thereby achieving a better live broadcast effect. Exemplarily, the first side is the left side, that is, the first light group 11 is located on the left side of the live broadcast personnel, and the second side is the right side, that is, the second light group 12 is located on the right side of the live broadcast personnel. Furthermore, the first light group 11 and the second light group 12 each include at least one light source, and the brightness is adjustable.

[0066] Based on this, in order to adjust the live broadcast lighting conveniently and efficiently and achieve good lighting effects, this embodiment provides a live broadcast lighting control method to control the lighting to achieve a preset effect.

[0067] The technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings in the embodiments of the present application.

[0068] like Figure 2 As shown, this embodiment provides a live broadcast lighting control method for adjusting the brightness of each light group in a live broadcast scene, thereby adjusting the overall lighting effect of the live broadcast scene. The live broadcast lighting control method is a cyclic lighting control process, which obtains the lighting effect after each adjustment, determines whether it meets the lighting requirements for the live broadcast, and adjusts the lighting based on the current lighting effect if it does not meet the lighting requirements, thereby ultimately achieving the preset lighting effect.

[0069] Specifically, when a lighting control process is executed once, it includes:

[0070] S100, collecting the current live image.

[0071] Among them, the current live broadcast image is the live broadcast image of the live broadcast room currently collected for the first time, or is the live broadcast image re-acquired after the previous lighting control process is completed, so as to obtain the current live broadcast lighting situation through the current live broadcast image.

[0072] Exemplarily, the current live image can be collected by a live camera, a live camera, etc.

[0073] S200: Divide the live image into adjustment areas, and calculate and obtain the current brightness value of each adjustment area.

[0074] Among them, each adjustment area is divided based on a preset division strategy, and the light corresponding to each adjustment area is adjusted to the required brightness to form light and dark changes in the live broadcast picture.

[0075] Exemplarily, each adjustment region includes regions divided based on human faces. During a live broadcast, the live broadcaster is responsible for the main content of the broadcast, and their faces are generally considered the main focus of the live broadcast. Based on this, the facial regions of each live broadcaster are extracted for subsequent brightness adjustment. Specifically, all faces are extracted using facial recognition technology as facial regions, and then divided into adjustment regions based on a preset division strategy.

[0076] It should be noted that to achieve a better live broadcast effect, the brightness of the live broadcaster's face is not evenly distributed. Usually, a certain degree of light and dark variation is required to ensure a better live broadcast atmosphere. Based on this, each face area is divided so that each area meets the preset brightness requirements, thus creating the light and dark variation required for live broadcast, thereby improving the live broadcast effect.

[0077] Based on this, in some optional embodiments, each adjustment area includes a first area and a second area. The first area is a collection of first sub-areas in the live image, and the second area is a collection of second sub-areas in the live image. The first sub-area and the second sub-area correspond one-to-one and are two sub-areas divided based on the same face area in the live image. Each face area is an area formed by a single face, that is, any face area in the live image is divided into the first sub-area and the second sub-area to form the first area and the second area.

[0078] The first sub-region is a sub-region of the face region on a first side, and the second sub-region is a sub-region of the face region on a second side.

[0079] Generally speaking, the light and dark changes during live broadcast are usually from left to right. Based on this, the face area is divided into two sub-areas on the left and right, as the first sub-area and the second sub-area, and the light and dark changes are formed from the first sub-area to the second sub-area. Furthermore, the first sub-area and the second sub-area corresponding to the same face area are two parts of equal area. For example, Figure 3 As shown, the face area is divided into two sub-areas, the left half of the face and the right half of the face, as the first sub-area and the second sub-area, wherein the left half of the face is the first sub-area and the right half of the face is the second sub-area.

[0080] In some optional embodiments, such as Figure 4 As shown, for any face region, the method for obtaining the first sub-region and the second sub-region includes:

[0081] S211, obtaining the total number of pixels in the face area, and calculating the corresponding half value of the total number of pixels.

[0082] The half value of the total number of pixels is half of the total number of pixels in the face area.

[0083] S212: Calculate and obtain the number of half-width columns based on the half-value of the total number of pixels, so as to use each of the consecutive half-width columns on the first side of the face area as the first sub-area and the remaining columns as the second sub-area, or use each of the consecutive half-width columns on the second side of the face area as the second sub-area and the remaining columns as the first sub-area.

[0084] Among them, the total number of pixels corresponding to each column of the continuous half-width columns on the first side or the second side of the face area is a minimum value that is not less than half the value of the total number of pixels. That is, the total number of pixels accumulated in each column starting from the first column on the first side or the second side of the face area is calculated, and the minimum value of the number of columns when the total number of pixels exceeds half the value of the total number of pixels is used as the half-width column number.

[0085] Specifically, taking the first side of the face area as an example, the total number of pixels in the first column of the face area on the first side is obtained. If it exceeds half the value of the total number of pixels, the number of half-width columns is 1. Otherwise, 1 column of pixels is added, that is, the sum of the number of pixels in the first column and the second column of the face area on the first side is obtained as the total number of pixels. If it exceeds half the value of the total number of pixels, the number of half-width columns is 2. Otherwise, 1 column of pixels is added, that is, the sum of the number of pixels in the first to third columns of the face area on the first side is obtained as the total number of pixels. If it exceeds half the value of the total number of pixels, the number of half-width columns is 3. And so on, to obtain the number of half-width columns.

[0086] The columns of the consecutive half-width columns on the first side of the face area are used as the first sub-area. That is, if the number of half-width columns is n, the columns from the first column to the nth column on the first side of the face area are used as the first sub-area, and the remaining columns are used as the second sub-area. That is, the columns from the n+1th column to the last column on the first side of the face area are used as the second sub-area.

[0087] Based on this, each face area can be divided quickly and conveniently to extract each adjustment area, and then the lighting can be adjusted based on these areas to make the live broadcast picture achieve the desired light and dark change effect.

[0088] Of course, the number of half-frame columns can also be calculated based on the half-value of the total number of pixels, starting from the first column on the second side of each face region, to define each consecutive half-frame column on the second side of the face region as the second sub-region, and the remaining columns as the first sub-region. The total number of pixels corresponding to each consecutive half-frame column on the second side of the face region is the minimum value that is not less than the half-value of the total number of pixels. For details, please refer to the aforementioned division method, which will not be detailed in this embodiment.

[0089] Based on this, a first area is formed based on each set of first sub-areas, and a second area is formed based on each set of second sub-areas. By obtaining the current brightness values ​​of the first area and the second area, it is tested whether they meet the preset brightness requirements and corresponding lighting adjustments are made.

[0090] In some optional embodiments, such as Figure 5 As shown, in order to adjust the background in the live broadcast picture, a background light group 13 can also be set in the live broadcast scene. The background light group 13 is located behind the live broadcast personnel and is used to provide live broadcast background lighting to further adjust the lighting conditions in the live broadcast picture, thereby achieving better live broadcast effects.

[0091] Based on this, each adjustment area also includes a background area, wherein the background area is the remaining area in the live image except for each face area.

[0092] For example, this embodiment uses a face detection model trained based on a pre-trained neural network model framework to detect the faces of each live broadcaster, thereby forming each face region, and uses the remaining area in the live broadcast image as the background region. Pre-trained neural network models include, but are not limited to, YOLO series neural network models, MTCNN neural network models, and SSD series neural network models.

[0093] It should be noted that the face detection model detects an area including the face. Since the area is usually square, the face area obtained by the face detection module alone will contain part of the background content, affecting the accuracy of the subsequent brightness calculation of the background area and each face area. Based on this, in some optional implementations, such as Figure 6 As shown, the method of obtaining the background area and each face area includes:

[0094] S221: Perform face detection on the live broadcast image to obtain at least one face frame range.

[0095] Specifically, a face detection model trained based on a neural network model framework is used to detect the faces of each live broadcaster, and the square ranges obtained by the detection are used as the face frame range. For example, the neural network model is the Yolov8 neural network model, which is a general target detection model used to locate the position of faces in live broadcast images and extract facial features.

[0096] S222: Perform image segmentation on each face frame range to obtain corresponding foreground images.

[0097] Each foreground image is used to represent a face image without background content. By obtaining the foreground image through image segmentation, the background extracted along with the face by the face detection model is eliminated, enhancing the accuracy of face recognition and, in turn, improving the accuracy of the background and face region segmentation.

[0098] For example, this embodiment uses a pre-trained neural network model to segment each face frame to obtain corresponding foreground images. Pre-trained neural network models include but are not limited to PSPNet neural network models, BiSeNet neural network models, ICNet neural network models, and UNet neural network models.

[0099] Optionally, this embodiment uses a UNET neural network model to perform image segmentation to obtain each foreground image. The UNET neural network model is a convolutional neural network with an encoder-decoder structure. It achieves high-precision pixel-level segmentation through jump connections and fusion of shallow details and deep semantic information.

[0100] It should be noted that the foreground images output by the unet neural network model after segmentation are ARGB images, in which the non-face content within the range of each face frame, that is, the part belonging to the background area, has a transparency set to 1.

[0101] S223, for any foreground image, extract all corresponding pixels to form a corresponding face area; after traversing each foreground image, extract all remaining pixels of the live image to form a corresponding background area.

[0102] Specifically, all pixels covered by each foreground image are used as pixels of each face area, and all pixels not covered in the live image are used as pixels of the background area.

[0103] In one specific embodiment, for each foreground image, all corresponding pixels are extracted as follows: for the current foreground image, all pixels with a transparency no greater than a preset transparency threshold are extracted as all pixels within the corresponding face region. For example, the transparency threshold is 0.2.

[0104] In a specific embodiment, the method for extracting all pixels of the background area is: extracting pixels in the live image that do not overlap with each face area as pixel points of the background area, wherein the coordinates of the pixel points are used to determine whether they overlap with the face area. If the coordinates of the pixel point do not overlap with the coordinates of any pixel in each face area, then the pixel point does not overlap with each face area.

[0105] Based on this, the extracted background area actually includes all areas in the live image except the face areas.

[0106] Based on this, the pixels belonging to the background area within each face frame are excluded through image segmentation, so as to ensure that each face area does not contain pixels belonging to the background area, so as to improve the accuracy of subsequent brightness adjustment. For example, see Figure 7 , wherein the left side is the background area extracted based on live image recognition, and the right side is the face area extracted based on live image recognition. Furthermore, each extracted face area is divided into a first sub-area and a second sub-area, so as to form a first area and a second area respectively. Based on the divided background area, the first area and the second area, the corresponding brightness value is calculated to test whether it meets the preset brightness requirement, and the corresponding lighting adjustment is performed. Among them, the specific implementation method of dividing the first sub-area and the second sub-area and forming the first area and the second area can be found in the above content and will not be elaborated here.

[0107] The current brightness value corresponding to the first area is the first weighted brightness value, and the current brightness value corresponding to the second area is the second weighted brightness value. Specifically, since each face area has a different degree of influence on the live broadcast effect, the first weighted brightness value is obtained by weighted calculation based on the average brightness value of each first sub-area, and the second weighted brightness value is obtained by weighted calculation based on the average brightness value of each second sub-area.

[0108] Exemplarily, the calculation method of the second weighted brightness value is the same as the calculation method of the first weighted brightness value. Taking the first weighted brightness value as an example, the specific calculation method of the weighted brightness value is described below. Specifically, Figure 8As shown, the calculation method of the first weighted brightness value includes:

[0109] S231 , obtaining the brightness value of each pixel in each first sub-region, and calculating the average brightness value of each first sub-region.

[0110] Specifically, the live image is converted into a grayscale image, and the brightness value of each pixel is the grayscale value of each pixel.

[0111] The brightness mean of each first sub-region is the average brightness value of all pixels covered by it. For example, the calculation formula of the brightness mean of each first sub-region is:

[0112]

[0113] in, For the The average brightness value corresponding to the first sub-region, In the first sub-area The brightness value of each pixel, For the The total number of pixels in the first sub-area.

[0114] S232: Calculate a weighted average of the brightness mean values ​​based on the weights of the first sub-regions, and use the weighted average as a first weighted brightness value.

[0115] Specifically, the first weighted brightness value is calculated as follows:

[0116]

[0117] in, is the first weighted brightness value, For the The weight corresponding to the first sub-region, For the The average brightness of the first sub-region, is the number of the first sub-areas in the live image.

[0118] It should be noted that when there are multiple live broadcasters in a live broadcast, the main live broadcaster is usually closer to the live broadcast camera. That is, in the live broadcast image, the closer the face is to the live broadcast camera, the greater the impact on the live broadcast effect. Since the face frame corresponding to the face close to the live broadcast camera will be larger, based on this, in order to achieve a better live broadcast effect, the weight of the lighting adjustment increases with the area of ​​each face frame range, thereby enhancing the influence of the face closer to the live broadcast camera on the lighting adjustment result. That is, the weight of each face area is determined based on the area of ​​each face frame range, and the weight of each face area is used as the weight of the corresponding first sub-area.

[0119] Specifically, based on the area of ​​each face frame range, the weight of each corresponding face region is calculated and obtained as the weight of the corresponding first sub-region. Figure 9 As shown in FIG, the calculation method of the weight corresponding to each face area includes:

[0120] S2321: Obtain the width and height of each face frame range to calculate the area of ​​each face frame range.

[0121] Specifically, since each face frame is a square, the product of the width and height of each face frame is used as the area of ​​the corresponding face frame. The number of pixels occupied by each row of each face frame is used as the width of the face frame, and the number of pixels occupied by each column of each face frame is used as the height of the face frame.

[0122] S2322: Based on a preset Gaussian weight calculation formula and in combination with the area of ​​each face frame range, obtain the weight of each corresponding face region.

[0123] Specifically, based on the preset standard deviation parameters and center position parameters, the weight corresponding to each facial area is calculated through Gaussian distribution. Among them, the center position parameter is the maximum value of the area of ​​each face frame range, so as to ensure that the weight corresponding to the face area with the largest area is the largest. The standard deviation parameter is used to characterize the degree of change of the weight with the change of area, thereby changing the degree of influence of facial areas with different face frame areas on light adjustment. Those skilled in the art can set the standard deviation parameter based on actual needs, and this embodiment does not impose specific restrictions here. For example, if it is necessary to enhance the influence of facial areas with larger face frame areas on the light adjustment results, a smaller standard deviation parameter is set. If it is necessary to reduce the influence of facial areas with larger face frame areas on the light adjustment results, a larger standard deviation parameter is set.

[0124] For example, the calculation formula for the weight corresponding to each face area is:

[0125]

[0126] in, For the The weight corresponding to the individual face area, For the The area corresponding to the personal face frame range, is the center position parameter, specifically, is the maximum value of the face frame area of ​​each person, is a standard deviation parameter, which can be set by those skilled in the art based on actual needs.

[0127] In other optional implementations, the weight corresponding to each facial area can also be calculated by obtaining the number of pixels in each facial area to characterize the area of ​​each facial area, and based on the number of pixels in each facial area, combined with a preset Gaussian weight calculation formula, obtaining the weight corresponding to each facial area, wherein the specific setting of the Gaussian weight calculation formula please refer to the above content, which will not be repeated in this embodiment.

[0128] Based on this, the weight of each first sub-region is obtained based on the area of ​​each face frame range to calculate the first weighted brightness value, thereby representing the brightness of the first region under the current lighting effect.

[0129] Furthermore, a weighted average of the brightness means of each second sub-region is obtained as the second weighted brightness value, wherein the weight of each second sub-region is the same as the weight of the first sub-region of the same face region, that is, the weight of each face region is determined based on the area of ​​each face frame range, so that the weight of each face region is used as the weight of the corresponding first sub-region. For the method of obtaining the second weighted brightness value, please refer to the method of obtaining the first weighted brightness value, which will not be described in detail in this embodiment.

[0130] In some optional embodiments, the current brightness value corresponding to the background area is the background brightness value. The background brightness value is calculated by obtaining the brightness value of each pixel in the background area and calculating the average brightness value of the background area, and using the average brightness value as the background brightness value. That is, the background brightness value is the average value obtained by dividing the sum of the brightness values ​​of each pixel in the background area by the total number of pixels in the background area.

[0131] Based on this, the brightness of the first area, the second area and the background area can be obtained through the first weighted brightness value, the second weighted brightness value and the background brightness value, so as to analyze whether the current lighting effect meets the lighting requirements and make corresponding adjustments.

[0132] S300, based on the target brightness value corresponding to each adjustment area and combined with the current brightness value of each adjustment area, calculate the brightness difference corresponding to each adjustment area respectively. If each brightness difference meets the preset brightness requirement, stop lighting control; otherwise, based on the preset lighting control strategy, adjust the light intensity of the corresponding lamp group and re-execute the lighting control process.

[0133] Specifically, based on the preset first target brightness value, second target brightness value and background target brightness value, combined with the first weighted brightness value, second weighted brightness value and background brightness value, the first brightness difference, second brightness difference and background brightness difference are calculated respectively. If the first brightness difference, the second brightness difference and the background brightness difference all meet the preset brightness requirements, the lighting control is stopped; otherwise, based on the preset lighting control strategy, the light intensity of the corresponding light group is adjusted, and the lighting control process is re-executed.

[0134] Among them, the first target brightness value is used to represent the ideal value of the first weighted brightness value when the lighting requirements required for live broadcast are met; the second target brightness value is used to represent the ideal value of the second weighted brightness value when the lighting requirements required for live broadcast are met; the background target brightness value is used to represent the ideal value of the background brightness value when the lighting requirements required for live broadcast are met.

[0135] The first brightness difference is the absolute value of the difference between the first target brightness value and the first weighted brightness value, the second brightness difference is the absolute value of the difference between the second target brightness value and the second weighted brightness value, and the background brightness difference is the absolute value of the difference between the background target brightness value and the background brightness value.

[0136] The brightness requirement is: each brightness difference does not exceed the preset brightness difference threshold. Specifically, the first brightness difference does not exceed the preset first brightness difference threshold, the second brightness difference does not exceed the preset second brightness difference threshold, and the background brightness difference does not exceed the preset background brightness difference threshold. Among them, the first brightness difference threshold is the maximum value of the first brightness difference when the lighting requirements required for live broadcast are met; the second brightness difference threshold is the maximum value of the second brightness difference when the lighting requirements required for live broadcast are met, and the background brightness difference threshold is the maximum value of the background brightness difference when the lighting requirements required for live broadcast are met. Specifically, those skilled in the art can set the specific values ​​of the first brightness difference threshold, the second brightness difference threshold and the background brightness difference threshold according to actual needs, and this embodiment does not make specific restrictions here. For example, the first brightness difference threshold, the second brightness difference threshold and the background brightness difference threshold are all 0.

[0137] Based on this, when the first brightness difference, the second brightness difference and the background brightness difference all meet the brightness requirements, the current live broadcast effect meets the lighting requirements required for the live broadcast. At this time, the lighting control process is stopped and the current lighting effect is used as the lighting effect during the live broadcast.

[0138] Otherwise, when any one of the first brightness difference, the second brightness difference and the background brightness difference does not meet the brightness requirement, the light intensity of the corresponding light group is adjusted based on the preset lighting adjustment strategy to adjust the lighting effect so that it ultimately meets the required lighting requirement.

[0139] In some optional embodiments, for any adjustment area, the lighting adjustment strategy includes: when the brightness difference does not meet the brightness requirement, if the brightness difference is greater than the step saturation threshold, the light brightness of the corresponding lamp group is adjusted based on the preset aggressive step size; otherwise, based on the preset minimum step size and combined with the brightness difference, a conservative step size is calculated, and the light brightness of the corresponding lamp group is adjusted based on the conservative step size.

[0140] Specifically, if Figure 10 As shown, the implementation method of adjusting the lighting effect based on the preset lighting adjustment strategy includes:

[0141] S301, when the first brightness difference does not meet the brightness requirement, if the first brightness difference is greater than the first step saturation threshold, the light brightness of the first lamp group 11 is adjusted based on the preset first aggressive step size; otherwise, based on the preset first minimum step size, combined with the first brightness difference, the first conservative step size is calculated, and the light brightness of the first lamp group 11 is adjusted based on the first conservative step size.

[0142] The first radical step length and the first conservative step length are both used to characterize the degree of light intensity adjustment of the first lamp group 11, and the first radical step length is greater than the first conservative step length.

[0143] Exemplarily, the brightness range of the first lamp group 11 is obtained, and the brightness is represented by a value between [0, 100], where 0 is used to represent the minimum brightness of the first lamp group 11, that is, the light intensity is 0, and 100 is used to represent the maximum brightness of the first lamp group 11. The brightness of the light of the first lamp group 11 is adjusted based on the first aggressive step size or the first conservative step size, that is, based on the current brightness of the light of the first lamp group 11, the brightness of the first lamp group 11 is changed by the first aggressive step size or the first conservative step size. For example, if the first aggressive step size is 15 and the current brightness of the light of the first lamp group 11 is 1, and the current light adjustment needs to increase the brightness of the first lamp group 11, then the brightness of the first lamp group 11 after adjustment is 16.

[0144] It should be noted that the first aggressive step size and the first conservative step size are only used to characterize the degree of light change. The increase or decrease in light intensity should be determined based on the numerical relationship between the first target brightness value and the first weighted brightness value. Specifically, when the first target brightness value is greater than the first weighted brightness value, the light intensity of the first lamp group 11 is enhanced; when the first target brightness value is less than the first weighted brightness value, the light intensity of the first lamp group 11 is reduced.

[0145] Furthermore, the light intensity of the first light group 11 located on the first side of the live broadcast personnel is changed to change the brightness of the first area. When the first brightness difference is greater than the first step saturation threshold, the current lighting effect is significantly different from the lighting requirements for the live broadcast. The first aggressive step length is used as the light intensity change of the first light group 11 to significantly change the lighting effect and improve the efficiency of lighting adjustment. When the first brightness difference is less than or equal to the first step saturation threshold, the current lighting effect is slightly different from the lighting requirements for the live broadcast. The first conservative step length is used as the light intensity change of the first light group 11 to slightly change the lighting effect to improve the accuracy of lighting adjustment and achieve a better lighting adjustment effect. Among them, the first step saturation threshold is used to divide the degree of difference between the current lighting effect and the lighting requirements for the live broadcast. Those skilled in the art can set the specific value of the first step saturation threshold according to actual needs. This embodiment does not impose any specific restrictions here. For example, the first step saturation threshold is 50.

[0146] Furthermore, when the first brightness difference is less than or equal to the first step saturation threshold, in order to ensure the accuracy of lighting adjustment while improving the efficiency of lighting adjustment, a first conservative step size is calculated based on the first minimum step size and combined with the first brightness difference. The first minimum step size is used to represent the minimum value of the light intensity adjustment of the first light group 11. Specifically, although lighting adjustment is performed only using the first minimum step size, the lighting adjustment has high accuracy but low efficiency. Based on this, the first brightness difference is used to obtain the degree of difference between the current lighting effect and the lighting requirements for live broadcasting. In combination with the first minimum step size, the light intensity change of the current lighting adjustment is obtained, i.e., the first conservative step size, thereby ensuring the accuracy of lighting adjustment while achieving high adjustment efficiency.

[0147] To facilitate understanding by those skilled in the art, the following example provides an expression for adjusting the first lamp group 11 based on the lighting adjustment strategy:

[0148]

[0149] in, is the change in brightness of the first lamp group 11, is the first minimum step size, exemplarily, ; For the first radical growth, illustratively, ; is the sensitivity coefficient, exemplarily, ; is the acceleration factor, illustratively, ; is the first step saturation threshold, exemplarily, .

[0150] Based on this, when the first brightness difference does not meet the brightness requirement, if the first brightness difference is greater than 50, the brightness of the first lamp group 11 is increased or decreased by 15. Specifically, based on the numerical relationship between the first target brightness value and the first weighted brightness value, it is determined whether the brightness of the first lamp group 11 is increased or decreased; if the first brightness difference is less than or equal to 50, based on The change value of the brightness of the first lamp group 11 is calculated, and based on the numerical relationship between the first target brightness value and the first weighted brightness value, it is determined whether the brightness of the first lamp group 11 increases or decreases.

[0151] S302, when the second brightness difference does not meet the brightness requirement, if the second brightness difference is greater than the second step saturation threshold, the light brightness of the second lamp group 12 is adjusted based on the preset second aggressive step; otherwise, based on the preset second minimum step, combined with the second brightness difference, the second conservative step is calculated, and the light brightness of the second lamp group 12 is adjusted based on the second conservative step.

[0152] The second radical step length and the second conservative step length are both used to characterize the degree of light intensity adjustment of the second lamp group 12, and the second radical step length is greater than the second conservative step length.

[0153] The light intensity of the second light group 12 located on the second side of the live broadcast personnel is changed to change the brightness of the second area. When the second brightness difference is greater than the second step saturation threshold, the current lighting effect is significantly different from the lighting requirements for live broadcast. The second radical step is used as the light intensity change amount of the second light group 12 to significantly change the lighting effect and improve the efficiency of lighting adjustment. When the second brightness difference is less than or equal to the second step saturation threshold, the current lighting effect is slightly different from the lighting requirements for live broadcast. The second conservative step is used as the light intensity change amount of the second light group 12 to slightly change the lighting effect to improve the accuracy of lighting adjustment and achieve a better lighting adjustment effect. Specifically, please refer to the aforementioned implementation method of adjusting the first light group 11 based on the lighting adjustment strategy. This embodiment will not be described in detail here.

[0154] S303, when the background brightness difference does not meet the brightness requirement, if the background brightness difference is greater than the background step saturation threshold, the light brightness of the background light group 13 is adjusted based on the preset background excitation step; otherwise, based on the preset background minimum step, combined with the background brightness difference, the background conservative step is calculated, and the light brightness of the background light group 13 is adjusted based on the background conservative step.

[0155] The background radical step length and the background conservative step length are both used to characterize the degree of light intensity adjustment of the background light group 13, and the background radical step length is greater than the background conservative step length.

[0156] Change the light intensity of the background light group 13 located in the background of the live broadcast personnel to change the brightness of the background area. When the background brightness difference is greater than the background step saturation threshold, the current lighting effect is quite different from the lighting requirements required for the live broadcast. The background radical step is used as the light intensity change of the background light group 13 to change the lighting effect to a greater extent and improve the efficiency of lighting adjustment. When the background brightness difference is less than or equal to the background step saturation threshold, the current lighting effect is relatively different from the lighting requirements required for the live broadcast. The background conservative step is used as the light intensity change of the background light group 13 to change the lighting effect to a lesser extent to improve the accuracy of lighting adjustment and achieve a better lighting adjustment effect. Specifically, please refer to the aforementioned implementation method of adjusting the first light group 11 based on the lighting adjustment strategy. This embodiment will not be described in detail here.

[0157] Based on this, the lighting adjustment strategy is used to adjust each light group in the live broadcast scene to change the lighting effect of the live broadcast scene, and live broadcast images are captured based on the adjusted live broadcast scene. Steps S100-S300 are repeated to test whether the adjusted live broadcast scene meets the required lighting requirements, so as to finally achieve a good lighting effect. The operation is simple and has high efficiency. For example, see Figure 11 , the left side is the live broadcast picture before the lighting adjustment, and the right side is the live broadcast picture after adjustment based on the above-mentioned live broadcast lighting control method. Based on this, through the above-mentioned live broadcast lighting control method, this application divides the first area and the second area, and adjusts them separately, so that the live broadcast picture forms a preset light and dark change, thereby achieving a better lighting adjustment effect. Furthermore, this application also divides the background area, distinguishes the background from the face of the live broadcast personnel in the live broadcast image, and cooperates with the lighting adjustment strategy to adjust the lighting of the face area and the lighting of the background area separately, realizing independent and intelligent control of the host's face and background lighting, taking into account the beauty of the face area and the improvement of the atmosphere of the background area, and obtaining a better live broadcast lighting effect.

[0158] like Figure 12 As shown, a live broadcast lighting control system provided by this embodiment includes an image acquisition module 51 , a brightness analysis module 52 and a lighting adjustment module 53 .

[0159] The image acquisition module 51 is used to acquire the current live image.

[0160] The brightness analysis module 52 is used to divide the live image into various adjustment areas and calculate and obtain the current brightness value of each adjustment area.

[0161] The lighting adjustment module 53 is connected to each lamp group and is used to calculate the first brightness difference, the second brightness difference and the background brightness difference based on the preset first target brightness value, the second target brightness value and the background target brightness value, combined with the first weighted brightness value, the second weighted brightness value and the background brightness value. If the first brightness difference, the second brightness difference and the background brightness difference all meet the preset brightness requirements, the lighting adjustment is stopped; otherwise, based on the preset lighting adjustment strategy, the light intensity of the corresponding lamp group is adjusted and the lighting adjustment process is re-executed.

[0162] It should be noted that each adjustment area includes a first area and a second area; the brightness analysis module 52 includes a face recognition submodule 521; the face recognition submodule 521 is used to perform face recognition on the live image, obtain at least one face area, and divide each face area into a first sub-area and a second sub-area; wherein the first area is a collection of each first sub-area, and the second area is a collection of each second sub-area. Adjust the brightness of the first area and the second area respectively to meet the preset lighting requirements. Specifically, the lighting adjustment module 53 is connected to the first light group 11 and the second light group 12 respectively, wherein the first light group 11 is used to control the brightness of the first area, and the second light group 12 is used to control the brightness of the second area. Based on the lighting adjustment strategy, the lighting adjustment module 53 controls the brightness changes of each light group respectively to change the brightness of the first area and the second area.

[0163] In some optional embodiments, the live broadcast scene also includes a background light group 13 for adjusting the lighting of the live broadcast background. Based on this, each adjustment area also includes a background area. The lighting adjustment module 53 is connected to the background light group 13 and controls the brightness change of the background light group based on the lighting adjustment strategy to change the brightness of the background area.

[0164] Furthermore, in order to divide the areas in the live broadcast screen, Figure 13 As shown, the face recognition submodule 521 includes a face detection unit 5211 , an image segmentation unit 5212 and an extraction unit 5213 .

[0165] The face detection unit 5211 is used to perform face detection on the live image and obtain at least one face frame range.

[0166] The image segmentation unit 5212 is used to perform image segmentation on each face frame range to obtain corresponding foreground images.

[0167] The extraction unit 5213 is used to extract all corresponding pixels of any foreground image to form a corresponding face area; after traversing each foreground image, it extracts all remaining pixels of the live image to form a corresponding background area.

[0168] The foreground image is obtained based on the image segmentation unit 5212, thereby excluding the background extracted by the face detection unit 5211 at the same time as the face, so as to enhance the accuracy of face recognition and further improve the accuracy of the division of the background area and each face area.

[0169] Based on the same technical concept, the live broadcast lighting control method provided by the embodiment of the present invention can be implemented on the terminal side or the server side.

[0170] like Figure 14 FIG. 6 shows an optional hardware structure diagram of a terminal provided in an embodiment of the present invention. The terminal 60 can be an intelligent live broadcast all-in-one device, a computer device, a tablet device, a smart phone, a personal digital processing device, a factory backend processing device, etc. The terminal 60 includes: at least one processor 61, a memory 62, at least one network interface 64, and a user interface 63. The various components in the device are coupled together via a bus system 65. It will be understood that the bus system 65 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 65 also includes a power bus, a control bus, and a status signal bus.

[0171] The user interface 63 may include control buttons for each light group, a camera interface, a display, a keyboard, a mouse, a microphone, a pickup, a trackball, a click gun, keys, buttons, a touchpad, or a touch screen, etc. The operator can set parameters and preset first target brightness, second target brightness, and background target brightness through the user interface 63, and finely optimize the lighting as needed without manual intervention. This greatly reduces the complexity of professional lighting adjustment in the live broadcast room, saves time and cost for lighting debugging for live broadcasts, and greatly improves the efficiency and accuracy of lighting control. It can achieve intelligent adjustment of live broadcast lighting with one click, making the light transition on the face of the live broadcaster in the live broadcast picture softer and more natural, the image quality effect more delicate and beautiful, and enhancing the atmosphere of the live broadcast room.

[0172] It will be appreciated that the memory 62 may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM) or a programmable read-only memory (PROM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM) and synchronous static random access memory (SSRAM). The memory featured in the embodiments of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.

[0173] The memory 62 in the embodiment of the present invention is used to store various types of data to support the operation of the terminal. Examples of such data include: any executable program for operating on the terminal 60, such as an operating system 621 and an application 622; the operating system 621 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application 622 can include various applications, such as a media player (MediaPlayer), a browser (Browser), etc., for implementing various application services. The live broadcast lighting control method provided in the embodiment of the present invention can be included in the application 622.

[0174] The method disclosed in the above embodiment of the present invention can be applied to the processor 61 or implemented by the processor 61. The processor 61 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by the hardware integrated logic circuit in the processor 61 or by instructions in the form of software. The above processor may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The processor 61 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiment of the present invention. The processor 61 may be a microprocessor or any conventional processor, etc. The steps of the accessory optimization method provided in the embodiment of the present invention can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in a memory. The processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0175] In an exemplary embodiment, the terminal 60 may be configured to execute the aforementioned method using one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), or complex programmable logic devices (CPLDs).

[0176] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when called by a processor, implements the live broadcast lighting control method provided by the present invention.

[0177] Among them, a computer-readable storage medium can be a tangible device that can hold and store instructions used by an instruction execution device. The computer-readable storage medium can be, for example, (but not limited to) an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, and a mechanical encoding device.

[0178] The computer-readable program characterized herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing / processing device.

[0179] To sum up, this application extracts each adjustment area in the live broadcast image to obtain the brightness of each adjustment area respectively, and then adjusts the light intensity of the corresponding light group based on its brightness, so that each adjustment area forms a preset light and dark effect, so as to ultimately meet the lighting requirements required for live broadcast, improve the effect of live broadcast, and is easy to operate and is not affected by the experience of the staff.

[0180] The descriptions of the processes or structures corresponding to the above figures have different emphases. For parts that are not described in detail in a certain process or structure, please refer to the relevant descriptions of other processes or structures.

[0181] The above embodiments are merely illustrative of the principles and effects of this application and are not intended to limit this application. Anyone skilled in the art may modify or alter the above embodiments without departing from the spirit and scope of this application. Therefore, all equivalent modifications or alterations made by one of ordinary skill in the art without departing from the spirit and technical concepts disclosed in this application shall be covered by the claims of this application.

Claims

1. A live broadcast lighting control method, characterized in that: A cyclic light control process, when executed once, includes: Collect the current live image; Divide the live image into adjustment areas, and calculate and obtain the current brightness value of each adjustment area; Based on the target brightness value corresponding to each adjustment area and the current brightness value of each adjustment area, the brightness difference corresponding to each adjustment area is calculated respectively. If each brightness difference meets the preset brightness requirement, the light control is stopped; otherwise, the light intensity of the corresponding light group is adjusted based on the preset light control strategy, and the light control process is executed again; Among them, each of the adjustment areas includes a first area and a second area, and the method for obtaining the first area and the second area includes: performing face recognition on the live image, obtaining at least one face area, and dividing each face area into a first sub-area and a second sub-area; wherein, the first area is a collection of each of the first sub-areas, and the second area is a collection of each of the second sub-areas.

2. The method according to claim 1, characterized in that For any of the face regions, the first sub-region and the second sub-region are obtained by: Obtaining the total number of pixels in the face area and calculating the corresponding half value of the total number of pixels; Calculating and obtaining the number of half-frame columns based on the half-value of the total number of pixels, such that each of the consecutive half-frame columns on the first side of the face region is used as the first sub-region and the remaining columns are used as the second sub-region, or each of the consecutive half-frame columns on the second side of the face region is used as the second sub-region and the remaining columns are used as the first sub-region; The half-frame column number is the minimum value of the number of consecutive columns on the first side or the second side of the face area, for which the total number of corresponding pixels is not less than half the total number of pixels.

3. The method according to claim 1, characterized in that Each of the adjustment areas also includes a background area, and a method for obtaining the background area includes: performing face recognition on the live image to obtain each of the face areas; based on each of the face areas, using the remaining area of ​​the live image as the background area.

4. The method according to claim 3, characterized in that Methods for obtaining the face region and background region include: Performing face detection on the live broadcast image to obtain at least one face frame range; Performing image segmentation on each face frame range to obtain corresponding foreground images; For any of the foreground images, all corresponding pixels are extracted to form the corresponding face area; after traversing each of the foreground images, all remaining pixels of the live image are extracted to form the corresponding background area.

5. The method according to claim 4, characterized in that The brightness value currently corresponding to the first area is a first weighted brightness value; the brightness value currently corresponding to the second area is a second weighted brightness value; the calculation method of the second weighted brightness value is the same as the calculation method of the first weighted brightness value, and the calculation method of the first weighted brightness value includes: Obtaining a brightness value of each pixel in each of the first sub-regions, and calculating a brightness average of each of the first sub-regions; Calculating a weighted average of the brightness mean values ​​based on the weights of the first sub-regions, and using the weighted average as the first weighted brightness value; The current brightness value corresponding to the background area is the background brightness value; the calculation method of the background brightness value includes: The brightness value of each pixel in the background area is obtained, and the brightness average of the background area is calculated, so as to use the brightness average as the background brightness value.

6. The method according to claim 5, characterized in that The weight of each of the first sub-regions and the weight of each of the second sub-regions are both weights corresponding to the face regions. The weights corresponding to the face regions are obtained by: Obtaining the width and height of each face frame range to calculate the area of ​​each face frame range; Based on a preset Gaussian weight calculation formula and in combination with the area of ​​each face frame range, a weight corresponding to each face region is obtained.

7. The method according to claim 1, characterized in that For any of the adjustment areas, the lighting adjustment strategy includes: When the brightness difference does not meet the brightness requirement, if the brightness difference is greater than the step saturation threshold, the light brightness of the corresponding lamp group is adjusted based on the preset aggressive step size; otherwise, based on the preset minimum step size and combined with the brightness difference, a conservative step size is calculated, and the light brightness of the corresponding lamp group is adjusted based on the conservative step size.

8. A live broadcast lighting control system, characterized in that: Including image acquisition module, brightness analysis module and light adjustment module; The image acquisition module is used to acquire the current live image; The brightness analysis module is used to divide the live image into adjustment areas and calculate and obtain the current brightness value of each adjustment area; The light adjustment module is connected to each light group and is used to calculate the brightness difference corresponding to each adjustment area based on the target brightness value corresponding to each adjustment area and the current brightness value of each adjustment area. If each brightness difference meets the preset brightness requirement, the light adjustment is stopped; Otherwise, based on the preset light adjustment strategy, adjust the light intensity of the corresponding light group and re-execute the light adjustment process; Among them, each of the adjustment areas includes a first area and a second area; the brightness analysis module includes a face recognition sub-module; the face recognition sub-module is used to perform face recognition on the live image, obtain at least one face area, and divide each face area into a first sub-area and a second sub-area; wherein, the first area is a collection of each of the first sub-areas, and the second area is a collection of each of the second sub-areas.

9. The system according to claim 8, characterized in that Each of the adjustment areas also includes a background area, and the face recognition submodule includes a face detection unit, an image segmentation unit, and an extraction unit; The face detection unit is configured to perform face detection on the live image to obtain at least one face frame range; The image segmentation unit is used to perform image segmentation on each face frame range to obtain corresponding foreground images; The extraction unit is used to extract all corresponding pixels of any foreground image to form the corresponding face area; after traversing each foreground image, extract all remaining pixels of the live image to form the corresponding background area.

10. A terminal, characterized in that: include: a processor and a memory, wherein the memory is communicatively connected to the processor; The memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the terminal executes the live lighting control method according to any one of claims 1 to 7.

Images