A method for implementing a live streaming fill light with face tracking illumination and the fill light itself.
By using facial recognition and servo motor drive technology, the fill light can automatically follow the movement of the face and changes in ambient light, which solves the shortcomings of manual adjustment of position and angle in existing technologies and provides a stable fill light effect.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-15
- Publication Date
- 2026-03-06
AI Technical Summary
Existing fill lights require manual adjustment of position and angle during live streaming and cannot automatically follow the movement of the person, making them inconvenient to use.
A face recognition module is used to identify the position of a face. The illumination angle of the light source module is adjusted by a servo motor, and the light intensity is automatically adjusted according to changes in ambient light. The two-dimensional movement of the light source module is realized by an MCU control module and a servo motor drive module.
The system enables the light source module to automatically adjust the illumination angle and intensity to follow the movement of the face, ensuring the stability and consistency of the supplementary lighting effect and reducing the need for manual adjustment.
Smart Images

Figure CN115240251B_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of fill light technology, specifically relating to a method for implementing a live streaming fill light for face tracking illumination and the method thereof. Background Technology
[0002] Camera fill lights, also known as camera lights, head lights, news lights, etc., are primarily used to provide auxiliary lighting when shooting in low-light conditions to obtain suitable footage. Camera fill lights now offer excellent controllability, including adjusting brightness and color temperature, and displaying remaining battery power.
[0003] The booming live streaming industry has led to a rapid increase in demand for fill lights. However, current fill lights on the market have some shortcomings in use. For example, users need to manually adjust the position and angle of the fill light when moving around during a live stream. Summary of the Invention
[0004] The purpose of this invention is to provide a method for implementing a live streaming fill light with face tracking illumination, thereby solving the problems mentioned in the background art. The method for implementing a live streaming fill light with face tracking illumination provided by this invention has the characteristic of automatically adjusting the illumination angle and fill light intensity according to the movement of the person.
[0005] Another objective of this invention is to provide a supplementary light used in a method for implementing a live streaming supplementary light for face tracking illumination.
[0006] To achieve the above objectives, the present invention provides the following technical solution: A method for implementing a live streaming fill light for face tracking illumination, comprising the following steps:
[0007] (a) Manually set the supplementary light intensity β and supplementary light angle of the light source module;
[0008] (ii) The MCU control module acquires the current face image data through the face recognition module. And the ratio δ of the width w to the height h of the face, δ=w / h;
[0009] (iii) When the ambient light intensity changes, the MCU control module obtains the illuminance value △β that needs to be compensated under the corresponding supplementary light intensity β through the face recognition module, and then the MCU control module controls the light source module to adjust the brightness according to the illuminance value △β that needs to be compensated.
[0010] (iv) When the face moves, the face recognition module obtains the face image and the δ value changes. The MCU control module sends a command to the servo drive module, which drives the servo to adjust the illumination angle of the light source module so that the δ value is equal to the set value.
[0011] Furthermore, in step (ii), the width w and height h of the face are the width and height values of the bounding rectangle when the face recognition module recognizes the face.
[0012] Furthermore, in step (iii), the method for obtaining the illuminance value Δβ to be compensated includes the following steps:
[0013] (1) The MCU control module extracts face image data. Introducing sampling signal Discretized images are obtained by periodically extracting the information distribution of the image according to the characteristics of the sampling function. , The sampled signal is a unit impulse sequence function generated by the system;
[0014] (2) Obtaining the discretized image through Fourier transform Amplitude-frequency response in the frequency domain , ,in, For phase frequency characteristics, ω= ;
[0015] (3) Through simulated digital high-pass filter Obtain the discretized image The amplitude of the high-frequency components in the two-dimensional space is summed, and then the signal intensity per unit scale in that two-dimensional space is taken to obtain the ambient illuminance value λ under the supplementary light intensity β.
[0016] Where S is the area of the face image captured by the face recognition module;
[0017] (4) Introduce the illuminance compensation parameter Δλ to obtain the illuminance value Δβ that needs to be compensated. The illuminance compensation parameter Δλ is the value obtained by the user adjusting the unit Δβ change of the light source module through external buttons, corresponding to the compensation coefficient.
[0018] Furthermore, in this invention, a live streaming fill light implementation method for face tracking illumination uses a fill light comprising a power supply, the output of which is connected to a power module and a light source module, the output of which is connected to a face recognition module, an MCU control module and a servo drive module, the MCU control module and the servo drive module, the servo drive module and the servo drive module, the servo drive module and the servo drive module, the servo drive module and the servo drive module, the servo drive module and the servo drive module, and the servo drive module and the light source module.
[0019] Furthermore, the face recognition module includes a storage module, a camera driver module, and an LED indicator module.
[0020] Furthermore, the power module includes an AC-DC conversion circuit and a DC-DC conversion circuit, wherein the input terminal of the DC-DC conversion circuit is connected to the output terminal of the AC-DC conversion circuit.
[0021] Furthermore, there are two servo motors: one servo motor drives the light source module to rotate along the X-axis, and the other servo motor drives the light source module to rotate along the Y-axis.
[0022] Furthermore, the light source module includes two LED light sources. The positive terminals of both LED light sources are connected to the VCC terminal. The negative terminal of one LED light source is connected to resistor R2. The other end of resistor R2 is connected to the collector of transistor Q2. The base of transistor Q2 is connected to resistor R4. The other end of resistor R4 is connected to the PWM W pin of the MCU control module. The negative terminal of the other LED light source is connected to resistor R1. The other end of resistor R1 is connected to the collector of transistor Q1. The base of transistor Q1 is connected to resistor R3. The other end of resistor R3 is connected to the PWM C pin of the MCU control module. The emitters of both transistors Q1 and Q2 are connected to the GND terminal.
[0023] Compared with the prior art, the beneficial effects of the present invention are:
[0024] 1. This invention identifies the position of a face through a face recognition module and adjusts the illumination angle of the light source module through a servo motor, so that the light source module can follow the movement of the face and adjust the illumination angle to ensure the supplementary lighting effect;
[0025] 2. This invention obtains the ambient illuminance value and the compensation illuminance value in the image information through the face recognition module, so that the light source module can adjust the light intensity according to the change of ambient illuminance to ensure the supplementary lighting effect;
[0026] 3. The present invention has two servo motors. One servo motor is used to drive the light source module to rotate along the X-axis, and the other servo motor is used to drive the light source module to rotate along the Y-axis, so as to realize the two-dimensional motion of the light source module.
[0027] 4. Before use, users can manually set the fill light angle and fill light intensity according to their own needs. As the face moves or the ambient light changes, the fill light angle and fill light intensity automatically adjusted by the light source module can satisfy the user. Attached Figure Description
[0028] Figure 1 This is a system block diagram of the present invention;
[0029] Figure 2 This is a circuit diagram of the light source module of the present invention;
[0030] Figure 3 This is a schematic diagram illustrating the implementation principle of face tracking in this invention.
[0031] In the diagram: 1. Power supply; 2. Power module; 3. Light source module; 4. Servo motor; 5. Face recognition module; 51. Storage module; 52. Camera driver module; 53. LED indicator module; 6. Servo motor driver module; 7. MCU control module. Detailed Implementation
[0032] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0033] Example 1
[0034] Please see Figure 1-3 The present invention provides the following technical solution: a method for implementing a live streaming fill light for face tracking illumination, comprising the following steps:
[0035] (a) Manually set the supplementary light intensity β and supplementary light angle of the light source module 3;
[0036] (ii) The MCU control module 7 obtains the current face image data through the face recognition module 5. And the ratio δ of the width w to the height h of the face, δ=w / h;
[0037] (iii) When the ambient light intensity changes, the MCU control module 7 obtains the illuminance value △β that needs to be compensated under the corresponding supplementary light intensity β through the face recognition module 5, and then the MCU control module 7 controls the light source module to adjust the brightness according to the illuminance value △β that needs to be compensated.
[0038] (iv) When the face moves, the face recognition module 5 obtains the face image and the δ value changes. The MCU control module 7 sends a command to the servo drive module 6, and the servo drive module 6 drives the servo 4 to adjust the illumination angle of the light source module 3 so that the δ value is equal to the set value.
[0039] By adopting the above technical solution, the face recognition module 5 identifies the position of the face, and the servo motor 4 adjusts the illumination angle of the light source module 3, so that the light source module 3 can adjust the illumination angle according to the movement of the face to ensure the supplementary lighting effect; the face recognition module 5 obtains the ambient illuminance value and the compensation illuminance value in the image information, so that the light source module 3 can adjust the light intensity according to the change of ambient illuminance to ensure the supplementary lighting effect; before use, the supplementary lighting angle and supplementary lighting intensity can be manually set according to the user's needs, so that the supplementary lighting angle and supplementary lighting intensity automatically adjusted by the light source module when the face moves or the ambient illuminance changes can also satisfy the user.
[0040] Specifically, in step (ii), the width w and height h of the face are the width and height values of the bounding rectangle when the face recognition module 5 recognizes the face.
[0041] Specifically, in step (iii), the method for obtaining the illuminance value Δβ that needs to be compensated includes the following steps:
[0042] (1) MCU control module 7 extracts face image data Introducing sampling signal Discretized images are obtained by periodically extracting the information distribution of the image according to the characteristics of the sampling function. , The sampled signal is a unit impulse sequence function generated by the system.
[0043] (2) Obtaining the discretized image through Fourier transform Amplitude-frequency response in the frequency domain , ,in, For phase frequency characteristics, ω= ;
[0044] (3) Through simulated digital high-pass filter Obtain the discretized image The amplitude of the high-frequency components in the two-dimensional space is summed, and then the signal intensity per unit scale in that two-dimensional space is taken to obtain the ambient illuminance value λ under the supplementary light intensity β.
[0045] Where S is the area of the face image captured by the face recognition module 5;
[0046] (4) Introduce the illuminance compensation parameter Δλ to obtain the illuminance value Δβ that needs to be compensated. The illuminance compensation parameter Δλ is the value obtained by the user adjusting the unit Δβ change of the light source module through external buttons, corresponding to the compensation coefficient.
[0047] Example 2
[0048] The difference between this embodiment and embodiment 1 is that, specifically, the supplementary light used in the method for implementing a live streaming supplementary light for face tracking illumination includes a power supply 1. The power supply 1 outputs two 220V / 50KHz AC power supplies, one for power supply module 2 and the other for light source module 3. The output terminals of the power supply 1 are connected to the power supply module 2 and the light source module 3, respectively. The output terminals of the power supply module 2 are connected to the face recognition module 5, the MCU control module 7, and the servo drive module 6, respectively. The MCU control module 7 is connected to the face recognition module 5, the light source module 3, and the servo drive module 6, respectively. The servo drive module 6 is connected to the servo 4, and the servo 4 is connected to the light source module 3.
[0049] By adopting the above technical solution, the face recognition module 5 identifies the position of the face, and the servo motor 4 adjusts the illumination angle of the light source module 3, so that the light source module 3 can follow the movement of the face and adjust the illumination angle to ensure the supplementary lighting effect.
[0050] Specifically, the face recognition module 5 includes a storage module 51, a camera driver module 52, and an LED indicator module 53.
[0051] By adopting the above technical solution, the storage module 51 is used to record the supplementary lighting parameters and supplementary lighting angle set by the user, and to store the image data captured by the camera in the face recognition module; the camera driving module 52 is used to drive the camera to work, and the LED indicator module 53 is used to indicate the working status.
[0052] Specifically, power module 2 includes an AC-DC conversion circuit and a DC-DC conversion circuit, wherein the input terminal of the DC-DC conversion circuit is connected to the output terminal of the AC-DC conversion circuit.
[0053] By adopting the above technical solution, the AC-DC conversion circuit outputs three 5V DC power supplies: one to power the face recognition module 5, one to power the servo drive module 6, and one to output 3.3V via the DC-DC conversion circuit to power the MCU control module 7.
[0054] Specifically, there are two servo motors 4. One servo motor 4 is used to drive the light source module 3 to rotate along the X-axis, and the other servo motor 4 is used to drive the light source module 3 to rotate along the Y-axis.
[0055] By adopting the above technical solution, two-dimensional motion of the light source module 3 is achieved.
[0056] Specifically, the light source module 3 includes two LED light sources. The positive terminals of both LED light sources are connected to the VCC terminal. The negative terminal of one LED light source is connected to resistor R2. The other end of resistor R2 is connected to the collector of transistor Q2. The base of transistor Q2 is connected to resistor R4. The other end of resistor R4 is connected to the PWM W pin of the MCU control module. The negative terminal of the other LED light source is connected to resistor R1. The other end of resistor R1 is connected to the collector of transistor Q1. The base of transistor Q1 is connected to resistor R3. The other end of resistor R3 is connected to the PWM C pin of the MCU control module. The emitters of both transistors Q1 and Q2 are connected to the GND terminal.
[0057] By adopting the above technical solution, the MCU control module 7 can directly control the transistor to dim the light source module 3, thereby avoiding the use of a dimming module and reducing production costs.
[0058] Servo motor 4 is preferably a servo motor sold by Shuangye Precision Mold (China) Co., Ltd.; face recognition module 5 is preferably an OPENMV4 H7 model sold by Shenzhen Xingtong Technology Co., Ltd.; servo motor drive module 6 is preferably an L298N type motor drive module.
[0059] In summary, this invention identifies the position of a face using the face recognition module 5 and adjusts the illumination angle of the light source module 3 using the servo motor 4. This allows the light source module 3 to adjust its illumination angle according to the movement of the face, ensuring a good supplementary lighting effect. Furthermore, this invention obtains the ambient illuminance and compensation illuminance values from the image information using the face recognition module 5, enabling the light source module 3 to adjust its light intensity according to changes in ambient illuminance, ensuring a good supplementary lighting effect. This invention has two servo motors: one to drive the light source module to rotate along the X-axis and the other to drive it to rotate along the Y-axis, achieving two-dimensional movement of the light source module. Before use, users can manually set the supplementary lighting angle and intensity according to their needs. Therefore, the automatic adjustment of the supplementary lighting angle and intensity by the light source module when the face moves or the ambient illuminance changes will satisfy the user.
[0060] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.
Claims
1. An implementation method of a live light filling lamp for face tracking illumination, characterized in that, It comprises the following steps: (1) manually setting the light compensation light intensity β and the light compensation angle of the light source module; (ii) The MCU control module obtains the current face image data through the face recognition module and the ratio δ of the width w and the height h of the face, δ = w / h; (3) when the ambient light intensity changes, the MCU control module obtains the compensation illumination value △β required under the corresponding light compensation light intensity β through the face recognition module, and then the MCU control module controls the light source module to adjust the brightness according to the compensation illumination value △β required; (4) when the face moves, the face recognition module obtains the change of the δ value of the face image, sends an instruction to the servo drive module through the MCU control module, and the servo drive module drives the servo to adjust the irradiation angle of the light source module, so that the δ value is equal to the set value. In step (3), the compensation illumination value △β is obtained by the following steps: (1) MCU control module extracts face image data , introduces a sampling signal , periodically extracts the information distribution of the image according to the sampling function characteristics to obtain a discrete image , , the sampling signal is a unit impulse sequence function generated by the system; (2) Fourier transform to obtain a discrete image Amplitude-frequency characteristic in the frequency domain , wherein, is the phase-frequency characteristic, ω= ; (3) through the analog digital high-pass filter acquiring the image discrete image In the two-dimensional space, the amplitude of the high-frequency part information is taken, and then the signal intensity of the unit scale under the two-dimensional space is taken to obtain the environmental illumination value λ under the light illumination intensity β. ; wherein S is the area of the face image collected by the face recognition module; (4) Introducing the illumination compensation parameter Δλ to obtain the illumination value Δβ to be compensated, The illumination compensation parameter Δλ is a value obtained by the user adjusting the compensation coefficient corresponding to the unit Δβ change of the light source module through the external button.
2. The implementation method of the live light supplementing lamp for face tracking illumination according to claim 1, characterized in that: In step (2), the face recognition module obtains the width w and height h of the face.
3. The live light of the face tracking and lighting according to any one of claims 1-2, characterized in that, The power supply, the output end of the power supply is connected with the power module and the light source module, the output end of the power module is connected with the face recognition module, the MCU control module and the servo drive module, the MCU control module is connected with the face recognition module, the light source module and the servo drive module, the servo drive module is connected with the servo, and the servo is connected with the light source module.
4. The light compensation lamp used in the implementation method of the live light compensation lamp for face tracking according to claim 3, characterized in that: The face recognition module comprises a storage module, a camera drive module and an LED indication module.
5. The light filling lamp used in the implementation method of the live light filling lamp for face tracking illumination according to claim 3, characterized in that: The power module comprises an AC-DC conversion circuit and a DC-DC conversion circuit, wherein the input end of the DC-DC conversion circuit is connected with the output end of the AC-DC conversion circuit.
6. The light filling lamp used in the implementation method of the live light filling lamp for face tracking illumination according to claim 3, characterized in that: The servo is provided with two, one servo is used for driving the light source module to rotate along the X axis, and the other servo is used for driving the light source module to rotate along the Y axis.
7. The light filling lamp used in the implementation method of the live light filling lamp for face tracking illumination according to claim 3, characterized in that: The light source module comprises two LED light sources, the positive ends of the two LED light sources are connected with the VCC end, the negative end of one LED light source is connected with the resistor R2, the other end of the resistor R2 is connected with the collector of the transistor Q2, the base of the transistor Q2 is connected with the resistor R4, the other end of the resistor R4 is connected with the PWM W pin of the MCU control module, the negative end of the other LED light source is connected with the resistor R1, the other end of the resistor R1 is connected with the collector of the transistor Q1, the base of the transistor Q1 is connected with the resistor R3, the other end of the resistor R3 is connected with the PWM C pin of the MCU control module, and the emitters of the transistor Q1 and the transistor Q2 are connected with the GND end.
Citation Information
Patent Citations
Face recognition backlight compensation method and device, readable storage medium and equipment
CN111368596A
Intelligent illumination compensation method and device for face recognition, equipment and system
CN113780262A