Camera module and interaction device

By configuring infrared sensors and color sensors in the camera module to expose the light when the time is wrong, and controlling infrared fill light when the time is wrong, the problem of excessive peak current in the existing technology is solved, and a lower current requirement is achieved. It promotes the integration and promotion of camera modules in interactive devices.

WO2024235029A1PCT designated stage expired Publication Date: 2024-11-21TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/091139
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-15
Filing Date
2024-05-06
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

When the light of the existing camera module is dark, the white light fill light and infrared fill light are in the fill light state at the same time, resulting in a large peak current, affecting the power supply capacity and integrated promotion of interactive equipment.

Method used

By configuring infrared sensors and color sensors to expose when the time is wrong, the image processor controls infrared fill light and white fill light when the time is wrong, avoiding both of them being turned on at the same time, thereby reducing the peak current.

Benefits of technology

The peak current in the camera module is reduced, the power supply capacity requirements for interactive devices are reduced, and the possibility of integration and promotion of camera modules in interactive devices is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024091139_21112024_PF_FP_ABST
    Figure CN2024091139_21112024_PF_FP_ABST
Patent Text Reader

Abstract

A camera module and an interaction device, relating to the technical field of electronic devices. The camera module comprises an infrared sensor (1), a color sensor (2), an infrared fill light (3), an image processor (4) and a white fill light (5). The infrared sensor (1) is electrically connected to the color sensor (2), the infrared fill light (3) and the image processor (4), and the image processor (4) is further electrically connected to the white fill light (5). The infrared fill light (3) is used for supplementing light for the infrared sensor (1), the white fill light (5) is used for supplementing light for the color sensor (2), and the infrared sensor (1) and the color sensor (2) are exposed at staggered times. The image processor (4) is configured to control the infrared fill light (3) and the white fill light (5) to supplement light at staggered times.
Need to check novelty before this filing date? Find Prior Art

Description

Camera modules and interactive devices

[0001] This disclosure claims priority to Chinese patent application number 202321157190.9, filed on May 15, 2023, entitled “Camera module and interactive device,” the entire contents of which are incorporated by reference into this disclosure. Technical Field

[0002] Embodiments of the present disclosure relate to a camera module and an interactive device. Background Art

[0003] Camera modules can be used in identity recognition modules such as interactive devices to collect and identify information. When the light is low, the camera module will add fill light, allowing the camera module to capture clearer images.

[0004] Summary of the Invention

[0005] At least one embodiment of the present disclosure provides a camera module, which includes an infrared sensor, a color sensor, an infrared fill light, an image processor and a white light fill light; the infrared sensor is electrically connected to the color sensor, the infrared fill light and the image processor, and the image processor is also electrically connected to the white light fill light; the infrared fill light is used to fill light for the infrared sensor, and the white light fill light is used to fill light for the color sensor, the infrared sensor and the color sensor are exposed at different times, and the image processor is configured to control the infrared fill light and the white light fill light to fill light at different times. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] FIG1 is a schematic diagram of current in a camera module according to an embodiment of the present disclosure;

[0007] FIG2 is a schematic structural diagram of a camera module according to an embodiment of the present disclosure;

[0008] FIG3 is a schematic diagram of signal transmission of a camera module shown in an embodiment of the present disclosure;

[0009] FIG4 is a schematic diagram of signal transmission of a camera module shown in an embodiment of the present disclosure;

[0010] FIG5 is a schematic diagram of current in a camera module according to an embodiment of the present disclosure;

[0011] FIG6 is a signal diagram of a camera module shown in an embodiment of the present disclosure;

[0012] FIG7 is a signal diagram of a camera module shown in an embodiment of the present disclosure.

[0013] Legend: 1. Infrared sensor, 2. Color sensor, 3. Infrared fill light, 4. Image processor, 5. White light fill light; a. First control signal, b. Second control signal, c. Frame synchronization signal, d. Third control signal. DETAILED DESCRIPTION

[0014] In the related art, the camera module includes an infrared sensor, a color sensor, an infrared fill light, an image processor, and a white light fill light. The infrared sensor is electrically connected to the infrared fill light. When the light is dim and the infrared sensor is exposed, the infrared fill light is in the fill light state, allowing the infrared sensor to obtain clearer black and white images. When the color sensor is exposed, the white light fill light is in the fill light state, allowing the color sensor to obtain clearer color images. Since infrared light is invisible light, the infrared fill light is generally lit in a pulsed periodic manner, and the human eye will not perceive the flicker of light. White light is visible light. If the white light fill light is only in the fill light state when the color sensor is exposed, it will cause discomfort to the human eye due to the flicker of white light. Therefore, in order to avoid light flickering and ensure the fill light effect, white light is usually filled in a continuous lighting mode.

[0015] However, since the white light fill light in the related art is always on in dim conditions, there may be a situation where the white light fill light and the infrared fill light are in the fill light state at the same time. At this time, the maximum current generated by the fill light in the camera module is the superposition of the current when the white light fill light is filling and the current when the color fill light is filling. As shown in Figure 1, the horizontal axis in the figure is time T, and the vertical axis is current I. The solid line graph is the current in the infrared fill light, and m is the current value of the infrared fill light in the fill light state. The dotted line graph is the current in the white light fill light, and n is the current value of the white light fill light in the fill light state. As can be seen from Figure 1, when the infrared fill light and the white light fill light are turned on at the same time, the driving currents of the two will be superimposed, that is, the maximum current generated by the two fill lights is m+n. Therefore, there are high requirements for the power supply capacity of the interactive device, which in turn affects the integration and promotion of the camera module in the interactive device.

[0016] In view of the above technical problems, as shown in Figure 2, an embodiment of the present disclosure provides a camera module, which includes an infrared sensor 1, a color sensor 2, an infrared fill light 3, an image processor 4, and a white light fill light 5. The infrared sensor 1 is electrically connected to the color sensor 2, the infrared fill light 3, and the image processor 4, and the image processor 4 is also electrically connected to the white light fill light 5. The infrared fill light 3 is used to fill light for the infrared sensor 1, and the white light fill light 5 is used to fill light for the color sensor 2. The infrared sensor 1 and the color sensor 2 are exposed at staggered times, and the image processor 4 is configured to control the infrared fill light 3 and the white light fill light 5 to fill light at staggered times.

[0017] The infrared fill light 3 and the white light fill light 5 are staggered in time, that is, the infrared fill light 3 and the white light fill light 5 are not turned on at the same time. In this way, the peak current in the camera module is the driving current of the infrared fill light 3 or the driving current of the white light fill light 5, which makes the peak current in the camera module smaller.

[0018] Below, the camera module provided by the embodiment of the present disclosure is described in more detail.

[0019] As shown in Figure 2, the camera module includes an infrared sensor 1, a color sensor 2, an infrared fill light 3, an image processor 4, and a white light fill light 5. The infrared sensor 1 is electrically connected to the color sensor 2, the infrared fill light 3, and the image processor 4. The image processor 4 is also electrically connected to the white light fill light 5. The infrared sensor 1 and the color sensor 2 are exposed at staggered times. As shown in Figures 3 and 4, the infrared sensor 1 is configured to output a first control signal a to the infrared fill light 3 and the image processor 4. When the infrared sensor 1 is in the exposure state, the first control signal a is in a high state and controls the infrared fill light 3 to provide fill light. The image processor 4 is configured to convert the first control signal a into a second control signal b and send the second control signal b to the white light fill light 5. When the color sensor 2 is in the exposure state, the second control signal b is in a high state and controls the white light fill light 5 to provide fill light. The first control signal a and the second control signal b are not in a high state at the same time.

[0020] Among them, the camera module can be used for palm swiping, code scanning and face swiping, etc. Therefore, the camera module provided by the embodiment of the present disclosure can also be called a palm swiping module, a code scanning module or a face swiping module, etc.

[0021] The disclosed embodiments do not limit the specific type of camera module. In some examples, the camera module is used in a payment device, and a user can use the camera module to complete payment by swiping their palm, scanning a code, or scanning their face. In other examples, the camera module can also be used in an access control device, and a user can use the camera module to open a door by swiping their palm, scanning a code, or scanning their face.

[0022] Infrared sensor 1 is also called an IR camera sensor (infrared red camera sensor), and color sensor 2 is also called an RGB camera sensor (red, green, and blue camera sensor). Infrared sensor 1 and color sensor 2 are used to collect information, such as information codes, facial information, and palm print information. Infrared sensor 1 generates a black-and-white image, while color sensor 2 generates a color image. By combining the images generated by infrared sensor 1 and color sensor 2, the camera module can obtain more comprehensive information, facilitating rapid information recognition.

[0023] The infrared fill light 3 may also be called an IR LED (Infra Red Light Emitting Diode), and the white light fill light 5 may also be called a white light LED (Light Emitting Diode). The infrared fill light 3 and the white light fill light 5 may be driven by a driving circuit or a power chip.

[0024] The image processor 4, which can also be called an ISP (Image Signal Processing) chip, is a CPU (Central Processing Unit) chip with image processing capabilities. After receiving the first control signal a, the image processor 4 can generate a second control signal b based on the first control signal a and send the second control signal b to the white light fill light 5.

[0025] The first control signal a and the second control signal b are both PWM (Pulse Width Modulation) waves.

[0026] In the camera module provided by the embodiment of the present disclosure, after the infrared fill light 3 receives the first control signal a sent by the infrared sensor 1, when the first control signal a is in a high level state, the infrared fill light 3 is turned on. After the white light fill light 5 receives the second control signal b sent by the image processor 4, when the second control signal b is in a high level state, the white light fill light 5 is turned on. Since the first control signal a and the second control signal b are not in a high level state at the same time, the infrared fill light 3 and the white light fill light 5 will not be turned on at the same time, that is, the infrared fill light 3 and the white light fill light 5 will fill light at different times. Therefore, the peak current appearing in the camera module is the current when the infrared fill light 3 is in the fill light state, or the current when the white light fill light 5 is in the fill light state, and the two currents will not be superimposed. Therefore, the peak current in the camera module is small, thereby reducing the requirements for the power supply capacity of the interactive device, which is beneficial to the integration and promotion of the camera module in the interactive device.

[0027] For example, as shown in Figure 5, the horizontal axis is time T, the vertical axis is current I, the solid line graph is the current in the infrared fill light 3, and m is the current value of the infrared fill light 3 when it is in the fill light state. The dotted line graph is the current in the white light fill light 5, and n is the current value of the white light fill light 5 when it is in the fill light state. Since the infrared fill light 3 and the white light fill light 5 are not lit at the same time, the currents of the infrared fill light 3 and the white light fill light 5 are not superimposed, so the maximum current generated by the two fill lights is m or n. In Figure 1, m>n, so the maximum current generated by the two fill lights is m, that is, the peak current in the camera module is the current value of the infrared fill light 3 when it is in the fill light state.

[0028] The following is an exemplary description of the implementation of the staggered filling light of the infrared fill light 3 and the white light fill light 5:

[0029] In some examples, as shown in Figure 6, the falling edge of the first control signal a coincides with the rising edge of the second control signal b. The falling edge of the first control signal a corresponds to the moment when the first control signal a changes from a high level to a low level, that is, the moment when the infrared fill light 3 changes from a fill light state to an off state. The rising edge of the second control signal b corresponds to the moment when the second control signal b changes from a low level to a high level, that is, the moment when the white light fill light 5 changes from an off state to a fill light state. The falling edge of the first control signal a coincides with the rising edge of the second control signal b, which enables the white light fill light 5 to be turned on only when the infrared fill light 3 is turned off, thereby accurately controlling the staggered fill light of the infrared fill light 3 and the white light fill light 5.

[0030] Of course, in other examples, the rising edge of the second control signal b may also lag behind the falling edge of the second control signal a, so that the white light fill light 5 can be turned on only after the infrared fill light 3 is turned off.

[0031] Because infrared light is invisible, the fill-in time and frequency of the infrared fill-in lamp 3 do not affect the human eye. To reduce the power consumed by the infrared fill-in lamp 3, the infrared fill-in lamp 3 only needs to provide fill-in light when the infrared sensor 1 is exposed. Since the on and off of the infrared fill-in lamp 3 is controlled by the first control signal a, the fill-in time of the infrared fill-in lamp 3 can be controlled by controlling the duty cycle of the first control signal a.

[0032] In some examples, the duty cycle of the first control signal a is 5%-10%. For example, the duty cycle of the first control signal a can be 8%. The duty cycle of the first control signal a represents the proportion of time that the first control signal a is at a high level relative to the total time within a pulse cycle. As shown in FIG7 , the duty cycle of the first control signal a is t2 / t1.

[0033] It is understandable that within a pulse cycle, the proportion of the power-on time (filling time) of the infrared fill light 3 relative to the total time is the same as the duty cycle of the first control signal a. That is, the duty cycle of the infrared fill light 3 is also 5%-10%.

[0034] Because white light is visible, the white fill light 5 cannot only illuminate when the color sensor 2 is exposed, otherwise it will irritate the human eye. At the same time, the power-on time of the white fill light 5 must be reduced. Since the activation of the white fill light 5 is controlled by the second control signal b, the power-on time of the white fill light 5 can be controlled by setting the duty cycle of the second control signal b.

[0035] In some examples, the duty cycle of the second control signal b is 60%-70%. For example, the duty cycle of the second control signal b can be 60%. The duty cycle of the second control signal b represents the proportion of time that the second control signal b is at a high level relative to the total time within a pulse cycle. As shown in Figure 7, the duty cycle of the second control signal b is t4 / t3.

[0036] It is understood that within a pulse cycle, the proportion of the power-on time (fill light time) of the white light fill light 5 relative to the total time is the same as the duty cycle of the second control signal b. That is, the duty cycle of the white light fill light 5 is also 60%-70%. This reduces the power consumption of the white light fill light 5 by 30%-40%. Furthermore, when the duty cycle of the white light fill light 5 is reduced to 60%-70%, the white light appears softer in subjective visual perception, thereby reducing irritation to the human eye.

[0037] It is understandable that the sum of the duty cycles of the first control signal a and the second control signal b needs to be less than or equal to 100% to ensure that the red fill light 3 and the white fill light 5 are not in the fill light state at the same time.

[0038] To reduce the impact of the periodic fill light of the white light fill lamp 5 on the human eye, in some examples, the frequency of the second control signal b is 80 Hz-100 Hz. For example, the frequency of the second control signal b can be 100 Hz.

[0039] When the light is low, the infrared sensor 1 needs to be exposed by the infrared fill light 3, and the color sensor 2 needs to be exposed by the white light fill light 5. Therefore, if the infrared fill light 3 and the white light fill light 5 are to be staggered, the infrared sensor 1 and the color sensor 2 need to be exposed at staggered times. The following is an example of how to implement staggered exposure of the infrared sensor 1 and the color sensor 2:

[0040] In some examples, as shown in FIG3 , infrared sensor 1 is further configured to generate a frame synchronization signal c and generate a first control signal a based on the frame synchronization signal c. Frame synchronization signal c is then sent to color sensor 2, where the first control signal a is also used to control the exposure of infrared sensor 1. When the first control signal a is in a high-level state, infrared sensor 1 is exposed. Color sensor 2 is configured to receive frame synchronization signal c and generate a third control signal d based on the frame synchronization signal c. The third control signal d is used to control the exposure of color sensor 2. When the third control signal d is in a high-level state, color sensor 2 is exposed, and the third control signal d and the first control signal a are not in a high-level state at the same time.

[0041] The frame synchronization signal c may also be referred to as the FSIN signal. The frame synchronization signal can accurately control the staggered exposure of the infrared sensor 1 and the color sensor 2.

[0042] It should be noted that the frame synchronization signal c only serves as a reference for staggered exposure of infrared sensor 1 and color sensor 2, and does not actually control the exposure of infrared sensor 1 and color sensor 2. Therefore, the frame synchronization signal c can be sent from infrared sensor 1 to color sensor 2, or from color sensor 2 to infrared sensor 1.

[0043] In other examples, as shown in FIG4 , color sensor 2 is further configured to generate a frame synchronization signal c and generate a third control signal d based on the frame synchronization signal c. The frame synchronization signal c is then sent to infrared sensor 1, where the third control signal d is used to control the exposure of color sensor 2. When the third control signal d is at a high level, color sensor 2 is exposed. Infrared sensor 1 is configured to receive the frame synchronization signal c and generate a first control signal a based on the frame synchronization signal c. The first control signal a is also used to control the exposure of infrared sensor 1. When the first control signal a is at a high level, infrared sensor 1 is exposed, and the third control signal d and the first control signal a are not at high levels at the same time.

[0044] The infrared sensor 1 and the color sensor 2 use the frame synchronization signal c as the same reference, so that the exposure of the infrared sensor 1 and the color sensor 2 can be accurately controlled.

[0045] As shown in Figure 6, the register in infrared sensor 1 sets the high level of first control signal a to lag behind the high level of frame synchronization signal c, based on the current high level of frame synchronization signal c. The register in color sensor 2 also sets the high level of third control signal d to lag behind the high level of frame synchronization signal c, based on the current high level of frame synchronization signal c. The lag time of third control signal d is greater than the lag time of first control signal a, causing infrared sensor 1 to be exposed first and color sensor 2 to be exposed later. It can also be understood that the high level of first control signal a lags behind the high level of frame synchronization signal c, and the high level of third control signal d appears earlier than the high level of frame synchronization signal c.

[0046] In some examples, as shown in FIG5 , the current of the infrared fill light 3 when in the fill light state is greater than the current of the white light fill light 5 when in the fill light state, that is, m>n.

[0047] Exemplarily, the current of the white light fill lamp 5 when in the fill light state is 20 mA.

[0048] In some examples, the number of the infrared fill lights 3 is 8-12, and the number of the white light fill lights 5 is 8-12.

[0049] Next, the peak current and power reduction of the camera module provided by the embodiment of the present disclosure are calculated:

[0050] Since the current of the infrared fill light 3 in the fill light mode is greater than the current of the white fill light 5 in the fill light mode, the reduction in the peak current of the fill light in the camera module is equal to the current value of the white fill light 5 in the fill light mode. Assuming there are 12 white fill lights 5, the power supply voltage is 5V, the power supply efficiency is 85%, the on-state voltage of the white fill light 5 is 3V, and the on-state current of the white fill light 5 is 20mA. The reduced peak current is: 20mA × 12 pieces × 3V / (5V × 85%) = 169.5mA. Assuming the duty cycle of the second control signal is 60%, the power saved by 12 white fill lights 5 is: 20mA × 12 pieces × 3V × 40% / 85% = 339mW.

[0051] An embodiment of the present disclosure also provides an interactive device, which includes the above-mentioned camera module.

[0052] The interactive device may be a payment device, an identity recognition device, or other device used to identify information.

[0053] When a user needs to use an interactive device to identify information in a dark environment, the interactive device's controller can control infrared sensor 1 in the camera module to send a first control signal a to the infrared fill light, and image processor 4 to send a second control signal b to the white light fill light 5. This allows the interactive device to obtain a clearer image and quickly identify information. Because the fill light in the camera module has a low peak current, the above-mentioned camera module can be integrated even if the interactive device has a weak power supply.

[0054] At the same time, since the peak current of the fill light is low, the interactive device has better EMC (Electro Magnetic Compatibility) performance. In addition, since the interactive device does not need to have a high power supply capacity, the material cost of the interactive device can be reduced.

[0055] The above descriptions are merely optional embodiments of the present disclosure and are not intended to limit the present disclosure. Any modifications, equivalent replacements, improvements, etc. made within the principles of the present disclosure shall be included in the scope of protection of the present disclosure.

Claims

1. A camera module, comprising an infrared sensor (1), a color sensor (2), an infrared fill light (3), an image processor (4) and a white light fill light (5); The infrared sensor (1) is electrically connected to the color sensor (2), the infrared fill light (3), and the image processor (4), and the image processor (4) is also electrically connected to the white light fill light (5); The infrared fill light (3) is used to fill light for the infrared sensor (1), and the white light fill light (5) is used to fill light for the color sensor (2). The infrared sensor (1) and the color sensor (2) are exposed at different times, and the image processor (4) is configured to control the infrared fill light (3) and the white light fill light (5) to fill light at different times.

2. According to the camera module of claim 1, the infrared sensor (1) is configured to output a first control signal (a) to the infrared fill light (3) and the image processor (4), wherein: When the infrared sensor (1) is in an exposure state, the first control signal (a) is in a high level state and controls the infrared fill light (3) to provide fill light; The image processor (4) is configured to convert the first control signal (a) into a second control signal (b), and send the second control signal (b) to the white light fill light (5), wherein the first control signal (a) and the second control signal (b) are not in a high level state at the same time, and when the color sensor (2) is in an exposure state, the second control signal (b) is in a high level state and controls the white light fill light (5) to fill light.

3. According to the camera module according to claim 2, the falling edge of the first control signal (a) coincides with the rising edge of the second control signal (b).

4. According to the camera module according to claim 2 or 3, the duty cycle of the first control signal (a) is 5%-10%.

5. According to the camera module according to claim 2 or 3, the duty cycle of the second control signal (b) is 60%-70%.

6. According to the camera module according to claim 2 or 3, the frequency of the second control signal (b) is 80Hz-100Hz.

7. According to the camera module of claim 2 or 3, the infrared sensor (1) is further configured to generate a frame synchronization signal (c), generate the first control signal (a) based on the frame synchronization signal (c), and send the frame synchronization signal (c) to the color sensor (2), wherein: When the first control signal (a) is in a high level state, the infrared sensor (1) is exposed; The color sensor (2) is configured to receive the frame synchronization signal (c) and generate a third control signal (d) based on the frame synchronization signal (c), wherein the third control signal (d) and the first control signal (a) are not in a high level state at the same time, and when the third control signal (d) is in a high level state, the color sensor (2) is exposed.

8. According to the camera module of claim 2 or 3, the color sensor (2) is further configured to generate a frame synchronization signal (c), generate the third control signal (d) based on the frame synchronization signal (c), and send the frame synchronization signal (c) to the infrared sensor (1), wherein: When the third control signal (d) is in a high level state, the color sensor (2) is exposed; The infrared sensor (1) is configured to receive the frame synchronization signal (c) and generate the first control signal (a) based on the frame synchronization signal (c), wherein the third control signal (d) and the first control signal (a) are not in a high level state at the same time, and when the first control signal (a) is in a high level state, the infrared sensor (1) is exposed.

9. The camera module according to claim 2 or 3, wherein the current of the infrared fill light (3) when in a fill light state is greater than the current of the white light fill light (5) when in a fill light state.

10. An interactive device, comprising a camera module as described in any one of claims 1 to 9.

Citation Information

Patent Citations

  • Image processing method and device and camera

    CN113114926A

  • Camera and camera control method

    CN114374776A

  • Image acquisition device and identification system

    CN215120998U

  • Camera module and interactive equipment

    CN219960728U

  • System and method for compensating for image quality for each brightness section

    WO2019031802A1