Vision sensor
Patent Information
- Application Number
- TW114113188
- Authority / Receiving Office
- TW · TW
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-04-08
- Publication Date
- 2026-10-16
- Estimated Expiration
- 2045-04-07
AI Technical Summary
Existing laptop and monitor designs require multiple independent sensors for human presence detection, ambient light sensing, and color sensing, leading to increased costs, assembly complexity, power consumption, and space occupation, which hinders thinner and lighter designs and affects aesthetics.
A vision sensor integrating photosensitive elements with a color filter layer for ambient light and color sensing, and separate elements for human presence detection, all on a single substrate, reducing assembly complexity, layout space, and power consumption while enhancing accuracy and reliability.
The integrated vision sensor reduces production costs, assembly complexity, and power consumption while improving sensing accuracy and reliability, enabling thinner designs and efficient energy use.
Smart Images
Figure TWG2TA001080118_001 
Figure TWG2TA001080118_002 
Figure TWG2TA001080118_003
Abstract
Description
Technical Field
[0001] This invention relates to an optical sensing technology, and more particularly to a vision sensor. Prior Technology
[0002] In existing technologies, laptops or monitors typically require multiple sensors to provide different sensing functions, such as human presence detectors (HPDs) to detect the presence of a user, ambient light sensors (ALS) to detect ambient light brightness, and color sensors to detect ambient light color. However, these sensors are mostly independent components that must be manufactured and assembled individually, leading to increased overall cost and assembly complexity. These sensors also occupy excessive space, making it difficult to achieve a thinner and lighter design, and even affecting the aesthetics of the device. Furthermore, each sensor requires an independent power supply, increasing the overall power consumption of the device. Summary of the Invention
[0003] This invention provides a vision sensor that integrates multiple sensing functions, which can not only significantly reduce production costs, assembly complexity and operating power consumption, but also improve the accuracy and reliability of sensing.
[0004] The visual sensor of the present invention includes a substrate, a plurality of photosensitive elements, a color filter layer, and a plurality of light-receiving elements. The plurality of photosensitive elements are disposed on the substrate and each has a light-receiving surface. The plurality of photosensitive elements includes a plurality of first photosensitive elements and a plurality of second photosensitive elements. The color filter layer is disposed on one side of the light-receiving surface of each of the second photosensitive elements. The color filter layer overlaps the plurality of second photosensitive elements but does not overlap the plurality of first photosensitive elements. The plurality of light-receiving elements are disposed on one side of the light-receiving surface of each of the photosensitive elements and include a plurality of first light-receiving elements and a plurality of second light-receiving elements. The plurality of first light-receiving elements overlap the plurality of first photosensitive elements. The plurality of second light-receiving elements overlap the plurality of second photosensitive elements. The light-receiving angle of each second light-receiving element is greater than the light-receiving angle of each first light-receiving element.
[0005] Based on the above, in a visual sensor according to an embodiment of the present invention, a color filter layer is provided above a plurality of second photosensitive elements, enabling them to sense ambient light brightness and color. The remaining plurality of first photosensitive elements, without a color filter layer, are used to detect whether a specific person or object is present in the sensor's field of view. Since these sensing functions all use the same type of photosensitive element, they can be integrated onto the same photosensitive element substrate, which not only reduces the assembly complexity of the visual sensor, the required layout space, and the overall power consumption, but also improves the reliability of the visual sensor. Furthermore, compared to the first light-receiving element paired with the first photosensitive element, the second light-receiving element paired with the second photosensitive element has a larger light-receiving angle, thus increasing the accuracy of ambient light color detection. Simple Explanation of the Diagram
[0006] Figure 1 is a top view schematic diagram of a vision sensor according to a first embodiment of the present invention. Figure 2 is a cross-sectional schematic diagram of the vision sensor in Figure 1. Figures 3A and 3B are cross-sectional schematic diagrams of some other modified embodiments of the vision sensor of Figure 1. Figure 4 is a schematic diagram of a user operating an electronic device equipped with the vision sensor shown in Figure 1. Figure 5 is a block diagram of the intelligent control process of the electronic device shown in Figure 4. Figure 6 is a cross-sectional schematic diagram of a vision sensor according to a second embodiment of the present invention. Implementation
[0007] Figure 1 is a top view of a vision sensor according to a first embodiment of the present invention. Figure 2 is a cross-sectional view of the vision sensor of Figure 1. Figures 3A and 3B are cross-sectional views of some other modified embodiments of the vision sensor of Figure 1. Figure 4 is a schematic diagram of a user operating an electronic device equipped with the vision sensor of Figure 1. Figure 5 is a block diagram of the intelligent control flow of the electronic device of Figure 4. Figure 2 corresponds to section line A-A' in Figure 1.
[0008] Referring to Figures 1 and 2, the vision sensor 10 includes a substrate 100, a plurality of photosensitive elements 120, and a color filter layer 140. The plurality of photosensitive elements 120 are disposed on the substrate 100, and each has a light-receiving surface 120rs. The substrate 100 is, for example, a circuit substrate having a plurality of pixel circuits (which may include capacitors, active components, and signal traces, but are not limited thereto). In this embodiment, the plurality of photosensitive elements 120 can be arranged along two mutually perpendicular directions (e.g., direction X and direction Y), that is, these photosensitive elements 120 are arranged in an array on the substrate 100.
[0009] A color filter layer 140 is disposed on one side of the light-receiving surface 120rs of the photosensitive element 120. It is particularly noteworthy that the color filter layer 140 overlaps only a portion of the photosensitive element 120. For example, in this embodiment, the plurality of photosensitive elements 120 may include a plurality of first photosensitive elements 121 and a plurality of second photosensitive elements 122. The number of first photosensitive elements 121 may be much greater than the number of second photosensitive elements 122 (i.e., a small number of photosensitive elements 120 are used as these second photosensitive elements 122), but this is not a limitation. The color filter layer 140 overlaps the plurality of second photosensitive elements 122 but does not overlap the plurality of first photosensitive elements 121. The aforementioned overlap relationship is defined, for example, along the Z direction. Unless otherwise specified below, the overlap relationship between the two components is defined in this manner, and the overlap direction will not be described further.
[0010] In detail, the color filter layer 140 may include multiple filter patterns with different filter colors, and these filter patterns are respectively superimposed on multiple second photosensitive elements 122. In this embodiment, the color filter layer 140 may include a first filter pattern 141, a second filter pattern 142, and a third filter pattern 143 with different filter colors. For example, the first filter pattern 141 is adapted to allow the first color light CL1 in the ambient light ABL to pass through, the second filter pattern 142 is adapted to allow the second color light CL2 in the ambient light ABL to pass through, and the third filter pattern 143 is adapted to allow the third color light CL3 in the ambient light ABL to pass through. The first color light CL1, the second color light CL2, and the third color light CL3 are, for example, red light, green light, and blue light, but are not limited thereto.
[0011] In this embodiment, an overlapping second photosensitive element 122 and a filter pattern serve as photosensitive pixels responsible for detecting the color and brightness of ambient light (ABL), while a first photosensitive element 121 not overlapping the color filter layer 140 serves as a photosensitive pixel responsible for detecting the presence of a specific person or object. That is, the combination of multiple second photosensitive elements 122 and the color filter layer 140 simultaneously possesses the sensing functions of both an ambient light sensor (ALS) and a color sensor, while multiple first photosensitive elements 121 possess the sensing function of a human presence detector (HPD).
[0012] The aforementioned sensing functions all use the same photosensitive element 120, and therefore can be integrated on the same photosensitive element substrate. This not only reduces the assembly complexity of the vision sensor 10, the required layout space, and the overall power consumption, but also improves the reliability of the vision sensor 10.
[0013] To increase the light-receiving angle range of each photosensitive pixel, the visual sensor 10 may also provide a light-receiving element 160 on one side of the light-receiving surface 120rs of each photosensitive element 120. For example, in this embodiment, a first light-receiving element 161 may be superimposed on one side of the light-receiving surface 120rs of each first photosensitive element 121, and a second light-receiving element 162 may be superimposed on one side of the light-receiving surface 120rs of each second photosensitive element 122.
[0014] It should be noted that, since the photosensitive pixels responsible for detecting the color and brightness of ambient light (ABL) (including the second photosensitive element 122) do not need to provide high-resolution images, their effective light-receiving angle range can be greater than the effective light-receiving angle range of the photosensitive pixels responsible for detecting the presence of a specific person or object (including the first photosensitive element 121). That is, in this embodiment, the light-receiving angle RA2 of each second light-receiving element 162 can be greater than the light-receiving angle RA1 of each first light-receiving element 161. This effectively increases the accuracy of the visual sensor 10 in detecting the color and brightness of ambient light (ABL) while simultaneously meeting the resolution requirements of the visual sensor 10 for sensing human images.
[0015] In this embodiment, the plurality of second light-receiving elements 162 may be located between the plurality of second photosensitive elements 122 and the color filter layer 140, but are not limited thereto. In some embodiments, the color filter layer 140 may be located between the plurality of second light-receiving elements 162 and the plurality of second photosensitive elements 122.
[0016] For example, in this embodiment, in order to make the light-receiving angle RA2 of the second light-receiving element 162 greater than the light-receiving angle RA1 of the first light-receiving element 161, the refractive index of the second light-receiving element 162 can be greater than the refractive index of the first light-receiving element 161. In this way, the colored light through the filter pattern can be more effectively focused on the light-receiving surface 120rs of the second photosensitive element 122, thereby improving the sensitivity of the visual sensor 10 to color sensing.
[0017] However, the present invention is not limited thereto. As shown in FIG3A, in another modified embodiment of the visual sensor 10A, the radius of curvature R2 of the second light-collecting element 162A can be greater than the radius of curvature R1 of the first light-collecting element 161A. That is, the surface curvature of the second light-collecting element 162A can be smaller than the surface curvature of the first light-collecting element 161A, so that colored light passing through the filter pattern at a larger angle can be deflected by the surface of the second light-collecting element 162A and guided to the light-collecting surface 120rs of the second photosensitive element 122, thereby expanding the sensing range of the visual sensor 10A for ambient light (ABL). The first light-collecting element 161A and the second light-collecting element 162A are, for example, microlenses.
[0018] As shown in Figure 3B, in another modified embodiment of the vision sensor 10B, the haze of the second light-collecting element 162B can be greater than that of the first light-collecting element 161B. For example, compared to the first light-collecting element 161B, the second light-collecting element 162B can increase the haze appropriately (e.g., a haze greater than 0% and less than or equal to 3%) to further diffuse the incident colored light. From another perspective, by enhancing the scattering ability of the second light-collecting element 162B, the vision sensor 10B can increase its ability to perceive light from more incident angles. In the vision sensor 10B, the diffusion ability of the second light-collecting element 162B may originate from, for example, a roughened surface, but is not limited thereto. In some embodiments, the diffusion ability of the second light-collecting element can also be bulk diffusion, i.e., the entire second light-collecting element is doped with diffusing particles.
[0019] Referring to Figures 2, 4, and 5, for example, the vision sensor 10 is adapted to be mounted on the electronic device 1 and used to perform the aforementioned various sensing functions. The electronic device 1 can be a computer screen, a laptop, a tablet computer, or a smartphone, but is not limited thereto. In this embodiment, the electronic device 1 may include a vision sensor 10, a main camera module 15, a control unit 30, and a display screen 50. The control unit 30 may be electrically coupled to the vision sensor 10 and the display screen 50.
[0020] In this embodiment, the visual sensor 10 may have a resolution much lower than that of the main camera module 15, such as 160×160 or 320×320, but is not limited thereto. Therefore, the overall power consumption of the visual sensor 10 will be significantly lower than the operating power consumption of the main camera module 15. For example, the main camera module 15 can be used in scenarios requiring high-quality images, such as video calls. When the main camera module 15 is turned off, the visual sensor 10 can continue to detect user behavior and ambient light color and intensity. In this way, the energy efficiency of the electronic device 1 can be maximized.
[0021] The following will exemplify how electronic device 1 can be intelligently controlled using visual sensor 10. For example, when electronic device 1 is in sleep mode or display screen 50 is off, if user USR enters the field of view of visual sensor 10, its multiple first photosensitive elements 121, after receiving light L from user USR, output a first signal SG1 to control unit 30. Control unit 30 is adapted to wake electronic device 1 from sleep mode or turn on display screen 50 according to the first signal SG1. The first signal SG1 may be, for example, a portrait or upper body image of user USR, but is not limited thereto.
[0022] During the operation of electronic device 1 by user USR, the second photosensitive element 122 of visual sensor 10 is adapted to receive ambient light ABL and output a second signal SG2 to control unit 30. Control unit 30 is also adapted to adjust the display brightness and color temperature of display screen 50 according to the second signal SG2. The second signal SG2 may include the brightness and color composition of ambient light ABL. On the other hand, when control unit 30 determines through first signal SG1 that user USR's gaze has shifted from display screen 50 to another location, control unit 30 will turn off display screen 50 to achieve energy saving. Conversely, if user USR's gaze shifts back to display screen 50 from another location, control unit 30 will turn display screen 50 back on.
[0023] In other words, the visual sensor 10 allows the electronic device 1 to dynamically adjust the operating states of its various components based on usage, thereby improving energy efficiency and extending battery life. Furthermore, it enhances the user experience (USR) of operating the electronic device 1.
[0024] On the other hand, since the aforementioned multiple sensing functions are integrated into a single vision sensor 10, the number of sensors required for different sensing functions can be significantly reduced. This not only helps to achieve a thinner and lighter design for the electronic device 1, but also simplifies its assembly process and reduces overall production costs.
[0025] Another embodiment will be described below to illustrate this disclosure in detail, wherein the same components will be marked with the same symbols, and the description of the same technical content will be omitted. For the omitted parts, please refer to the foregoing embodiment, and they will not be repeated below.
[0026] Figure 6 is a cross-sectional schematic diagram of a vision sensor according to a second embodiment of the present invention. Referring to Figure 6, the difference between the vision sensor 10C of this embodiment and the vision sensor 10 of Figure 2 is that the arrangement of the multiple light-collecting elements is different. Specifically, in the vision sensor 10C of this embodiment, the light-collecting elements corresponding to different filter patterns can have different radii of curvature.
[0027] For example, in this embodiment, the wavelength of the second color light CL2 passing through the second filter pattern 142 may be less than the wavelength of the first color light CL1 passing through the first filter pattern 141, and greater than the wavelength of the third color light CL3 passing through the third filter pattern 143. In order to balance the sensing ability of the photosensitive pixels for different colors of light, the radius of curvature R2b of the second light-collecting element 162Cb superimposed on the second filter pattern 142 may be less than the radius of curvature R2a of the second light-collecting element 162Ca superimposed on the first filter pattern 141, and greater than the radius of curvature R2c of the second light-collecting element 162Cc superimposed on the third filter pattern 143.
[0028] It should be noted that the vision sensor 10A in Figure 3A, the vision sensor 10B in Figure 3B, and the vision sensor 10C in Figure 6 can also be used in the electronic device 1 in Figure 4 to replace the vision sensor 10, and can produce similar or the same effects.
[0029] In summary, in a visual sensor according to an embodiment of the present invention, a color filter layer is provided above a plurality of second photosensitive elements, enabling them to sense ambient light brightness and color. The remaining plurality of first photosensitive elements, without color filter layers, are used to detect the presence of a specific person or object within the sensor's field of view. Since these sensing functions all use the same type of photosensitive element, they can be integrated onto the same photosensitive element substrate, which not only reduces the assembly complexity, required layout space, and overall power consumption of the visual sensor, but also improves its reliability. Furthermore, compared to the first light-receiving element associated with the first photosensitive element, the second light-receiving element associated with the second photosensitive element has a larger light-receiving angle, thus increasing the accuracy of ambient light color detection.
[0030] 1: Electronic devices 10, 10A, 10B, 10C: Vision sensors 15: Main camera module 30: Control Unit 50: Display screen 100:Substrate 120: Photosensitive element 120rs: Finished surface 121: First photosensitive element 122: Second photosensitive element 140: Color filter layer 141: First filter pattern 142: Second filter pattern 143: Third filter pattern 160: Light receiving element 161, 161A, 161B: First light-receiving element 162, 162A, 162B, 162Ca, 162Cb, 162Cc: Second light-receiving element ABL: Ambient Light CL1: First color light CL2: Secondary color light CL3: Third color light L: Light R1, R2, R2a, R2b, R2c: Radius of curvature RA1, RA2: Beam angle SG1: First Signal SG2: Second Signal A-A': section line X, Y, Z: Direction
Claims
1. A vision sensor, comprising: One substrate; A plurality of photosensitive elements are disposed on the substrate, each having a light-receiving surface. The photosensitive elements include a plurality of first photosensitive elements and a plurality of second photosensitive elements. A color filter layer is disposed on one side of the light-receiving surface of each of the second photosensitive elements. The color filter layer overlaps the second photosensitive elements but does not overlap the first photosensitive elements. A plurality of light-receiving elements are disposed on one side of the light-receiving surface of each of the photosensitive elements, and include a plurality of first light-receiving elements and a plurality of second light-receiving elements. The first light-receiving elements overlap the first photosensitive elements, and the second light-receiving elements overlap the second photosensitive elements, wherein the light-receiving angle of each of the second light-receiving elements is greater than the light-receiving angle of each of the first light-receiving elements.
2. The visual sensor as claimed in claim 1, wherein the color filter layer comprises a plurality of filter patterns with different filter colors, the filter patterns being respectively superimposed on the second photosensitive elements.
3. The visual sensor as claimed in claim 2, wherein the filter patterns include a first filter pattern and a second filter pattern, the first filter pattern being for allowing a first color light to pass through, the second filter pattern being for allowing a second color light to pass through, the wavelength of the first color light being greater than the wavelength of the second color light, and the radius of curvature of the first of the second light-receiving elements overlapping the first filter pattern being greater than the radius of curvature of the second of the second light-receiving elements overlapping the second filter pattern.
4. The vision sensor of claim 3, wherein the filter patterns further include a third filter pattern for allowing a third color light to pass through, the wavelength of the third color light being less than the wavelength of the second color light, and the radius of curvature of the third of the second light-receiving elements overlapping the third filter pattern being less than the radius of curvature of the second of the second light-receiving elements.
5. The visual sensor as claimed in claim 2, wherein the second light-receiving elements are located between the second photosensitive elements and the filter patterns.
6. The visual sensor as claimed in claim 1, wherein the radius of curvature of each of the second light-collecting elements is greater than the radius of curvature of each of the first light-collecting elements.
7. The vision sensor as claimed in claim 1, wherein the refractive index of each of the second light-collecting elements is greater than the refractive index of each of the first light-collecting elements.
8. The visual sensor as claimed in claim 1, wherein the haze of each of the second light-receiving elements is greater than the haze of each of the first light-receiving elements.
9. The visual sensor as claimed in claim 1, configured on an electronic device and for detecting the presence of a user, wherein the first photosensitive elements, upon receiving light from the user, output a first signal to a control unit of the electronic device, the control unit being configured to wake the electronic device from a sleep state or to turn on or off a display screen of the electronic device based on the first signal.
10. The visual sensor as claimed in claim 9, wherein the second photosensitive elements are configured to receive ambient light and output a second signal to the control unit, and the control unit is further configured to adjust the display brightness and color temperature of the display screen according to the second signal.