Image acquisition device and imaging method thereof
By overlapping the light source acquisition graphics in the light source component, the problem of limited fingerprint information extraction range in the under-screen fingerprint module is solved, and the reading of the "dead zone" and the improvement of information density are achieved.
Patent Information
- Application Number
- CN202110182668.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-02-09
- Publication Date
- 2025-09-30
- Estimated Expiration
- 2041-02-09
AI Technical Summary
When existing fingerprint modules are integrated under the screen, the range of fingerprint information extraction is limited, especially due to the existence of "dead zones", which affects the screen-to-body ratio and information extraction efficiency.
The overlapping part of the first area of the acquisition pattern corresponding to the light source in the light source assembly and the second area of the acquisition pattern corresponding to another light source is used, and the processor performs image processing on the overlapping part to obtain more comprehensive fingerprint information.
It realizes the reading of fingerprint information in the "dead zone", improves the light source density, expands the fingerprint information extraction range, and improves the information extraction density without increasing hardware costs.
Smart Images

Figure CN114913560B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of fingerprint imaging, and in particular to an image acquisition device and an imaging method thereof. Background Art
[0002] Existing fingerprint recognition technology uses an image capture device to capture a person's fingerprint image, then compares it with existing fingerprint imaging information in the fingerprint recognition system to achieve identity verification. Due to its ease of use and the uniqueness of human fingerprints, fingerprint recognition technology has been widely used in various fields, such as security inspections such as public security bureaus and customs, building access control systems, and consumer products such as personal computers and mobile phones.
[0003] Fingerprint modules are increasingly being used in mobile devices such as laptops, tablets, and mobile phones, enabling automatic unlocking and functionality. Fingerprint recognition in mobile phones is particularly widespread.
[0004] However, the presence of the fingerprint module often hinders the improvement of the screen-to-body ratio of mobile devices, especially when the image acquisition device is set on the front of the mobile phone. The setting of the image acquisition device often affects the increase of the display device area.
[0005] To achieve both fingerprint unlocking and a higher screen-to-body ratio, under-screen fingerprint modules integrate an image acquisition device with the display module, using the light generated by the display module to image the fingerprint. However, the range of fingerprint information extracted by this fingerprint module is limited. Summary of the Invention
[0006] The problem solved by the present invention is: how to further expand the scope of extracted fingerprint information.
[0007] To solve the above problems, the present invention provides an image acquisition device, comprising:
[0008] A light source assembly, the light source assembly includes multiple light sources; a sensing surface, the light generated by the multiple light sources is reflected after being incident on the sensing surface to form multiple corresponding signal lights; a sensing assembly, the sensing assembly is suitable for collecting the multiple signal lights to obtain a first collected image; the collection pattern corresponding to each light source includes: a first area and a second area, the first area is an image formed on the sensing assembly by the signal light corresponding to the first light emitted by the light source, and the second area is an image formed on the sensing assembly by the signal light corresponding to the second light emitted by the light source, the first light is the light generated by the light source with an incident angle on the sensing surface less than the critical angle of total reflection, and the second light is the light generated by the light source with an incident angle on the sensing surface greater than or equal to the critical angle of total reflection; the first area of the collection pattern corresponding to a light source in the light source assembly at least partially overlaps with the second area of the collection pattern corresponding to another light source, and the first collection image at the position corresponding to the overlapping part is a first overlapping part; a processor, the processor is suitable for processing the first collection image in combination with the first overlapping part to obtain a second collection image.
[0009] Optionally, a portion of a first area of a collection pattern corresponding to a light source in the light source assembly overlaps with a portion of a second area of a collection pattern corresponding to another light source.
[0010] Optionally, all first areas of the collection pattern corresponding to one light source in the light source assembly overlap with the second areas of the collection pattern corresponding to another light source.
[0011] Optionally, a portion of the first area of the collection pattern corresponding to one light source in the light source assembly overlaps with a first area of the collection pattern corresponding to another light source.
[0012] Optionally, the processor is adapted to obtain a collection pattern corresponding to the other light source at a corresponding position according to the first overlapping portion.
[0013] Optionally, the one light source and the other light source generate light simultaneously, and the sensing component is suitable for simultaneously collecting the multiple signal lights to obtain the first collected image; the processor is suitable for separating the first collected image in combination with the first overlapping part, and obtaining the second collected image based on the separation result.
[0014] Optionally, the second area of the acquisition pattern corresponding to a light source in the light source assembly partially overlaps with the second area of the acquisition pattern corresponding to another light source, and the first acquisition image at the position corresponding to the overlapping part is the second overlapping part; the processor is suitable for separating the second overlapping part in combination with the first overlapping part.
[0015] Optionally, in the second area of the acquisition pattern corresponding to any light source, the non-overlapping portion is the determination portion of the first acquisition image; and the processor is suitable for processing the first acquisition image in combination with the first overlapping portion and the determination portion.
[0016] Optionally, the photosensitive surface of the sensor component for collecting signal light faces away from the sensing surface.
[0017] Optionally, it further includes: a light shielding layer, which is located on a side of the sensing component facing the sensing surface.
[0018] Optionally, the light source includes a point light source, and the projection ranges of the reflected lights formed by the multiple light sources on the sensing surface on the sensing component at least partially overlap.
[0019] Optionally, the light source includes multiple point light sources, and the projection ranges of the reflected lights formed by the multiple point light sources in one light source on the sensing surface do not overlap on the sensing component.
[0020] Optionally, the distance between a point light source of the one light source and the closest point light source of the other light source is less than , where H is the distance between the point light source and the sensing surface, n is the refractive index of the material between the point light source and the sensing surface, R is the radius of the projection range of the second light generated by the point light source on the sensing surface, and k is the magnification ratio of the collected pattern compared to the real fingerprint pattern.
[0021] Optionally, when R>3r, the distance between a point light source of the one light source and the closest point light source of the other light source is and within the range.
[0022] Optionally, the light source assembly includes at least one of a liquid crystal display, an active matrix organic light emitting diode display, or a light emitting diode display.
[0023] Optionally, the first area and the second area of the collection pattern corresponding to the light source are adjacent to each other, and the signal strength of the second area is greater than the signal strength of the first area.
[0024] Optionally, the signal intensity of the first area of the acquisition pattern corresponding to the light source is approximately zero. Accordingly, the present invention also provides an imaging method of an image acquisition device, the image acquisition device comprising:
[0025] A light source assembly, the light source assembly comprising a plurality of light sources; a sensing surface, wherein light generated by the plurality of light sources is incident on the sensing surface and then reflected to form a plurality of corresponding signal lights; a sensing assembly, the sensing assembly being adapted to collect the plurality of signal lights to obtain a first collected image; the collection pattern corresponding to each light source comprising: a first area and a second area, the first area being an image formed on the sensing assembly by the signal light corresponding to the first light emitted by the light source, the second area being an image formed on the sensing assembly by the signal light corresponding to the second light emitted by the light source, the first light being light generated by the light source and having an incident angle on the sensing surface less than a critical angle for total reflection, the second light being light generated by the light source and having an incident angle on the sensing surface greater than or equal to the critical angle for total reflection;
[0026] The imaging method includes: obtaining a first acquired image, wherein a first area of an acquisition pattern corresponding to a light source in the light source assembly at least partially overlaps with a second area of an acquisition pattern corresponding to another light source, and the first acquired image at a position corresponding to the overlapping portion is a first overlapping portion; and processing the first acquired image in combination with the first overlapping portion to obtain a second acquired image.
[0027] Optionally, a portion of a first area of a collection pattern corresponding to a light source in the light source assembly overlaps with a portion of a second area of a collection pattern corresponding to another light source.
[0028] Optionally, all first areas of the collection pattern corresponding to one light source in the light source assembly overlap with the second areas of the collection pattern corresponding to another light source.
[0029] Optionally, a portion of the first area of the collection pattern corresponding to one light source in the light source assembly overlaps with a first area of the collection pattern corresponding to another light source.
[0030] Optionally, the step of obtaining the second collected image includes: obtaining a collection pattern corresponding to the other light source at a corresponding position according to the first overlapping portion.
[0031] Optionally, in the step of obtaining the first acquired image, the multiple signal lights are simultaneously acquired to obtain the first acquired image; the step of obtaining the second acquired image includes: separating the first acquired image in combination with the first overlapping part, and obtaining the second acquired image based on the separation result.
[0032] Optionally, in the step of obtaining the first captured image, the second area of the capture pattern corresponding to a light source in the light source assembly partially overlaps with the second area of the capture pattern corresponding to another light source, and the first capture image at the position corresponding to the overlapping part is the second overlapping part; the step of separating the first captured image includes: separating the second overlapping part in combination with the first overlapping part.
[0033] Optionally, in the step of obtaining the first acquired image, the non-overlapping part in the second area of the acquisition figure corresponding to any light source is the determination part of the first acquired image; the step of obtaining the second acquired image includes: processing the first acquired image in combination with the first overlapping part and the determination part.
[0034] Optionally, the first area and the second area of the collection pattern corresponding to the light source are adjacent to each other, and the signal strength of the second area is greater than the signal strength of the first area.
[0035] Optionally, the signal intensity of the first area of the acquisition pattern corresponding to the light source is approximately zero.
[0036] Optionally, the imaging method is applicable to an under-screen fingerprint module.
[0037] Optionally, the light source assembly includes at least one of a liquid crystal display, an active matrix organic light emitting diode display, or a light emitting diode display.
[0038] Compared with the prior art, the technical solution of the present invention has the following advantages:
[0039] In the technical solution of the present invention, the first overlapping portion is a first captured image corresponding to the overlapping position of the first area of the capture pattern corresponding to one light source in the light source assembly and the second area of the capture pattern corresponding to another light source, and the processor processes the first captured image in combination with the first overlapping portion to obtain a second captured image, thereby enabling the reading of fingerprint information within at least a portion of the first area, that is, enabling the reading of fingerprint information in the "dead zone", creating conditions for increasing the light source density to possibly reduce or even eliminate the "dead zone", thereby breaking through the limitation of the range of information fingerprint extraction.
[0040] In an optional solution of the present invention, the photosensitive surface of the sensor component that collects signal light faces away from the sensing surface, which can effectively reduce the interference of stray light such as ambient light. Furthermore, by setting a light-shielding layer on the side of the sensor component facing the sensing surface, the influence of stray light can be further reduced. Therefore, the setting of the back-to-back photosensitive surface and the light-shielding layer can effectively improve the signal-to-noise ratio.
[0041] In an optional solution of the present invention, the light source includes multiple point light sources, and these multiple point light sources can be arranged in an array. Therefore, the light source assembly can be a variety of display screens. Thus, the image acquisition device can be an under-screen image acquisition device, utilizing the light generated by the display screen to perform fingerprint imaging. This not only does not increase the module structure and thickness, but also can utilize the smaller pixel pitch of the display screen to increase the density of fingerprint information extraction, thereby improving information extraction density without increasing hardware costs. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] Figure 1 It is a schematic diagram of the cross-sectional structure of a fingerprint module;
[0043] Figure 2 is a schematic diagram of a fingerprint image obtained by another fingerprint module;
[0044] Figure 3 1 is a schematic cross-sectional structural diagram of an embodiment of an image acquisition device of the present invention;
[0045] Figure 4 yes Figure 3 A schematic diagram of a first captured image obtained by the embodiment of the image capture device shown;
[0046] Figure 5 yes Figure 4 A simulation diagram of a first captured image obtained by the embodiment of the image capture device shown;
[0047] Figure 6 is a schematic diagram showing a situation where a first area of a collection pattern corresponding to one light source is adjacent to a second area of a collection pattern corresponding to another light source;
[0048] Figure 7 is a schematic diagram of a first captured image obtained by another embodiment of the image capture device of the present invention;
[0049] Figure 8 yes Figure 7 A simulation diagram of a first captured image obtained by the image acquisition apparatus embodiment shown;
[0050] Figure 9 is a schematic diagram of a first captured image obtained by another embodiment of the image capture device of the present invention;
[0051] Figure 10 Is a simulation diagram of the first captured image obtained by another embodiment of the image acquisition device of the present invention;
[0052] Figure 11 This is a simulation diagram of an image acquired by another embodiment of the image acquisition device of the present invention;
[0053] Figure 12 This is a simulation diagram of an image acquired by another embodiment of the image acquisition device of the present invention;
[0054] Figure 13 It is a flow chart of an imaging method according to an embodiment of the present invention. DETAILED DESCRIPTION
[0055] As can be seen from the background technology, the existing fingerprint module imaging method has the problem of limited area of extracted fingerprint information. Now, combined with the imaging principle of the fingerprint module, the reasons for the limited area of extracted fingerprint information image are analyzed:
[0056] refer to Figure 1 , which shows a schematic diagram of the cross-sectional structure of a fingerprint module.
[0057] The fingerprint module includes: a light source 11, an image sensor 12, and a sensing surface 13. When a finger is pressed on the sensing surface 13, the light generated by the light source 11 forms reflected light carrying fingerprint information on the sensing surface 13.
[0058] The critical angle at which the light emitted by the light source 11 is totally reflected on the sensing surface 13 is θ c At this time, the projection of the light emitted by the light source 11 on the sensing surface 13 is r. When the incident angle θ of the light emitted by the light source 11 on the sensing surface 13 is greater than θ c When a finger is pressed on the sensing surface 13, the maximum radius of the contact area between the finger and the sensing surface 13 that can be detected by the light source 11 is R (R is usually related to the light intensity of the light source 11 and the distance between the light source 11 and the sensing surface 13). The area of the maximum fingerprint area that can be detected by the light emitted by the light source 11 is When the projection of the light emitted by the light source 11 on the sensing surface 13 is less than r, on the one hand, when the light intensity of the light source 11 itself is large, the light source 11 forms a bright spot with a certain area corresponding to the receiving area on the image sensor 12. On the other hand, since the light emitted by the light source 11 cannot be totally reflected on the sensing surface 13 at this time, compared with the area where the projection of the light emitted by the light source 11 on the sensing surface 13 is greater than or equal to r, the fingerprint information contained in the image formed after the light is received by the image sensor 12 in the area with the projection of the light source 11 as the center on the sensing surface 13 is much weaker. Therefore, the effective contact area of the fingerprint information that the light source 11 can detect is The efficiencies of measured area in the fingerprint image obtained by the fingerprint module are: , it can be seen that the limit of the measurement area efficiency of the fingerprint module is 25%, that is, the measurement area efficiency of the fingerprint module with a single point light source will not exceed 25%.
[0059] Since the measurement area efficiency limit of a single point light source fingerprint module is only 25%, in the solution of an under-screen fingerprint module that uses display pixels as point light sources, multiple arrayed point light sources are generally used to form a light source array to increase the amount of information obtained in the fingerprint image. However, in this structure, the distance between the point light sources in the light source array cannot be too close, otherwise the images formed by adjacent point light sources are likely to overlap, thereby affecting the acquisition of the fingerprint image. Under the premise of the same fingerprint image size, the limitation of the spacing between the point light sources and the limit of the measurement area efficiency of a single point light source fingerprint module will affect the measurement area efficiency of the entire fingerprint image.
[0060] Combined with reference Figure 2 , shows a schematic diagram of a fingerprint image obtained by another fingerprint module.
[0061] The fingerprint module includes multiple point light sources (two point light sources are used as an example in the figure). Figure 2 As shown, the distances between the multiple point light sources in the fingerprint module are small, so that the images of different point light sources overlap.
[0062] The fingerprint image 20 includes: a first area 21a / 21b and a second area 22a / 22b, wherein the first area 21a / 21b is obtained by the sensing component collecting signal light corresponding to the first light emitted by the light source, and the second area 22a / 22b is obtained by the sensing component collecting signal light corresponding to the second light emitted by the light source, the first light is the light generated by the light source and the incident angle on the sensing surface is less than the critical angle of total reflection, the second light is the light generated by the light source and the incident angle on the sensing surface is greater than or equal to the critical angle of total reflection, and the critical angle of total reflection is the incident angle of the light generated by the light source when total reflection occurs on the sensing surface.
[0063] In some embodiments, the first area 21a is adjacent to the second area 22a, and the first area 21b is adjacent to the second area 22b. Specifically, the second area 22a may surround the first area 21a, and the second area 22b may surround the first area 21b.
[0064] As previously mentioned, fingerprint images in the first region 21a / 21b are often overexposed (the light-sensitive surface of the image sensor faces the sensing surface), making fingerprint information extraction impossible. Therefore, the first region 21a / 21b is often considered a "dead zone" where fingerprint information cannot be extracted. This "dead zone" limits the range of fingerprint information that can be extracted.
[0065] To solve the above technical problems, the present invention provides an image acquisition device, comprising:
[0066] a light source assembly, the light source assembly comprising a plurality of light sources;
[0067] a sensing surface, wherein the light generated by the plurality of light sources is incident on the sensing surface and is reflected to form a plurality of corresponding signal lights;
[0068] A sensing component, wherein the sensing component is adapted to collect the plurality of signal lights to obtain a first collected image;
[0069] The collection pattern corresponding to each light source includes: a first area and a second area, wherein the first area is an image formed on the sensing component by the signal light corresponding to the first light emitted by the light source, and the second area is an image formed on the sensing component by the signal light corresponding to the second light emitted by the light source, wherein the first light is light generated by the light source and has an incident angle on the sensing surface less than the critical angle of total internal reflection, and the second light is light generated by the light source and has an incident angle on the sensing surface greater than or equal to the critical angle of total internal reflection;
[0070] A first area of a collection pattern corresponding to one light source in the light source assembly at least partially overlaps with a second area of a collection pattern corresponding to another light source, and a first collection image at a position corresponding to the overlapping portion is a first overlapping portion;
[0071] A processor is adapted to process the first acquired image in combination with the first overlapping portion to obtain a second acquired image.
[0072] The technical solution of the present invention realizes the reading of fingerprint information in the "dead zone", which can create conditions for increasing the light source density to possibly reduce or even eliminate the "dead zone", thereby breaking the limitation of the range of fingerprint information extraction.
[0073] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.
[0074] refer to Figures 3 to 5 ,in Figure 3 FIG2 shows a schematic cross-sectional structure diagram of an image acquisition device according to an embodiment of the present invention; Figure 4 yes Figure 3 A schematic diagram of a first captured image obtained by the embodiment of the image capture device shown; Figure 5 Shown Figure 4 A simulation diagram of the first captured image obtained by the embodiment of the image capture device shown.
[0075] like Figure 3As shown, the image acquisition device includes: a light source component 110, the light source component 110 includes multiple light sources; a sensing surface 120, the light generated by the multiple light sources is incident on the sensing surface 120 and is reflected to form multiple corresponding signal lights; a sensing component 140, the sensing component 140 is suitable for collecting the multiple signal lights to obtain a first captured image 100.
[0076] like Figure 3 As shown, in this embodiment, the light source assembly 110 includes a first light source 111 and a second light source 112; the light generated by the first light source 111 and the second light source 112 is reflected on the sensing surface to form signal light corresponding to the first light source 111 and the second light source 112; Figure 4 As shown, the sensor component 140 collects signal light corresponding to the first light source 111 and the second light source 112 to obtain the first collected image 100 .
[0077] In some embodiments of the present invention, the first light source 111 and the second light source 112 generate light simultaneously, and the sensor component 140 is adapted to simultaneously collect the multiple signal lights to obtain the first collected image 100. That is, the first collected image 100 is formed by superimposing the collected graphics corresponding to all the light sources in the light source component. Specifically, Figure 4 As shown, the first captured image 100 obtained by the sensor component 140 includes a captured pattern 101 corresponding to the first light source 111 and a captured pattern 102 corresponding to the second light source 112 .
[0078] It should be noted that in some embodiments of the present invention, the light source includes multiple point light sources, and the reflected light generated by multiple point light sources in a single light source on the sensing surface does not overlap in the projection range on the sensing component. The multiple point light sources are arranged in an array. In this embodiment, the first light source 111 and the second light source 112 each include multiple point light sources arranged in an array.
[0079] Specifically, such as Figure 3 As shown, in this embodiment, the light source assembly is an active matrix organic light-emitting diode (AMOLED) display screen. The light source comprises multiple display pixels in the AMOLED display screen, and the point light sources are display pixels of the AMOLED display screen. The first light source 111 comprises some of the display pixels, and the second light source 112 comprises some of the display pixels. In other embodiments of the present invention, the light source may also be a liquid crystal display screen or a light-emitting diode display screen (e.g., a MicroLED display screen).
[0080] In some embodiments, the image acquisition device further includes a light-transmitting cover plate (not shown) for providing the sensing surface 120. Specifically, the light-transmitting cover plate can be a glass cover plate, which is located on the display screen.
[0081] It can be seen that the image acquisition device can be an under-screen image acquisition device, which uses the light generated by the display screen to perform fingerprint imaging. On the one hand, it will not increase the module structure and module thickness. On the other hand, it can use the display screen to display a smaller pixel pitch to increase the density of fingerprint information extraction, thereby improving the information extraction density without increasing hardware costs.
[0082] It should also be noted that in some embodiments of the present invention, the photosensitive surface of the sensor component 140 for collecting signal light faces away from the sensing surface 120, that is, Figure 3 As shown, the sensor assembly 140 includes a plurality of photosensitive pixels 141, each of which has a photosensitive surface 142 for collecting light signals. The photosensitive surface 142 is disposed away from the sensing surface 120. Therefore, the signal light formed on the sensing surface 120 is totally reflected again on the surface of the image acquisition device opposite the sensing surface 120, forming waveguide light 131, which is then projected onto the photosensitive surface 142 of the photosensitive pixels 141 in the sensor assembly 140 for collection. It should be noted that the "waveguide light" mentioned in the embodiments of the present invention refers to light that has been totally reflected at least once on two opposing surfaces of the image acquisition device.
[0083] In some embodiments, the image acquisition device further includes a substrate 160 located on a side of the sensor component 140 facing away from the sensing surface 120. The substrate 160 has a first surface and a second surface facing each other. The first surface of the substrate 160 is in contact with the sensor component 140, and the waveguide light 131 is totally reflected by the second surface of the substrate 160. The substrate 160 is made of a light-transmitting material, such as SiNx, and may have a thickness of approximately 0.5 μm.
[0084] In some embodiments, the sensing component 140 further includes a light-transmitting substrate (e.g., a glass substrate), and the photosensitive pixel 141 is located on the light-transmitting substrate. The thickness of the light-transmitting substrate may be approximately 0.5 mm. In some embodiments, the photosensitive pixel 141 further includes a first surface opposite to the photosensitive surface 142, the first surface being light-transmitting and facing the sensing surface 120. The image acquisition device further includes: a light-shielding layer 143, the light-shielding layer 143 being located on the side of the photosensitive pixel 141 facing the sensing surface 120, and being used to block light from entering the photosensitive pixel 141 from the first surface of the photosensitive pixel 141. Specifically, as Figure 3As shown, the light shielding layer 143 is located between the photosensitive pixels 141 and the sensing surface 120. The light shielding layer 143 includes multiple discrete light shielding portions, each of which covers the first surface of the photosensitive pixels 141. The lateral dimensions (i.e., parallel to the sensing surface 120) of the light shielding portions are greater than or equal to the lateral dimensions of the photosensitive pixels 141. A light-transmitting medium is filled between adjacent light shielding portions, allowing signal light to enter the substrate 160 through the light-transmitting medium between adjacent light shielding portions and between adjacent photosensitive pixels 141. The light shielding layer 143 is made of an opaque material, and thus can effectively prevent light from entering the first surface of the photosensitive pixels 141. In the embodiment of the present invention, the photosensitive surface 142 faces away from the sensing surface 120, which can effectively avoid interference from stray light such as ambient light. This is because it is difficult for ambient light to be totally reflected by the second surface of the substrate 160 and received by the photosensitive surface 142. In addition, the provision of the light-shielding layer 143 can further reduce the influence of stray light. Therefore, the provision of the back-to-back photosensitive surface 142 and the light-shielding layer 143 can effectively improve the signal-to-noise ratio, thereby facilitating the reading of fingerprint information in the first area.
[0085] In some embodiments, the light shielding layer 143 includes a light-absorbing material to absorb light and prevent high-order secondary reflections, which may form fingerprint images with different magnifications. In other embodiments, the light shielding layer 143 may also be an electrode (e.g., a metal electrode) of the photosensitive pixel 141. During fabrication, the electrode of the photosensitive pixel 141 used as the light shielding layer 143 is larger than a conventional pixel electrode to completely block light incident on the first surface of the photosensitive pixel 141.
[0086] like Figure 4 As shown, the collection pattern 101 / 102 corresponding to each light source includes: a first area 101a / 102a and a second area 101b / 102b surrounding the first area 101a / 102a, the first area 101a / 102a is obtained by the sensing component 140 collecting the signal light corresponding to the first light emitted by the light source, and the second area 101b / 102b is obtained by the sensing component 140 collecting the signal light corresponding to the second light emitted by the light source, the first light is the light generated by the light source and the incident angle on the sensing surface 120 is less than the critical angle of total reflection, the second light is the light generated by the light source and the incident angle on the sensing surface 120 is greater than or equal to the critical angle of total reflection.
[0087] Specifically, the collection pattern 101 corresponding to the first light source 111 includes: a first area 101a and a second area 101b surrounding the first area 101a; the collection pattern 102 corresponding to the second light source 112 includes: a first area 102a and a second area 102b surrounding the first area 102a.
[0088] Different from Figure 1 The structure of the fingerprint module of the embodiment shown, Figure 3 The photosensitive surface 142 of the photosensitive pixel 141 in the image acquisition device of the illustrated embodiment is positioned away from the sensing surface 120. Therefore, the signal intensity of the first region of the acquisition pattern corresponding to each point light source is nearly zero. This is because the first region corresponds to a first light ray generated by the point light source, whose angle of incidence on the sensing surface 120 is less than the critical angle for total internal reflection. Most of this first light ray transmits through the sensing surface 120, while a small portion is reflected by the sensing surface 120. In the under-screen image acquisition device, the signal intensity of this small portion of light is significantly attenuated after transmitting through the display screen. After secondary reflection from the lower surface of the substrate 160, the signal intensity ultimately received by the photosensitive surface 142 of the photosensitive pixel 141 is approximately zero. In other words, the signal intensity of the first region is approximately zero. The second area corresponds to the second light generated by the point light source, whose incident angle on the sensing surface 120 is greater than or equal to the critical angle of total reflection. The second light undergoes a total reflection on the sensing surface 120, and then a second total reflection on the lower surface of the substrate 160, and is finally received by the photosensitive surface 142 of the photosensitive pixel 141. Therefore, the signal strength of the second area is much higher than the signal strength of the first area, and can be used to extract effective fingerprint information.
[0089] In some embodiments of the present invention, the light source includes a point light source, and the projection ranges of the reflected lights formed by the multiple light sources on the sensing surface on the sensing component at least partially overlap.
[0090] In some embodiments of the present invention, each light source in the light source assembly includes a plurality of point light sources arranged in an array, and the projection ranges of the reflected light formed by the multiple point light sources in one light source on the sensing surface on the sensing assembly do not overlap, so the collection pattern corresponding to each light source includes a plurality of circular patterns that correspond one-to-one to the multiple point light sources in the light source and do not overlap. Specifically, Figure 4 and Figure 5 In the figure, a circular pattern in the collection pattern 101 corresponding to the first light source 111 and a circular pattern in the collection pattern 102 corresponding to the second light source 112 are taken as examples for description.
[0091] In the light source assembly 110, the spacing between the multiple light sources is small, and the first area 101a / 102a of the acquisition pattern 101 / 102 corresponding to one light source in the light source assembly 110 at least partially overlaps with the second area 102b / 101b of the acquisition pattern 102 / 101 corresponding to another light source, and the first acquisition image 100 at the position corresponding to the overlapping part is the first overlapping part 101ab / 102ab. In some embodiments of the present invention, the light source includes a plurality of point light sources arranged in an array. Therefore, according to the optical paths of the first light and the second light, it can be known that the radius of the first area of the circular pattern in the acquisition pattern corresponding to each light source is kr and the radius of the second area is kR, wherein r is the radius of the transmission range of the first light generated by the point light source on the sensing surface 120, R is the radius of the projection range of the second light generated by the point light source on the sensing surface 120, k is the magnification ratio of the acquisition pattern compared to the real fingerprint pattern, k is related to the relative position relationship between the point light source, the sensing surface 120 and the photosensitive surface 142, and k is a positive number greater than 0. Specifically, , where H is the distance between the point light source and the sensing surface, and n is the refractive index of the material between the point light source and the sensing surface.
[0092] It should be noted that the radius R of the second zone is theoretically infinite. However, it may vary for different image acquisition devices due to differences in component performance and structure. Generally speaking, the radius R of the second zone is related to parameters such as the luminous performance and luminous angle of the point light source in the light source assembly, the photosensitivity and luminous angle of the sensor assembly, and the transmittance of each material layer in the image acquisition device.
[0093] In some embodiments of the present invention, the acquisition patterns corresponding to each light source are the same; therefore, Figure 6 As shown, the distance D between a point light source of the one light source and the closest point light source of the other light source is equal to When the first area of the collection pattern corresponding to the one light source is adjacent to the second area of the collection pattern corresponding to the other light source. Therefore, the distance D between a point light source of the one light source and the closest point light source of the other light source is less than When the first area of the acquisition pattern corresponding to one light source in the light source assembly at least partially overlaps with the second area of the acquisition pattern corresponding to another light source. It should be noted that the relative positional relationship between the first area and the second area between the acquisition patterns corresponding to different light sources will vary with the performance and structure of the components in the image acquisition device. Generally speaking, the relative positional relationship between the first area and the second area between the acquisition patterns corresponding to different light sources is related to the luminous performance and luminous angle of the light source in the light source assembly, the photosensitivity and photosensitivity angle of the sensor assembly, and the relative positional relationship between the light source, the sensing surface, and the sensor assembly. Therefore, the technical solution of the present invention cannot be limited by the distance D between a point light source of the one light source and the closest point light source of the other light source. As long as the multiple light sources in the light source assembly are arranged closely enough, the technical solution of the present invention can be applied.
[0094] like Figure 4 and 5 As shown, the distance between the first light source 111 and the second light source 112 in the light source assembly 110 is small, so that the first area 101a of the collection pattern 101 corresponding to the first light source 111 at least partially overlaps with the second area 102b of the collection pattern 102 corresponding to the second light source 112.
[0095] In some embodiments, the image acquisition device is an under-screen image acquisition device. When a portion of the first area 101a of the acquisition pattern 101 corresponding to the first light source 111 overlaps with the second area 102b of the acquisition pattern 102 corresponding to the second light source 112, a portion of the first area 102a of the acquisition pattern 102 corresponding to the second light source 112 also overlaps with the second area 101b of the acquisition pattern 101 corresponding to the first light source 111.
[0096] Therefore, the first acquisition image 100 has two first overlapping parts, namely the first overlapping part 101ab and the first overlapping part 102ab, wherein the first overlapping part 101ab corresponds to the overlapping part of the first area 101a of the acquisition pattern 101 corresponding to the first light source 111 and the second area 102b of the acquisition pattern 102 corresponding to the second light source 112; the first overlapping part 102ab corresponds to the overlapping part of the first area 102a of the acquisition pattern 102 corresponding to the second light source 112 and the second area 101b of the acquisition pattern 101 corresponding to the first light source 111. Since the signal strength of the first area 101a and the first area 102a is approximately zero when the acquisition patterns 101 and 102 corresponding to the first light source 111 and the second light source 112 respectively do not overlap, when the acquisition patterns 101 and 102 corresponding to the first light source 111 and the second light source 112 respectively occur as shown in FIG. Figure 4 and Figure 5When overlapping as shown, the first overlapping portion 101ab can be approximately regarded as containing only the image of the second area 102b at the position of the first overlapping portion 101ab, and the first overlapping portion 102ab can be approximately regarded as containing only the image of the second area 101b at the position of the first overlapping portion 102ab, that is, the first overlapping portions 101ab and 102ab can be approximately regarded as containing only the detection image from a single light source, rather than the superposition of the detection images of the first light source 111 and the second light source 112.
[0097] like Figure 4 As shown, in this embodiment, the distance between the first light source 111 and the second light source 112 is small enough so that part of the first area 101a of the acquisition pattern 101 corresponding to the first light source 111 and the first area 102a of the acquisition pattern 102 corresponding to the second light source 112 overlap. Specifically, the distance between the first light source 111 and the second light source 112 is less than .
[0098] Continue to refer Figures 3-5 The image acquisition device further includes: a processor 150, wherein the processor 150 is adapted to process the first acquired image in combination with the first overlapping portion to obtain a second acquired image.
[0099] The first overlapping portion is a first captured image corresponding to the overlapping position of the first area of the capture pattern corresponding to one light source in the light source assembly and the second area of the capture pattern corresponding to another light source. The processor processes the first captured image in combination with the first overlapping portion to obtain a second captured image, thereby enabling the reading of fingerprint information within a portion of the first area, that is, enabling the reading of fingerprint information in the "dead zone", creating conditions for increasing the light source density to possibly reduce or even eliminate the "dead zone", thereby breaking through the limitation of the range of fingerprint information extraction.
[0100] In some embodiments of the present invention, the processor 150 is adapted to obtain a collection pattern corresponding to the other light source at a corresponding position according to the first overlapping portion. Figure 4 and Figure 5 As shown, the processor 150 obtains the acquisition pattern 102 corresponding to the second light source 112 at the corresponding position based on the first overlapping portion 101ab. The processor 150 also obtains the acquisition pattern 101 corresponding to the first light source 111 at the corresponding position based on the first overlapping portion 102ab. For example, the image within the first overlapping portion 101ab is the acquisition pattern of the second light source 112 at that position, and the image within the first overlapping portion 102ab is the acquisition pattern of the first light source 111 at that position.
[0101] It should be noted that, in some embodiments of the present invention, the multiple light sources are driven simultaneously to generate light, and the sensing component 140 simultaneously collects the multiple signal lights to obtain the first collected image 100. The first collected image 100 is composed of the collection graphics corresponding to all light sources in the light source component; therefore, the processor 150 is suitable for separating the first collected image 100 in combination with the first overlapping part 101ab / 102ab, and obtaining the second collected image based on the separation result.
[0102] In this embodiment, the first acquisition image 100 includes an acquisition graphic 101 corresponding to the first light source 111 and an acquisition graphic 102 corresponding to the second light source 112. The processor 150 separates the first acquisition image 100 according to the first overlapping part to obtain the acquisition graphic 101 corresponding to the first light source 111 and the acquisition graphic 102 corresponding to the second light source 112, respectively; and obtains the second acquisition image based on the acquisition graphic 101 corresponding to the first light source 111 and the acquisition graphic 102 corresponding to the second light source 112.
[0103] It should be noted that the processor 150 can separate the first acquired image 100 according to the imaging principle of linear propagation of light to analytically obtain the acquisition graphic 101 corresponding to the first light source 111 and the acquisition graphic 102 corresponding to the second light source 112; it can also use a pre-trained deep learning model to separate the first acquired image 100.
[0104] In some embodiments of the present invention, the second area 101b / 102b of the acquisition pattern 101 / 102 corresponding to a light source in the light source assembly partially overlaps with the second area 102b / 101b of the acquisition pattern 102 / 101 corresponding to another light source, and the first acquisition image 100 at the corresponding position of the overlapping part is the second overlapping part 100bb; the processor 150 is suitable for separating the second overlapping part 100bb in combination with the first overlapping part 101ab / 102ab.
[0105] Specifically, such as Figure 4 and Figure 5 As shown, part of the second area 101b of the acquisition figure 101 corresponding to the first light source 111 and the second area 102b of the acquisition figure 102 corresponding to the second light source 112 overlap, and the second overlapping part 100bb is the first acquisition image 100 at the position corresponding to the overlapping part; the processor 150 is suitable for separating the second overlapping part 100bb according to at least one of the first overlapping part 101ab and the first overlapping part 102ab, and obtaining the second acquisition image according to the separation result.
[0106] In addition, if Figure 4 and Figure 5 As shown, the non-overlapping portion of the second area 101b / 102b of the acquisition pattern 101 / 102 corresponding to any light source is the determination portion 101bc / 102bc of the first acquired image 100; the processor 150 is adapted to process the first acquired image 100 in combination with the first overlapping portion 101ab / 102ab and the determination portion 101bc / 102bc. Specifically, the processor 150 may separate the second overlapping portion 100bb of the first acquired image 100 based on the first overlapping portion 101ab / 102ab and the determination portion 101bc / 102bc to obtain the second acquired image. In some embodiments, the processor 150 may also separate the second overlapping portion 100bb of the first acquired image 100 based only on the determination portion 101bc / 102bc to obtain the second acquired image.
[0107] It should be noted that, in some embodiments of the present invention, the processor 150 is further adapted to combine the separation result of the second overlapping portion 100bb with the first overlapping portion 101ab / 102ab and the determination portion 101bc / 102bc of the first acquired image 100 to obtain the second acquired image. Figure 4 and Figure 5 As shown, in the second acquisition image, only the first area 101a of the acquisition pattern 101 corresponding to the first light source 111 and the first area 102a of the acquisition pattern 102 corresponding to the second light source 112 overlap (i.e. Figure 4 and Figure 5 The area indicated by 103 in the figure cannot read fingerprint information, becoming a "dead zone". This shows that the technical solution of the present invention can effectively reduce the area of the "dead zone", which is conducive to breaking the limitation of the range of fingerprint information extraction.
[0108] On the other hand, Figure 4 and Figure 5 As shown, the distance between the first light source 111 and the second light source 112 is very small, less than However, there is still an unreadable “dead zone” in the first collected image 100. It can be seen that the distance between adjacent point light sources cannot be too small.
[0109] refer to Figure 7 and Figure 8 , Figure 7 is a schematic diagram of a first captured image obtained by another embodiment of the image capture device of the present invention; Figure 8 yes Figure 7 The simulation results of the first captured image obtained by the embodiment of the image capture device are shown.
[0110] like Figure 7 and Figure 8 As shown, the distance between one light source and another light source in the light source is relatively large, so that part of the first area 201a / 202a of the acquisition pattern 201 / 202 corresponding to one light source in the light source assembly overlaps with the second area 202b / 201b of the acquisition pattern 202 / 201 corresponding to the other light source, and the first acquisition image 200 at the corresponding position of the overlapping part is the first overlapping part 201ab / 202ab.
[0111] It should be noted that when the distance D between one light source and another light source in the light source satisfies , and R>3r, the first area 201a / 202a of the acquisition pattern 201 / 202 corresponding to one light source in the light source assembly only partially overlaps with the second area 202b / 201b of the acquisition pattern 202 / 201 corresponding to the other light source. When R<3r, a "dead zone" exists in the first acquired image regardless of how the distance D between one light source and another light source varies. However, the area of the "dead zone" in the first acquired image can be reduced by adjusting the distance D between one light source and another light source.
[0112] like Figure 7 and Figure 8 As shown, the distance between the first light source and the second light source in the light source assembly is relatively large, so that the first area 201a of the collection pattern 201 corresponding to the first light source and the second area 202b of the collection pattern 202 corresponding to the second light source partially overlap.
[0113] In some embodiments, the image acquisition device is also an under-screen image acquisition device. When the first area 201a of the acquisition pattern 201 corresponding to the first light source and the second area 202b of the acquisition pattern 202 corresponding to the second light source partially overlap, part of the first area 202a of the acquisition pattern 202 corresponding to the second light source also overlaps with the second area 201b of the acquisition pattern 201 corresponding to the first light source.
[0114] Therefore, the first acquisition image 200 has two first overlapping parts, namely the first overlapping part 201ab and the first overlapping part 202ab, wherein the first overlapping part 201ab corresponds to the overlapping part of the first area 201a of the acquisition pattern 201 corresponding to the first light source and the second area 202b of the acquisition pattern 202 corresponding to the second light source; the first overlapping part 202ab corresponds to the overlapping part of the first area 202a of the acquisition pattern 202 corresponding to the second light source and the second area 201b of the acquisition pattern 201 corresponding to the first light source. Since the signal strength of the first area 201a and the first area 202a is approximately zero when the acquisition patterns 201 and 202 corresponding to the first light source and the second light source respectively do not overlap, when the acquisition patterns 201 and 202 corresponding to the first light source and the second light source respectively occur as shown in FIG. Figure 7 and Figure 8 When overlapping as shown, the first overlapping portion 201ab can be approximately regarded as containing only the image of the second area 202b at the position of the first overlapping portion 201ab, and the first overlapping portion 202ab can be approximately regarded as containing only the image of the second area 201b at the position of the first overlapping portion 202ab, that is, the first overlapping portions 201ab and 202ab can be approximately regarded as containing only the detection image from a single light source, rather than the superposition of the detection images of the first light source and the second light source respectively.
[0115] Therefore, the processor may process the first acquired image 200 in combination with at least one of the first overlapping portion 201ab and the first overlapping portion 202ab to obtain the second acquired image. For example, the processor may perform separation and analysis processing on the first acquired image 200 in combination with at least one of the first overlapping portion 201ab and the first overlapping portion 202ab to obtain the second acquired image.
[0116] It should be noted that the second area 201b / 202b of the acquisition pattern 201 / 202 corresponding to one light source in the light source assembly partially overlaps with the second area 202b / 201b of the acquisition pattern 202 / 201 corresponding to another light source, and the first acquisition image 200 at the corresponding position of the overlapping part is the second overlapping part 200bb.
[0117] But if Figure 7 and Figure 8As shown, when the distance between the first light source and the second light source in the light source assembly is relatively large, so that only a portion of the first area 201a / 202a of the collection pattern 201 / 202 corresponding to the one light source overlaps with the second area 202b / 201b of the collection pattern 202 / 201 corresponding to the other light source, there are still portions of the first area 201a of the collection pattern 201 corresponding to the one light source and the first area 202a of the collection pattern 202 corresponding to the other light source that do not overlap (i.e. Figure 7 and Figure 8 These areas are still “dead zones” where fingerprint information cannot be read. Therefore, the distance between adjacent point light sources cannot be too large.
[0118] refer to Figure 9 , Figure 9 It is a schematic diagram of a first captured image obtained by another embodiment of the image capture device of the present invention.
[0119] like Figure 9 As shown, the spacing between one light source and another light source in the light source assembly is appropriate, so that the entire first area 301a / 302a of the acquisition pattern 301 / 302 corresponding to the one light source in the light source assembly overlaps with the second area 302b / 301b of the acquisition pattern 302 / 301 corresponding to the other light source, and the first acquisition image 300 corresponding to the overlapping portion is a first overlapping portion 301ab / 302ab. The overlapping of the entire first area 301a / 302a of the acquisition pattern 301 / 302 corresponding to the one light source in the light source assembly and the second area 302b / 301b of the acquisition pattern 302 / 301 corresponding to the other light source means that the position corresponding to the first area 301a / 302a of the acquisition pattern 301 / 302 corresponding to the one light source in the light source assembly is completely within the range of the second area 302b / 301b of the acquisition pattern 302 / 301 corresponding to the other light source.
[0120] It should be noted that, in order to make all first areas 301a / 302a of the collection pattern 301 / 302 corresponding to one light source in the light source assembly overlap with the second areas 302b / 301b of the collection pattern 302 / 301 corresponding to another light source, when the distance D between one light source and another light source in the light source assembly satisfies: , and R>3r, all first areas 301a / 302a of the acquisition pattern 301 / 302 corresponding to one light source in the light source assembly overlap with the second area 302b / 301b of the acquisition pattern 302 / 301 corresponding to another light source, and the first area 301a / 302a of the acquisition pattern 301 / 302 corresponding to one light source in the light source assembly does not overlap with the first area 302a / 301a of the acquisition pattern 302 / 301 corresponding to the other light source. At this time, there is no "dead zone" in the first acquisition image 300, and the range of fingerprint information contained is the largest.
[0121] In this embodiment, the image acquisition device is also an under-screen image acquisition device. When all first areas 301a of the acquisition pattern 301 corresponding to the first light source overlap with the second area 302b of the acquisition pattern 302 corresponding to the second light source, all first areas 302a of the acquisition pattern 302 corresponding to the second light source also overlap with the second area 301b of the acquisition pattern 301 corresponding to the first light source.
[0122] Therefore, the first acquisition image 300 has two first overlapping portions, namely a first overlapping portion 301ab and a first overlapping portion 302ab, wherein the first overlapping portion 301ab corresponds to the position of the first area 301a of the acquisition pattern 301 corresponding to the first light source; and the first overlapping portion 302ab corresponds to the position of the first area 302a of the acquisition pattern 302 corresponding to the second light source. Since the signal strength of the first area 301a and the first area 302a is approximately zero when the acquisition patterns 301 and 302 corresponding to the first light source and the second light source respectively do not overlap, when the acquisition patterns 301 and 302 corresponding to the first light source and the second light source respectively overlap, Figure 9 When overlapping as shown, the first overlapping portion 301ab can be approximately regarded as containing only the image of the second area 302b at the position of the first overlapping portion 301ab, and the first overlapping portion 302ab can be approximately regarded as containing only the image of the second area 301b at the position of the first overlapping portion 302ab, that is, the first overlapping portions 301ab and 302ab can be approximately regarded as containing only the detection image from a single light source, rather than the superposition of the detection images of the first light source and the second light source respectively.
[0123] Therefore, the processor may process the first acquired image 300 in combination with at least one of the first overlapping portion 301ab and the first overlapping portion 302ab to obtain the second acquired image. For example, the processor may perform separation and analysis processing on the first acquired image 300 in combination with at least one of the first overlapping portion 301ab and the first overlapping portion 302ab to obtain the second acquired image.
[0124] like Figure 9 As shown, when the distance between one light source and another light source in the light source is appropriate, so that all the first areas 301a / 302a of the acquisition pattern 301 / 302 corresponding to one light source in the light source assembly overlap with the second areas 302b / 301b of the acquisition pattern 302 / 301 corresponding to another light source, fingerprint information can be read in all position areas of the first acquisition image shown, that is, the "dead zone" can be eliminated in this case.
[0125] It should be noted that the second area 301b / 302b of the acquisition pattern 301 / 302 corresponding to one light source in the light source assembly partially overlaps with the second area 302b / 301b of the acquisition pattern 302 / 301 corresponding to another light source, and the first acquisition image 300 at the corresponding position of the overlapping part is the second overlapping part 300bb.
[0126] refer to Figure 10 , Figure 10 is a simulation result of the first captured image obtained by another embodiment of the image capture device of the present invention. Figure 10 As shown, the spacing between one light source and another light source in the light source assembly is relatively appropriate, so that almost all of the first area 401a / 402a of the acquisition pattern 401 / 402 corresponding to the one light source overlaps with the second area 402b / 401b of the acquisition pattern 402 / 401 corresponding to the other light source. The first acquisition image 400 corresponding to the overlapping portion is a first overlapping portion 401ab / 402ab, thereby increasing the area in the first acquisition image 400 where fingerprint information can be read. The second area 401b / 402b of the acquisition pattern 401 / 402 corresponding to the one light source in the light source assembly partially overlaps with the second area 402b / 401b of the acquisition pattern 402 / 401 corresponding to the other light source. The first acquisition image 400 corresponding to the overlapping portion is a second overlapping portion 400bb.
[0127] It should be noted that in the aforementioned embodiment, the light source assembly only includes the first light source and the second light source. However, the present invention does not limit the number of light sources in the light source assembly, and the number of light sources in the light source assembly can also be 3, 4, or other numbers.
[0128] Specifically, Figure 11 FIG. 1 shows a simulation diagram of an image acquired by another embodiment of the image acquisition device of the present invention. Figure 12 FIG shows a simulation diagram of an image acquired by another embodiment of the image acquisition device of the present invention. Figure 11 The light source component of the fingerprint module shown for collecting images includes three light sources; Figure 12The light source assembly of the fingerprint module shown in the captured image includes four light sources. As can be seen, as the number of light sources in the light source assembly increases, the area of the first overlapping portion in the captured image decreases. Therefore, the configuration of the light source assembly and the small spacing between adjacent light sources can effectively improve the reading density of fingerprint information.
[0129] In addition, the present invention also provides an imaging method for the image acquisition device.
[0130] refer to Figure 13 , shows a flow chart of an embodiment of an imaging method of an image acquisition device of the present invention. Figures 4 and 5 ,in Figure 4 yes Figure 13 A schematic diagram of a first captured image obtained by an embodiment of an imaging method of an image capture device is shown; Figure 5 yes Figure 13 A simulation diagram of the first captured image obtained by the imaging method embodiment of the image capture device shown.
[0131] It should be noted that, in some embodiments of the present invention, the imaging method is applicable to an under-screen fingerprint module. Figures 3 to 5 The image acquisition device used in this embodiment is the image acquisition device provided by the present invention. Specifically, the light source assembly includes at least one of a liquid crystal display, an active matrix organic light-emitting diode display, or a light-emitting diode display. However, this approach is merely an example. In other embodiments of the present invention, the imaging method may also utilize other image acquisition devices that meet the requirements.
[0132] The imaging method includes: first executing step S110 to obtain the first acquired image 100, wherein the first area 101a / 102a of the acquisition pattern 101 / 102 corresponding to one light source in the light source assembly at least partially overlaps with the second area 102b / 101b of the acquisition pattern 102 / 101 corresponding to another light source, and the first acquired image 100 corresponding to the overlapping portion is a first overlapping portion 101ab / 102ab.
[0133] It should be noted that if Figure 4As shown, the collection pattern 101 / 102 corresponding to each light source includes: a first area 101a / 102a and a second area 101b / 102b surrounding the first area 101a / 102a, the first area 01a / 102a is obtained by the sensing component 140 collecting the signal light corresponding to the first light emitted by the light source, and the second area 101b / 102b is obtained by the sensing component 140 collecting the signal light corresponding to the second light emitted by the light source, the first light is the light generated by the light source and the incident angle on the sensing surface 120 is less than the critical angle of total reflection, the second light is the light generated by the light source and the incident angle on the sensing surface 120 is greater than or equal to the critical angle of total reflection.
[0134] Specifically, the collection pattern 101 corresponding to the first light source 111 includes: a first area 101a and a second area 101b surrounding the first area 101a; the collection pattern 102 corresponding to the second light source 112 includes: a first area 102a and a second area 102b surrounding the first area 102a.
[0135] In some embodiments of the present invention, the image acquisition device is an under-screen image acquisition device. When a portion of the first area 101a of the acquisition pattern 101 corresponding to the first light source 111 overlaps with the second area 102b of the acquisition pattern 102 corresponding to the second light source 112, a portion of the first area 102a of the acquisition pattern 102 corresponding to the second light source 112 also overlaps with the second area 101b of the acquisition pattern 101 corresponding to the first light source 111.
[0136] Therefore, the first acquisition image 100 has two first overlapping parts, namely the first overlapping part 101ab and the first overlapping part 102ab, wherein the first overlapping part 101ab corresponds to the overlapping part of the first area 101a of the acquisition pattern 101 corresponding to the first light source 111 and the second area 102b of the acquisition pattern 102 corresponding to the second light source 112; the first overlapping part 102ab corresponds to the overlapping part of the first area 102a of the acquisition pattern 102 corresponding to the second light source 112 and the second area 101b of the acquisition pattern 101 corresponding to the first light source 111.
[0137] like Figure 4 As shown, in this embodiment, a portion of the first area 101 a of the collection pattern 101 corresponding to the first light source 111 and the first area 102 a of the collection pattern 102 corresponding to the second light source 112 overlap.
[0138] Continue to refer Figure 13 After executing step S110, execute step S120 to process the first acquired image 100 in combination with the first overlapping portion 101ab / 102ab to obtain a second acquired image.
[0139] The first overlapping portion 101ab / 102ab corresponds to the overlapping portion of the first area 101a / 102a of the acquisition pattern 101 / 102 corresponding to one light source in the light source assembly and the second area 102b / 101b of the acquisition pattern 102 / 101 corresponding to another light source. The first acquisition image 100 is processed in combination with the first overlapping portion 101ab / 102ab to obtain a second acquisition image, thereby enabling the reading of fingerprint information within part of the first area 101a / 102a, that is, enabling the reading of fingerprint information in the "dead zone", creating conditions for increasing the light source density to possibly reduce or even eliminate the "dead zone", thereby breaking through the limitations of the range of fingerprint information extraction based on the total reflection imaging principle of physical optics.
[0140] In some embodiments of the present invention, executing step S120, the step of obtaining the second collected image includes: obtaining a collection pattern corresponding to the other light source at the corresponding position according to the first overlapping portion. Figure 4 and Figure 5 As shown, the processor 150 obtains the acquisition pattern 102 corresponding to the second light source 112 at the corresponding position according to the first overlapping portion 101ab; the processor 150 also obtains the acquisition pattern 101 corresponding to the first light source 111 at the corresponding position according to the first overlapping portion 102ab.
[0141] It should be noted that, in some embodiments of the present invention, in the step of executing step S110 to obtain the first acquired image, the multiple light sources generate light simultaneously, and the multiple signal lights are simultaneously acquired to obtain the first acquired image 100, and the first acquired image 100 is composed of acquisition graphics corresponding to all light sources in the light source assembly; therefore, executing step S120 to obtain the second acquired image includes: separating the first acquired image 100 in combination with the first overlapping portion 101ab / 102ab, and obtaining the second acquired image based on the separation result.
[0142] In this embodiment, the first acquired image 100 includes an acquisition graphic 101 corresponding to the first light source 111 and an acquisition graphic 102 corresponding to the second light source 112. Step S120 is executed to separate the first acquired image 100 according to the first overlapping portion in the step of obtaining the second acquired image to respectively obtain the acquisition graphic 101 corresponding to the first light source 111 and the acquisition graphic 102 corresponding to the second light source 112; and the second acquired image is obtained based on the acquisition graphic 101 corresponding to the first light source 111 and the acquisition graphic 102 corresponding to the second light source 112.
[0143] It should be noted that the step of separating the first acquired image can be performed by separating the first acquired image 100 according to the imaging principle of linear propagation of light to analytically obtain the acquisition graphic 101 corresponding to the first light source 111 and the acquisition graphic 102 corresponding to the second light source 112; the first acquired image 100 can also be separated using a pre-trained deep learning model.
[0144] In some embodiments of the present invention, in the step of executing step S110 to obtain the first acquired image, the second area 101b / 102b of the acquisition pattern 101 / 102 corresponding to one light source in the light source assembly partially overlaps with the second area 102b / 101b of the acquisition pattern 102 / 101 corresponding to another light source, and the first acquisition image 100 at the corresponding position of the overlapping portion is the second overlapping portion 100bb; the step of separating the first acquired image includes: separating the second overlapping portion 100bb in combination with the first overlapping portion 101ab / 102ab.
[0145] Specifically, such as Figure 4 and Figure 5 As shown, part of the second area 101b of the acquisition pattern 101 corresponding to the first light source 111 and the second area 102b of the acquisition pattern 102 corresponding to the second light source 112 overlap, and the second overlapping portion 100bb is the first acquisition image 100 corresponding to the overlapping portion; therefore, the step of separating the first acquisition image includes: separating the second overlapping portion 100bb according to at least one of the first overlapping portion 101ab and the first overlapping portion 102ab, and obtaining the second acquisition image according to the separation result.
[0146] In addition, if Figure 4 and Figure 5 As shown, in the step of obtaining the first acquired image by executing step S110, the non-overlapping portion of the second area 101b / 102b of the acquisition pattern 101 / 102 corresponding to any light source is the determination portion 101bc / 102bc of the first acquired image 100. In the step of obtaining the second acquired image by executing step S120, the step of obtaining the second acquired image includes processing the first acquired image 100 in combination with the first overlapping portion 101ab / 102ab and the determination portion 101bc / 102bc. Specifically, in the step of obtaining the second acquired image, the second overlapping portion 100bb of the first acquired image 100 is separated based on the first overlapping portion 101ab / 102ab and the determination portion 101bc / 102bc to obtain the second acquired image. In some embodiments, in the step of obtaining the second acquired image, only the second overlapping portion 100bb of the first acquired image 100 is separated based on the determination portion 101bc / 102bc to obtain the second acquired image.
[0147] It should be noted that, in some embodiments of the present invention, executing step S120, the step of obtaining the second acquired image further includes: splicing the separation result of the second overlapping portion 100bb with the first overlapping portion 101ab / 102ab and the determination portion 101bc / 102bc of the first acquired image 100 to obtain the second acquired image.
[0148] like Figure 4 and Figure 5 As shown, in the second acquisition image, only the first area 101a of the acquisition pattern 101 corresponding to the first light source 111 and the first area 102a of the acquisition pattern 102 corresponding to the second light source 112 overlap (i.e. Figure 4 and Figure 5 The area indicated by 103 in the image above is unable to read fingerprint information, becoming a "dead zone." This demonstrates that the technical solution of the present invention can effectively reduce the area of this "dead zone," thereby overcoming the limitations of the range of fingerprint information extraction based on the principle of total reflection imaging based on physical optics.
[0149] refer to Figure 7 and Figure 8 , Figure 7 is a schematic diagram of a first captured image obtained by another embodiment of an imaging method of an image capture device of the present invention; Figure 8 yes Figure 7 The simulation results of the first acquired image obtained by the imaging method embodiment are shown.
[0150] like Figure 7 and Figure 8 As shown, in this embodiment, part of the first area 201a / 202a of the acquisition pattern 201 / 202 corresponding to one light source in the light source assembly overlaps with the second area 202b / 201b of the acquisition pattern 202 / 201 corresponding to another light source, and the first acquisition image 200 at the corresponding position of the overlapping part is the first overlapping part 201ab / 202ab.
[0151] In this embodiment, in the step of obtaining the first acquisition image 200, when the first area 201a of the acquisition pattern 201 corresponding to the first light source and the second area 202b of the acquisition pattern 202 corresponding to the second light source partially overlap, part of the first area 202a of the acquisition pattern 202 corresponding to the second light source also overlaps with the second area 201b of the acquisition pattern 201 corresponding to the first light source.
[0152] Therefore, the first acquisition image 200 has two first overlapping parts, namely the first overlapping part 201ab and the first overlapping part 202ab, wherein the first overlapping part 201ab corresponds to the overlapping part of the first area 201a of the acquisition graphic 201 corresponding to the first light source and the second area 202b of the acquisition graphic 202 corresponding to the second light source; the first overlapping part 202ab corresponds to the overlapping part of the first area 202a of the acquisition graphic 202 corresponding to the second light source and the second area 201b of the acquisition graphic 201 corresponding to the first light source.
[0153] Therefore, in the step of obtaining the second collected image, the first collected image 200 is processed in combination with at least one of the first overlapping portion 201 ab and the first overlapping portion 202 ab to obtain the second collected image.
[0154] But if Figure 7 and Figure 8 As shown, when only part of the first area 201a / 202a of the acquisition pattern 201 / 202 corresponding to the one light source overlaps with the second area 202b / 201b of the acquisition pattern 202 / 201 corresponding to the other light source, there are still parts of the first area 201a of the acquisition pattern 201 corresponding to the one light source and the first area 202a of the acquisition pattern 202 corresponding to the other light source that do not overlap (i.e. Figure 7 and Figure 8 These areas are still “dead zones” where fingerprint information cannot be read.
[0155] It should be noted that the second area 201b / 202b of the acquisition pattern 201 / 202 corresponding to one light source in the light source assembly partially overlaps with the second area 202b / 201b of the acquisition pattern 202 / 201 corresponding to another light source, and the first acquisition image 200 at the corresponding position of the overlapping part is the second overlapping part 200bb.
[0156] refer to Figure 9 , Figure 9 It is a schematic diagram of a first captured image obtained by another embodiment of the imaging method of the image capture device of the present invention.
[0157] like Figure 9 As shown, in this embodiment, all first areas 301a / 302a of the acquisition pattern 301 / 302 corresponding to one light source in the light source assembly overlap with the second area 302b / 301b of the acquisition pattern 302 / 301 corresponding to another light source, and the first acquisition image 300 at the corresponding position of the overlapping part is the first overlapping part 301ab / 302ab.
[0158] The overlapping of all first areas 301a / 302a of the collection pattern 301 / 302 corresponding to one light source in the light source assembly with the second area 302b / 301b of the collection pattern 302 / 301 corresponding to another light source means that the position corresponding to the first area 301a / 302a of the collection pattern 301 / 302 corresponding to one light source in the light source assembly is completely within the range of the second area 302b / 301b of the collection pattern 302 / 301 corresponding to the other light source.
[0159] In this embodiment, in the step of obtaining the first acquisition image 200, when all first areas 301a of the acquisition pattern 301 corresponding to the first light source overlap with the second area 302b of the acquisition pattern 302 corresponding to the second light source, all first areas 302a of the acquisition pattern 302 corresponding to the second light source also overlap with the second area 301b of the acquisition pattern 301 corresponding to the first light source.
[0160] Therefore, the first acquisition image 300 has two first overlapping parts, namely the first overlapping part 301ab and the first overlapping part 302ab, wherein the first overlapping part 301ab corresponds to the position of the first area 301a of the acquisition graphic 301 corresponding to the first light source; the first overlapping part 302ab corresponds to the position of the first area 302a of the acquisition graphic 302 corresponding to the second light source.
[0161] Therefore, in the step of obtaining the second collected image, the first collected image 300 is processed in combination with at least one of the first overlapping portion 301 ab and the first overlapping portion 302 ab to obtain the second collected image.
[0162] So, if Figure 9 As shown, in the step of obtaining the first acquisition image 200, all first areas 301a / 302a of the acquisition pattern 301 / 302 corresponding to one light source in the light source assembly are overlapped with the second area 302b / 301b of the acquisition pattern 302 / 301 corresponding to another light source, so that fingerprint information can be read in all position areas of the first acquisition image shown, that is, the "dead zone" can be eliminated in this case.
[0163] It should be noted that the second area 301b / 302b of the acquisition pattern 301 / 302 corresponding to one light source in the light source assembly partially overlaps with the second area 302b / 301b of the acquisition pattern 302 / 301 corresponding to another light source, and the first acquisition image 300 at the corresponding position of the overlapping part is the second overlapping part 300bb.
[0164] It should also be noted that in the aforementioned embodiment, the light source assembly in the image acquisition device used in the imaging method includes only a first light source and a second light source. However, the present invention does not limit the number of light sources in the light source assembly, and the light source assembly in the applicable image acquisition device may also include three, four, or other light sources.
[0165] Specifically, Figure 11 FIG. 1 shows a simulation diagram of an image acquired by another embodiment of the imaging method of the image acquisition device of the present invention. Figure 12 FIG. 1 shows a simulation diagram of an image acquired by another embodiment of the imaging method of the image acquisition device of the present invention. Figure 11 The light source assembly of the image acquisition device used in the illustrated example includes three light sources; Figure 12 The light source assembly of the image acquisition device used in the illustrated example includes four light sources. As can be seen, as the number of light sources in the light source assembly of the applicable image acquisition device increases, the area of the first overlapping portion in the captured image decreases accordingly. Therefore, the arrangement of the light source assembly and the small spacing between adjacent light sources can effectively improve the fingerprint information reading density.
[0166] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention should be based on the scope defined by the claims.
Claims
1. An image acquisition device, characterized in that: include: A light source assembly, the light source assembly comprising a plurality of light sources, the plurality of light sources generating light simultaneously; a sensing surface, wherein the light generated by the plurality of light sources is incident on the sensing surface and is reflected to form a plurality of corresponding signal lights; a sensing assembly, the sensing assembly being adapted to simultaneously collect the plurality of signal lights to obtain a first captured image, the light-sensitive surface of the sensing assembly for collecting the signal lights facing away from the sensing surface, wherein waveguide light formed on the sensing surface is formed by total reflection again on a surface of the image capture device opposite to the sensing surface, and is projected onto the light-sensitive surface of the sensing assembly to be collected, the waveguide light being light that is totally reflected at least once on each of two opposite surfaces of the image capture device; The collection pattern corresponding to each light source includes: a first area and a second area, wherein the first area is an image formed on the sensing component by the signal light corresponding to the first light emitted by the light source, and the second area is an image formed on the sensing component by the signal light corresponding to the second light emitted by the light source, wherein the first light is light generated by the light source and has an incident angle on the sensing surface less than the critical angle of total internal reflection, and the second light is light generated by the light source and has an incident angle on the sensing surface greater than or equal to the critical angle of total internal reflection; A first area of a collection pattern corresponding to one light source in the light source assembly at least partially overlaps with a second area of a collection pattern corresponding to another light source, and a first collection image at a position corresponding to the overlapping portion is a first overlapping portion; A processor is adapted to separate the first acquired image in combination with the first overlapping portion, and obtain a second acquired image according to the separation result.
2. The image acquisition device according to claim 1, wherein: A portion of a first area of a collection pattern corresponding to a light source in the light source assembly overlaps with a portion of a second area of a collection pattern corresponding to another light source.
3. The image acquisition device according to claim 1, wherein: The entire first area of the collection pattern corresponding to one light source in the light source assembly overlaps with the second area of the collection pattern corresponding to another light source.
4. The image acquisition device according to claim 1, wherein: A portion of the first area of the collection pattern corresponding to one light source in the light source assembly overlaps with a first area of the collection pattern corresponding to another light source.
5. The image acquisition device according to any one of claims 1 to 4, characterized in that: The processor is adapted to obtain a collection pattern corresponding to the other light source at a corresponding position according to the first overlapping portion.
6. The image acquisition device according to claim 1, wherein: The second area of the acquisition pattern corresponding to one light source in the light source assembly partially overlaps with the second area of the acquisition pattern corresponding to another light source, and the first acquisition image at a position corresponding to the overlapping portion is a second overlapping portion; The processor is adapted to separate the second overlapping portion in conjunction with the first overlapping portion.
7. The image acquisition device according to claim 1, wherein: In the second area of the acquisition pattern corresponding to any light source, the non-overlapping portion is the determined portion of the first acquisition image; The processor is adapted to process the first acquired image in combination with the first overlapping portion and the determining portion.
8. The image acquisition device according to claim 1, wherein: Also includes: A light shielding layer is located on a side of the sensing component facing the sensing surface.
9. The image acquisition device according to claim 1, wherein: The light source includes a point light source, and the reflected light generated by the multiple light sources on the sensing surface has at least a partially overlapping projection range on the sensing component.
10. The image acquisition device according to claim 1, wherein: The light source includes a plurality of point light sources, and the projection ranges of the reflected lights formed by the plurality of point light sources in one light source on the sensing surface do not overlap on the sensing component.
11. The image acquisition device according to claim 9 or 10, characterized in that: The distance between a point light source of the one light source and the closest point light source of the other light source is less than , where H is the distance between the point light source and the sensing surface, n is the refractive index of the material between the point light source and the sensing surface, R is the radius of the projection range of the second light generated by the point light source on the sensing surface, and k is the magnification ratio of the collected pattern compared to the real fingerprint pattern.
12. The image acquisition device according to claim 11, wherein: When R>3r, the distance between a point light source of the one light source and the closest point light source of the other light source is and Within the range of , r is the radius of the transmission range of the first light generated by the point light source on the sensing surface.
13. The image acquisition device according to claim 9 or 10, characterized in that: The light source assembly includes at least one of a liquid crystal display, an active matrix organic light emitting diode display or a light emitting diode display.
14. The image acquisition device according to claim 1 or 8, characterized in that: The first area and the second area of the collection pattern corresponding to the light source are adjacent to each other, and the signal strength of the second area is greater than the signal strength of the first area.
15. The image acquisition device according to claim 1 or 8, characterized in that: The signal intensity of the first area of the acquisition pattern corresponding to the light source is approximately zero.
16. An imaging method of an image acquisition device, characterized in that: The image acquisition device comprises: A light source assembly, the light source assembly comprising a plurality of light sources, the plurality of light sources generating light simultaneously; a sensing surface, wherein the light generated by the plurality of light sources is incident on the sensing surface and is reflected to form a plurality of corresponding signal lights; a sensing assembly, the sensing assembly being adapted to simultaneously collect the plurality of signal lights to obtain a first captured image, the light-sensitive surface of the sensing assembly for collecting the signal lights facing away from the sensing surface, wherein waveguide light formed on the sensing surface is formed by total reflection again on a surface of the image capture device opposite to the sensing surface, and is projected onto the light-sensitive surface of the sensing assembly to be collected, the waveguide light being light that is totally reflected at least once on each of two opposite surfaces of the image capture device; The collection pattern corresponding to each light source includes: a first area and a second area, wherein the first area is an image formed on the sensing component by the signal light corresponding to the first light emitted by the light source, and the second area is an image formed on the sensing component by the signal light corresponding to the second light emitted by the light source, wherein the first light is light generated by the light source and has an incident angle on the sensing surface less than the critical angle of total internal reflection, and the second light is light generated by the light source and has an incident angle on the sensing surface greater than or equal to the critical angle of total internal reflection; The imaging method comprises: Obtaining the first captured image, wherein a first area of a capture pattern corresponding to one light source in the light source assembly at least partially overlaps with a second area of a capture pattern corresponding to another light source, and the first captured image at a position corresponding to the overlapping portion is a first overlapping portion; The first collected image is separated in combination with the first overlapping portion, and a second collected image is obtained according to the separation result.
17. The imaging method according to claim 16, wherein: A portion of a first area of a collection pattern corresponding to a light source in the light source assembly overlaps with a portion of a second area of a collection pattern corresponding to another light source.
18. The imaging method according to claim 16, wherein: The entire first area of the collection pattern corresponding to one light source in the light source assembly overlaps with the second area of the collection pattern corresponding to another light source.
19. The imaging method according to claim 16, wherein: A portion of the first area of the collection pattern corresponding to one light source in the light source assembly overlaps with a first area of the collection pattern corresponding to another light source.
20. The imaging method according to any one of claims 16 to 19, wherein: The step of obtaining a second collected image includes: obtaining a collection pattern corresponding to the other light source at a corresponding position according to the first overlapping portion.
21. The imaging method according to claim 16, wherein In the step of obtaining the first collected image, the second area of the collection pattern corresponding to one light source in the light source assembly partially overlaps with the second area of the collection pattern corresponding to another light source, and the first collected image at a position corresponding to the overlapping portion is the second overlapping portion; The step of separating the first collected image includes: separating the second overlapping portion in combination with the first overlapping portion.
22. The imaging method according to claim 16, wherein: In the step of obtaining the first collected image, the non-overlapping portion of the second area of the collection pattern corresponding to any light source is the determined portion of the first collected image; The step of obtaining the second collected image includes: processing the first collected image in combination with the first overlapping portion and the determining portion.
23. The imaging method according to claim 16, wherein: The first area and the second area of the collection pattern corresponding to the light source are adjacent to each other, and the signal strength of the second area is greater than the signal strength of the first area.
24. The imaging method according to claim 23, wherein: The signal intensity of the first area of the acquisition pattern corresponding to the light source is approximately zero.
25. The imaging method according to claim 16, wherein The imaging method is applicable to under-screen fingerprint modules.
26. The imaging method according to claim 25, wherein The light source assembly includes at least one of a liquid crystal display, an active matrix organic light emitting diode display or a light emitting diode display.
Citation Information
Patent Citations
Texture recognition apparatus and driving method for texture recognition apparatus
WO2020220302A1