Biometric feature collection and identification system and method, terminal
The biometric feature collection and identification system addresses issues of low image quality and hygiene concerns in contact sensors by using an aerial guidance screen and non-contact image processing, ensuring safer and efficient biometric feature collection and identification.
Patent Information
- Application Number
- KR1020237026629
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-01-06
- Filing Date
- 2022-01-05
- Publication Date
- 2026-11-11
- Estimated Expiration
- 2042-01-05
AI Technical Summary
Fingerprint identification systems using contact sensors suffer from low image quality, small collected area, and hygiene concerns due to physical contact, and feature-point-based matching algorithms are sensitive to image quality.
A biometric feature collection and identification system that uses an imaging subsystem to visualize a guidance screen in an aerial target area, with a detection module to trigger image collection when the target object's pose matches the guidance pose, and an image processing module to process and identify biometric features without physical contact.
Enables safer, more efficient, and intuitive non-contact biometric feature collection and identification by eliminating the need for physical contact with equipment and reducing image quality sensitivity, while ensuring accurate feature extraction and user convenience.
Smart Images

Figure 112023096551128-PCT00001_ABST
Abstract
Description
Technology Field
[0001] The present disclosure relates to the field of imaging identification technology, and in particular to a biometric feature collection identification system, a terminal, and a biometric feature collection identification method. Background Technology
[0002] In related technologies, fingerprint identification systems use contact sensors (e.g., contact optical sensors or contact capacitive sensors) to collect fingerprint images and match them using feature-point-based matching algorithms. However, feature-point-based matching algorithms are highly sensitive to the quality of the fingerprint image; contact sensor-based fingerprint image collection equipment cannot guarantee image quality and suffers from disadvantages such as a small collected fingerprint area, low resolution, and a lack of feature points. Furthermore, because this method relies on physical contact between the finger and the fingerprint detection device, user hygiene concerns arise due to the requirement to place the finger against the scanner. The problem to be solved
[0003] The present disclosure aims to solve at least one of the technical problems existing in the prior art. To this end, the first objective of the present disclosure is to provide a biological feature collection and identification system. The method of operation of the collection and identification system is simpler, and can prevent risks caused by contact with the equipment during user operation.
[0004] The second objective of the present disclosure is to provide a terminal device.
[0005] The third objective of the present disclosure is to provide a method for identifying biological features collected. means of solving the problem
[0006] To solve the above technical problem, a first aspect of the present disclosure provides a biometric feature collection identification system. This includes an imaging subsystem and a collection identification subsystem. The imaging subsystem includes an imaging module used to visualize and display a guidance screen for biometric feature collection identification in an aerial target area; and a detection module used to transmit a collection trigger signal when a target object is detected to exist in the aerial target area, the target object interacts with the guidance screen, and the pose of the target object corresponds to the guidance pose of the guidance screen. The collection identification subsystem includes an image collection module used to collect image information of a target object within the aerial target area in response to the collection trigger signal; an image storage module used to store biometric feature information; and an image processing module connected to the image collection module and the image storage module, which performs biometric feature processing according to the image information, stores the processed biometric feature information in the image storage module, or compares the processed biometric feature information with the biometric feature information stored in the image storage module to identify a user identity.
[0007] The biometric feature collection and identification system of the present disclosure embodiment visualizes a guidance screen for biometric feature collection and identification in an aerial target area through an imaging module. That is, since the aerial target area is used as a reference plane for user operation, the user can perform operations according to the guidance screen appearing at a point in the aerial target area. Additionally, when the detection module detects that the pose of the target object corresponds to the guidance pose on the guidance screen, it transmits a collection trigger signal to the image collection module. The image collection module captures an image of the target object within the aerial target area, and the image processing module performs biometric feature processing according to the corresponding image information to store or identify the user's biometric features, thereby realizing the purpose of non-contact collection and identification of the user's biometric features. Furthermore, in the present disclosure embodiment, the user can trigger the image collection module to perform image information collection and identification by touching the guidance screen in the aerial target area. Since there is no need to install additional restraining devices to guide user operation and there is no need to contact the main body of the equipment during the collection and identification process, the user can perform non-contact biometric feature collection and identification operations more safely and efficiently.
[0008] In some embodiments, the imaging module comprises: a housing having a display window formed therein and a receiving cavity formed therein; a display screen installed in the receiving cavity and used to display a guide screen for identifying the biological feature collection; an optical assembly installed in the receiving cavity and used to converge and image the light of the guide screen displayed by the display screen onto the aerial target area—wherein the display screen is installed on the light source side of the optical assembly and the display window is on the imaging side of the optical assembly—; and a main control unit installed in the receiving cavity and used to control the display screen.
[0009] In some embodiments, the imaging module is connected to the main control unit and further includes a data processing module used to transmit guidance notification information when it is detected that the pose of the target object does not match the guidance pose of the guidance screen. The main control unit controls the display screen to display the guidance notification information. The optical assembly converges and images the light of the guidance notification information displayed by the display screen onto the aerial target area.
[0010] In some embodiments, the image collection module comprises at least one image collection unit used to collect image information of a target object within the aerial target area; and a control unit connected to each of the image collection units and used to control the image collection units to operate in response to the collection trigger signal.
[0011] In some embodiments, the image acquisition unit is installed on the imaging side of the optical assembly, and the optical axis of the image acquisition unit and the normal to the imaging plane of the aerial target area form a preset angle.
[0012] In some embodiments, the image acquisition unit is installed on the imaging side of the optical assembly. A beam splitter is installed on the surface of the imaging side of the optical assembly. The beam splitter is used to reflect image information of the target object in the aerial target area and to transmit the image information to the image acquisition unit.
[0013] In some embodiments, the optical axis of the image acquisition unit and the normal to the imaging plane of the aerial target area are perpendicular, and the beam splitter is a semi-transparent, semi-reflective beam splitter with respect to visible light. Or, the optical axis of the image acquisition unit and the normal to the imaging plane of the aerial target area are perpendicular, the image acquisition unit is an infrared image acquisition unit, and the beam splitter is a beam splitter that projects visible light and reflects infrared light.
[0014] In some embodiments, the image acquisition module further includes at least one total reflection unit used to transmit image information of the aerial target area target object reflected by the beam splitter to the image acquisition unit by total reflection.
[0015] In some embodiments, the image collection unit is installed on the light source side of the optical assembly, and the optical axis of the image collection unit and the plane containing the aerial target area form a preset angle.
[0016] In some embodiments, a through hole is installed at a position penetrating the optical axis of the corresponding image collection unit on the optical assembly.
[0017] In some embodiments, the image capture module is connected to the control unit and further includes a lighting unit used to activate lighting in response to the capture trigger signal.
[0018] In some embodiments, the lighting unit is a backlight assembly of the display screen, and the main control unit is further used to control the backlight assembly of the display screen to emit lighting light in a preset mode in response to the collection trigger signal. Alternatively, the lighting unit is installed on the imaging side of the optical assembly, and the illumination surface of the lighting unit faces the aerial target area.
[0019] In some embodiments, the lighting unit is installed on the light source side of the optical assembly and is installed opposite the display screen.
[0020] In some embodiments, a diffuse reflection layer is installed on the surface of the display screen, and the irradiation surface of the lighting unit faces the surface of the display screen. Or, the irradiation surface of the lighting unit faces the aerial target area.
[0021] An embodiment according to a second aspect of the present disclosure provides a terminal. It includes an equipment body; and a biometric feature collection identification system according to the embodiment. The biometric feature collection identification system is installed on the equipment body.
[0022] The terminal of the present disclosed embodiment can prevent risks associated with contacting the equipment during user operation by adopting a biometric feature collection and identification system according to the embodiment to collect and identify the user's biometric feature information. Furthermore, since there is no need to install additional restriction devices to guide user operation, contactless fingerprint collection operation is safer and more efficient.
[0023] An embodiment according to a third aspect of the present disclosure provides a method for collecting and identifying biometric features. This includes the steps of: providing an aerial target area; visualizing a guidance screen for collecting and identifying biometric features in the aerial target area; collecting image information of a target object within the aerial target area when it is detected that a target object exists in the aerial target area, the target object interacts with the guidance screen, and the pose of the target object corresponds to the guidance pose of the guidance screen; and performing biometric feature processing according to the image information, storing the processed biometric feature information, or comparing the processed biometric feature information with the stored biometric feature information to identify a user identity.
[0024] The biometric feature collection and identification method according to the present disclosure embodiment visualizes a guidance screen for biometric feature collection and identification in an aerial target area. That is, since the aerial target area is used as a reference plane for user operation, the user can perform operations according to the guidance screen appearing in the aerial target area. Furthermore, when it is detected that the target object corresponds to a guidance pose on the guidance screen, image information of the target object within the aerial target area is collected, and biometric feature processing is performed according to the image information. By storing the processed biometric feature information or identifying the user's identity, the purpose of non-contact collection and identification of the user's biometric features is realized. In addition, in the present disclosure embodiment, the operation method in which the user touches the guidance screen in the aerial target area to collect image information when it corresponds to a guidance pose within the guidance screen is easier and more intuitive. It eliminates the need to install additional restriction devices to guide user operation and prevents risks caused by contact with the main body of the equipment during user operation, making it safer and more efficient when the user performs non-contact identification operations.
[0025] In some embodiments, the step of performing biological feature processing according to the image information comprises: a step of acquiring a biological feature interest region among the image information; a step of acquiring a pre-processed image by pre-processing the biological feature interest region; a step of extracting feature points among the pre-processed image; and a step of determining target biological features by performing similarity matching on the feature points.
[0026] In some embodiments, the method further includes the step of acquiring a three-dimensional biological feature image of a target object according to image information of a target object within an aerial target area collected in a different direction before acquiring a biological feature interest region among the image information; and the step of unfolding the three-dimensional biological feature image into an equivalent two-dimensional biological feature image.
[0027] In some embodiments, after performing similarity matching on the feature points, the method further comprises: a step of transmitting guidance notification information when it is detected that the pose of the target object and the guidance pose among the guidance screens do not match; and a step of controlling a display screen to display the guidance notification information, and converging and imaging the light of the guidance notification information displayed by the display screen onto the aerial target area.
[0028] In some embodiments, the bio-feature collection and identification method further comprises: detecting an interaction action between a target object within the aerial target area and the guidance screen; providing a bio-feature interaction screen according to the interaction action between the target object and the guidance screen; and visualizing the bio-feature interaction screen in the aerial target area.
[0029] Additional aspects and advantages of the present disclosure are described in part below, some of which may become clear from the following description or be understood through the practice of the present disclosure. Brief explanation of the drawing
[0030] The above and / or additional aspects and advantages of the present disclosure will be obvious and easily understood from the description of the embodiments together with the accompanying drawings below. FIG. 1 is a structural block diagram of a biological feature collection identification system according to one embodiment of the present disclosure. FIG. 2 is a structural diagram of a biological feature collection identification system according to one embodiment of the present disclosure. FIG. 3 is a structural diagram of a human-computer interaction according to one embodiment of the present disclosure. FIG. 4 is a structural diagram of an optical assembly according to one embodiment of the present disclosure. FIG. 5 is a schematic diagram of a first optical waveguide array and a second optical waveguide array according to one embodiment of the present disclosure. FIG. 6 is a front view of an optical assembly along the thickness direction according to one embodiment of the present disclosure. FIG. 7 is a partial structural diagram of a first optical waveguide array and a second optical waveguide array according to one embodiment of the present disclosure. FIG. 8 is a schematic diagram of the optical path of an optical assembly according to one embodiment of the present disclosure. FIG. 9 is a structural diagram of a biological feature collection identification system according to another embodiment of the present disclosure. FIG. 10 is a schematic diagram of three image collection units performing image information collection according to one embodiment of the present disclosure. FIG. 11 is a schematic diagram of a feature extraction method of three image collection units according to one embodiment of the present disclosure. FIG. 12 is a schematic diagram of a feature extraction method of three image collection units according to another embodiment of the present disclosure. FIG. 13 is a schematic diagram showing that the optical axis of an image collection unit according to one embodiment of the present disclosure and the normal of the imaging plane of an aerial target area form a preset angle. FIG. 14 is a schematic diagram in which the optical axis of an image collection unit according to one embodiment of the present disclosure and the normal of the imaging plane of an aerial target area are perpendicular. FIG. 15 is a schematic diagram of a total reflection unit according to one embodiment of the present disclosure performing image information collection. FIG. 16 is a schematic diagram showing an image collection unit according to one embodiment of the present disclosure installed on the light source side of an optical assembly. FIG. 17 is a schematic diagram of a lighting unit according to one embodiment of the present disclosure diffusely reflecting through a display screen surface. FIG. 18 is a schematic diagram in which the irradiation surface of a lighting unit according to one embodiment of the present disclosure faces an aerial target area. FIG. 19 is a schematic diagram of a lighting unit installed on a display screen according to one embodiment of the present disclosure. FIG. 20 is a structural block diagram of a terminal according to one embodiment of the present disclosure. FIG. 21 is a flowchart of a method for collecting and identifying biological features according to one embodiment of the present disclosure. FIG. 22 is a flowchart for performing bio-feature processing according to image information according to one embodiment of the present disclosure. Specific details for implementing the invention
[0031] Hereinafter, embodiments of the present invention will be described in detail, and the embodiments described with reference to the attached drawings are exemplary.
[0032] To solve the above-mentioned problems, an embodiment of the first aspect of the present disclosure provides a biological feature collection and identification system with reference to the attached drawings. The biological feature collection and identification system has a more convenient method of operation and can prevent risks associated with contact with equipment during user operation.
[0033] FIG. 1 is a structural block diagram of a biometric feature collection identification system (1000) according to an embodiment of the present disclosure. The biometric feature collection identification system (1000) of the embodiment of the present disclosure includes an imaging subsystem (100) and a collection identification subsystem (200). Here, the biometric features mentioned in the embodiment of the present disclosure may be physiological features shared by the human body, such as fingerprints, faces, palm prints, and irises.
[0034] Here, the imaging subsystem (100) includes an imaging module (110) and a detection module (120). The imaging module (110) is used to image and display a guidance screen for identifying biological feature collection in an aerial target area. The detection module (120) is used to transmit a collection trigger signal when it is detected that a target object is present in the aerial target area, the target object interacts with the guidance screen, and the pose of the target object corresponds to the guidance pose of the guidance screen.
[0035] The collection identification subsystem (200) includes an image collection module (210), an image processing module (220), and an image storage module (230). The image collection module (210) is used to collect image information of a target object within an aerial target area in response to a collection trigger signal. The collection area of the image collection module (210) covers a three-dimensional space containing the aerial target area. The image storage module (230) is used to store biometric feature information. The image processing module (220) is connected to the image collection module (210) and the image storage module (230), performs biometric feature processing according to the collected image information, stores the processed biometric feature information in the image storage module (230), or compares the processed biometric feature information with the biometric feature information stored in the image storage module (230) to identify the user's identity.
[0036] In an embodiment of the present disclosure, a guidance screen for biological feature collection identification is visualized in an aerial target area through an imaging module (110). When a detection module (120) detects that the pose of a target object corresponds to the guidance pose of the guidance screen, it transmits a collection trigger signal to an image collection module (210). In response to the collection trigger signal, the image collection module (210) collects image information of the target object within the aerial target area. An image processing module (220) performs biological feature processing according to the corresponding image information, and an image storage module (230) stores the biological feature information processed by the image processing module (220). That is, the biological feature collection identification system (1000) according to an embodiment of the present disclosure performs biological feature collection identification by adopting a method in which interactive aerial imaging technology and non-contact biological feature collection identification technology are combined.
[0037] Preferably, the biometric feature collection identification of the present embodiment may be fingerprint collection identification, and the biometric feature information may be fingerprint information. Since the position of the guidance screen that the imaging subsystem (100) visualizes and displays in the aerial target area is relatively fixed, it is easy for the user to directly interact with the floating real image, so the user can perform actual operations according to the guidance screen appearing in the aerial target area.
[0038] For example, if it is necessary to collect the user's fingerprint information, the user places their finger in the aerial target area according to the guidance screen, and when the user's finger is placed in the aerial target area and corresponds to the guidance pose on the guidance screen, the image collection module (210) captures the user's fingerprint information as an image, and the image processing module (220) processes the captured image information and stores it in the image storage module (230). Accordingly, the collection of the user's fingerprint information is completed.
[0039] When it is necessary to identify the user's fingerprint information, the user places their finger in the aerial target area according to the guidance screen, and when the user's finger is placed in the aerial target area and corresponds to the guidance pose on the guidance screen, the image collection module (210) captures the user's fingerprint information as an image, and the image processing module (220) processes the captured image information and compares the processed fingerprint information with the fingerprint information stored in the image storage module (230) to identify the user's identity according to the identification result.
[0040] The present disclosure performs image collection identification by triggering the collection identification subsystem (200) by touching an aerial target area, so there is no need to install additional restriction devices to guide user operation, and since the user does not need to contact the main body of the equipment during the collection identification process, the user is safer, more convenient, and more efficient when collecting fingerprints.
[0041] Specifically, the imaging module (110) forms a guide screen, i.e., a real image, that is floated at a determined location point in the air, and covers the three-dimensional space, i.e., the aerial target area, where the floating real image is located. By displaying relevant notification information in the aerial target area and guiding the current user's actions, the imaging module (110) completes the collection and identification of the current user's biometric feature information. Therefore, since the user interacts directly with the floating real image, there is no need to install additional restriction mechanisms to guide user operations, thereby reducing the risk associated with contact between the user and the equipment body and improving the effectiveness of non-contact collection and identification of the biometric feature collection and identification system (1000) of the present disclosure.
[0042] The detection module (120) is used to detect the user's operation regarding the floating real-world image. When it is detected that a target object exists in the aerial target area and the pose of the target object corresponds to the guidance pose on the guidance screen, a collection trigger signal is transmitted to the image collection module (210). The image collection module (210) receives the collection trigger signal and collects image information of the target object within the aerial target area, and the image processing module (220) performs bio-feature processing according to the image information to implement the collection or identification of bio-features. The operation method in which the user touches the aerial target area to trigger the image collection module (210) to perform collection identification is more convenient and intuitive.
[0043] In this embodiment, the detection module (120) can periodically detect interaction operations between the user and the floating real-world image. For example, in the fingerprint collection identification process, the interaction operations include interactions such as location and palm direction. When the user's hand is touched to the floating real-world image area and the touch location and hand direction are detected to correspond to the guidance screen, the detection module (120) transmits a collection trigger signal, the image collection module (210) receives the collection trigger signal and captures an image of the user's hand in the floating real-world image area, and the image processing module (220) processes the hand image to obtain fingerprint information and compares the fingerprint information with stored fingerprint information to determine the user's identity.
[0044] In this embodiment, the detection module (120) may be an optical sensor. The detection type may include, but is not limited to, far-infrared and near-infrared rays, ultrasound, laser interference, optical grating, encoder, optical fiber, or charge-coupled device (CCD). The detection area of the detection module (120) and the guidance screen are located on the same plane and include a three-dimensional space containing the guidance screen. In actual application, the optimal detection type can be selected according to the mounting space, viewing angle, and usage environment, making it easy for the user to operate in the aerial target area in an optimal pose, thereby improving the user experience.
[0045] The collection area of the image collection module (210) covers the location where the guidance screen is located, i.e., the aerial target area, and the said area constitutes the biometric feature collection area. Specifically, when performing biometric feature collection identification, the display position of the guidance screen is relatively fixed. When the detection module (120) detects that the user and the guidance screen are directly interacting, it transmits a collection trigger signal to trigger the image collection module (210) to perform image collection on the user's biometric features at the guidance screen location, and the image processing module (220) processes the biometric-specific image and stores the processed biometric feature information in the image storage module (230) to implement biometric feature collection. Alternatively, the purpose of non-contact biometric feature collection identification of the user is realized by comparing the processed biometric feature information with the stored biometric feature information to identify the user's identity.
[0046] When the image collection module (210) performs image collection, it can accurately match the placement pose of the target object according to the floating real-world image guided without a medium, and at the same time, quickly search for the contour of the target object to match the position of the target object. Therefore, it can accurately extract the center position of the target object in the image and perform main feature extraction within a suitable range surrounding the center position. Thus, the impact of scale, translation, and rotation on the image during image collection is reduced, unreliability caused by the image algorithm is reduced, and potential image algorithm errors in bio-feature extraction and bio-feature matching are reduced.
[0047] In addition, since the location of the floating actual image is determined, the present disclosed embodiment ensures that the collection area of the image collection module (210) covers the location of the floating actual image, and according to the actual situation, the aperture of the image collection module (210) is installed to be as large as possible, thereby increasing the amount of scattered light from the target object during the collection process, so that a clearer image of the target object can be obtained.
[0048] In some embodiments, the image collection module (210) may be used to acquire a plurality of biometric feature information of a user in an aerial target area, and the collection method is not limited to structured light, stereo vision, and optical time of flight (TOF). For example, in the case of collecting and identifying fingerprint information, it may be collected using two high-speed cameras, the two high-speed cameras are installed at a distance of a preset baseline (e.g., camera spacing), and fingerprint images of different parts of at least one finger on the user's palm are acquired through a stereo vision method, fingerprint depth information is acquired according to at least two parallax maps corresponding to different parts of the finger, spliced to construct a 3D fingerprint image of the surface of the finger area, and then unfolded into an equivalent 2D fingerprint image to acquire fingerprint information compatible with a large number of fingerprint databases currently acquired and stored by other methods, for example, fingerprint information acquired by contact. It can be understood that, without considering compatibility with other planar fingerprint information, it is possible to identify and verify the user's identity based solely on the acquired 3D fingerprint image.
[0049] The image processing module (220) performs biometric feature processing on the image information collected by the image collection module (210) to complete the identification of collected biometric features. Here, the processing of the image information includes the extraction of regions of interest, grayscale conversion of the image, enhancement of the image, binarization and segmentation of the image, extraction of feature points, and matching of feature points. Through a series of image pre-processing operations and feature extraction operations, feature data of key points is recorded, and the feature data of key points is stored in the image storage module (230) to realize the purpose of collecting user identity. Alternatively, the feature data of key points is compared with the feature data stored in the image storage module (230), similarity is determined through an algorithm, and finally, the degree of matching of biometric features is determined to determine whether the user biometric features pass, thereby realizing the purpose of verifying the user's identity.
[0050] The image storage module (230) may be a storage device pre-integrated within the system, a cloud server with storage capabilities connected remotely via Wi-Fi, Bluetooth, etc., or a removable portable device such as an SD card or a hard disk, and is not limited thereto. Since the user's biometric feature information is stored through the image storage module (230), it is easy to subsequently extract and use it to identify the user's identity.
[0051] A biometric feature collection identification system (1000) according to the present disclosure embodiment visualizes a guidance screen for biometric feature collection identification in an aerial target area through an imaging module (110). That is, the aerial target area is used as a reference plane for user operation, and the user can operate according to the guidance screen appearing in the aerial target area. When the detection module (120) detects that the pose of the target object corresponds to the guidance pose of the guidance screen, it transmits a collection trigger signal to the image collection module (210). The image collection module (210) captures an image of the target object within the aerial target area, and the image processing module (220) performs biometric feature processing according to the information of the captured image, thereby collecting the user's biometric features or identifying the user's identity, thereby realizing the purpose of non-contact biometric feature collection identification of the user. In the embodiment of the present disclosure, the user can trigger the image collection module (210) to perform image information collection identification by touching the aerial target area. Since there is no need to install additional restriction devices to guide user operation and there is no need to contact the main body of the equipment during the collection and identification process, it is safer and more efficient when users perform non-contact biometric feature collection and identification operations.
[0052] In some embodiments, as illustrated in FIG. 2, the imaging module (110) of the present disclosure includes a housing (10), a display screen (20), an optical assembly (30), and a main control unit (40).
[0053] Here, as illustrated in FIG. 2, a display window (1) is formed in the housing (10), and a receiving cavity (2) is formed inside. A display screen (20) is used to display a guide screen for identifying biological features. An optical assembly (30) is installed in the receiving cavity (2) and is used to converge and image the light of the guide screen displayed by the display screen (20) onto an aerial target area (11). The display screen (20) is installed on the light source side of the optical assembly (30), and the display window (1) is on the imaging side of the optical assembly (30). The display window (1) is used to transmit light refracted by the optical assembly (30). Specifically, the optical assembly (30) may be installed at the display window (1), and the optical assembly (30) refracts the light emitted from the display screen (20), and the refracted light passes through the display window (1) and converges and images onto the aerial target area (11). The main control unit (40) is installed in the receiving cavity (2), and the main control unit (40) is used to control the display screen (20).
[0054] Specifically, as illustrated in FIG. 3, a display screen (20) is mounted on the light source side, which is one side of the optical assembly (30), and the display screen (20) is controlled to display a guide screen. The light of the guide screen displayed by the display screen (20) is visualized and displayed in the aerial target area (11) through the optical assembly (30). The three-dimensional space of the guide screen is the aerial target area (11). The detection module (120) is used to detect interaction operations between the user and the guide screen and feeds back the detected operation signal to the main control unit (40). The main control unit (40) triggers the image collection module (210) to collect an image and performs biometric feature processing on the collected image information through the image processing module (220) to collect biometric feature information or identify the user's identity.
[0055] In the present embodiment, the imaging mode of the display screen (20) may include, but is not limited to, an RGB (red, green, blue) light-emitting diode (LED), an LCD (Liquid Crystal Display), an LCOS (Liquid Crystal on Silicon) element, an OLED (Organic Light-Emitting Diode) array, a projection, a laser, a laser diode, or any other suitable display screen or stereoscopic display screen. The display screen (20) can provide a clear, bright, and high-contrast video light source, and the main control unit (40) controls the display screen (20) to display a guide screen and to converge and image it through the optical assembly (30). This can display a clear floating real image at the aerial target area location, making it easy for the user to operate.
[0056] In this embodiment, the brightness of the display screen (20) is 500 cd / m 2 Since it can be set to be no lower, the effect of brightness loss during optical path propagation can be reduced. Of course, in actual application, the display brightness of the display screen (20) can be adjusted according to the brightness of the ambient light.
[0057] In this embodiment, by performing a viewing angle control process on the display image surface of the display screen (20), the afterimage of the aerial target area (11) can be reduced and the screen quality improved. At the same time, it can also prevent others from peeking, making it easy to apply widely to other input devices that require privacy protection.
[0058] The structure of the optical assembly (30) and the principle of its implementation imaging according to the present disclosure embodiment are described below.
[0059] In some embodiments, the optical assembly (30) may adopt a flat lens, and the flat lens is fixed to the housing (10). As shown in FIG. 4, the flat lens includes two transparent substrates (8), a first optical waveguide array (6) and a second optical waveguide array (7) located between the two transparent substrates (8). Here, the first optical waveguide array (6) and the second optical waveguide array (7) are arranged in close contact and orthogonally on the same plane. Preferably, the thickness of the first optical waveguide array (6) and the second optical waveguide array (7) is the same, making design and production easy.
[0060] Specifically, as illustrated in FIG. 4, the planar lens includes a first transparent substrate (8), a first optical waveguide array (6), a second optical waveguide array (7), and a second glass substrate (8) sequentially from one side of the display screen (20) to one side of the air target area (11).
[0061] Here, the first transparent substrate (8) and the second transparent substrate (8) both have two optical surfaces. The transparent substrate (8) has a transmittance of 90 to 100% for light with a wavelength between 390 nm and 760 nm. The material of the transparent substrate (8) may be at least one of glass, plastic, polymer, and acrylic resin, which is used to protect the optical waveguide array and filter out excess light. Note that if the strength is sufficient after the first optical waveguide array (6) and the second optical waveguide array (7) are in close contact orthogonally, or if there is a thickness limit in the mounted environment, only one transparent substrate (8) may be placed or no transparent substrate (8) may be placed.
[0062] The principle by which the optical assembly (30) implements aerial imaging is that the first optical waveguide array (6) and the second optical waveguide array (7) are composed of a plurality of reflection units (9) with rectangular cross-sections, and the length of each reflection unit (9) is limited by the outer circumference of the optical waveguide array and thus has a different length. As shown in FIG. 5, the extension direction of the reflection unit (9) of the first optical waveguide array (6) is X, the extension direction of the reflection unit (9) of the second optical waveguide array (7) is Y, and the Z direction is the thickness direction of the optical waveguide array. The extension directions (optical waveguide array directions) of the reflection units (9) of the first optical waveguide array (6) and the second optical waveguide array (7) are perpendicular to each other. That is, when viewed in the Z direction (thickness direction), the first optical waveguide array (6) and the second optical waveguide array (7) are arranged to be orthogonal to each other, so that two beams located in the orthogonal direction converge at one point, ensuring that the object image plane (light source side and imaging side) is symmetrical with respect to the planar lens, thereby causing an equivalent negative refraction phenomenon and realizing aerial imaging.
[0063] In some embodiments, as illustrated in FIG. 6, the first optical waveguide array (6) or the second optical waveguide array (7) is composed of a plurality of parallel-arranged reflective units (9) arranged to be tilted 45 degrees from the user's viewing angle. Specifically, the first optical waveguide array (6) may be composed of reflective units (9) that are 45 degrees downward to the left and have a rectangular cross section, and the second optical waveguide array (7) may be composed of reflective units (9) that are 45 degrees downward to the right and have a rectangular cross section. The arrangement direction of the reflective units (9) of the two sets of optical waveguide arrays may be interchangeable. For example, the extension direction of the reflective units (9) in the first optical waveguide array (6) is Y, the extension direction of the reflective units (9) in the second optical waveguide array (7) is X, and the Z direction is the thickness direction of the optical waveguide array. When viewed in the Z direction (thickness direction), the first optical waveguide array (6) and the second optical waveguide array (7) are arranged to be orthogonal to converge two beams located in orthogonal directions to a single point, and the object image plane (light source side and imaging side) is symmetrical with respect to the planar lens to cause the same negative refraction phenomenon, thereby realizing aerial imaging. Here, the optical waveguide material has an optical refractive index n1, and in some embodiments, n1 > 1.4, for example, the value of n1 is 1.5, 1.8, and 2.0, etc.
[0064] As illustrated in FIG. 7, in the case of the first optical waveguide array (6) and the second optical waveguide array (7), there are two intersection surfaces between each reflection unit (9) and the adjacent reflection unit (9), and the intersection surfaces are joined by an adhesive (13) with relatively good light transmittance. Preferably, the adhesive (13) can be selected from a photosensitive adhesive or a thermosetting adhesive, and the thickness of the adhesive (13) satisfies T1 > 0.001 mm, for example, T1 = 0.002 mm, T1 = 0.003 mm, or T1 = 0.0015 mm. The specific thickness can be set according to specific needs. The adhesive (13) is installed between adjacent optical waveguide arrays among the planar lenses and between the optical waveguide array and the transparent substrate (8) to improve rigidity.
[0065] In some embodiments, the cross-section of the reflection unit (9) may be rectangular, and a reflection film (12) is installed on one or both sides along the arrangement direction of the reflection unit (9). Specifically, a reflection film (12) is coated on both sides of each reflection unit (9) in the arrangement direction of the optical waveguide array. The material of the reflection film (12) may be a metallic material such as aluminum or silver, or other non-metallic compound material to implement total reflection. The function of the reflection film (12) is to prevent light from entering the adjacent optical waveguide array without total reflection to form stray light and affect imaging. Alternatively, each reflection unit (9) may have a dielectric film added on the reflection film (12), and the function of the dielectric film is to improve the reflectivity of light.
[0066] The cross-sectional width a and cross-sectional length b of a single reflection unit (9) satisfy 0.1mm ≤ a ≤ 5mm and 0.1mm ≤ b ≤ 5mm, for example, a=2mm and b=4mm or a=3mm and b=5mm. When displaying on a large screen, multiple optical waveguide arrays can be spliced to meet large requirements. The overall shape of the optical waveguide array is set according to the application scenario requirements, and in this embodiment, the two sets of optical waveguide arrays have an overall rectangular structure, the reflection units (9) on the two diagonals are triangular, and the reflection unit (9) in the middle has a trapezoidal structure. The lengths of each reflection unit (9) are different, with the reflection unit (9) on the rectangular diagonal being the longest and the reflection units (9) at both ends being the shortest.
[0067] Additionally, the flat lens may include an anti-reflection member and a visual control member, and the anti-reflection member may increase the overall transmittance of the flat lens and improve the resolution and brightness of the image on the guidance screen of the aerial target area (11). The visual control member may be used to eliminate afterimages on the guidance screen of the aerial target area (11), reduce dizziness of the observer, prevent the observer from peeking into the inside of the device from other angles, and improve the overall aesthetics of the device. Here, the anti-reflection member and the visual control member may be combined, or they may be installed independently between the transparent substrate (8) and the waveguide array, between two layers of waveguide arrays, or on the outer layer of the transparent substrate (8).
[0068] The imaging principle of a planar lens is explained below with reference to Fig. 8, and the specific details are as follows.
[0069] Orthogonal decomposition is performed on an arbitrary optical signal using a two-layer waveguide array structure that is orthogonal to each other at the micron scale. The original signal is projected onto the first optical waveguide array (6), and the projection point of the original signal is used as the origin. A rectangular coordinate system is constructed with an x-axis perpendicular to the first optical waveguide array (6), and the original signal within the rectangular coordinate system is decomposed into signals in which two paths, a signal X located on the x-axis and a signal Y located on the y-axis, are orthogonal to each other. Here, when signal X passes through the first optical waveguide array (6), total reflection is performed on the surface of the reflective film (12) according to a reflection angle equal to the angle of incidence. At this time, signal Y is maintained parallel to the first optical waveguide array (6), and after passing through the first optical waveguide array (6), total reflection is performed on the surface of the reflective film (12) according to a reflection angle equal to the angle of incidence on the surface of the second optical waveguide array (7). The reflected light signal, composed of reflected signal Y and signal X, is likely to form mirror symmetry with the original light signal. Therefore, light from any direction can form mirror symmetry when passing through this flat lens, and the emitted light from any light source converges back into a floating image at a symmetrical position when passing through this flat lens. That is, a guidance screen is visualized in the aerial target area (11). The imaging distance of the floating image is the same as the distance from the flat lens to the image source, which is the display screen (20), and this is equidistant imaging. The position of the floating image is in the air, and the image is displayed directly in the air without a specific carrier. Therefore, the image in the space viewed by the user is the image transmitted from the display screen (20).
[0070] In an embodiment of the present disclosure, when light emitted from a light source of a display screen (20) passes through a flat lens, the above process occurs on the flat lens. Specifically, as shown in FIG. 8, the incident angles of light in the first optical waveguide array (6) are α1, α2, and α3, respectively. The reflection angles of light in the first optical waveguide array (6) are β1, β2, and β3, respectively. Here, α1=β1, α2=β2, and α3=β3. After being reflected through the first optical waveguide array (6), the incident angles on the second optical waveguide array (7) are γ1, γ2, and γ3, respectively. The reflection angles in the second optical waveguide array (7) are δ1, δ2, and δ3, respectively. Here, γ1=δ1, γ2=δ2, and γ3=δ3.
[0071] Furthermore, the convergent and imaged incident angles are α1, α2, α3…, α, respectively. n If the distance between the light source of the display screen (20) and the flat lens is L, the distance between the imaging position of the floating real image and the flat lens is also L, and the viewing angle ε of the floating real image is 2 times max(α).
[0072] It can be understood that if the dimensions of the optical waveguide array are relatively small, images can be viewed only at a certain distance from the imaging side of the optical waveguide array, and if the dimensions of the optical waveguide array increase, a larger imaging distance can be achieved, thereby expanding the field of view.
[0073] Preferably, the angle between the flat lens and the display screen (20) is set to a range of 45°±5°, so that the dimensions of the flat lens are effectively utilized to improve imaging quality and reduce afterimage effects. Additionally, if there are other requirements for the imaging position, a different angle may be selected at the expense of some imaging quality. Preferably, the size of the flat lens can be set to a screen capable of displaying a floating image that the entire display screen (20) represents. However, if only a part of the screen of the display screen (20) needs to be viewed during actual use, the dimensions of the flat lens can be freely adjusted in size and position according to the actual display screen, and this is not limited.
[0074] In addition, the above describes the imaging principle of a planar lens that primarily adopts a two-layer optical waveguide array structure. In some other embodiments, a plurality of cubic columnar reflective units (9) are installed with reflective films (12) on all sides, and the plurality of cubic columnar reflective units (9) are all arranged in an array along the X and Y directions in a single-layer optical waveguide array structure. That is, two layers of optical waveguide arrays are combined into one layer, and the imaging principle thereof is the same as the imaging principle of a two-layer optical waveguide array structure, and can be used as a planar lens structure.
[0075] In this embodiment, since the thickness of the first optical waveguide array (6) and the second optical waveguide array (7) is the same, the complexity of the structure of the first optical waveguide array (6) and the second optical waveguide array (7) is simplified, the difficulty of manufacturing the first optical waveguide array (6) and the second optical waveguide array (7) is lowered, the production efficiency of the first optical waveguide array (6) and the second optical waveguide array (7) is improved, and the production cost of the first optical waveguide array (6) and the second optical waveguide array (7) can be reduced. Here, it should be noted that the same thickness is not absolutely the same, but is a relative range. That is, to improve production efficiency, there may be a certain thickness difference between the optical waveguide arrays under the premise that it does not affect the quality of aerial imaging.
[0076] In this embodiment, the main control unit (40) and the detection module (120) are connected via a wired or wireless method to transmit digital or analog signals, thereby allowing for flexible control of the overall device volume and enhancing the electrical stability of the biometric feature collection identification system (1000).
[0077] As illustrated in FIG. 9, the imaging module (110) of the present disclosure embodiment further includes a data processing module (111). The data processing module (111) is connected to the main control unit (40). The data processing module (111) is used to transmit guidance notification information when the detection module (120) detects that the pose of the target object does not match the guidance pose of the guidance screen. Additionally, the main control unit (40) controls the display screen (20) to display guidance notification information and visualizes the light of the guidance notification information displayed by the display screen (20) through the optical assembly (30) by converging it onto the aerial target area (11). The user completes the collection and identification of user biometric feature information by adjusting the interaction pose according to the guidance notification information to achieve a better interaction.
[0078] A light-absorbing layer is installed on the inner wall of the receiving cavity (2) of the present disclosure embodiment. In other words, all parts within the housing (10) other than the display surface of the display screen (20) undergo black light-absorbing treatment. For example, a light-absorbing paint is sprayed or a light-absorbing film is attached to eliminate diffuse reflection of light from the internal members of the housing (10), thereby improving the display effect of a floating image.
[0079] As illustrated in FIG. 9, the image collection module (210) of the present disclosure embodiment includes at least one image collection unit (21) and a control unit (22). Here, the image collection unit (21) is used to collect image information of a target object within an aerial target area (11). The control unit (22) is connected to each image collection unit (21), and the control unit (22) is connected to a main control unit (40). The control unit (22) is used to control the image collection unit (21) to operate in response to a collection trigger signal. Specifically, the image collection unit (21) is used to collect image information of a target object within an aerial target area in response to a collection trigger signal.
[0080] The image collection unit (21) may be a single or multiple high-speed CMOS cameras. As illustrated in FIG. 10, the image collection unit (21) includes three cameras, and the collection area of each camera covers the area where the guide screen is located. By setting the focal plane position of each camera to the aerial target area (11), image information of different parts of the target object can be clearly captured. For example, when the user's palm is positioned in the aerial target area (11), each camera can clearly capture fingerprint images of different parts of at least one finger. Additionally, if the above conditions are met, the image collection unit (21) may preferably adopt a fixed-focus large-aperture camera, so the process of focusing on the target object position during image capture can be omitted, and the speed, success rate, and reliability of image collection and identification can be improved, and the resolution and brightness of the capture can be improved by ensuring sufficient light transmission even with a large aperture.
[0081] It should be noted that when the collection area of a single focal range of the image collection unit (21) cannot cover the entire floating real-world area, or even if it does cover the entire floating real-world area but all necessary image information cannot be acquired in a single attempt when performing image collection on a target object, the image collection unit (21) must maintain the necessary focus adjustment function. At the same time, by taking the aerial target area (11) as a reference plane and considering the case where this focus adjustment range is relatively small, the image collection unit (21) can acquire a visible light image of the target object and can also acquire an infrared image of the target object. Additionally, the image collection unit (21) may exclude the influence of ambient light by adding a light filter sheet for light in a corresponding wavelength range.
[0082] There are various ways in which the image collection unit (21) extracts key features within a suitable range surrounding the center of the target object, and these are not limited thereto. Below, two feature extraction methods are listed and explained using the example of a case where the image collection unit (21) includes three high-speed CMOS cameras, and specifically as follows.
[0083] As illustrated in FIG. 11, for example, in the case of collecting and identifying fingerprint information, three high-speed CMOS cameras of different directions are installed to acquire images of target objects of different directions, corresponding to collection channel 1, collection channel 2, and collection channel 3, and an image processing module (220) performs feature extraction and matching for each image of each collection channel, and fuses three sets of matching results through an average fusion algorithm to obtain a final comparison result. Alternatively, as illustrated in FIG. 12, three high-speed CMOS cameras of different directions are installed to acquire images of target objects of different directions, and an image processing module (220) acquires target object depth information according to at least two parallax maps corresponding to different directions of the target object, performs splicing to construct a 3D image of the surface of the target object, and then unfolds it into an equivalent 2D target object image, thereby performing feature extraction and feature matching based on the 2D image to obtain a final comparison result.
[0084] Hereinafter, with reference to FIG. 9, a biometric feature collection identification system (1000) of the present disclosure embodiment is described using user fingerprint information as an example. Specifically, it is as follows.
[0085] In the initial state, the main control unit (40) causes the display screen (20) to display a guidance screen, and the guidance screen is visualized and displayed in the air target area (11) via the optical assembly (30). As illustrated in FIG. 3, the optical assembly (30), such as a flat lens, visualizes a palm-shaped image on the display screen (20) in the air on the other side of the flat lens, that is, at the point of the air target area (11), thereby guiding the user to perform fingerprint collection identification in the correct area, and at the same time, the detection module (120), such as an optical sensor, periodically detects the user's interaction operation, which includes position, palm direction interaction, etc. The user places their palm according to the displayed guidance screen, and when the detection module (120) detects that the user's palm touches the air target area and that the position and direction are correct, the detection module (120) transmits a collection trigger signal to the main control unit (40), and the main control unit (40) transmits a control signal to the control unit (22). The control unit (22) controls the image collection unit (21) to start collecting images of the user's palm fingerprint and transmits the image information to the image processing module (220) to perform processing and analysis. It also verifies whether the user identity is passed by comparing it with the internal fingerprint database stored in the image storage module (230). Furthermore, if the image information collection by the image collection unit (21) fails, the data processing module (111) analyzes the cause of failure, such as errors in the direction of the user's palm, movement too fast, or positional bias. Additionally, it generates guidance notification information and transmits it to the main control unit (40), and the main control unit (40) controls the display screen (20) to display the guidance notification information, thereby guiding the user's palm movement to correctly complete the collection of fingerprint information and implement user identity identification.
[0086] Additionally, a detection module (120), such as an optical sensor, may detect other user operations such as clicking or sliding, and transmits interaction operation information to the main control unit (40). The main control unit (40) determines specific user operations, such as selecting a fingerprint recording mode or looking up fingerprint information, according to an internal command set. At the same time, it transmits a UI (User Interface) operation interface, such as related control buttons and settings, to the display screen (20) to display an image in the aerial target area and guide user operations.
[0087] It can be understood that FIG. 9 is merely an example of a biometric feature collection identification system (1000) according to an embodiment of the present disclosure. Here, the image processing module (220) may be installed in conjunction with the data processing module (111) of the direct imaging module (110), or the image processing module (220) and the data processing module (111) of the imaging module (110) may be installed separately, and this is not limited thereto. However, both of these may be used to generate guidance notification information when the image information fails to identify valid biometric features. Additionally, the main control unit (40) and the control unit (22) provided in the embodiment of the present disclosure may be installed in conjunction or installed separately, and this is not limited thereto.
[0088] In this embodiment, the main control unit (40) may be installed directly integrated with the display screen (20), or the main control unit (40) and the display screen (20) may be installed separately. The control command content of the main control unit (40) may be transmitted to an external device and used to process or control other external devices, such as fingerprint locks or attendance record devices. Additionally, it may be understood that the image collection unit (21), control unit (22), and image processing module (220) according to the embodiment of the present disclosure may be controlled by an external device without passing through the main control unit (40).
[0089] An image collection unit (21) according to an embodiment of the present disclosure is installed to face directly the direction of an aerial target area (11). For example, if the image collection unit (21) is a high-speed CMOS camera, the camera optical axis is made perpendicular to the plane containing the guide screen. However, in actual use, due to the presence of the optical assembly (30), the optical axis of the image collection unit (21) and the normal of the guide screen have a single angle of inclination, so the optical axis of the image collection unit (21) is not perpendicular to the plane containing the guide screen, and thus a problem of distortion in the collected image may occur. In response to this, an embodiment of the present disclosure provides various arrangement methods of the image collection unit (21) and methods to respond to distortion that reduce the problem of image distortion. Below, several preferred arrangement methods of the embodiment of the present disclosure will be specifically described.
[0090] In some embodiments, as illustrated in FIG. 13, an image collection unit (21) is installed on the imaging side of an optical assembly (30), and the optical axis of the image collection unit (21) and the normal to the imaging plane of the aerial target area (11) form a preset angle θ (0° < θ < 90°). That is, the image collection unit (21) is positioned above the optical assembly (30). That is, the image collection unit (21) and the guide screen are located on the same side as the optical assembly (30). Under this installation method, after the image collection unit (21) avoids the optical assembly (30), the optical axis of the image collection unit (21) and the normal to the guide screen form a fixed angle θ. Therefore, the embodiments of the present disclosure can obtain clear image information by correcting deformation distortion factors caused by the angle θ when performing processing on the image.
[0091] In some other embodiments, as illustrated in FIG. 14, an image collection unit (21) is installed on the imaging side of the optical assembly (30). At the same time, a beam splitter (31) is positioned on the imaging side, which is the upper surface of the optical assembly (30). Specifically, the beam splitter (31) can transmit a portion of the penetrating light and reflect the other portion, thereby reflecting image information of a target object in the air target area (11) through the beam splitter (31) and transmitting the image information to the image collection unit (21), thereby obtaining clear image information.
[0092] Hereinafter, two preferred methods for installing a beam splitter (31) on the surface of the optical assembly imaging side are described with reference to FIG. 14.
[0093] In some embodiments, as illustrated in FIG. 14, the optical axis of the image acquisition unit (21) and the normal of the imaging plane of the aerial target area (11) are perpendicular, and the image acquisition unit (21) adopts a visible light image acquisition unit. The beam splitter (31) is a visible light semi-transparent semi-reflective beam splitter. That is, it is a beam splitter having a projection ratio of 50% and a reflection ratio of 50% for visible light. The image acquisition unit (21) is installed so that the optical axis is perpendicular to the plane containing the guide screen after being reflected through the beam splitter (31). Thus, when the image acquisition unit (21) needs to acquire a visible light target object image, the image acquisition unit (21) can acquire a target object image that is not deformed or distorted through the reflection of the beam splitter (31).
[0094] In some embodiments, as shown in FIG. 14, the optical axis of the image collection unit (21) and the normal of the imaging plane of the aerial target area (11) are perpendicular, and the image collection unit (21) adopts an infrared image collection unit. The beam splitter (31) is a beam splitter that transmits visible light and reflects infrared light. Since the beam splitter (31) that transmits visible light and reflects infrared light has excellent light transmittance for the visible light wavelength range, adopting this beam splitter (31) can solve the problem of low floating real-image brightness, and since the beam splitter (31) completely reflects infrared light, there is basically no loss of light when capturing infrared images, so the image collection unit (21) can acquire a clear image of the target object.
[0095] In some embodiments, as shown in FIG. 14, a light filter member (24) capable of filtering visible light is installed on the light incident side of the infrared image collection unit to further prevent interference of visible light.
[0096] In some embodiments, the beam splitter (31) according to the present disclosure may be installed to cover the dimensional size of the entire optical assembly (30) or to freely set its size according to the actual image acquisition demand. For example, as shown in FIG. 14, the beam splitter (31) completely covers the surface on the imaging side of the optical assembly (30).
[0097] In some embodiments, as illustrated in FIG. 15, the image collection module (210) of the present disclosure embodiment further includes at least one total reflection unit (25), such as a total reflection mirror. The at least one total reflection unit (25) is used to perform total reflection on image information of a target object in an aerial target area (11) reflected by a beam splitter (31) and to transmit the image information to an image collection unit (21). For example, FIG. 15 adopts a single total reflection mirror so that light scattered from a target object in an aerial target area (11) undergoes total reflection multiple times before finally entering the image collection unit (21). By adopting a total reflection unit (25), the position of the image collection unit (21) can be more freely arranged. For example, the height of the equipment can be lowered by reducing the occupied space, and the total reflection unit (25) does not change the angle state of the final optical axis and the guide screen.
[0098] In some other embodiments, as illustrated in FIG. 16, in the present disclosure, the image collection unit (21) is installed on the light source side of the optical assembly (30), and the optical axis of the image collection unit (21) and the plane containing the aerial target area (11) may be perpendicular or may form other angles. For example, the image collection unit (21) is positioned below the optical assembly (30). That is, the image collection unit (21) and the display screen (20) are located on the same side, and since the optical axis of the image collection unit (21) and the plane containing the aerial target area (11) are perpendicular, the optical assembly (30) has a certain light transmittance, so a target object pattern without deformation distortion can be obtained by effectively utilizing this. It can be understood that the optical axis of the image collection unit (21) and the plane containing the aerial target area (11) may form a preset angle θ, and clear image information can be obtained by correcting the deformation distortion element caused by the angle θ during post-processing.
[0099] Here, when the image acquisition unit (21) is positioned on the light source side of the optical assembly (30), image information is acquired using the light transmittance of the optical assembly (30). However, when acquiring a target object image, since the optical assembly (30) has a large amount of microstructure and light is susceptible to interference from the microstructure, such interference must be eliminated when performing image processing. Below, two preferred solutions provided in the embodiments of the present disclosure are described.
[0100] In some embodiments, the image collection unit (21) adopts an infrared image collection unit. An image of a target object is captured, and a light filter member (24) that filters visible light is installed on the light incident side of the infrared image collection unit to prevent interference of the microstructure.
[0101] In some other embodiments, the embodiment of the present disclosure has a through hole installed on the optical assembly (30) at a position penetrating the optical axis of the corresponding image collection unit (21). By allowing the image collection unit (21) to pass directly through the through hole, the capture of an image of a target object is achieved, thereby reducing interference in the microstructure of the optical assembly (30).
[0102] In some embodiments, as illustrated in FIG. 9, the image collection module (210) of the present disclosure further includes a lighting unit (23). The lighting unit (23) is connected to a control unit (22) and is used to activate lighting in response to a collection trigger signal. Specifically, the control unit (22) is used to control the opening and closing of the image collection unit (21) and the lighting unit (23). The control unit (22) controls the opening and closing of both simultaneously to prevent the lighting unit (23) from always being in an open state, thereby reducing energy consumption, or the control unit (22) may control the image collection unit (21) and the lighting unit (23) individually, and it is understood that this is not limited thereto. The embodiments of the present disclosure use the lighting unit (23) to irradiate light uniformly onto a target object, and can enhance the contrast and resolution of the ridges in the target object image.
[0103] In the present embodiment, the present disclosure allows the position of the lighting unit (23) to be flexibly configured according to lighting requirements, and this is not limited thereto. It should be noted that since the direction of the light source directly determines the direction of the shading of the target object ridges, under irradiation of light sources in different directions, the ridges of the collected target object image have a displacement of up to 2 to 3 times the ridge width. Therefore, the present disclosure improves the quality of the collected image by designing various arrangement methods for the lighting unit. Below, several preferred arrangement methods of the present disclosure are described in detail.
[0104] In some embodiments, the lighting unit (23) is a backlight assembly of the display screen (20). The main control unit (40) is further used to control the backlight assembly of the display screen (20) in response to a collection trigger signal to emit lighting light in a preset mode. For example, when the detection module (120) detects that a target object exists in the aerial target area and that the interaction pose between the target object and the guidance screen corresponds to the guidance pose of the guidance screen, it transmits a collection trigger signal. Furthermore, the main control unit (40) controls the backlight assembly of the display screen (20) in response to the collection trigger signal to emit lighting light in a preset mode, and furthermore, the lighting light emitted from the display screen (20) converges into the aerial target area through the optical assembly (30) to illuminate the target object, thereby enhancing the contrast and resolution of the ridges in the target object image and improving the quality of the collected image.
[0105] Specifically, the imaging mode of the display screen (20) may include an RGB light-emitting diode, an LCOS element, an OLED array, a projection, a laser, a laser diode, or any other suitable display screen or stereoscopic display screen, and the brightness of the display screen (20) is 500 cd / m² 2Since it is not lower than that, in the present disclosed embodiment, the display screen (20) itself can be utilized as a lighting unit (23). When a user performs an operation at an aerial target area (11), the presence of a target object is detected using a detection module (120), and a collection trigger signal is transmitted to a main control unit (40). The main control unit (40) transmits a control command to the display screen (20), and controls the display screen (20), such as the backlight assembly of the display screen (20), to emit a high-brightness blue light strobe once. Since the high-brightness strobe light passes through the optical assembly (30) and converges at the same guide screen position, uniform diffuse reflection can be formed on the surface of the target object. At this time, the control unit (22) synchronously controls the image collection unit (21) to immediately capture the shadows of the ridges and bone lines of the target object, thereby collecting the target object image and inputting it into the image processing module (220), and the image processing module (220) performs biometric feature processing on the target object image information and stores the processed biometric feature processing to complete the feature collection. Alternatively, the purpose of non-contact collection and identification of user biometric features is realized by comparing the processed biometric feature information with the biometric feature information stored in the image storage module (230) to identify the user identity.
[0106] In some embodiments, as illustrated in FIG. 17, the lighting unit (23) according to the present disclosure is positioned below the optical assembly (30). That is, the lighting unit (23) is installed on the light source side of the optical assembly (30) and is installed opposite the display screen (20).
[0107] It should be noted that, in the case of a method in which a lighting unit (23) is installed on the light source side, since all parts except the display surface of the display screen (20) inside the housing (10) are treated to absorb light, there may be three preferred arrangement methods for the lighting unit (23) to improve the quality of the target object image.
[0108] In some embodiments, as illustrated in FIG. 17, a diffuse reflection layer (26) is installed on the surface of a display screen (20). The illumination surface of the lighting unit (23) faces the surface of the display screen (20). That is, in the embodiment of the present disclosure, the lighting unit (23) is mounted on the opposite side of the display screen (20), and at the same time, a diffuse reflection treatment is performed, such as attaching a transparent diffuse reflection film to the surface of the display screen (20), to form a diffuse reflection layer (26). Based on this, light emitted by the lighting unit (23) can be scattered without affecting the transmission of display light. When the control unit (22) triggers the lighting unit (23) to turn on, the light emitted from the lighting unit (23) is scattered through the diffuse reflection layer (26) at a point on the surface of the display screen (20), reflected through the optical assembly (30), and then converges at a point on the guide screen position, thereby forming a uniform light illumination plane and illuminating the ridges of the target object, so that a high-contrast image of the target object is obtained.
[0109] In another embodiment, as illustrated in FIG. 18, the illumination surface of the lighting unit (23) of the present disclosure is directed toward the aerial target area (11). That is, the present disclosure has the lighting unit (23) mounted on the opposite side of the display screen (20). At this time, there is no need to perform diffuse reflection treatment on the surface of the display screen (20), and by installing the light source illumination surface of the lighting unit (23) so as to be directed toward the position of the guide screen and allowing the optical assembly (30) to have a projection effect, the light source of the lighting unit (23) can be made to directly pass through the optical assembly (30) to provide illumination to the target object.
[0110] In the present embodiment, the lighting unit (23) may include a single annular or circular light source, or the lighting unit (23) may include a light source in which a plurality of illumination surfaces face the aerial target area (11), and the plurality of light sources are installed at a predetermined spacing angle. That is, in the case of the arrangement method of the lighting unit (23) shown in FIG. 18, the number of lighting units (23) may be one or a plurality, and this is not limited thereto. Here, the positions of the plurality of lighting units (23) are arranged at different angles to illuminate different parts of at least one target object, such as the left, right, and front sides of the fingerprint, and the illumination areas of the lighting units (23) may overlap at the same time, and this is not limited thereto.
[0111] In this embodiment, the form of the light source provided by the lighting unit (23) is not limited to the light source of the display screen (20) itself, the light source inside the device, or the light source outside the device. The light source may be a visible light source, and the preferred wavelength is a blue LED light source with a wavelength of 450 nm to 470 nm. The target object can acquire a high-contrast image under irradiation of a light source in this wavelength range. Additionally, the light source may be selected as a light source in the infrared wavelength range to prevent visible light from interfering with the guidance screen display effect. It should be noted that a strong light source in all directions weakens the shadows formed by the ridges of the target object and further affects the resolution of the target object image; therefore, the present disclosed embodiment preferably uses an annular light source to acquire a clear target object image. Preferably, an optical member such as a lens or a light equalization plate may be added in front of the light source to improve the lighting effect.
[0112] In some other embodiments, the lighting unit (23) is installed on the display screen (20). For example, the lighting unit (23) includes an annular light source installed to surround the display screen (20). Alternatively, the backlight assembly of the lighting unit (23) and the display screen (20) is installed integrally.
[0113] As illustrated in FIG. 19, the lighting unit (23) of the present disclosure embodiment uses an annular LED light source to surround the display screen (20) once. When the lighting unit (23) is turned on, the light emitted by the annular LED light source is reflected through the optical assembly (30) and then provides light to the guide screen location. Alternatively, the direct lighting unit (23) is integrated with the backlight assembly of the display screen (20). For example, taking an LCD display screen as an example, when the LED lighting is triggered, the LCD display screen can be controlled so that all the light passes through, so that the light emitted by the lighting unit (23) passes through the LCD display screen and is reflected again through the optical assembly (30) and then illuminates the guide screen location.
[0114] In the case of an installation where the lighting unit (23) is located on the imaging side, in some embodiments, the lighting unit (23) may be installed on the imaging side of the optical assembly (30), and the illumination surface of the lighting unit (23) faces the aerial target area (11). In other words, the lighting unit (23) is positioned above the optical assembly (30). That is, the lighting unit (23) and the guide screen are located on the same side of the optical assembly (30), as shown in FIG. 16. Under this arrangement, the arrangement of the lighting unit (23) is made more flexible. For example, an annular blue light LED light source may be adopted to uniformly surround a plurality of image collection units (21). For example, three image collection units (21) and three lighting units (23) are synchronously positioned at different angles to investigate and photograph different locations of the target object, and the three image collection units (21) are each positioned at a narrow angle of 45° within the same plane to ensure that the collected images completely cover the effective area of the target object. The lighting units (23) may also illuminate independently away from the image collection units (21), and the number may be one or more, and preferably, an annular LED light source is adopted to effectively cover different locations of the target object.
[0115] Accordingly, the biometric feature collection and identification system (1000) according to the embodiment of the present disclosure combines interactive aerial imaging technology and non-contact collection and identification technology, so that a location for displaying a guidance screen in the air is determined based on the imaging subsystem (100), and the aerial target area, which is a three-dimensional space containing the guidance screen, is covered and used as a reference plane for image collection by the collection and identification subsystem (200). When a user touches the guidance screen, the detection module (120) transmits a collection trigger signal to trigger the image collection unit (21) to collect user biometric feature information. Therefore, there is no need to install a separate restriction device to guide user operation, and there is no risk of the user coming into contact with the main body of the equipment during operation, so the non-contact biometric feature collection and identification operation can be more convenient, safe, and efficient. In addition, in the present disclosure embodiment, when the aperture of the image collection unit (21) satisfies the depth of field that can cover the actual shooting location, the aperture may be set larger depending on the actual situation to increase the amount of light received from the scattered light of the target object area during the collection process, thereby obtaining a clearer image of the target object and at the same time reducing the requirement for the brightness of the light source of the lighting unit (23).
[0116] An embodiment according to a second aspect of the present disclosure provides a terminal. As illustrated in FIG. 20, a terminal (2000) according to an embodiment of the present disclosure comprises an equipment body (300) and a biometric feature collection identification system (1000) according to the embodiment. Herein, the biometric feature collection identification system (1000) is installed on the equipment body (300).
[0117] The terminal (2000) of the present disclosure embodiment can prevent the risk associated with contacting the equipment during user operation by adopting the biometric feature collection and identification system (1000) according to the embodiment to collect and identify the user's biometric feature information. In addition, since there is no need to guide user operation by installing an additional restriction device, the contactless fingerprint collection operation is safer and more efficient.
[0118] An embodiment according to a third aspect of the present disclosure provides a method for collecting and identifying biological features. As illustrated in FIG. 21, the method according to an embodiment of the present disclosure comprises at least steps S1 to S4.
[0119] Step S1: Provide an aerial target area.
[0120] To address the issues of inconvenience and hygiene risks associated with conventional non-contact fingerprint identification operations, embodiments of the present disclosure adopt a method that combines interactive airborne imaging technology with non-contact biometric feature collection and identification technology to complete the airborne fingerprint collection and identification process with high efficiency.
[0121] In this embodiment, the method of the present disclosure can form a floating image at a fixed position in the air using an interactive air imaging technique, and the floating image position is relatively fixed in the air so that it can cover the three-dimensional space containing the floating image and be used as an air target area.
[0122] Step S2: Visualize a guidance screen for biological feature collection identification onto the aerial target area.
[0123] Optionally, the display screen is controlled to display a guidance screen for biological feature collection identification, and the guidance screen is visualized in the aerial target area through an optical assembly.
[0124] In this embodiment, the guidance screen can be understood as a floating real image to guide user operation, and by adopting interactive aerial imaging technology, the guidance screen for biological feature collection identification can be visualized and displayed in an aerial target area. Through direct interaction with the floating real image, the user can be guided through the operation process without additional restriction mechanisms, thereby avoiding the risk of the user coming into contact with the main body of the equipment.
[0125] Step S3: If a target object exists in the aerial target area, the target object interacts with the guidance screen, and it is detected that the pose of the target object corresponds to the guidance pose of the guidance screen, image information of the target object within the aerial target area is collected.
[0126] Furthermore, when a target object is detected to exist in an aerial target area, interacts with the target object and the guidance screen, and the pose of the target object corresponds to the guidance pose of the guidance screen, the backlight assembly of the display screen is controlled to emit light in a preset mode, and image information of the target object within the aerial target area is collected. By controlling the backlight assembly of the display screen to generate light in a preset mode and emit light onto the target object, the contrast and resolution of the ridges in the target object image are enhanced, thereby improving the quality of the collected image.
[0127] In this embodiment, since the position of the guidance screen generated by adopting interactive aerial imaging technology is relatively fixed in the air, the user can perform operations according to the guidance screen and adjust the collection area where images are collected to an aerial target area. When a target object is detected to exist within the aerial target area and the pose of the target object corresponds to the guidance pose of the guidance screen, image information of the target object within the aerial target area is collected. For example, when performing fingerprint collection and identification, the user places their palm at the location point of the guidance screen; when the user's palm touches the floating real-world area and the position and orientation are detected to be correct, a collection action is triggered to acquire the user's fingerprint information.
[0128] In this embodiment, when performing image acquisition, the placement pose of a target object can be accurately aligned according to a floating real-world image guided without a medium, and simultaneously, the target object's contour can be rapidly searched to align its position. Consequently, the center position of the target object within the image can be accurately extracted, and key feature extraction can be performed within a suitable range surrounding the center position. Therefore, the impact of scale, translation, and rotation on the image during acquisition is reduced, unreliability caused by image algorithms is decreased, and potential image algorithm errors in bio-feature extraction and bio-feature matching are reduced.
[0129] Specifically, the imaging mode of the display screen may include RGB light-emitting diodes, LCOS elements, OLED arrays, projection, lasers, laser diodes, or any other suitable display screen or stereoscopic display screen, and the brightness of the display screen is 500 cd / m² 2It is not lower than. Therefore, in an embodiment of the present invention, the display screen itself can be utilized as a lighting unit. For example, when a user performs an operation at an aerial target area point, the presence of a target object is detected using a detection module, and a collection trigger signal is transmitted to a main control unit. The main control unit transmits a control command to the display screen and controls the backlight assembly of the display screen to emit a high-intensity blue light strobe once. Since the high-intensity strobe light passes through the optical assembly and converges at the same guide screen location point, uniform diffuse reflection can be formed on the surface of the target object. At this time, the control unit synchronously controls the image collection unit to immediately capture the shadows of the ridges and bone lines of the target object, thereby collecting the target object image and inputting it into an image processing module. The image processing module performs biometric feature processing on the target object image information and stores the processed biometric feature processing to complete feature collection. Alternatively, the purpose of non-contact collection and identification of user biometric features is realized by comparing the processed biometric feature information with the biometric feature information stored in the image storage module to identify the user's identity.
[0130] Step S4: Perform biometric feature processing based on image information, store the processed biometric feature information, or identify the user identity by comparing the processed biometric feature information with the stored biometric feature information.
[0131] In this embodiment, processing analysis is performed on the acquired image information, and the processed image information is stored to complete the collection of user biometric features.
[0132] When it is necessary to identify the user's biometric feature information, if direct interaction between the user and the guidance screen is detected, image capture of the user's biometric features is performed, the captured image information is processed, and the user identity is verified by comparing it with the stored biometric feature information, thereby implementing contactless collection and identification of the user's biometric features.
[0133] According to the biometric feature collection and identification method of the present disclosure, a guidance screen for biometric feature collection and identification is visualized in an aerial target area. That is, the aerial target area is used as a reference plane for user operation, and the user can operate according to the guidance screen appearing in the aerial target area. When it is detected that the user corresponds to a guidance pose on the guidance screen, image information of the target object within the aerial target area is collected, and biometric feature processing is performed according to the image information. By storing the processed biometric feature information or identifying the user's identity, the purpose of non-contact collection and identification of the user's biometric features is realized. The above method can make the operation method for collecting image information more convenient and intuitive. Since there is no need to install additional restraining devices to guide user operation, the risk of contact with the main body of the equipment during user operation can be avoided, making it more natural and safe when the user performs non-contact identification operations.
[0134] In some embodiments, the method according to the embodiment of the present disclosure performs bio-feature processing according to image information and includes at least steps S5 to S8, as shown in FIG. 22.
[0135] Step S5: Acquire the region of interest for biological features within the image information.
[0136] Here, the biofeature region of interest can be understood as a biofeature image region selected from the image information, and by defining the biofeature region of interest and performing additional processing, processing time can be reduced and accuracy improved.
[0137] In this embodiment, first, a non-biological feature background is removed from the image information, for example, by extracting biological features from the image information through a color space. Here, the color space may adopt the HSV color model (Hue, Saturation, Lightness) or the YcbCr model (Y refers to the luminance component, Cb to the blue saturation component, and Cr to the red saturation component).
[0138] For example, in the HSV color space, the skin HSV value is 26 <H<34, 43<S<255, 46<V<255이며, 여기에서 H는 색조, S는 채도, V는 명도를 나타낸다. 비생체 특징 배경은 HSV 컬러 공간에 의해 제거될 수 있으며, 지문을 예로 들면 이미지 정보 중 세 가지 매개변수 H, S, V를 사용하여 이미지 정보에서 손가락 컬러 요구 사항을 충족하는 부분을 남기고 배경 부분을 제거함으로써, 손가락 끝 특징의 추출을 완료한다.
[0139] Next, for the unremoved background near the skin, contours of a relatively small area are removed by calculating the area of the closed contour using contour detection. Here, a contour can be understood as a curve formed by connecting consecutive points and has the same color or grayscale. Additionally, contour detection can be performed more accurately by performing threshold processing or by adopting a Canny edge detection operator to perform edge detection before finding the contour.
[0140] Furthermore, a bio-feature region of interest is extracted through depth information, and as illustrated in FIG. 3, an optical sensor periodically detects user interaction operations, including the interaction location and the direction of the target object. Therefore, the depth information of the collected target object is a fixed value, and the bio-feature region of interest can be obtained by removing data outside a certain range of depth information. For example, image information obtained through a depth camera is a number with four channels, formed by combining RGB for the color channel and D for the depth channel, i.e., RGB-D image information, and the depth information of each pixel can be determined by traversing the row and column values of the image information. If the depth value range is 20 cm to 40 cm and the data information satisfies the target object requirements, the RGB value of the image information is maintained and used as the bio-feature region of interest, and other depth values that do not satisfy the requirements are set to black.
[0141] Step S6: Pre-processing is performed on the region of interest for biological features to obtain a pre-processed image.
[0142] In the present embodiment, a region of interest for biological features is pre-processed, and this includes operations such as grayscale conversion of the image, image enhancement, image binarization, and segmentation, thereby obtaining a pre-processed image.
[0143] Here, in the case of image grayscale conversion, the color map is converted into a grayscale map because the computational load for color images is relatively large. That is, by converting the three RGB channels into a single channel, the computational load is reduced, the system's execution speed is improved, and processing latency is decreased, thereby ensuring the system's real-time capability. Image grayscale conversion involves making the values of the three color components R, G, and B of the image color equal; since the range of color values is [0, 255], there are only 256 levels of grayscale. In other words, a grayscale image can represent only 256 grayscale colors. Image grayscale conversion can utilize methods such as the component method, the maximum method, the average method, and the weighted average method, but is not limited to these. For example, taking the average method as an example, processing is performed using the average of the R, G, and B color components, and the formula for calculating the value of each channel is I(x,y) = 1 / 3 * I_R(x,y) + 1 / 3 * I_G(x,y) + 1 / 3 * I_B(x,y).
[0144] For image enhancement, the ridges of a target object can be made more visible and the spacing between the ridges can be made sharper. For example, the image enhancement process can adopt Gabor feature extraction, which is a linear filter used for edge extraction. Since its representation of frequency and direction is similar to the human visual system, it allows for the selection of superior directions and scales for image enhancement. Furthermore, Gabor is not sensitive to changes in lighting, making it suitable for fingerprint analysis.
[0145] To further reduce the amount of computation, the enhanced grayscale map can be binarized and subdivided. Here, binarization means converting the values of each channel from 0 to 255 in the grayscale map into 0 and 1. For example, to binarize a grayscale image, a threshold range can be set, and pixel values within the set threshold range can be changed to 1 (e.g., white parts) and pixel values outside the set threshold range can be changed to 0 (e.g., black parts) to distinguish the biometric feature interest region to be identified, while simultaneously performing subdivision on the binarized image using a 2x2 rectangle as a template.
[0146] Step S7: Extract feature points from the pre-processed image.
[0147] Specifically, feature point extraction involves finding feature points that can describe the biometric features, such as finding fingerprint feature points in a biometric feature interest region based on a pre-processed image. In this embodiment, the feature points are developed around ridges and include ridge midpoints, endpoints, branching points, intersection points, etc. To better describe the feature points, SIFT feature descriptors of the biometric feature interest region can be extracted using a SIFT feature extraction algorithm, and at the same time, a dedicated sliding window can be adopted to describe ridge characteristics. For example, a 3x3 window can be used to scan the entire image, and by analyzing the values, locations, and number of pixel points within the window, it can be determined whether there are endpoints or branching points.
[0148] Step S8: Similarity matching is performed on feature points to determine target biological features.
[0149] In the present embodiment, the embodiment of the present disclosure records feature data of feature points after the pre-processing operation and feature extraction operation, compares it with another set of feature data, determines similarity through an algorithm, and finally determines the degree of matching of biological features.
[0150] For example, feature points extracted using SIFT features from a pre-processed image all possess orientation, dimension, and positional information. Since these feature points exhibit translational, scaling, magnification, and rotational invariance, the similarity between the feature points of the target object in the pre-processed image and the existing stored image is compared to determine whether they are the same person. Here, in the case of images of different parts of the target object, multiple parts of the target object are sheared into distinct region images using algorithms such as the centroid distance method or curvature analysis, thereby facilitating the individual performance of feature extraction and matching algorithms for each part.
[0151] In some embodiments, the step of performing bio-feature processing according to image information before acquiring a bio-feature region of interest in image information further includes the step of acquiring a three-dimensional bio-feature image of a target object according to image information of a target object within an aerial target region collected from different parts, and unfolding the three-dimensional bio-feature image into an equivalent two-dimensional bio-feature image to acquire bio-feature information compatible with a large database of target objects currently acquired and stored in a different way.
[0152] In some embodiments, the method according to the embodiments of the present disclosure further includes the steps of transmitting guidance notification information when it is detected that the pose of a target object and the guidance pose of a guidance screen do not match, controlling a display screen to display guidance notification information, and converging the light of the guidance notification information displayed by the display screen onto an aerial target area to visualize it. In other words, if image information collection fails, the cause of failure, such as an error in the user's palm direction, too fast movement, or positional bias, is analyzed to generate guidance notification information, and the guidance notification information is visualized onto an aerial target area to guide user movement, thereby correctly completing the collection of image information.
[0153] A method according to an embodiment of the present disclosure further comprises the steps of: detecting an interaction action between a target object and a guidance screen within an aerial target area, and providing a biometric feature interaction screen according to the interaction action between the target object and the guidance screen; and visualizing the biometric feature interaction screen in the aerial target area. For example, a user interaction action including operations such as clicking or sliding is detected, and specific user operations such as selecting a fingerprint recording mode or looking up fingerprint information are determined based on the correspondence between the interaction action and an internal command set, and a biometric feature interaction screen, such as a corresponding control button and UI operation interface such as settings, is displayed as an image at a point in the aerial target area.
[0154] An embodiment according to a fourth aspect of the present disclosure provides a storage medium in which a computer program is stored, wherein the computer program implements the biometric feature collection identification method of the embodiment when executed by a processor.
[0155] In the description of this specification, any process or method description described in a flowchart or otherwise may be understood as representing a module, segment, or portion of code of an executable instruction comprising one or more steps for implementing a custom logical function or process. Furthermore, the scope of preferred embodiments of this disclosure includes other implementations that may not follow the order as illustrated or discussed herein, and include executing functions in a manner that is essentially concurrent based on the mentioned functions or in the reverse order. This should be understood by those skilled in the art to which the embodiments of this disclosure pertain.
[0156] In a logic and / or step shown in a flowchart or otherwise described, it may be considered, for example, as an ordered list of executable instructions for implementing a logical function, specifically implemented on any computer-readable medium, provided to, or used in combination with, an instruction execution system, device, or equipment (e.g., a computer-based system, a system including a processor, or other system capable of taking instructions from an instruction execution system, device, or equipment and executing instructions). For the purposes of this specification, "computer-readable medium" may be a device provided to or used in combination with an instruction execution system, device, or equipment by containing, storing, communicating, propagating, or transmitting a program. More specific examples of computer-readable media (incomplete list) include electrical connections having one or more wires (electronic devices), portable computer disk boxes (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read-only memory (CDROM). Alternatively, the computer-readable medium may even be paper or other suitable media on which the program is printed. This is because the program can be acquired electronically by performing editing and decoding, for example, through optical scanning via paper or other media, or by processing in other suitable ways, and then stored in computer memory.
[0157] It should be understood that each part of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, a plurality of steps or methods may be implemented in software or firmware that is stored in memory and executed by a suitable instruction execution system. For example, when implemented in hardware as in other embodiments, this may be implemented by any one or a combination thereof of technologies known in the art, such as discrete logic circuits having logic gate circuits for implementing logic functions on data signals, ASICs having suitable combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
[0158] A person skilled in the art will understand that a program may instruct the relevant hardware to complete all or part of the steps performed to implement the methods of the above embodiments. The program may be stored on a computer-readable storage medium and, when executed, includes one or a combination thereof of the steps of the method embodiments.
[0159] Additionally, each functional unit among each embodiment of the present disclosure may be integrated into a single processing module, each unit may exist physically separately, or two or more units may be integrated into a single module. The integrated module may be implemented in the form of hardware or in the form of a software functional module. When the integrated module is implemented in the form of a software functional module and sold or used as a separate product, it may be stored on a single computer-readable storage medium.
[0160] The storage media mentioned above may be read-only memory, magnetic disks, or optical disks. Although embodiments of the present invention have been illustrated and described above, the embodiments are exemplary and should not be interpreted as limiting the present invention, and a person skilled in the art will understand that the embodiments described above can be changed, modified, substituted, and varied within the scope of this disclosure.
[0161] In the description of this specification, any description referring to terms such as “one embodiment,” “some embodiment,” “exemplary embodiment,” “example,” “specific example,” or “some example” means that the specific features, structures, materials, properties, etc. described in the said embodiment or example are included in at least one embodiment or example of this disclosure. In this specification, exemplary expressions of the said terms do not necessarily refer to the same embodiment or example.
[0162] Although embodiments of the present disclosure have been illustrated and described, those skilled in the art will understand that various changes, modifications, substitutions, and variations to these embodiments may be made without departing from the principles and spirit of the present disclosure. The scope of the present disclosure is limited by the claims and their equivalents. Explanation of the symbols
[0163] 2000: Terminal 1000: Biological Feature Collection and Identification System 300: Equipment main body 100: Imaging Subsystem 200: Collection Identification Subsystem 110: Imaging Module 120: Detection module 210: Image Capture Module 220: Image processing module 230: Image storage module 11: Aerial Target Area 111: Data processing module 10: Housing 20: Display screen 30: Optical assembly 40: Main Control Unit 1: Display window 2: Receiving cavity 21: Image Collection Unit 22: Control Unit 31: Beam Splitter 23: Lighting Unit 24: Optical filter absence 25: Total Reflection Unit 26: Diffuse reflection layer 6: First optical waveguide array 7: Second optical waveguide array 8: Transparent substrate 9: Reflection unit 12: Reflective film 13: Adhesive
Claims
Claim 1 A biometric feature collection and identification system comprises an imaging subsystem and a collection identification subsystem, wherein the imaging subsystem includes: an imaging module used to visualize and display a guidance screen for biometric feature collection and identification in an aerial target area; and a detection module used to transmit a collection trigger signal when a target object is detected to exist in the aerial target area, the target object interacts with the guidance screen, and the pose of the target object corresponds to the guidance pose of the guidance screen; and wherein the collection identification subsystem includes: an image collection module used to collect image information of a target object within the aerial target area in response to the collection trigger signal; an image storage module used to store biometric feature information; and an image processing module connected to the image collection module and the image storage module, which performs biometric feature processing according to the image information, stores the processed biometric feature information in the image storage module, or compares the processed biometric feature information with the biometric feature information stored in the image storage module to identify a user identity. Claim 2 A biofeature collection and identification system according to claim 1, wherein the imaging module comprises: a housing having a display window formed therein and a receiving cavity formed therein; a display screen installed in the receiving cavity and used to display a guide screen for biofeature collection and identification; an optical assembly installed in the receiving cavity and used to converge and image the light of the guide screen displayed by the display screen onto an aerial target area - the display screen is installed on the light source side of the optical assembly and the display window is on the imaging side of the optical assembly -; and a main control unit installed in the receiving cavity and used to control the display screen; characterized in that it comprises Claim 3 A bio-feature collection and identification system according to paragraph 2, wherein the imaging module further comprises a data processing module connected to the main control unit and used to transmit guidance notification information when it is detected that the pose of the target object and the guidance pose of the guidance screen do not match; wherein the main control unit controls the display screen to display the guidance notification information; and wherein the optical assembly converges and images the light of the guidance notification information displayed by the display screen onto the aerial target area. Claim 4 A biometric feature collection identification system according to claim 2, wherein the image collection module comprises: at least one image collection unit used to collect image information of a target object within the aerial target area; and a control unit connected to each image collection unit and used to control the image collection unit to operate in response to a collection trigger signal. Claim 5 A biofeature collection and identification system according to claim 4, wherein the image collection unit is installed on the imaging side of the optical assembly, and the optical axis of the image collection unit and the normal to the imaging plane of the aerial target area form a preset angle. Claim 6 A bio-feature collection identification system according to claim 4, wherein the image collection unit is installed on the imaging side of the optical assembly; a beam splitter is installed on the surface of the imaging side of the optical assembly, and the beam splitter is used to reflect image information of the target object in the aerial target area and transmit the image information to the image collection unit. Claim 7 A biofeature collection identification system according to claim 6, wherein the optical axis of the image collection unit and the normal of the imaging plane of the aerial target area are perpendicular, and the beam splitter is a semi-transparent, semi-reflective beam splitter for visible light; or wherein the optical axis of the image collection unit and the normal of the imaging plane of the aerial target area are perpendicular, the image collection unit is an infrared image collection unit, and the beam splitter is a beam splitter that projects visible light and reflects infrared light. Claim 8 A bio-feature collection and identification system according to claim 6, wherein the image collection module further comprises at least one total reflection unit used to transmit the image information of the aerial target area target object reflected by the beam splitter to the image collection unit. Claim 9 A bio-feature collection and identification system according to claim 4, wherein the image collection unit is installed on the light source side of the optical assembly, and the optical axis of the image collection unit and the plane containing the aerial target area form a preset angle. Claim 10 A bio-feature collection and identification system according to claim 9, characterized in that a through hole is installed at a position penetrating the optical axis of the corresponding image collection unit on the optical assembly. Claim 11 A biometric feature collection identification system according to claim 4, wherein the image collection module further comprises a lighting unit connected to the control unit and used to activate lighting in response to the collection trigger signal. Claim 12 A biofeature collection identification system according to claim 11, wherein the lighting unit is a backlight assembly of the display screen, and the main control unit is further used to control the backlight assembly of the display screen to emit lighting light in a preset mode in response to the collection trigger signal; or wherein the lighting unit is installed on the imaging side of the optical assembly, and the illumination surface of the lighting unit is directed toward the aerial target area. Claim 13 A bio-feature collection and identification system according to claim 11, characterized in that the lighting unit is installed on the light source side of the optical assembly and is installed opposite the display screen. Claim 14 A bio-feature collection and identification system according to claim 13, wherein a diffuse reflection layer is installed on the surface of the display screen, and the irradiation surface of the lighting unit faces the surface of the display screen; or the irradiation surface of the lighting unit faces the aerial target area. Claim 15 A terminal comprising: an equipment body; and a biometric feature collection identification system according to any one of claims 1 to 14, wherein the biometric feature collection identification system is installed on the equipment body. Claim 16 A method for collecting and identifying biometric features, comprising: a step of providing an aerial target area; a step of visualizing a guidance screen for collecting and identifying biometric features in the aerial target area; a step of collecting image information of a target object within the aerial target area when it is detected that a target object exists in the aerial target area, the target object interacts with the guidance screen, and the pose of the target object corresponds to the guidance pose of the guidance screen; and a step of performing biometric feature processing according to the image information, storing the processed biometric feature information, or comparing the processed biometric feature information with the stored biometric feature information to identify a user identity. Claim 17 A method for collecting and identifying biological features according to claim 16, wherein the step of performing biological feature processing according to the image information comprises: a step of acquiring a biological feature interest region among the image information; a step of acquiring a pre-processed image by pre-processing the biological feature interest region; a step of extracting feature points among the pre-processed image; and a step of determining target biological features by performing similarity matching on the feature points. Claim 18 A biofeature collection and identification method according to claim 17, further comprising, prior to the step of acquiring a biofeature interest region among the image information, a step of acquiring a three-dimensional biofeature image of a target object according to image information of a target object within an aerial target region collected in different directions; and a step of unfolding the three-dimensional biofeature image into an equivalent two-dimensional biofeature image. Claim 19 A bio-feature collection and identification method according to claim 16, further comprising: a step of transmitting guidance notification information when it is detected that the pose of the target object and the guidance pose among the guidance screens do not match; and a step of controlling a display screen to display the guidance notification information, and converging and imaging the light of the guidance notification information displayed by the display screen onto the aerial target area. Claim 20 A bio-feature collection and identification method according to any one of claims 16 to 19, wherein the bio-feature collection and identification method further comprises: a step of detecting an interaction operation between a target object within the aerial target area and the guidance screen; a step of providing a bio-feature interaction screen according to the interaction operation between the target object and the guidance screen; and a step of imaging the bio-feature interaction screen in the aerial target area.
Citation Information
Patent Citations
Camera based contactless fingerprint reader
KR101965749B1
Fingerprint identifying method and fingerprint identification device
KR1020170087896A
Under-screen biometric recognition device, biometric recognition assembly and terminal device
KR1020190095872A
Under-screen biometric identification apparatus and electronic device
KR102031601B1
