Terminal device, method, apparatus and storage medium for processing biometric features

Abstract

The present disclosure relates to a terminal device, a method and apparatus for processing biometric features, and a storage medium. The terminal device includes: a screen module; a biometric feature module, including: a sensing component, the sensing area corresponding to the sensing component is located within the display area corresponding to the screen module, and is used for sensing an object to be recognized; a feature acquisition component, located in a non-display area of the terminal device other than the display area of the screen module, and is used for acquiring biometric feature information of the object to be recognized; a communication module, connected to the biometric feature module, and is used for sending the biometric feature information to the cloud. In this way, on the one hand, the feature acquisition component does not need to occupy the display area of the terminal device, which can improve the screen-to-body ratio of the terminal device and even realize the transparency of the display screen of the terminal device; on the other hand, the acquired biometric feature information is sent to the cloud for processing, and there is no need to set up a dedicated hardware circuit for processing biometric feature information on the terminal device side, which can realize the thinness and lightness of the terminal device.

Description

Technical Field

[0001] The present disclosure relates to biometric technology, and in particular, to a terminal device, a method and apparatus for processing biometric features, and a storage medium. Background Art

[0002] With the development of terminal devices and technological innovation, terminal devices can perform more and more functions. To implement these functions, it is necessary to integrate hardware circuits that support these functions on the terminal device. To implement these functions and perform data calculation and processing on the terminal device, different processors need to be set for each hardware circuit integrated on the terminal device. However, this will increase the size and thickness of the terminal device. Summary of the Invention

[0003] The present disclosure provides a terminal device, a method and apparatus for processing biometric features, and a storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided a terminal device, including:

[0005] A screen module;

[0006] A biometric module, including: a sensing component and a feature acquisition component, where a sensing area corresponding to the sensing component is located within a display area corresponding to the screen module, and is configured to sense an object to be recognized;

[0007] The feature acquisition component is located in a non-display area of the terminal device other than the display area of the screen module, and is configured to acquire biometric feature information of the object to be recognized;

[0008] A communication module, connected to the biometric module, and configured to send the biometric feature information to the cloud.

[0009] Optionally, the terminal device further includes:

[0010] A hardware module, located in the non-display area, connected to the communication module, and configured to acquire acquisition data, and send the acquisition data to the cloud through the communication module;

[0011] The hardware module includes:

[0012] A power supply module, configured to provide electrical energy for the terminal device;

[0013] A function module, where the function module includes: a system circuit, and the system circuit has at least one of the following functions: an audio function, a charging function, a sensing function, a display function, and a camera function. Optionally, the sensing component and the feature acquisition component are transparent.

[0014] Optionally, the terminal device further includes:

[0015] A support module, which is used to support the screen module and is transparent.

[0016] A screen base, which is used to carry a screen film layer assembly, and both the screen base and the screen film layer assembly are transparent.

[0017] Optionally, the feature acquisition component includes:

[0018] A light output sub-component, which forms a first transmission optical path with the sensing component, and the light output by the light output sub-component is transmitted to the sensing component along the first transmission optical path.

[0019] A light receiving sub-component, which forms a second transmission optical path with the sensing component. After the light transmitted to the sensing component along the first transmission optical path is reflected by the object to be recognized, it is transmitted to the light receiving sub-component along the second transmission optical path.

[0020] Optionally, the light output surface of the light output sub-component is parallel and opposite to the light input surface of the light receiving sub-component.

[0021] Optionally, the terminal device further includes:

[0022] A first frame, and the light output sub-component is disposed in the area where the first frame is located;

[0023] A second frame, which is parallel and opposite to the first frame, and the light receiving sub-component is disposed in the area where the second frame is located;

[0024] Wherein, the screen module is located between the first frame and the second frame.

[0025] Optionally, the light input surface of the light receiving sub-component and the light output surface of the light output sub-component both face the display surface of the display module.

[0026] Optionally, the feature acquisition component further includes:

[0027] A first deflection component, which is used to deflect the light output from the light output surface of the light output sub-component to the sensing component;

[0028] A second deflection component, which is used to deflect the light reflected by the object to be recognized on the sensing component to the light receiving sub-component.

[0029] Optionally, the first deflection component is located between the light output sub-component and the sensing component, forming a first sub-transmission optical path with the light output sub-component and a second sub-transmission optical path with the sensing component. The first sub-transmission optical path and the second sub-transmission optical path together constitute the first transmission optical path;

[0030] The second deflection component is located between the sensing component and the light receiving sub-component, forming a third sub-transmission optical path with the sensing component and a fourth sub-transmission optical path with the light receiving sub-component. The third sub-transmission optical path and the fourth sub-transmission optical path together constitute the second transmission optical path.

[0031] Optionally, both the first deflection component and the second deflection component are located in the non-display area of the terminal device except for the display area of the screen module.

[0032] According to the second aspect of the embodiments of the present disclosure, a method for processing biometric features is provided, which is applied to a terminal device and includes:

[0033] When a trigger operation of a to-be-identified object for the sensing area is detected, biometric feature information of the to-be-identified object is obtained based on a feature acquisition component; wherein, the sensing area is located in the display area of the screen module of the terminal device, and the feature acquisition component is located in the non-display area of the terminal device except for the display area of the screen module;

[0034] Send the biometric feature information to the cloud.

[0035] Optionally, the method further includes:

[0036] When a trigger operation for the hardware module is detected, acquisition data is obtained; wherein, the hardware module is located in the non-display area;

[0037] Send the obtained acquisition data to the cloud.

[0038] Optionally, the obtaining of the biometric feature information of the to-be-identified object based on the feature acquisition component includes:

[0039] Obtain an optical signal detected for the to-be-identified object based on the feature acquisition component;

[0040] Obtain the biometric feature information based on the detected optical signal.

[0041] Optionally, the method further includes:

[0042] Receive indication information returned by the cloud for the biometric feature information, and perform the operation indicated by the indication information.

[0043] According to a third aspect of the embodiments of the present disclosure, there is provided a biometric processing device, including:

[0044] a processor;

[0045] a memory for storing instructions executable by the processor;

[0046] wherein the processor is configured to: when executing the executable instructions, implement the steps in any one of the methods described in the second aspect above.

[0047] According to a fourth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, which when the instructions in the storage medium are executed by a processor of a biometric processing device, enables the biometric processing device to execute the steps in any one of the methods described in the second aspect above.

[0048] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0049] As can be seen from the above embodiments, in the present disclosure, the feature acquisition component of the biometric module is disposed in a non-display area outside the display area of the screen module, and the acquired biometric information is sent to the cloud. In this way, on the one hand, the feature acquisition component of the biometric module does not need to occupy the display area of the terminal device, which can improve the screen-to-body ratio of the terminal device and even realize the transparency of the display screen of the terminal device; on the other hand, by sending the acquired biometric information to the cloud for processing, instead of setting up a dedicated hardware circuit for processing biometric information on the terminal device side, the terminal device can be made thinner and lighter.

[0050] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.

[0052] Figure 1 is a schematic structural diagram of a terminal device shown according to an exemplary embodiment.

[0053] Figure 2 is a schematic structural diagram of a sensing component shown according to an exemplary embodiment.

[0054] Figure 3 is a schematic cross-sectional structural diagram of a sensing component shown according to an exemplary embodiment.

[0055] Figure 4It is a schematic structural diagram of a feature acquisition component shown according to an exemplary embodiment.

[0056] Figure 5 It is a schematic structural diagram of another terminal device shown according to an exemplary embodiment.

[0057] Figure 6 It is a schematic structural diagram of another feature acquisition component shown according to an exemplary embodiment.

[0058] Figure 7 It is a schematic flowchart of a biometric processing method shown according to an exemplary embodiment.

[0059] Figure 8 It is a block diagram of a processing device for biometrics shown according to an exemplary embodiment. Detailed implementation manners

[0060] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0061] In the embodiments of the present disclosure, a terminal device is provided. Figure 1 It is a schematic structural diagram of a terminal device shown according to an exemplary embodiment. As Figure 1 shown, the terminal device 100 mainly includes:

[0062] A screen module 101;

[0063] A biometric module, including: a sensing component 102 and a feature acquisition component 103. The sensing area corresponding to the sensing component 102 is located within the display area corresponding to the screen module 101 and is used to sense an object to be recognized.

[0064] The feature acquisition component 103 is located in a non-display area of the terminal device except for the display area of the screen module 101 and is used to acquire biometric information of the object to be recognized.

[0065] A communication module 104, connected to the biometric module, is used to send the biometric information to the cloud.

[0066] Here, the terminal device may include: mobile phones, laptop computers, tablet computers, smart TVs, wearable electronic devices, etc. In some other embodiments, the terminal device may also be smart glasses. Taking the terminal device as a mobile phone as an example, the screen module may be the display screen on the mobile phone.

[0067] In the embodiments of the present disclosure, the biometric feature may include: fingerprint feature. Correspondingly, the biometric module may include: an optical fingerprint module. Taking the biometric module as an optical fingerprint module as an example, in the embodiments of the present disclosure, the sensing component of the optical fingerprint module may sense the object to be recognized, and after sensing the object to be recognized, the fingerprint feature information of the object to be recognized may be obtained based on the feature acquisition component. Among them, the object to be recognized may be the user's finger, facial feature.

[0068] Among them, the display area of the screen module may be used to display time, application function icons, etc., and the present disclosure does not limit this. The sensing area corresponding to the sensing component is located within the display area of the screen module. When the user touches the sensing area with a finger, the terminal device may collect the user's fingerprint and send the user's fingerprint to the cloud, so that the cloud performs fingerprint recognition based on the collected user's fingerprint and sends the fingerprint recognition result to the terminal device, so that the terminal device can implement corresponding device operations, which helps to improve the convenience of user operations.

[0069] In some embodiments, the non-display area outside the display area of the screen module may be the area where the frame of the terminal device is located. For example, the feature acquisition component of the biometric module may be arranged within the frame of the terminal device.

[0070] In some embodiments, the sensing component may include a touch sensor. For example, touch sensors may be arranged around the sensing area. Figure 2 is a schematic structural diagram of a sensing component shown according to an exemplary embodiment. As Figure 2 shown, touch sensors 201 may be arranged around the sensing area corresponding to the sensing component 102. For example, one touch sensor 201 may be arranged above, below, left, and right of the sensing area 201 respectively, for detecting the touch operation of the object to be recognized. In some embodiments, one touch sensor, two touch sensors, etc. may also be arranged, and no specific limitation is made here.

[0071] Figure 3 is a schematic cross-sectional structural diagram of a sensing component shown according to an exemplary embodiment. As Figure 3 shown, the touch sensor 201 is located below the light-transmitting layer 301 of the screen module; based on the above structure, the touch sensor 201 may be arranged below the light-transmitting area of the light-transmitting layer 301 for detecting the touch operation of the object to be recognized. In some other embodiments, the light-transmitting area may also be reused as the sensing area.

[0072] In another embodiment, a pressing operation on the sensing area can be detected, and when the pressing operation is detected, it is determined that the object to be recognized covers the sensing area. For example, the pressing operation can be detected by a pressure sensor. In some other embodiments, the object to be recognized can also be detected by a temperature sensor. For example, when the temperature of the contact object in the sensing area detected based on the temperature sensor is greater than a set temperature threshold, it is determined that the object to be recognized covers the sensing area.

[0073] In the embodiments of the present disclosure, after the biometric information of the object to be recognized is obtained by the biometric acquisition module, the biometric information can be sent to the cloud through the communication module, and the cloud can process the biometric information. Taking the biometric information as fingerprint feature information as an example, after the cloud receives the fingerprint feature information, the fingerprint feature information can be matched with the preset fingerprint features, and an indication information corresponding to the matching result is generated. After the indication information is generated, the indication information can be sent to the terminal device.

[0074] For example, when the terminal device is in the locked screen state, if the fingerprint feature information matches the preset fingerprint features successfully, a first indication information is sent to the terminal device, where the first indication information is used to indicate the terminal device to unlock. After the terminal device receives the first indication information, it will be automatically unlocked. If the fingerprint feature information fails to match the preset fingerprint features, a second indication information is sent to the terminal device, where the second indication information is used to indicate that the fingerprint feature information fails to match the preset fingerprint features. After the terminal device receives the second indication information, the unlocking operation of the terminal device can be prohibited, and a prompt message indicating the matching failure is output.

[0075] In some embodiments, the screen module can be a Light Emitting Diode (LED) module or an Organic Light-Emitting Diode (OLED) module, as long as the screen module can transmit light. The present disclosure does not limit the type of the screen module.

[0076] Wherein, when the biometric module is an optical fingerprint module, the self-luminescence of the OLED component can be used to provide a light source for fingerprint acquisition of the terminal device, which is beneficial to saving the internal space of the terminal device. Moreover, based on the relatively small pixel points of the OLED component, it is beneficial for light to pass through to ensure the fingerprint acquisition effect of the optical fingerprint module. Of course, a supplementary light source can also be provided for the optical fingerprint module in the terminal device, which is not specifically limited herein.

[0077] In the embodiments of the present disclosure, the feature acquisition component of the biometric module is disposed in a non-display area outside the display area of the screen module, and the acquired biometric information is sent to the cloud. In this way, on the one hand, the feature acquisition component of the biometric module does not need to occupy the display area of the terminal device, which can improve the screen-to-body ratio of the terminal device and even realize the transparency of the display screen of the terminal device; on the other hand, by sending the acquired biometric information to the cloud for processing, instead of setting up dedicated hardware circuits for processing biometric information on the terminal device side, the terminal device can be made thinner and lighter.

[0078] In some alternative embodiments, the terminal device further includes:

[0079] A hardware module, located in the non-display area, is connected to the communication module, configured to acquire acquisition data, and send the acquisition data to the cloud through the communication module;

[0080] The hardware module includes:

[0081] A power supply module, configured to provide electrical energy for the terminal device;

[0082] A function module, the function module includes: a system circuit, and the system circuit has at least one of the following functions: an audio function, a charging function, a sensing function, a display function, and a camera function.

[0083] Here, the power supply module may include: a Power Management IC (PMIC). The system circuit with an audio function may include: an audio driving circuit and an audio sounding circuit; the system circuit with a sensing function may include: a biometric sensing circuit, a sensor circuit, etc.; the system circuit with a camera function may include: a camera connection circuit; the system circuit with a display function may include: a screen display circuit.

[0084] In some implementations, the control lines inside the screen module of the terminal device may also be disposed at a position corresponding to the non-display area within the terminal device.

[0085] In some embodiments, the hardware module may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU) and other core processors. In the embodiments of the present disclosure, the processing functions of the core processors can be placed in the cloud device, and the data acquisition and data transceiver functions are retained in the terminal device, which can reduce the components required to be laid out in the terminal device and a large number of heat dissipation modules required to be set up.

[0086] In the embodiments of the present disclosure, the hardware module is disposed in a non-display area outside the display area of the screen module, and the acquisition data obtained by the hardware module is sent to the cloud. In this way, on the one hand, the hardware module does not need to occupy the display area of the terminal device, which can improve the screen-to-body ratio of the terminal device and even realize the transparency of the display screen of the terminal device; on the other hand, by sending the acquisition data obtained by the hardware module to the cloud for processing, instead of setting up a dedicated hardware circuit for processing the acquisition data on the terminal device side, the terminal device can be made thinner and lighter.

[0087] In some alternative embodiments, the sensing component and the feature acquisition component are transparent.

[0088] In the embodiments of the present disclosure, since the sensing component and the feature acquisition component are located in the display area, in the implementation process, by setting the sensing component and the feature acquisition component to be transparent, the screen-to-body ratio of the terminal device can be improved, and even the transparency of the display screen of the terminal device can be realized.

[0089] In some alternative embodiments, the terminal device further includes:

[0090] A support module for supporting the screen module, and the support module is transparent;

[0091] A screen substrate for carrying the screen film layer component, and both the screen substrate and the screen film layer component are transparent.

[0092] Here, the support module may be a support member for supporting the screen module. The screen substrate may include a base material for preparing the screen module. In the implementation process, transparent materials can be used to prepare the screen substrate and the support module. Among them, the screen film layer component may be components printed on or disposed on the screen substrate. In the implementation process, the components can be prepared based on transparent materials to finally realize the transparency of the screen module.

[0093] In the embodiments of the present disclosure, by setting both the support module and the screen substrate of the terminal device to be transparent, the overall transparency of the terminal device can be realized.

[0094] In some alternative embodiments, the feature acquisition component includes:

[0095] A light output sub-component that forms a first transmission optical path with the sensing component, and the light output by the light output sub-component is transmitted to the sensing component along the first transmission optical path;

[0096] A light receiving sub-component that forms a second transmission optical path with the sensing component. After the light transmitted to the sensing component along the first transmission optical path is reflected by the object to be recognized, it is transmitted to the light receiving sub-component along the second transmission optical path.

[0097] Figure 4 is a structural diagram of a feature acquisition component according to an exemplary embodiment. Figure 4 As shown, the feature acquisition component includes a light output subcomponent 401 and a light receiving subcomponent 402, a first transmission optical path is formed between the light output subcomponent 401 and the sensing component 102, and a second transmission optical path is formed between the light receiving subcomponent 402 and the sensing component 102. In the implementation process, the light output subcomponent 401 can output light, and the light can be transmitted to the sensing component 102 via the first transmission optical path. In the case where the sensing component 102 is covered with an object to be identified, the light transmitted to the sensing component 102 along the first transmission optical path can be transmitted to the light receiving subcomponent 402 along the second transmission optical path after being reflected by the object to be identified.

[0098] In the disclosed embodiment, taking the user's finger as an example, the object to be identified can be formed based on the light reflected by the object to be identified obtained by the light receiving subassembly, and the formed image to be identified can be sent to the cloud, and the cloud can perform fingerprint identification based on the image to be identified to obtain a fingerprint identification result. In other embodiments, the generated image to be identified can also be sent to other electronic devices that communicate with the terminal device, so that the other electronic devices can perform fingerprint identification based on the image to be identified to obtain a fingerprint identification result.

[0099] Here, the light output subassembly may emit light outward, and the light may be reflected on the surface of the object to be identified. The light receiving subassembly receives the reflected light and converts it into an electrical signal, which is then converted into a fingerprint image. When the object to be identified is a user's finger, the effective light received by the light receiving subassembly may be the light reflected by the lines on the fingerprint surface of the user's finger.

[0100] For example, when the feature acquisition component is acquiring fingerprints, light can be emitted through the light output subcomponent, and the light can be emitted and propagated outward through the transparent pixels of the screen module. When the outwardly emitted light encounters the object to be identified (for example, the user's finger), part of the light will be reflected back by the object to be identified, and the reflected light can be emitted and propagated to the light receiving subcomponent through the screen module and transparent pixels. The light receiving subcomponent can form an image to be identified based on the received reflected light, and send the formed image to be identified to the cloud, so that the cloud can perform fingerprint identification based on the image to be identified to obtain a fingerprint identification result.

[0101] In the embodiments of the present disclosure, by disposing the light output sub-component and the light receiving sub-component in the non-display area outside the display area of the display module in the terminal device, the screen-to-body ratio of the terminal device can be improved. By sending the acquired biometric information to the cloud for processing, instead of setting up dedicated hardware circuits for processing biometric information on the terminal device side, the terminal device can be made thinner and lighter.

[0102] In some alternative embodiments, the light output by the light output sub-component is infrared light.

[0103] In the embodiments of the present disclosure, infrared light is output by the light output sub-component, and the acquisition of biometric information is realized based on the infrared light. Since infrared light is non-visible light, the influence of light on the acquired biometric information can be reduced, thereby improving the accuracy of the acquired biometric information.

[0104] In other embodiments, near-infrared light can also be output by the light output sub-component, and the acquisition of biometric information is realized based on the near-infrared light. No specific limitation is made here.

[0105] In some alternative embodiments, the light-emitting surface of the light output sub-component is parallel and opposite to the light-incident surface of the light receiving sub-component.

[0106] As Figure 4 shown, the feature acquisition component includes a light output sub-component and a light receiving sub-component. Since the light-emitting surface of the light output sub-component is parallel and opposite to the light-incident surface of the light receiving sub-component. In this way, it is convenient to form the first transmission optical path and the second transmission optical path, thereby simplifying the design of the optical path.

[0107] In some alternative embodiments, the terminal device further includes:

[0108] A first frame, where the light output sub-component is disposed in the area where the first frame is located;

[0109] A second frame, parallel and opposite to the first frame, where the light receiving sub-component is disposed in the area where the second frame is located;

[0110] Wherein, the screen module is located between the first frame and the second frame.

[0111] Figure 5 is a schematic structural diagram of another terminal device shown according to an exemplary embodiment. As Figure 5As shown in the figure, the terminal device 100 includes a first frame 501 and a second frame 502. Among them, the light output sub-component 401 is located within the first frame 501, and the light receiving sub-component 402 is located within the second frame 502. In the present disclosure, the first frame and the second frame may be part of the middle frame of the terminal device, where the middle frame may be represented as a frame for supporting the screen module.

[0112] In some other embodiments, the light output sub-component may be pasted on the inner surface of the first frame. In some other embodiments, when the thickness of the first frame is greater than the thickness of the light output sub-component, the light output sub-component may be embedded inside the first frame. For example, a through hole with a cross-section that fits the cross-section of the light output sub-component may be opened on the first frame. The through hole penetrates the inner surface and the outer surface of the first frame, and the light output sub-component is disposed in the through hole. In this way, the internal space of the first frame of the terminal device can be fully utilized to achieve the thinning and lightening of the terminal device.

[0113] In some embodiments, the light receiving sub-component may be pasted on the inner surface of the second frame. In some other embodiments, when the thickness of the second frame is greater than the thickness of the light receiving sub-component, the light receiving sub-component may be embedded inside the second frame. For example, a through hole with a cross-section that fits the cross-section of the light receiving sub-component may be opened on the second frame. The through hole penetrates the inner surface and the outer surface of the second frame, and the light receiving sub-component is disposed in the through hole. In this way, the internal space of the second frame of the terminal device can be fully utilized to achieve the thinning and lightening of the terminal device.

[0114] In some alternative embodiments, the light incident surface of the light receiving sub-component and the light emitting surface of the light output sub-component both face the display surface of the display module. In some alternative embodiments, the feature acquisition component further includes:

[0115] A first deflection component for deflecting the light output from the light emitting surface of the light output sub-component to the sensing component;

[0116] A second deflection component for deflecting the light reflected by the object to be recognized on the sensing component to the light receiving sub-component.

[0117] In this embodiment, the first deflection component can be used to receive the incident light and change the propagation direction of the light. For example, it can change the propagation direction of the light output by the light output sub-component. In an example, the first deflection component includes at least one light conducting surface, where the at least one light conducting surface may include: a light incident surface for receiving light and a light emitting surface for outputting light. In this way, the light can be received through the light incident surface, and after the light is received based on the light incident surface, the light with the changed propagation direction can be output through the light emitting surface.

[0118] For example, in some alternative embodiments, the first deflection component may be a prism or other device that changes the propagation direction of light. Exemplarily, in some embodiments, the first deflection component may include: a triangular prism. Here, a triangular prism is a transparent body with a triangular cross-section in optics and an optical instrument made of a transparent material with a triangular cross-section.

[0119] In some embodiments, the light incident surface of the triangular prism may be perpendicular to the light output surface. In this way, when the triangular prism receives light perpendicular to the light incident surface, after the light is reflected by the reflective surface of the triangular prism, the conduction direction can be changed to be perpendicular to the light output surface of the light output sub-component. At this time, the light can be conducted to the sensing component.

[0120] In another example, at least one light conduction surface may include: a reflective surface for reflecting light. For example, if at least one light conduction surface only includes: a reflective surface for reflecting light, in this way, light can be directly received based on the reflective surface, and the conduction direction of the light can be changed based on the reflective surface, and then the light with the changed conduction direction can be output.

[0121] In some embodiments, the second deflection component may be used to receive incident light and change the conduction direction of the light. For example, it can change the conduction direction of the light output by the sensing component. In one example, the second deflection component includes at least one light conduction surface, where at least one light conduction surface may include: a light incident surface for receiving light and a light output surface for outputting light. In this way, light can be received through the light incident surface, and after the light is received based on the light incident surface, the light with the changed conduction direction can be output through the light output surface.

[0122] For example, in some alternative embodiments, the second deflection component may be a prism or other device that changes the propagation direction of light. Exemplarily, in some embodiments, the second deflection component may include: a triangular prism. Here, a triangular prism is a transparent body with a triangular cross-section in optics and an optical instrument made of a transparent material with a triangular cross-section.

[0123] In some embodiments, the light incident surface of the triangular prism may be perpendicular to the light output surface. In this way, when the triangular prism receives light perpendicular to the light incident surface, after the light is reflected by the reflective surface of the triangular prism, the conduction direction can be changed to be perpendicular to the light incident surface of the light receiving sub-component. At this time, the light can be conducted to the light receiving sub-component.

[0124] In another example, at least one light conduction surface may include: a reflective surface for reflecting light. For example, if at least one light conduction surface only includes: a reflective surface for reflecting light, in this way, light can be directly received based on the reflective surface, and the conduction direction of the light can be changed based on the reflective surface, and then the light with the changed conduction direction can be output.

[0125] In some other embodiments, the orientation of the light-emitting surface of the light output sub-component and / or the orientation of the light-incident surface of the light receiving sub-component can also be adjusted. Correspondingly, the orientations of the reflecting surfaces of the first deflection component and the second deflection component can be adjusted accordingly, as long as it can ensure that the light output by the light output sub-component is deflected to the light receiving sub-component, and no specific limitation is made here.

[0126] In some alternative embodiments, the first deflection component is located between the light output sub-component and the sensing component, forming a first sub-transmission optical path with the light output sub-component and a second sub-transmission optical path with the sensing component. The first sub-transmission optical path and the second sub-transmission optical path together constitute the first transmission optical path;

[0127] The second deflection component is located between the sensing component and the light receiving sub-component, forming a third sub-transmission optical path with the sensing component and a fourth sub-transmission optical path with the light receiving sub-component. The third sub-transmission optical path and the fourth sub-transmission optical path together constitute the second transmission optical path.

[0128] Figure 6 It is a schematic structural diagram of another feature acquisition component shown according to an exemplary embodiment. As Figure 6 shown, the feature acquisition component further includes a first deflection component 601 and a second deflection component 602. In the implementation process, the first deflection component 601 can deflect the light output from the light-emitting surface of the light output sub-component 401 to the sensing component 102, and the second deflection component 602 can deflect the light reflected by the object to be recognized on the sensing component 102 to the light receiving sub-component 402.

[0129] In the implementation process, the first deflection component can form a first sub-transmission optical path with the light output sub-component and a second sub-transmission optical path with the sensing component. Then, based on the first sub-transmission optical path and the second sub-transmission optical path together constituting the first transmission optical path, it ensures that the light output by the light output sub-component is successfully conducted to the sensing component. The second deflection component can form a third sub-transmission optical path with the sensing component and a fourth sub-transmission optical path with the light receiving sub-component. Then, based on the third sub-transmission optical path and the fourth sub-transmission optical path together constituting the second transmission optical path, it ensures that the light output by the sensing component is successfully conducted to the light receiving sub-component.

[0130] In the embodiments of the present disclosure, by adding the first deflection component and the second deflection component, and through the mutual cooperation of the first deflection component and the second deflection component to form different transmission optical paths, and then realizing the transmission of light, the flexibility of the terminal device in processing light can be improved, and further the setting directions of the light output sub-component and the light receiving sub-component can be made more flexible.

[0131] In some alternative embodiments, both the first deflection component and the second deflection component are located in a non-display area of the terminal device except for the display area of the screen module.

[0132] In the present disclosure, by disposing the first deflection component and the second deflection component in a non-display area outside the display area of the screen module, in this way, the first deflection component and the second deflection component do not need to occupy the display area of the terminal device, which can improve the screen-to-body ratio of the terminal device and even realize the transparency of the display screen of the terminal device.

[0133] In some alternative embodiments, the included angle between the light-emitting surface of the light output sub-component and the light deflection surface of the first deflection component is equal to the included angle between the light-incident surface of the light receiving sub-component and the light deflection surface of the second deflection component. In this way, through the setting of the symmetric structure, it can be ensured that all the light rays output by the light output sub-component can be successfully conducted to the light receiving sub-component, which can improve the accuracy of the obtained fingerprint information.

[0134] An embodiment of the present disclosure provides a method for processing biometric features. Figure 7 It is a schematic flowchart of a method for processing biometric features shown according to an exemplary embodiment, which is applied to a terminal device, such as Figure 7 shown, and the method mainly includes the following steps:

[0135] In step 701, when a trigger operation of a to-be-identified object for a sensing area is detected, biometric feature information of the to-be-identified object is acquired based on a feature acquisition component; wherein, the sensing area is located in the display area of the screen module of the terminal device, and the feature acquisition component is located in a non-display area of the terminal device except for the display area of the screen module.

[0136] In step 702, the biometric feature information is sent to the cloud.

[0137] In an embodiment of the present disclosure, after biometric feature information of a to-be-identified object is acquired based on a biometric feature acquisition module, the biometric feature information can be sent to the cloud through a communication module, and the cloud can process the biometric feature information.

[0138] In some embodiments, the screen module can be a Light Emitting Diode (LED) module or an Organic Light-Emitting Diode (OLED) module, as long as the screen module can transmit light, and the present disclosure does not limit the type of the screen module.

[0139] In the disclosed embodiment, the feature acquisition component of the biometric module is set in the non-display area outside the display area of ​​the screen module, and the acquired biometric information is sent to the cloud. In this way, on the one hand, the feature acquisition component of the biometric module does not need to occupy the display area of ​​the terminal device, which can increase the screen-to-body ratio of the terminal device and even make the display screen of the terminal device transparent; on the other hand, by sending the acquired biometric information to the cloud for processing, there is no need to set up a hardware circuit specifically for processing biometric information on the terminal device side, which can make the terminal device lighter and thinner.

[0140] In some optional embodiments, the acquiring of the biometric information of the object to be identified based on the feature acquisition component includes:

[0141] Acquiring, based on the feature acquisition component, a light signal obtained by detecting the object to be identified;

[0142] The biometric information is obtained based on the detected light signal.

[0143] Here, taking the case where the object to be identified is a user's finger as an example, the light output subassembly can emit light outwards, and the light is reflected on the surface of the object to be identified. After receiving the reflected light, the light receiving subassembly converts it into an electrical signal, and then converts it into a fingerprint image. When the object to be identified is the user's finger, the effective light received by the light receiving subassembly can be the light reflected by the lines on the fingerprint surface of the user's finger.

[0144] For example, when the feature acquisition component is acquiring fingerprints, light can be emitted through the light output subcomponent, and the light can be emitted and propagated outward through the transparent pixels of the screen module. When the outwardly emitted light encounters the object to be identified (for example, the user's finger), part of the light will be reflected back by the object to be identified, and the reflected light can be emitted and propagated to the light receiving subcomponent through the screen module and transparent pixels. The light receiving subcomponent can form an image to be identified based on the received reflected light, and send the formed image to be identified to the cloud, so that the cloud can perform fingerprint identification based on the image to be identified to obtain a fingerprint identification result.

[0145] In the disclosed embodiment, by arranging the light output subassembly and the light receiving subassembly in the non-display area outside the display area of ​​the display module in the terminal device, the screen-to-body ratio of the terminal device can be increased. By sending the acquired biometric information to the cloud for processing, it is not necessary to arrange a hardware circuit specifically for processing biometric information on the terminal device side, so that the terminal device can be made thinner and lighter.

[0146] In some optional embodiments, the method further includes:

[0147] When a trigger operation for the hardware module is detected, acquisition data is obtained; wherein, the hardware module is located in the non-display area;

[0148] The acquired acquisition data is sent to the cloud.

[0149] In some alternative embodiments, the method further includes:

[0150] Receive the indication information returned by the cloud for the biometric information and perform the operation indicated by the indication information.

[0151] Here, taking the biometric information as fingerprint feature information as an example, after the cloud receives the fingerprint feature information, the fingerprint feature information can be matched with a preset fingerprint feature, and indication information corresponding to the matching result is generated. After generating the indication information, the indication information can be sent to the terminal device.

[0152] For example, if the fingerprint feature information matches the preset fingerprint feature successfully, a first indication information is sent to the terminal device, wherein the first indication information is used to instruct the terminal device to unlock. After the terminal device receives the first indication information, it unlocks automatically; if the fingerprint feature information does not match the preset fingerprint feature, a second indication information is sent to the terminal device, wherein the second indication information is used to indicate that the fingerprint feature information does not match the preset fingerprint feature. After the terminal device receives the second indication information, the unlocking operation of the terminal device can be prohibited and a prompt message indicating the matching failure is output.

[0153] In some embodiments, the biometric information obtained by the biometric module can be sent to the Microcontroller Unit (MCU) of the terminal device. The MCU sends the biometric information to the cloud for matching through the communication module. After the algorithm processing is implemented in the cloud, the indication information corresponding to the matching result is sent down to the terminal device through the communication network so that the terminal device can implement the unlocking operation.

[0154] In the embodiments of the present disclosure, by setting the matching process in the cloud and processing biometric information through the cloud, even if the user loses the terminal device, others need to authenticate the identity information through the cloud to unlock the terminal device, and authorization to unlock can only be obtained after successful authentication, which can reduce the possibility of criminals cracking and unlocking the terminal device through local matching. Moreover, through the technical solution in the present disclosure, after the user loses the terminal device, the user can, through cloud authentication, apply at any time for another terminal device (the first terminal device) to use the identity authentication of the original terminal device (the second terminal device). Once someone attempts to unlock the second terminal device, the cloud can send a reminder message to the first terminal device, and the user can immediately know through the first terminal device that someone is cracking and unlocking the second terminal device, thereby improving the security level of the terminal device.

[0155] Figure 8 FIG. is a block diagram of a processing device 1200 for biometrics shown according to an exemplary embodiment. For example, the device 1200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0156] Referring to Figure 8 , the device 1200 may include one or more of the following components: a processing component 1202, a memory 1204, a power supply component 1206, a multimedia component 1208, an audio component 1210, an input / output (I / O) interface 1212, a sensor component 1214, and a communication component 1216.

[0157] The processing component 1202 generally controls the overall operation of the device 1200, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 1202 may include one or more processors 1220 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 1202 may include one or more modules to facilitate the interaction between the processing component 1202 and other components. For example, the processing component 1202 may include a multimedia module to facilitate the interaction between the multimedia component 1208 and the processing component 1202.

[0158] The memory 1204 is configured to store various types of data to support the operation of the device 1200. Examples of such data include instructions for any application or method operating on the device 1200, contact data, phone book data, messages, pictures, videos, and the like. The memory 1204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0159] The power supply component 1206 provides power to various components of the device 1200. The power supply component 1206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1200.

[0160] The multimedia component 1208 includes a screen that provides an output interface between the device 1200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can not only sense the boundaries of touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 1208 includes a front camera and / or a rear camera. When the device 1200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0161] The audio component 1210 is configured to output and / or input audio signals. For example, the audio component 1210 includes a microphone (MIC) that is configured to receive external audio signals when the device 1200 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 1204 or transmitted via the communication component 1216. In some embodiments, the audio component 1210 further includes a speaker for outputting audio signals.

[0162] The I / O interface 1212 provides an interface between the processing component 1202 and a peripheral interface module, which can be a keyboard, a click wheel, buttons, etc. These buttons can include, but are not limited to: a home button, a volume button, a power-on button, and a lock button.

[0163] The sensor assembly 1214 includes one or more sensors for providing a status assessment of various aspects of the device 1200. For example, the sensor assembly 1214 can detect the on / off state of the device 1200, the relative positioning of components, such as the display and keypad of the device 1200. The sensor assembly 1214 can also detect a change in the position of the device 1200 or a component of the device 1200, the presence or absence of user contact with the device 1200, the orientation or acceleration / deceleration of the device 1200, and a change in the temperature of the device 1200. The sensor assembly 1214 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1214 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1214 can further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0164] The communication component 1216 is configured to facilitate communication between the device 1200 and other devices in a wired or wireless manner. The device 1200 can access a wireless network based on communication standards, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1216 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0165] In an exemplary embodiment, the device 1200 can be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above-described method.

[0166] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 1204 including instructions, is also provided. The above instructions can be executed by the processor 1220 of the device 1200 to complete the above-described method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0167] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor of a biometric processing device, enables the biometric processing device to execute a biometric processing method, the method comprising:

[0168] When a trigger operation of an object to be recognized for a sensing area is detected, acquiring biometric information of the object to be recognized based on a feature acquisition component; wherein, the sensing area is located in a display area of a screen module of the terminal device, and the feature acquisition component is located in a non-display area of the terminal device other than the display area of the screen module;

[0169] Sending the biometric information to the cloud.

[0170] Those skilled in the art will readily conceive of other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present invention, which follow the general principles of the present invention and include common general knowledge or conventional technical means in the technical field not disclosed in this disclosure. The specification and embodiments are only to be considered as exemplary, and the true scope and spirit of the present invention are pointed out by the following claims.

[0171] It should be understood that the present invention is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present invention is only limited by the appended claims.

Claims

1. A terminal device, characterized in that, Including: A screen module; A biometric module, including: a sensing component and a feature acquisition component, wherein a sensing area corresponding to the sensing component is located within a display area corresponding to the screen module for sensing an object to be recognized; The feature acquisition component is located in a non-display area of the terminal device other than the display area of the screen module for acquiring biometric information of the object to be recognized; the feature acquisition component includes: a light output sub-component and a light reception sub-component disposed at intervals in the non-display area, and a light-emitting surface of the light output sub-component is parallel and opposite to a light-incident surface of the light reception sub-component; the non-display area includes an area where a border of the terminal device is located; A communication module, connected to the biometric module, for sending the biometric information to the cloud.

2. The terminal device according to claim 1, wherein The terminal device further includes: A hardware module, located in the non-display area, connected to the communication module, for acquiring acquisition data and sending the acquisition data to the cloud through the communication module; The hardware module includes: A power supply module for supplying electric energy to the terminal device; A function module, the function module includes: a system circuit, and the system circuit has at least one of the following functions: an audio function, a charging function, a sensing function, a display function, and a camera function.

3. The terminal device according to claim 1, wherein The sensing component and the feature acquisition component are transparent.

4. The terminal device according to claim 1, wherein The terminal device further includes: A support module for supporting the screen module, and the support module is transparent; A screen substrate for carrying a screen film layer assembly, and both the screen substrate and the screen film layer assembly are transparent.

5. The terminal device according to claim 1, wherein The feature acquisition component includes: A light output sub-component, forming a first transmission optical path with the sensing component, and light output by the light output sub-component is transmitted to the sensing component along the first transmission optical path; A light reception sub-component, forming a second transmission optical path with the sensing component, and light transmitted to the sensing component along the first transmission optical path is reflected by the object to be recognized and then transmitted to the light reception sub-component along the second transmission optical path.

6. The terminal device according to claim 5, wherein The terminal device further includes: A first border, and the light output sub-component is disposed in an area where the first border is located; A second border, parallel and opposite to the first border, and the light reception sub-component is disposed in an area where the second border is located; Wherein, the screen module is located between the first border and the second border.

7. The terminal device according to claim 5, wherein The light-incident surface of the light reception sub-component and the light-emitting surface of the light output sub-component both face a display surface of the screen module.

8. The terminal device according to claim 5, wherein The feature acquisition component further includes: A first deflection component for deflecting light output from the light-emitting surface of the light output sub-component to the sensing component; A second deflection component for deflecting light reflected by the object to be recognized on the sensing component to the light reception sub-component.

9. The terminal device according to claim 8, wherein The first deflection component is located between the light output sub-component and the sensing component, forming a first sub-transmission optical path with the light output sub-component and a second sub-transmission optical path with the sensing component. The first sub-transmission optical path and the second sub-transmission optical path together constitute the first transmission optical path; The second deflection component is located between the sensing component and the light receiving sub-component, forming a third sub-transmission optical path with the sensing component and a fourth sub-transmission optical path with the light receiving sub-component. The third sub-transmission optical path and the fourth sub-transmission optical path together constitute the second transmission optical path.

10. The terminal device according to claim 8, wherein both the first deflection component and the second deflection component are located in a non-display area of the terminal device except for the display area of the screen module.

11. A method for processing biometric features, characterized in that, Applied to a terminal device, including: When a trigger operation of a to-be-identified object for a sensing area is detected, obtaining biometric information of the to-be-identified object based on a feature acquisition component; wherein, the sensing area is located in the display area of the screen module of the terminal device, and the feature acquisition component is located in a non-display area of the terminal device except for the display area of the screen module; the feature acquisition component includes a light output sub-component and a light receiving sub-component that are spaced apart in the non-display area, and the light-emitting surface of the light output sub-component is parallel and opposite to the light-incident surface of the light receiving sub-component; the non-display area includes the area where the border of the terminal device is located; Sending the biometric information to the cloud.

12. The method according to claim 11, characterized in that, The method further includes: When a trigger operation for a hardware module is detected, obtaining acquisition data; wherein, the hardware module is located in the non-display area; Sending the obtained acquisition data to the cloud.

13. The method according to claim 11, wherein The obtaining the biometric information of the to-be-identified object based on the feature acquisition component includes: Obtaining an optical signal obtained by detecting the to-be-identified object based on the feature acquisition component; Obtaining the biometric information based on the detected optical signal.

14. The method according to claim 11, wherein The method further includes: Receiving indication information returned by the cloud for the biometric information and performing an operation indicated by the indication information.

15. A biometric processing device, characterized in that, Including: A processor; A memory for storing processor-executable instructions; Wherein, the processor is configured to: when executing the executable instructions, implement the steps in the method according to any one of claims 11 to 14.

16. A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a biometric processing device, enabling the biometric processing device to execute the steps in the method according to any one of claims 11 to 14.

Images