Haptic feedback method and apparatus, and electronic device, storage medium and program product

Abstract

Provided in the embodiments of the present application are a haptic feedback method and apparatus, and an electronic device, a storage medium and a program product. The haptic feedback method comprises: acquiring a fingerprint image obtained when a user inputs a fingerprint by means of a fingerprint sensor of a terminal device; on the basis of the fingerprint image, determining pressing area information of the user inputting the fingerprint by means of the fingerprint sensor; on the basis of the pressing area information, determining vibration configuration information of a vibration element of the terminal device; and on the basis of the vibration configuration information, controlling the vibration element to vibrate so as to provide haptic feedback to the user.

Description

Haptic feedback methods, devices, electronic devices, storage media and software products

[0001] This application claims priority to Chinese Patent Application No. 202410910470.5, filed on July 8, 2024, entitled "Haptic Feedback Method, Apparatus, Electronic Device, Storage Medium and Program Product", and Chinese Patent Application No. 202410918658.4, filed on July 8, 2024, entitled "Haptic Feedback Method, Apparatus, Electronic Device, Storage Medium and Program Product", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of electronic device technology, and in particular to a haptic feedback method, device, electronic device, storage medium, and program product. Background Technology

[0003] Fingerprint sensors are commonly used in smartphones and other terminal devices, enabling important functions such as smart unlocking and financial transactions. To improve the waterproofing of terminal devices (such as smartphones), accommodate the widespread adoption of foldable screens, and meet the requirements for weight and thinness reduction, buttonless designs are becoming the preferred solution. Therefore, based on this technological trend, it is necessary to provide a new technical solution to improve the user experience of using fingerprint sensors in buttonless terminal devices. Summary of the Invention

[0004] In view of this, embodiments of this application provide a haptic feedback scheme to improve the user experience.

[0005] According to a first aspect of the embodiments of this application, a tactile feedback method is provided, comprising: acquiring a fingerprint image obtained when a user registers a fingerprint through a fingerprint sensor of a terminal device; determining, based on the fingerprint image, information on the pressing area of ​​the fingerprint registered by the user through the fingerprint sensor; determining, based on the pressing area information, vibration configuration information of a vibration element of the terminal device; and controlling the vibration element to vibrate based on the vibration configuration information to provide tactile feedback to the user.

[0006] According to a second aspect of the embodiments of this application, a tactile feedback device is provided, comprising: a first acquisition module, configured to acquire a fingerprint image obtained when a user registers a fingerprint through a fingerprint sensor of a terminal device; a first determination module, configured to determine, based on the fingerprint image, the pressing area information of the fingerprint registered by the user through the fingerprint sensor; a second determination module, configured to determine, based on the pressing area information, vibration configuration information of a vibration element of the terminal device; and a first control module, configured to control the vibration element to vibrate based on the vibration configuration information, so as to provide tactile feedback to the user.

[0007] According to the tactile feedback scheme provided in the embodiments of this application, on the one hand, by setting a fingerprint sensor and a vibration element in the terminal device, the vibration of the vibration element can be controlled to provide tactile feedback on the use of the fingerprint sensor, thereby giving the user a better tactile experience when using the fingerprint sensor on the terminal device (including but not limited to terminal devices without physical buttons), thus effectively improving the user experience; on the other hand, since this scheme can determine the pressing area information of the fingerprint recorded by the user through the fingerprint sensor based on the fingerprint image when the user records the fingerprint, and determine the vibration configuration information of the vibration element based on the pressing area information, and control the vibration of the vibration element based on the vibration configuration information, the vibration of the vibration element can be reasonably controlled according to the user's pressing area information, thereby achieving more reasonable tactile feedback to the user, thus improving the user experience of using the fingerprint sensor.

[0008] According to a third aspect of the embodiments of this application, a tactile feedback method is provided, comprising: acquiring a wake-up signal and controlling a fingerprint sensor of a terminal device to enter a working state according to the wake-up signal; receiving a fingerprint image recorded by a user through the fingerprint sensor and determining whether the fingerprint image is a valid fingerprint image; in response to determining that the fingerprint image is a valid fingerprint image, performing fingerprint recognition based on the fingerprint image to obtain a fingerprint recognition result; and controlling a vibration element of the terminal device to vibrate based on the fingerprint recognition result to provide tactile feedback to the user.

[0009] According to a fourth aspect of the embodiments of this application, a tactile feedback device is provided, comprising: a second acquisition module, configured to acquire a wake-up signal and control a fingerprint sensor of a terminal device to enter a working state according to the wake-up signal; a determination module, configured to receive a fingerprint image entered by a user through the fingerprint sensor and determine whether the fingerprint image is a valid fingerprint image; an identification module, configured to, in response to determining that the fingerprint image is a valid fingerprint image, perform fingerprint identification based on the fingerprint image to obtain a fingerprint identification result; and a second control module, configured to control a vibration element of the terminal device to vibrate based on the fingerprint identification result to provide tactile feedback to the user.

[0010] According to the tactile feedback scheme provided in the embodiments of this application, on the one hand, by setting a fingerprint sensor and a vibration element in the terminal device, the vibration element can be controlled to vibrate to provide tactile feedback for the use of the fingerprint sensor, thereby providing users with a better tactile experience when using the fingerprint sensor on the terminal device (including but not limited to terminal devices without physical buttons), thus effectively improving the user experience; on the other hand, in the embodiments of this application, the fingerprint sensor is only woken up to enter the working state when fingerprint recognition and tactile feedback are required, which helps to reduce the power consumption of the fingerprint sensor and the terminal device; furthermore, since the fingerprint image recorded by the user through the fingerprint sensor is received and fingerprint recognition is performed only after the fingerprint image is determined to be a valid fingerprint image, the possibility of fingerprint recognition failure when using the fingerprint sensor is reduced; furthermore, in the embodiments of this application, after obtaining the fingerprint recognition result, the vibration element can be reasonably controlled to vibrate according to the fingerprint recognition result to provide reasonable tactile feedback to the user, effectively reminding the user, thereby improving the user experience of using the fingerprint sensor. Therefore, it can be seen that the technical solution in this application embodiment, through the entire process of first waking up the fingerprint, then determining the valid fingerprint image, then fingerprint recognition, and then providing vibration and tactile feedback, can effectively improve the user experience of using the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons).

[0011] According to a fifth aspect of the present application, an electronic device is provided, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory is used to store a computer program; and the processor is used to execute the method described in the first or third aspect by running the computer program stored in the memory.

[0012] According to a sixth aspect of the embodiments of this application, a computer storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the method as described in the first or third aspect.

[0013] According to a seventh aspect of the embodiments of this application, a computer program product is provided, including a computer program that, when executed by a processor, implements the method described in the first or third aspect. Attached Figure Description

[0014] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.

[0015] Figure 1 is a flowchart of the steps of a tactile feedback method according to the first aspect of the present application.

[0016] Figure 2 is an optional schematic diagram of the fingerprint sensor and vibration element installed on a terminal device according to an embodiment of this application.

[0017] Figure 3 is a side view of the fingerprint sensor and vibration element along direction F.

[0018] Figure 4 is a flowchart of some optional sub-steps of step S104 in an embodiment of this application.

[0019] Figure 5A shows the finger pressing state when the user's fingerprint enrollment operation is a valid enrollment operation.

[0020] Figure 5B shows the finger pressing state when a user's fingerprint enrollment operation is invalid.

[0021] Figure 6 is a schematic diagram of the structure of an optional vibration element according to an embodiment of this application.

[0022] Figure 7 is a schematic diagram of an optional overall process of the haptic feedback scheme of the first aspect of the present application.

[0023] Figure 8 is a schematic diagram of a tactile feedback device according to a second aspect of an embodiment of this application.

[0024] Figure 9 is a flowchart of the steps of a tactile feedback method according to a third aspect of the present application.

[0025] Figure 10A shows some possible schematic diagrams of the placement between the ring capacitive sensor and the fingerprint sensor.

[0026] Figure 10B shows some possible schematic diagrams of the placement of the detection electrode and the fingerprint sensor.

[0027] Figure 11 is a flowchart of some optional steps in determining whether a fingerprint image is a valid fingerprint image in an embodiment of this application.

[0028] Figure 12 is a schematic diagram of another optional overall process of the haptic feedback scheme of the third aspect of the present application.

[0029] Figure 13 is a schematic diagram of a tactile feedback device according to a fourth aspect of an embodiment of this application.

[0030] Figure 14 is a schematic diagram of the structure of an electronic device according to an embodiment of this application.

[0031] Explanation of reference numerals in the attached figures:

[0032] 100, Vibrating element; 10, Vibrating unit; 11, First electrode; 12, Second electrode; 121, First sub-electrode plate; 122, Second sub-electrode plate; 123, Conductor structure; 13, Piezoelectric layer; 20, Fixing unit; 30, Adhesive layer; 40, Wire; 200, Fingerprint sensor; 300, Terminal device; 301, Housing; 302, Mid-frame; 303, Screen; 304, Side frame; 1000, Tactile feedback device; 1002, First acquisition module; 1004, First determination module; 1006, Second determination module; 1008, First control module; 800, Tactile feedback device; 802, Second acquisition module; 804, Determination module; 806, Recognition module; 808, Second control module. Detailed Implementation

[0033] To enable those skilled in the art to better understand the technical solutions in the embodiments of this application, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art should fall within the protection scope of the embodiments of this application.

[0034] Fingerprint sensors are commonly used in smartphones and other terminal devices, enabling important functions such as smart unlocking and financial transactions. To improve the waterproof performance of terminal devices (e.g., smartphones), accommodate the widespread adoption of foldable screens, and meet the requirements for weight and thinness reduction, buttonless and holeless designs are becoming the preferred solution. Therefore, based on this technological trend, this application provides a haptic feedback solution to improve the user experience when using fingerprint sensors in buttonless terminal devices.

[0035] The specific implementation of the embodiments of this application will be further described below with reference to the accompanying drawings.

[0036] Figure 1 is a flowchart of a tactile feedback method according to a first aspect of an embodiment of the present application. According to the first aspect of an embodiment of the present application, a tactile feedback method is provided. Referring to Figure 1, the method includes steps S102, S104, S106, and S108, specifically:

[0037] S102: Obtain the fingerprint image obtained when the user registers their fingerprint through the fingerprint sensor of the terminal device.

[0038] In this embodiment, the terminal device can be any type of electronic device that requires a fingerprint sensor for fingerprint detection. For example, it can be a mobile terminal such as a mobile phone, a tablet computer, a computer, a server, etc.

[0039] Optionally, the fingerprint sensor can be an ultrasonic fingerprint sensor or a capacitive fingerprint sensor. It should be understood that the specific structure of the ultrasonic fingerprint sensor and the capacitive fingerprint sensor is not limited in this embodiment. Alternatively, the fingerprint sensor can also be other types of fingerprint sensors, such as optical fingerprint sensors, as long as the requirements are met.

[0040] Optionally, the fingerprint sensor in this embodiment can be disposed within the housing of the terminal device, and the housing can protect the fingerprint sensor. Optionally, the fingerprint sensor can be a rear fingerprint sensor or a side fingerprint sensor. The rear fingerprint sensor can be a fingerprint sensor whose fingerprint recognition area is located on the back of the terminal device (for example, taking a mobile terminal such as a mobile phone as an example, the back of the terminal device can be the side facing away from the screen). The side fingerprint sensor can be a fingerprint sensor whose fingerprint recognition area is located on the side frame of the terminal device. With the above types of fingerprint sensors, rear fingerprint recognition or side fingerprint recognition can be realized, and the need for vibration and tactile feedback for rear or side fingerprints on the terminal device can be well met.

[0041] In this embodiment, a fingerprint sensor and a vibration element are simultaneously installed in the terminal device, and tactile feedback is provided to the user by controlling the vibration of the vibration element. The vibration element can be a low-frequency vibration source and can adopt any structure. Optionally, the low-frequency vibration source can be configured to generate low-frequency vibrations greater than 500Hz. In some optional examples, the low-frequency vibration source can be or may include a piezoelectric actuator, an eccentric rotating block, and / or a linear resonant actuator. It should be noted that, as part of the inventive point of the tactile feedback scheme of this embodiment, this embodiment provides a novel structure of vibration element to facilitate the implementation of the tactile feedback scheme. This structure will be described in detail in conjunction with the following steps and will not be repeated here.

[0042] In this embodiment, the vibration element can be disposed at any suitable location on the terminal device. Optionally, both the vibration element and the fingerprint sensor are disposed within the housing of the terminal device, and the vibration element can be disposed around the edge of the fingerprint sensor, or it can be disposed below the fingerprint sensor. By disposing the vibration element in these optional locations, it is beneficial to better provide tactile feedback through vibration when the user uses the fingerprint sensor, thereby improving the tactile feedback effect and the user experience of the fingerprint sensor. Optionally, the vibration element can also be directly mounted on the fingerprint sensor and used as a whole. For example, both the vibration element and the fingerprint sensor can be mounted in the middle frame within the housing of the terminal device. Optionally, multiple vibration elements can also be used in this embodiment, and these multiple vibration elements can be disposed below and / or around the edge of the fingerprint sensor.

[0043] For example, Figure 2 shows an optional schematic diagram of the fingerprint sensor and vibration element installed on a terminal device according to an embodiment of this application. An optional installation method can be understood with reference to Figure 2. Figure 2 can be considered as a top-down structural schematic diagram of the terminal device. The fingerprint sensor 200 shown in Figure 2 can be an ultrasonic fingerprint sensor, and is a side-mounted fingerprint sensor. In Figure 2, the terminal device 300 includes a housing 301, a mid-frame 302, and a screen 303. The housing 301 includes a side frame 304, and the mid-frame 302 is disposed within the housing 301. The fingerprint sensor 200 and vibration element 100 can be installed in the mid-frame 302 inside the housing 301. Optionally, the fingerprint sensor 200 and vibration element 100 can be fixed between the mid-frame 302 and the side frame 304 inside the housing 301 by injecting adhesive, thereby achieving the installation of the fingerprint sensor 200 and vibration element 100 on the terminal device 300. Referring to Figure 2, users can also place their fingers on the side frame 304 of the terminal device 300 along direction F to register their fingerprints through the fingerprint registration area of ​​the fingerprint sensor 200, thus achieving fingerprint recognition. Figure 3 is a side view of the fingerprint sensor 200 and the vibration element 100 along direction F. Furthermore, referring to Figures 2 and 3, multiple vibration elements 100 (i.e., vibration element 100A, vibration element 100B, and vibration element 100C) can be arranged around the perimeter of the fingerprint sensor 200. Optionally, the thickness of the side frame 304 of the terminal device 300 can be 0.5 mm or less, and the side frame 304 can be made of metal, but is not limited to this.

[0044] In another optional installation method, the mid-frame and side bezel of the terminal device can be designed as a single unit, with the side bezel being part of the mid-frame (it should be understood that the side bezel is also part of the terminal device's housing). Blind holes can be made on the inner side of the side bezel, and at least part of the fingerprint sensor (side fingerprint sensor) and vibration element can be placed within these blind holes. The fingerprint sensor and vibration element can be fixed in the blind holes by injecting adhesive, thus achieving the installation of the fingerprint sensor and vibration element on the terminal device. Optionally, the side bezel of the single-unit mid-frame can be designed with a hybrid layering of 0.5mm or less metal material and 1mm or less plastic material. Since the fingerprint sensor's signal acquisition and the vibration element's vibration penetration capabilities are limited, by creating blind holes on the inner side of the side frame and placing at least part of the fingerprint sensor and vibration element within these blind holes, the thickness of the cover plate that needs to be penetrated can be reduced without affecting structural reliability. This reduces the difficulty of transmitting tactile feedback from the vibration element to the user, thereby improving the tactile feedback effect. Furthermore, when the fingerprint sensor is an ultrasonic fingerprint sensor, it can also reduce the difficulty of ultrasonic signal transmission and prevent situations where ultrasonic signals cannot penetrate the housing. In addition, it can make more rational use of the space inside the terminal device's housing, adapting to the requirements of thinner and lighter terminal devices. This can improve the performance of the side fingerprint sensor and vibration element, enhancing the user's experience of using the fingerprint sensor and the tactile feedback experience.

[0045] Optionally, multiple vibration elements may be provided in the embodiments of this application. For example, in some embodiments, multiple vibration elements may be arranged around the periphery of the fingerprint sensor, and / or, multiple vibration elements may be arranged below the fingerprint sensor. By controlling at least one of the multiple vibration elements to vibrate, a variety of vibration effects can be provided, achieving diverse and rich tactile feedback effects and improving the user experience. In addition, other functions can also be achieved through multiple vibration elements, such as detecting finger slippage and pressure value detection, etc.

[0046] Optionally, in this embodiment, before a user enrolls their fingerprint using the fingerprint sensor on the terminal device, the fingerprint sensor can be woken up to enable it to enter a working state capable of collecting fingerprints. Optionally, a wake-up signal can be acquired, and the fingerprint sensor can be controlled to enter the working state based on the wake-up signal. The wake-up signal can be obtained in any suitable manner. For example, if the fingerprint sensor is operating in low-power mode, the user's finger can be detected in real time (either by the fingerprint sensor or by other detection methods). If the user's finger is detected touching the location on the terminal device corresponding to the fingerprint enrollment area of ​​the fingerprint sensor, a wake-up signal is generated to wake the fingerprint sensor from low-power mode to a working state capable of collecting fingerprints. Alternatively, if the fingerprint sensor is in a turned-off state, the terminal device can receive a wake-up operation from the user to generate a wake-up signal, which in turn wakes the fingerprint sensor from a turned-off state to a working state capable of collecting fingerprints. Optionally, the wake-up operation can include, but is not limited to, a click operation by the user through the touchscreen of the terminal device, a voice operation, a gesture operation, etc.

[0047] When registering a fingerprint, a user can place their finger on the corresponding area of ​​the fingerprint sensor on the terminal device (for example, if it's a side-mounted fingerprint sensor, this area will be on the side edge of the terminal device; if it's a rear-mounted fingerprint sensor, this area will be on the back of the terminal device). For terminal devices without physical buttons, to better indicate the location of the fingerprint registration area, an indicator mark can optionally be added to the casing of the mobile device. This will help the user understand the approximate location of the fingerprint registration area, facilitating fingerprint registration and recognition. For example, the indicator mark can be a printed logo (which can be at least one or more of any pattern, text, etc.), or it can be a sticker or other structure that indicates the location.

[0048] Since there is a possibility of accidental touch or misoperation during fingerprint detection, this application embodiment can improve the effect of fingerprint recognition and tactile feedback by setting some conditions, which will be described in detail below.

[0049] S104: Based on the fingerprint image, determine the pressing area information of the fingerprint recorded by the user through the fingerprint sensor.

[0050] After obtaining the fingerprint image entered by the user, the pressure area information of the fingerprint entered through the fingerprint sensor can be determined based on the fingerprint image. The pressure area information refers to the relevant information of the area of ​​the finger pressed on the fingerprint entry area when the user enters their fingerprint through the fingerprint sensor. In this embodiment, the pressure area information is used to configure the vibration of the subsequent vibration element to achieve tactile feedback, which can improve the effect of tactile feedback. For example, it can reduce the possibility of redundant fingerprint recognition due to accidental touches or misoperations by the user.

[0051] In some optional embodiments, the pressing area information includes the proportion of the pressing area of ​​the fingerprint sensor pressed by the user in the fingerprint enrollment area; referring to the flowchart shown in FIG4, the above step S104 includes the following sub-steps S1041 and S1042, specifically:

[0052] S1041: Determine the fingerprint area in the fingerprint image.

[0053] In this embodiment, the fingerprint area can be the area of ​​a valid fingerprint in a fingerprint image. For example, in some embodiments, the fingerprint area can be determined by determining the number of pixels of the fingerprint in the fingerprint image. Alternatively, in other embodiments, the fingerprint area can be determined by first fitting contour lines to the pixels of the fingerprint in the fingerprint image to obtain the contour of the fingerprint in the fingerprint image, and then determining the fingerprint area based on the number of pixels within the contour.

[0054] S1042: Determine the ratio between the fingerprint area and the total area of ​​the fingerprint image, and set the ratio as the proportion of the pressed area.

[0055] Optionally, the total area of ​​the fingerprint image can be determined based on the total number of pixels in the fingerprint image. Optionally, since the size of the fingerprint image acquired by the fingerprint sensor can be set to a fixed size, the total area of ​​the acquired fingerprint image can also be a fixed area. Therefore, the total area can be pre-stored and retrieved directly when needed.

[0056] The ratio between the calculated fingerprint area and the total area of ​​the fingerprint image indicates the proportion of the user's fingerprint area in the entire fingerprint image. This corresponds to the proportion of the area pressed by the user when entering the fingerprint through the fingerprint sensor. Therefore, this ratio can be determined as the proportion of the pressed area for subsequent data processing.

[0057] Based on this, in the optional embodiments of the above sub-steps S1041 and S1042 in this application, the pressing area information of the fingerprint recorded by the user through the fingerprint sensor can be effectively determined based on the fingerprint image. This facilitates the subsequent vibration configuration information of the vibration element based on the pressing area information, so that the vibration element can be reasonably controlled to vibrate according to the user's pressing area information, thereby achieving more reasonable tactile feedback to the user and improving the user's experience of using the fingerprint sensor.

[0058] S106: Based on the pressing area information, determine the vibration configuration information of the vibration element of the terminal device.

[0059] After obtaining the pressing area information, the vibration configuration information of the vibrating element can be determined based on this information. The vibration configuration information allows for the configuration of the vibration state of the vibrating element, controlling it to enter a corresponding vibration state. Different vibration configuration information corresponds to different vibration states.

[0060] Optionally, multiple different vibration configuration information can be preset (for example, the first vibration configuration information, the second vibration configuration information, and the third vibration configuration information described below) so as to control the vibration element to enter different vibration states when needed, so as to more conveniently provide different tactile feedback effects to the user through different vibration effects.

[0061] It should be understood that step S106 can be implemented in a variety of optional ways. For the sake of describing the embodiments of this application, the relevant optional content of step S106 will be described in detail in conjunction with the relevant content of S108 below, and will not be repeated here.

[0062] S108: Based on vibration configuration information, control the vibration element to vibrate in order to provide tactile feedback to the user.

[0063] Based on this, the tactile feedback scheme in steps S102 to S108 above provides the following benefits: First, by setting a fingerprint sensor and a vibration element in the terminal device, the vibration of the vibration element can be controlled to provide tactile feedback on the use of the fingerprint sensor. This allows users to have a better tactile experience when using the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons), thus effectively improving the user experience. Second, this scheme can determine the pressure area information of the fingerprint when the user registers it based on the fingerprint image, and determine the vibration configuration information of the vibration element based on the pressure area information. The vibration element can then be controlled to vibrate based on the vibration configuration information. This allows for more reasonable tactile feedback to the user, thereby improving the user experience of using the fingerprint sensor.

[0064] In some optional embodiments, step S106 includes: in response to the pressing area information satisfying a first preset condition, determining first vibration configuration information for controlling the vibration element of the terminal device to enter a first vibration state. Based on this, step S108 includes: based on the first vibration configuration information, controlling the vibration element to enter the first vibration state to vibrate, so as to provide tactile feedback to the user.

[0065] Optionally, the first preset condition can be a condition for determining whether the user's fingerprint enrollment operation is invalid. When the pressure area information meets the first preset condition, the user's fingerprint enrollment operation can be considered invalid. Because users may accidentally touch or misoperate during fingerprint enrollment, resulting in a small pressure area within the fingerprint enrollment area, using fingerprint images enrolled under such circumstances for fingerprint recognition may lead to recognition failure.

[0066] For example, referring to FIG5A, the user's fingerprint enrollment operation is shown in a valid enrollment state (for ease of understanding, the fingerprint edge on the finger in FIG5A is schematically shown with dashed lines, but this is not intended to limit the embodiments of this application). As can be seen from FIG5A, the user's finger presses a normal area in the fingerprint enrollment area, and the enrolled fingerprint image is relatively complete. Therefore, the enrolled fingerprint can meet the requirements for normal recognition. As another example, referring to FIG5B, the user's fingerprint enrollment operation is shown in a invalid enrollment state (for ease of understanding, the fingerprint edge on the finger in FIG5B is schematically shown with dashed lines, but this is not intended to limit the embodiments of this application). As can be seen from FIG5B, the user's finger is not pressed well in the fingerprint enrollment area, resulting in a smaller pressing area and an incomplete fingerprint image, which may lead to a situation where the fingerprint image cannot be recognized normally.

[0067] Therefore, in this embodiment of the application, by determining the first vibration configuration information for controlling the vibration element to enter the first vibration state when the pressing area information meets the first preset condition, it is convenient to control the vibration element to enter the first vibration state for vibration based on the first vibration configuration information, so as to realize the corresponding tactile feedback when the user accidentally touches or misoperates when registering fingerprints, effectively reminding the user, thereby improving the user experience of the fingerprint sensor of the terminal device.

[0068] The first preset condition can be preset as needed. For example, optionally, the first preset condition can be a threshold condition. Taking the pressing area information as the pressing area ratio in the above text as an example, in some optional embodiments, the step of "determining the first vibration configuration information for controlling the vibration element of the terminal device to enter the first vibration state in response to the pressing area information satisfying the first preset condition" includes: determining the first vibration configuration information for controlling the vibration element of the terminal device to enter the first vibration state in response to the pressing area ratio being less than a preset threshold. Based on this, it is possible to effectively realize corresponding tactile feedback for situations where users accidentally touch or misoperate when enrolling fingerprints, effectively reminding users, thereby improving the user experience of using the fingerprint sensor of the terminal device.

[0069] In some optional embodiments, step S106 further includes: responding to the fact that the pressure area information meets a second preset condition but not a first preset condition, performing fingerprint recognition based on the fingerprint image to obtain a fingerprint recognition result, and determining target vibration configuration information for controlling the vibration element of the terminal device to enter a target vibration state based on the fingerprint recognition result, wherein the second preset condition is different from the first preset condition, and the target vibration state is different from the first vibration state, and the fingerprint recognition result is used to indicate the legitimacy of the user's identity as recorded by the fingerprint sensor. Based on this, step S108 includes: controlling the vibration element to enter the target vibration state and vibrate based on the target vibration configuration information to provide tactile feedback to the user.

[0070] In this application, fingerprint recognition can be implemented using any fingerprint recognition algorithm, and no specific limitations are imposed here.

[0071] Optionally, the second preset condition can be a criterion for determining whether the user's fingerprint enrollment operation is a valid enrollment operation. When the pressure area information meets the second preset condition but not the first preset condition, the user's fingerprint enrollment operation is considered a valid enrollment operation. As mentioned above, when it is a valid enrollment operation, the fingerprint image can meet the requirements of fingerprint recognition. Then, fingerprint recognition can be performed based on the fingerprint image to obtain the fingerprint recognition result, so as to further realize tactile feedback.

[0072] It should be understood that, on the one hand, the above-mentioned optional solutions in the embodiments of this application, by performing fingerprint recognition on the fingerprint image only after the fingerprint area information meets the second preset condition but not the first preset condition, that is, after determining that the user's fingerprint enrollment operation is a valid enrollment operation, can reduce the possibility that the fingerprint recognition cannot obtain a normal result, thereby ensuring the fingerprint recognition effect; on the other hand, the target vibration configuration information for controlling the vibration element to enter the target vibration state can be determined based on the fingerprint recognition result, so that the vibration element can be controlled to enter the target vibration state different from the first vibration state based on the target vibration configuration information, so as to realize the corresponding tactile feedback for the user's normal fingerprint recognition, and realize the tactile feedback that distinguishes between normal fingerprint recognition, accidental touch / misoperation, etc., and effectively distinguish and remind the user, thereby improving the user's experience of using the fingerprint sensor of the terminal device.

[0073] It should be understood that fingerprint sensors can pre-register some users' fingerprints before use. The fingerprint recognition result indicates the legitimacy of the user's identity when the fingerprint is entered through the fingerprint sensor. Specifically, if the fingerprint entered by the user is determined to be the fingerprint of a user who has already registered when performing fingerprint recognition based on the fingerprint image, the fingerprint recognition result indicates that the user's identity is legitimate. Conversely, if the fingerprint entered by the user is determined to be the fingerprint of a user who has not already registered when performing fingerprint recognition based on the fingerprint image, the fingerprint recognition result indicates that the user's identity is illegitimate.

[0074] The second preset condition can be preset as needed. For example, optionally, the second preset condition can be a threshold condition. Taking the pressing area information as the pressing area ratio in the above text as an example, in some optional embodiments, the step of "responding to the pressing area information satisfying the second preset condition but not the first preset condition, performing fingerprint recognition based on the fingerprint image to obtain a fingerprint recognition result, and determining the target vibration configuration information for controlling the vibration element of the terminal device to enter the target vibration state based on the fingerprint recognition result" includes: responding to the pressing area ratio being greater than or equal to a preset threshold, performing fingerprint recognition based on the fingerprint image to obtain a fingerprint recognition result, and determining the target vibration configuration information for controlling the vibration element of the terminal device to enter the target vibration state based on the fingerprint recognition result. Based on this, tactile feedback can be effectively implemented for normal fingerprint recognition by the user, realizing tactile feedback that distinguishes between normal fingerprint recognition, accidental touch / misoperation, etc., and effectively differentiating and reminding the user accordingly, thereby improving the user experience of using the fingerprint sensor of the terminal device.

[0075] In some optional embodiments, the target vibration state includes a second vibration state and a third vibration state, and the second vibration state is different from the third vibration state; then the above-mentioned "determining the target vibration configuration information for controlling the vibration element of the terminal device to enter the target vibration state based on the fingerprint recognition result" includes: in response to the fingerprint recognition result indicating that the user's identity is legitimate, determining the second vibration configuration information for controlling the vibration element of the terminal device to enter the second vibration state; or, in response to the fingerprint recognition result indicating that the user's identity is illegitimate, determining the third vibration configuration information for controlling the vibration element of the terminal device to enter the third vibration state.

[0076] Optionally, after determining the second vibration configuration information, the vibration element can be controlled to enter a second vibration state to provide tactile feedback to the user. Alternatively, after determining the third vibration configuration information, the vibration element can be controlled to enter a third vibration state to provide tactile feedback to the user.

[0077] It should be understood that in this embodiment of the application, different vibration configuration information is determined based on whether the user identity indicated by the fingerprint recognition result is legitimate. This allows the vibration element to be controlled to achieve different vibrations based on different vibration configuration information, thereby realizing tactile feedback to distinguish between legitimate and illegitimate user identities. This effectively distinguishes and reminds users, thereby improving the user experience of using the fingerprint sensor on the terminal device.

[0078] In some optional embodiments, step S108 includes: controlling the vibration element to vibrate at a vibration frequency of 500 Hz or higher based on vibration configuration information to provide tactile feedback to the user.

[0079] Based on this, in this embodiment of the application, the vibration element is controlled to vibrate at a vibration frequency of 500Hz or higher, so as to ensure that the user can clearly perceive the tactile feedback effect brought about by the vibration of the vibration element, thereby ensuring the user's tactile feedback experience and thus ensuring the user's experience of using the fingerprint sensor of the terminal device.

[0080] Optionally, in the embodiments of this application, the vibration element vibrates at a frequency greater than or equal to 500Hz in the first, second, and third vibration states. However, different vibration frequencies can be used to achieve different vibration states, thereby producing different tactile feedback effects. Optionally, the vibration effect can also be changed by adjusting the duration and amplitude of the vibration. Additionally, the upper limit of the vibration frequency of the vibration element can be 1MHz.

[0081] For example, as an easy-to-understand illustration, in a first vibration state, the vibrating element can be controlled to vibrate at a frequency greater than 500 Hz (e.g., for 1 second) based on the first vibration frequency configuration information; in a second vibration state, the vibrating element can be controlled to vibrate at a frequency greater than 500 Hz (e.g., for 3 seconds) based on the second vibration frequency configuration information; and in a third vibration state, the vibrating element can be controlled to vibrate intermittently at a frequency greater than 500 Hz (e.g., intermittent vibration lasting 1 or 2 seconds) based on the third vibration frequency configuration information. Of course, this example is merely a simple illustration and is not intended to limit the embodiments of this application; in practice, it can be configured as needed.

[0082] In some optional embodiments, the terminal device in this application embodiment further includes a driving power supply for outputting a driving voltage. The driving voltage can be used to drive the vibration of the vibration element. Optionally, the driving power supply can be an AC driving power supply or a switching power supply. Optionally, the driving power supply can be disposed within the housing of the terminal device. The structure of the driving power supply is not limited here. Optionally, the driving power supply may include a driving chip and a power supply, wherein the driving chip obtains the power supply voltage from the power supply and outputs the required driving voltage based on the power supply voltage. The vibration unit 10 mentioned below can be electrically connected to the driving chip of the driving power supply. Optionally, the driving voltage can be in the range of 5V to 100V, but is not limited thereto.

[0083] The structure of a novel vibration element provided in this application embodiment will be described below. Figure 6 shows a schematic diagram of an optional vibration element according to an embodiment of this application. As shown in Figure 6, the optional vibration element 100 includes a vibration unit 10 and a fixing unit 20; the vibration unit 10 is electrically connected to a driving power supply and obtains a driving voltage from the driving power supply to vibrate under the action of the driving voltage; the vibration unit 10 is connected to a terminal device through the fixing unit 20, and the vibration is transmitted to the terminal device through the fixing unit 20 to provide tactile feedback to the user. For such an optional vibration element 100, when controlling the vibration element 100 to vibrate, the vibration unit 10 of the vibration element 100 can be controlled to vibrate by adjusting the driving voltage output by the driving power supply.

[0084] Based on this, the structure of the vibration element 100 in this embodiment can effectively control the vibration of its vibration unit 10, and can effectively realize different vibration states based on different vibration configuration information, so as to provide tactile feedback to the user and improve the user experience of the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons).

[0085] Optionally, the fixing unit 20 is connected to the housing of the terminal device. The vibration unit 10 can transmit vibration to the housing of the terminal device through the fixing unit 20 to provide tactile feedback to the user. The connection between the fixing unit 20 and the terminal device can be achieved through any structure, including but not limited to bonding, welding, screwing, etc. For example, optionally, the fixing unit 20 can be fixedly connected to the housing of the terminal device by applying a potted adhesive, so that the vibration unit 10 can transmit vibration to the housing of the terminal device through the fixing unit 20 to provide tactile feedback to the user.

[0086] Optionally, the vibration unit 10 of the vibration element 100 can be electrically connected to the drive power supply via a wire, or it can be electrically connected to the drive power supply via other electrical connection methods.

[0087] In some optional embodiments, when adjusting the drive voltage output by the drive power supply, the drive voltage output by the drive power supply can be adjusted by changing the switching frequency of the drive power supply and / or by changing the magnitude of the drive voltage output by the drive power supply.

[0088] Based on this, the embodiments of this application can effectively adjust the driving voltage output by the driving power supply in order to control the vibration of the vibration element 100 and realize different vibration states, so as to provide tactile feedback to the user and improve the user experience of the fingerprint sensor of the terminal device (including but not limited to the terminal device without physical buttons).

[0089] The specific structure of the vibration unit 10 is not limited in the embodiments of this application. In some optional embodiments, referring to FIG6, the vibration unit 10 includes: a first electrode 11, a piezoelectric layer 13, and a second electrode 12; the first electrode 11 is connected to a first side of the piezoelectric layer 13 along the thickness direction, and at least a portion of the second electrode 12 is connected to a second side of the piezoelectric layer 13 along the thickness direction, and the first electrode 11 and the second electrode 12 are not in contact; the fixing unit 20 is connected to the first electrode 11 and / or the second electrode 12; both the first electrode 11 and the second electrode 12 are electrically connected to the driving power supply and are used to obtain a driving voltage from the driving power supply to supply power to the piezoelectric layer 13. The piezoelectric layer 13 deforms under the action of the driving voltage to vibrate, and the vibration is transmitted to the terminal device through the fixing unit 20 to provide tactile feedback to the user.

[0090] Based on this, the structure of the vibration element 100 in this embodiment can effectively control the vibration of the piezoelectric layer 13 of its vibration unit 10, and can effectively realize different vibration states based on different vibration configuration information, so as to provide tactile feedback to the user and improve the user experience of the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons).

[0091] Optionally, both the first electrode 11 and the second electrode 12 may be made of a conductive material, which can be selected as needed. For example, the first electrode 11 and the second electrode 12 may include various metallic materials, but are not limited thereto. The metallic material may be one or a combination of copper, silver, etc. Optionally, both the first electrode 11 and the second electrode 12 may be plate-shaped, for example, they may be made into a metal plate structure.

[0092] Optionally, the piezoelectric layer 13 in this embodiment is made of a piezoelectric material, which can be selected as needed. When the first electrode 11 and the second electrode 12 are energized, deformation in the vertical direction can be achieved, and the material can return to its original shape after the power is turned off. By continuously switching the power on and off, vibration in the vertical direction can be generated. Therefore, by changing the switching frequency of the driving power supply and / or by changing the magnitude of the driving voltage output by the driving power supply, the vibration state of the piezoelectric layer 13 can be adjusted.

[0093] Optionally, the material of the piezoelectric layer 13 may include at least one of lead zirconate titanate, lithium niobate, and PVDF (polyvinylidene difluoride). Such materials can better accommodate the requirement that the piezoelectric layer 13 deforms under the action of a driving voltage to generate vibration, thereby better realizing tactile feedback.

[0094] Optionally, the piezoelectric layer 13 in this embodiment can support vibration at a vibration frequency of 500Hz to 1MHz, which can meet the needs of the control vibration element in the optional embodiment above to vibrate at a vibration frequency of greater than or equal to 500Hz to provide tactile feedback to the user.

[0095] Optionally, the fixing unit 20 can cooperate with the piezoelectric layer 13 of the vibration unit 10 to transmit the vibration of the piezoelectric layer 13 to the housing of the terminal device, thereby achieving vibration feedback. The fixing unit 20 can be made of any suitable material, such as metal or other materials. For example, optionally, the material of the fixing unit 20 has a Brinell hardness greater than or equal to 50. Such a material can better meet the structural strength requirements of the fixing unit 20.

[0096] Optionally, the fixing unit 20 is connected to the first electrode 11 and / or the second electrode 12 to secure the piezoelectric layer 13 to the fixing unit 20, preventing it from detaching during vibration. The fixing unit 20 can be connected to the first electrode 11 and / or the second electrode 12 in any way. For example, as shown in FIG6, the fixing unit 20 can be bonded to the first electrode 11 and / or the second electrode 12 via an adhesive layer 30. Bonding via the adhesive layer 30 improves the fixing effect. The adhesive layer 30 can have any structure. Optionally, it can be a film, glue, etc., and can be made of a material with a temperature resistance of 50°C or higher to ensure the temperature resistance of the vibrating element 100. It should be understood that the example in FIG6 is an example of the fixing unit 20 being bonded to the first sub-electrode plate 121 of the second electrode 12 via the adhesive layer 30.

[0097] Optionally, both the first electrode 11 and the second electrode 12 can be electrically connected to the driving power supply via wires, or they can be electrically connected to the driving power supply via other conductive methods.

[0098] The second electrode 12 in this embodiment can be a single, complete electrode plate, or it can include multiple electrically connected electrode plates in a split configuration. For example, in some optional embodiments, referring to FIG6, the second electrode 12 includes a first sub-electrode plate 121 and a second sub-electrode plate 122 electrically connected. The first sub-electrode plate 121 is connected to a second side of the piezoelectric layer 13 along the thickness direction, and the second sub-electrode plate 122 is connected to a first side of the piezoelectric layer 13 along the thickness direction, with a gap between the second sub-electrode plate 122 and the first electrode 11. The first electrode 11 and the second sub-electrode plate 122 are electrically connected to a driving power supply so that the first electrode 11 and the first sub-electrode plate 121 obtain a driving voltage from the driving power supply to power the piezoelectric layer 13.

[0099] Based on this, the optional second electrode 12 structure in this embodiment allows for several advantages. First, the first electrode 11 and the first sub-electrode plate 121 electrically connected to the second sub-electrode plate 122 can effectively obtain driving voltage from the driving power supply to power the piezoelectric layer 13. This facilitates effective control of the vibration of the piezoelectric layer 13 of the vibration unit 10 and enables the realization of different vibration states based on different vibration configuration information. This provides tactile feedback to the user, thereby improving the user experience of the fingerprint sensor on the terminal device (including but not limited to terminal devices without physical buttons). Second, since the second sub-electrode plate 122 and the first electrode 11 are located on the same side of the piezoelectric layer 13 along the thickness direction, it is easier to electrically connect the second sub-electrode plate 122 and the first electrode 11 to the driving power supply, reducing the difficulty of wiring. Furthermore, the spacing between the second sub-electrode plate 122 and the first electrode 11 prevents conduction between the first electrode 11 and the first sub-electrode plate 121, thus meeting the power supply requirements of the piezoelectric layer 13 and effectively realizing tactile feedback.

[0100] Optionally, as shown in FIG6, the first electrode 11 and the second sub-electrode plate 122 can both be electrically connected to the driving power supply through the wire 40. Since the first electrode 11 and the second sub-electrode plate 122 are both located on the same side of the piezoelectric layer 13 along the thickness direction, the wire 40 can be led from one side, which makes it easier to make electrical connections and reduces the difficulty of leading wires.

[0101] Optionally, referring to FIG6, the fixing unit 20 is connected to the first sub-electrode plate 121. In this example, the fixing unit 20 is bonded to the first sub-electrode plate 121 through the adhesive layer 30. With both the first electrode 11 and the second sub-electrode plate 122 located on the same side of the piezoelectric layer 13 along its thickness direction, and since the wire leads can all be led from the same side of the piezoelectric layer 13 along its thickness direction, it is also convenient to connect the fixing unit 20 to the terminal device when installing the vibration element 100. Furthermore, the wires 40 connected from the first electrode 11 and the second sub-electrode plate 122 are less susceptible to interference.

[0102] Optionally, referring to FIG6, the size of the first sub-electrode plate 121 is larger than that of the second sub-electrode plate 122, and the size of the first electrode 11 is larger than that of the second sub-electrode plate 122. The second sub-electrode plate 122 may occupy a smaller portion of the first side of the piezoelectric layer 13 along the thickness direction, thereby facilitating the first electrode 11 and the second sub-electrode plate 122 to better supply power to the piezoelectric layer 13 by the driving voltage. Of course, the dimensional examples shown in FIG6 are not intended to limit the embodiments of this application.

[0103] The embodiments of this application do not limit the manner in which the first sub-electrode plate 121 and the second sub-electrode plate 122 are electrically connected. In some optional embodiments, referring to FIG6, the first sub-electrode plate 121 is electrically connected to the second sub-electrode plate 122 through a conductor structure 123, wherein the conductor structure 123 passes through the piezoelectric layer 13.

[0104] Based on this, by using the conductor structure 123 that passes through the piezoelectric layer 13 to achieve the electrical connection between the first sub-electrode plate 121 and the second sub-electrode plate 122, the structure of the vibration element 100 can be made more compact, and the volume of the vibration element 100 can be reduced, thus reducing the space occupied when installed in the terminal device.

[0105] In this embodiment, the conductor structure 123 can be any conductor passing through the piezoelectric layer 13, such as, but not limited to, wires, conductive vias, etc. The conductor structure 123 can be made of various metallic materials, but is not limited thereto.

[0106] Optionally, the vibration element 100 and the fingerprint sensor (e.g., an ultrasonic fingerprint sensor) in this embodiment can be driven by the same power supply or by different power supplies.

[0107] The overall process of the tactile feedback scheme of the first aspect of this application embodiment will be illustrated below with reference to the flowchart shown in FIG7. This overall process can be understood by substituting it into the application scenarios of side fingerprint tactile feedback or rear fingerprint tactile feedback of a terminal device. The fingerprint sensor can be understood as an ultrasonic fingerprint sensor, and the vibration element can be understood as the optional structure of the vibration element 100 shown in FIG6.

[0108] Referring to Figure 7, in this overall process, a wake-up signal is first acquired, and the fingerprint sensor is woken up based on the wake-up signal to enter the working state that can collect fingerprint images.

[0109] Next, the fingerprint sensor captures the fingerprint image of the user pressing their finger to enter the fingerprint;

[0110] Next, based on the fingerprint image, the pressing area information of the fingerprint entered by the user through the fingerprint sensor is determined. The pressing area information can be the proportion of the pressing area of ​​the fingerprint entered by the user in the fingerprint sensor. The ratio between the fingerprint area in the fingerprint image and the total area of ​​the fingerprint image can be determined as the pressing area proportion.

[0111] Then, a judgment can be made based on the ratio of the pressing area. If the ratio of the pressing area is less than a preset threshold (i.e., the pressing area information meets the first preset condition), the first vibration configuration information for controlling the vibration element of the terminal device to enter the first vibration state is determined, and the vibration element is controlled to vibrate based on the first vibration configuration information to provide the first type of tactile feedback to the user, thereby achieving the tactile feedback effect for the user's accidental touch / misoperation when the fingerprint is entered by the fingerprint sensor.

[0112] If the proportion of the pressed area is greater than a preset threshold (i.e., the pressed area information meets the second preset condition but does not meet the first preset condition), then fingerprint recognition is performed based on the fingerprint image to obtain the fingerprint recognition result.

[0113] If the fingerprint recognition result indicates that the user who entered the fingerprint is legitimate, then the second vibration configuration information for controlling the vibration element to enter the second vibration state is determined, and the vibration element is controlled to vibrate based on the second vibration configuration information to provide the user with a second type of tactile feedback, thereby achieving the tactile feedback effect of the fingerprint sensor for legitimate users.

[0114] If the fingerprint recognition result indicates that the user's identity is invalid, the third vibration configuration information for controlling the vibration element to enter the third vibration state is determined, and the vibration element is controlled to vibrate based on the third vibration configuration information to provide the user with a third type of tactile feedback, thereby achieving the tactile feedback effect of using the fingerprint sensor for users with invalid identities.

[0115] It should be understood that the overall process illustrated in Figure 7 above is not intended to limit the embodiments of this application. It should also be understood that the relevant content in the above overall process can be understood in conjunction with the preceding embodiments.

[0116] It is understood that the foregoing description of the haptic feedback scheme is merely an exemplary description of the embodiments of this application and is not intended to limit the embodiments of this application in any way.

[0117] In summary, the tactile feedback scheme provided in this application embodiment, on the one hand, by setting a fingerprint sensor and a vibration element in the terminal device, can control the vibration of the vibration element to provide tactile feedback on the use of the fingerprint sensor, thereby providing users with a better tactile experience when using the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons), thus effectively improving the user experience; on the other hand, since this scheme can determine the pressing area information of the fingerprint recorded by the user through the fingerprint sensor based on the fingerprint image when the user registers the fingerprint, and determine the vibration configuration information of the vibration element based on the pressing area information, and control the vibration of the vibration element based on the vibration configuration information, the vibration of the vibration element can be reasonably controlled according to the user's pressing area information, thereby achieving more reasonable tactile feedback to the user, thus improving the user experience of using the fingerprint sensor.

[0118] Based on the same inventive concept as the tactile feedback method provided in the first aspect, and referring to FIG8, according to the second aspect of the embodiments of this application, a tactile feedback device 1000 is provided, comprising:

[0119] The first acquisition module 1002 is used to acquire the fingerprint image obtained when the user enters his fingerprint through the fingerprint sensor of the terminal device.

[0120] The first determining module 1004 is used to determine the pressing area information of the fingerprint recorded by the user through the fingerprint sensor based on the fingerprint image;

[0121] The second determining module 1006 is used to determine the vibration configuration information of the vibration element of the terminal device based on the pressing area information;

[0122] The first control module 1008 is used to control the vibration element to vibrate based on the vibration configuration information in order to provide tactile feedback to the user.

[0123] The tactile feedback scheme provided in this application embodiment, on the one hand, by setting a fingerprint sensor and a vibration element in the terminal device, can control the vibration of the vibration element to provide tactile feedback on the use of the fingerprint sensor, thereby giving the user a better tactile experience when using the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons), thus effectively improving the user experience; on the other hand, since the first determining module 1004 can determine the pressing area information of the fingerprint entered by the user through the fingerprint sensor based on the fingerprint image when the user enters the fingerprint, the second determining module 1006 can determine the vibration configuration information of the vibration element based on the pressing area information, and the first control module 1008 can control the vibration element to vibrate based on the vibration configuration information, the vibration element can be reasonably controlled to vibrate according to the user's pressing area information, so as to achieve more reasonable tactile feedback to the user, thereby improving the user's experience of using the fingerprint sensor.

[0124] In some optional embodiments, the pressing area information includes the proportion of the pressing area pressed by the user in the fingerprint enrollment area of ​​the fingerprint sensor; the first determining module 1004 is specifically used to: determine the fingerprint area in the fingerprint image; determine the ratio between the fingerprint area and the total area of ​​the fingerprint image, and determine the ratio as the pressing area proportion.

[0125] In some optional embodiments, the second determining module 1006 is specifically used to: determine first vibration configuration information for controlling the vibration element of the terminal device to enter a first vibration state in response to the pressing area information satisfying a first preset condition; the first control module 1008 is specifically used to: control the vibration element to enter the first vibration state to vibrate based on the first vibration configuration information, so as to provide tactile feedback to the user.

[0126] In some optional embodiments, the second determining module 1006 is further configured to: respond to the fact that the pressing area information satisfies a second preset condition but not a first preset condition, perform fingerprint recognition based on the fingerprint image to obtain a fingerprint recognition result, and determine target vibration configuration information for controlling the vibration element of the terminal device to enter a target vibration state based on the fingerprint recognition result, wherein the second preset condition is different from the first preset condition, and the target vibration state is different from the first vibration state, and the fingerprint recognition result is used to indicate the legality of the user's identity by registering a fingerprint through the fingerprint sensor; the first control module 1008 is specifically configured to: control the vibration element to enter the target vibration state to vibrate based on the target vibration configuration information, so as to provide tactile feedback to the user.

[0127] In some optional embodiments, the target vibration state includes a second vibration state and a third vibration state, and the second vibration state is different from the third vibration state; the second determining module 1006 is specifically used to: in response to the fingerprint recognition result indicating that the user's identity is legitimate, determine second vibration configuration information for controlling the vibration element of the terminal device to enter the second vibration state; or, in response to the fingerprint recognition result indicating that the user's identity is illegitimate, determine third vibration configuration information for controlling the vibration element of the terminal device to enter the third vibration state.

[0128] In some optional embodiments, the first control module 1008 is specifically used to: control the vibration element to vibrate at a vibration frequency greater than or equal to 500Hz based on the vibration configuration information, so as to provide tactile feedback to the user.

[0129] In some optional embodiments, the terminal device further includes a driving power supply, and the vibration element includes a vibration unit and a fixing unit; the vibration unit is electrically connected to the driving power supply and receives a driving voltage from the driving power supply to vibrate under the action of the driving voltage; the vibration unit is connected to the terminal device through the fixing unit and transmits the vibration to the terminal device through the fixing unit to provide tactile feedback to the user; the first control module 1008 is specifically used to: adjust the driving voltage output by the driving power supply to control the vibration unit of the vibration element to vibrate.

[0130] In some optional embodiments, the first control module 1008 is specifically used to: adjust the drive voltage output by the drive power supply by changing the switching frequency of the drive power supply and / or by changing the magnitude of the drive voltage output by the drive power supply.

[0131] In some optional embodiments, the vibration unit includes: a first electrode, a piezoelectric layer, and a second electrode; the first electrode is connected to a first side of the piezoelectric layer along its thickness direction, at least a portion of the second electrode is connected to a second side of the piezoelectric layer along its thickness direction, and the first electrode and the second electrode are not in contact; the fixing unit is connected to the first electrode and / or the second electrode; both the first electrode and the second electrode are electrically connected to the driving power supply and are used to obtain a driving voltage from the driving power supply to supply power to the piezoelectric layer; the piezoelectric layer deforms under the action of the driving voltage to vibrate, and the vibration is transmitted to the terminal device through the fixing unit to provide tactile feedback to the user.

[0132] In some optional embodiments, the second electrode includes an electrically connected first sub-electrode plate and a second sub-electrode plate, the first sub-electrode plate being connected to a second side of the piezoelectric layer along the thickness direction, the second sub-electrode plate being connected to a first side of the piezoelectric layer along the thickness direction, and a gap existing between the second sub-electrode plate and the first electrode; the first electrode and the second sub-electrode plate are electrically connected to the driving power supply so that the first electrode and the first sub-electrode plate obtain a driving voltage from the driving power supply to supply power to the piezoelectric layer.

[0133] In some alternative embodiments, the first sub-electrode plate is electrically connected to the second sub-electrode plate via a conductor structure, wherein the conductor structure passes through the piezoelectric layer.

[0134] In some optional embodiments, the vibrating element satisfies at least one of the following conditions: the material of the piezoelectric layer includes at least one of lead zirconate titanate, lithium niobate, and PVDF; the fixing unit is bonded to the first electrode and / or the second electrode via an adhesive layer; and the material of the fixing unit has a Brinell hardness greater than or equal to 50.

[0135] In some optional embodiments, both the vibration element and the fingerprint sensor are disposed within the housing of the terminal device, the vibration element is located below or around the edge of the fingerprint sensor, and the fingerprint sensor is a side fingerprint sensor or a rear fingerprint sensor of the terminal device.

[0136] In some optional embodiments, a plurality of vibration elements are arranged around the periphery of the fingerprint sensor, and / or a plurality of vibration elements are arranged below the fingerprint sensor; the first control module 1008 is specifically used to: control at least one of the plurality of vibration elements to vibrate based on the vibration configuration information to provide tactile feedback to the user.

[0137] The tactile feedback device 1000 and its optional embodiments in this application have been described in detail in the foregoing tactile feedback method embodiments. Therefore, their related content and beneficial effects can be understood by referring to the content of the optional embodiments of the above method, and will not be repeated here.

[0138] Figure 9 is a flowchart of a tactile feedback method according to a third aspect of an embodiment of this application. According to a third aspect of an embodiment of this application, a tactile feedback method is provided. Referring to Figure 9, the method includes steps T102, T104, T106, and T108, specifically:

[0139] T102: Acquires a wake-up signal and controls the fingerprint sensor of the terminal device to enter the working state according to the wake-up signal.

[0140] In this embodiment, the terminal device can be any type of electronic device that requires a fingerprint sensor for fingerprint detection. For example, it can be a mobile phone, tablet computer, computer, server, etc.

[0141] Optionally, the fingerprint sensor can be an ultrasonic fingerprint sensor or a capacitive fingerprint sensor. It should be understood that the specific structure of the ultrasonic fingerprint sensor and the capacitive fingerprint sensor is not limited in this embodiment. Alternatively, the fingerprint sensor can also be other types of fingerprint sensors, such as optical fingerprint sensors, as long as the requirements are met.

[0142] Optionally, the fingerprint sensor in this embodiment can be disposed within the housing of the terminal device, and the housing can protect the fingerprint sensor. Optionally, the fingerprint sensor can be a rear fingerprint sensor or a side fingerprint sensor. The rear fingerprint sensor can be a fingerprint sensor whose fingerprint recognition area is located on the back of the terminal device (for example, taking a mobile terminal such as a mobile phone as an example, the back of the terminal device can be the side facing away from the screen). The side fingerprint sensor can be a fingerprint sensor whose fingerprint recognition area is located on the side frame of the terminal device. With the above types of fingerprint sensors, rear fingerprint recognition or side fingerprint recognition can be realized, and the need for vibration and tactile feedback for rear or side fingerprints on the terminal device can be well met.

[0143] In this embodiment, a fingerprint sensor and a vibration element are simultaneously installed in the terminal device, and tactile feedback is provided to the user by controlling the vibration of the vibration element. The vibration element can be a low-frequency vibration source and can adopt any structure. Optionally, the low-frequency vibration source can be configured to generate low-frequency vibrations greater than 500Hz. In some optional examples, the low-frequency vibration source can be or may include a piezoelectric actuator, an eccentric rotating block, and / or a linear resonant actuator. It should be noted that, as part of the inventive point of the tactile feedback scheme of this embodiment, this embodiment provides a novel structure of vibration element to facilitate the implementation of the tactile feedback scheme. This structure will be described in detail in conjunction with the following steps and will not be repeated here.

[0144] In this embodiment, the vibration element can be disposed at any suitable location on the terminal device. Optionally, both the vibration element and the fingerprint sensor are disposed within the housing of the terminal device, and the vibration element can be disposed around the edge of the fingerprint sensor, or it can be disposed below the fingerprint sensor. By disposing the vibration element in these optional locations, it is beneficial to better provide tactile feedback through vibration when the user uses the fingerprint sensor, thereby improving the tactile feedback effect and the user experience of the fingerprint sensor. Optionally, the vibration element can also be directly mounted on the fingerprint sensor and used as a whole. For example, both the vibration element and the fingerprint sensor can be mounted in the middle frame within the housing of the terminal device. Optionally, multiple vibration elements can also be used in this embodiment, and these multiple vibration elements can be disposed below and / or around the edge of the fingerprint sensor.

[0145] For example, Figure 2 shows an optional schematic diagram of the fingerprint sensor and vibration element installed on a terminal device according to an embodiment of this application. An optional installation method can be understood with reference to Figure 2. Figure 2 can be considered as a top-down structural schematic diagram of the terminal device. The fingerprint sensor 200 shown in Figure 2 can be an ultrasonic fingerprint sensor, and is a side-mounted fingerprint sensor. In Figure 2, the terminal device 300 includes a housing 301, a mid-frame 302, and a screen 303. The housing 301 includes a side frame 304, and the mid-frame 302 is disposed within the housing 301. The fingerprint sensor 200 and vibration element 100 can be installed in the mid-frame 302 inside the housing 301. Optionally, the fingerprint sensor 200 and vibration element 100 can be fixed between the mid-frame 302 and the side frame 304 inside the housing 301 by injecting adhesive, thereby achieving the installation of the fingerprint sensor 200 and vibration element 100 on the terminal device 300. Referring to Figure 2A, users can also place their fingers on the side frame 304 of the terminal device 300 along direction F to register their fingerprints through the fingerprint enrollment area of ​​the fingerprint sensor 200, thus achieving fingerprint recognition. Figure 3 is a side view of the fingerprint sensor 200 and the vibration element 100 along direction F. Furthermore, referring to Figures 2 and 3, multiple vibration elements 100 (i.e., vibration element 100A, vibration element 100B, and vibration element 100C) can be arranged around the perimeter of the fingerprint sensor 200. Optionally, the thickness of the side frame 304 of the terminal device 300 can be 0.5 mm or less, and the side frame 304 can be made of metal, but is not limited to this.

[0146] In another optional installation method, the mid-frame and side bezel of the terminal device can be designed as a single unit, with the side bezel being part of the mid-frame (it should be understood that the side bezel is also part of the terminal device's housing). Blind holes can be made on the inner side of the side bezel, and at least part of the fingerprint sensor (side fingerprint sensor) and vibration element can be placed within these blind holes. The fingerprint sensor and vibration element can be fixed in the blind holes by injecting adhesive, thus achieving the installation of the fingerprint sensor and vibration element on the terminal device. Optionally, the side bezel of the single-unit mid-frame can be designed with a hybrid layering of 0.5mm or less metal material and 1mm or less plastic material. Since the fingerprint sensor's signal acquisition and the vibration element's vibration penetration capabilities are limited, by creating blind holes on the inner side of the side frame and placing at least part of the fingerprint sensor and vibration element within these blind holes, the thickness of the cover plate that needs to be penetrated can be reduced without affecting structural reliability. This reduces the difficulty of transmitting tactile feedback from the vibration element to the user, thereby improving the tactile feedback effect. Furthermore, when the fingerprint sensor is an ultrasonic fingerprint sensor, it can also reduce the difficulty of ultrasonic signal transmission and prevent situations where ultrasonic signals cannot penetrate the housing. In addition, it can make more rational use of the space inside the terminal device's housing, adapting to the requirements of thinner and lighter terminal devices. This can improve the performance of the side fingerprint sensor and vibration element, enhancing the user's experience of using the fingerprint sensor and the tactile feedback experience.

[0147] Optionally, multiple vibration elements may be provided in the embodiments of this application. For example, in some embodiments, multiple vibration elements may be arranged around the periphery of the fingerprint sensor, and / or, multiple vibration elements may be arranged below the fingerprint sensor. By controlling at least one of the multiple vibration elements to vibrate, a variety of vibration effects can be provided, achieving diverse and rich tactile feedback effects and improving the user experience. In addition, other functions can also be achieved through multiple vibration elements, such as detecting finger slippage and pressure value detection, etc.

[0148] Optionally, in this embodiment of the application, when a user has a need for fingerprint recognition via a fingerprint sensor, the fingerprint sensor can be woken up before the fingerprint sensor on the terminal device is used to enroll the fingerprint, so that the fingerprint sensor can enter a working state capable of collecting fingerprints.

[0149] In this embodiment, a wake-up signal can be acquired, and the fingerprint sensor can be controlled to enter a working state based on the wake-up signal. The wake-up signal can be acquired in any suitable manner. For example, in some optional embodiments, "acquiring a wake-up signal" in step T102 includes: generating a wake-up signal in response to detecting a user's finger through the fingerprint sensor, and / or detecting a user's finger through a detection unit disposed on the terminal device outside the fingerprint sensor, and / or receiving a predetermined wake-up operation from the user through the terminal device.

[0150] It should be understood that the present application embodiment uses at least one of the above-mentioned optional methods to effectively generate a wake-up signal, which can effectively adapt to the fingerprint sensor wake-up requirements of different terminal devices, and can more flexibly adopt wake-up measures to wake up the fingerprint sensor, thus effectively improving the user experience of using the fingerprint sensor and terminal device.

[0151] Optionally, the fingerprint sensor used in this embodiment can be a fingerprint sensor with real-time finger detection function. For example, the fingerprint sensor can be a capacitive fingerprint sensor or an ultrasonic fingerprint sensor. Optionally, the fingerprint sensor can be in a low-power operating state or other non-fingerprint-collecting operating state, and can simultaneously be in a real-time finger detection working mode. If the user's finger touches the position on the terminal device corresponding to the fingerprint enrollment area of ​​the fingerprint sensor, the detected signal (e.g., capacitive signal or ultrasonic signal) will change. For example, the signal will exceed a certain threshold. At this time, it can be determined that the fingerprint sensor has detected the user's finger, and a wake-up signal can be generated in response to the detection result, so as to wake up the fingerprint sensor from the low-power operating state to the working state that can collect fingerprints based on the wake-up signal.

[0152] Optionally, the detection unit used in this application embodiment may include any sensor or combination of sensors, and is not specifically limited in this application embodiment. Optionally, the detection unit in this application embodiment may be disposed within the housing of the terminal device to meet the usage requirements of terminal devices without physical buttons. Optionally, the detection unit may be disposed within the housing of the terminal device and mounted on the mid-frame. Optionally, the detection unit may be disposed around the edge of the fingerprint sensor, or it may be disposed in other locations. It should be understood that when setting the detection unit, the setting of the vibration element needs to be considered, which can be set as needed in actual use.

[0153] For example, in some optional embodiments, the above-mentioned "detecting the user's finger by a detection unit disposed outside the fingerprint sensor of the terminal device" includes: detecting at least one of the capacitance signal change, ultrasonic signal change, and voltage signal change caused by the finger by a detection unit disposed outside the fingerprint sensor of the terminal device, so as to detect the user's finger.

[0154] It should be understood that when a user uses a fingerprint sensor, placing their finger on the detection area of ​​the detection unit will cause a change in at least one of the corresponding capacitance signal, ultrasonic signal, or voltage signal, allowing the detection unit to detect the finger. The detection unit described above detects the user's finger by detecting at least one of the changes in capacitance, ultrasonic signal, or voltage signal caused by the finger. This generates a reliable and effective wake-up signal, effectively adapting to the fingerprint sensor wake-up requirements of different terminal devices. It allows for more flexible wake-up measures, thus effectively improving the user experience when using the fingerprint sensor and the terminal device.

[0155] Optionally, corresponding to the detection unit detecting the user's finger by detecting changes in capacitance signal, the detection unit may include a ring-shaped capacitive sensor. Optionally, the ring-shaped capacitive sensor may be disposed within the housing of the terminal device and mounted on the mid-frame, positioned around the periphery of the fingerprint sensor. With this arrangement, the ring-shaped capacitive sensor acts as a "ring" surrounding the fingerprint sensor. For example, referring to FIG10A, an optional structure of the ring-shaped capacitive sensor 401 and an optional schematic diagram of its placement position relative to the fingerprint sensor 200 are shown. Referring to sub-figure a in FIG10A, the ring-shaped capacitive sensor 401 may be an integral ring-shaped capacitive sensor, which may be integrally fitted around the periphery of the fingerprint sensor 200. Referring to sub-figure b in Figure 10A, the ring-shaped capacitive sensor 401 can be a split ring-shaped capacitive sensor, which may include multiple capacitive sensors (such as two in this sub-figure b). Multiple capacitive sensors (such as 401a and 401b in this sub-figure b) are combined to form a ring-shaped capacitive sensor, which are respectively set at different positions around the edge of the fingerprint sensor 200 (such as capacitive sensors 401a and 401b in this sub-figure b can be symmetrically set).

[0156] Optionally, corresponding to the detection unit detecting the user's finger by detecting changes in ultrasonic signals, the detection unit may include an ultrasonic sensor. Optionally, the ultrasonic sensor may be disposed within the housing of the terminal device and mounted on the mid-frame, and disposed around the periphery of the fingerprint sensor. The placement of the ultrasonic sensor can be similar to that of the ring capacitive sensor in Figure 10A, but the structure may be different; therefore, it can also be understood in conjunction with Figure 10A, and will not be shown separately here. It should be noted that since the ultrasonic sensor can penetrate a metal layer of a certain thickness when emitting and receiving ultrasonic signals, the use of an ultrasonic sensor to detect the user's finger in the detection unit can also meet the requirement of a hole-free terminal device with a metal housing.

[0157] Optionally, corresponding to the detection unit detecting a user's finger by detecting changes in the voltage signal, the detection unit may include detection electrodes. Optionally, the detection electrodes may include electrodes made of any metal material, or electrodes made of other conductive materials. The detection electrodes may be disposed within the housing of the terminal device and mounted on the mid-frame, and disposed around the periphery of the fingerprint sensor. For example, referring to FIG10B, some optional schematic diagrams of the placement positions of multiple detection electrodes 402 and the fingerprint sensor 200 are shown, indicating that the multiple detection electrodes 402 are respectively disposed at different positions in the periphery edge region of the fingerprint sensor 200. To facilitate the detection electrodes in detecting fingers, openings may be made in the housing (e.g., metal housing) of the terminal device in areas corresponding to the detection electrodes to expose the detection electrodes to the outside of the housing. For example, in the terminal device with an integrated design of the mid-frame and side frame as described above, the side frame is part of both the housing and the mid-frame, and the detection electrodes may be disposed inside the mid-frame by making openings in the side frame to place the detection electrodes inside the mid-frame and expose them to the outside of the housing. For example, in a terminal device with a non-unibody design for the mid-frame and side bezels, the detection electrodes can be disposed on the surface of the mid-frame. This can be achieved by creating openings in the side bezels to expose the detection electrodes on the mid-frame surface to the outside of the housing. It should be understood that such examples of placement are not intended to limit the embodiments of this application.

[0158] It should be understood that one or more of the above-mentioned ring capacitive sensors, ultrasonic sensors, and detection electrodes can be selected as needed, as long as they meet the usage requirements of the terminal device. The above detection unit can effectively generate a wake-up signal when the fingerprint sensor is in a turned-off or low-power operating state, thereby waking the fingerprint sensor to a working state capable of collecting fingerprints.

[0159] Optionally, in this embodiment of the application, a wake-up signal may also be generated in response to receiving a predetermined wake-up operation from the user via the terminal device. The predetermined wake-up operation may include, but is not limited to, a click operation by the user via the touchscreen of the terminal device, a voice operation by the user, a gesture operation by the user, etc. For example, if the fingerprint sensor is in a turned-off / low-power operating state, the user's wake-up operation can be received via the terminal device to generate a wake-up signal based on the wake-up operation, and based on the wake-up signal, the fingerprint sensor can be woken up from the turned-off / low-power operating state to a working state capable of collecting fingerprints.

[0160] It should be understood that the above-mentioned methods of detecting the user's finger through a fingerprint sensor, detecting the user's finger through a detection unit, and receiving the user's predetermined wake-up operation through a terminal device to generate a wake-up signal can be any one or more, as long as they meet the usage needs of the terminal device.

[0161] It should be understood that in this embodiment of the application, the fingerprint sensor is woken up to enter the working state that can collect fingerprints only when fingerprint recognition and tactile feedback are required, which helps to reduce the power consumption of the fingerprint sensor and the terminal device.

[0162] T104: Receives the fingerprint image entered by the user through the fingerprint sensor and determines whether the fingerprint image is a valid fingerprint image.

[0163] It should be understood that when a user registers a fingerprint image using a fingerprint sensor, they can place their finger on the terminal device at the location corresponding to the fingerprint registration area of ​​the fingerprint sensor (for example, if it is a side-mounted fingerprint sensor, this location can be on the side edge of the terminal device; if it is a rear-mounted fingerprint sensor, this location can be on the back of the terminal device). For terminal devices without physical buttons, to facilitate indicating the location of the fingerprint registration area, optionally, an indicator mark can be added to the casing of the mobile device to help users know the approximate location of the fingerprint registration area, facilitating fingerprint registration and recognition. For example, the indicator mark can be a printed logo (which can be at least one or more of any pattern, text, etc.), or it can be a sticker or other structure that can indicate the location.

[0164] After obtaining a fingerprint image, it can be determined whether the fingerprint image is a valid fingerprint image. In the embodiments of this application, a valid fingerprint image can be a fingerprint image that can be normally recognized. Whether a fingerprint image can be normally recognized, that is, whether the fingerprint image is a valid fingerprint image, can be determined through several methods.

[0165] For example, in some optional embodiments, referring to the flowchart shown in FIG11, the "determining whether the fingerprint image is a valid fingerprint image" in step T104 above includes the following steps T1041 to T1043, specifically:

[0166] T1041: Determine the fingerprint area in the fingerprint image.

[0167] In this embodiment, the fingerprint area can be the area of ​​a valid fingerprint in a fingerprint image. For example, in some embodiments, the fingerprint area can be determined by determining the number of pixels of the fingerprint in the fingerprint image. Alternatively, in other embodiments, the fingerprint area can be determined by first fitting contour lines to the pixels of the fingerprint in the fingerprint image to obtain the contour of the fingerprint in the fingerprint image, and then determining the fingerprint area based on the number of pixels within the contour.

[0168] T1042: Determine the area ratio between the fingerprint area and the total area of ​​the fingerprint image.

[0169] Optionally, the total area of ​​the fingerprint image can be determined based on the total number of pixels in the fingerprint image. Optionally, since the size of the fingerprint image acquired by the fingerprint sensor can be set to a fixed size, the total area of ​​the acquired fingerprint image can also be a fixed area. Therefore, the total area can be pre-stored and retrieved directly when needed.

[0170] Then, the ratio between the fingerprint area and the total area of ​​the fingerprint image can be calculated, which gives the area ratio between the two.

[0171] T1043: Determine whether a fingerprint image is a valid fingerprint image based on the area ratio.

[0172] If the area ratio is too small, it means that there is less fingerprint data in the fingerprint image, which may prevent normal fingerprint recognition. Therefore, the area ratio can be used to determine whether a fingerprint image is a valid fingerprint image.

[0173] Based on this, through the optional implementation of the above sub-steps T1041 to T1043, it is possible to effectively determine whether the fingerprint is a valid fingerprint image, so as to facilitate subsequent fingerprint recognition and vibration tactile feedback based on the valid fingerprint image, thereby improving the user experience.

[0174] This application does not limit the specific implementation of step T1043. In some optional embodiments, step T1063 includes: in response to the area ratio being greater than or equal to a preset threshold, the fingerprint image is determined to be a valid fingerprint image; otherwise, the fingerprint image is determined not to be a valid fingerprint image.

[0175] It should be understood that by comparing the area ratio with a preset threshold, it is possible to effectively determine whether a fingerprint image is valid, so as to facilitate subsequent fingerprint recognition and vibration haptic feedback based on valid fingerprint images, thereby improving the user experience.

[0176] It should be understood that one reason for a fingerprint image to appear too small is an invalid user input, such as accidental touches or misoperations. When a user accidentally touches or misoperates during fingerprint input, the area pressed by the finger within the fingerprint input area may be too small, resulting in an incomplete fingerprint image captured by the fingerprint sensor, thus leading to a smaller area. If a fingerprint image entered under such circumstances is used for fingerprint recognition, it may fail to be recognized correctly.

[0177] For example, referring to FIG5A, the user's fingerprint enrollment operation is shown in a valid enrollment state (for ease of understanding, the fingerprint edge on the finger in FIG5A is schematically shown with dashed lines, but this is not intended to limit the embodiments of this application). As can be seen from FIG5A, the user's finger presses a normal area in the fingerprint enrollment area, and the enrolled fingerprint image is relatively complete. Therefore, the calculated area ratio is also large, thus meeting the requirements for normal recognition. As another example, referring to FIG5B, the user's fingerprint enrollment operation is shown in a invalid enrollment state (for ease of understanding, the fingerprint edge on the finger in FIG5B is schematically shown with dashed lines, but this is not intended to limit the embodiments of this application). As can be seen from FIG5B, the user's finger does not press well in the fingerprint enrollment area, resulting in a smaller pressing area and an incomplete fingerprint image. Therefore, the calculated area ratio is also small, which may lead to a situation where the fingerprint image cannot be recognized normally.

[0178] Therefore, through the above implementation methods in this application embodiment, it is possible to effectively determine whether a fingerprint image is a valid fingerprint image, so as to facilitate subsequent data processing.

[0179] T106: In response to determining that the fingerprint image is a valid fingerprint image, perform fingerprint recognition based on the fingerprint image to obtain the fingerprint recognition result.

[0180] It should be understood that in the embodiments of this application, fingerprint recognition is performed only after the fingerprint image is determined to be a valid fingerprint image, which can reduce the possibility that fingerprint recognition using a fingerprint sensor may fail to produce a result.

[0181] In this application, fingerprint recognition can be implemented using any fingerprint recognition algorithm, and no specific limitations are imposed here.

[0182] In this application, the fingerprint recognition result can indicate the legitimacy of the user's identity by registering a fingerprint through a fingerprint sensor. It should be understood that the fingerprint sensor can pre-register some users' fingerprints before use. Specifically, if it is determined during fingerprint recognition based on a fingerprint image that the fingerprint registered by the user belongs to a user who has already registered, the fingerprint recognition result indicates that the user's identity is legitimate; conversely, if it is determined during fingerprint recognition based on a fingerprint image that the fingerprint registered by the user does not belong to a user who has already registered, the fingerprint recognition result indicates that the user's identity is illegitimate.

[0183] T108: Based on the fingerprint recognition result, the vibration element of the terminal device is controlled to vibrate to provide tactile feedback to the user.

[0184] After obtaining the fingerprint recognition result, the vibration element can be controlled to vibrate in a reasonable manner to provide the user with appropriate tactile feedback, effectively remind the user, and thus improve the user experience of using the fingerprint sensor.

[0185] Based on this, the optional implementation of sub-steps T102 to T108 in this application provides the following advantages: First, by setting a fingerprint sensor and a vibration element in the terminal device, the vibration element can be controlled to vibrate to provide tactile feedback for the use of the fingerprint sensor, thereby providing users with a better tactile experience when using the fingerprint sensor on the terminal device (including but not limited to terminal devices without physical buttons), effectively improving the user experience. Second, in this embodiment, the fingerprint sensor is only woken up to enter the working state when fingerprint recognition and tactile feedback are required, which helps to reduce the power consumption of the fingerprint sensor and the terminal device. Third, since this solution performs fingerprint recognition only after receiving the fingerprint image entered by the user through the fingerprint sensor and confirming that the fingerprint image is valid, the possibility of fingerprint recognition failing to produce a result is reduced. Fourth, after obtaining the fingerprint recognition result, the vibration element can be reasonably controlled to vibrate according to the fingerprint recognition result to provide reasonable tactile feedback to the user, effectively reminding the user and improving the user experience of using the fingerprint sensor. Therefore, it can be seen that the technical solution in this application embodiment, through the entire process of first waking up the fingerprint, then determining the valid fingerprint image, then fingerprint recognition, and then providing vibration and tactile feedback, can effectively improve the user experience of using the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons).

[0186] In some optional embodiments, step T108 includes: in response to the fingerprint recognition result indicating that the user's identity is legitimate, controlling the vibration element of the terminal device to enter a first vibration state to vibrate, so as to provide tactile feedback to the user; in response to the fingerprint recognition result indicating that the user's identity is illegitimate, controlling the vibration element of the terminal device to enter a second vibration state different from the first vibration state to vibrate, so as to provide tactile feedback to the user.

[0187] It should be understood that in this embodiment, the vibration element is controlled to enter different vibration states to achieve different vibrations based on whether the user identity indicated by the fingerprint recognition result is legitimate. This provides tactile feedback to distinguish between legitimate and illegitimate user identities, effectively differentiating and reminding users accordingly, thereby improving the user experience of using the fingerprint sensor on the terminal device.

[0188] Optionally, the tactile feedback method in this application may further include: in response to determining that the fingerprint image is not a valid fingerprint image, controlling the vibration element of the terminal device to enter a third vibration state different from both the first and second vibration states to provide tactile feedback to the user. This effectively distinguishes and reminds the user, further improving the user experience.

[0189] In some alternative embodiments, when controlling the vibration of the vibrating element, the vibrating element can be controlled to vibrate at a vibration frequency of 500 Hz or higher to provide tactile feedback to the user.

[0190] Based on this, in this embodiment of the application, the vibration element is controlled to vibrate at a vibration frequency of 500Hz or higher, so as to ensure that the user can clearly perceive the tactile feedback effect brought about by the vibration of the vibration element, thereby ensuring the user's tactile feedback experience and thus ensuring the user's experience of using the fingerprint sensor of the terminal device.

[0191] Optionally, the vibration element in this embodiment vibrates at a frequency greater than or equal to 500Hz under various vibration states (such as the first vibration state, the second vibration state, etc.). However, different vibration frequencies can be used to achieve different vibration states, thereby producing different tactile feedback effects. Optionally, the vibration effect can also be changed by adjusting the vibration duration, vibration amplitude, etc. Additionally, the upper limit of the vibration frequency of the vibration element can be 1MHz.

[0192] For example, as an easy-to-understand illustration, in the first vibration state, the vibrating element can vibrate at a vibration frequency greater than 500 Hz (e.g., for 3 seconds); in the second vibration state, the vibrating element can vibrate intermittently at a vibration frequency greater than 500 Hz (e.g., intermittent vibration lasting 1 or 2 seconds). Of course, this example is merely a simple illustration and is not intended to limit the embodiments of this application in any way; in practice, it can be configured as needed.

[0193] In some optional embodiments, the terminal device in this application embodiment further includes a driving power supply for outputting a driving voltage. The driving voltage can be used to drive the vibration of the vibration element. Optionally, the driving power supply can be an AC driving power supply or a switching power supply. Optionally, the driving power supply can be disposed within the housing of the terminal device. The structure of the driving power supply is not limited here. Optionally, the driving power supply may include a driving chip and a power supply, wherein the driving chip obtains the power supply voltage from the power supply and outputs the required driving voltage based on the power supply voltage. The vibration unit 10 mentioned below can be electrically connected to the driving chip of the driving power supply. Optionally, the driving voltage can be in the range of 5V to 100V, but is not limited thereto.

[0194] The structure of a novel vibration element provided in this application embodiment will be described below. Figure 6 shows a schematic diagram of an optional vibration element according to an embodiment of this application. As shown in Figure 6, the optional vibration element 100 includes a vibration unit 10 and a fixing unit 20; the vibration unit 10 is electrically connected to a driving power supply and obtains a driving voltage from the driving power supply to vibrate under the action of the driving voltage; the vibration unit 10 is connected to a terminal device through the fixing unit 20, and the vibration is transmitted to the terminal device through the fixing unit 20 to provide tactile feedback to the user. For such an optional vibration element 100, when controlling the vibration element 100 to vibrate, the vibration unit 10 of the vibration element 100 can be controlled to vibrate by adjusting the driving voltage output by the driving power supply.

[0195] Based on this, the structure of the vibration element 100 in this embodiment of the application can effectively control the vibration of its vibration unit 10 and effectively realize different vibration states, so as to provide tactile feedback to the user and improve the user experience of the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons).

[0196] Optionally, the fixing unit 20 is connected to the housing of the terminal device. The vibration unit 10 can transmit vibration to the housing of the terminal device through the fixing unit 20 to provide tactile feedback to the user. The connection between the fixing unit 20 and the terminal device can be achieved through any structure, including but not limited to bonding, welding, screwing, etc. For example, optionally, the fixing unit 20 can be fixedly connected to the housing of the terminal device by applying a potted adhesive, so that the vibration unit 10 can transmit vibration to the housing of the terminal device through the fixing unit 20 to provide tactile feedback to the user.

[0197] Optionally, the vibration unit 10 of the vibration element 100 can be electrically connected to the drive power supply via a wire, or it can be electrically connected to the drive power supply via other electrical connection methods.

[0198] In some optional embodiments, when adjusting the drive voltage output by the drive power supply, the drive voltage output by the drive power supply can be adjusted by changing the switching frequency of the drive power supply and / or by changing the magnitude of the drive voltage output by the drive power supply.

[0199] Based on this, the embodiments of this application can effectively adjust the driving voltage output by the driving power supply in order to control the vibration of the vibration element 100 and realize different vibration states, so as to provide tactile feedback to the user and improve the user experience of the fingerprint sensor of the terminal device (including but not limited to the terminal device without physical buttons).

[0200] The specific structure of the vibration unit 10 is not limited in the embodiments of this application. In some optional embodiments, referring to FIG6, the vibration unit 10 includes: a first electrode 11, a piezoelectric layer 13, and a second electrode 12; the first electrode 11 is connected to a first side of the piezoelectric layer 13 along the thickness direction, and at least a portion of the second electrode 12 is connected to a second side of the piezoelectric layer 13 along the thickness direction, and the first electrode 11 and the second electrode 12 are not in contact; the fixing unit 20 is connected to the first electrode 11 and / or the second electrode 12; both the first electrode 11 and the second electrode 12 are electrically connected to the driving power supply and are used to obtain a driving voltage from the driving power supply to supply power to the piezoelectric layer 13. The piezoelectric layer 13 deforms under the action of the driving voltage to vibrate, and the vibration is transmitted to the terminal device through the fixing unit 20 to provide tactile feedback to the user.

[0201] Based on this, the structure of the vibration element 100 in this embodiment can effectively control the vibration of the piezoelectric layer 13 of its vibration unit 10 and effectively realize different vibration states, so as to provide tactile feedback to the user and improve the user experience of the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons).

[0202] Optionally, both the first electrode 11 and the second electrode 12 may be made of a conductive material, which can be selected as needed. For example, the first electrode 11 and the second electrode 12 may include various metallic materials, but are not limited thereto. The metallic material may be one or a combination of copper, silver, etc. Optionally, both the first electrode 11 and the second electrode 12 may be plate-shaped, for example, they may be made into a metal plate structure.

[0203] Optionally, the piezoelectric layer 13 in this embodiment is made of a piezoelectric material, which can be selected as needed. When the first electrode 11 and the second electrode 12 are energized, deformation in the vertical direction can be achieved, and the material can return to its original shape after the power is turned off. By continuously switching the power on and off, vibration in the vertical direction can be generated. Therefore, by changing the switching frequency of the driving power supply and / or by changing the magnitude of the driving voltage output by the driving power supply, the vibration state of the piezoelectric layer 13 can be adjusted.

[0204] Optionally, the material of the piezoelectric layer 13 may include at least one of lead zirconate titanate, lithium niobate, and PVDF (polyvinylidene difluoride). Such materials can better accommodate the requirement that the piezoelectric layer 13 deforms under the action of a driving voltage to generate vibration, thereby better realizing tactile feedback.

[0205] Optionally, the piezoelectric layer 13 in this embodiment can support vibration at a vibration frequency of 500Hz to 1MHz, which can meet the needs of the control vibration element in the optional embodiment above to vibrate at a vibration frequency of greater than or equal to 500Hz to provide tactile feedback to the user.

[0206] Optionally, the fixing unit 20 can cooperate with the piezoelectric layer 13 of the vibration unit 10 to transmit the vibration of the piezoelectric layer 13 to the housing of the terminal device, thereby achieving vibration feedback. The fixing unit 20 can be made of any suitable material, such as metal or other materials. For example, optionally, the material of the fixing unit 20 has a Brinell hardness greater than or equal to 50. Such a material can better meet the structural strength requirements of the fixing unit 20.

[0207] Optionally, the fixing unit 20 is connected to the first electrode 11 and / or the second electrode 12 to secure the piezoelectric layer 13 to the fixing unit 20, preventing it from detaching during vibration. The fixing unit 20 can be connected to the first electrode 11 and / or the second electrode 12 in any way. For example, as shown in FIG6, the fixing unit 20 can be bonded to the first electrode 11 and / or the second electrode 12 via an adhesive layer 30. Bonding via the adhesive layer 30 improves the fixing effect. The adhesive layer 30 can have any structure. Optionally, it can be a film, glue, etc., and can be made of a material with a temperature resistance of 50°C or higher to ensure the temperature resistance of the vibrating element 100. It should be understood that the example in FIG6 is an example of the fixing unit 20 being bonded to the first sub-electrode plate 121 of the second electrode 12 via the adhesive layer 30.

[0208] Optionally, both the first electrode 11 and the second electrode 12 can be electrically connected to the driving power supply via wires, or they can be electrically connected to the driving power supply via other conductive methods.

[0209] The second electrode 12 in this embodiment can be a single, complete electrode plate, or it can include multiple electrically connected electrode plates in a split configuration. For example, in some optional embodiments, referring to FIG6, the second electrode 12 includes a first sub-electrode plate 121 and a second sub-electrode plate 122 electrically connected. The first sub-electrode plate 121 is connected to a second side of the piezoelectric layer 13 along the thickness direction, and the second sub-electrode plate 122 is connected to a first side of the piezoelectric layer 13 along the thickness direction, with a gap between the second sub-electrode plate 122 and the first electrode 11. The first electrode 11 and the second sub-electrode plate 122 are electrically connected to a driving power supply so that the first electrode 11 and the first sub-electrode plate 121 obtain a driving voltage from the driving power supply to power the piezoelectric layer 13.

[0210] Based on this, the optional second electrode 12 structure in this embodiment allows for several advantages. First, the first electrode 11 and the first sub-electrode plate 121 electrically connected to the second sub-electrode plate 122 can effectively obtain driving voltage from the driving power supply to power the piezoelectric layer 13. This enables effective control of the vibration of the piezoelectric layer 13 of the vibration unit 10 and allows for the realization of different vibration states, thus providing tactile feedback to the user and improving the user experience of the fingerprint sensor on the terminal device (including but not limited to terminal devices without physical buttons). Second, since the second sub-electrode plate 122 and the first electrode 11 are located on the same side of the piezoelectric layer 13 along the thickness direction, it is easier to electrically connect the second sub-electrode plate 122 and the first electrode 11 to the driving power supply, reducing the difficulty of wiring. Furthermore, the spacing between the second sub-electrode plate 122 and the first electrode 11 prevents conduction between the first electrode 11 and the first sub-electrode plate 121, thus meeting the power supply requirements of the piezoelectric layer 13 and effectively realizing tactile feedback.

[0211] Optionally, as shown in FIG6, the first electrode 11 and the second sub-electrode plate 122 can both be electrically connected to the driving power supply through the wire 40. Since the first electrode 11 and the second sub-electrode plate 122 are both located on the same side of the piezoelectric layer 13 along the thickness direction, the wire 40 can be led from one side, which makes it easier to make electrical connections and reduces the difficulty of leading wires.

[0212] Optionally, referring to FIG6, the fixing unit 20 is connected to the first sub-electrode plate 121. In this example, the fixing unit 20 is bonded to the first sub-electrode plate 121 through the adhesive layer 30. With both the first electrode 11 and the second sub-electrode plate 122 located on the same side of the piezoelectric layer 13 along its thickness direction, and since the wire leads can all be led from the same side of the piezoelectric layer 13 along its thickness direction, it is also convenient to connect the fixing unit 20 to the terminal device when installing the vibration element 100. Furthermore, the wires 40 connected from the first electrode 11 and the second sub-electrode plate 122 are less susceptible to interference.

[0213] Optionally, referring to FIG6, the size of the first sub-electrode plate 121 is larger than that of the second sub-electrode plate 122, and the size of the first electrode 11 is larger than that of the second sub-electrode plate 122. The second sub-electrode plate 122 may occupy a smaller portion of the first side of the piezoelectric layer 13 along the thickness direction, thereby facilitating the first electrode 11 and the second sub-electrode plate 122 to better supply power to the piezoelectric layer 13 by the driving voltage. Of course, the dimensional examples shown in FIG6 are not intended to limit the embodiments of this application.

[0214] The embodiments of this application do not limit the manner in which the first sub-electrode plate 121 and the second sub-electrode plate 122 are electrically connected. In some optional embodiments, referring to FIG6, the first sub-electrode plate 121 is electrically connected to the second sub-electrode plate 122 through a conductor structure 123, wherein the conductor structure 123 passes through the piezoelectric layer 13.

[0215] Based on this, by using the conductor structure 123 that passes through the piezoelectric layer 13 to achieve the electrical connection between the first sub-electrode plate 121 and the second sub-electrode plate 122, the structure of the vibration element 100 can be made more compact, and the volume of the vibration element 100 can be reduced, thus reducing the space occupied when installed in the terminal device.

[0216] In this embodiment, the conductor structure 123 can be any conductor passing through the piezoelectric layer 13, such as, but not limited to, wires, conductive vias, etc. The conductor structure 123 can be made of various metallic materials, but is not limited thereto.

[0217] Optionally, the vibration element 100 and the fingerprint sensor (e.g., an ultrasonic fingerprint sensor) in this embodiment can be driven by the same power supply or by different power supplies.

[0218] The overall process of the tactile feedback scheme in the third aspect of this application embodiment will be illustrated below with reference to the flowchart shown in FIG12. This overall process can be understood by substituting it into the application scenarios of side fingerprint tactile feedback or rear fingerprint tactile feedback in a terminal device. The fingerprint sensor can be understood as an ultrasonic fingerprint sensor, and the vibration element can be understood as the optional structure of the vibration element 100 shown in FIG6.

[0219] Referring to Figure 12, in this overall process, a wake-up signal is first obtained by detecting the user's finger through a fingerprint sensor, detecting the user's finger through a detection unit (the detection unit may include, but is not limited to, at least one of a ring capacitive sensor, an ultrasonic sensor, or a detection electrode), and receiving at least one of the user's predetermined wake-up operations through a terminal device to generate a wake-up signal.

[0220] Then, the fingerprint sensor is woken up by the wake-up signal and put into a working state where it can acquire fingerprint images;

[0221] Next, the fingerprint sensor captures the fingerprint image of the user pressing their finger to enter the fingerprint;

[0222] Next, determine the area ratio between the fingerprint area and the total area of ​​the fingerprint image;

[0223] Then, the fingerprint image can be determined as a valid fingerprint image based on the area ratio. If the area ratio of the pressed area is greater than or equal to a preset threshold, the fingerprint image is determined to be a valid fingerprint image. Then, fingerprint recognition is performed based on the fingerprint image to obtain the fingerprint recognition result.

[0224] If the fingerprint recognition result indicates that the user's identity is legitimate, then it is determined to control the vibration element to enter the first vibration state to vibrate, so as to provide the first type of tactile feedback to the user, thereby realizing the tactile feedback effect of the fingerprint sensor for a legitimate user.

[0225] If the fingerprint recognition result indicates that the user's identity is invalid, then it is determined to control the vibration element to enter the second vibration state to vibrate, so as to provide the user with a second kind of tactile feedback, thereby achieving the tactile feedback effect of using the fingerprint sensor on the user with invalid identity.

[0226] If the area ratio is less than a preset threshold, the fingerprint image is determined to be a non-valid fingerprint image. The vibration element of the control terminal device is then put into a third vibration state to provide a third type of tactile feedback to the user, thus achieving another type of tactile feedback effect.

[0227] It should be understood that the overall process described in Figure 12 above is not intended to limit the embodiments of this application. It should also be understood that the relevant content in the above overall process can be understood in conjunction with the preceding embodiments.

[0228] It is understood that the foregoing description of the haptic feedback scheme is merely an exemplary description of the embodiments of this application and is not intended to limit the embodiments of this application in any way.

[0229] Based on the same inventive concept as the haptic feedback method provided in the third aspect, and referring to FIG13, according to the fourth aspect of the embodiments of this application, a haptic feedback device 800 is provided, comprising:

[0230] The second acquisition module 802 is used to acquire a wake-up signal and control the fingerprint sensor of the terminal device to enter the working state according to the wake-up signal.

[0231] The determination module 804 is used to receive the fingerprint image entered by the user through the fingerprint sensor and determine whether the fingerprint image is a valid fingerprint image;

[0232] The identification module 806 is configured to, in response to determining that the fingerprint image is a valid fingerprint image, perform fingerprint identification based on the fingerprint image to obtain a fingerprint identification result;

[0233] The second control module 808 is used to control the vibration element of the terminal device to vibrate based on the fingerprint recognition result, so as to provide tactile feedback to the user.

[0234] In some optional embodiments, the second acquisition module 802 is specifically configured to: generate the wake-up signal in response to detecting the user's finger through the fingerprint sensor, and / or detecting the user's finger through a detection unit disposed on the terminal device outside the fingerprint sensor, and / or receiving a predetermined wake-up operation from the user through the terminal device.

[0235] In some optional embodiments, the second acquisition module 802 is specifically used to: detect at least one of the capacitance signal change, ultrasonic signal change, and voltage signal change caused by the finger through a detection unit disposed on the terminal device outside the fingerprint sensor, so as to detect the user's finger.

[0236] In some optional embodiments, the detection unit includes at least one of a ring capacitive sensor, an ultrasonic sensor, and a detection electrode, and the detection unit is disposed within the housing of the terminal device.

[0237] In some optional embodiments, the determining module 804 is specifically used to: determine the fingerprint area in the fingerprint image; determine the area ratio between the fingerprint area and the total area of ​​the fingerprint image; and determine whether the fingerprint image is a valid fingerprint image based on the area ratio.

[0238] In some optional embodiments, the determining module 804 is specifically configured to: determine the fingerprint image as a valid fingerprint image in response to the area ratio being greater than or equal to a preset threshold, and otherwise determine the fingerprint image as not a valid fingerprint image.

[0239] In some optional embodiments, the second control module 808 is specifically configured to: in response to the fingerprint recognition result indicating that the user's identity is legitimate, control the vibration element of the terminal device to enter a first vibration state to vibrate, so as to provide tactile feedback to the user; in response to the fingerprint recognition result indicating that the user's identity is illegitimate, control the vibration element of the terminal device to enter a second vibration state different from the first vibration state to vibrate, so as to provide tactile feedback to the user.

[0240] In some optional embodiments, the second control module 808 is specifically used to: control the vibration element of the terminal device to vibrate at a vibration frequency greater than or equal to 500Hz.

[0241] In some optional embodiments, the terminal device further includes a driving power supply, and the vibration element includes a vibration unit and a fixing unit; the vibration unit is electrically connected to the driving power supply and receives a driving voltage from the driving power supply to vibrate under the action of the driving voltage; the vibration unit is connected to the terminal device through the fixing unit and transmits the vibration to the terminal device through the fixing unit to provide tactile feedback to the user; the second control module 808 is specifically used to: control the vibration element of the terminal device to vibrate by adjusting the driving voltage output by the driving power supply.

[0242] In some optional embodiments, the second control module 808 is specifically used to: adjust the drive voltage output by the drive power supply by changing the switching frequency of the drive power supply and / or by changing the magnitude of the drive voltage output by the drive power supply.

[0243] In some optional embodiments, the vibration unit includes: a first electrode, a piezoelectric layer, and a second electrode; the first electrode is connected to a first side of the piezoelectric layer along its thickness direction, at least a portion of the second electrode is connected to a second side of the piezoelectric layer along its thickness direction, and the first electrode and the second electrode are not in contact; the fixing unit is connected to the first electrode and / or the second electrode; both the first electrode and the second electrode are electrically connected to the driving power supply and are used to obtain a driving voltage from the driving power supply to supply power to the piezoelectric layer; the piezoelectric layer deforms under the action of the driving voltage to vibrate, and the vibration is transmitted to the terminal device through the fixing unit to provide tactile feedback to the user.

[0244] In some optional embodiments, the second electrode includes an electrically connected first sub-electrode plate and a second sub-electrode plate, the first sub-electrode plate being connected to a second side of the piezoelectric layer along the thickness direction, the second sub-electrode plate being connected to a first side of the piezoelectric layer along the thickness direction, and a gap existing between the second sub-electrode plate and the first electrode; the first electrode and the second sub-electrode plate are electrically connected to the driving power supply so that the first electrode and the first sub-electrode plate obtain a driving voltage from the driving power supply to supply power to the piezoelectric layer.

[0245] In some alternative embodiments, the first sub-electrode plate is electrically connected to the second sub-electrode plate via a conductor structure, wherein the conductor structure passes through the piezoelectric layer.

[0246] In some optional embodiments, the vibrating element satisfies at least one of the following conditions: the material of the piezoelectric layer includes at least one of lead zirconate titanate, lithium niobate, and PVDF; the fixing unit is bonded to the first electrode and / or the second electrode via an adhesive layer; and the material of the fixing unit has a Brinell hardness greater than or equal to 50.

[0247] In some optional embodiments, both the vibration element and the fingerprint sensor are disposed within the housing of the terminal device, the vibration element is located below or around the edge of the fingerprint sensor, and the fingerprint sensor is a side fingerprint sensor or a rear fingerprint sensor of the terminal device.

[0248] In some optional embodiments, a plurality of vibration elements are disposed around the periphery of the fingerprint sensor, and / or a plurality of vibration elements are disposed below the fingerprint sensor; the second control module 808 is specifically used to: control at least one of the plurality of vibration elements to vibrate based on the fingerprint recognition result, so as to provide tactile feedback to the user.

[0249] The tactile feedback scheme provided in this application embodiment has several advantages. First, by setting a fingerprint sensor and a vibration element in the terminal device, the vibration element can be controlled to vibrate to provide tactile feedback for the use of the fingerprint sensor. This provides users with a better tactile experience when using the fingerprint sensor on the terminal device (including but not limited to terminal devices without physical buttons), effectively improving the user experience. Second, in this application embodiment, the fingerprint sensor is only woken up to enter the working state when fingerprint recognition and tactile feedback are required, which helps reduce the power consumption of the fingerprint sensor and the terminal device. Third, since this scheme performs fingerprint recognition only after receiving the fingerprint image entered by the user through the fingerprint sensor and confirming that the fingerprint image is valid, the possibility of fingerprint recognition failing to produce a result is reduced. Fourth, after obtaining the fingerprint recognition result, the vibration element can be reasonably controlled to vibrate according to the fingerprint recognition result to provide reasonable tactile feedback to the user, effectively reminding the user and improving the user experience of using the fingerprint sensor. Therefore, it can be seen that the technical solution in this application embodiment, through the entire process of first waking up the fingerprint, then determining the valid fingerprint image, then fingerprint recognition, and then providing vibration and tactile feedback, can effectively improve the user experience of using the fingerprint sensor of the terminal device (including but not limited to terminal devices without physical buttons).

[0250] The tactile feedback device 800 and its optional embodiments in this application have been described in detail in the foregoing tactile feedback method embodiments. Therefore, their related content and beneficial effects can be understood by referring to the content of the optional embodiments of the above method, and will not be repeated here.

[0251] According to a fifth aspect of the embodiments of this application, an electronic device is provided, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory is used to store a computer program; and the processor is used to execute the haptic feedback method described in the first or third aspect by running the computer program stored in the memory.

[0252] Figure 9 shows a structural block diagram of an optional electronic device according to an embodiment of this application. This application does not limit the specific implementation of the electronic device 900. As an example, referring to Figure 9, the electronic device 900 provided in this application includes: a processor 902, a communications interface 904, a memory 906, and a communication bus 908. Wherein:

[0253] The processor 902, communication interface 904, and memory 906 communicate with each other via communication bus 908.

[0254] Communication interface 904 is used to communicate with other electronic devices or servers.

[0255] The processor 902 is used to execute the computer program 910, specifically the relevant steps in any of the aforementioned haptic feedback method embodiments.

[0256] Specifically, computer program 910 may include program code that includes computer operation instructions.

[0257] The processor 902 may be a CPU, a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; or they may be processors of different types, such as one or more CPUs and one or more ASICs.

[0258] Memory 906 is used to store computer program 910. Memory 906 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0259] Specifically, computer program 910 can be used to cause processor 902 to execute the haptic feedback method in any of the embodiments of the first or third aspect described above.

[0260] The specific implementation of each step in computer program 910 can be found in the corresponding steps and units described in any of the aforementioned haptic feedback method embodiments in the first or third aspect, and will not be repeated here. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the devices and modules described above can be referred to the corresponding process descriptions in the aforementioned method embodiments, and will not be repeated here.

[0261] The electronic device 900 in this application embodiment has been described in detail in the tactile feedback method embodiments of the first or third aspects above. Therefore, its related content and beneficial effects can be understood with reference to the above method embodiments, and will not be repeated here.

[0262] According to a sixth aspect of the embodiments of this application, this application also provides a computer storage medium storing a computer program thereon, which, when executed by a processor, implements the haptic feedback method described in any one of the multiple method embodiments of the first or third aspect. The computer storage medium includes, but is not limited to, compact disc read-only memory (CD-ROM), random access memory (RAM), floppy disk, hard disk, or magneto-optical disk, etc.

[0263] According to a seventh aspect of the embodiments of this application, the embodiments of this application also provide a computer program product, including a computer program that, when executed by a processor, implements the haptic feedback method as described in any of the embodiments of the multiple method embodiments of the first or third aspect above.

[0264] The haptic feedback device 1000 / haptic feedback device 800 / electronic device 900 / computer storage medium / computer program product embodiments in this application have been described in detail in the haptic feedback method embodiments of the first or third aspects above. Therefore, their related contents and beneficial effects can be understood by referring to the above method embodiments, and will not be repeated here.

[0265] It should be understood that the various figures in the embodiments of this application are for the purpose of illustrating the structure, and the dimensions of each structure may not be drawn according to the actual scale.

[0266] Furthermore, it should be noted that the user-related information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to sample data used for training the model, data used for analysis, stored data, displayed data, etc.) involved in the embodiments of this application are all information and data authorized by the user or fully authorized by all parties. Moreover, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0267] It should be noted that, depending on the implementation needs, the various components / steps described in the embodiments of this application can be broken down into more components / steps, or two or more components / steps or parts of the operation of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of this application.

[0268] The methods described in the embodiments of this application can be implemented in hardware, firmware, or as software or computer code that can be stored in a recording medium (such as a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code downloaded over a network that is originally stored in a remote recording medium or a non-transitory machine-readable medium and will be stored in a local recording medium. Thus, the methods described herein can be stored on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA)). It is understood that the computer, processor, microprocessor controller, or programmable hardware includes storage components (e.g., Random Access Memory (RAM), Read-Only Memory (ROM), Flash Memory, etc.) capable of storing or receiving software or computer code, which, when accessed and executed by the computer, processor, or hardware, implements the methods described herein. Furthermore, when a general-purpose computer accesses code used to implement the methods shown herein, the execution of the code transforms the general-purpose computer into a dedicated computer for executing the methods shown herein.

[0269] Those skilled in the art will recognize that the units and method steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for specific applications, but such implementations should not be considered beyond the scope of the embodiments of this application.

[0270] The above embodiments are only used to illustrate the embodiments of this application, and are not intended to limit the embodiments of this application. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of this application. Therefore, all equivalent technical solutions also fall within the scope of the embodiments of this application, and the patent protection scope of the embodiments of this application should be defined by the claims.

Claims

1. A haptic feedback method, comprising: Acquire the fingerprint image obtained when a user registers their fingerprint using the fingerprint sensor on the terminal device; Based on the fingerprint image, the pressing area information of the fingerprint recorded by the user through the fingerprint sensor is determined; Based on the pressing area information, the vibration configuration information of the vibration element of the terminal device is determined; Based on the vibration configuration information, the vibration element is controlled to vibrate in order to provide tactile feedback to the user.

2. The method according to claim 1, wherein, The pressing area information includes the proportion of the pressing area that the user presses on the fingerprint enrollment area of ​​the fingerprint sensor; The step of determining the pressure area information of the fingerprint recorded by the user through the fingerprint sensor based on the fingerprint image includes: Determine the fingerprint area in the fingerprint image; Determine the ratio between the fingerprint area and the total area of ​​the fingerprint image, and define the ratio as the pressing area ratio.

3. The method according to claim 1, wherein, The step of determining the vibration configuration information of the vibration element of the terminal device based on the pressing area information includes: in response to the pressing area information satisfying a first preset condition, determining first vibration configuration information for controlling the vibration element of the terminal device to enter a first vibration state; The step of controlling the vibration element to vibrate based on the vibration configuration information to provide tactile feedback to the user includes: controlling the vibration element to enter a first vibration state to vibrate based on the first vibration configuration information to provide tactile feedback to the user.

4. The method according to claim 3, wherein, The step of determining the vibration configuration information of the vibration element of the terminal device based on the pressing area information further includes: responding to the pressing area information satisfying a second preset condition but not a first preset condition, performing fingerprint recognition based on the fingerprint image to obtain a fingerprint recognition result, and determining target vibration configuration information for controlling the vibration element of the terminal device to enter a target vibration state based on the fingerprint recognition result, wherein the second preset condition is different from the first preset condition, and the target vibration state is different from the first vibration state, and the fingerprint recognition result is used to indicate the legality of the identity of the user who registered the fingerprint through the fingerprint sensor; The step of controlling the vibration element to vibrate based on the vibration configuration information to provide tactile feedback to the user includes: controlling the vibration element to enter a target vibration state to vibrate based on the target vibration configuration information to provide tactile feedback to the user.

5. The method according to claim 4, wherein, The target vibration state includes a second vibration state and a third vibration state, and the second vibration state is different from the third vibration state; The step of determining the target vibration configuration information for controlling the vibration element of the terminal device to enter the target vibration state based on the fingerprint recognition result includes: In response to the fingerprint recognition result indicating that the user's identity is legitimate, second vibration configuration information for controlling the vibration element of the terminal device to enter a second vibration state is determined; or, In response to the fingerprint recognition result indicating that the user's identity is illegitimate, third vibration configuration information for controlling the vibration element of the terminal device to enter a third vibration state is determined.

6. The method according to claim 1, wherein, The step of controlling the vibration element to vibrate based on the vibration configuration information to provide tactile feedback to the user includes: Based on the vibration configuration information, the vibration element is controlled to vibrate at a vibration frequency of 500Hz or higher to provide tactile feedback to the user.

7. The method according to any one of claims 1-6, wherein, The terminal device further includes a driving power supply, and the vibration element includes a vibration unit and a fixing unit; the vibration unit is electrically connected to the driving power supply and obtains a driving voltage from the driving power supply to vibrate under the action of the driving voltage; the vibration unit is connected to the terminal device through the fixing unit and transmits the vibration to the terminal device through the fixing unit to provide tactile feedback to the user; Controlling the vibration element to vibrate includes: Adjust the driving voltage output by the driving power supply to control the vibration unit of the vibration element to vibrate.

8. The method according to claim 7, wherein, Adjusting the drive voltage output by the drive power supply includes: The driving voltage output by the driving power supply is adjusted by changing the switching frequency of the driving power supply and / or by changing the magnitude of the driving voltage output by the driving power supply.

9. The method according to claim 7, wherein, The vibration unit includes: a first electrode, a piezoelectric layer, and a second electrode; the first electrode is connected to a first side of the piezoelectric layer along the thickness direction, at least a portion of the second electrode is connected to a second side of the piezoelectric layer along the thickness direction, and the first electrode and the second electrode are not in contact with each other; the fixing unit is connected to the first electrode and / or the second electrode. Both the first electrode and the second electrode are electrically connected to the driving power supply and are used to obtain driving voltage from the driving power supply to supply power to the piezoelectric layer. The piezoelectric layer deforms under the action of the driving voltage to vibrate, and the vibration is transmitted to the terminal device through the fixing unit to provide tactile feedback to the user.

10. The method according to claim 9, wherein, The second electrode includes a first sub-electrode plate and a second sub-electrode plate that are electrically connected. The first sub-electrode plate is connected to a second side of the piezoelectric layer along the thickness direction, and the second sub-electrode plate is connected to a first side of the piezoelectric layer along the thickness direction. There is a gap between the second sub-electrode plate and the first electrode. The first electrode and the second sub-electrode plate are electrically connected to the driving power supply so that the first electrode and the first sub-electrode plate obtain driving voltage from the driving power supply to supply power to the piezoelectric layer.

11. The method according to claim 10, wherein, The first sub-electrode plate is electrically connected to the second sub-electrode plate through a conductor structure, wherein the conductor structure passes through the piezoelectric layer.

12. The method according to claim 9, wherein, The vibrating element satisfies at least one of the following conditions: The material of the piezoelectric layer includes at least one of lead zirconate titanate, lithium niobate, and PVDF. The fixing unit is bonded to the first electrode and / or the second electrode through an adhesive layer; The material of the fixing unit has a Brinell hardness greater than or equal to 50.

13. The method according to any one of claims 1-6, wherein, Both the vibration element and the fingerprint sensor are disposed inside the housing of the terminal device. The vibration element is located below or around the edge of the fingerprint sensor, and the fingerprint sensor is a side fingerprint sensor or a rear fingerprint sensor of the terminal device.

14. The method according to claim 13, wherein, Multiple vibration elements are disposed around the periphery of the fingerprint sensor, and / or multiple vibration elements are disposed below the fingerprint sensor; The step of controlling the vibration element to vibrate based on the vibration configuration information to provide tactile feedback to the user includes: Based on the vibration configuration information, at least one of the multiple vibration elements is controlled to vibrate in order to provide tactile feedback to the user.

15. A haptic feedback device, comprising: The first acquisition module is used to acquire the fingerprint image obtained when the user registers his / her fingerprint through the fingerprint sensor of the terminal device. The first determining module is used to determine the pressing area information of the fingerprint recorded by the user through the fingerprint sensor based on the fingerprint image; The second determining module is used to determine the vibration configuration information of the vibration element of the terminal device based on the pressing area information; The first control module is used to control the vibration element to vibrate based on the vibration configuration information in order to provide tactile feedback to the user.

16. A haptic feedback method, comprising: Acquire a wake-up signal and control the fingerprint sensor of the terminal device to enter the working state according to the wake-up signal; Receive the fingerprint image entered by the user through the fingerprint sensor, and determine whether the fingerprint image is a valid fingerprint image; In response to determining that the fingerprint image is a valid fingerprint image, fingerprint recognition is performed based on the fingerprint image to obtain a fingerprint recognition result; Based on the fingerprint recognition result, the vibration element of the terminal device is controlled to vibrate to provide tactile feedback to the user.

17. The method according to claim 16, wherein, The acquisition of the wake-up signal includes: The wake-up signal is generated in response to the detection of the user's finger by the fingerprint sensor, and / or by the detection unit located outside the fingerprint sensor on the terminal device, and / or by the terminal device receiving a predetermined wake-up operation from the user.

18. The method according to claim 17, wherein, The detection of the user's finger by a detection unit disposed outside the fingerprint sensor of the terminal device includes: The user's finger is detected by a detection unit located outside the fingerprint sensor of the terminal device, which detects at least one of the capacitance signal change, ultrasonic signal change, and voltage signal change caused by the finger.

19. The method according to claim 17, wherein, The detection unit includes at least one of a ring capacitive sensor, an ultrasonic sensor, and a detection electrode, and the detection unit is disposed within the housing of the terminal device.

20. The method of claim 16, wherein, Determining whether the fingerprint image is a valid fingerprint image includes: Determine the fingerprint area in the fingerprint image; Determine the area ratio between the fingerprint area and the total area of ​​the fingerprint image; Based on the area ratio, it is determined whether the fingerprint image is a valid fingerprint image.

21. The method according to claim 20, wherein, The step of determining whether the fingerprint image is a valid fingerprint image based on the area ratio includes: If the area ratio is greater than or equal to a preset threshold, the fingerprint image is determined to be a valid fingerprint image; otherwise, the fingerprint image is determined to be a non-valid fingerprint image.

22. The method according to claim 16, wherein, The step of controlling the vibration element of the terminal device to vibrate based on the fingerprint recognition result to provide tactile feedback to the user includes: In response to the fingerprint recognition result indicating that the user's identity is legitimate, the vibration element of the terminal device is controlled to enter a first vibration state to vibrate, so as to provide tactile feedback to the user; In response to the fingerprint recognition result indicating that the user's identity is illegitimate, the vibration element of the terminal device is controlled to enter a second vibration state different from the first vibration state to provide tactile feedback to the user.

23. The method according to claim 16, wherein, The method of controlling the vibration element of the terminal device to vibrate includes: The vibration element of the terminal device is controlled to vibrate at a vibration frequency greater than or equal to 500Hz.

24. The method according to any one of claims 16-23, wherein, The terminal device further includes a driving power supply, and the vibration element includes a vibration unit and a fixing unit; the vibration unit is electrically connected to the driving power supply and obtains a driving voltage from the driving power supply to vibrate under the action of the driving voltage; the vibration unit is connected to the terminal device through the fixing unit and transmits the vibration to the terminal device through the fixing unit to provide tactile feedback to the user; The method of controlling the vibration element of the terminal device to vibrate includes: By adjusting the driving voltage output by the driving power supply, the vibration element of the terminal device can be controlled to vibrate.

25. The method according to claim 24, wherein, Adjusting the drive voltage output by the drive power supply includes: The driving voltage output by the driving power supply is adjusted by changing the switching frequency of the driving power supply and / or by changing the magnitude of the driving voltage output by the driving power supply.

26. The method according to claim 24, wherein, The vibration unit includes: a first electrode, a piezoelectric layer, and a second electrode; the first electrode is connected to a first side of the piezoelectric layer along the thickness direction, at least a portion of the second electrode is connected to a second side of the piezoelectric layer along the thickness direction, and the first electrode and the second electrode are not in contact with each other; the fixing unit is connected to the first electrode and / or the second electrode. Both the first electrode and the second electrode are electrically connected to the driving power supply and are used to obtain driving voltage from the driving power supply to supply power to the piezoelectric layer. The piezoelectric layer deforms under the action of the driving voltage to vibrate, and the vibration is transmitted to the terminal device through the fixing unit to provide tactile feedback to the user.

27. The method according to claim 26, wherein, The second electrode includes a first sub-electrode plate and a second sub-electrode plate that are electrically connected. The first sub-electrode plate is connected to a second side of the piezoelectric layer along the thickness direction, and the second sub-electrode plate is connected to a first side of the piezoelectric layer along the thickness direction. There is a gap between the second sub-electrode plate and the first electrode. The first electrode and the second sub-electrode plate are electrically connected to the driving power supply so that the first electrode and the first sub-electrode plate obtain driving voltage from the driving power supply to supply power to the piezoelectric layer.

28. The method according to claim 27, wherein, The first sub-electrode plate is electrically connected to the second sub-electrode plate through a conductor structure, wherein the conductor structure passes through the piezoelectric layer.

29. The method according to claim 27, wherein, The vibrating element satisfies at least one of the following conditions: The material of the piezoelectric layer includes at least one of lead zirconate titanate, lithium niobate, and PVDF. The fixing unit is bonded to the first electrode and / or the second electrode through an adhesive layer; The material of the fixing unit has a Brinell hardness greater than or equal to 50.

30. The method according to any one of claims 16-23, wherein, Both the vibration element and the fingerprint sensor are disposed inside the housing of the terminal device. The vibration element is located below or around the edge of the fingerprint sensor, and the fingerprint sensor is a side fingerprint sensor or a rear fingerprint sensor of the terminal device.

31. The method according to claim 30, wherein, Multiple vibration elements are disposed around the periphery of the fingerprint sensor, and / or multiple vibration elements are disposed below the fingerprint sensor; The step of controlling the vibration element of the terminal device to vibrate based on the fingerprint recognition result to provide tactile feedback to the user includes: Based on the fingerprint recognition result, at least one of the multiple vibration elements is controlled to vibrate in order to provide tactile feedback to the user.

32. A haptic feedback device, comprising: The second acquisition module is used to acquire a wake-up signal and control the fingerprint sensor of the terminal device to enter the working state according to the wake-up signal; The determination module is used to receive the fingerprint image entered by the user through the fingerprint sensor and determine whether the fingerprint image is a valid fingerprint image; The identification module is configured to, in response to determining that the fingerprint image is a valid fingerprint image, perform fingerprint identification based on the fingerprint image to obtain a fingerprint identification result; The second control module is used to control the vibration element of the terminal device to vibrate based on the fingerprint recognition result, so as to provide tactile feedback to the user.

33. An electronic device, comprising: The processor, the communication interface, the memory, and the communication bus are provided, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus. The memory is used to store computer programs; The processor is configured to perform the method of any one of claims 1-14, 16-31 by running the computer program stored in the memory.

34. A computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method as described in any one of claims 1-14, 16-31.

35. A computer program product comprising a computer program that, when executed by a processor, implements the method as described in any one of claims 1-14, 16-31.

Images