A device control method and system based on fingerprint features

By acquiring multiple frames of sensor images and combining fingerprint features and timing information to determine operating parameters, the problem of limited application scenarios and large space occupation of fingerprint scanning chips is solved, enabling rich device control functions and a better user experience.

CN118736630BActive Publication Date: 2026-11-17SILEAD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310335074.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-03-30
Publication Date
2026-11-17
Estimated Expiration
2043-03-30

AI Technical Summary

Technical Problem

Existing fingerprint scanning chips have limited application scenarios and occupy a large space, lacking effective expansion methods.

Method used

By acquiring multiple frames of sensor images, combining fingerprint features and timing information, operating parameters are determined, and device status is adjusted to enrich application functions.

Benefits of technology

This expands the application of fingerprint scanning chips and improves user convenience and experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118736630B_ABST
    Figure CN118736630B_ABST
Patent Text Reader

Abstract

This specification provides a device control method and system based on fingerprint features, applied in the field of fingerprint sensing technology. The method includes: acquiring multiple frames of sensing images; the multiple frames of sensing images correspond to time sequence information; determining operation parameters corresponding to the multiple frames of sensing images based on the time sequence information; wherein, it includes: combining fingerprint features in the multiple frames of sensing images and the time sequence information to obtain fingerprint feature changes; comprehensively determining operation parameters based on the fingerprint feature changes; and adjusting the device state according to the operation parameters. Through the above process, users can perform specific operations on the surface of the fingerprint scanning chip, expanding the ways users can operate and facilitating operation in specific application scenarios, thereby expanding the application of fingerprint scanning chips and improving the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This specification relates to the field of fingerprint sensing technology, and in particular to a device control method and system based on fingerprint features. Background Technology

[0002] Fingerprint scanning chips are primarily used for fingerprint recognition and are widely used in areas such as mobile phone unlocking, electronic payments, and access control. After capturing a fingerprint image, the chip compares it to a pre-stored fingerprint. If the comparison matches, authentication is successful, and operations such as unlocking and transferring funds are executed.

[0003] Currently, the application scenarios of fingerprint scanning chips are mainly limited to the aforementioned identity authentication. However, this results in two main issues: firstly, the functionality of fingerprint scanning chips on devices is relatively limited, lacking effective applications; secondly, using fingerprint scanning chips for fingerprint recognition requires a certain surface area, meaning the chip itself may occupy a considerable amount of space. Therefore, a technical solution is needed to effectively expand the application scenarios of fingerprint scanning chips. Summary of the Invention

[0004] The purpose of the embodiments in this specification is to provide a device control method and system based on fingerprint features to solve the problem of how to enrich the application functions of fingerprint scanning chips.

[0005] To address the aforementioned technical problems, embodiments of this specification propose a device control method based on fingerprint features, comprising: acquiring multiple frames of sensor images; the multiple frames of sensor images corresponding to time sequence information; determining operation parameters corresponding to the multiple frames of sensor images based on the time sequence information; wherein, the method includes: combining fingerprint features in the multiple frames of sensor images and the time sequence information to obtain fingerprint feature changes; determining operation parameters based on the fingerprint feature changes; and adjusting the device state according to the operation parameters.

[0006] In some implementations, the method is applied to a terminal device; adjusting the device state according to the operating parameters includes: determining the control logic corresponding to the operating parameters; and adjusting the device's own state based on the control logic.

[0007] In some implementations, the method is applied to a fingerprint detection module; adjusting the device state according to the operating parameters includes: generating a corresponding control command based on the operating parameters; and sending the control command to a terminal device so that the terminal device adjusts the device state accordingly based on the control command.

[0008] In some implementations, before obtaining the fingerprint feature changes by combining the fingerprint features in the multi-frame sensing images and the time sequence information, the method further includes: sequentially determining whether each sensing image contains fingerprint features; if it does, identifying the fingerprint features in the corresponding sensing image.

[0009] In some implementations, the step of combining the fingerprint features in the multi-frame sensing images and the temporal information to obtain the fingerprint feature change includes: determining, based on the temporal information, whether there is at least one identical fingerprint feature between adjacent sensing images; if so, determining the first position information of the at least one identical fingerprint feature in the adjacent sensing images; and determining the fingerprint feature change based on the first position information.

[0010] Based on the above implementation, after determining whether there is at least one identical fingerprint feature between adjacent sensor images based on time sequence information, the method further includes: if not, comparing the fingerprint features in different sensor images with a preset overall fingerprint image in sequence, and determining the second position information of each fingerprint feature in the preset overall fingerprint image; and determining the fingerprint feature change based on the second position information.

[0011] In some implementations, the step of combining the fingerprint features in the multiple frames of sensor images and the timing information to obtain the fingerprint feature changes includes: identifying the fingerprint features in each sensor image respectively; comparing the fingerprint features sequentially with a preset overall fingerprint image and determining the third position information of each fingerprint feature in the preset overall fingerprint image; combining the third position information and the timing information to determine the fingerprint feature changes between sensor images; and determining operation parameters based on the fingerprint feature changes.

[0012] In some implementations, determining the operation parameters corresponding to the multi-frame sensing images based on the timing information includes: identifying whether the multi-frame sensing images contain non-fingerprint images; the non-fingerprint images are images that do not contain fingerprint features; if they do contain fingerprint images, determining the operation parameters by combining the timing information of the fingerprint images and the non-fingerprint images; the operation parameters include the number of touches.

[0013] Based on the above implementation method, adjusting the device state according to the operation parameters includes: selecting an application or selecting a portion of the display interface based on the number of touches.

[0014] Based on the aforementioned implementation, after identifying whether the multi-frame sensing images contain non-fingerprint images, the method further includes: if not, determining operation parameters based on the temporal information of the sensing images; the operation parameters include translation parameters, rotation parameters, or long press duration.

[0015] Based on the above implementation, adjusting the device state according to the operation parameters includes: switching the display interface, switching the selected application, or adjusting the volume / brightness based on the translation or rotation parameters; or selecting an application or a portion of the display interface based on the long press duration corresponding to the operation parameters.

[0016] Based on the aforementioned implementation, after identifying whether the multi-frame sensing images contain non-fingerprint images, the method further includes: if they contain non-fingerprint images, determining at least two fingerprint image intervals based on the temporal information of the fingerprint images and non-fingerprint images; the fingerprint image intervals are composed of temporally continuous fingerprint images; determining the operation parameters within each fingerprint image interval; and adjusting the device state according to the operation parameters, including: determining the corresponding control logic / control command by integrating multiple operation parameters; and adjusting the device state according to the control logic / control command.

[0017] Based on the aforementioned embodiments, the sensing image is acquired by a fingerprint scanning chip; the fingerprint scanning chip includes a fingerprint sensing array composed of multiple rows and columns of fingerprint sensing elements; the sensing image is generated based on a portion of the fingerprint sensing elements in the fingerprint sensing array.

[0018] Based on the above embodiments, the partial fingerprint sensing elements include: fingerprint sensing elements in a specific row, or fingerprint sensing elements in a specific column, or fingerprint sensing elements in a specific area.

[0019] This specification also proposes a device control method based on fingerprint features, comprising: acquiring multiple frames of sensor images; the multiple frames of sensor images corresponding to time sequence information; determining operation parameters corresponding to the multiple frames of sensor images based on the time sequence information; wherein, it includes: combining the fingerprint features in the multiple frames of sensor images and the time sequence information to acquire fingerprint feature changes; determining operation parameters based on the fingerprint feature changes; and controlling the device state of the terminal device in the unlocked state according to the operation parameters.

[0020] This specification also proposes a fingerprint-based device control system, including a fingerprint detection module and a terminal device. The fingerprint detection module includes a fingerprint scanning chip. The fingerprint scanning chip is used to generate a sensing image on the chip surface. The fingerprint detection module processes the sensing image based on the steps of the above-described fingerprint-based device control method and sends the processing result to the terminal device. The terminal device is used to adjust the device state according to the received processing result.

[0021] In some implementations, the fingerprint scanning chip is disposed on the side or back of the terminal device.

[0022] This specification also proposes a fingerprint-based device control system, including a fingerprint detection module and a terminal device. The fingerprint detection module includes a fingerprint scanning chip. The fingerprint scanning chip is used to generate a sensing image on the chip surface. The fingerprint detection module is used to send the sensing image to the terminal device. The terminal device includes a memory and a processor. The memory is used to store computer programs / instructions. The processor is used to execute the computer programs / instructions to implement the steps of the above-described fingerprint-based device control method to adjust the device state.

[0023] In some implementations, the fingerprint scanning chip is disposed on the side or back of the terminal device.

[0024] As can be seen from the technical solutions provided in the embodiments of this specification above, these embodiments acquire multiple frames of sensor images, analyze the fingerprint features in the sensor images, combine them with timing information to determine the changes in fingerprint features, and then deduce the corresponding operation parameters based on these changes. The device state is then adjusted according to these operation parameters. Through this process, users can perform specific operations on the surface of the fingerprint scanning chip, expanding the ways users can operate and facilitating their operations in specific application scenarios. This expands the application methods of fingerprint scanning chips and improves the user experience. Attached Figure Description

[0025] To more clearly illustrate the technical solutions in the embodiments or prior art of this specification, the drawings used in the description of the embodiments or prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0026] Figure 1 This is a flowchart illustrating a device control method based on fingerprint features, as described in this specification.

[0027] Figure 2 This is a schematic diagram illustrating a finger being placed close to a fingerprint scanning chip, as described in an embodiment of this specification.

[0028] Figure 3 This is a schematic diagram illustrating an example of interlaced scanning for acquiring sensor images according to an embodiment of this specification;

[0029] Figure 4 This is a schematic diagram illustrating the sensor image comparison effect of an embodiment of this specification;

[0030] Figure 5 This is a schematic diagram illustrating the sensor image comparison effect of an embodiment of this specification;

[0031] Figure 6 This is a schematic diagram illustrating an embodiment of this specification that compares a preset fingerprint image.

[0032] Figure 7 This is a schematic diagram illustrating a finger touching the chip surface twice, as described in an embodiment of this specification.

[0033] Figure 8 This is a flowchart illustrating a device control method based on fingerprint features, as described in this specification.

[0034] Figure 9 This is a flowchart illustrating a device control method based on fingerprint features, as described in this specification.

[0035] Figure 10 This is a flowchart illustrating a device control method based on fingerprint features, as described in this specification. Detailed Implementation

[0036] The technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this specification, and not all embodiments. Based on the embodiments in this specification, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this specification.

[0037] To address the aforementioned technical problems, this specification proposes a device control method based on fingerprint features. The executing entity of the fingerprint-based device control method is a corresponding electronic device or module. For example... Figure 1 As shown, the device control method based on fingerprint features may include the following specific implementation steps.

[0038] S110: Acquire multiple frames of sensor images; the multiple frames of sensor images correspond to time sequence information.

[0039] A sensing image is an image acquired by a sensing module. After acquiring corresponding sensing information for a specific sensing area, the sensing module can process the sensing information into a sensing image to reflect the current state of the sensing area.

[0040] In some implementations, the sensing module for acquiring the sensing image can be a fingerprint scanning chip. The fingerprint scanning chip acquires the corresponding sensing image by sensing its own detection area after triggering corresponding sensing conditions, such as at a certain time interval or upon detecting a conductive object touching the detection unit. For example, as... Figure 2 As shown, when a finger is placed close to the fingerprint scanning chip, the fingerprint scanning chip can acquire an image corresponding to the fingerprint on the finger surface.

[0041] The specific method of acquiring the sensor image can correspond to the type of fingerprint scanning chip. For example, when the fingerprint scanning chip is a capacitive fingerprint chip, the chip generates corresponding electrical signals based on the distance between different positions on the sensing area and the conductive object. After processing the electrical signals, the surface undulation state of the object on the sensing area can be determined, thereby generating a corresponding sensor image that reflects features such as fingerprints. When the fingerprint scanning chip is an optical fingerprint chip, different positions on the sensing area can emit corresponding light, and the light reflected by the object being detected can be acquired. Based on the parameters of the received reflected light, the features of the object at the corresponding position can be determined, and the sensor image corresponding to the sensing area can be generated by combining the parameter information from different positions.

[0042] In practical applications, the specific method of acquiring sensor images can be set according to the parameters and working mode of the fingerprint scanning chip, and is not limited to the above examples, so it will not be elaborated here.

[0043] When the sensing image is acquired based on a fingerprint scanning chip, the sensing image may or may not contain fingerprint features. For example, when a user places their finger on the sensing area of ​​the fingerprint scanning chip, the acquired sensing image generally contains the corresponding fingerprint features. However, when the fingerprint scanning chip acquires a sensing image due to other conditions, such as when the finger is not placed on the sensing area, or when the user removes their finger from the sensing area during the acquisition process, the acquired sensing image may not contain fingerprint features.

[0044] In the embodiments of this specification, in order to control the device based on the sensor images in subsequent steps, it is necessary to acquire multiple frames of sensor images, and each frame of sensor image corresponds to a specific timing information.

[0045] Multi-frame sensor images can be continuously acquired or acquired by re-acquiring multiple frames at intervals. When sensor images are acquired at intervals, it is preferable that the interval between adjacent frames is equal to facilitate the determination of the specific operation corresponding to the sensor image in subsequent steps.

[0046] Timing information is used to indicate the order in which each sensor image was acquired. This can be the acquisition time of each sensor image or other identifiers related to the acquisition order. After sorting the sensor images based on the timing information, changes in objects on the surface of the sensing area can be reflected based on the sorted sensor images.

[0047] In practical applications, the size of the sensor image depends on the area of ​​the fingerprint scanning chip. In typical fingerprint recognition scenarios based on authentication, it is often necessary to ensure the area of ​​the fingerprint scanning chip is large enough to capture a complete fingerprint image, or an image containing a sufficient number of fingerprint features. In the embodiments of this specification, the chip for acquiring the sensor image can be set to a larger area mode to capture a more complete fingerprint image, or it can be set to a smaller area mode, as long as it can capture a certain number of fingerprint features. For example, the size of the sensor image may include three fingerprint features. In practical applications, the size of the fingerprint scanning chip can be adjusted according to requirements, and there is no limitation on this.

[0048] In practical applications, fingerprint scanning chips can contain fingerprint sensing arrays composed of multiple rows and columns of fingerprint sensing elements. Different fingerprint sensing elements acquire corresponding sensing information, and by combining the sensing information from different locations, a sensing image corresponding to the detection area can be generated.

[0049] In the embodiments of this specification, since the main function of the sensing image is not to perform identity verification based on fingerprint recognition, the method of acquiring the sensing image can also be adjusted. That is, when acquiring the sensing image, it is not necessary to activate all fingerprint sensing elements in the fingerprint sensing array, but only to use some fingerprint sensing elements in the fingerprint sensing array to generate the sensing image.

[0050] Specifically, it can be to select fingerprint sensor elements in a specific row to generate a sensor image, such as activating fingerprint sensor elements in a row-by-row manner, or selecting multiple rows of fingerprint sensor elements in the middle section to generate a sensor image, for example... Figure 3 As shown, assuming the chip's recognition area is 32×1160 pixels, interlaced scanning of the central portion results in a true scanning area of ​​32×140 pixels. This significantly speeds up the fingerprint chip's scanning process. Alternatively, specific columns of fingerprint sensors can be selected to generate a sensor image. For example, activating fingerprint sensors in every other column, or selecting multiple columns of fingerprint sensors in the central portion. A specific area of ​​fingerprint sensors can also be selected, such as selecting only the fingerprint sensors within the central circular area to generate a sensor image. In practical applications, the positions of the selected fingerprint sensors can be adjusted according to requirements, and are not limited to the examples above; further details will not be elaborated upon here.

[0051] By selecting a portion of the fingerprint sensing elements to generate sensing images, not only is the effectiveness of the sensing images used to perform subsequent steps guaranteed, but the scanning speed can also be accelerated, thereby shortening the time to acquire sensing images and ensuring the continuity between the acquired multiple frames of sensing images.

[0052] S120: Determine the operation parameters corresponding to the multi-frame sensing images based on the timing information.

[0053] After acquiring multiple frames of sensor images, the arrangement order of the sensor images is determined by combining the timing information of the sensor images, and then the corresponding operation parameters can be determined based on the sensor images. When a user performs a corresponding operation on the surface of the fingerprint scanning chip, such as sliding or double-clicking on the surface of the fingerprint scanning chip, the user's action reflected in these sensor images can be determined by comparing the differences between the sensor images. For example, if the timing information determines that the fingerprint features in the sensor image are gradually moving downwards in the image, it can be determined that the user has performed a sliding operation.

[0054] The device control method based on fingerprint features pre-stores corresponding operation parameters in its execution entity, enabling the determination of these parameters based on changes in the sensor images. These operation parameters may include, for example, translation, rotation, long press, and tap. Translation may include swiping up, down, left, right, and other directional movements. In practical applications, other types of operation parameters can be set as needed, and are not limited to the examples described above; further details will not be elaborated here.

[0055] Since sensor images reflect the features of the current sensing area, and it's necessary to determine changes in these images, it's crucial to locate the changes between different images. Therefore, fingerprint features within the sensor images can be used to determine specific operational parameters. By combining the temporal information of multiple sensor images, identifying the fingerprint features within these images, and determining the changes in these fingerprint features, specific operational parameters can be determined. For example, if the fingerprint features in adjacent sensor images have shifted around their center, it can be determined that the user has rotated their finger within the sensing area.

[0056] Specifically, in order to achieve the above steps of determining the operation parameters based on changes in fingerprint features, it is possible to first determine whether each sensor image contains fingerprint features. If fingerprint features are present, then the fingerprint features can be identified.

[0057] In practical applications, due to the characteristics of the acquisition process and specific actions, the acquired sensor images may not all contain fingerprint features. For example, when the user removes their finger from the detection area after finishing the operation, the fingerprint scanning chip may still acquire sensor images for a period of time, so that the sensor images acquired during this period do not contain fingerprint features. It is known that when the user performs a double-click operation, they must remove their finger from the detection area, so that the sensor images acquired during this period do not contain fingerprint features.

[0058] Once the sensor images containing fingerprint features are identified, these features can be extracted. Fingerprint features can include the typical line arrangement and intersection characteristics of a fingerprint. Generally, fingerprint features can be the fingerprint-specific image appearance of a specific area within an image, or features corresponding to the fingerprint as a whole within the image. The specific method for identifying fingerprint features depends on the definition and identification method used in the actual application, and will not be elaborated upon here.

[0059] In some implementations, after identifying fingerprint features in each sensor image, it can be determined sequentially based on time-series information whether at least one identical fingerprint feature exists between adjacent sensor images. The method for determining identical fingerprint features can be to first sequentially identify fingerprint features in adjacent sensor images and then compare each fingerprint feature to determine if an identical fingerprint feature exists; alternatively, it can be to directly determine whether there are common parts in adjacent sensor images, and then determine whether there are fingerprint features within those common parts that can constitute a recognition effect. In practical applications, the method for determining whether identical fingerprint features exist between adjacent sensor images can be determined according to requirements, and there are no restrictions on this.

[0060] If, based on the above judgment, it is determined that there is at least one identical fingerprint feature between adjacent sensor images, then the first position information of the at least one identical fingerprint feature in the adjacent sensor images can be determined. The first position information represents the position of the fingerprint feature in each of the two adjacent sensor images, and the change in the fingerprint feature can be determined based on the change in the first position information.

[0061] The above implementation process will be illustrated using a specific example. For example... Figure 4 As shown, these are three adjacent fingerprint images. By comparing the first and second fingerprint images and comparing their fingerprint features, it can be determined that the fingerprint has slid down. By comparing the second and third fingerprint images and comparing their fingerprint features, it can be determined that the fingerprint has slid up. Figure 5 This diagram illustrates the placement of identical fingerprint features in the same position, allowing for a clearer assessment of positional changes between fingerprint images. Combining these three fingerprint images, it can be determined that the fingerprint feature change occurred first with a downward swipe followed by an upward swipe.

[0062] If, based on the aforementioned judgment, there are no identical fingerprint features between any two adjacent sensor images, for example, when a user moves their finger quickly, the previous sensor image corresponds to the upper part of the finger, and the next sensor image corresponds to the lower part of the finger, making it impossible to determine the fingerprint movement corresponding to these two sensor images by directly comparing adjacent sensor images.

[0063] In this case, the fingerprint features in the two sensor images can be compared with the preset overall fingerprint image in turn to determine the second position information of the fingerprint features in the two sensor images in the preset overall fingerprint image.

[0064] The preset overall fingerprint image can be a pre-recorded sensor image containing a complete fingerprint. For example, it can be a complete fingerprint image of the user's dominant finger, or it can be a fingerprint image containing multiple fingers. During comparison, the fingerprint features in the sensor image are compared with the fingerprint images of each of these fingers. The second location information is used to indicate the position of the fingerprint features in the preset overall fingerprint image. By analyzing the positions of fingerprint features in adjacent sensor images within the preset overall fingerprint image, and combining this with the positions of the fingerprint features in their respective adjacent sensor images, the displacement between images can be determined, and the final changes in fingerprint features can be determined.

[0065] To illustrate this, let's use a concrete example, such as... Figure 6 As shown, this is a schematic diagram of the preset overall fingerprint image. The first sensor image collected corresponds to region 1 in the figure, and the second sensor image collected corresponds to region 2 in the figure. By determining the second position information corresponding to these two sensor images, it can be determined that the displacement between the images is from left to right, and the corresponding operation of the user's finger should be a left swipe operation.

[0066] By comparing the features with a preset overall fingerprint image, it is possible to identify changes in fingerprint features when it is impossible to judge based on similar parts between adjacent sensor images.

[0067] In some implementations, instead of determining whether adjacent sensor images share the same fingerprint features, the aforementioned operation of judging whether they are adjacent can directly compare the fingerprint features in the sensor images sequentially with a preset overall fingerprint image, and determine the third position information of each fingerprint feature within the preset overall fingerprint image. Then, combining the third position information and timing information, the changes in fingerprint features between sensor images are determined, and the operation parameters are determined based on these changes. The specific implementation process can be referred to the description in the above implementations, and will not be repeated here.

[0068] The above process primarily addresses the case where the sensor image contains fingerprint features. However, in practical applications, some sensor images may contain fingerprint features while others do not. For ease of explanation, these two types of sensor images will be referred to as fingerprint images and non-fingerprint images, respectively. Based on the aforementioned description, non-fingerprint images may be generated due to the characteristics of the acquisition process or specific operations. For example, when a user performs a double-click operation, the finger may be lifted, resulting in a non-fingerprint image between the two clicks. Correspondingly, the specific operation performed by the user can be deduced from these non-fingerprint images.

[0069] Therefore, in some implementations, it can be first identified whether non-fingerprint images are included in the multi-frame sensor images. If so, the operation parameters are determined by combining the temporal information of the fingerprint and non-fingerprint images. Specifically, the sensor images can be arranged chronologically based on the temporal information, and then the distribution intervals of different fingerprint and non-fingerprint images can be determined. Within each distribution interval, there are consecutive fingerprint or non-fingerprint images. The number of clicks can be determined based on the number of fingerprint image distribution intervals. For example, such as... Figure 7 As shown, at time t5, the finger is attached to the surface of the fingerprint scanning chip; at time t6, the finger is moved away from the fingerprint scanning chip; and at time t7, the finger is back attached to the fingerprint scanning chip. The sensor images acquired at these three times differ, and this difference can be used to further determine the user's double-tap operation.

[0070] To illustrate with an example, suppose 100 frames of sensor images are captured, where frames 1-30 are fingerprint images, frames 31-45 are non-fingerprint images, frames 45-85 are fingerprint images, and frames 86-100 are non-fingerprint images. The fingerprint images have two distribution intervals. During the time period of sensor image acquisition, the user's finger makes contact with the detection area for two relatively short periods. Therefore, the corresponding operation parameter can be determined to be two touches, that is, a double-touch operation is performed.

[0071] Preferably, to clearly identify a user's operation as touching the detection area, the size of the fingerprint image interval and the size of the non-fingerprint image interval corresponding to the touch operation can be preset. The interval size can be used to limit the number of frames in the interval. For example, if the distribution interval corresponding to the fingerprint image contains too few images, it may be a mis-touch rather than an intentional touch by the user; if the distribution interval corresponding to the fingerprint image contains too many images, the user may have performed a long press operation. Correspondingly, if the distribution interval of the non-fingerprint image contains too few images, the chip may not have effectively captured the image or the user may have misoperated; if the distribution interval of the non-fingerprint image contains too many images, the user may not have touched the chip surface for a long time, possibly performing two independent operations. In practical applications, the size of the fingerprint image interval and the size of the non-fingerprint image interval corresponding to the touch operation can be set according to specific circumstances, which will not be elaborated here.

[0072] By limiting the size of the interval, effective filtering of touch operations is ensured, thus guaranteeing the accuracy of determining the operation parameters.

[0073] Preferably, when determining a touch operation, the fingerprint features in the fingerprint image can be further analyzed. Generally, when a touch operation is performed, the user's finger does not move significantly, meaning the fingerprint image within a single touch operation shows little difference. Therefore, the changes in fingerprint features within a certain range can be analyzed. If the changes are within a controllable range, it can be determined that these fingerprint images correspond to the user's touch operation.

[0074] Similarly, further analysis of fingerprint features ensured the accuracy of the identified touch operations.

[0075] While identifying the touch operation, the number of touches corresponding to the multiple frames of sensor images collected can be counted. The number of touches can be determined based on the fingerprint image range that can effectively reflect the touch operation. For example, if there are two fingerprint image ranges, the number of touches is 2, and the user performed a double-click operation; if there are three fingerprint image ranges, the number of touches is 3, and the user performed a triple-click operation.

[0076] If, based on the aforementioned judgment, it is determined that all acquired multi-frame sensor images are fingerprint images, i.e., they do not contain non-fingerprint images, then the final operation parameters can be directly determined by combining these sensor images. The specific method for determining the operation parameters can be referred to the aforementioned description and will not be repeated here. The operation parameters determined in this way include translation parameters, rotation parameters, or long-press duration.

[0077] Translation parameters can be parameters generated by a user's finger sliding on the chip surface in a certain direction. Specifically, translation parameters can include the translation direction and translation distance.

[0078] Rotation parameters can be the operational parameters corresponding to the user's finger rotating on the chip surface. Specifically, rotation parameters can include the rotation direction and rotation angle.

[0079] The long press duration can be considered the operation parameter corresponding to a user's finger pressing on the chip surface for an extended period. If it is determined that the fingerprint features in a continuous portion of the fingerprint image do not undergo any displacement transformation, and the duration corresponding to this portion of the fingerprint image exceeds the long press judgment threshold, then the corresponding operation can be determined as a long press operation, and the corresponding operation parameter is the long press duration. The long press duration can also be determined by combining the acquisition interval between adjacent fingerprint images.

[0080] In practical applications, other operation parameters can be determined according to needs and other types of user operations, and are not limited to the above examples, which will not be elaborated here.

[0081] In some implementations, the sensing image may contain non-fingerprint images, but the fingerprint images within the fingerprint image regions formed based on the non-fingerprint images each correspond to specific operational parameters. For example, there may be three fingerprint image regions, corresponding to a swipe down, a rotation, and a touch operation, respectively. In this case, the user's actions may not be simple multiple touches, but rather a combination of different operations. The operational parameters corresponding to different fingerprint image regions can be determined separately and applied to subsequent analysis.

[0082] Specifically, at least two fingerprint image intervals can first be determined based on the timing information of fingerprint and non-fingerprint images. A fingerprint image interval can consist of multiple temporally consecutive fingerprint images. Next, the operation parameters corresponding to the fingerprint images in different fingerprint image intervals are determined, and the execution order of these operation parameters is determined by combining the timing information between the fingerprint image intervals. This allows for the integration of these operation parameters in subsequent steps to determine the control method for the terminal device.

[0083] In some cases, the sensor image acquisition operation may be performed due to accidental contact by other conductive objects or device malfunction, resulting in sensor images that do not contain fingerprint features. If none of the sensor images contain fingerprint features, the acquired sensor images can be ignored without further processing.

[0084] S130: Adjust the device status according to the operating parameters.

[0085] After determining the operating parameters corresponding to the sensor image, the device state can be adjusted and controlled according to these parameters. Specifically, the device control content corresponding to the operating parameters can be preset, and then the device state can be adjusted based on the operating parameters. In actual operation, corresponding operation commands can be generated based on the operating parameters and then sent to the corresponding execution module for execution, or the device state can be directly adjusted based on the operating parameters.

[0086] In some implementations, when the operation parameter is the number of touches, the operation of selecting an application or selecting a portion of the display interface can be achieved based on the number of touches.

[0087] Specifically, the terminal device interface can include a selection cursor, whose position can correspond to a specific application or a specific area. By inputting a certain number of touches, the user can select the application or a specific area. For example, when the cursor is on application A, a double-tap (two touches) selects and opens the application; when the cursor is on the upper left area, a triple-tap (three touches) selects or zooms in on the upper left area. In practical applications, corresponding operations can also be performed directly based on the number of touches, such as quickly locking the screen or shutting down the device after a certain number of touches. The specific operations can be adjusted according to the actual application and are not limited in this respect.

[0088] In some implementations, if the determined operation parameter is a translation parameter, operations such as switching interfaces, switching selected applications, or adjusting volume / brightness can be performed based on the translation parameter. For example, when no application is currently selected, a left or right swipe can switch the currently displayed interface; when an application has already been selected by the cursor or other means, the translation parameter can be used to switch the selected application, such as selecting an application above, below, to the left, to the right, or diagonally. Other operations can be performed to open the selected application, such as opening it by double-clicking. In specific interfaces, the translation parameter can also be used to adjust volume / brightness. For example, when playing music, videos, or other media files, swiping up increases the volume, and swiping down decreases the volume; when displaying images or playing videos, swiping left decreases the brightness, and swiping right increases the brightness.

[0089] If the determined operation parameter is a rotation parameter, it can also be used to switch interfaces or change the display effect. For example, when in a specific interface, rotation can be used to return to the main interface or navigate to a specific sub-interface. Within a specific display interface, rotation parameters can also change the display effect, such as rotating an image or video left or right. In practical applications, the specific correspondence between translation or rotation parameters and operation steps can be determined according to requirements, and is not limited to the examples above, which will not be elaborated further here.

[0090] In some implementations, if the determined operation parameter is the long press duration, the operation of selecting an application or a portion of the display interface can be performed based on the long press duration. For example, when a cursor is present on the application, a long press, after reaching a certain duration, can select or open the application. When no application is selected, a long press, after reaching a certain duration, can select or zoom in on that portion of the application. In practical applications, other operations corresponding to the long press duration can be set according to the long press duration and the current application scenario, and are not limited to the above examples, which will not be elaborated here.

[0091] In some implementations, multiple operational parameters may be combined to determine the corresponding control logic / control command. For example, according to the implementation in step S120, at least two fingerprint image intervals are determined, and each of these two fingerprint image intervals corresponds to its own operational parameters. The corresponding control logic / control command can be determined by combining these operational parameters based on the timing of the fingerprint image intervals. Specifically, a correspondence between multiple consecutive operational parameters and control logic can be set. For example, swiping up and then long-pressing corresponds to opening a specific application. In practical applications, the correspondence between operational parameters and control logic / control command can be set according to requirements, which will not be elaborated here.

[0092] Furthermore, it should be noted that the device on which the fingerprint scanning chip is installed can be the same as or a different device from the device that needs to be controlled. For example, when the fingerprint scanning chip is installed in a smartphone, the user performs corresponding operations based on the fingerprint scanning chip. The MCU in the smartphone or chip module analyzes the operation and determines the specific adjustment method, directly adjusting the state of the smartphone, such as directly opening a specific application on the smartphone.

[0093] When the device with the fingerprint scanning chip is different from the device to be controlled, the input and output devices can be separated, and information can be transmitted between the two devices. For example, the fingerprint scanning chip can be placed on a remote control or gamepad. When a user slides the fingerprint scanning chip up on the remote control, the remote control sends a control signal to the TV, which can increase the TV volume. When a user slides the fingerprint scanning chip in a specific direction on the gamepad, they can control the movement of a game character on a game console or computer in that specific direction.

[0094] The specific control modes and implementation processes between the fingerprint scanning chip-based device and the device to be controlled can be adjusted based on the actual application requirements and are not limited to the above examples, so they will not be elaborated here.

[0095] Based on the above embodiments and scenario examples, it can be seen that the method acquires corresponding multi-frame sensor images, analyzes the fingerprint features in the sensor images, determines the changes in fingerprint features by combining time-series information, and then derives the operation parameters corresponding to the changes in fingerprint features. The device state is then adjusted according to these operation parameters. Through this process, users can perform specific operations on the surface of the fingerprint scanning chip, which expands the ways users can operate and facilitates operation in specific application scenarios, thereby expanding the application of fingerprint scanning chips and improving the user experience.

[0096] Regarding the aforementioned fingerprint-based device control method, the executing entity of the device control method can be further distinguished, along with the differences arising from the execution of the device control method under different executing entities. The executing entity of the fingerprint scanning chip-based device control method can be a terminal device. That is, after receiving the sensing image from the fingerprint scanning chip, the terminal device directly processes the sensing image through its own processor to obtain the corresponding processing result, and then adjusts its own state based on the processing result. The executing entity of the fingerprint-based device control method can also be a fingerprint detection module. The fingerprint detection module includes a fingerprint scanning chip and an MCU (microprocessor). After the fingerprint scanning chip acquires the sensing image, the MCU directly processes the sensing image based on the corresponding processing logic to obtain the processing result, such as a corresponding control command. After the fingerprint detection module sends the processing result to the terminal device, the terminal device directly adjusts its own state based on the processing result. The following description further illustrates the fingerprint-based device control method under different circumstances by distinguishing the executing entity.

[0097] like Figure 8The diagram shows a flowchart of a fingerprint-based device control method when the executing entity is a terminal device. The fingerprint-based device control method may include the following specific implementation steps.

[0098] S810: Acquire multiple frames of sensor images; the multiple frames of sensor images correspond to time sequence information.

[0099] In this embodiment, the execution entity is the terminal device, which is independent of the fingerprint detection module. The fingerprint detection module can be an independent module on the terminal device or a module located on another device. After acquiring the sensing image through the fingerprint scanning chip, the fingerprint detection module can send the sensing image to the terminal device, which then processes the sensing image and performs corresponding operations based on the processing results.

[0100] The specific method of acquiring the sensor image can correspond to the type of fingerprint scanning chip. For example, when the fingerprint scanning chip is a capacitive fingerprint chip, the chip generates corresponding electrical signals based on the distance between different positions on the sensing area and the conductive object. After processing the electrical signals, the surface undulation state of the object on the sensing area can be determined, thereby generating a corresponding sensor image that reflects features such as fingerprints. When the fingerprint scanning chip is an optical fingerprint chip, different positions on the sensing area can emit corresponding light, and the light reflected by the object being detected can be acquired. Based on the parameters of the received reflected light, the features of the object at the corresponding position can be determined, and the sensor image corresponding to the sensing area can be generated by combining the parameter information from different positions.

[0101] In practical applications, the specific method of acquiring sensor images can be set according to the parameters and working mode of the fingerprint scanning chip, and is not limited to the above examples, so it will not be elaborated here.

[0102] When the sensing image is acquired based on a fingerprint scanning chip, the sensing image may or may not contain fingerprint features. For example, when a user places their finger on the sensing area of ​​the fingerprint scanning chip, the acquired sensing image generally contains the corresponding fingerprint features. However, when the fingerprint scanning chip acquires a sensing image due to other conditions, such as when the finger is not placed on the sensing area, or when the user removes their finger from the sensing area during the acquisition process, the acquired sensing image may not contain fingerprint features.

[0103] In the embodiments of this specification, in order to control the device based on the sensor images in subsequent steps, it is necessary to acquire multiple frames of sensor images, and each frame of sensor image corresponds to a specific timing information.

[0104] Multi-frame sensor images can be continuously acquired or acquired by re-acquiring multiple frames at intervals. When sensor images are acquired at intervals, it is preferable that the interval between adjacent frames is equal to facilitate the determination of the specific operation corresponding to the sensor image in subsequent steps.

[0105] Timing information is used to indicate the order in which each sensor image was acquired. This can be the acquisition time of each sensor image or other identifiers related to the acquisition order. After sorting the sensor images based on the timing information, changes in objects on the surface of the sensing area can be reflected based on the sorted sensor images.

[0106] In practical applications, the size of the sensor image depends on the area of ​​the fingerprint scanning chip. In typical fingerprint recognition scenarios based on authentication, it is often necessary to ensure the area of ​​the fingerprint scanning chip is large enough to capture a complete fingerprint image, or an image containing a sufficient number of fingerprint features. In the embodiments of this specification, the chip for acquiring the sensor image can be set to a larger area mode to capture a more complete fingerprint image, or it can be set to a smaller area mode, as long as it can capture a certain number of fingerprint features. For example, the size of the sensor image may include three fingerprint features. In practical applications, the size of the fingerprint scanning chip can be adjusted according to requirements, and there is no limitation on this.

[0107] In practical applications, fingerprint scanning chips can contain fingerprint sensing arrays composed of multiple rows and columns of fingerprint sensing elements. Different fingerprint sensing elements acquire corresponding sensing information, and by combining the sensing information from different locations, a sensing image corresponding to the detection area can be generated.

[0108] In the embodiments of this specification, since the main function of the sensing image is not to perform identity verification based on fingerprint recognition, the method of acquiring the sensing image can also be adjusted. That is, when acquiring the sensing image, it is not necessary to activate all fingerprint sensing elements in the fingerprint sensing array, but only to use some fingerprint sensing elements in the fingerprint sensing array to generate the sensing image.

[0109] Specifically, it can be to select fingerprint sensor elements in a specific row to generate a sensor image, such as activating fingerprint sensor elements in a row-by-row manner, or selecting multiple rows of fingerprint sensor elements in the middle section to generate a sensor image, for example... Figure 2As shown, assuming the chip's recognition area is 32×1160 pixels, interlaced scanning of the central portion results in a true scanning area of ​​32×140 pixels. This significantly speeds up the fingerprint chip's scanning process. Alternatively, specific columns of fingerprint sensors can be selected to generate a sensor image. For example, activating fingerprint sensors in every other column, or selecting multiple columns of fingerprint sensors in the central portion. A specific area of ​​fingerprint sensors can also be selected, such as selecting only the fingerprint sensors within the central circular area to generate a sensor image. In practical applications, the positions of the selected fingerprint sensors can be adjusted according to requirements, and are not limited to the examples above; further details will not be elaborated upon here.

[0110] By selecting a portion of the fingerprint sensing elements to generate sensing images, not only is the effectiveness of the sensing images used to perform subsequent steps guaranteed, but the scanning speed can also be accelerated, thereby shortening the time to acquire sensing images and ensuring the continuity between the acquired multiple frames of sensing images.

[0111] When sending the sensor image to the terminal device, the fingerprint detection module can perform certain processing on the image. For example, it can append time-series information to the image or process it into a format that is easier for the terminal device to parse. The specific processing method can be configured based on the actual application requirements, and will not be elaborated here.

[0112] The specific method for sending sensor images can be determined based on the communication method between the fingerprint detection module and the terminal device in actual application, and will not be elaborated here.

[0113] S820: Determine the operation parameters corresponding to the multi-frame sensing images based on the timing information; wherein, the operation parameters include: combining the fingerprint features in the multi-frame sensing images and the timing information to obtain the fingerprint feature changes; and determining the operation parameters based on the fingerprint feature changes.

[0114] After acquiring multiple frames of sensor images, the arrangement order of the sensor images is determined by combining the timing information of the sensor images, and then the corresponding operation parameters can be determined based on the sensor images. When a user performs a corresponding operation on the surface of the fingerprint scanning chip, such as sliding or double-clicking on the surface of the fingerprint scanning chip, the user's action reflected in these sensor images can be determined by comparing the differences between the sensor images. For example, if the timing information determines that the fingerprint features in the sensor image are gradually moving downwards in the image, it can be determined that the user has performed a sliding operation.

[0115] The terminal device pre-stores corresponding operation parameters, which can then be determined by observing changes in the sensed images. These operation parameters may include, for example, translation, rotation, long press, and tap. Translation can include swiping up, down, left, right, and other directional movements. In practical applications, other types of operation parameters can be set as needed, and are not limited to the examples above; they will not be elaborated upon here.

[0116] Since sensor images reflect the features of the current sensing area, and it's necessary to determine changes in these images, it's crucial to locate the changes between different images. Therefore, fingerprint features within the sensor images can be used to determine specific operational parameters. By combining the temporal information of multiple sensor images, identifying the fingerprint features within these images, and determining the changes in these fingerprint features, specific operational parameters can be determined. For example, if the fingerprint features in adjacent sensor images have shifted around their center, it can be determined that the user has rotated their finger within the sensing area.

[0117] Specifically, in order to achieve the above steps of determining the operation parameters based on changes in fingerprint features, it is possible to first determine whether each sensor image contains fingerprint features. If fingerprint features are present, then the fingerprint features can be identified.

[0118] In practical applications, due to the characteristics of the acquisition process and specific actions, the acquired sensor images may not all contain fingerprint features. For example, when the user removes their finger from the detection area after finishing the operation, the fingerprint scanning chip may still acquire sensor images for a period of time, so that the sensor images acquired during this period do not contain fingerprint features. It is known that when the user performs a double-click operation, they must remove their finger from the detection area, so that the sensor images acquired during this period do not contain fingerprint features.

[0119] Once the sensor images containing fingerprint features are identified, these features can be extracted. Fingerprint features can include the typical line arrangement and intersection characteristics of a fingerprint. Generally, fingerprint features can be the fingerprint-specific image appearance of a specific area within an image, or features corresponding to the fingerprint as a whole within the image. The specific method for identifying fingerprint features depends on the definition and identification method used in the actual application, and will not be elaborated upon here.

[0120] In some implementations, after identifying fingerprint features in each sensor image, it can be determined sequentially based on time-series information whether at least one identical fingerprint feature exists between adjacent sensor images. The method for determining identical fingerprint features can be to first sequentially identify fingerprint features in adjacent sensor images and then compare each fingerprint feature to determine if an identical fingerprint feature exists; alternatively, it can be to directly determine whether there are common parts in adjacent sensor images, and then determine whether there are fingerprint features within those common parts that can constitute a recognition effect. In practical applications, the method for determining whether identical fingerprint features exist between adjacent sensor images can be determined according to requirements, and there are no restrictions on this.

[0121] If, based on the above judgment, it is determined that there is at least one identical fingerprint feature between adjacent sensor images, then the first position information of the at least one identical fingerprint feature in the adjacent sensor images can be determined. The first position information represents the position of the fingerprint feature in each of the two adjacent sensor images, and the change in the fingerprint feature can be determined based on the change in the first position information.

[0122] The above implementation process will be illustrated using a specific example. For example... Figure 4 As shown, these are three adjacent fingerprint images. By comparing the first and second fingerprint images and comparing their fingerprint features, it can be determined that the fingerprint has slid down. By comparing the second and third fingerprint images and comparing their fingerprint features, it can be determined that the fingerprint has slid up. Figure 5 This diagram illustrates the placement of identical fingerprint features in the same position, allowing for a clearer assessment of positional changes between fingerprint images. Combining these three fingerprint images, it can be determined that the fingerprint feature change occurred first with a downward swipe followed by an upward swipe.

[0123] If, based on the aforementioned judgment, there are no identical fingerprint features between any two adjacent sensor images, for example, when a user moves their finger quickly, the previous sensor image corresponds to the upper part of the finger, and the next sensor image corresponds to the lower part of the finger, making it impossible to determine the fingerprint movement corresponding to these two sensor images by directly comparing adjacent sensor images.

[0124] In this case, the fingerprint features in the two sensor images can be compared with the preset overall fingerprint image in turn to determine the second position information of the fingerprint features in the two sensor images in the preset overall fingerprint image.

[0125] The preset overall fingerprint image can be a pre-recorded sensor image containing a complete fingerprint. For example, it can be a complete fingerprint image of the user's dominant finger, or it can be a fingerprint image containing multiple fingers. During comparison, the fingerprint features in the sensor image are compared with the fingerprint images of each of these fingers. The second location information is used to indicate the position of the fingerprint features in the preset overall fingerprint image. By analyzing the positions of fingerprint features in adjacent sensor images within the preset overall fingerprint image, and combining this with the positions of the fingerprint features in their respective adjacent sensor images, the displacement between images can be determined, and the final changes in fingerprint features can be determined.

[0126] To illustrate this, let's use a concrete example, such as... Figure 6 As shown, this is a schematic diagram of the preset overall fingerprint image. The first sensor image collected corresponds to region 1 in the figure, and the second sensor image collected corresponds to region 2 in the figure. By determining the second position information corresponding to these two sensor images, it can be determined that the displacement between the images is from left to right, and the corresponding operation of the user's finger should be a left swipe operation.

[0127] By comparing the features with a preset overall fingerprint image, it is possible to identify changes in fingerprint features when it is impossible to judge based on similar parts between adjacent sensor images.

[0128] In some implementations, instead of determining whether adjacent sensor images share the same fingerprint features, the aforementioned operation of judging whether they are adjacent can directly compare the fingerprint features in the sensor images sequentially with a preset overall fingerprint image, and determine the third position information of each fingerprint feature within the preset overall fingerprint image. Then, combining the third position information and timing information, the changes in fingerprint features between sensor images are determined, and the operation parameters are determined based on these changes. The specific implementation process can be referred to the description in the above implementations, and will not be repeated here.

[0129] The above process primarily addresses the case where the sensor image contains fingerprint features. However, in practical applications, some sensor images may contain fingerprint features while others do not. For ease of explanation, these two types of sensor images will be referred to as fingerprint images and non-fingerprint images, respectively. Based on the aforementioned description, non-fingerprint images may be generated due to the characteristics of the acquisition process or specific operations. For example, when a user performs a double-click operation, the finger may be lifted, resulting in a non-fingerprint image between the two clicks. Correspondingly, the specific operation performed by the user can be deduced from these non-fingerprint images.

[0130] Therefore, in some implementations, it can be first identified whether non-fingerprint images are included in the multi-frame sensor images. If so, the operation parameters are determined by combining the temporal information of the fingerprint and non-fingerprint images. Specifically, the sensor images can be arranged chronologically based on the temporal information, and then the distribution intervals of different fingerprint and non-fingerprint images can be determined. Within each distribution interval, there are consecutive fingerprint or non-fingerprint images. The number of clicks can be determined based on the number of fingerprint image distribution intervals. For example, such as... Figure 7 As shown, at time t5, the finger is attached to the surface of the fingerprint scanning chip; at time t6, the finger is moved away from the fingerprint scanning chip; and at time t7, the finger is back attached to the fingerprint scanning chip. The sensor images acquired at these three times differ, and this difference can be used to further determine the user's double-tap operation.

[0131] To illustrate with an example, suppose 100 frames of sensor images are captured, where frames 1-30 are fingerprint images, frames 31-45 are non-fingerprint images, frames 45-85 are fingerprint images, and frames 86-100 are non-fingerprint images. The fingerprint images have two distribution intervals. During the time period of sensor image acquisition, the user's finger makes contact with the detection area for two relatively short periods. Therefore, the corresponding operation parameter can be determined to be two touches, that is, a double-touch operation is performed.

[0132] Preferably, to clearly identify a user's operation as touching the detection area, the size of the fingerprint image interval and the size of the non-fingerprint image interval corresponding to the touch operation can be preset. The interval size can be used to limit the number of frames in the interval. For example, if the distribution interval corresponding to the fingerprint image contains too few images, it may be a mis-touch rather than an intentional touch by the user; if the distribution interval corresponding to the fingerprint image contains too many images, the user may have performed a long press operation. Correspondingly, if the distribution interval of the non-fingerprint image contains too few images, the chip may not have effectively captured the image or the user may have misoperated; if the distribution interval of the non-fingerprint image contains too many images, the user may not have touched the chip surface for a long time, possibly performing two independent operations. In practical applications, the size of the fingerprint image interval and the size of the non-fingerprint image interval corresponding to the touch operation can be set according to specific circumstances, which will not be elaborated here.

[0133] By limiting the size of the interval, effective filtering of touch operations is ensured, thus guaranteeing the accuracy of determining the operation parameters.

[0134] Preferably, when determining a touch operation, the fingerprint features in the fingerprint image can be further analyzed. Generally, when a touch operation is performed, the user's finger does not move significantly, meaning the fingerprint image within a single touch operation shows little difference. Therefore, the changes in fingerprint features within a certain range can be analyzed. If the changes are within a controllable range, it can be determined that these fingerprint images correspond to the user's touch operation.

[0135] Similarly, further analysis of fingerprint features ensured the accuracy of the identified touch operations.

[0136] While identifying the touch operation, the number of touches corresponding to the multiple frames of sensor images collected can be counted. The number of touches can be determined based on the fingerprint image range that can effectively reflect the touch operation. For example, if there are two fingerprint image ranges, the number of touches is 2, and the user performed a double-click operation; if there are three fingerprint image ranges, the number of touches is 3, and the user performed a triple-click operation.

[0137] If, based on the aforementioned judgment, it is determined that all acquired multi-frame sensor images are fingerprint images, i.e., they do not contain non-fingerprint images, then the final operation parameters can be directly determined by combining these sensor images. The specific method for determining the operation parameters can be referred to the aforementioned description and will not be repeated here. The operation parameters determined in this way include translation parameters, rotation parameters, or long-press duration.

[0138] Translation parameters can be parameters generated by a user's finger sliding on the chip surface in a certain direction. Specifically, translation parameters can include the translation direction and translation distance.

[0139] Rotation parameters can be the operational parameters corresponding to the user's finger rotating on the chip surface. Specifically, rotation parameters can include the rotation direction and rotation angle.

[0140] The long press duration can be considered the operation parameter corresponding to a user's finger pressing on the chip surface for an extended period. If it is determined that the fingerprint features in a continuous portion of the fingerprint image do not undergo any displacement transformation, and the duration corresponding to this portion of the fingerprint image exceeds the long press judgment threshold, then the corresponding operation can be determined as a long press operation, and the corresponding operation parameter is the long press duration. The long press duration can also be determined by combining the acquisition interval between adjacent fingerprint images.

[0141] In practical applications, other operation parameters can be determined according to needs and other types of user operations, and are not limited to the above examples, which will not be elaborated here.

[0142] In some implementations, the sensing image may contain non-fingerprint images, but the fingerprint images within the fingerprint image regions formed based on the non-fingerprint images each correspond to specific operational parameters. For example, there may be three fingerprint image regions, corresponding to a swipe down, a rotation, and a touch operation, respectively. In this case, the user's actions may not be simple multiple touches, but rather a combination of different operations. The operational parameters corresponding to different fingerprint image regions can be determined separately and applied to subsequent analysis.

[0143] Specifically, at least two fingerprint image intervals can first be determined based on the timing information of fingerprint and non-fingerprint images. A fingerprint image interval can consist of multiple temporally consecutive fingerprint images. Next, the operation parameters corresponding to the fingerprint images in different fingerprint image intervals are determined, and the execution order of these operation parameters is determined by combining the timing information between the fingerprint image intervals. This allows for the integration of these operation parameters in subsequent steps to determine the control method for the terminal device.

[0144] In some cases, the sensor image acquisition operation may be performed due to accidental contact by other conductive objects or device malfunction, resulting in sensor images that do not contain fingerprint features. If none of the sensor images contain fingerprint features, the acquired sensor images can be ignored without further processing.

[0145] S830: Determine the control logic corresponding to the operating parameters.

[0146] Since the terminal device needs to adjust its own state directly based on the sensor images, the sensor device can directly determine the corresponding control logic based on the operating parameters. The control logic can be logic directly executed by the sensor device's processor, or logic sent by the processor to the corresponding processing module of the terminal device and then executed by the processing module.

[0147] In some implementations, when the operation parameter is the number of touches, control logic for selecting an application or a portion of the display interface can be generated based on the number of touches.

[0148] Specifically, the terminal device interface can include a selection cursor, whose position can correspond to a specific application or a specific area. By inputting a certain number of touches, the user can select the application or a specific area. For example, when the cursor is on application A, a double-tap (two touches) selects and opens the application; when the cursor is on the upper left area, a triple-tap (three touches) selects or zooms in on the upper left area. In practical applications, corresponding operations can also be performed directly based on the number of touches, such as quickly locking the screen or shutting down the device after a certain number of touches. The specific operations can be adjusted according to the actual application and are not limited in this respect.

[0149] In some implementations, if the determined operation parameter is a translation parameter, control logic for switching interfaces, switching selected applications, or adjusting volume / brightness can be generated based on the translation parameter. For example, when no application is currently selected, a left or right swipe can switch the currently displayed interface; when an application has already been selected by the cursor or other means, the selected application can be switched based on the translation parameter, such as selecting an application above, below, to the left, to the right, or diagonally. Other operations can be performed to open the selected application, such as opening it via a double-click. In specific interfaces, the volume / brightness can also be adjusted by executing the translation parameter. For example, when playing music, videos, or other media files, swiping up increases the playback volume, and swiping down decreases it; when displaying images or playing videos, swiping left decreases the brightness, and swiping right increases it.

[0150] If the determined operation parameter is a rotation parameter, control logic for switching interfaces or changing the interface display effect can also be generated. For example, when in a specific interface, rotation can be used to return to the main interface or navigate to a specific sub-interface. Within a specific display interface, rotation parameters can also change the display effect, such as rotating an image or video left or right. In practical applications, the specific correspondence between translation or rotation parameters and operation steps can be determined according to requirements, and is not limited to the above examples, which will not be elaborated further here.

[0151] In some implementations, if the determined operation parameter is the long press duration, control logic for selecting an application or a portion of the display interface can be generated based on the long press duration. For example, when a cursor is present on the application, a long press, with a duration exceeding a certain value, can select or open the application. When no application is selected, a long press, with a duration exceeding a certain value, can select or enlarge that portion of the application. In practical applications, other operations corresponding to the long press duration can be set based on the duration and the current application scenario, and are not limited to the examples above, which will not be elaborated upon here.

[0152] In some implementations, multiple operational parameters may be combined to determine the corresponding control logic. For example, according to the implementation in step S120, at least two fingerprint image intervals are determined, and each of these two fingerprint image intervals corresponds to its own operational parameters. The corresponding control logic / control command can be determined by combining these operational parameters based on the timing of the fingerprint image intervals. Specifically, a correspondence between multiple consecutive operational parameters and control logic can be set. For example, swiping up and then long-pressing corresponds to opening a specific application. In practical applications, the correspondence between operational parameters and control logic / control command can be set according to requirements, which will not be elaborated here.

[0153] S840: Adjust the device's own state based on the control logic.

[0154] After generating the corresponding control logic, the device's own state can be adjusted according to the control logic. The specific control method can be set by combining the example in step S830 and the specific execution status of the device, and will not be elaborated here.

[0155] Based on the above embodiments, the terminal device itself processes the sensed images and completes the device control process, which can be effectively applied in practical applications and fits the actual application scenarios, thus improving the user experience.

[0156] like Figure 9 The diagram shows a flowchart of a fingerprint-based device control method when the executing entity is a fingerprint detection module. The fingerprint-based device control method may include the following specific implementation steps.

[0157] S910: Acquire multiple frames of sensor images; the multiple frames of sensor images correspond to time sequence information.

[0158] Since the execution entity in this embodiment is the fingerprint detection module, and the sensing image is acquired by the fingerprint scanning chip within the fingerprint detection module, the sensing image can be directly obtained based on the internal communication method within the fingerprint detection module. For example, when the fingerprint detection module integrates an MCU or SOC chip, the fingerprint scanning chip can directly send the sensing image to the MCU or SOC chip.

[0159] The specific method of acquiring the sensor image can correspond to the type of fingerprint scanning chip. For example, when the fingerprint scanning chip is a capacitive fingerprint chip, the chip generates corresponding electrical signals based on the distance between different positions on the sensing area and the conductive object. After processing the electrical signals, the surface undulation state of the object on the sensing area can be determined, thereby generating a corresponding sensor image that reflects features such as fingerprints. When the fingerprint scanning chip is an optical fingerprint chip, different positions on the sensing area can emit corresponding light, and the light reflected by the object being detected can be acquired. Based on the parameters of the received reflected light, the features of the object at the corresponding position can be determined, and the sensor image corresponding to the sensing area can be generated by combining the parameter information from different positions.

[0160] In practical applications, the specific method of acquiring sensor images can be set according to the parameters and working mode of the fingerprint scanning chip, and is not limited to the above examples, so it will not be elaborated here.

[0161] When the sensing image is acquired based on a fingerprint scanning chip, the sensing image may or may not contain fingerprint features. For example, when a user places their finger on the sensing area of ​​the fingerprint scanning chip, the acquired sensing image generally contains the corresponding fingerprint features. However, when the fingerprint scanning chip acquires a sensing image due to other conditions, such as when the finger is not placed on the sensing area, or when the user removes their finger from the sensing area during the acquisition process, the acquired sensing image may not contain fingerprint features.

[0162] In the embodiments of this specification, in order to control the device based on the sensor images in subsequent steps, it is necessary to acquire multiple frames of sensor images, and each frame of sensor image corresponds to a specific timing information.

[0163] Multi-frame sensor images can be continuously acquired or acquired by re-acquiring multiple frames at intervals. When sensor images are acquired at intervals, it is preferable that the interval between adjacent frames is equal to facilitate the determination of the specific operation corresponding to the sensor image in subsequent steps.

[0164] Timing information is used to indicate the order in which each sensor image was acquired. This can be the acquisition time of each sensor image or other identifiers related to the acquisition order. After sorting the sensor images based on the timing information, changes in objects on the surface of the sensing area can be reflected based on the sorted sensor images.

[0165] In practical applications, the size of the sensor image depends on the area of ​​the fingerprint scanning chip. In typical fingerprint recognition scenarios based on authentication, it is often necessary to ensure the area of ​​the fingerprint scanning chip is large enough to capture a complete fingerprint image, or an image containing a sufficient number of fingerprint features. In the embodiments of this specification, the chip for acquiring the sensor image can be set to a larger area mode to capture a more complete fingerprint image, or it can be set to a smaller area mode, as long as it can capture a certain number of fingerprint features. For example, the size of the sensor image may include three fingerprint features. In practical applications, the size of the fingerprint scanning chip can be adjusted according to requirements, and there is no limitation on this.

[0166] In practical applications, fingerprint scanning chips can contain fingerprint sensing arrays composed of multiple rows and columns of fingerprint sensing elements. Different fingerprint sensing elements acquire corresponding sensing information, and by combining the sensing information from different locations, a sensing image corresponding to the detection area can be generated.

[0167] In the embodiments of this specification, since the main function of the sensing image is not to perform identity verification based on fingerprint recognition, the method of acquiring the sensing image can also be adjusted. That is, when acquiring the sensing image, it is not necessary to activate all fingerprint sensing elements in the fingerprint sensing array, but only to use some fingerprint sensing elements in the fingerprint sensing array to generate the sensing image.

[0168] Specifically, a sensor image can be generated by selecting fingerprint sensor elements in a specific row, such as activating fingerprint sensor elements in a row with alternating rows, or selecting multiple rows of fingerprint sensor elements in the middle section. Similarly, a sensor image can be generated by selecting fingerprint sensor elements in a specific column, such as activating fingerprint sensor elements in a column with alternating columns, or selecting multiple columns of fingerprint sensor elements in the middle section. Alternatively, a sensor image can be generated by selecting fingerprint sensor elements in a specific area, such as selecting only the fingerprint sensor elements within the central circular area. In practical applications, the position of the selected fingerprint sensor elements can be adjusted according to requirements, and is not limited to the examples above, which will not be elaborated further here.

[0169] By selecting a portion of the fingerprint sensing elements to generate sensing images, not only is the effectiveness of the sensing images used to perform subsequent steps guaranteed, but the scanning speed can also be accelerated, thereby shortening the time to acquire sensing images and ensuring the continuity between the acquired multiple frames of sensing images.

[0170] S920: Determine the operation parameters corresponding to the multi-frame sensing images based on the timing information; wherein, the operation parameters include: combining the fingerprint features in the multi-frame sensing images and the timing information to obtain the fingerprint feature changes; and determining the operation parameters based on the fingerprint feature changes.

[0171] After acquiring multiple frames of sensor images, the arrangement order of the sensor images is determined by combining the timing information of the sensor images, and then the corresponding operation parameters can be determined based on the sensor images. When a user performs a corresponding operation on the surface of the fingerprint scanning chip, such as sliding or double-clicking on the surface of the fingerprint scanning chip, the user's action reflected in these sensor images can be determined by comparing the differences between the sensor images. For example, if the timing information determines that the fingerprint features in the sensor image are gradually moving downwards in the image, it can be determined that the user has performed a sliding operation.

[0172] The fingerprint detection module pre-stores corresponding operation parameters, which can then be determined by observing changes in the sensor images. These operation parameters may include, for example, translation, rotation, long press, and tap. Translation can include swiping up, down, left, right, and other directional movements. In practical applications, other types of operation parameters can be set as needed, and are not limited to the examples above; further details will not be provided here.

[0173] Since sensor images reflect the features of the current sensing area, and it's necessary to determine changes in these images, it's crucial to locate the changes between different images. Therefore, fingerprint features within the sensor images can be used to determine specific operational parameters. By combining the temporal information of multiple sensor images, identifying the fingerprint features within these images, and determining the changes in these fingerprint features, specific operational parameters can be determined. For example, if the fingerprint features in adjacent sensor images have shifted around their center, it can be determined that the user has rotated their finger within the sensing area.

[0174] Specifically, in order to achieve the above steps of determining the operation parameters based on changes in fingerprint features, it is possible to first determine whether each sensor image contains fingerprint features. If fingerprint features are present, then the fingerprint features can be identified.

[0175] In practical applications, due to the characteristics of the acquisition process and specific actions, the acquired sensor images may not all contain fingerprint features. For example, when the user removes their finger from the detection area after finishing the operation, the fingerprint scanning chip may still acquire sensor images for a period of time, so that the sensor images acquired during this period do not contain fingerprint features. It is known that when the user performs a double-click operation, they must remove their finger from the detection area, so that the sensor images acquired during this period do not contain fingerprint features.

[0176] Once the sensor images containing fingerprint features are identified, these features can be extracted. Fingerprint features can include the typical line arrangement and intersection characteristics of a fingerprint. Generally, fingerprint features can be the fingerprint-specific image appearance of a specific area within an image, or features corresponding to the fingerprint as a whole within the image. The specific method for identifying fingerprint features depends on the definition and identification method used in the actual application, and will not be elaborated upon here.

[0177] In some implementations, after identifying fingerprint features in each sensor image, it can be determined sequentially based on time-series information whether at least one identical fingerprint feature exists between adjacent sensor images. The method for determining identical fingerprint features can be to first sequentially identify fingerprint features in adjacent sensor images and then compare each fingerprint feature to determine if an identical fingerprint feature exists; alternatively, it can be to directly determine whether there are common parts in adjacent sensor images, and then determine whether there are fingerprint features within those common parts that can constitute a recognition effect. In practical applications, the method for determining whether identical fingerprint features exist between adjacent sensor images can be determined according to requirements, and there are no restrictions on this.

[0178] If, based on the above judgment, it is determined that there is at least one identical fingerprint feature between adjacent sensor images, then the first position information of the at least one identical fingerprint feature in the adjacent sensor images can be determined. The first position information represents the position of the fingerprint feature in each of the two adjacent sensor images, and the change in the fingerprint feature can be determined based on the change in the first position information.

[0179] The above implementation process will be illustrated using a specific example. For example... Figure 4 As shown, these are three adjacent fingerprint images. By comparing the first and second fingerprint images and comparing their fingerprint features, it can be determined that the fingerprint has slid down. By comparing the second and third fingerprint images and comparing their fingerprint features, it can be determined that the fingerprint has slid up. Figure 5This diagram illustrates the placement of identical fingerprint features in the same position, allowing for a clearer assessment of positional changes between fingerprint images. Combining these three fingerprint images, it can be determined that the fingerprint feature change occurred first with a downward swipe followed by an upward swipe.

[0180] If, based on the aforementioned judgment, there are no identical fingerprint features between any two adjacent sensor images, for example, when a user moves their finger quickly, the previous sensor image corresponds to the upper part of the finger, and the next sensor image corresponds to the lower part of the finger, making it impossible to determine the fingerprint movement corresponding to these two sensor images by directly comparing adjacent sensor images.

[0181] In this case, the fingerprint features in the two sensor images can be compared with the preset overall fingerprint image in turn to determine the second position information of the fingerprint features in the two sensor images in the preset overall fingerprint image.

[0182] The preset overall fingerprint image can be a pre-recorded sensor image containing a complete fingerprint. For example, it can be a complete fingerprint image of the user's dominant finger, or it can be a fingerprint image containing multiple fingers. During comparison, the fingerprint features in the sensor image are compared with the fingerprint images of each of these fingers. The second location information is used to indicate the position of the fingerprint features in the preset overall fingerprint image. By analyzing the positions of fingerprint features in adjacent sensor images within the preset overall fingerprint image, and combining this with the positions of the fingerprint features in their respective adjacent sensor images, the displacement between images can be determined, and the final changes in fingerprint features can be determined.

[0183] To illustrate this, let's use a concrete example, such as... Figure 6 As shown, this is a schematic diagram of the preset overall fingerprint image. The first sensor image collected corresponds to region 1 in the figure, and the second sensor image collected corresponds to region 2 in the figure. By determining the second position information corresponding to these two sensor images, it can be determined that the displacement between the images is from left to right, and the corresponding operation of the user's finger should be a left swipe operation.

[0184] By comparing the features with a preset overall fingerprint image, it is possible to identify changes in fingerprint features when it is impossible to judge based on similar parts between adjacent sensor images.

[0185] In some implementations, instead of determining whether adjacent sensor images share the same fingerprint features, the aforementioned operation of judging whether they are adjacent can directly compare the fingerprint features in the sensor images sequentially with a preset overall fingerprint image, and determine the third position information of each fingerprint feature within the preset overall fingerprint image. Then, combining the third position information and timing information, the changes in fingerprint features between sensor images are determined, and the operation parameters are determined based on these changes. The specific implementation process can be referred to the description in the above implementations, and will not be repeated here.

[0186] The above process primarily addresses the case where the sensor image contains fingerprint features. However, in practical applications, some sensor images may contain fingerprint features while others do not. For ease of explanation, these two types of sensor images will be referred to as fingerprint images and non-fingerprint images, respectively. Based on the aforementioned description, non-fingerprint images may be generated due to the characteristics of the acquisition process or specific operations. For example, when a user performs a double-click operation, the finger may be lifted, resulting in a non-fingerprint image between the two clicks. Correspondingly, the specific operation performed by the user can be deduced from these non-fingerprint images.

[0187] Therefore, in some implementations, it can be first identified whether non-fingerprint images are included in the multi-frame sensor images. If so, the operation parameters are determined by combining the temporal information of the fingerprint and non-fingerprint images. Specifically, the sensor images can be arranged chronologically based on the temporal information, and then the distribution intervals of different fingerprint and non-fingerprint images can be determined. Within each distribution interval, there are consecutive fingerprint or non-fingerprint images. The number of clicks can be determined based on the number of fingerprint image distribution intervals. For example, such as... Figure 7 As shown, at time t5, the finger is attached to the surface of the fingerprint scanning chip; at time t6, the finger is moved away from the fingerprint scanning chip; and at time t7, the finger is back attached to the fingerprint scanning chip. The sensor images acquired at these three times differ, and this difference can be used to further determine the user's double-tap operation.

[0188] To illustrate with an example, suppose 100 frames of sensor images are captured, where frames 1-30 are fingerprint images, frames 31-45 are non-fingerprint images, frames 45-85 are fingerprint images, and frames 86-100 are non-fingerprint images. The fingerprint images have two distribution intervals. During the time period of sensor image acquisition, the user's finger makes contact with the detection area for two relatively short periods. Therefore, the corresponding operation parameter can be determined to be two touches, that is, a double-touch operation is performed.

[0189] Preferably, to clearly identify a user's operation as touching the detection area, the size of the fingerprint image interval and the size of the non-fingerprint image interval corresponding to the touch operation can be preset. The interval size can be used to limit the number of frames in the interval. For example, if the distribution interval corresponding to the fingerprint image contains too few images, it may be a mis-touch rather than an intentional touch by the user; if the distribution interval corresponding to the fingerprint image contains too many images, the user may have performed a long press operation. Correspondingly, if the distribution interval of the non-fingerprint image contains too few images, the chip may not have effectively captured the image or the user may have misoperated; if the distribution interval of the non-fingerprint image contains too many images, the user may not have touched the chip surface for a long time, possibly performing two independent operations. In practical applications, the size of the fingerprint image interval and the size of the non-fingerprint image interval corresponding to the touch operation can be set according to specific circumstances, which will not be elaborated here.

[0190] By limiting the size of the interval, effective filtering of touch operations is ensured, thus guaranteeing the accuracy of determining the operation parameters.

[0191] Preferably, when determining a touch operation, the fingerprint features in the fingerprint image can be further analyzed. Generally, when a touch operation is performed, the user's finger does not move significantly, meaning the fingerprint image within a single touch operation shows little difference. Therefore, the changes in fingerprint features within a certain range can be analyzed. If the changes are within a controllable range, it can be determined that these fingerprint images correspond to the user's touch operation.

[0192] Similarly, further analysis of fingerprint features ensured the accuracy of the identified touch operations.

[0193] While identifying the touch operation, the number of touches corresponding to the multiple frames of sensor images collected can be counted. The number of touches can be determined based on the fingerprint image range that can effectively reflect the touch operation. For example, if there are two fingerprint image ranges, the number of touches is 2, and the user performed a double-click operation; if there are three fingerprint image ranges, the number of touches is 3, and the user performed a triple-click operation.

[0194] If, based on the aforementioned judgment, it is determined that all acquired multi-frame sensor images are fingerprint images, i.e., they do not contain non-fingerprint images, then the final operation parameters can be directly determined by combining these sensor images. The specific method for determining the operation parameters can be referred to the aforementioned description and will not be repeated here. The operation parameters determined in this way include translation parameters, rotation parameters, or long-press duration.

[0195] Translation parameters can be parameters generated by a user's finger sliding on the chip surface in a certain direction. Specifically, translation parameters can include the translation direction and translation distance.

[0196] Rotation parameters can be the operational parameters corresponding to the user's finger rotating on the chip surface. Specifically, rotation parameters can include the rotation direction and rotation angle.

[0197] The long press duration can be considered the operation parameter corresponding to a user's finger pressing on the chip surface for an extended period. If it is determined that the fingerprint features in a continuous portion of the fingerprint image do not undergo any displacement transformation, and the duration corresponding to this portion of the fingerprint image exceeds the long press judgment threshold, then the corresponding operation can be determined as a long press operation, and the corresponding operation parameter is the long press duration. The long press duration can also be determined by combining the acquisition interval between adjacent fingerprint images.

[0198] In practical applications, other operation parameters can be determined according to needs and other types of user operations, and are not limited to the above examples, which will not be elaborated here.

[0199] In some implementations, the sensing image may contain non-fingerprint images, but the fingerprint images within the fingerprint image regions formed based on the non-fingerprint images each correspond to specific operational parameters. For example, there may be three fingerprint image regions, corresponding to a swipe down, a rotation, and a touch operation, respectively. In this case, the user's actions may not be simple multiple touches, but rather a combination of different operations. The operational parameters corresponding to different fingerprint image regions can be determined separately and applied to subsequent analysis.

[0200] Specifically, at least two fingerprint image intervals can first be determined based on the timing information of fingerprint and non-fingerprint images. A fingerprint image interval can consist of multiple temporally consecutive fingerprint images. Next, the operation parameters corresponding to the fingerprint images in different fingerprint image intervals are determined, and the execution order of these operation parameters is determined by combining the timing information between the fingerprint image intervals. This allows for the integration of these operation parameters in subsequent steps to determine the control method for the terminal device.

[0201] In some cases, the sensor image acquisition operation may be performed due to accidental contact by other conductive objects or device malfunction, resulting in sensor images that do not contain fingerprint features. If none of the sensor images contain fingerprint features, the acquired sensor images can be ignored without further processing.

[0202] S930: Generate corresponding control commands based on the operating parameters.

[0203] After determining the operating parameters, corresponding control commands can be generated based on these parameters. These control commands can be sent to a terminal device and executed by the terminal device to change the device's state. For example, when the fingerprint detection module is located on a smartphone, the control command can be directly sent to the smartphone's processing module, allowing the smartphone to perform the corresponding operation based on the command. When the fingerprint detection module is located on a remote control, the control command can be transmitted to the signal transmission module on the remote control, which then sends the control command to the corresponding device to be controlled.

[0204] In some implementations, when the operation parameter is the number of touches, operation instructions for selecting an application or a portion of the display interface can be generated based on the number of touches.

[0205] Specifically, the terminal device interface can include a selection cursor, whose position can correspond to a specific application or a specific area. By inputting a certain number of touches, the user can select the application or a specific area. For example, when the cursor is on application A, a double-tap (two touches) selects and opens the application; when the cursor is on the upper left area, a triple-tap (three touches) selects or zooms in on the upper left area. In practical applications, corresponding operations can also be performed directly based on the number of touches, such as quickly locking the screen or shutting down the device after a certain number of touches. The specific operations can be adjusted according to the actual application and are not limited in this respect.

[0206] In some implementations, if the determined operation parameter is a translation parameter, operation instructions for switching interfaces, switching selected applications, or adjusting volume / brightness can be generated based on the translation parameter. For example, when no application is currently selected, a left or right swipe can switch the currently displayed interface; when an application has already been selected by the cursor or other means, the selected application can be switched based on the translation parameter, such as selecting an application above, below, to the left, to the right, or diagonally. Other operations can be performed to open the selected application, such as opening it by double-clicking. In specific interfaces, volume / brightness can also be adjusted by executing the translation parameter. For example, when playing music, videos, or other media files, swiping up increases the playback volume, and swiping down decreases the playback volume; when displaying images or playing videos, swiping left decreases the brightness, and swiping right increases the brightness.

[0207] If the determined operation parameter is a rotation parameter, operation instructions for switching interfaces or changing the interface display effect can also be generated. For example, when in a specific interface, a rotation operation can achieve the effect of returning to the main interface or going to a specific sub-interface. In a specific display interface, the rotation parameter can also change the display effect of the interface, such as rotating an image or video left or right. In practical applications, the specific correspondence between translation or rotation parameters and operation steps can be determined according to requirements, and is not limited to the above examples, which will not be elaborated further here.

[0208] In some implementations, if the determined operation parameter is the long press duration, an operation instruction to select an application or a portion of the display interface can be generated based on the long press duration. For example, when a cursor is present on the application, a long press, after reaching a certain duration, can select or open the application. When no application is selected, a long press, after reaching a certain duration, can select or zoom in on that portion of the application. In practical applications, other operations corresponding to the long press duration can be set based on the long press duration and the current application scenario, and are not limited to the examples above, which will not be elaborated further here.

[0209] In some implementations, multiple operation parameters may be combined to determine the corresponding operation command. For example, according to the implementation in step S120, at least two fingerprint image intervals are determined, and each of these two fingerprint image intervals corresponds to its own operation parameters. The corresponding control logic / control command can be determined by combining these operation parameters based on the timing of the fingerprint image intervals. Specifically, a correspondence between multiple consecutive operation parameters and control logic can be set. For example, swiping up and then long-pressing corresponds to opening a specific application. In practical applications, the correspondence between operation parameters and control logic / control command can be set according to requirements, which will not be elaborated here.

[0210] S940: The control command is sent to the terminal device so that the terminal device adjusts the device state accordingly based on the control command.

[0211] After generating the control command, it can be sent to the terminal device, which then adjusts the device status according to the control command. Specific sending and implementation methods can be set based on the example in step S930 above and the actual application environment, and will not be elaborated further here.

[0212] Based on the above embodiments, the generation of control commands through the fingerprint detection module is achieved, which is suitable for relevant scenarios in practical applications, reduces the processing pressure on the device itself, and improves the user experience.

[0213] Based on the above exemplary description, typical device control methods primarily target devices in an unlocked state. For example, when selecting or clicking an application using a fingerprint scanning chip, the terminal device to be controlled must be unlocked to display the corresponding interface and information. For devices in a locked state, this specification also proposes a device control method based on fingerprint features. The main purpose is to input corresponding operation commands when the device is locked and to control the device while maintaining its locked state. Figure 10 As shown, the device control method based on fingerprint features may include the following specific implementation steps.

[0214] S1010: Acquire multiple frames of sensor images; the multiple frames of sensor images correspond to time sequence information.

[0215] It is important to emphasize that the sensor images acquired in this step are obtained when the terminal device is in a locked state. A locked state refers to the terminal device being in a locked state, such as a smartphone in a locked screen state, or other smart devices in a standby state. Generally, a terminal device cannot function normally in a locked state; for example, the screen may be black and unable to display images. However, some operations can be performed in the background, such as playing music, making phone calls, or downloading data. In this case, the terminal device can still be controlled even when locked, such as adjusting the volume or dialing a specific number. The fingerprint detection module can be activated and function normally when the terminal device is locked, thereby completing the acquisition of the sensor images.

[0216] For a detailed description of this step, please refer to the introduction in step S110, which will not be repeated here.

[0217] S1020: Determine the operation parameters corresponding to the multi-frame sensing images based on the timing information; wherein, the operation parameters include: combining the fingerprint features in the multi-frame sensing images and the timing information to obtain the fingerprint feature changes; and determining the operation parameters based on the fingerprint feature changes.

[0218] The steps for obtaining operation parameters described above are also performed when the terminal device is locked. When the fingerprint detection module and the terminal device are located on different devices, the fingerprint detection module can determine the operation parameters independently, or send the processing content to the processing module of the device it is located on, where the device performs the corresponding calculation. When the fingerprint detection module is located on the terminal device, the fingerprint detection module can complete the processing independently, or it can activate some or all of the processing modules of the terminal device, and the terminal device's own processing module can determine the corresponding operation parameters based on the sensor image. Neither of these processes affects the unlocked state of the terminal device.

[0219] For a detailed description of this step, please refer to the introduction in step S110, which will not be repeated here.

[0220] S1030: Control the device status of the terminal device when it is not unlocked according to the operation parameters.

[0221] When the terminal device is in an unlocked state, the device state is controlled according to the operation parameters. Due to the limitations of the unlocked state in practical applications, the device state adjusted in this step should be a state that the terminal device can still achieve without changing its own unlocked state, such as changing the volume of the terminal device or dialing a specific number. Specific application methods can be adjusted according to the definition of the unlocked state of the terminal device and the specific operation commands set in the actual application, and will not be elaborated here.

[0222] For a detailed description of this step, please refer to the introduction in step S110, which will not be repeated here.

[0223] Through the above embodiments, the device can be effectively controlled even when the terminal device is in an unlocked state, which simplifies the relevant operations of users in practical applications, expands the relevant scenarios for recognizing user actions and determining instructions, enriches the technical means of controlling the device, and helps to improve the user's actual operating experience.

[0224] based on Figure 8 In addition to the corresponding fingerprint-based device control method, this specification also proposes a fingerprint-based device control system, which includes a fingerprint detection module and a terminal device.

[0225] The fingerprint detection module may include a fingerprint scanning chip. The fingerprint scanning chip acquires a corresponding sensor image for a detection area on the surface. In some embodiments, the fingerprint scanning chip may be located on the side and back of the terminal device, so that when the user operates the terminal device, the fingerprint scanning chip can be used to record fingerprint feature information to obtain the corresponding sensor image. The fingerprint detection module can perform simple processing on the sensor image to include temporal information or make it easier for the terminal device to parse and process. The fingerprint detection module can send the sensor image to the terminal device.

[0226] The terminal device includes a memory and a processor.

[0227] The memory includes, but is not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), Cache, Hard Disk Drive (HDD), Memory Card, etc. The memory is used to store computer programs / instructions.

[0228] The processor can be implemented in any suitable manner. For example, the processor can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers, etc. The processor is used to execute the computer program / instructions to achieve, for example, Figure 8 The corresponding fingerprint-based device control method processes the sensor images and adjusts the device status based on the processing results.

[0229] based on Figure 9 In addition to the corresponding fingerprint-based device control method, this specification also proposes a fingerprint-based device control system, which includes a fingerprint detection module and a terminal device.

[0230] The fingerprint detection module may include a fingerprint scanning chip and a microprocessor.

[0231] The fingerprint scanning chip acquires corresponding sensor images for the detection area on the surface. In some embodiments, the fingerprint scanning chip can be disposed on the side and back of the terminal device, so that the user can use the fingerprint scanning chip to record fingerprint feature information and obtain the corresponding sensor image when operating the terminal device.

[0232] The microprocessor processes the sensed image to obtain a corresponding processing result and sends the result to the terminal device. The processing result may be, for example, a control command or direct control logic. The microprocessor can be based on... Figure 9 The corresponding fingerprint-based device control method processes the sensor image to obtain the corresponding processing result.

[0233] The terminal device is used to receive the processing results sent by the fingerprint detection module and adjust the device state based on the processing results. For example, it can directly execute control commands to complete the change of device state.

[0234] Although the process described above includes multiple operations that occur in a specific order, it should be clearly understood that these processes may include more or fewer operations, which may be executed sequentially or in parallel (e.g., using parallel processors or a multithreaded environment).

[0235] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this specification. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0236] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0237] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0238] Computer-readable media include both permanent and non-permanent, removable and non-removable media that can store information by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0239] Those skilled in the art will understand that the embodiments of this specification can be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, the embodiments of this specification can take the form of computer program products implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0240] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, system embodiments are basically similar to method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments. In the description of this specification, the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of the embodiments in this specification. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described can be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0241] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A device control method based on a fingerprint feature, characterized by, include: Acquire multiple frames of sensor images; The multi-frame sensor images correspond to time sequence information; The operation parameters corresponding to the multi-frame sensing images are determined based on the time sequence information; wherein, the operation parameters include: combining the fingerprint features in the multi-frame sensing images and the time sequence information to obtain the fingerprint feature changes; and comprehensively determining the operation parameters based on the fingerprint feature changes. Adjust the device status according to the operating parameters; The step of determining the operation parameters corresponding to the multi-frame sensing images based on the timing information includes: Identify whether the multi-frame sensing images contain non-fingerprint images; the non-fingerprint images are images that do not contain fingerprint features. If included, the operation parameters are determined by combining the temporal information of fingerprint images and non-fingerprint images; the operation parameters include the number of touches, which is determined based on the fingerprint image range that can effectively reflect the touch operation.

2. The method as described in claim 1, characterized in that, The method is applied to a terminal device; adjusting the device state according to the operating parameters includes: Determine the control logic corresponding to the operating parameters; The control logic is used to adjust the state of the device itself.

3. The method of claim 1, wherein, The method is applied to a fingerprint detection module; adjusting the device state according to the operating parameters includes: Generate corresponding control commands based on the operating parameters; The control command is sent to the terminal device so that the terminal device can adjust the device state accordingly based on the control command.

4. The method of any one of claims 1-3, wherein, Before obtaining the fingerprint feature changes by combining the fingerprint features in the multi-frame sensing images and the temporal information, the method further includes: Determine in turn whether each sensor image contains fingerprint features; If present, identify the fingerprint features in the corresponding sensor image.

5. The method of any one of claims 1-3, wherein, The step of combining the fingerprint features in the multi-frame sensing images with the temporal information to obtain the fingerprint feature changes includes: Based on time sequence information, determine whether there is at least one identical fingerprint feature between adjacent sensor images; If present, determine the first location information of the at least one identical fingerprint feature in adjacent sensing images; The fingerprint feature changes are determined based on the first location information.

6. The method of claim 5, wherein, After determining whether there is at least one identical fingerprint feature between adjacent sensor images based on time-series information, the method further includes: If not, the fingerprint features in different sensor images are compared with the preset overall fingerprint image in turn, and the second position information of each fingerprint feature in the preset overall fingerprint image is determined. The fingerprint feature changes are determined based on the second location information.

7. The method of any one of claims 1-3, wherein, The step of combining the fingerprint features in the multi-frame sensing images with the temporal information to obtain the fingerprint feature changes includes: Identify fingerprint features in each sensor image separately; The fingerprint features are compared sequentially with a preset overall fingerprint image, and the third position information of each fingerprint feature in the preset overall fingerprint image is determined. By combining the third location information and the timing information, the changes in fingerprint features between the sensor images are determined; The operating parameters are determined based on the changes in the fingerprint features.

8. The method of claim 1, wherein, The step of adjusting the device status according to the operating parameters includes: Based on the number of touches, the operation of selecting an application or selecting a portion of the display interface can be achieved.

9. The method of claim 1, wherein, After identifying whether the multi-frame sensing images contain non-fingerprint images, the method further includes: If not included, the operation parameters are determined based on the temporal information of the sensor image; the operation parameters include translation parameters, rotation parameters, or long press duration.

10. The method of claim 9, wherein, The step of adjusting the device status according to the operating parameters includes: Based on the translation or rotation parameters, operations such as switching the display interface, switching the selected application, or adjusting the volume / brightness can be implemented. Based on the long press duration corresponding to the operation parameters, the operation of selecting an application or selecting a portion of the display interface can be achieved.

11. The method of claim 1, wherein, After identifying whether the multi-frame sensing images contain non-fingerprint images, the method further includes: If included, at least two fingerprint image intervals are determined based on the temporal information of fingerprint images and non-fingerprint images; the fingerprint image intervals consist of temporally consecutive fingerprint images. Determine the operation parameters for different fingerprint image regions; The step of adjusting the device status according to the operating parameters includes: The corresponding control logic / control command is determined by combining multiple operating parameters; Adjust the device state according to the control logic / control commands.

12. The method of any one of claims 1-3, 6, 8-11, wherein, The sensing image is acquired by a fingerprint scanning chip; the fingerprint scanning chip includes a fingerprint sensing array composed of multiple rows and columns of fingerprint sensing elements; the sensing image is generated based on a portion of the fingerprint sensing elements in the fingerprint sensing array.

13. The method as described in claim 12, characterized in that, The fingerprint sensing element includes: A fingerprint sensor element for a specific row, or a fingerprint sensor element for a specific column, or a fingerprint sensor element for a specific area.

14. A device control method based on a fingerprint feature, characterized by, include: Acquire multiple frames of sensor images; The multi-frame sensor images correspond to time sequence information; The operation parameters corresponding to the multi-frame sensing images are determined based on the time sequence information; wherein, the operation parameters include: combining the fingerprint features in the multi-frame sensing images and the time sequence information to obtain the fingerprint feature changes; and comprehensively determining the operation parameters based on the fingerprint feature changes. The device status of the terminal device in the unlocked state is controlled according to the operating parameters; The step of determining the operation parameters corresponding to the multi-frame sensing images based on the timing information includes: Identify whether the multi-frame sensing images contain non-fingerprint images; the non-fingerprint images are images that do not contain fingerprint features. If included, the operation parameters are determined by combining the temporal information of fingerprint images and non-fingerprint images; the operation parameters include the number of touches, which is determined based on the fingerprint image range that can effectively reflect the touch operation.

15. A device control system based on fingerprint features, characterized by Includes fingerprint detection modules and terminal devices; The fingerprint detection module includes a fingerprint scanning chip; the fingerprint scanning chip is used to generate a sensing image on the chip surface; the fingerprint detection module processes the sensing image based on the steps of the method according to any one of claims 1, 3-14 and sends the processing result to the terminal device; The terminal device is used to adjust the device status based on the received processing results.

16. The system of claim 15, wherein, The fingerprint scanning chip is located on the side or back of the terminal device.

17. A device control system based on fingerprint features, characterized by Includes fingerprint detection modules and terminal devices; The fingerprint detection module includes a fingerprint scanning chip; the fingerprint scanning chip is used to generate a sensing image on the chip surface; the fingerprint detection module is used to send the sensing image to a terminal device; The terminal device includes a memory and a processor; the memory is used to store computer programs / instructions; the processor is used to execute the computer programs / instructions to adjust the device state by implementing the steps of the method as described in any one of claims 1-2 and 4-14.

18. The system of claim 17, wherein, The fingerprint scanning chip is located on the side or back of the terminal device.

Citation Information

Patent Citations

  • Method and device for generating instruction

    US20170083741A1

  • Fingerprint sensor device and methods thereof

    US20170364726A1