Multi-mode biological characteristic recognition intelligent lock and control method thereof

Abstract

The invention is suitable for the technical field of intelligent locks, and particularly relates to a multi-mode biological feature recognition intelligent lock and a control method thereof. Performing matching verification on the multiple pieces of biological feature information in a preset biological feature library in sequence, and determining the matched biological feature information as effective biological feature information; accumulating and counting the quantity of the effective biological characteristic information in real time to obtain an effective characteristic quantity value; and according to the effective feature quantity value, the multi-mode biological feature recognition intelligent lock is controlled not to execute operation, execute pre-unlocking operation or execute unlocking operation. According to the method, multi-modal biological characteristic collection and verification can be carried out on a plurality of individuals outside a door at the same time, the time needed for unlocking is shortened through pre-unlocking operation, the unlocking efficiency is improved, and the experience feeling of a user is improved while the safety is guaranteed.

Description

Technical Field

[0001] The present application belongs to the technical field of smart locks, and in particular to a multimodal biometric recognition smart lock and a control method thereof. Background Art

[0002] A multimodal biometric smart lock is a smart lock that integrates multiple biometric technologies, improving security and recognition accuracy by combining multiple biometric features.

[0003] In the prior art, a multimodal biometric recognition smart lock needs to control the lock tongue to retract after completing the steps of collecting and identifying a person's multiple biometric features. High-security smart locks often have complex lock tongue structures and slow retraction, which affects the efficiency of unlocking. Summary of the invention

[0004] The embodiment of the present application provides a multimodal biometric recognition smart lock and a control method thereof, which can solve the problem of low unlocking efficiency caused by the need to control the complex structure of the lock tongue to be retracted after completing the collection and recognition of a person's multiple biometric features when unlocking the multimodal biometric recognition smart lock.

[0005] In a first aspect, an embodiment of the present application provides a control method for a multi-modal biometric smart lock, which is applied to a multi-modal biometric smart lock, and the method includes: Acquire multiple biometric information; wherein the multiple biometrics come from one or more individuals; Performing matching verification on the plurality of biometric information in a preset biometric database in turn, and determining the biometric information that can be matched as valid biometric information; Accumulate and count the number of valid biometric feature information in real time to obtain a valid feature quantity value; According to the value of the number of valid features, the multimodal biometric smart lock is controlled to respectively not perform an operation, perform a pre-unlocking operation or perform an unlocking operation; wherein, the pre-unlocking operation is that the multimodal biometric smart lock retracts at least one of the multiple groups of lock tongues into the lock body, and at least one group of the lock tongues is in the lock plate, so that the multimodal biometric smart lock is in a locked state; the unlocking operation is that the multimodal biometric smart lock completely retracts the lock tongue into the lock body, so that the multimodal biometric smart lock is in an open state.

[0006] The above technical solutions in the embodiments of the present application have at least the following technical effects: By acquiring multiple biometric information; matching and verifying the multiple biometric information in the preset biometric library in turn, and determining the biometric information that can be matched as valid biometric information; accumulating and counting the number of valid biometric information in real time to obtain the valid feature quantity value; according to the valid feature quantity value, controlling the multi-modal biometric recognition smart lock to not perform an operation, perform a pre-unlocking operation, or perform an unlocking operation. This method can simultaneously collect and verify the multi-modal biometrics of multiple individuals outside the door, and reduce the time required for unlocking through the pre-unlocking operation, improve the efficiency of unlocking, and enhance the user experience while ensuring security.

[0007] In a possible implementation manner of the first aspect, the acquiring multiple biometric feature information includes: Determining that the lock tongue is in a locked state; wherein the locked state means that at least a portion of the lock tongue is within the lock plate, making the door unable to be opened; Obtain the biometric information of all individuals in a first area; wherein the first area is an area with the multimodal biometric recognition smart lock as the center and a preset distance as the radius, and is located outside the door.

[0008] In a possible implementation manner of the first aspect, the acquiring multiple biometric feature information includes: Determining that the lock tongue is in a locked state; wherein the locked state means that at least a portion of the lock tongue is within the lock plate, making the door unable to be opened; Obtain the biometric information of all individuals in a first area; wherein the first area is an area with the multimodal biometric recognition smart lock as the center and a preset distance as the radius, and is located outside the door.

[0009] In a possible implementation manner of the first aspect, the biometric information includes biometric data; wherein the biometric data is used to identify and verify personal identity; and the biometric data of any two of the biometric information are different; The matching and verifying of the plurality of biometric information in a preset biometric database in turn, and determining the biometric information that can be matched as valid biometric information, includes: The biometric data of the plurality of biometric information are matched and verified in a preset biometric database in turn, and the biometric information that the biometric data can match is determined as the valid biometric information.

[0010] In a possible implementation manner of the first aspect, the biometric information further includes information acquisition time data; and the sequentially matching and verifying the plurality of biometric information in a preset biometric database, and determining the biometric information that can be matched as valid biometric information, includes: According to the time data of obtaining the plurality of the information, sorting the plurality of the biometric feature information in order from earliest to latest to obtain a sorting result; According to the sorting result, the plurality of biometric feature information are matched in sequence in a pre-stored feature information database, and the biometric feature information that is successfully matched is determined as the valid biometric feature information.

[0011] In a possible implementation manner of the first aspect, the method further includes: Obtaining security level information; wherein the security level information is used to indicate the degree of security requirements for the installation environment of the multimodal biometric smart lock; According to the security level information, a pre-unlock value and an unlock value are obtained; The controlling the multimodal biometric feature recognition smart lock to respectively not perform an operation, perform a pre-unlocking operation, or perform an unlocking operation according to the effective feature quantity value comprises: According to the effective feature quantity value, the pre-unlock value and the unlock value, the multimodal biometric recognition smart lock is controlled to not perform an operation, perform a pre-unlock operation or perform an unlock operation respectively.

[0012] In a possible implementation manner of the first aspect, obtaining a pre-unlocking value and an unlocking value according to the security level information includes: Determining a security threshold according to the security level information; According to the safety threshold, the pre-unlocking value and the unlocking value are determined by matching in a safety value correspondence table.

[0013] In a possible implementation manner of the first aspect, controlling the multimodal biometric smart lock to respectively not perform an operation, perform a pre-unlocking operation, or perform an unlocking operation according to the valid feature quantity value includes: When the value of the number of valid features is less than the pre-unlock value, the multimodal biometric smart lock does not perform an operation; When the effective feature quantity value is equal to the pre-unlock value, controlling the multimodal biometric feature recognition smart lock to perform the pre-unlock operation; When the valid feature quantity value is equal to the unlocking value, the multimodal biometric recognition smart lock is controlled to perform the unlocking operation; wherein the unlocking value is greater than the pre-unlocking value.

[0014] In a possible implementation manner of the first aspect, the method further includes: According to the security threshold, verification time data is obtained; If the effective feature quantity value does not increase to be equal to the unlock value within the time indicated by the verification time data, resetting the effective feature quantity value to zero; Within the time indicated by the verification time data, if the effective feature quantity value increases to be equal to the unlock value, the verification of the biometric information is stopped, and when it is detected that the lock tongue is in the locked state again, the effective feature quantity value is reset to zero.

[0015] In a possible implementation manner of the first aspect, the valid biometric information includes acquisition source information, and the acquisition source information is used to indicate a source individual and a source location of the biometric information; If the effective feature quantity value does not increase to be equal to the unlock value within the time indicated by the verification time data, resetting the effective feature quantity value to zero includes: Within the time indicated by the verification time data, the value of the number of valid features is zero, and the multimodal biometric feature recognition smart lock is controlled not to perform an operation; or Within the time indicated by the verification time data, the valid feature quantity value is greater than zero and less than the unlock value, and the re-collected biometric information is obtained; wherein the re-collected biometric information includes re-collected source information, and the re-collected source information is used to indicate the source individual and source location of the re-collected biometric information; the re-collected source information of any of the re-collected biometric information is different from the acquisition source information of any of the valid biometric information; Matching and verifying the plurality of recollected biometric information in a preset biometric database respectively, and determining the recollected biometric information that passes the matching and verification as recollected valid biometric information; Accumulating and counting the number of the re-collected valid biometric information in real time to obtain a value of the number of re-collected valid features; The resampled effective feature quantity value is added to the effective feature quantity value.

[0016] In a second aspect, the embodiment of the present application provides a multi-modal biometric recognition smart lock control system, including: An acquisition unit, configured to acquire a plurality of biometric information; wherein the plurality of biometric information comes from one or more individuals; A verification unit, used to sequentially perform matching verification on the plurality of biometric information in a preset biometric database, and determine the biometric information that can be matched as valid biometric information; A statistical unit, used for accumulating and counting the number of valid biometric characteristic information in real time to obtain a valid characteristic quantity value; A control unit is used to control the multimodal biometric smart lock to perform no operation, perform a pre-unlocking operation or perform an unlocking operation according to the value of the number of valid features; wherein the pre-unlocking operation is that the multimodal biometric smart lock retracts at least one of the multiple groups of lock tongues into the lock body, and at least one group of the lock tongues is in the lock plate, so that the multimodal biometric smart lock is in a locked state; the unlocking operation is that the multimodal biometric smart lock completely retracts the lock tongue into the lock body, so that the multimodal biometric smart lock is in an open state.

[0017] In the third aspect, an embodiment of the present application provides a multimodal biometric smart lock, comprising a lock body, a lock tongue, a lock plate, a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that when the processor executes the computer program, it implements a method as described in any one of the first aspects above.

[0018] In a fourth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on a multimodal biometric smart lock, the multimodal biometric smart lock executes the control method of the multimodal biometric smart lock described in any one of the first aspects above.

[0019] It can be understood that the beneficial effects of the second to fourth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0021] Figure 1 It is a flowchart of a control method of a multi-modal biometric recognition smart lock provided by an embodiment of the present application; Figure 2 It is a schematic diagram of the implementation flow of steps S100, S200 and S300 in the control method of a multi-modal biometric recognition smart lock provided in an embodiment of the present application; Figure 3 This is a schematic diagram of the implementation flow of step S01 in the control method of a multi-modal biometric recognition smart lock provided in an embodiment of the present application; Figure 4It is a schematic diagram of the implementation flow of step S400 in the control method of a multi-modal biometric recognition smart lock provided in an embodiment of the present application; Figure 5 It is a schematic diagram of the structure of a multi-modal biometric recognition smart lock provided by an embodiment of the present application; Figure 6 It is a structural schematic diagram of a control device for a multi-modal biometric recognition smart lock provided in one embodiment of the present application; Figure 7 It is a structural diagram of a multimodal biometric recognition smart lock control system provided in one embodiment of the present application. DETAILED DESCRIPTION

[0022] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0023] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0024] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0025] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0026] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0027] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0028] A multimodal biometric smart lock is a smart lock that integrates multiple biometric technologies to improve security and recognition accuracy by combining multiple biometrics.

[0029] In the prior art, a multimodal biometric recognition smart lock needs to control the lock tongue to retract after completing the steps of collecting and identifying a person's multiple biometric features. High-security smart locks often have complex lock tongue structures and slow retraction, which affects the efficiency of unlocking.

[0030] To solve the above problems, the embodiment of the present application provides a control method for a multi-modal biometric identification smart lock. In this method, multiple biometric information is obtained; the multiple biometric information is matched and verified in the preset biometric library in turn, and the biometric information that can be matched is determined as valid biometric information; the number of valid biometric information is accumulated and counted in real time to obtain a valid feature quantity value; according to the valid feature quantity value, the multi-modal biometric identification smart lock is controlled to not perform an operation, perform a pre-unlocking operation, or perform an unlocking operation. This method can collect and verify multi-modal biometrics of multiple individuals outside the door at the same time, and reduce the time required for unlocking through the pre-unlocking operation, improve the efficiency of unlocking, and enhance the user experience while ensuring safety.

[0031] The control method of the multimodal biometric smart lock provided in the embodiment of the present application can be applied to the multimodal biometric smart lock 100. At this time, the multimodal biometric smart lock 100 is the executor of the control method of the multimodal biometric smart lock provided in the embodiment of the present application. The embodiment of the present application does not impose any restrictions on the specific type of the multimodal biometric smart lock 100.

[0032] For example, see Figure 5The multimodal biometric identification smart lock 100 may include a lock body 10, multiple sets of lock tongues 20, multiple motors, a collection module 30, a lock plate 40 and a control device 50. The lock body 10 is arranged on the door. Multiple sets of lock tongues 20 are slidably connected to the lock body 10, and the lock tongues 20 can move to completely enter the lock body 10 or partially enter the lock plate 40. Multiple motors are connected to multiple sets of lock tongues 20 in a one-to-one correspondence, and multiple motors are electrically connected to the control device 50 respectively, and the motors are used to drive the lock tongues 20 to move. The collection module 30 is arranged on the outward side of the lock body 10, and is electrically connected to the control device 50. The collection module 30 is used to collect multiple biometric features. The lock plate 40 is arranged on the door frame, and multiple recessed holes are provided on the lock plate 40 for accommodating the lock tongues 20 in a one-to-one correspondence. The control device 50 is arranged in the lock body 10, and is used to control the collection module 30 to collect and match the biometric features of the user outside the door, and is also used to control the motor to drive the lock tongue 20 to move. The control device 100 may be a single chip microcomputer, a PLC, a central processing unit, a handheld device with wireless communication function, a computing device or other processing devices connected to a wireless modem. A gear may be provided at the power output end of the motor, and a rack matched with the gear is provided at one end of the lock tongue 20. The gear is driven to rotate by the motor, thereby driving the lock tongue 20 to move. Alternatively, a swing rod is provided at the power output end of the motor, and the lock tongue 20 is connected to the swing rod through a connecting rod. The two ends of the connecting rod are respectively hinged to the lock tongue 20 and the swing rod. The lock tongue 20 is provided in the moving channel of the lock body 10, so that the moving direction of the lock tongue 20 is fixed. The swing rod is driven to rotate by the motor, thereby driving the lock tongue 20 to move in the moving channel, but it is not limited thereto. The acquisition module 30 may include a fingerprint collector, a camera, a microphone, a human body sensing sensor, etc., but it is not limited thereto.

[0033] In order to better understand the control method of the multimodal biometric smart lock provided in the embodiment of the present application, the specific implementation process of the control method of the multimodal biometric smart lock provided in the embodiment of the present application is exemplarily introduced below.

[0034] Figure 1 A schematic flow chart of a control method for a multi-modal biometric smart lock provided in an embodiment of the present application is shown. The control method for a multi-modal biometric smart lock includes: S100, obtaining multiple biometric information; wherein the multiple biometrics come from one or more individuals.

[0035] It can be understood that biometric information is data of physiological characteristics or behavioral characteristics used to identify an individual's identity. Biometric information can be acquired through the acquisition module 30. Multiple biometric information can be collected from one person, or multiple biometric information can be collected from multiple persons, but is not limited to this.

[0036] As an optional embodiment of this application, please refer to Figure 2 , S100, obtaining multiple biometric information, including: S110, determining that the lock tongue 20 is in a locked state; wherein the locked state means that at least a portion of the lock tongue 20 is in the lock plate 40, so that the door cannot be opened.

[0037] It is understood that the position of the lock tongue 20 can be determined by setting an infrared sensor on one side of the lock body 10 to detect the position of the lock tongue 20, or by setting an encoder on the motor to detect the rotation angle of the motor, but it is not limited to this. When the multimodal biometric recognition smart lock 100 is in a locked state, there is a need to unlock. When at least part of the lock tongue 20 is in the strike plate 40, the door panel can be prevented from moving relative to the door frame.

[0038] S120, obtaining biometric information of all individuals in the first area; wherein the first area is an area with the multimodal biometric recognition smart lock 100 as the center and a preset distance as the radius, and is located outside the door.

[0039] It can be understood that the first area is an area used to limit the collection range of the collection module 30, and the preset distance as the radius of the first area can be input by the user for adjustment, or can be a fixed value, but is not limited thereto.

[0040] With such a configuration, by determining that the lock tongue 20 is in a locked state and then acquiring the biometric information of all individuals in the first area, it is possible to avoid the acquisition module 30 continuing to work when in the open state, or the acquisition module 30 collecting data from individuals outside the first area. This can effectively reduce the power consumption of the multimodal biometric recognition smart lock 100 and save resources. By collecting data from multiple individuals, the number of collected samples is increased, thereby improving the opening success rate and speed.

[0041] S200, matching and verifying multiple biometric information in a preset biometric database in turn, and determining the biometric information that can be matched as valid biometric information.

[0042] It can be understood that the preset biometric database includes multiple biometric information. The multiple biometric information in the preset biometric database can be input by the user through the acquisition module 30 and the control device 50, or can be imported into the control device 50 by the user through other data carriers, but is not limited thereto. The multiple biometric information in the preset biometric database can correspond to one individual, or can correspond to multiple individuals respectively, but is not limited thereto. The collected biometric information is matched with the multiple biometric information in the preset biometric database in sequence. If there is biometric information in the preset biometric database that is the same as the collected biometric information, the collected biometric information is determined as valid biometric information.

[0043] As an optional embodiment of the present application, the biometric information includes biometric data; wherein the biometric data is used to identify and verify personal identity; the biometric data of any two biometric information are different; S200, sequentially matching and verifying multiple biometric information in a preset biometric library, and determining the biometric information that can be matched as valid biometric information, including: The biometric data of multiple biometric information are matched and verified in the preset biometric database in turn, and the biometric information that the biometric data can match is determined as the valid biometric information.

[0044] It can be understood that biometric data is data used to identify and verify personal identity, such as fingerprint images, facial images, pupil images, voiceprint spectra, but not limited to these.

[0045] With such a setting, by collecting biometric information of different biometric data, and then matching and verifying them in the preset biometric library respectively, the biometric information that can match the biometric data is determined as valid biometric information. This can avoid repeated collection of the same biometric information, reduce the power consumption of the multimodal biometric recognition smart lock 100, improve the recognition efficiency of the multimodal biometric recognition smart lock 100, and speed up the unlocking speed of the multimodal biometric recognition smart lock 100.

[0046] Optionally, the biometric information also includes information acquisition time data; see Figure 2 , S200, sequentially matching and verifying multiple biometric information in a preset biometric database, and determining the biometric information that can be matched as valid biometric information, including: S210, acquiring time data according to the multiple information, and sorting the multiple biometric feature information in order from early to late to obtain a sorting result.

[0047] It can be understood that the information acquisition time data is used to indicate the time when the biometric information is acquired, and then the biometric information is sorted from early to late according to the acquisition time of multiple biometric information to obtain the sorting result.

[0048] S220, according to the sorting result, sequentially match the plurality of biometric feature information in a pre-stored feature information database, and determine the successfully matched biometric feature information as valid biometric feature information.

[0049] It can be understood that, according to the sorting result, the biometric feature information obtained first is matched in the pre-stored feature information library.

[0050] With such a setting, by sorting multiple biometric information according to the information acquisition time data, and matching and verifying the multiple biometric information in sequence from early to late according to the acquisition time, the recognition efficiency of the multimodal biometric recognition smart lock 100 for biometric information can be improved, the data can be easily analyzed, and the error rate in the matching process can be reduced.

[0051] S300, the number of valid biometric feature information is accumulated and counted in real time to obtain a valid feature quantity value.

[0052] With such a setting, by accumulating the number of valid biometric information in real time, the valid feature quantity value is obtained, so that the multimodal biometric recognition smart lock 100 can respond to the changes in the quantity of valid biometric information in a timely manner, thereby effectively improving the unlocking speed of the multimodal biometric recognition smart lock 100.

[0053] S400, according to the value of the number of valid features, controls the multimodal biometric smart lock 100 to respectively not perform an operation, perform a pre-unlocking operation or perform an unlocking operation; wherein, the pre-unlocking operation is that the multimodal biometric smart lock 100 retracts at least one of the multiple groups of lock tongues 20 into the lock body 10, and at least one group of lock tongues 20 is in the lock plate 40, so that the multimodal biometric smart lock 100 is in a locked state; the unlocking operation is that the multimodal biometric smart lock 100 completely retracts the lock tongue 20 into the lock body 10, so that the multimodal biometric smart lock 100 is in an open state.

[0054] It can be understood that the multimodal biometric recognition smart lock 100 controls multiple motors respectively through the control device 50 according to the change of the effective feature quantity value, and then controls the movement of multiple lock tongues 20.

[0055] In one possible implementation, see Figure 3 , the control method of the multimodal biometric recognition smart lock also includes: S01, obtaining security level information; wherein the security level information is used to indicate the degree of security requirement for the installation environment of the multimodal biometric recognition smart lock 100.

[0056] It can be understood that the security level information is used to indicate the degree of security requirements for the installation environment of the multimodal biometric identification smart lock 100. For example, the security level information can be marked as "level one, level two, level three", and the degree of security requirements increases step by step, or it can be marked as "no one inside, only children inside, adults inside", and the degree of security requirements decreases step by step, but it is not limited to this. The security level information can be input by the user for setting, or the multimodal biometric identification smart lock 100 can obtain the information inside the door to set it according to the current environment, but it is not limited to this.

[0057] S02, obtaining a pre-unlocking value and an unlocking value according to the security level information.

[0058] It can be understood that different pre-unlocking values ​​and unlocking values ​​are obtained according to the degree of security requirements indicated by different security level information. The pre-unlocking value is less than the unlocking value. For example, the corresponding coefficient can be set according to the security level information, and the pre-unlocking value and the unlocking value can be calculated according to the effective feature quantity value and the coefficient, or the pre-unlocking value and the unlocking value corresponding to the security level information can be obtained in the corresponding table according to a preset corresponding table, but it is not limited thereto.

[0059] Optionally, S400, valid feature quantity value, controlling the multimodal biometric feature recognition smart lock 100 to not perform an operation, perform a pre-unlocking operation, or perform an unlocking operation, including: According to the effective feature quantity value, the pre-unlock value and the unlock value, the multimodal biometric recognition smart lock 100 is controlled to not perform an operation, perform a pre-unlock operation or perform an unlock operation respectively.

[0060] With such a setting, the real-time changes in the value of the effective feature quantity are compared with the pre-unlock value and the unlock value, and then the multimodal biometric smart lock 100 is controlled to not perform an operation, perform a pre-unlock operation, or perform an unlock operation. The multimodal biometric smart lock 100 can be adjusted in real time to improve ease of use, and can be adjusted according to security requirements to improve security.

[0061] Optionally, see Figure 3 , S20, obtaining a pre-unlock value and an unlock value according to the security level information, including: S021: Determine a security threshold according to the security level information.

[0062] It can be understood that the security threshold is a numerical value determined according to the degree of security requirement indicated by the security level information. For example, a correspondence table between security level information and security thresholds can be established, and the security threshold can be matched in the correspondence table to obtain the security threshold; or a preset numerical value can be assigned to the security level information to obtain the security threshold, but it is not limited to this.

[0063] S022: According to the safety threshold, match in a safety value correspondence table to determine a pre-unlocking value and an unlocking value.

[0064] Exemplarily, the safety value correspondence table is a data set for indicating the correspondence between the safety threshold and the pre-unlocking value and the unlocking value. For example, the pre-unlocking value and the unlocking value in the safety value correspondence table can be calculated according to the safety threshold and the preset quantitative relationship. The safety threshold can be "1, 2, 3", and the preset quantitative relationship is "the pre-unlocking value is equal to the product of the safety threshold and the first coefficient", and "the unlocking value is equal to the product of the safety threshold and the second coefficient". The first coefficient can be "1", and the second coefficient can be "2". Then the pre-unlocking value can be "1 (1*1=1), 2 (2*1=2), 3 (3*1=3)", and the unlocking value can be For example, the pre-unlock value and the unlock value in the security value correspondence table are matched according to the security threshold; or the pre-unlock value and the unlock value in the security value correspondence table can be input by the user at the first use to complete the setting. When the security threshold is "1", the pre-unlock value is input and set to "2" and the unlock value is input and set to "3". When the security threshold is "2", the pre-unlock value is input and set to "4" and the unlock value is input and set to "7". Then, in the security value correspondence table, the pre-unlock value and the unlock value are matched according to the security threshold, but not limited to this.

[0065] In this way, the security threshold is determined according to the security level information, and the pre-unlock value and the unlock value are determined by matching in the security value correspondence table. The pre-unlock value and the unlock value are determined according to the degree of security requirements, and then the multimodal biometric smart lock 100 is controlled according to the pre-unlock value and the unlock value. Different restriction conditions are set for the pre-unlock operation and the unlock operation to increase the difficulty of unlocking, thereby improving the security of the multimodal biometric smart lock 100, and adaptive settings are made according to the needs and habits of different members to reduce security risks caused by misoperation.

[0066] As an optional embodiment of this application, please refer to Figure 4 S400, according to the value of the number of valid features, controlling the multimodal biometric recognition smart lock 100 to not perform an operation, perform a pre-unlocking operation, or perform an unlocking operation, including: S410, when the valid feature quantity value is less than the pre-unlock value, the multimodal biometric recognition smart lock 100 is controlled not to perform an operation.

[0067] S420, when the valid feature quantity value is equal to the pre-unlock value, control the multimodal biometric recognition smart lock 100 to perform a pre-unlock operation.

[0068] S430, when the value of the number of valid features is equal to the unlocking value, control the multimodal biometric recognition smart lock 100 to perform an unlocking operation; wherein the unlocking value is greater than the pre-unlocking value.

[0069] It can be understood that when the effective feature quantity value is less than the pre-unlock value, any lock tongue 20 of the multimodal biometric smart lock 100 does not move; until the effective feature quantity value increases to equal the pre-unlock value, at least one group of lock tongues 20 among the multiple groups of lock tongues 20 of the multimodal biometric smart lock 100 is retracted to separate from the lock plate 40, and at least one group of lock tongues 20 maintains contact with the lock plate 40, so that the multimodal biometric smart lock 100 is in a locked state; when the effective feature quantity value increases to equal the unlock value, all lock tongues 20 of the multimodal biometric smart lock 100 are retracted into the lock body 10 and separated from the lock plate 40, so that the multimodal biometric smart lock 100 is in an open state.

[0070] With this setting, when the value of the effective feature quantity is less than the pre-unlock value, equal to the pre-unlock value, and equal to the unlock value, the multimodal biometric identification smart lock is controlled to not perform an operation, perform a pre-unlock operation, or perform an unlock operation, respectively, so that the opening conditions of the multimodal biometric identification smart lock are controllable, allowing users to set unlocking conditions according to their own security needs and usage habits, providing personalized security protection, while improving security, speeding up unlocking efficiency, ensuring the convenience of the multimodal biometric identification smart lock, optimizing the user experience, and not performing operations when the unlocking conditions are not met, which can reduce unnecessary energy consumption.

[0071] Optionally, see Figure 4 , the control method of the multimodal biometric recognition smart lock also includes: S10, obtaining verification time data according to the security threshold.

[0072] Exemplarily, the verification time data represents the time that the multimodal biometric recognition smart lock 100 is allowed to use to match and verify biometric information when it is in a locked state. The verification time data may be preset time data corresponding to a security threshold, or may be time data corresponding to the security threshold input by the user according to actual usage requirements. For example, the security threshold is "1", and the corresponding verification time data is "30 seconds", or the security threshold is "2", and the corresponding verification time data is "10 seconds", but is not limited thereto.

[0073] S20, if the valid feature quantity value does not increase to be equal to the unlock value within the time indicated by the verification time data, the valid feature quantity value is reset to zero.

[0074] It can be understood that within the time indicated by the verification time data that is allowed to be used to match and verify the biometric information, the value of the effective feature quantity has not increased to be equal to the unlock value. Under the security requirements corresponding to the current security threshold, the user outside the door cannot provide sufficient biometric information to meet the unlocking restriction conditions, and the effective feature quantity value is reset to zero. The user needs to re-provide biometric information that can meet the unlocking restriction conditions.

[0075] In a possible implementation, the effective biometric information includes the acquired source information, and the acquired source information is used to indicate the source individual and source part of the biometric information; see Figure 4 , S20, within the time indicated by the verification time data, if the effective feature quantity value does not increase to be equal to the unlock value, resetting the effective feature quantity value to zero, including: S21a, within the time indicated by the verification time data, the value of the number of valid features is zero, and the multimodal biometric recognition smart lock 100 is controlled not to perform any operation.

[0076] It can be understood that within the time indicated by the verification time data, the value of the number of valid features is zero, indicating that within this time period, no individual in the first area outside the door has biometric information that can pass the matching verification.

[0077] S21b, within the time indicated by the verification time data, the value of the number of valid features is greater than zero but less than the unlocking value, and the re-collected biometric information is obtained; wherein, the re-collected biometric information includes re-collected source information, and the re-collected source information is used to indicate the source individual and source location of the re-collected biometric information; the re-collected source information of any re-collected biometric information is different from the acquisition source information of any valid biometric information.

[0078] It can be understood that within the time indicated by the verification time data, the value of the number of valid features is greater than zero but less than the unlock value, indicating that during this time period, at least one individual in the first area outside the door has biometric information that can pass the matching verification. Due to occlusion, light, angle, etc., some biometric information that can pass the matching verification fails to pass the matching verification. The individuals in the first area can be acquired again to increase the value of the number of valid features to equal the unlock value. The acquisition source information is used to indicate the source of the acquisition of biometric information, and the re-collected source information is used to indicate the source of the re-collected biometrics. The re-collected source information of any re-collected biometric information is different from the acquisition source information of any valid biometric information, so that the re-collected source information is different from the valid biometric information.

[0079] S22, matching and verifying the plurality of re-collected biometric information in a preset biometric database respectively, and determining the re-collected biometric information that passes the matching and verification as the re-collected valid biometric information.

[0080] It can be understood that the re-collected biometric information is matched and verified in the preset biometric library to re-verify the biometric information that cannot be obtained or fails to pass the matching verification due to occlusion, light, angle, etc.

[0081] S23, the number of re-collected valid biometric information is accumulated and counted in real time to obtain the number value of re-collected valid features.

[0082] S24, adding the re-sampled valid feature quantity value to the valid feature quantity value.

[0083] With such a configuration, by obtaining the re-sampled biometric information within the time indicated by the verification time data and based on the valid feature quantity value and the unlocking value when the valid feature quantity value is greater than zero but less than the unlocking value, and performing matching verification on the re-sampled biometric information, the re-sampled biometric information that passes the matching verification is determined as the re-sampled valid biometric information, and the number of re-sampled valid biometric information is added to the valid feature quantity value, so that the biometric information that can be matched and verified but cannot be correctly verified can be matched and verified again, so as to reduce the error rate of the multimodal biometric recognition smart lock 100 in identifying and unlocking, improve the accuracy of identification, improve the environmental adaptability of the multimodal biometric recognition smart lock 100, optimize the user experience, and make the unlocking process smoother and more convenient.

[0084] S30, within the time indicated by the verification time data, if the effective feature quantity value increases to be equal to the unlock value, stop verifying the biometric information, and reset the effective feature quantity value to zero when it is detected that the lock tongue 20 is in the locked state again.

[0085] With such a setting, within the time indicated by the verification time data, the user completes the unlocking of the multimodal biometric recognition smart lock 100 after identification, and until the multimodal biometric recognition smart lock 100 is opened and closed again, the valid feature quantity value is reset to zero to avoid affecting the next identification and opening of the multimodal biometric recognition smart lock 100. This can improve the security of the multimodal biometric recognition smart lock 100, reduce the possibility of misoperation and misunderstanding of the lock, and can reduce energy consumption to achieve energy-saving effects.

[0086] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0087] Corresponding to the control method of the multimodal biometric smart lock described in the above embodiment, the embodiment of the present application also provides a multimodal biometric smart lock control system, and the various units of the system can implement the various steps of the control method of the multimodal biometric smart lock. Figure 7 A structural block diagram of a multimodal biometric recognition smart lock control system provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0088] Reference Figure 7 The system comprises: An acquisition unit, used to acquire multiple biometric information; wherein the multiple biometrics come from one or more individuals; A verification unit, used to sequentially perform matching verification on a plurality of biometric information in a preset biometric database, and determine the biometric information that can be matched as valid biometric information; A statistical unit, used for accumulating and counting the number of valid biometric information in real time to obtain a valid feature quantity value; A control unit is used to control the multimodal biometric smart lock 100 to perform no operation, perform a pre-unlocking operation or perform an unlocking operation according to the value of the number of valid features; wherein the pre-unlocking operation is that the multimodal biometric smart lock 100 retracts at least one of the multiple groups of lock tongues 20 into the lock body 10, and at least one group of lock tongues 20 is in the lock plate 40, so that the multimodal biometric smart lock 100 is in a locked state; the unlocking operation is that the multimodal biometric smart lock 100 completely retracts the lock tongue 20 into the lock body 10, so that the multimodal biometric smart lock 100 is in an open state.

[0089] It should be noted that the information interaction, execution process and other contents between the above-mentioned units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0090] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units is used as an example for illustration. In practical applications, the above-mentioned functions can be assigned to different functional units as needed, that is, the internal structure of the system can be divided into different functional units to complete all or part of the functions described above. The functional units in the embodiment can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0091] The present application also provides a multi-modal biometric identification smart lock 100, see Figure 5 The multimodal biometric recognition smart lock includes a lock body 10, multiple sets of lock tongues 20, multiple motors, a collection module 30, a lock plate 40 and a control device 50. Figure 6 FIG. 5 is a schematic diagram of the structure of a control device 50 provided in an embodiment of the present application. Figure 6 As shown, the control device 50 of this embodiment includes: at least one processor 51 ( Figure 6 Only one is shown), at least one memory 52 ( Figure 6 Only one is shown in the figure) and a computer program 53 stored in the at least one memory 52 and executable on the at least one processor 51. When the processor 51 executes the computer program 53, the control device 50 implements the steps in any of the above-mentioned control method embodiments of the multimodal biometric recognition smart lock, or the control device 50 implements the functions of the various units in the above-mentioned system embodiments.

[0092] Exemplarily, the computer program 53 may be divided into one or more units, which are stored in the memory 52 and executed by the processor 51 to complete the present application. The one or more units may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 53 in the control device 50.

[0093] The control device 50 may be a single chip microcomputer, a PLC, a central processing unit, or other computing devices. The control device 50 may include, but is not limited to, a processor 51 and a memory 52. ​​Those skilled in the art will appreciate that Figure 6This is merely an example of the control device 50 and does not constitute a limitation on the control device 50 , which may include more or fewer components than shown in the figure, or a combination of certain components, or different components, for example, may also include input and output devices, network access devices, buses, etc.

[0094] The processor 51 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0095] In some embodiments, the memory 52 may be an internal storage unit of the control device 50, such as a hard disk or memory of the control device 50. In other embodiments, the memory 52 may also be an external storage device of the control device 50, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the control device 50. Further, the memory 52 may also include both an internal storage unit of the control device 50 and an external storage device. The memory 52 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 52 may also be used to temporarily store data that has been output or is to be output.

[0096] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in any of the above method embodiments are implemented.

[0097] An embodiment of the present application provides a computer program product. When the computer program product runs on a multimodal biometric smart lock 100, the multimodal biometric smart lock 100 implements the steps in any of the above-mentioned method embodiments.

[0098] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium that can carry the computer program code to the multimodal biometric recognition smart lock 100. For example, a USB flash drive, a mobile hard disk, a disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0099] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0100] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0101] In the embodiments provided in the present application, it should be understood that the disclosed multimodal biometric smart lock and its control method can be implemented in other ways. For example, the embodiment of the multimodal biometric smart lock 100 described above is only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0102] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0103] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A control method for a multi-modal biometric recognition smart lock, characterized in that: Applied to a multi-modal biometric identification smart lock, the method comprises: Acquire multiple biometric information; wherein the multiple biometrics come from one or more individuals; Performing matching verification on the plurality of biometric information in a preset biometric database in turn, and determining the biometric information that can be matched as valid biometric information; Accumulate and count the number of valid biometric feature information in real time to obtain a valid feature quantity value; According to the value of the number of valid features, the multimodal biometric smart lock is controlled to respectively not perform an operation, perform a pre-unlocking operation or perform an unlocking operation; wherein, the pre-unlocking operation is that the multimodal biometric smart lock retracts at least one of the multiple groups of lock tongues into the lock body, and at least one group of the lock tongues is in the lock plate, so that the multimodal biometric smart lock is in a locked state; the unlocking operation is that the multimodal biometric smart lock completely retracts the lock tongue into the lock body, so that the multimodal biometric smart lock is in an open state.

2. The control method of the multi-modal biometric smart lock according to claim 1, characterized in that: The obtaining of multiple biometric information includes: Determining that the lock tongue is in a locked state; wherein the locked state means that at least a portion of the lock tongue is within the lock plate, making the door unable to be opened; Obtain the biometric information of all individuals in a first area; wherein the first area is an area with the multimodal biometric recognition smart lock as the center and a preset distance as the radius, and is located outside the door.

3. The control method of the multi-modal biometric smart lock according to claim 2, characterized in that: The biometric information includes biometric data; wherein the biometric data is used to identify and verify personal identity; the biometric data of any two biometric information are different; The matching and verifying of the plurality of biometric information in a preset biometric database in turn, and determining the biometric information that can be matched as valid biometric information, includes: The biometric data of the plurality of biometric information are matched and verified in a preset biometric database in turn, and the biometric information that the biometric data can match is determined as the valid biometric information.

4. The control method of the multi-modal biometric smart lock according to claim 1, characterized in that: The biometric information also includes information acquisition time data; the matching and verification of the plurality of biometric information in the preset biometric database is performed in sequence, and the biometric information that can be matched is determined as valid biometric information, including: According to the time data of obtaining the plurality of the information, sorting the plurality of the biometric feature information in order from earliest to latest to obtain a sorting result; According to the sorting result, the plurality of biometric feature information are matched in sequence in a pre-stored feature information database, and the biometric feature information that is successfully matched is determined as the valid biometric feature information.

5. The control method of the multi-modal biometric smart lock according to claim 1, characterized in that: The method further comprises: Obtaining security level information; wherein the security level information is used to indicate the degree of security requirements for the installation environment of the multimodal biometric smart lock; According to the security level information, a pre-unlock value and an unlock value are obtained; The controlling the multimodal biometric feature recognition smart lock to respectively not perform an operation, perform a pre-unlocking operation, or perform an unlocking operation according to the effective feature quantity value comprises: According to the effective feature quantity value, the pre-unlock value and the unlock value, the multimodal biometric recognition smart lock is controlled to not perform an operation, perform a pre-unlock operation or perform an unlock operation respectively.

6. The control method of the multi-modal biometric smart lock according to claim 5, characterized in that: The obtaining of a pre-unlock value and an unlock value according to the security level information includes: Determining a security threshold according to the security level information; According to the safety threshold, the pre-unlocking value and the unlocking value are determined by matching in a safety value correspondence table.

7. The control method of the multi-modal biometric smart lock according to claim 6, characterized in that: The controlling the multimodal biometric feature recognition smart lock to respectively not perform an operation, perform a pre-unlocking operation, or perform an unlocking operation according to the effective feature quantity value comprises: When the value of the number of valid features is less than the pre-unlock value, the multimodal biometric smart lock does not perform an operation; When the effective feature quantity value is equal to the pre-unlock value, controlling the multimodal biometric feature recognition smart lock to perform the pre-unlock operation; When the valid feature quantity value is equal to the unlocking value, the multimodal biometric recognition smart lock is controlled to perform the unlocking operation; wherein the unlocking value is greater than the pre-unlocking value.

8. The control method of the multi-modal biometric recognition smart lock according to claim 7, characterized in that: The method further comprises: According to the security threshold, verification time data is obtained; If the effective feature quantity value does not increase to be equal to the unlock value within the time indicated by the verification time data, resetting the effective feature quantity value to zero; Within the time indicated by the verification time data, if the effective feature quantity value increases to be equal to the unlock value, the verification of the biometric information is stopped, and when it is detected that the lock tongue is in the locked state again, the effective feature quantity value is reset to zero.

9. The control method of the multi-modal biometric smart lock according to claim 8, characterized in that: The valid biometric information includes acquisition source information, and the acquisition source information is used to indicate the source individual and source location of the biometric information; If the effective feature quantity value does not increase to be equal to the unlock value within the time indicated by the verification time data, resetting the effective feature quantity value to zero includes: Within the time indicated by the verification time data, the value of the number of valid features is zero, and the multimodal biometric feature recognition smart lock is controlled not to perform an operation; or Within the time indicated by the verification time data, the valid feature quantity value is greater than zero and less than the unlock value, and the re-collected biometric information is obtained; wherein the re-collected biometric information includes re-collected source information, and the re-collected source information is used to indicate the source individual and source location of the re-collected biometric information; the re-collected source information of any of the re-collected biometric information is different from the acquisition source information of any of the valid biometric information; Matching and verifying the plurality of recollected biometric information in a preset biometric database respectively, and determining the recollected biometric information that passes the matching and verification as recollected valid biometric information; Accumulating and counting the number of the re-collected valid biometric information in real time to obtain a value of the number of re-collected valid features; The resampled effective feature quantity value is added to the effective feature quantity value.

10. A multimodal biometric identification smart lock, comprising a lock body, a lock tongue, a lock plate, a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 9 is implemented.

Images