Low-power intelligent lock system with sound source positioning and lock control method

Abstract

The present invention provides a low-power intelligent lock system and lock control method with sound source positioning, wherein the system includes an intelligent lock device installed on a door body, the intelligent lock device includes a control module, a motor module connected to the control module, and a lock body driven by the motor module, the control module is also connected to a human body detection module installed on the outside of the door body, a camera module, an outside MIC, and an inside MIC installed on the inside of the door body, and the control module includes a sound source positioning module, a voiceprint recognition module, a face recognition module, and a voice recognition module. According to the location of the sound source, specific control is performed. When the sound source is outside the door, a dual biometric authentication method is used to ensure the strength of the anti-counterfeiting authentication, and low power consumption and convenience can be achieved at the same time. When the sound source is inside the door, the user's hands are freed, and safe, fast, and convenient long-distance unlocking is achieved.

Description

Technical Field

[0001] The present invention belongs to the field of intelligent lock control, and in particular relates to a low-power intelligent lock system with sound source positioning and a lock control method. Background Art

[0002] As the core product of home smart security products, smart door locks have become an indispensable core component of the smart home ecosystem.

[0003] There are many ways to open a smart lock, such as fingerprint, password, card swiping, mobile phone remote control, etc., which is very convenient and fast.

[0004] Although smart locks bring a lot of convenience to home life, an obvious disadvantage of smart locks is that they consume a lot of power. Although the power consumption feature cannot be completely avoided, it can be improved by reducing power consumption as much as possible to extend battery life. At present, in order to achieve low power consumption of smart locks, people have conducted long-term explorations. For example, a multifunctional smart door lock disclosed in a Chinese patent [application number: CN201811306593.9], the core idea of ​​which is to set a human body detection module for the smart lock, and only turn on the recognition module when a human body is detected, such as fingerprint recognition or face recognition. The human body detection module consumes very little power, but the recognition module consumes a lot of power. This solution triggers the recognition module through human body detection, and only starts the recognition when a human body is detected, which can reduce power consumption to a certain extent. However, in this solution, whether the owner or the visitor comes, the recognition module will be activated and enter a high power consumption state, so there is still a problem of high power consumption. Summary of the invention

[0005] The purpose of the present invention is to provide a low-power intelligent lock system and lock control method with sound source positioning in order to solve the above problems.

[0006] In order to achieve the above object, the present invention adopts the following technical solutions:

[0007] A low-power smart lock system with sound source positioning, comprising a smart lock device installed on a door body, the smart lock device comprising a control module, a motor module connected to the control module, and a lock body driven by the motor module, the control module is also connected to a human detection module installed on the outside of the door body, a camera module, an outside-door MIC, and an inside-door MIC installed on the inside of the door body, and the control module comprises a sound source positioning module, a voiceprint recognition module, a face recognition module and a speech recognition module.

[0008] In the above-mentioned low-power smart lock system with sound source positioning, the control module is also connected to a display module installed on the inside of the door body and a lock control operation prompt module installed on the outside of the door body. The display module is used to display the image captured by the camera module, and the lock control operation prompt module includes any one or more of a speaker, an indicator light or a liquid crystal display.

[0009] In the above-mentioned low-power intelligent lock system with sound source positioning, the control module is also connected to a wireless module, the wireless module is used to receive a remote unlocking command, and the control module includes a signal analysis module for identifying a remote unlocking command.

[0010] A low-power smart lock control method with sound source positioning based on the low-power smart lock system with sound source positioning comprises the following steps:

[0011] S1. The human body detection module sends the detected human body approaching signal to the control module to switch the system from a deep sleep state to a low-power standby state;

[0012] S2. The door MIC and / or the door MIC receive the sound signal and send it to the control module;

[0013] S3. The control module locates the sound source through the sound source positioning module. When the sound source is identified as being inside the door, the inner door lock control process is started. When the sound source is identified as being outside the door, the outer door lock control process is started.

[0014] In the above-mentioned control method of the low-power smart lock with sound source positioning, before step S3, the control module determines through the voice recognition module whether the sound signal contains a specific voice for unlocking. If so, step S3 is executed, otherwise the process ends.

[0015] In the above-mentioned control method of the low-power smart lock with sound source positioning, the door lock control process includes the following steps:

[0016] A2. The lock body is driven to unlock according to the specific voice in the sound source inside the door.

[0017] In the control method of the low-power smart lock with sound source positioning, the door lock control process further includes step A1 before step A2:

[0018] A1. The control module identifies the voiceprint characteristics of the sound source inside the door through the voiceprint recognition module, and determines whether the person is a registered person based on the voiceprint characteristics. If so, execute step A2, otherwise end the process.

[0019] In the above-mentioned control method of the low-power smart lock with sound source positioning, the door lock control process also includes the following steps:

[0020] When the control module receives the cat-eye opening command from the person inside the door, it starts the display module located inside the door and the camera module located outside the door, and transmits the image captured by the camera module to the display module in real time for display. The owner inside the door can directly issue the cat-eye opening command through voice commands (such as "Xiaohui, turn on the cat-eye function"), or through other methods, such as operating the switch next to the display module.

[0021] In the above-mentioned control method of the low-power smart lock with sound source positioning, the exterior door lock control process includes the following steps:

[0022] B1. The control module identifies the voiceprint characteristics of the sound source outside the door through the voiceprint recognition module, and determines whether it is a registered person according to the voiceprint characteristics. If so, execute step B2, otherwise end the process;

[0023] B2. Start the camera module, and the control module performs face recognition on the face image collected by the camera module through the face recognition module, and determines whether it is a registered person based on the face recognition result. If so, the lock body is driven to unlock, otherwise the process ends.

[0024] In the control method of the low-power smart lock with sound source positioning, in step B1, if the sound source outside the door does not belong to a registered person, the wireless module is driven to switch to a standby wake-up state and maintain a preset time. If the wireless module receives a correct remote unlocking command within the preset time period, the lock body is driven to unlock, otherwise the process ends;

[0025] When the lock body is opened by starting the inner door lock control process or the outer door lock control process, a voice prompt is given through the speaker to remind the person outside the door that the lock has been opened.

[0026] The advantages of the present invention are:

[0027] 1. Through human proximity detection and voice recognition, multi-level function awakening or activation is performed to achieve low power consumption control of the device;

[0028] 2. When a person approaches, the relatively low-power sound source positioning and voice recognition technology is activated to identify the location of the sound source containing specific voices, and activate the door unlocking inside or outside according to the location of the sound source;

[0029] 3. When the sound source is outside the door, combined with voiceprint recognition technology, the face recognition function with high accuracy but high power consumption is activated only when the voiceprint belongs to a registered person. The face recognition function with high power consumption is activated only when necessary. Through the dual biometric authentication method, the strength of anti-counterfeiting authentication is guaranteed, while low power consumption and convenience can be achieved;

[0030] 4. When the sound source is inside the door, the owner inside the door can unlock the door remotely through voice at low power consumption, freeing the user's hands and realizing remote unlocking safely, quickly and conveniently;

[0031] 5. Sound source positioning can not only effectively reduce the power consumption of lock control products and extend battery life, but also take into account the safety and convenience of unlocking. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 This is a system structure block diagram of a low-power intelligent lock system with sound source positioning in Embodiment 1 of the present invention;

[0033] Figure 2 This is a system structure block diagram of a low-power intelligent lock system with sound source positioning in Embodiment 2 of the present invention. DETAILED DESCRIPTION

[0034] The present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0035] Embodiment 1

[0036] like Figure 1 As shown, this embodiment discloses a low-power smart lock system with sound source positioning, including a smart lock device installed on a door body, the smart lock device including a control module 1, a motor module 2 connected to the control module 1, a lock body driven by the motor module 2, and a power module for powering the system and for storing necessary information such as facial information, voiceprint information, and specific voice information for unlocking.

[0037] In particular, the control module 1 is also connected to a human detection module 3, a camera module 4, an external door MIC 5, a lock control operation prompt module installed on the outside of the door body, and an internal door MIC 8 and a display module 7 installed on the inside of the door body. The lock control operation prompt module includes any one or more of a speaker 6, an indicator light or a liquid crystal display screen, and the speaker 6 is preferred in this embodiment.

[0038] Human body detection module 3 is used for human body approach detection, and uses low-power human body approach detection devices such as human body thermal infrared and infrared ranging. The system is usually in deep sleep state. When a human body is detected approaching, the module generates a trigger wake-up signal to switch the system from a deep sleep state of several microamperes to a low-power standby state of several milliamperes;

[0039] Camera module 4, used for collecting facial images outside the door;

[0040] Speaker 6, used for voice reminder of lock control operation;

[0041] The MIC5 outside the door and the MIC8 inside the door are used for sound source collection and are located outside and inside the door respectively. The sound source positioning module of the control module 1 locates the sound source position according to the sound intensity of the two MICs respectively;

[0042] The motor module 2 is protected by the metal parts of the lock body and is used to receive the control signal of the control module 1 and drive the mechanical parts of the lock body to perform unlocking and locking operations;

[0043] Display module 7, used to display the image collected by camera module 4, realizing the electronic cat's eye function;

[0044] The control module 1 includes a sound source positioning module, a voiceprint recognition module, a face recognition module and a speech recognition module, and is used for face recognition, speech recognition, voiceprint recognition, sound source positioning, etc., and performs corresponding lock control.

[0045] The human detection module 3, the camera module 4, the outside door MIC5, and the speaker 6 can be installed together or separately on the lock body outside the door body, the outside side surface of the door body, or the wall next to the outside of the door body; the display module 7 and the inside door MIC8 can be installed together or separately on the lock body inside the door body, the outside side surface of the door body, or the wall next to the inside of the door body.

[0046] Specifically, the lock control method flow of this system when it is put into use is as follows:

[0047] Under normal conditions, the system is in a deep sleep state with power consumption at the level of several microamperes, and at this time, only the human body detection module 3 is in a standby state that can be awakened;

[0048] 1. When a user approaches the lock body, the human body detection module 3 detects that someone is approaching and sends a human body approach signal to the control module 1. This signal is used as a trigger wake-up signal to switch the system from a deep sleep state of several microamperes to a low-power standby state of several milliamperes. At this time, both the MIC5 outside the door and the MIC8 inside the door are in a standby wake-up state, allowing the reception of voice wake-up commands;

[0049] 2. The user inside or outside the door makes a voice (the voice made by the users inside and outside the door talking or the voice made by the user outside the door alone, or the voice made by the user inside the door alone), the MIC5 outside the door and the MIC8 inside the door receive the sound signal at the same time, and transmit the sound signal to the control module 1 after level conversion;

[0050] 3. The control module 1 determines whether the voice content of the sound signal contains a specific voice for unlocking (a specific voice emitted by the user inside or outside the door during the conversation) through the voice recognition module. If so, step 4 is executed, otherwise the process ends;

[0051] 4. The control module 1 locates the sound source of the sound signal through the sound source positioning module. If the sound signal to which the specific voice content belongs is located inside the door, or both the sound source outside the door and the sound source inside the door contain specific voices, the door is unlocked according to the specific voice in the sound source inside the door. The specific voice is usually one type, such as "Xiaohui, open the door", or it can be several types, such as "Xiaohui, open the door", "Xiaohui, please open the door", etc.

[0052] If the sound signal of the specific voice content is located outside the door, the control module 1 identifies the voiceprint characteristics of the sound source outside the door through the voiceprint recognition module, and determines whether it is a registered person according to the voiceprint characteristics. If so, execute step 5, otherwise end the process;

[0053] 5. Start the camera module 4 and enter the high power consumption mode. The control module 1 performs face recognition on the face image collected by the camera module 4 through the face recognition module, and determines whether it is a registered person based on the face recognition result. If so, the lock body is driven to unlock, and a corresponding voice prompt is given through the speaker 6 (such as: "The lock is open, please come in"), otherwise the process ends.

[0054] Furthermore, in order to further improve the security performance of the lock body, when the sound signal is located inside the door, the voiceprint feature of the sound source inside the door can also be recognized, and whether it is a registered person can be determined based on the voiceprint feature. If so, the lock will be unlocked based on the specific voice in the sound source inside the door, otherwise, the lock will not be unlocked.

[0055] Furthermore, a display module 7 can be equipped. When a visitor arrives, the owner inside the door can judge whether it is necessary to turn on the electronic cat's eye function for further identification by the knocking sound or the conversation with the visitor. If it is considered necessary, the cat's eye function can be turned on by a voice command (such as: "Xiaohui, Xiaohui, turn on the cat's eye function"), and the camera module 4 and the display module 7 are turned on accordingly, and the image captured by the camera module 4 is transmitted to the display module 7 in real time for display; if it is considered unnecessary, the door can be unlocked directly by a voice command (such as: "Xiaohui, unlock").

[0056] In the unlocking scene outside the door, the multi-modal dual biometric authentication method of "face recognition + voiceprint recognition + speech recognition" is adopted, which strengthens the strength of anti-counterfeiting authentication while achieving low power consumption and maintaining convenience. In the unlocking scene inside the door, the "sound source positioning + voiceprint recognition + speech recognition" technology is used, which can free users' hands and realize long-distance unlocking safely, quickly and conveniently.

[0057] This solution can exist alone or be combined with traditional methods, such as setting a manual unlocking switch inside the door so that the owner inside the door can unlock the door manually.

[0058] This solution can determine whether the voice command comes from outside the door or inside the door through sound source positioning, and turn on the electronic functional components according to the source of the voice command, which can effectively control the power consumption of the lock control, reduce the power consumption of the product, and increase the battery life; in addition, this solution can effectively determine whether the person who issues the effective voice command is inside or outside the door through sound source positioning. If the person is outside the door, high-power facial recognition authentication can be turned on, and the security of external entry can be enhanced through multiple authentications, while reducing system power consumption; if the person is inside the door, the door can be unlocked for the visitor directly through voice recognition (such as: "Xiaohui, unlock"), realizing the convenience of unlocking.

[0059] Therefore, this solution can not only effectively reduce the power consumption of lock control products and increase battery life through sound source positioning, but also take into account the safety and convenience of unlocking.

[0060] Embodiment 2

[0061] This embodiment is similar to the first embodiment, except that the control module 1 of this embodiment is further connected to a wireless module 9, the wireless module is used to receive a remote unlocking command, and the control module 1 includes a signal parsing module for identifying a remote unlocking command.

[0062] The lock control system of this embodiment further comprises the following steps when put into use:

[0063] When the sound information comes from outside the door and the sound source outside the door does not belong to a registered person, the wireless module is driven to switch to the standby wake-up state and maintain the preset time so that the owner can remotely unlock the door wirelessly through the remote client. If the wireless module 9 receives the correct remote unlocking command within the preset time period, the lock body is driven to unlock, otherwise the process ends and only the human body detection module 3 is restored to a deep sleep state that can be awakened.

[0064] The specific embodiments described herein are merely examples of the spirit of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in similar ways, but they will not deviate from the spirit of the present invention or exceed the scope defined by the appended claims.

[0065] Although the terms such as control module 1, motor module 2, human body detection module 3, camera module 4, door exterior MIC 5, speaker 6, display module 7, door interior MIC 8, signal analysis module 15, and wireless module 9 are used more frequently in this article, the possibility of using other terms is not excluded. The use of these terms is only for the purpose of more conveniently describing and explaining the essence of the present invention; interpreting them as any additional limitation is contrary to the spirit of the present invention.

Claims

1. A low-power intelligent lock system with sound source localization, comprising an intelligent lock device installed on a door body, the intelligent lock device comprising a control module (1), a motor module (2) connected to the control module (1), and a lock body driven by the motor module (2), characterized in that: The control module (1) is also connected to a human body detection module (3), a camera module (4), an external door MIC (5), and an internal door MIC (8) installed on the inner side of the door body, and the control module (1) includes a sound source positioning module, a voiceprint recognition module, a face recognition module, and a voice recognition module; The system control process includes: S1. The human body detection module (3) sends a detected human body approach signal to the control module (1) so that the system switches from a deep sleep state to a low power standby state; S2. The door internal MIC (8) and / or door external MIC (5) receives the sound signal and sends it to the control module (1); The control module (1) determines whether the sound signal contains a specific voice for unlocking through the voice recognition module, and if so, executes step S3, otherwise ends the process; S3. The control module (1) locates the sound source through the sound source positioning module, and starts the door lock control process when it is identified as the sound source inside the door, and starts the door lock control process when it is identified as the sound source outside the door; The door lock control process includes: driving the lock body to unlock according to a specific voice in the door sound source; The exterior door lock control process includes: B1. The control module (1) identifies the voiceprint characteristics of the sound source outside the door through the voiceprint recognition module, and determines whether it is a registered person based on the voiceprint characteristics. If so, execute step B2, otherwise end the process; B2. Start the camera module (4), the control module (1) performs face recognition on the face image collected by the camera module (4) through the face recognition module, and determines whether the person is a registered person based on the face recognition result. If so, the lock body is driven to unlock, otherwise the process ends.

2. The low-power intelligent lock system with sound source positioning according to claim 1 is characterized in that: The control module (1) is also connected to a display module (7) installed on the inner side of the door body and a lock control operation prompt module installed on the outer side of the door body, wherein the display module (7) is used to display the image captured by the camera module (4), and the lock control operation prompt module includes any one or more of a speaker (6), an indicator light or a liquid crystal display screen.

3. The low-power intelligent lock system with sound source positioning according to claim 2 is characterized in that: The control module (1) is also connected to a wireless module (9), the wireless module (9) is used to receive a remote unlocking command, and the control module (1) includes a signal analysis module (15) for identifying a remote unlocking command.

4. A low-power smart lock control method with sound source positioning based on the low-power smart lock system with sound source positioning according to any one of claims 1 to 3, characterized in that: The following steps are involved: S1. The human body detection module (3) sends a detected human body approach signal to the control module (1) so that the system switches from a deep sleep state to a low power standby state; S2. The door internal MIC (8) and / or door external MIC (5) receives the sound signal and sends it to the control module (1); The control module (1) determines whether the sound signal contains a specific voice for unlocking through the voice recognition module, and if so, executes step S3, otherwise ends the process; S3. The control module (1) locates the sound source through the sound source positioning module, and starts the door lock control process when it is identified as the sound source inside the door, and starts the door lock control process when it is identified as the sound source outside the door; The door lock control process includes: driving the lock body to unlock according to a specific voice in the door sound source; The exterior door lock control process includes: B1. The control module (1) identifies the voiceprint characteristics of the sound source outside the door through the voiceprint recognition module, and determines whether it is a registered person based on the voiceprint characteristics. If so, execute step B2, otherwise end the process; B2. Start the camera module (4), the control module (1) performs face recognition on the face image collected by the camera module (4) through the face recognition module, and determines whether the person is a registered person based on the face recognition result. If so, the lock body is driven to unlock, otherwise the process ends.

5. The control method of the low-power intelligent lock with sound source positioning according to claim 4 is characterized in that: The door lock control process includes: A1. The control module (1) identifies the voiceprint characteristics of the sound source inside the door through the voiceprint recognition module, and determines whether the person is a registered person based on the voiceprint characteristics. If so, execute step A2, otherwise end the process; A2. The lock body is driven to unlock according to the specific voice in the sound source inside the door.

6. The control method of the low-power intelligent lock with sound source positioning according to claim 5, characterized in that: The door lock control process also includes the following steps: When the control module (1) receives a peephole opening command from a person inside the door, it activates the display module (7) located inside the door body and the camera module (4) located outside the door body, and transmits the image captured by the camera module (4) to the display module (7) in real time for display.

7. The control method of the low-power intelligent lock with sound source positioning according to claim 6, characterized in that: In step B1, if the sound source outside the door does not belong to a registered person, the wireless module is driven to switch to a standby wake-up state and maintained for a preset time. If the wireless module (9) receives a correct remote unlocking command within the preset time period, the lock body is driven to unlock, otherwise the process ends; When the lock body is opened by starting the internal lock control process or the external lock control process, a voice prompt is given through the speaker (6) to remind the person outside the door that the lock has been opened.

Images