Intelligent door lock control method, device and equipment based on voice recognition and medium

Abstract

The invention relates to the technical field of intelligent locks, and discloses an intelligent door lock control method, device and equipment based on voice recognition and a medium. The method comprises the steps that voice signals and environment data are collected through indoor monitoring equipment associated with an intelligent door lock; position information of the target user is determined according to the environment data, and a door lock response range corresponding to the voice signal is judged based on the position information; constructing a door lock task list and a dynamic triggering condition by using the voice signal and the door lock response range; when the dynamic triggering condition is met, the intelligent door lock is controlled to execute corresponding control operation according to the door lock task list. According to the invention, the problems of insufficient safety, vulnerability to attacks and poor environmental adaptability when the intelligent door lock is controlled by voice in the prior art are solved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent locks, and particularly to an intelligent door lock control method, device, equipment and medium based on voice recognition. Background Art

[0002] With the rapid development of smart home technology, voice interaction has gradually become one of the core ways for users to interact with devices. As a key entrance to home security, the intelligent demand of intelligent door locks is increasing day by day. Traditional intelligent door locks mostly rely on authentication methods such as fingerprints, passwords or cards, and voice control has become a new research direction due to the convenience of non-contact operation. However, the easy replicability of voice commands (such as recording attacks, AI simulation attacks) brings great challenges to applications in security scenarios. In the prior art, some solutions attempt to achieve door lock control through a single voice recognition module or basic voiceprint verification, but in complex home scenarios, such methods are difficult to resist advanced attack means and lack dynamic adaptability to user behavior and environmental data, resulting in insufficient security or a high risk of misoperation.

[0003] Currently, the following problems exist in the voice-based intelligent door lock control scheme: First, it relies on a single voice verification mechanism and lacks the collaborative verification of multi-modal authentication (such as voiceprint, facial information, user location), making it vulnerable to forged voices or remote attacks; Second, it does not dynamically adjust the command response range and security policy in combination with the user's location, which may lead to misjudgment of commands or abuse of permissions; Third, in the remote control scenario, the voice command and identity authentication (such as fingerprint, password) are not strongly bound, posing a risk of man-in-the-middle attack. These problems limit the security and practicality of voice control in the field of intelligent door locks. Summary of the Invention

[0004] In view of this, embodiments of the present invention provide an intelligent door lock control method, device, equipment and medium based on voice recognition to solve the problems of insufficient security, vulnerability to attacks and poor environmental adaptability existing when the existing voice-controlled intelligent door lock is used.

[0005] In a first aspect, an embodiment of the present invention provides an intelligent door lock control method based on voice recognition, and the method includes:

[0006] Collect voice signals and environmental data through indoor monitoring devices associated with the intelligent door lock;

[0007] Determine the location information of the target user according to the environmental data, and judge the door lock response range corresponding to the voice signal based on the location information;

[0008] Construct a door lock task list and dynamic trigger conditions by using the voice signal and the door lock response range;

[0009] When the dynamic trigger condition is satisfied, control the intelligent door lock to execute corresponding control operations according to the door lock task list.

[0010] Further, the determining the door lock response range corresponding to the voice signal based on the position information includes:

[0011] Analyze the environmental data to obtain the behavior pattern of the target user;

[0012] If the behavior pattern is a static pattern, identify the spatial area where the target user is currently located according to the environmental data, and determine the door lock response range corresponding to the voice signal based on the spatial area;

[0013] Or, if the behavior pattern is a dynamic pattern, trigger a behavior prediction mechanism to predict the movement trajectory of the target user, obtain a prediction area, and determine the door lock response range corresponding to the voice signal based on the prediction area.

[0014] Further, the identifying the spatial area where the target user is currently located according to the environmental data, and determining the door lock response range corresponding to the voice signal based on the spatial area includes:

[0015] Obtain the space-door lock mapping table stored in the intelligent door lock;

[0016] Determine the spatial area where the target user is currently located according to the environmental data;

[0017] Match the spatial area in the space-door lock mapping table to obtain the door lock response range corresponding to the spatial area.

[0018] Further, the constructing the door lock task list and the dynamic trigger condition by using the voice signal and the door lock response range includes:

[0019] Identify the voiceprint information and the instruction information in the voice signal;

[0020] Verify the voiceprint information to obtain a verification result;

[0021] When the verification result is successful, construct the door lock task list and the dynamic trigger condition according to the instruction information and the door lock response range.

[0022] Further, the constructing the door lock task list and the dynamic trigger condition according to the instruction information and the door lock response range includes:

[0023] Extract the time parameter, identity identifier, and original instruction set in the instruction information;

[0024] Traverse the preset facial images in the intelligent door lock to obtain the first facial image associated with the identity identifier;

[0025] Use the time parameter and the first facial image to construct a dynamic trigger condition, and integrate the original instruction set and the door lock response range into a door lock task list.

[0026] Further, the integrating the original instruction set and the door lock response range into a door lock task list includes:

[0027] Create an initial task list;

[0028] For each intelligent door lock in the door lock response range, screen out at least one associated control instruction from the original instruction set;

[0029] Combine each intelligent door lock with the corresponding control instruction into a task item, and store multiple task items in the initial task list to obtain a door lock task list.

[0030] Further, before controlling the intelligent door lock to execute the corresponding control operation according to the door lock task list, the method further includes:

[0031] Detect whether the current time reaches the time parameter in the dynamic trigger condition;

[0032] At the time parameter in the dynamic trigger condition, collect the second facial image of the person in front of the door through the outdoor monitoring device of the intelligent door lock;

[0033] Compare the second facial image with the first facial image in the dynamic trigger condition to obtain a comparison result;

[0034] Determine whether the dynamic trigger condition is satisfied according to the comparison result.

[0035] In a second aspect, an embodiment of the present invention provides an intelligent door lock control device based on voice recognition, and the device includes:

[0036] A monitoring module, configured to collect voice signals and environmental data through an indoor monitoring device associated with the intelligent door lock;

[0037] A determination module, configured to determine the position information of the target user according to the environmental data, and judge the door lock response range corresponding to the voice signal based on the position information;

[0038] A construction module, configured to construct a door lock task list and a dynamic trigger condition by using the voice signal and the door lock response range;

[0039] A control module, configured to, when the dynamic triggering condition is satisfied, control the intelligent door lock to perform corresponding control operations according to the door lock task list.

[0040] In a third aspect, an embodiment of the present invention provides a computer device, including: a memory and a processor, which are communicatively connected to each other. The memory stores computer instructions, and the processor executes the computer instructions to execute the method according to the first aspect or any corresponding implementation manner thereof.

[0041] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which computer instructions are stored. The computer instructions are used to cause a computer to execute the method according to the first aspect or any corresponding implementation manner thereof.

[0042] The method provided by the embodiments of the present application has the following beneficial effects:

[0043] The method provided by the embodiments of the present application can synchronously obtain environmental information such as user voice instructions, their behavior trajectories, and spatial positions by integrating data collection of multiple indoor devices, providing a data basis for subsequent multi-modal verification. Compared with single voice input, it enhances the context relevance of instructions and effectively identifies non-voice attack behaviors. By combining indoor positioning technology with a space-door lock mapping table, the operation permissions of the door lock associated with the area where the user is located are dynamically delimited. For example, when the user is in the bedroom, only the bedroom door lock is allowed to be operated, avoiding cross-area mis-triggering, solving the problem of permission allocation in traditional solutions, achieving precise instruction range control, and reducing security risks. By parsing keywords such as time parameters and identity identifiers in the voice instructions and combining with a preset facial image library, a dynamic triggering condition including a timing task and identity verification is constructed, and the voice signal is decomposed into a composite task chain of periodically collecting the face in front of the door and performing unlocking after passing the comparison, realizing a refined decomposition of the instruction intention and supporting the security policy arrangement in complex scenarios. Through the multi-level verification mechanism of the dynamic triggering condition, it is ensured that all security constraints are met before the instruction is executed, and through the strong coupling design of multiple authentications, the defense ability in complex attack scenarios is significantly improved. Description of the Drawings

[0044] In order to more clearly illustrate the specific implementation manners of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for use in the specific implementation manners or the description of the prior art. Obviously, the following drawings are some implementation manners of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0045] Figure 1 It is a schematic flowchart of a method for controlling an intelligent door lock based on voice recognition according to an embodiment of the present invention;

[0046] Figure 2 It is a schematic flowchart of a method for updating a voiceprint template according to an embodiment of the present invention;

[0047] Figure 3 It is a schematic flowchart of intelligent door lock control according to an embodiment of the present invention;

[0048] Figure 4 It is a structural block diagram of an intelligent door lock control device based on voice recognition according to an embodiment of the present invention;

[0049] Figure 5 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. Detailed implementation manners

[0050] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0051] According to an embodiment of the present invention, there are provided an intelligent door lock control method, device, equipment, and medium based on voice recognition. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0052] In this embodiment, an intelligent door lock control method based on voice recognition is provided. Figure 1 It is a flowchart of an intelligent door lock control method based on voice recognition according to an embodiment of the present invention. As Figure 1 shown, the process includes the following steps:

[0053] Step S11, collect voice signals and environmental data through an indoor monitoring device associated with the intelligent door lock.

[0054] In the embodiments of the present application, the indoor monitoring device is a series of devices that have established a communication connection with the intelligent door lock and is used to collect relevant information indoors. The indoor monitoring device includes, but is not limited to, an intelligent camera, a microphone array, an infrared sensor, a temperature and humidity sensor, a lidar sensor, etc. The voice signal is collected to obtain voice commands issued by the target user (the owner inside the house), such as "open the door", "lock the door", etc., so as to subsequently identify and process the commands to achieve the control of the intelligent door lock. The environmental data is crucial for determining the location information of the target user and judging the door lock response range corresponding to the voice signal. Different environmental data can reflect the behavior patterns of the target user and the spatial areas where the target user is located. The environmental data includes, but is not limited to: image data, which can capture indoor images through an intelligent camera and provide information such as the position and posture of personnel through analysis by object detection and tracking algorithms to identify the specific position of the target user; infrared sensing data, which uses an infrared sensor to detect the infrared radiation of the human body to judge whether a person is within the monitoring range and the general moving direction; temperature and humidity data, which reflects the usage conditions of different rooms according to the changes in temperature and humidity. For example, a significant increase in temperature and humidity in a certain area may indicate that someone is active; distance data, which uses a lidar sensor to measure the distance of objects to construct a three-dimensional space model of the indoor environment and determine the distance between the target user and each intelligent door lock.

[0055] Step S12: Determine the location information of the target user according to the environmental data, and judge the door lock response range corresponding to the voice signal based on the location information.

[0056] In the embodiments of the present application, determining the location information of the target user according to the environmental data includes: performing data fusion processing on various types of environmental data to construct a unified data model to eliminate errors and conflicts between different data sources; based on the image data, using an advanced deep learning object detection and pose estimation model to accurately identify the contour, feature points and pose of the target user, and combining the spatial coordinate information of the image to initially determine the approximate position of the target user on the indoor plane; according to the infrared sensing data, analyzing the triggering sequence and intensity changes of multiple infrared sensors, and using the triangulation principle to further narrow down the possible area where the target user may be located to provide supplementary information for location determination; for the temperature and humidity data, by establishing a temperature and humidity change model for each area in the indoor environment and combining the real-time collected temperature and humidity data, judging whether the target user is in an area with abnormal temperature and humidity changes. If there is an abnormality, include this area in the scope of location analysis; using the distance data obtained by the lidar sensor to construct a three-dimensional point cloud map of the indoor environment, mapping the position of the target user in the image to the three-dimensional point cloud map, and at the same time combining the areas narrowed down by the infrared sensor and the temperature and humidity data to accurately calculate the coordinate position of the target user in the three-dimensional space; continuously monitoring the dynamic changes of the environmental data, and using the Kalman filter algorithm to update and correct the location information of the target user in real time to adapt to the movement of the target user and the dynamic changes of the environment.

[0057] In the embodiments of the present application, determining the door lock response range corresponding to the voice signal based on the location information includes the following steps A1 - A3:

[0058] Step A1: Analyze the environmental data to obtain the behavior pattern of the target user.

[0059] Specifically, after the intelligent door lock system receives the voice signal and environmental data collected by the indoor monitoring device, it is necessary to analyze these complex environmental data. The environmental data covers various aspects of information such as images captured by the intelligent camera, induction data of the infrared sensor, and data of the temperature and humidity sensor. By using advanced data analysis algorithms and machine learning models, these data are comprehensively processed to infer the current behavior pattern of the target user. For example, if the intelligent camera captures that the user has been in a fixed position for a long time and the infrared sensor does not detect an obvious movement signal, and it is determined that the user is in a resting state by combining other data such as temperature and humidity, then the behavior pattern of the target user can be determined as a static pattern; on the contrary, if multiple sensors detect that the user frequently moves between different areas, it is determined as a dynamic pattern.

[0060] Step A2: If the behavior pattern is a static pattern, identify the spatial area where the target user is currently located according to the environmental data, and determine the door lock response range corresponding to the voice signal based on the spatial area.

[0061] Specifically, first obtain the pre - stored space - door lock mapping table from the storage system of the intelligent door lock. This table details the association relationship between each spatial area and the corresponding operable door lock. Then, use the image information in the environmental data, the position induction of the sensor, etc. again to determine the specific spatial area where the target user is currently located. Finally, match the identified spatial area with the pre - stored space - door lock mapping table to clarify the door lock response range corresponding to this spatial area.

[0062] In the embodiments of the present application, identifying the spatial area where the target user is currently located according to the environmental data and determining the door lock response range corresponding to the voice signal based on the spatial area includes the following steps a1 - a3:

[0063] Step a1: Obtain the pre - stored space - door lock mapping table in the intelligent door lock.

[0064] Specifically, obtain the pre - stored space - door lock mapping table from the storage system of the intelligent door lock. This mapping table is the basic data for determining the entire door lock response range. It pre - records the association relationship between each spatial area in the house and the corresponding operable door lock. For example, it may stipulate that the bedroom corresponds to the bedroom door, and the living room corresponds to all external doors, etc. The intelligent door lock system will regularly check whether this mapping table has been updated to adapt to changes in the house layout or user demand adjustments.

[0065] The implementation process of updating or configuring the pre - stored space - door lock mapping table may include: First, the update requirement is triggered by the user's active operation or the system's automatic detection. Then, data collection is carried out, including the user's input or the device's assistance in obtaining space information, and the system automatically identifies newly added or removed door locks and updates their status. Then, the mapping relationship is established, which can be manually set visually by the user in the management interface or automatically matched by the system according to the location information and optimized in combination with historical data. After that, data verification is carried out. First, logical checks are performed to ensure rationality, and then the user actually tests the door lock response. After passing the verification, the new mapping table data is stored locally in the smart door lock and synchronized to the cloud server for backup. Finally, the system notifies the user that the update is complete and provides a feedback channel to collect user evaluations for continuous optimization.

[0066] Step a2: Determine the space area where the target user is currently located according to the environmental data.

[0067] Specifically, determine the space area where the target user is currently located according to the environmental data collected by the indoor monitoring equipment. The environmental data contains a variety of information. For example, the images captured by the intelligent camera can show the user's location, the infrared sensor can detect the range of personnel activities, and the data of the temperature and humidity sensor can assist in judging the usage of different rooms. By comprehensively analyzing and processing this environmental data and applying advanced data analysis algorithms and models, it is possible to accurately identify which space area the target user is in, such as in the bedroom, living room, or kitchen, etc.

[0068] Step a3: Match the space area in the space - door lock mapping table to obtain the door lock response range corresponding to the space area.

[0069] Specifically, match the determined space area where the target user is located with the obtained space - door lock mapping table. By searching for the door lock information corresponding to this space area in the mapping table, the door lock response range corresponding to this space area can be obtained. For example, if it is determined that the user is in the bedroom, by matching the mapping table, it can be known that the corresponding door lock response range is only the bedroom door. At this time, the door lock control instruction issued by the user is only effective for the bedroom door.

[0070] Step A3: If the behavior mode is the dynamic mode, trigger the behavior prediction mechanism to predict the moving trajectory of the target user, obtain the prediction area, and determine the door lock response range corresponding to the voice signal based on the prediction area.

[0071] Specifically, when the target user is in the dynamic mode, it means that their position is not fixed but in a moving state. At this time, the intelligent door lock will trigger the behavior prediction mechanism, which comprehensively analyzes the environmental data continuously collected by the indoor monitoring devices, such as the movement trajectory of people recorded by the intelligent camera, the change of people's position sensed by the infrared sensor, and other information. By applying data analysis algorithms and machine learning models, the possible movement trajectory of the target user within a certain period of time in the future is predicted, so as to obtain a predicted area. This predicted area represents the spatial range that the target user may reach next. Subsequently, based on this predicted area, the door lock response range corresponding to the voice signal is determined. For example, if it is predicted that the target user will move from the living room to the bedroom, the door lock response range can include the door from the living room to the bedroom and the bedroom door, etc., to ensure that the voice commands issued during the user's movement can be accurately corresponded to the appropriate door lock.

[0072] Step S13, construct a door lock task list and dynamic trigger conditions by using the voice signal and the door lock response range.

[0073] In the embodiment of the present application, step S13 includes the following steps B1 - B3:

[0074] Step B1, identify the voiceprint information and command information in the voice signal.

[0075] Specifically, through voice recognition technology, the voiceprint information and command information are identified from the voice signal. The voiceprint information is like a unique "voice fingerprint" for each person, which can provide a key basis for verifying the identity of the speaker in the follow - up; while the command information contains the specific operations that the user wants to perform on the intelligent door lock, such as "open the door", "lock the door", etc. This step lays the foundation for subsequent identity verification and task construction.

[0076] Step B2, verify the voiceprint information to obtain a verification result.

[0077] Specifically, after obtaining the voiceprint information, it is compared and verified with the standard voiceprint template pre - stored in the intelligent door lock. This process can use voiceprint recognition algorithms to determine whether the current voiceprint matches the voiceprint of the authorized user. Only through strict verification can it be ensured that a legitimate user is issuing the command, effectively preventing illegal personnel from using recorded voice or AI - simulated voice to control the door lock, and improving the security of the intelligent door lock.

[0078] In addition, as Figure 2As shown in the figure, a method for updating a voiceprint template specifically includes: the indoor monitoring device associated with the intelligent door lock continuously collects the voice signals of authorized users during daily use; performs quality assessment on the collected voice signals, and filters out the voice signals with higher quality for subsequent processing; extracts voiceprint features from the filtered voice signals; uses an advanced voiceprint feature extraction algorithm to convert the voice signals into digital feature vectors; calculates and compares the similarity between the newly extracted voiceprint features and the currently stored voiceprint template; makes a judgment based on the comparison result: if the similarity is higher than the threshold, it indicates that the voiceprint change is small, and the new features can be used for progressive update; if the similarity is lower than the threshold, the user identity needs to be further confirmed; when the new features meet the update conditions, the voiceprint template is updated in a weighted fusion manner; different weights are given to the new features and the old template, and the weight of the new features can be dynamically adjusted according to factors such as time or similarity, so that the template gradually adapts to the voiceprint changes while retaining the original features; stores the updated voiceprint template in the database of the intelligent door lock; regularly conducts effect tracking and evaluation on the updated voiceprint template; evaluates the effectiveness of the update strategy by recording indicators such as verification success rate and misrecognition rate, and adjusts the update parameters and methods according to the evaluation results.

[0079] Step B3, when the verification result is successful verification, construct a door lock task list and dynamic trigger conditions according to the instruction information and the door lock response range.

[0080] Specifically, after the voiceprint verification is passed, construct a door lock task list and dynamic trigger conditions according to the instruction information and the previously determined door lock response range. First, extract the time parameter, identity identifier, and original instruction set from the instruction information, then find the first facial image associated with the identity identifier, use the time parameter and the first facial image to construct the dynamic trigger conditions, and at the same time integrate the original instruction set and the door lock response range into the door lock task list. This list clarifies the door lock operations to be performed and the corresponding door locks, while the dynamic trigger conditions specify the timing and conditions for performing these operations.

[0081] In the embodiment of the present application, constructing a door lock task list and dynamic trigger conditions according to the instruction information and the door lock response range includes the following steps b1 - b3:

[0082] Step b1, extract the time parameter, identity identifier, and original instruction set in the instruction information.

[0083] Specifically, when the voiceprint information is verified and it is confirmed that the voice command is issued by a legitimate user, the command information will be deeply analyzed. With the help of natural language processing and semantic analysis technologies, three key elements are extracted from the command information. The time parameter can clarify the execution time point or time period of the door lock control operation, such as expressions like "in 10 minutes" or "at 8 o'clock tomorrow morning"; the identity identifier is used to determine the specific person involved in the command, such as "User A", "Visitor", etc.; the original command set covers the specific operation requirements of the user for the door lock, such as "open the door", "lock the door", "double-lock the door", etc. The information extracted is the basic data for subsequent construction of the door lock task list and dynamic trigger conditions, and plays a crucial role in the accurate execution of the entire intelligent door lock control process.

[0084] Step b2: Traverse the preset facial images in the intelligent door lock to obtain the first facial image associated with the identity identifier.

[0085] Specifically, the intelligent door lock pre-stores the facial images of multiple authorized users, which serve as important bases for user identity verification. Traverse the preset facial image database in the intelligent door lock, and according to the extracted identity identifier, use an image matching algorithm to find the associated first facial image. This first facial image represents the facial features of the user corresponding to the specific identity identifier and will be used later to compare with the facial image of the person actually collected in front of the door to further verify whether the door lock operation is initiated by a legitimate user.

[0086] Step b3: Use the time parameter and the first facial image to construct a dynamic trigger condition, and integrate the original command set and the door lock response range into a door lock task list.

[0087] Specifically, first, use the extracted time parameter and the found first facial image to construct a dynamic trigger condition. The time parameter sets the time limit for the execution of the door lock operation. The first facial image is a key feature for identity verification. Only when the time arrives and the facial image of the person in front of the door matches the first facial image will the door lock operation be triggered. Then, carry out the integration work of the original command set and the door lock response range. First, create an initial task list, and then for each intelligent door lock within the door lock response range, screen out the relevant control commands from the original command set. For example, if the door lock response range includes the bedroom door and the living room door, and the original command set has "lock the bedroom door" and "open the living room door", then screen out the corresponding control commands for the bedroom door and the living room door respectively. Finally, combine each intelligent door lock with the corresponding control command into a task item, and store multiple task items in the initial task list to form a complete door lock task list, clarifying the specific operations that each door lock needs to execute.

[0088] In the embodiment of the present application, the original instruction set and the door lock response range are integrated into a door lock task list, including the following steps b31 - b33:

[0089] Step b31, create an initial task list.

[0090] Specifically, in the previous process, operations such as voice instruction parsing, voiceprint verification, and identity matching have been completed, and key information such as the original instruction set and the door lock response range has been obtained. At this time, a data structure is needed to organize and store the subsequent door lock tasks to be executed. The initial task list provides storage space for combining each intelligent door lock and its corresponding control instruction into a task item later. It can adopt suitable data structures such as lists and arrays, and will be initialized when created, such as setting the initial capacity, defining the storage format, etc., to ensure efficient storage and management of subsequent task items.

[0091] Step b32, for each intelligent door lock within the door lock response range, filter out at least one associated control instruction from the original instruction set.

[0092] Specifically, based on the known door lock response range (i.e., which door locks need to participate in the operation) and the original instruction set (including various door lock control instructions), for each intelligent door lock within the door lock response range, the system will filter out at least one associated control instruction from the original instruction set. For example, if the door lock response range includes the bedroom door and the living room door, and the original instruction set has "lock the bedroom door", "open the living room door", and "anti-lock the kitchen door", then the "lock the bedroom door" instruction will be filtered out for the bedroom door, and the "open the living room door" instruction will be filtered out for the living room door, while the "anti-lock the kitchen door" instruction will be excluded because the kitchen door is not within the door lock response range. This filtering process is based on the matching of the door lock identifier in the instruction and the door lock response range to ensure that each intelligent door lock can obtain the corresponding valid control instruction.

[0093] Step b33, combine each intelligent door lock with the corresponding control instruction into a task item, and store multiple task items into the initial task list to obtain the door lock task list.

[0094] Specifically, combine each intelligent door lock with its corresponding control instruction into a task item. For example, combine the bedroom door and "lock the bedroom door" into a task item, and combine the living room door and "unlock" into another task item. Then, store these task items into the initial task list in sequence. Through this process, a complete door lock task list is finally obtained. This list records each intelligent door lock that needs to be operated and the corresponding control instruction, providing clear guidance for controlling the intelligent door lock to execute the corresponding control operation according to the list when the dynamic trigger condition is met later.

[0095] Step S14, when the dynamic trigger condition is met, control the smart door lock to perform corresponding control operations according to the door lock task list.

[0096] In the embodiment of the present application, when the preset dynamic trigger condition is met, control the smart door lock to perform corresponding control operations according to the previously constructed door lock task list. For example, the door lock task list contains a task item such as "After 10 minutes, when the facial information of the person in front of the door matches that of user A, open the living room door". When the time arrives and the facial information comparison is successful, that is, the dynamic trigger condition is met, send an open door instruction to the smart lock of the living room door to control the lock mechanism to complete the door opening action.

[0097] Before and after controlling the smart door lock to perform operations, it is necessary to monitor the state of the door lock in real time. Before sending the control instruction, confirm that the door lock is in a normal operable state; after the instruction is executed, obtain the feedback information of the door lock in time to judge whether the operation is successful. If the door lock feedbacks that the operation fails, automatically analyze the reasons, such as door lock failure, insufficient power, etc., and send an alarm message to the user, and at the same time try to take other emergency measures, such as resending the instruction or notifying the maintenance personnel.

[0098] As an example, as Figure 3 shown, a smart door lock control process includes: first, collect voice signals and environmental data through devices, then determine the user's location and the door lock response range based on these data, and then construct a task list and trigger conditions. After that, verify the voiceprint information. If the verification fails, end the process; if the verification is successful, judge whether the trigger condition is met. If not, loop the judgment. If it is met, collect the facial image in front of the door, and then compare the collected image with the preset image. If they do not match, end the process. If they match, perform the door lock operation.

[0099] In the embodiment of the present application, the method further includes the following steps C1 - C4:

[0100] Step C1, detect whether the current time reaches the time parameter in the dynamic trigger condition.

[0101] Specifically, continuously detect the current time and compare it with the time parameter in the dynamic trigger condition. For example, if the user's voice instruction is "Open the door after 10 minutes", then continuously check the current time to judge whether 10 minutes have passed. Only when the current time reaches the value set by the time parameter will subsequent operations be triggered, which ensures that the door lock operation can be accurately executed according to the user's expected time and avoids executing the instruction too early or too late.

[0102] Step C2, at the time parameter in the dynamic trigger condition, collect the second facial image of the person in front of the door through the outdoor monitoring device of the smart door lock.

[0103] Specifically, when it is detected that the current time reaches the time parameter in the dynamic trigger condition, the outdoor monitoring device of the intelligent door lock, usually the camera on the outer door panel, is used to collect the second facial image of the person in front of the door. This operation is to further verify the identity of the person in front of the door and, combined with the previously set identity identifier, ensure that only authorized personnel can trigger the door lock operation. For example, if the voice command specifies that "User A" can open the door at a specific time, the facial image of the person in front of the door is collected at this time for subsequent comparison with the preset facial image of User A.

[0104] Step C3: Compare the second facial image with the first facial image in the dynamic trigger condition to obtain a comparison result.

[0105] Specifically, the collected second facial image is compared with the first facial image pre-associated in the dynamic trigger condition. This comparison process will use a face recognition algorithm to extract feature points from the image and calculate the matching degree. The comparison result will be presented in the form of a similarity value or a judgment of successful / failed matching. For example, if the comparison result shows that the similarity reaches more than 90%, it can be considered a successful match; if the similarity is lower than a certain threshold, it is determined as a failed match.

[0106] Step C4: Determine whether the dynamic trigger condition is met according to the comparison result.

[0107] Specifically, if the comparison result shows a successful match, it means that the identity of the person in front of the door is consistent with the preset authorized person. At this time, it can be determined that the dynamic trigger condition is met, and the intelligent door lock will be controlled to execute the corresponding control operation according to the door lock task list, such as opening the door. On the contrary, if the comparison result is a failed match, it is considered that the dynamic trigger condition is not met, and the intelligent door lock will not execute the corresponding operation, thus ensuring the security of the door lock and preventing unauthorized personnel from entering.

[0108] In this embodiment, a voice recognition-based intelligent door lock control device is also provided. This device is used to implement the above-mentioned embodiment and the preferred implementation manner, and those that have been described will not be repeated. As used hereinafter, the term "module" can be a combination of software and / or hardware that can achieve a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.

[0109] This embodiment provides a voice recognition-based intelligent door lock control device, as Figure 4 shown, including:

[0110] A monitoring module 41, configured to collect voice signals and environmental data through the indoor monitoring device associated with the intelligent door lock;

[0111] A determination module 42, configured to determine the location information of a target user according to environmental data, and judge the door lock response range corresponding to the voice signal based on the location information;

[0112] A construction module 43, configured to construct a door lock task list and a dynamic trigger condition by using the voice signal and the door lock response range;

[0113] A control module 44, configured to, when the dynamic trigger condition is satisfied, control the intelligent door lock to execute corresponding control operations according to the door lock task list.

[0114] In an optional implementation manner of the present application, the determination module 42 includes: an analysis sub-module and a matching sub-module;

[0115] The analysis sub-module is configured to analyze the environmental data to obtain the behavior pattern of the target user; if the behavior pattern is a static pattern, identify the spatial area where the target user is currently located according to the environmental data, and determine the door lock response range corresponding to the voice signal based on the spatial area; or, if the behavior pattern is a dynamic pattern, trigger a behavior prediction mechanism to predict the movement trajectory of the target user to obtain a prediction area, and determine the door lock response range corresponding to the voice signal based on the prediction area.

[0116] The matching sub-module is configured to obtain a pre-stored space-door lock mapping table in the intelligent door lock; determine the spatial area where the target user is currently located according to the environmental data; match the spatial area in the space-door lock mapping table to obtain the door lock response range corresponding to the spatial area.

[0117] In an optional implementation manner of the present application, the construction module 43 is configured to identify the voiceprint information and the instruction information in the voice signal; verify the voiceprint information to obtain a verification result; when the verification result is successful verification, construct a door lock task list and a dynamic trigger condition according to the instruction information and the door lock response range.

[0118] In an optional implementation manner of the present application, the construction module 43 includes an integration sub-module and a creation sub-module;

[0119] The integration sub-module is configured to extract the time parameter, the identity identifier, and the original instruction set in the instruction information; traverse the preset facial images in the intelligent door lock to obtain a first facial image associated with the identity identifier; construct a dynamic trigger condition by using the time parameter and the first facial image, and integrate the original instruction set and the door lock response range into a door lock task list.

[0120] The creation sub-module is configured to create an initial task list; for each intelligent door lock in the door lock response range, screen out at least one associated control instruction from the original instruction set; combine each intelligent door lock with the corresponding control instruction into a task item, and store multiple task items in the initial task list to obtain a door lock task list.

[0121] In an optional embodiment of the present application, the device further includes: a comparison module, configured to detect whether the current time reaches the time parameter in the dynamic trigger condition; when the time parameter in the dynamic trigger condition is reached, collect a second facial image of the person in front of the door through the outdoor monitoring device of the intelligent door lock; compare the second facial image with the first facial image in the dynamic trigger condition to obtain a comparison result; and determine whether the dynamic trigger condition is satisfied according to the comparison result.

[0122] Please refer to Figure 5 , Figure 5 which is a schematic structural diagram of a computer device provided by an optional embodiment of the present invention. As Figure 5 shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including a high-speed interface and a low-speed interface. Each component communicates with each other using different buses and can be installed on a common main board or installed in other ways as needed. The processor can process instructions executed within the computer device, including instructions stored in the memory or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a set of blade servers, or a multi-processor system).

[0123] The processor 10 can be a central processing unit, a network processor, or a combination thereof. Among them, the processor 10 can further include a hardware chip. The above hardware chip can be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The above programmable logic device can be a complex programmable logic device, a field programmable gate array, a general array logic, or any combination thereof.

[0124] Among them, the memory 20 stores instructions executable by at least one processor 10, so that at least one processor 10 executes the method shown in the above embodiments.

[0125] The memory 20 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of a computer device for the display of a kind of mini-program landing page, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some alternative embodiments, the memory 20 may optionally include a memory remotely provided with respect to the processor 10, and these remote memories can be connected to the computer device through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0126] The memory 20 may include a volatile memory, for example, a random access memory; the memory may also include a non-volatile memory, for example, a flash memory, a hard disk, or a solid-state drive; the memory 20 may further include a combination of the above types of memories.

[0127] The computer device further includes a communication interface 30 for the computer device to communicate with other devices or communication networks.

[0128] Embodiments of the present invention also provide a computer-readable storage medium. The methods according to the embodiments of the present invention can be implemented in hardware, firmware, or be implemented as computer code that can be recorded on a storage medium, or be implemented as computer code originally stored in a remote storage medium or a non-transitory machine-readable storage medium and to be downloaded through a network and stored in a local storage medium, so that the methods described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid-state drive, etc.; further, the storage medium may further include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code, and when the software or computer code is accessed and executed by the computer, the processor, or the hardware, the methods shown in the above embodiments are implemented.

[0129] Although the embodiments of the present invention are described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations all fall within the scope defined by the appended claims.

Claims

1. A smart door lock control method based on voice recognition, characterized in that: The method comprises: Collect voice signals and environmental data through indoor monitoring devices associated with smart door locks; Determine the location information of the target user according to the environmental data, and determine the door lock response range corresponding to the voice signal based on the location information; Using the voice signal and the door lock response range to construct a door lock task list and dynamic trigger conditions; When the dynamic trigger condition is met, the smart door lock is controlled to perform corresponding control operations according to the door lock task list.

2. The method according to claim 1, characterized in that The determining, based on the position information, a door lock response range corresponding to the voice signal includes: Analyze the environmental data to obtain the behavior pattern of the target user; If the behavior mode is a static mode, identifying the spatial area where the target user is currently located according to the environmental data, and determining the door lock response range corresponding to the voice signal based on the spatial area; Alternatively, if the behavior mode is a dynamic mode, the behavior prediction mechanism is triggered to predict the movement trajectory of the target user, obtain a predicted area, and determine the door lock response range corresponding to the voice signal based on the predicted area.

3. The method according to claim 2, characterized in that The identifying the spatial region where the target user is currently located according to the environmental data, and determining the door lock response range corresponding to the voice signal based on the spatial region, includes: Obtaining a space-door lock mapping table pre-stored in the smart door lock; Determine the spatial area where the target user is currently located according to the environmental data; The spatial area is matched in the space-door lock mapping table to obtain a door lock response range corresponding to the spatial area.

4. The method according to claim 1, characterized in that The method of using the voice signal and the door lock response range to construct a door lock task list and a dynamic trigger condition includes: Identifying voiceprint information and command information in the voice signal; Verifying the voiceprint information to obtain a verification result; When the verification result is successful, a door lock task list and a dynamic trigger condition are constructed according to the instruction information and the door lock response range.

5. The method according to claim 4, characterized in that The step of constructing a door lock task list and a dynamic trigger condition according to the instruction information and the door lock response range includes: Extracting the time parameter, identity identifier and original instruction set from the instruction information; Traversing the preset facial images in the smart door lock to obtain a first facial image associated with the identity identifier; The time parameter and the first facial image are used to construct a dynamic trigger condition, and the original instruction set and the door lock response range are integrated into a door lock task list.

6. The method according to claim 5, characterized in that The integrating the original instruction set and the door lock response range into a door lock task list includes: Create an initial task list; For each smart door lock in the door lock response range, filter out at least one associated control instruction from the original instruction set; Each of the smart door locks is combined with a corresponding control instruction into a task item, and a plurality of the task items are stored in the initial task list to obtain a door lock task list.

7. The method according to claim 1, characterized in that Before controlling the smart door lock to perform corresponding control operations according to the door lock task list, the method further includes: Detecting whether the current time reaches the time parameter in the dynamic trigger condition; When the time parameter in the dynamic trigger condition is met, a second facial image of the person in front of the door is collected by the outdoor monitoring device of the smart door lock; Comparing the second facial image with the first facial image in the dynamic trigger condition to obtain a comparison result; Determine whether the dynamic trigger condition is met according to the comparison result.

8. An intelligent door lock control device based on voice recognition, characterized in that: The device comprises: A monitoring module is used to collect voice signals and environmental data through indoor monitoring equipment associated with the smart door lock; A determination module, configured to determine the location information of the target user according to the environmental data, and determine the door lock response range corresponding to the voice signal based on the location information; A construction module, used to construct a door lock task list and a dynamic trigger condition using the voice signal and the door lock response range; A control module is used to control the smart door lock to perform corresponding control operations according to the door lock task list when the dynamic trigger condition is met.

9. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the method according to any one of claims 1 to 7 by executing the computer instructions.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 7.

Images