Intelligent home control method and system based on intelligent door lock, medium and product

Abstract

The invention provides an intelligent home control method and system based on an intelligent door lock, a medium and a product, and relates to the technical field of image recognition of intelligent home. And the intelligent door lock detects the existence of the user, carries out door lock permission verification based on an identity verification result, and screens out the user with the legal permission. In this way, active control can be changed into passive control, and the portable degree and the intelligent home atmosphere are improved. And after the permission verification is passed, acquiring a real-time image of the user, and judging whether a triggering behavior exists or not according to the image. If the triggering behavior exists, sending a corresponding triggering instruction, and enabling the smart home to adjust according to instruction parameters; and if no triggering behavior exists, a personalized matching instruction can be sent according to the identity verification result to guide adjustment. According to the method and the system, more possibilities are given to adjustment, so that the method and the system have richness like active adjustment, and various use requirements of users in different scenes are fully met.

Description

Technical Field

[0001] The present application relates to the field of image recognition technology for smart homes, and in particular to a smart home control method, system, medium and product based on a smart door lock. Background Art

[0002] Through intelligent network connection and interaction, smart homes transform traditional home appliances into smart devices capable of intelligent perception and automatic adjustment, thereby improving living comfort and allowing people to enjoy life easily.

[0003] Most of the mainstream smart home control systems on the market today rely on mobile phone apps or other similar central control devices to achieve control purposes. Take the mobile phone app as an example. When users use it for the first time, they need to pair and connect the various smart home devices in their home with the mobile phone app. After that, they can see the specific status of each device and the adjustable parameter options on the app. When you want to operate a certain device, just find the corresponding device icon on the APP interface, and then adjust the contents such as the switch status, operation mode, and specific parameters of the device according to the preset operation interface. If other central control devices are used, the operation logic is similar. Each smart home device is controlled through its operation panel or touch interface to achieve intelligent management of the entire home environment. This method does bring certain convenience to users during normal use.

[0004] However, in related technologies, users need to actively control and adjust smart homes, resulting in low portability and a poor smart home atmosphere. Summary of the invention

[0005] The present application provides a smart home control method, system, medium and product based on a smart door lock, which are used to improve portability and the smart atmosphere of a home.

[0006] In the first aspect, the present application provides a smart home control method based on a smart door lock, including: when the smart door lock detects a user, it authenticates the user and obtains an authentication result; the smart door lock verifies the door lock authority according to the authentication result; when the door lock authority verification passes, the smart door lock obtains a real-time image of the user; the smart door lock determines whether there is a trigger behavior in the real-time image; the trigger behavior is a trigger action pre-set by the user, and corresponds to a corresponding trigger instruction; if there is a trigger behavior, the smart door lock sends a trigger instruction corresponding to the trigger behavior to the smart home, and the trigger instruction is used to guide the smart home to make adjustments according to the parameters contained in the trigger instruction; if there is no trigger behavior, the smart door lock sends a personalized matching instruction to the smart home, the personalized matching instruction is determined according to the authentication result, and the personalized matching instruction is used to guide the smart home to make adjustments according to the parameters contained in the personalized matching instruction.

[0007] By adopting the above technical solution, the smart door lock detects the presence of the user, then starts the identity authentication process, conducts door lock permission verification based on the identity authentication results, and screens out users with legal permissions. Then the smart home is notified to start, so that active control can be changed to passive control, improving portability and home smart atmosphere. At the same time, when the permission verification is passed, the real-time image of the user is obtained, and then the image is used to determine whether there is a triggering behavior. In the case of a triggering behavior, the smart door lock can send the corresponding triggering instruction to the smart home, allowing the smart home to adjust according to the instruction parameters; if there is no triggering behavior, it can also send personalized matching instructions based on the identity authentication results to guide the adjustment. It gives more possibilities for adjustment, making it as rich as active adjustment, fully meeting the various usage needs of users in different scenarios, and further demonstrating the intelligence and practicality of the smart home system.

[0008] In combination with some embodiments of the first aspect, in some embodiments, the step of the smart door lock determining whether there is a triggering behavior in the real-time image specifically includes: the smart door lock obtains an action sequence of the real-time image, wherein the action sequence includes multiple action segments, each action segment corresponds to a user behavior feature within a preset sampling window; the smart door lock calculates the integrity parameters of each action segment in the action sequence; the smart door lock progressively merges the action segments in the action sequence whose integrity parameters exceed a preset integrity threshold, wherein: the smart door lock merges adjacent action segments whose integrity parameters exceed the preset integrity threshold; the smart door lock determines whether the integrity parameter of the merged target action segment exceeds the preset integrity threshold; if it exceeds the preset integrity threshold; the smart door lock regards the target action segment as an action segment, and executes the integrity parameter merge. The step of merging adjacent action fragments when the number of action fragments exceeds the preset integrity threshold; if it does not exceed the preset integrity threshold; the smart door lock cancels the merger and adds a forward restriction mark to the action fragment before the merger demarcation point; adds a backward restriction mark to the action fragment after the merger demarcation point; the forward restriction mark is used to prohibit the corresponding action fragment from merging forward; the backward restriction mark is used to prohibit the corresponding action fragment from merging backward; until all action fragments cannot be merged, a number of complete action sets are obtained; the smart door lock iteratively identifies trigger behaviors for the complete action set, wherein: the smart door lock removes complete actions from the complete action set in sequence; the smart door lock determines whether the removed complete action set is a trigger behavior; if it is not a trigger behavior, the step of removing complete actions from the complete action set in sequence is returned.

[0009] By adopting the above technical solution, the smart door lock first obtains the action sequence of the real-time image. This action sequence covers multiple action segments. Each action segment corresponds to the user behavior characteristics within the preset sampling window, and the user's series of actions are disassembled into analyzable units. Then the integrity parameters of each action segment are calculated to measure the completeness of the action segment and provide a basis for subsequent judgment. Then, progressive merging is performed. For action segments whose integrity parameters exceed the preset threshold, adjacent action segments are merged, and the merged situation is continuously iterated. If it does not meet the threshold, a restriction mark is added to avoid unreasonable merging until several complete action sets are obtained. Finally, through iterative trigger behavior recognition, complete actions are eliminated in time sequence to determine whether it is a trigger behavior. Effectively eliminate the interference of transition actions from the user entering the password to preparing the trigger behavior, lock the real trigger behavior, so that the smart home can respond accurately according to the user's intention, avoid erroneous operations caused by misjudgment, and make the entire control process smoother, more reasonable and efficient.

[0010] In combination with some embodiments of the first aspect, in some embodiments, after the step of passing the door lock authority verification, the method also includes: the smart door lock determines whether there are other people in the corresponding home through historical images and historical door lock authority verification results; if there are other people in the corresponding home, the smart door lock sends an impact area request to the smart home, so that the smart home sends the impact area; the impact area is determined by the smart home according to whether the controlled home is activated and the regional distribution information of the preset indoor scene; after receiving the impact area, the smart door lock determines whether the area connected to the smart door lock is included in the impact area; if it is included in the impact area, the control of the smart home is ended; if it is not included in the impact area, the smart door lock sends a trigger instruction corresponding to the trigger behavior to the smart home, specifically including: the smart door lock sends the trigger instruction corresponding to the trigger behavior and the connected area instruction to the smart home, the connected area instruction is used to guide the smart home to adjust the connected area according to the parameters contained in the trigger instruction; the step of the smart door lock sending a personalized matching instruction to the smart home, specifically including: the smart door lock sends a personalized matching instruction and a connected area instruction to the smart home, the connected area instruction is used to guide the smart home to adjust the connected area according to the parameters contained in the personalized matching instruction.

[0011] By adopting the above technical solution, after the door lock authority verification passes this node, the smart door lock starts the judgment process of other people in the home. If it is determined that there are other people, it will send an impact area request to the smart home. The smart home will determine the impact area based on whether the home controlled by itself is activated and the regional distribution information of the preset indoor scene. After receiving it, the smart door lock determines whether the area connected to itself is included in the impact area. If it is included, the control of the smart home is terminated to avoid interference with the smart home status in the area where the indoor user is located; if it is not included, when sending a trigger instruction or a personalized matching instruction, the connected area instruction will be attached to guide the smart home to adjust the corresponding area according to the parameters. In this way, by sensing the distribution of people in the home when a new user enters, and then reasonably controlling the adjustment range of the smart home, it is effectively avoided that the new user enters the room and arbitrarily changes the state of the comfortable environment of the indoor user, maintains the use experience of different users in different scenarios, and makes the control of the smart home more suitable for a variety of actual use scenarios, improving the overall practicality and user satisfaction.

[0012] In combination with some embodiments of the first aspect, in some embodiments, the step of the smart door lock determining whether there are other people in the corresponding home through historical images and historical door lock authority verification results specifically includes: the smart door lock obtains the last real-time image corresponding to the last door lock authority verification; the smart door lock extracts the direction determination results of all other people from the last real-time image to obtain an entry event; the smart door lock obtains the last exit image that was not verified by the door lock authority; the smart door lock extracts the direction determination results of all other people from the exit image to obtain an exit event; the smart door lock performs a difference operation on the entry event and the exit event; the smart door lock determines whether there are other people in the corresponding home based on the difference operation result.

[0013] By adopting the above technical solution, the smart door lock will obtain the last real-time image corresponding to the last door lock permission verification, and carefully extract the direction determination results of all other people from the real-time image, so as to accurately determine the door entry event and clearly understand the situation of people entering the room. At the same time, the smart door lock will also obtain the last exit image that has not been verified by the door lock permission, and also use the corresponding technology to extract the direction determination results of all other people from the exit image, so as to clarify the exit event and grasp the relevant situation of the person leaving the room. Subsequently, the obtained entry event and exit event are subtracted to determine whether there are other people in the corresponding home at the moment. Real-time control of the situation of people in the home is achieved in a logically clear and efficient way, which provides a reliable basis for the subsequent reasonable control of the smart home status and avoidance of affecting the comfort environment of users who are already indoors.

[0014] In combination with some embodiments of the first aspect, in some embodiments, after the step of the smart door lock obtaining the real-time image of the user, it also includes: the smart door lock determines whether there is a follower other than the user through the real-time image; if there is a follower; the smart door lock authenticates the follower and obtains the follower identity authentication result; the smart door lock performs door lock authority verification based on the follower identity authentication result; if the door lock authority verification passes, the smart door lock sends a first common instruction to the smart home, the first common instruction is the intersection of the instruction set corresponding to the identity authentication result and the instruction set corresponding to the follower identity authentication result, and the first common instruction is used to guide the smart home to make adjustments according to the parameters contained in the first common instruction.

[0015] By adopting the above technical solution, after obtaining the real-time image of the user, the smart door lock will use the image to determine whether there are any followers other than the user. This judgment link plays a key role in discovering other accompanying persons. If there are followers, identity verification and door lock permission verification will be carried out in turn. These two verification processes are like layers of checks to ensure the legitimacy of the people entering. Then, the first common instruction is formed by taking the intersection of the instruction set corresponding to the identity verification result and the instruction set corresponding to the follow-up identity verification result. Based on this instruction, the smart home is adjusted, fully considering the situation of multiple users, avoiding the dominance of only the user who opens the door, and improving the overall user experience.

[0016] In combination with some embodiments of the first aspect, in some embodiments, after the step of the smart door lock obtaining the real-time image of the user, it also includes: the smart door lock determines whether there is a follower other than the user through the real-time image; if there is a follower, the smart door lock authenticates the follower and obtains the follower identity authentication result; the smart door lock performs door lock authority verification based on the follower identity authentication result; if the door lock authority verification passes, the smart door lock sends a second common instruction to the smart home, the second common instruction is determined by the setting parameters of the smart home when the user and the follower are present at the same time, and the second common instruction is used to guide the smart home to make adjustments according to the parameters contained in the second common instruction.

[0017] By adopting the above technical solution, the smart door lock starts the process of determining the follower after acquiring the real-time image. Once a follower is found, identity authentication and door lock authority verification will be performed to lay the foundation for subsequent reasonable control. When the authority verification is passed, a second common instruction determined by the simultaneous presence of the user and the follower will be generated. Compared with the first common instruction that takes the intersection of the instruction set corresponding to the identity authentication result and the instruction set corresponding to the follower identity authentication result, the second common instruction avoids the embarrassing situation that there may be no intersection, resulting in the inability to generate effective instructions. By focusing on the actual operation of the smart home in the past when more than two people are present at the same time, the parameters are determined, ensuring the effective generation of instructions, and can more stably and reliably guide the smart home to make adjustments that meet the needs of multiple people, fully taking into account the expectations of all users entering the room, and improving the rationality of the overall smart home control and user experience.

[0018] In combination with some embodiments of the first aspect, in some embodiments, the second common instruction is determined by the steps of setting parameters of the smart home when the user and the follower are present at the same time, specifically including: the smart home obtains the time period when the user and the follower are present at the same time; the smart home obtains the historical operating parameters within the time period; the smart home performs statistical analysis on the historical operating parameters according to the setting frequency to obtain the parameter frequency distribution; and selects the parameter combination with the highest frequency in the parameter frequency distribution as the included parameters of the second common instruction.

[0019] By adopting the above technical solution, the smart home will accurately lock the time period when the user and the followers are present at the same time, and obtain the historical operating parameters within the time period. These parameters carry key information about the actual operating status of the smart home when multiple people were present at the same time in the past. Then, these historical operating parameters are statistically analyzed according to the setting frequency to obtain the parameter frequency distribution, and finally the parameter combination with the highest frequency in the parameter frequency distribution is selected as the included parameters of the second common instruction. This method based on statistical analysis of actual operating data can fully generate reasonable and effective instructions based on the past usage habits of multiple people.

[0020] In a second aspect, the present application provides a smart home control system implemented based on a smart door lock, the smart home control system implemented based on the smart door lock comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, the one or more processors call the computer instructions to enable the smart home control system implemented based on the smart door lock to execute the method described in the first aspect and any possible implementation method of the first aspect.

[0021] In a third aspect, the present application provides a computer program product comprising instructions. When the computer program product is run on a smart home control system implemented based on a smart door lock, the smart home control system implemented based on the smart door lock executes the method described in the first aspect and any possible implementation method of the first aspect.

[0022] In a fourth aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on a smart home control system implemented based on a smart door lock, enables the smart home control system implemented based on the smart door lock to execute the method described in the first aspect and any possible implementation method of the first aspect.

[0023] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. The smart door lock detects the presence of the user, then starts the identity authentication process, performs door lock permission verification based on the identity authentication results, and screens out users with legal permissions. Then the smart home is notified to start, so that active control can be changed to passive control, improving portability and home smart atmosphere. At the same time, when the permission verification is passed, the real-time image of the user is obtained, and then the image is used to determine whether there is a triggering behavior. In the case of a triggering behavior, the smart door lock can send the corresponding triggering instruction to the smart home, allowing the smart home to adjust according to the instruction parameters; if there is no triggering behavior, it can also send personalized matching instructions based on the identity authentication results to guide the adjustment. It gives more possibilities for adjustment, making it as rich as active adjustment, fully meeting the various usage needs of users in different scenarios, and further demonstrating the intelligence and practicality of the smart home system.

[0024] 2. The smart door lock first obtains the action sequence of the real-time image. This action sequence covers multiple action segments. Each action segment corresponds to the user behavior characteristics within the preset sampling window, and the user's series of actions are disassembled into analyzable units. Then the integrity parameters of each action segment are calculated to measure the completeness of the action segment and provide a basis for subsequent judgment. Then, progressive merging is performed. For action segments whose integrity parameters exceed the preset threshold, adjacent action segments are merged, and the merged situation is continuously iterated. If it does not meet the threshold, a restriction mark is added to avoid unreasonable merging until several complete action sets are obtained. Finally, through iterative trigger behavior recognition, complete actions are eliminated in time sequence to determine whether it is a trigger behavior. Effectively eliminate the interference of transition actions from the user entering the password to preparing for the trigger behavior, lock the real trigger behavior, so that the smart home can respond accurately according to the user's intention, avoid erroneous operations caused by misjudgment, and make the entire control process smoother, more reasonable and efficient.

[0025] 3. After the door lock authority verification passes this node, the smart door lock starts the judgment process of other people in the home. If it is determined that there are other people, it will send an impact area request to the smart home. The smart home will determine the impact area based on whether the home it controls is activated and the regional distribution information of the preset indoor scene. After receiving it, the smart door lock determines whether the area connected to itself is included in the impact area. If it is included, the control of the smart home is terminated to avoid interference with the smart home status in the area where the indoor user is located; if it is not included, when sending a trigger command or a personalized matching command, the connected area command will be attached to guide the smart home to adjust the corresponding area according to the parameters. In this way, by sensing the distribution of people in the home when a new user enters, and then reasonably controlling the adjustment range of the smart home, it effectively avoids the new user from arbitrarily changing the state of the comfortable environment of the indoor user when entering the room, maintaining the user experience of different users in different scenarios, making the control of the smart home more suitable for a variety of actual usage scenarios, and improving the overall practicality and user satisfaction.

[0026] 4. After the smart door lock obtains the real-time image, it starts to judge the follower. Once a follower is found, identity authentication and door lock authority verification will be carried out to lay the foundation for subsequent reasonable control. When the authority verification is passed, a second common instruction determined by the simultaneous presence of the user and the follower will be generated. Compared with the first common instruction, which takes the intersection of the instruction set corresponding to the identity authentication result and the instruction set corresponding to the follower identity authentication result, the second common instruction avoids the embarrassing situation that there may be no intersection, resulting in the inability to generate effective instructions. By focusing on the actual operation of the smart home in the past when more than two people are present at the same time, the parameters are determined by comprehensive considerations such as the actual operation of the smart home in the past, which ensures the effective generation of instructions, and can more stably and reliably guide the smart home to make adjustments that meet the needs of multiple people, fully taking into account the expectations of all users entering the room, and improving the rationality of the overall smart home control and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is a flow chart of a smart home control method implemented based on a smart door lock in an embodiment of the present application; Figure 2 yes Figure 1 A schematic diagram of a specific flow chart of step S104; Figure 3 is another flow chart of the smart home control method implemented based on the smart door lock in the embodiment of the present application; Figure 4 is another flow chart of the smart home control method implemented based on the smart door lock in the embodiment of the present application; Figure 5is another flow chart of the smart home control method implemented based on the smart door lock in the embodiment of the present application; Figure 6 It is an exemplary hardware structure diagram of a smart home control system implemented based on a smart door lock in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items.

[0029] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0030] See also Figure 1 , Figure 1 It is a flow chart of a smart home control method implemented based on a smart door lock in an embodiment of the present application; A smart home control method based on a smart door lock, comprising: S101, when the smart door lock detects a user, it authenticates the user and obtains an authentication result; Among them, the identity authentication result is used to represent the comprehensive judgment conclusion obtained after the above identity authentication process, which includes two important dimensions: one is to determine whether the user has the authority to unlock the door, and the other is to clarify the specific identity corresponding to the user.

[0031] Specifically, when the smart door lock uses its built-in sensing devices, such as infrared sensors, proximity sensors, etc., to detect that a user appears in front of the door, that is, when it determines that someone is approaching and preparing to enter, the corresponding verification method is started according to the user's operation. If the user chooses fingerprint unlocking, the smart door lock will collect the image data of the current pressed fingerprint, and then compare it with the stored fingerprint data of the legitimate user. This method can simultaneously obtain whether the user has the right to unlock and who the specific identity of the user is; if it is unlocked by password, it will determine whether the entered password is consistent with the preset password. At this time. After these corresponding verification operations, the identity authentication result is finally obtained to determine whether the user has the right to enter.

[0032] It should be noted that, in some embodiments, even if the verification fails, the corresponding result status will be clearly reflected, such as feedback such as lack of unlocking authority and empty identity set.

[0033] S102, the smart door lock performs door lock authority verification according to the identity verification result; Continuing with the above example, the identity authentication result includes determining whether the user has the permission to unlock the door.

[0034] S103, when the door lock authority verification is passed, the smart door lock obtains the real-time image of the user; Specifically, after completing the permission verification and passing the judgment, the smart door lock will immediately activate its built-in image acquisition module. Generally, the camera will be turned on to capture the user's current image from a suitable angle to ensure that the user's real-time image can be obtained clearly and completely.

[0035] S104, the smart door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to a corresponding triggering instruction; Among them, trigger behavior refers to specific actions that users set in the smart home system in advance according to their needs and usage habits. These actions have clear definitions and styles, such as raising your hand and waving, specific gestures, etc., and each trigger behavior corresponds to a corresponding trigger instruction. The trigger instruction is used to tell the smart home what specific operation needs to be performed and the relevant parameters of the operation. For example, the trigger instruction can be to brighten the lights to a certain brightness value, or to open the curtains to a certain degree.

[0036] Specifically, the smart door lock will analyze the user's actions in the real-time image frame by frame, extracting key feature information such as the user's body movements and posture changes, and then compare these extracted feature information with the trigger behavior features pre-set by the user to see if there is a match, so as to determine whether there is a trigger behavior in the real-time image.

[0037] In some specific embodiments, the smart door lock first splits the real-time image into image frames in chronological order, and then performs edge detection, contour extraction and other operations on each frame to obtain the user's appearance profile information in the image. Based on the appearance profile information, the user's action changes in the continuous frame images are analyzed to construct an action sequence, such as the start, duration, and change amplitude of the action. The constructed action sequence is matched and compared with the standard action sequence corresponding to the preset trigger behavior. If the match is successful, it is determined that the real-time image has a trigger behavior. If the match fails, it is determined that there is no trigger behavior. This is not limited here.

[0038] S105: If there is a triggering behavior, the smart door lock sends a triggering instruction corresponding to the triggering behavior to the smart home, and the triggering instruction is used to guide the smart home to make adjustments according to the parameters contained in the triggering instruction; Specifically, through the communication link established with the smart home system, a trigger instruction is sent to the corresponding smart home device, so that after receiving the instruction, the smart home device performs corresponding adjustment operations according to the parameters contained in the instruction to achieve automatic control.

[0039] S106: If there is no triggering behavior, the smart door lock sends a personalized matching instruction to the smart home. The personalized matching instruction is determined according to the identity authentication result. The personalized matching instruction is used to guide the smart home to make adjustments according to the parameters included in the personalized matching instruction.

[0040] Among them, personalized matching instructions refer to instructions generated based on the user's identity authentication results and combined with information such as the personalized preferences previously set by the user, which are used to guide smart home devices to make corresponding adjustments. They can be default instructions set by the user, default instructions for different time periods, the user's most commonly used parameter sets, etc.

[0041] For example, in terms of lighting control, users may set the lighting brightness, color and other parameters when entering the room to specific default instructions based on their daily habits, such as using softer warm yellow lights and adjusting the brightness to 50%, which becomes part of the personalized matching instructions; for example, users can set corresponding default instructions for different time periods. When entering the room at night, they hope that the smart speaker will automatically play soothing light music, which will also be included in the category of personalized matching instructions; for example, the smart home system, through statistical analysis of users' past operation data, finds that a certain parameter combination of certain devices is the most frequently used by users, and these most frequently used instruction parameters are the default instructions.

[0042] It can be seen that the smart door lock detects the presence of the user, then starts the identity authentication process, conducts door lock permission verification based on the identity authentication results, and screens out users with legal permissions. Then the smart home is notified to start, so that active control can be changed to passive control, improving portability and home intelligence atmosphere. At the same time, when the permission verification is passed, the real-time image of the user is obtained, and then the image is used to determine whether there is a triggering behavior. In the case of a triggering behavior, the smart door lock can send the corresponding triggering instruction to the smart home, allowing the smart home to adjust according to the instruction parameters; if there is no triggering behavior, it can also send personalized matching instructions based on the identity authentication results to guide the adjustment. It gives more possibilities for adjustment, making it as rich as active adjustment, fully meeting the various usage needs of users in different scenarios, and further demonstrating the intelligence and practicality of the smart home system.

[0043] In actual application scenarios, smart door locks undertake basic and critical tasks such as password input. According to the above embodiment, after the user enters the password, the smart door lock will obtain the user's real-time image to further determine whether there is a triggering behavior. However, during the transition period from the user completing the password input to preparing to make a preset triggering behavior. During this period, the user may have various natural actions, and these transition actions are mixed with the triggering behavior, making it difficult to accurately identify the triggering behavior.

[0044] See also Figure 2 , Figure 2 yes Figure 1 A schematic diagram of a specific flow chart of step S104; Therefore, in some embodiments, step S104 specifically includes: S201, the smart door lock acquires an action sequence of a real-time image, wherein the action sequence includes a plurality of action segments, each action segment corresponds to a user behavior feature within a preset sampling window; Specifically, the smart door lock divides the time interval according to the preset sampling window duration, starting from the start moment of the image, extracts the behavioral characteristics of the user in each time interval, and organizes these behavioral characteristics based on different sampling windows into corresponding action fragments. These action fragments are then combined in chronological order to form an action sequence, thereby breaking down the user's more complex continuous actions into small units that are convenient for subsequent analysis and processing, laying the foundation for accurately judging the triggering behavior.

[0045] S201, the smart door lock calculates the integrity parameters of each action segment in the action sequence; Among them, the integrity parameter refers to a numerical indicator used to quantitatively evaluate the completeness of each action segment. It comprehensively considers multiple factors such as the start, duration, continuity of the action involved in the action segment, and whether the key action elements are complete, so as to judge whether the action segment meets the standards of a relatively complete and effective behavior unit.

[0046] Specifically, for each action segment in the action sequence, its integrity can be comprehensively judged from the following multiple dimensions to determine the integrity parameters: Movement trajectory continuity: Detailed analysis of the movement trajectory continuity of the action segment. When the movement trajectory is smooth without obvious pauses or mutations during execution, it indicates that the movement continuity is strong, which means that the movement segment is more in line with the normal and complete behavior pattern, and a higher integrity parameter can be assigned at this time; on the contrary, if the trajectory has obvious interruptions, jumps or irregular turns, it means that the movement continuity is poor, and its integrity parameter should be reduced accordingly.

[0047] Acceleration of motion speed: Focus on the change in speed of the action clip during the motion process, that is, acceleration. Acceleration reflects the degree of change in the speed of the action. When the acceleration is greater than the preset upper threshold, it may mean that the action has a sudden acceleration and does not conform to the smoothness of normal behavior; when the acceleration is less than the preset lower threshold, it may mean that the action is too slow or there is an abnormal pause. In both cases, the integrity of the action clip will be affected and the integrity parameter should be lowered.

[0048] Track angle change rate: Evaluate the integrity of the action by analyzing the angle change rate of the action track. The angle change rate reflects the speed of the change of the direction of the action. If the angle change rate is too large, it means that the direction of the action changes frequently and drastically, which may not conform to the logic and continuity of the normal action; if the angle change rate is too small, it may mean that the action is too rigid and lacks flexibility. According to the comparison between the angle change rate and the reasonable range, adjust the integrity parameters accordingly.

[0049] S203, the smart door lock progressively merges the action segments whose integrity parameters exceed the preset integrity threshold in the action sequence, wherein: S2031, the action segments whose integrity parameters of the smart door lock exceed the preset integrity threshold are merged with adjacent action segments; Specifically, first determine the position of the action segment whose integrity parameter exceeds the threshold in the entire action sequence, and then check whether its adjacent action segments (previous and next) meet the conditions for merging. The merging conditions here are that the adjacent action segments themselves are not merged and have no restriction marks (such as forward restriction marks or backward restriction marks). After these conditions are met, the smart door lock will merge the current action segment with the adjacent action segment and regenerate a new target action segment.

[0050] S2032, the smart door lock determines whether the integrity parameter of the merged target action segment exceeds a preset integrity threshold; S2033: If the preset integrity threshold is exceeded, the smart door lock regards the target action segment as an action segment and executes step S2031; S2034, if it does not exceed the preset integrity threshold; the smart door lock cancels the merge, and adds a forward restriction mark to the action segment before the merge demarcation point; adds a backward restriction mark to the action segment after the merge demarcation point; the forward restriction mark is used to prohibit the corresponding action segment from merging forward; the backward restriction mark is used to prohibit the corresponding action segment from merging backward; Specifically, the position of the current target action fragment that does not meet the integrity threshold in the action sequence will be located first, and then the corresponding merge demarcation point will be found according to the previously merged records to clarify which two action fragments have been merged before. Next, the smart door lock will perform the undo merge operation, disassemble the merged target action fragment into the original two independent action fragments, and restore their original behavioral feature data and integrity parameters and other information. After that, a forward restriction flag is added to the action fragment before the merge demarcation point (that is, the previous action fragment originally involved in the merge), for example, a Boolean field is added to its data structure and assigned a value of true, indicating that it is prohibited from merging forward; at the same time, a backward restriction flag is added to the action fragment after the merge demarcation point (the next action fragment originally involved in the merge), and the corresponding Boolean value is also set to true to prevent it from merging backwards, so as to avoid unreasonable merging again in the subsequent analysis process.

[0051] S2035, until all action segments cannot be merged, and several complete action sets are obtained; S204, the smart door lock performs iterative trigger behavior recognition on the complete action set, wherein: S2041, the smart door lock removes complete actions from the complete action set in chronological order; Specifically, the smart door lock starts with the earliest complete action and removes it from the complete action set in sequence. Each time a complete action is removed, the remaining complete action set will be subjected to subsequent trigger behavior judgment operations to see whether the preset trigger behavior can be found in the remaining actions. By eliminating actions in chronological order, the scope of the analyzed actions is continuously adjusted, and actions that may not be trigger behaviors are gradually eliminated, thereby improving the accuracy and efficiency of trigger behavior recognition.

[0052] S2042, the smart door lock determines whether the complete action set after elimination is a triggering behavior; It should be noted that the principle and process of this step are similar to those of step S104. The relevant principles and processes can refer to step S104 and are not limited here.

[0053] S2043: If it is not a triggering behavior, return to step S2041.

[0054] It can be seen that the smart door lock first obtains the action sequence of the real-time image. This action sequence covers multiple action segments. Each action segment corresponds to the user behavior characteristics within the preset sampling window, and the user's series of actions are disassembled into analyzable units. Then the integrity parameters of each action segment are calculated to measure the completeness of the action segment and provide a basis for subsequent judgment. Then, progressive merging is performed. For action segments whose integrity parameters exceed the preset threshold, adjacent action segments are merged, and the merged situation is continuously iterated. If it does not meet the threshold, a restriction mark is added to avoid unreasonable merging until several complete action sets are obtained. Finally, through iterative trigger behavior recognition, complete actions are eliminated in time sequence to determine whether it is a trigger behavior. Effectively eliminate the interference of transition actions from the user entering the password to preparing the trigger behavior, lock the real trigger behavior, so that the smart home can respond accurately according to the user's intention, avoid erroneous operations caused by misjudgment, and make the entire control process smoother, more reasonable and efficient.

[0055] In daily actual use scenarios, the following situation often occurs: when a new user enters the room, it often affects the user experience of the users who are already indoors to a certain extent. These changes may not be in line with the current needs and preferences of the users who are already indoors. The users who are already indoors may be in a comfortable environment, engaged in activities such as reading and resting. The adjustment of the smart home state caused by the entry of new users breaks the original comfortable state, forcing them to readjust the relevant equipment, which undoubtedly brings inconvenience to the users who are already indoors and reduces the overall user satisfaction.

[0056] See also Figure 3 , Figure 3 is another flow chart of the smart home control method implemented based on the smart door lock in the embodiment of the present application; Therefore, in some other embodiments, the smart home control method based on the smart door lock includes: S301: When the smart door lock detects a user, it authenticates the user and obtains an authentication result; S302, the smart door lock performs door lock authority verification according to the identity verification result; S303: When the door lock authority verification is passed, the smart door lock obtains the real-time image of the user; S304, the smart door lock determines whether there are other people in the corresponding home through historical images and historical door lock permission verification results; Specifically, the smart door lock will call its internally stored historical image data and historical door lock permission verification results for analysis. For historical images, the smart door lock will use image recognition technology to identify whether there are people in the image and the characteristic information of the people. At the same time, combined with the historical door lock permission verification results, check which users successfully entered the room at different time points to infer whether there are other people in the home at the current moment. For example, if the historical image shows that there were people active in the room not long ago, and the historical door lock permission verification results do not show the record of the person leaving, then it can be judged that there are other people in the room. Through this judgment, it provides a basis for subsequent operations such as sending impact area requests to the smart home, ensuring that the control of the smart home can fully consider the actual situation of the people indoors.

[0057] In some specific embodiments, step S304 specifically includes: S3041, the smart door lock obtains the last real-time image corresponding to the last time the door lock authority verification passed; S3042, the smart door lock extracts the direction determination results of all other persons from the last real-time image to obtain the door entry event; Specifically, the smart door lock uses the target detection algorithm to identify all people in the image, and distinguish which are the current users who are verifying permissions and which are other people. Then, for these other people, the posture recognition algorithm is used to analyze their body movements, such as the direction of the body, the direction of the footsteps, etc., and at the same time, combined with their position in the image (whether they are inside or outside the door, which side of the door they are close to, etc.), the direction determination results of each other person are comprehensively judged, that is, whether they are entering or leaving the room. Finally, the direction determination results of all other people are integrated to form a complete record of the door entry event. It should be noted that one person entering the door once is an entry event.

[0058] S3043, the smart door lock obtains the last exit image that was not verified by the door lock authority; Among them, the last exit image without door lock permission verification refers to the image information collected by the smart door lock before the most recent door lock permission verification, which has not gone through the normal door lock permission verification process but shows people moving from indoors to outdoors. These images record possible situations of people leaving the room. For example, within a certain period of time, someone directly opened the door and went out from the room without passing the identity authentication link of the smart door lock. The image of this process collected by the smart door lock at that time is the last exit image without door lock permission verification. It can help analyze the people's going out situation and provide a reference for judging whether there are other people remaining in the room.

[0059] S3044, the smart door lock extracts the direction determination results of all other persons from the exit image to obtain an exit event; It should be noted that the principle and process of this step are similar to those of step S3042. The relevant principles and processes can be referred to step S3042 and will not be repeated here.

[0060] S3045, the smart door lock performs difference calculation on the door entry event and the door exit event; Specifically, the total number of people in the door entry event is used as the minuend, and the total number of people in the door exit event is used as the subtrahend, and a subtraction operation is performed to obtain a difference operation result.

[0061] S3046. The smart door lock determines whether there are other people in the corresponding home based on the difference calculation result.

[0062] Specifically, if the difference calculation result is greater than 0, it means that the number of people entering the room during the statistical time period is greater than the number of people leaving, so it can be preliminarily determined that there are likely to be other people in the corresponding home; if the difference calculation result is equal to 0, it means that the number of people entering and leaving the room is the same, and it can be preliminarily determined that there are no other people in the corresponding home.

[0063] It can be seen that the smart door lock will obtain the last real-time image corresponding to the last door lock permission verification, and carefully extract the direction determination results of all other people from the real-time image, so as to accurately determine the door entry event and clearly understand the situation of people entering the room. At the same time, the smart door lock will also obtain the last exit image that has not been verified by the door lock permission, and also use the corresponding technology to extract the direction determination results of all other people from the exit image, so as to clarify the exit event and grasp the relevant situation of the person leaving the room. Subsequently, the obtained entry event and exit event are subtracted to determine whether there are other people in the corresponding home at the moment. Real-time control of the situation of people in the home is achieved in a logically clear and efficient way, which provides a reliable basis for the subsequent reasonable control of the smart home status and avoidance of affecting the comfort environment of users who are already indoors.

[0064] S305. If there are other people in the corresponding home, the smart door lock sends an impact area request to the smart home, so that the smart home sends the impact area; the impact area is determined by the smart home according to whether the controlled home is activated and the regional distribution information of the preset indoor scene; In some embodiments, the smart home will first conduct a detailed check on the activation status of the various home appliances it controls to identify which home appliances are currently in operation, on, and other activation states. Then, with the help of the association recognition function, the specific locations of these activated home appliances are accurately locked. On this basis, the regional distribution information of the preset indoor scenes is referred to. This information details the functions and scope definitions of different areas in various scenarios. By comprehensively analyzing these factors, the smart home system can accurately determine the area where other people already indoors may be affected by the entry of new users, which is the so-called impact area.

[0065] S306: After receiving the affected area, the smart door lock determines whether the area connected to the smart door lock is included in the affected area; Specifically, the smart door lock will compare the area information of its own connection with the received impact area information. If all parts of the area connected to the smart door lock are within the scope of the impact area, it means that the area may have an impact on people already in the room, and further control strategies need to be considered; if it is not included in the impact area, the subsequent trigger behavior judgment and control operations can be carried out according to the normal process.

[0066] S307: If it is included in the affected area, then end the control of the smart home; S308: If it is not included in the affected area, the smart door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to the corresponding triggering instruction; S309: If there is a triggering behavior, the smart door lock sends a triggering instruction corresponding to the triggering behavior and a connected area instruction to the smart home, where the connected area instruction is used to guide the smart home to adjust the connected area according to the parameters included in the triggering instruction; Among them, the connected area instruction is a command specifically used to limit the control range. The connected area here refers to the specific spatial range with which the smart door lock establishes a connection and can achieve effective control. For example, the smart door lock is installed in the living room, and its connected area is the living room area, which means that subsequent control operations will only adjust the smart home devices in this specific living room area without affecting the device status in other areas.

[0067] S310: If there is no triggering behavior, the smart door lock sends a personalized matching instruction and a connected area instruction to the smart home, and the connected area instruction is used to guide the smart home to adjust the connected area according to the parameters included in the personalized matching instruction.

[0068] It can be seen that after the door lock authority verification passes this node, the smart door lock starts the judgment process of other people in the home. If it is determined that there are other people, it will send an impact area request to the smart home. The smart home will determine the impact area based on whether the home it controls is activated and the regional distribution information of the preset indoor scene. After receiving it, the smart door lock determines whether the area connected to itself is included in the impact area. If it is included, the control of the smart home is terminated to avoid interference with the smart home status in the area where the indoor user is located; if it is not included, when sending a trigger command or a personalized matching command, the connected regional command will be attached to guide the smart home to adjust the corresponding area according to the parameters. In this way, by sensing the distribution of people in the home when a new user enters, and then reasonably controlling the adjustment range of the smart home, it effectively avoids the new user from arbitrarily changing the state of the comfortable environment of the indoor user when entering the room, maintaining the user experience of different users in different scenarios, making the control of the smart home more suitable for a variety of actual usage scenarios, and improving the overall practicality and user satisfaction.

[0069] In real life, we often encounter situations where multiple users enter a room at the same time. When controlling smart homes, current smart door locks often take the user who opens the door as the dominant one. However, this control method obviously does not fully consider the needs and expectations of other users who enter the room together. It may not be able to meet the personalized needs of other users, causing some users to spend extra time manually adjusting the device status after entering the room, making it impossible to fully reflect the convenience and intelligent advantages of smart homes, affecting the overall user experience.

[0070] See also Figure 4 , Figure 4 is another flow chart of the smart home control method implemented based on the smart door lock in the embodiment of the present application; A smart home control method based on a smart door lock, comprising: S401: When the smart door lock detects a user, it authenticates the user and obtains an authentication result; S402, the smart door lock performs door lock authority verification according to the identity verification result; S403: When the door lock authority verification is passed, the smart door lock obtains the real-time image of the user; S404, the smart door lock determines whether there is a follower other than the user through the real-time image; Specifically, the smart door lock identifies all individuals in the image and determines whether the number is greater than 2.

[0071] S405: If there is a follower, the smart door lock performs identity authentication on the follower and obtains a follower identity authentication result; Specifically, the smart door lock will start the corresponding identity verification process for each individual identified as a follower. Taking face recognition as an example, the smart door lock will start the camera to shoot the face of the follower to obtain a clear facial image, and then use the built-in face recognition algorithm to compare the image with the locally stored database of legal user facial images to see if there is a matching image. If the match is successful, the follower's verification method is passed.

[0072] S406, the smart door lock performs door lock authority verification according to the follow-up identity verification result; S407, the smart door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to the corresponding triggering instruction; S408: If there is a triggering behavior, the smart door lock sends a triggering instruction corresponding to the triggering behavior to the smart home, and the triggering instruction is used to guide the smart home to make adjustments according to the parameters contained in the triggering instruction; S409. If there is no triggering behavior, the smart door lock sends a first common instruction to the smart home. The first common instruction is the intersection of the instruction set corresponding to the identity authentication result and the instruction set corresponding to the follow-up identity authentication result. The first common instruction is used to guide the smart home to make adjustments according to the parameters contained in the first common instruction.

[0073] Specifically, it is carried out under the scenario of creating an indoor environment that is relatively satisfactory to everyone by taking into account the rights and preferences of all parties. The smart door lock will first extract the instruction set corresponding to the identity authentication result. It should be noted that this instruction set contains multiple sets of instructions. The smart door lock will perform an intersection operation on the two instruction sets, that is, find the set of instructions that exist in both instruction sets. The operation parameters involved in these instructions are the content that can meet the needs of both the main user and the followers.

[0074] It can be seen that after obtaining the real-time image of the user, the smart door lock will use the image to determine whether there are any followers other than the user. This judgment link plays a key role in discovering other accompanying persons. If there are followers, identity verification and door lock permission verification will be carried out in turn. These two verification processes are like layers of checks to ensure the legitimacy of the person entering. Then, the first common instruction is formed by taking the intersection of the instruction set corresponding to the identity verification result and the instruction set corresponding to the follow-up identity verification result. Based on this instruction, the smart home is adjusted, fully considering the situation of multiple users, avoiding the dominance of only the user who opens the door, and improving the overall user experience.

[0075] See also Figure 5 , Figure 5 is another flow chart of the smart home control method implemented based on the smart door lock in the embodiment of the present application; In some embodiments, a smart home control method based on a smart door lock includes: S501: When the smart door lock detects a user, it authenticates the user and obtains an authentication result; S502, the smart door lock performs door lock authority verification according to the identity verification result; S503: When the door lock authority verification is passed, the smart door lock obtains a real-time image of the user; S504, the smart door lock determines whether there is a follower other than the user through the real-time image; Specifically, the smart door lock identifies all individuals in the image and determines whether the number is greater than 2.

[0076] S505. If there is a follower, the smart door lock performs identity authentication on the follower and obtains a follower identity authentication result; S506, the smart door lock performs door lock authority verification according to the follow-up identity verification result; S507, the smart door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to the corresponding triggering instruction; S508: If there is a triggering behavior, the smart door lock sends a triggering instruction corresponding to the triggering behavior to the smart home, and the triggering instruction is used to guide the smart home to make adjustments according to the parameters contained in the triggering instruction; S509. If there is no triggering behavior, the smart door lock sends a second common instruction to the smart home. The second common instruction is determined by the setting parameters of the smart home when the user and the follower are present at the same time. The second common instruction is used to guide the smart home to adjust according to the parameters contained in the second common instruction.

[0077] Specifically, after determining that there is no triggering behavior, the smart door lock will first query the local storage or the storage area associated with the smart home system for the record information about the setting parameters of the smart home devices when the user and the follower were present at the same time in the past. This query process may involve multi-dimensional retrieval methods such as time and personnel identification to accurately locate the corresponding historical data. For example, the smart door lock will search the local historical usage record database for the average value or the most frequently occurring stable value of the equipment parameters such as the brightness of the living room light and the air conditioning temperature every time the user and the follower enter the room at the same time in the past week. Then, the smart door lock will classify and sort according to the device type based on the parameter information found, and organize the brightness parameters of the living room light together to form a complete set of instructions, namely the second common instruction.

[0078] It can be seen that the smart door lock starts the process of judging the follower after acquiring the real-time image. Once a follower is found, identity authentication and door lock authority verification will be carried out to lay the foundation for subsequent reasonable control. When the authority verification is passed, a second common instruction determined by the simultaneous presence of the user and the follower will be generated. Compared with the first common instruction, which takes the intersection of the instruction set corresponding to the identity authentication result and the instruction set corresponding to the follower identity authentication result, the second common instruction avoids the embarrassing situation that there may be no intersection, resulting in the inability to generate effective instructions. By focusing on the actual operation of the smart home in the past when more than two people are present at the same time, the parameters are determined, ensuring the effective generation of instructions, and can more stably and reliably guide the smart home to make adjustments that meet the needs of multiple people, fully taking into account the expectations of all users entering the room, and improving the rationality of the overall smart home control and user experience.

[0079] In some embodiments, step S509 specifically includes: S5091, the smart home obtains the time period during which the user and the follower are present at the same time; S5092, smart home obtains historical operating parameters within a time period S5093, the smart home performs statistical analysis on historical operating parameters according to the set frequency to obtain parameter frequency distribution; S5094. Select the parameter combination with the highest frequency in the parameter frequency distribution as the included parameters of the second common instruction.

[0080] It can be seen that the smart home will accurately lock the time period when the user and the followers are present at the same time, and obtain the historical operating parameters within this time period. These parameters carry key information about the actual operating status of the smart home when multiple people were present at the same time in the past. Then, these historical operating parameters are statistically analyzed according to the setting frequency to obtain the parameter frequency distribution, and finally the parameter combination with the highest frequency in the parameter frequency distribution is selected as the included parameters of the second common instruction. This method based on statistical analysis of actual operating data can fully generate reasonable and effective instructions based on the past usage habits of multiple people.

[0081] The following introduces a smart home control system 600 implemented by an exemplary smart door lock provided in an embodiment of the present application. Figure 6 It is a schematic diagram of an exemplary hardware structure of a smart home control system 600 implemented by a smart door lock provided in an embodiment of the present application.

[0082] In some embodiments, the smart home control system 600 implemented by the smart door lock is a computer device or the smart home control system 600 implemented by the smart door lock includes a computer device. The computer device includes a processor, a memory and a network interface connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The network interface of the computer device is used to communicate with other external terminals or servers through a network connection. In some embodiments, the network interface can be a wired network interface, and in some embodiments, the network interface can also be a wireless network interface. When the computer program is executed by the processor, the method in the embodiment of the present application is implemented.

[0083] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0084] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0085] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

[0086] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0087] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

Claims

1. A smart home control method based on smart door lock, characterized in that: include: When the smart door lock detects a user, it authenticates the user and obtains an authentication result; The smart door lock performs door lock authority verification according to the identity verification result; When the door lock authority verification is passed, the smart door lock obtains the real-time image of the user; The smart door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to a corresponding triggering instruction; If the triggering behavior occurs, the smart door lock sends the triggering instruction corresponding to the triggering behavior to the smart home, and the triggering instruction is used to instruct the smart home to make adjustments according to the parameters included in the triggering instruction; If the triggering behavior does not occur, the smart door lock sends a personalized matching instruction to the smart home, where the personalized matching instruction is determined according to the identity authentication result, and the personalized matching instruction is used to guide the smart home to make adjustments according to the parameters included in the personalized matching instruction.

2. The method according to claim 1, characterized in that The step of the smart door lock determining whether there is a triggering behavior in the real-time image specifically includes: The smart door lock obtains an action sequence of the real-time image, wherein the action sequence includes a plurality of action segments, each of which corresponds to a user behavior feature within a preset sampling window; The smart door lock calculates the integrity parameter of each action segment in the action sequence; The smart door lock progressively merges the action segments whose integrity parameters exceed a preset integrity threshold in the action sequence, wherein: The action segment whose integrity parameter of the smart door lock exceeds the preset integrity threshold is merged with adjacent action segments; The smart door lock determines whether the integrity parameter of the merged target action segment exceeds a preset integrity threshold; If the preset integrity threshold is exceeded, the smart door lock regards the target action segment as an action segment, and executes the step of merging the action segment whose integrity parameter exceeds the preset integrity threshold with the adjacent action segments; If it does not exceed the preset integrity threshold, the smart door lock cancels the merge and adds a forward restriction mark to the action segment before the merge demarcation point; adds a backward restriction mark to the action segment after the merge demarcation point; the forward restriction mark is used to prohibit the corresponding action segment from merging forward; the backward restriction mark is used to prohibit the corresponding action segment from merging backward; Until all action fragments cannot be merged, and several complete action sets are obtained; The smart door lock performs iterative triggering behavior recognition on the complete action set, wherein: The smart door lock removes complete actions from the complete action set in sequence; The smart door lock determines whether the complete action set after elimination is the triggering behavior; If it is not the triggering behavior, then return to the step of removing complete actions from the complete action set in chronological order.

3. The method according to claim 1, characterized in that After the step of passing the door lock authority verification, the method further includes: The smart door lock determines whether there are other people in the corresponding home through historical images and historical door lock authority verification results; If there are other people in the corresponding home, the smart door lock sends an impact area request to the smart home, so that the smart home sends the impact area; the impact area is determined by the smart home according to whether the controlled home is activated and the regional distribution information of the preset indoor scene; After receiving the affected area, the smart door lock determines whether the area to which the smart door lock is connected is included in the affected area; If it is included in the affected area, then the control of the smart home is terminated; If it is not included in the affected area, the step of sending the trigger instruction corresponding to the trigger behavior to the smart home by the smart door lock specifically includes: sending the trigger instruction corresponding to the trigger behavior and a connected area instruction to the smart home, wherein the connected area instruction is used to instruct the smart home to adjust the connected area according to the parameters included in the trigger instruction; The step of the smart door lock sending a personalized matching instruction to the smart home specifically includes: The smart door lock sends a personalized matching instruction and a connected area instruction to the smart home, and the connected area instruction is used to guide the smart home to adjust the connected area according to the parameters included in the personalized matching instruction.

4. The method according to claim 3, characterized in that The step of the smart door lock judging whether there are other people in the corresponding home through historical images and historical door lock authority verification results specifically includes: The smart door lock obtains the last real-time image corresponding to the last time the door lock authority verification passed; The smart door lock extracts direction determination results of all other persons from the last real-time image to obtain a door entry event; The smart door lock obtains the last exit image that was not verified by the door lock authority; The smart door lock extracts direction determination results of all other persons from the exit image to obtain an exit event; The smart door lock performs a difference calculation between the door entry event and the door exit event; The smart door lock determines whether there are other people in the corresponding home based on the difference calculation result.

5. The method according to claim 1, characterized in that After the step of obtaining the real-time image of the user, the smart door lock further includes: The smart door lock determines whether there is a follower other than the user through the real-time image; If there is a follower, the smart door lock performs identity authentication on the follower and obtains the follower identity authentication result; The smart door lock performs door lock authority verification according to the follow-up identity verification result; When the door lock authority verification is passed, the smart door lock sends a first common instruction to the smart home, where the first common instruction is the intersection of the instruction set corresponding to the identity authentication result and the instruction set corresponding to the follow-up identity authentication result, and the first common instruction is used to guide the smart home to make adjustments according to the parameters contained in the first common instruction.

6. The method according to claim 1, characterized in that After the step of obtaining the real-time image of the user, the smart door lock further includes: The smart door lock determines whether there is a follower other than the user through the real-time image; If there is a follower, the smart door lock performs identity authentication on the follower and obtains the follower identity authentication result; The smart door lock performs door lock authority verification according to the follow-up identity verification result; When the door lock authority verification is passed, the smart door lock sends a second common instruction to the smart home. The second common instruction is determined by the setting parameters of the smart home when the user and the follower are present at the same time. The second common instruction is used to guide the smart home to make adjustments according to the parameters contained in the second common instruction.

7. The method according to claim 6, characterized in that The step of determining the setting parameters of the smart home when the second common instruction is provided by the user and the follower at the same time specifically includes: The smart home obtains a time period during which the user and the follower are present at the same time; The smart home obtains historical operating parameters within the time period The smart home performs statistical analysis on the historical operating parameters according to the set frequency to obtain parameter frequency distribution; A parameter combination with the highest occurrence frequency in the parameter frequency distribution is selected as the included parameters of the second common instruction.

8. A smart home control system based on smart door locks, characterized in that: The smart home control system implemented based on the smart door lock includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the smart home control system implemented based on the smart door lock to execute the method described in any one of claims 1-7.

9. A computer program product comprising instructions, characterized in that When the computer program product runs on a smart home control system implemented based on a smart door lock, the smart home control system implemented based on the smart door lock executes the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium comprising instructions, characterized in that: When the instruction is executed on a smart home control system implemented based on a smart door lock, the smart home control system implemented based on a smart door lock executes the method as described in any one of claims 1 to 7.

Images