A smart home control method, system, medium and product implemented based on an intelligent door lock

Abstract

The present application provides a smart home control method, system, medium and product implemented based on an intelligent door lock, which relates to the field of image recognition technology for smart homes. The intelligent door lock detects the presence of a user, conducts door lock permission verification based on the identity verification result, and screens out users with legitimate permissions. Then, it notifies the smart home to start, so that it can change from active control to passive control, improving the portability and the atmosphere of home intelligence. After the permission verification is passed, the real-time image of the user is obtained, and then it is judged whether there is a triggering behavior based on the image. For the case of a triggering behavior, a corresponding triggering instruction is sent to make the smart home adjust according to the instruction parameters; if there is no triggering behavior, personalized matching instructions can also be sent according to the identity verification result to guide the adjustment. It endows the adjustment with more possibilities, making it have the richness like active adjustment, fully meeting the various usage requirements of users in different scenarios.

Description

Technical Field

[0001] This application relates to the technical field of image recognition in smart homes, and particularly to a smart home control method, system, medium and product implemented based on an intelligent door lock. Background Art

[0002] Smart homes transform traditional household devices into intelligent devices capable of intelligent perception and automatic adjustment through intelligent network connections and interactions, enhancing the comfort of living and allowing people to easily enjoy life.

[0003] Currently, most of the mainstream smart home control systems on the market rely on mobile phone apps or other similar central control devices to achieve control purposes. Take the mobile phone app as an example. When users first use it, they need to first pair and connect each smart home device in the home with the mobile phone app. After that, they can see the specific status and adjustable parameter options of each device on the app. When they want to operate a certain device, they only need to find the corresponding device icon on the app interface and then adjust the content such as the on / off state, operation mode, and specific parameters of the device according to the preset operation interface. If other central control devices are used, the operation logic is similar. They control each smart home device through its operation panel or touch interface to achieve the intelligent management of the entire home environment. This method does bring a certain degree of convenience to users in daily use.

[0004] However, in related technologies, users need to actively control and adjust smart homes, resulting in low portability and a poor atmosphere of home intelligence. Summary of the Invention

[0005] This application provides a smart home control method, system, medium and product implemented based on an intelligent door lock, which is used to improve portability and the atmosphere of home intelligence.

[0006] In a first aspect, the present application provides a smart home control method implemented based on an intelligent door lock, including: when the intelligent door lock detects a user, authenticating the user to obtain an authentication result; the intelligent door lock performing door lock permission verification according to the authentication result; when the door lock permission verification is passed, the intelligent door lock obtaining a real-time image of the user; the intelligent door lock determining whether there is a triggering behavior in the real-time image; the triggering behavior being a triggering action preset by the user and corresponding to a corresponding triggering instruction; if there is a triggering behavior, the intelligent door lock sending the triggering instruction corresponding to the triggering behavior to the smart home, and the triggering instruction being used to guide the smart home to make adjustments according to the parameters included in the triggering instruction; if there is no triggering behavior, the intelligent door lock sending a personalized matching instruction to the smart home, the personalized matching instruction being determined according to the authentication result, and the personalized matching instruction being used to guide the smart home to make adjustments according to the parameters included in the personalized matching instruction.

[0007] By adopting the above technical solution, the intelligent door lock detects the presence of the user, then starts the authentication process, conducts door lock permission verification based on the authentication result, and screens out users with legitimate permissions. Then the smart home is notified to start, so that the active control can be changed to passive control, improving the portability and the atmosphere of home intelligence. At the same time, when the permission verification is passed, the real-time image of the user is obtained, and then it is judged whether there is a triggering behavior based on the image. In the case of a triggering behavior, the intelligent door lock can send the corresponding triggering instruction to the smart home to make the smart home adjust according to the instruction parameters; if there is no triggering behavior, a personalized matching instruction can also be sent based on the authentication result to guide the adjustment. It endows more possibilities for adjustment, making it as rich as active adjustment, fully meeting the various usage requirements of users in different scenarios, and further highlighting the intelligence and practicality of the smart home system.

[0008] In combination with some embodiments of the first aspect, in some embodiments, the steps for the intelligent door lock to determine whether there is a triggering behavior in the real-time image specifically include: The intelligent door lock obtains the action sequence of the real-time image, where the action sequence includes multiple action segments, and each action segment corresponds to the user behavior characteristics within a preset sampling window; The intelligent door lock calculates the integrity parameter of each action segment in the action sequence; The intelligent door lock performs progressive merging on the action segments whose integrity parameters in the action sequence exceed the preset integrity threshold, where: The intelligent door lock merges adjacent action segments for the action segments whose integrity parameters exceed the preset integrity threshold; The intelligent door lock determines whether the integrity parameter of the merged target action segment exceeds the preset integrity threshold; If it exceeds the preset integrity threshold; then the intelligent door lock regards the target action segment as an action segment and executes the step of merging adjacent action segments for the action segments whose integrity parameters exceed the preset integrity threshold; If it does not exceed the preset integrity threshold; then the intelligent door lock cancels the merge and adds a forward restriction flag to the action segment before the merge boundary point; Adds a backward restriction flag to the action segment after the merge boundary point; The forward restriction flag is used to prohibit the corresponding action segment from merging forward; The backward restriction flag is used to prohibit the corresponding action segment from merging backward; Until all action segments cannot be merged, several complete action sets are obtained; The intelligent door lock performs iterative triggering behavior recognition on the complete action sets, where: The intelligent door lock sequentially removes complete actions from the complete action sets in time sequence; The intelligent door lock determines whether the complete action set after removal is a triggering behavior; If it is not a triggering behavior, then return to the step of sequentially removing complete actions from the complete action sets in time sequence.

[0009] By adopting the above technical solution, the intelligent door lock first obtains the action sequence of the real-time image. This action sequence covers multiple action segments, and each action segment corresponds to the user behavior characteristics within a preset sampling window, breaking down a series of user actions into analyzable units. Then it calculates the integrity parameter of each action segment to measure the completeness of the action segment and provide a basis for subsequent judgment. Next, it performs progressive merging. For the action segments whose integrity parameters exceed the preset threshold, it merges adjacent action segments and continuously iteratively judges the merged situation. If it does not meet the threshold, it adds restriction flags to avoid unreasonable merging until several complete action sets are obtained. Finally, through iterative triggering behavior recognition, it sequentially removes complete actions in time sequence to determine whether it is a triggering behavior. It effectively excludes the interference of transitional actions during the period from when the user enters the password to when they are about to trigger the behavior, locks in the real triggering behavior, enables the smart home to accurately respond according to the user's intention, avoids incorrect operations caused by misjudgment, and makes the entire control process smoother, more reasonable, and more efficient.

[0010] In connection with some embodiments of the first aspect, in some embodiments, after the steps in the case where the door lock permission verification is passed, the method further includes: the intelligent door lock determines whether there are other persons in the corresponding home based on historical images and historical door lock permission verification results; if there are other persons in the corresponding home, the intelligent door lock sends a request for the affected area to the smart home, so that the smart home sends the affected area; the affected area is determined by the smart home according to whether the controlled home is activated and the area distribution information of the preset indoor scene; after receiving the affected area, the intelligent door lock determines whether the area connected to the intelligent door lock is included in the affected area; if it is included in the affected area, the control of the smart home is ended; if it is not included in the affected area, the step of the intelligent door lock sending a trigger instruction corresponding to the trigger behavior to the smart home specifically includes: the intelligent door lock sends a trigger instruction corresponding to the trigger behavior and an instruction for the connected area to the smart home, and the instruction for the connected area is used to guide the smart home to adjust the connected area according to the parameters included in the trigger instruction; the step of the intelligent door lock sending a personalized matching instruction to the smart home specifically includes: the intelligent door lock sends a personalized matching instruction and an instruction for the connected area to the smart home, and the instruction for the connected area is used to guide the smart home to adjust the connected area according to the parameters included in the personalized matching instruction.

[0011] By adopting the above technical solution, after the node where the door lock permission verification is passed, the intelligent door lock starts the judgment process of the situation of other persons in the home. If it is determined that there are other persons, a request for the affected area is sent to the smart home, and the smart home determines the affected area according to whether the home it controls is activated and the area distribution information of the preset indoor scene. After receiving it, the intelligent door lock determines whether the area it is connected to is included in the affected area. If it is included, the control of the smart home is ended to avoid interfering with the state of the smart home in the area where the user already in the room is located; if it is not included, when sending the trigger instruction or the personalized matching instruction, an instruction for the connected area will be attached to guide the smart home to adjust the corresponding area according to the parameters. In this way, by sensing the distribution of people in the home when a new user enters, the adjustment range of the smart home can be reasonably controlled, effectively avoiding the random change of the comfortable environment state of the user already in the room when a new user enters the room, maintaining the usage experience of different users in different scenarios, making the control of the smart home more suitable for diverse actual usage scenarios, and improving the overall practicality and user satisfaction.

[0012] In some embodiments in combination with some embodiments of the first aspect, the steps for the intelligent door lock to determine whether there are other persons in the corresponding home based on historical images and historical door lock permission verification results specifically include: The intelligent door lock obtains the previous real-time image corresponding to the previous successful door lock permission verification; the intelligent door lock extracts the direction determination results of all other persons from the previous real-time image to obtain an entry event; the intelligent door lock obtains the previous exit image that has not passed the door lock permission verification; the intelligent door lock extracts the direction determination results of all other persons from the exit image to obtain an exit event; the intelligent door lock performs a difference operation on the entry event and the exit event; the intelligent door lock determines whether there are other persons in the corresponding home based on the difference operation result.

[0013] By adopting the above technical solution, the intelligent door lock will obtain the previous real-time image corresponding to the previous successful door lock permission verification, carefully extract the direction determination results of all other persons from this real-time image, so as to accurately determine the entry event and clearly master the situation of people entering the room. At the same time, the intelligent door lock will also obtain the previous exit image that has not passed the door lock permission verification, and also use the corresponding technology to extract the direction determination results of all other persons from the exit image, thereby clarifying the exit event and grasping the relevant situation of people leaving the room. Subsequently, the obtained entry event and exit event are subjected to a difference operation to determine whether there are still other persons in the corresponding home at present. It realizes the real-time control of the personnel situation in the home in a logically clear and efficient manner, providing a reliable basis for subsequent reasonable control of the smart home state and avoiding affecting the comfortable environment of the users already in the room.

[0014] In some embodiments in combination with some embodiments of the first aspect, after the step of the intelligent door lock obtaining the real-time image of the user, it further includes: The intelligent door lock determines whether there are accompanying persons other than the user through the real-time image; if there are accompanying persons; then the intelligent door lock performs identity verification on the accompanying persons to obtain an accompanying identity verification result; the intelligent door lock performs door lock permission verification according to the accompanying identity verification result; in the case where the door lock permission verification is passed, the intelligent door lock sends a first common instruction to the smart home, and the first common instruction is the intersection of the instruction set corresponding to the identity verification result and the instruction set corresponding to the accompanying identity verification result, and the first common instruction is used to guide the smart home to make adjustments according to the parameters included in the first common instruction.

[0015] By adopting the above technical solution, after the intelligent door lock obtains the real-time image of the user, it will judge whether there are any accompanying persons other than the user based on the image. This judgment link plays a key role in detecting other accompanying persons. If there are accompanying persons, identity verification and door lock permission verification will be carried out in sequence. These two verification processes are like layers of checks to ensure the legitimacy of the entering personnel. Then, the first common instruction is formed by taking the intersection of the instruction set corresponding to the identity verification result and the instruction set corresponding to the accompanying identity verification result. Based on this instruction, the smart home is adjusted, fully considering the situation of multiple users, avoiding being dominated only by the opening user, and improving the overall user experience.

[0016] Combined with some embodiments of the first aspect, in some embodiments, after the step of the intelligent door lock obtaining the real-time image of the user, it further includes: the intelligent door lock judges whether there are any accompanying persons other than the user through the real-time image; if there are accompanying persons; then the intelligent door lock conducts identity verification on the accompanying persons to obtain an accompanying identity verification result; the intelligent door lock conducts door lock permission verification according to the accompanying identity verification result; in the case where the door lock permission verification is passed, the intelligent door lock sends a second common instruction to the smart home. The second common instruction is determined by the parameters set by the smart home when the user and the accompanying persons are both present, and the second common instruction is used to guide the smart home to make adjustments according to the parameters included in the second common instruction.

[0017] By adopting the above technical solution, the link of the intelligent door lock judging the accompanying persons is initiated first after obtaining the real-time image. Once an accompanying person is found, identity verification and door lock permission verification are then carried out, laying a foundation for subsequent reasonable control. When the permission verification is passed, a second common instruction determined when the user and the accompanying persons are both present will be generated. Compared with the way of taking the intersection of the instruction set corresponding to the identity verification result and the instruction set corresponding to the accompanying identity verification result for the first common instruction, the second common instruction avoids the embarrassing situation where there may be no intersection, resulting in the inability to generate an effective instruction. By focusing on the comprehensive consideration of the actual operation situation of the smart home when two or more people are present at the same time and other factors to determine the parameters, the effective generation of the instruction is ensured, and it can more stably and reliably guide the smart home to make adjustments that meet the needs of multiple people, fully taking into account the expectations of all users entering the room, and improving the rationality and user experience of the overall smart home control.

[0018] Combined with some embodiments of the first aspect, in some embodiments, the step of the second common instruction being determined by the parameters set by the smart home when the user and the accompanying persons are both present specifically includes: the smart home obtains the time period when the user and the accompanying persons are both present; the smart home obtains the historical operation parameters during the time period; the smart home statistically analyzes the historical operation parameters according to the set frequency to obtain a parameter frequency distribution; the parameter combination with the highest frequency of occurrence in the parameter frequency distribution is selected as the parameter included in the second common instruction.

[0019] By adopting the above technical solution, the smart home can accurately lock the time period when the user and the follower are both present, and obtain the historical operation parameters during this time period. These parameters carry the key information of the actual operation state of the smart home when multiple people were present in the past. Then, the historical operation parameters are statistically analyzed according to the set frequency to obtain the parameter frequency distribution. Finally, the parameter combination with the highest frequency in the parameter frequency distribution is selected as the parameter included in the second common instruction. This way of statistical analysis based on actual operation data can fully generate reasonable and effective instructions according to the past usage habits of multiple people.

[0020] In a second aspect, the present application provides a smart home control system implemented based on an intelligent door lock. The smart home control system implemented based on the intelligent door lock includes: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is used to store computer program code, and the computer program code includes computer instructions. The one or more processors call the computer instructions to cause the smart home control system implemented based on the intelligent door lock to execute the method described in the first aspect and any possible implementation manner in the first aspect.

[0021] In a third aspect, the present application provides a computer program product containing instructions. When the computer program product runs on the smart home control system implemented based on the intelligent door lock, it causes the smart home control system implemented based on the intelligent door lock to execute the method described in the first aspect and any possible implementation manner in the first aspect.

[0022] In a fourth aspect, the present application provides a computer-readable storage medium including instructions. When the instructions run on the smart home control system implemented based on the intelligent door lock, it causes the smart home control system implemented based on the intelligent door lock to execute the method described in the first aspect and any possible implementation manner in the first aspect.

[0023] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

[0024] 1. The intelligent door lock detects the presence of the user, then starts the authentication process, conducts door lock permission verification based on the authentication result, and screens out users with legitimate permissions. Then it notifies the start of the smart home, which can change from active control to passive control, improving portability and the atmosphere of home intelligence. At the same time, after the permission verification passes, the real-time image of the user is obtained, and then it is judged whether there is a triggering behavior based on the image. In the case of a triggering behavior, the intelligent door lock can send a corresponding triggering instruction to the smart home to let the smart home adjust according to the instruction parameters; if there is no triggering behavior, it can also send a personalized matching instruction based on the authentication result to guide the adjustment. It endows the adjustment with more possibilities, making it as rich as active adjustment, fully meeting the various usage requirements of users in different scenarios, and further demonstrating the intelligence and practicality of the smart home system.

[0025] 2. First, the intelligent door lock obtains the action sequence of the real-time image. This action sequence covers multiple action segments, and each action segment corresponds to the user behavior characteristics within the preset sampling window, decomposing a series of user actions into analyzable units. Then, it calculates the integrity parameters of each action segment to measure the completeness of the action segment and provide a basis for subsequent judgments. Next, progressive merging is carried out. For action segments with integrity parameters exceeding the preset threshold, adjacent action segments are merged, and the merged situation is continuously iteratively judged. If it does not meet the threshold, a restriction flag is added to avoid unreasonable merging until several complete action sets are obtained. Finally, through iterative triggering behavior recognition, complete actions are removed in chronological order to judge whether it is a triggering behavior. It effectively eliminates the interference of transitional actions during the period from when the user enters the password to when they are about to trigger a behavior, locks in the real triggering behavior, enables the smart home to accurately respond according to the user's intention, avoids incorrect operations caused by misjudgment, and makes the entire control process smoother, more reasonable, and more efficient.

[0026] 3. After the node where the door lock permission verification is passed, the intelligent door lock starts the process of judging the situation of other people in the home. If it is determined that there are other people, it will send a request for the affected area to the smart home. The smart home will determine the affected area based on whether the home appliances it controls are activated and the area distribution information of the preset indoor scenes. After receiving it, the intelligent door lock will judge whether the area it is connected to is included in the affected area. If it is included, the control of the smart home will end to avoid interfering with the status of the smart home in the area where the users already in the room are located; if it is not included, when sending a trigger instruction or a personalized matching instruction, it will attach the connected area instruction to guide the smart home to adjust the corresponding area according to the parameters. In this way, by sensing the distribution of people in the home when a new user enters, the adjustment range of the smart home is reasonably controlled, effectively avoiding the situation where the comfortable environment of the users already in the room is randomly changed when a new user enters the room, maintaining the usage experience of different users in different scenarios, making the control of the smart home more suitable for diverse actual usage scenarios, and improving the overall practicality and user satisfaction.

[0027] 4. After the intelligent door lock obtains the real-time image, the link of judging the following person starts first. Once a following person is found, then identity verification and door lock permission verification are carried out, laying a foundation for subsequent reasonable control. When the permission verification is passed, a second common instruction determined when the user and the following person exist at the same time will be generated. Compared with the method of taking the intersection of the instruction set corresponding to the identity verification result and the instruction set corresponding to the following identity verification result for the first common instruction, the second common instruction avoids the embarrassing situation where there may be no intersection, resulting in the inability to generate an effective instruction. By focusing on the comprehensive consideration of the past actual operation situation of the smart home when two or more people are present at the same time and other factors to determine the parameters, the effective generation of the instruction is ensured, which can more stably and reliably guide the smart home to make adjustments that meet the needs of multiple people, fully taking into account the expectations of all users entering the room, and improving the rationality and user experience of the overall smart home control. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 is a flowchart of a smart home control method implemented based on an intelligent door lock in an embodiment of the present application;

[0029] Figure 2 is Figure 1 a specific flowchart of step S104 of

[0030] Figure 3 is another flowchart of a smart home control method implemented based on an intelligent door lock in an embodiment of the present application;

[0031] Figure 4 is another flowchart of a smart home control method implemented based on an intelligent door lock in an embodiment of the present application;

[0032] Figure 5 It is another flowchart of the smart home control method implemented based on the intelligent door lock in the embodiments of the present application;

[0033] Figure 6 It is an exemplary hardware structure diagram of the smart home control system implemented based on the intelligent door lock in the embodiments of the present application. Specific Embodiments

[0034] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and appended claims of the present application, the singular forms "a", "an", "the", "above-mentioned", "this", and "this one" are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more of the listed items.

[0035] Hereinafter, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as implying or suggesting relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality" is two or more.

[0036] Please refer to Figure 1 , Figure 1 It is a flowchart of the smart home control method implemented based on the intelligent door lock in the embodiments of the present application;

[0037] A smart home control method implemented based on an intelligent door lock, comprising:

[0038] S101. When the intelligent door lock detects a user, authenticate the user to obtain an authentication result;

[0039] Wherein, the authentication result is used to represent the comprehensive determination conclusion obtained after the above authentication process, and includes two important dimensions. One is to determine whether the user has the unlocking permission, and the other is to clarify who the specific identity of the user is.

[0040] Specifically, when the intelligent door lock uses its built-in sensing devices, such as infrared sensors and proximity sensors, to detect that there is a user in front of the door, that is, in the scenario where it is determined that a person is approaching and preparing to enter, the corresponding verification method is activated according to the user's operation. If the user selects fingerprint unlocking, the intelligent door lock will collect the image data of the currently pressed fingerprint and then compare it with the stored legal user fingerprint data. This method can simultaneously determine whether the user has the permission to unlock and who the specific corresponding user is. If unlocking is through a password, it will be determined whether the entered password is consistent with the preset password. At this time, after these corresponding verification operations, the identity verification result is finally obtained to determine whether the user has the permission to enter.

[0041] It should be noted that in some embodiments, even if the verification fails, the corresponding result status will be clearly shown, such as feedback indicating that the unlocking permission is not available and the identity is an empty set.

[0042] S102. The intelligent door lock performs door lock permission verification according to the identity verification result;

[0043] Continuing with the above example, the identity verification result includes determining whether the user has the permission to unlock.

[0044] S103. When the door lock permission verification is passed, the intelligent door lock obtains the real-time image of the user;

[0045] Specifically, after the intelligent door lock completes the permission verification and determines that it is passed, it will immediately activate its built-in image acquisition module, usually the camera starts to work, and takes a picture of the user from a suitable angle to ensure that the real-time image of the user can be clearly and completely obtained.

[0046] S104. The intelligent door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to the corresponding triggering instruction;

[0047] Among them, the triggering behavior refers to specific actions preset by the user in the intelligent home system according to their own needs and usage habits. These actions have clear definitions and styles, such as raising a hand and waving, specific gestures, etc. And each triggering behavior corresponds to a corresponding triggering instruction. The triggering instruction is used to inform the intelligent home what specific operations need to be performed and the relevant parameters of the operations, etc. For example, the triggering instruction can be to adjust the light to a certain brightness value or to open the curtain to a certain extent, etc.

[0048] Specifically, the intelligent door lock analyzes the user actions in the real-time image frame by frame, extracts key feature information such as the user's body movements and posture changes. Then, it compares the extracted feature information with the trigger behavior features pre-set by the user to check if there is a match, so as to determine whether there is a trigger behavior in the real-time image.

[0049] In some specific embodiments, the intelligent door lock first splits the real-time image into individual image frames in chronological order, and then performs operations such as edge detection and contour extraction on each frame of the image to obtain the user's external contour information in the image. Based on the external contour information, it analyzes the action changes of the user in consecutive frame images and constructs an action sequence, such as key elements like the start, duration, and change amplitude of the action. It matches and compares the constructed action sequence with the standard action sequence corresponding to the pre-set trigger behavior. If the match is successful, it is determined that there is a trigger behavior in the real-time image; if the match fails, it is determined that there is no trigger behavior. There is no limitation here.

[0050] S105. If there is a trigger behavior, the intelligent door lock sends a trigger instruction corresponding to the trigger behavior to the smart home. The trigger instruction is used to guide the smart home to make adjustments according to the parameters included in the trigger instruction.

[0051] Specifically, through the communication link established with the smart home system, the trigger instruction is sent to the corresponding smart home device. After receiving the instruction, the smart home device performs corresponding adjustment operations according to the parameters included in the instruction to achieve automatic control.

[0052] S106. If there is no trigger behavior, the intelligent door lock sends a personalized matching instruction to the smart home. The personalized matching instruction is determined according to the authentication result, and the personalized matching instruction is used to guide the smart home to make adjustments according to the parameters included in the personalized matching instruction.

[0053] Among them, the personalized matching instruction refers to an instruction generated according to the user's authentication result, combined with information such as the user's previously set personalized preferences, etc., and is used to guide the smart home device to make corresponding adjustments. It can be the default instruction set by the user, the default instruction by time period, the set of parameters most commonly used by the user, and so on.

[0054] For example, in terms of lighting control, users may, according to their daily habits, set parameters such as the brightness and color of the lights when entering the room as specific default instructions. For instance, being accustomed to relatively soft warm yellow lights and adjusting the brightness to 50%, this becomes part of the personalized matching instructions. Another example is that users can set corresponding default instructions for different time periods. When entering the room at night, they hope that the smart speaker will automatically play soothing light music, which will also be included in the scope of personalized matching instructions. Additionally, through statistical analysis of the user's past operation data, the smart home system discovers that a certain parameter combination of several devices is the most frequently used by the user, and these instruction parameters with the highest usage frequency are set as default instructions.

[0055] It can be seen that the smart door lock detects the presence of the user, then initiates the identity verification process, conducts door lock permission verification based on the identity verification result, and screens out users with legitimate permissions. Then it notifies the smart home to start. In this way, it can change from active control to passive control, improving the portability and the intelligent atmosphere of the home. At the same time, after the permission verification is passed, it obtains the real-time image of the user, and then judges whether there is a triggering behavior based on the image. For cases with triggering behaviors, the smart door lock can send corresponding triggering instructions to the smart home to let the smart home adjust according to the instruction parameters; if there is no triggering behavior, it can also send personalized matching instructions based on the identity verification result to guide the adjustment. This gives more possibilities for adjustment, making it as rich as active adjustment, fully meeting the various usage requirements of users in different scenarios, and further highlighting the intelligence and practicality of the smart home system.

[0056] In the actual application scenario, the smart door lock undertakes basic and key tasks such as entering passwords. According to the above embodiment, after the user enters the password, the smart door lock will obtain the real-time image of the user to further judge whether there is a triggering behavior. However, during the transitional stage from when the user completes password input to when they are about to make a preset triggering behavior. Since the user may have various natural actions during this period, and these transitional actions are mixed with the triggering behavior, it becomes difficult to accurately identify the triggering behavior.

[0057] Please refer to Figure 2 , Figure 2 is Figure 1 the specific process schematic diagram of step S104;

[0058] Therefore, in some embodiments, step S104 specifically includes:

[0059] S201. The smart door lock obtains the action sequence of the real-time image, where the action sequence includes multiple action segments, and each action segment corresponds to the user behavior characteristics within a preset sampling window;

[0060] Specifically, the intelligent door lock divides time intervals in sequence starting from the image start time according to the preset sampling window duration, extracts the behavioral characteristics presented by the user in each time interval, organizes these behavioral characteristics based on different sampling windows into corresponding action segments respectively, and then combines these action segments in chronological order to form an action sequence. In this way, the relatively complex continuous actions of the user are disassembled into small units that are convenient for subsequent analysis and processing, laying a foundation for accurately judging trigger behaviors.

[0061] S201. The intelligent door lock calculates the integrity parameters of each action segment in the action sequence;

[0062] Among them, the integrity parameter is a numerical index used to quantitatively evaluate the completeness of each action segment. It comprehensively considers various factors such as the start of the action, the duration, the action coherence, and the completeness of key action elements involved in the action segment, so as to judge whether the action segment meets the standard of a relatively complete and effective behavioral unit.

[0063] Specifically, for each action segment in the action sequence, its integrity can be comprehensively judged from the following multiple dimensions, and then the integrity parameter can be determined:

[0064] Motion trajectory coherence: Analyze the motion trajectory coherence of the action segment in detail. When the action is being executed and its trajectory is smooth without obvious pauses or mutations, it indicates that the coherence of the action is strong, meaning that this action segment is more in line with the normal and complete behavioral pattern, and a higher integrity parameter can be assigned at this time; on the contrary, if there are obvious interruptions, jumps or irregular turns in the trajectory, it shows that the coherence of the action is poor, and its integrity parameter should be reduced accordingly.

[0065] Acceleration of motion speed: Focus on considering the speed change situation of the action segment during the motion, that is, acceleration. Acceleration reflects the degree of change in the action speed. When the acceleration is greater than the preset upper threshold, it may indicate that the action has a sudden acceleration and does not conform to the smoothness of normal behaviors; when the acceleration is less than the preset lower threshold, it may mean that the action is too slow or there are abnormal pauses. In these two cases, the integrity of the action segment will be affected, and the integrity parameter should be lowered.

[0066] Trajectory angle change rate: Evaluate the integrity of the action by analyzing the trajectory angle change rate of the action. The trajectory angle change rate reflects the speed of change of the action direction. If the trajectory angle change rate is too large, it means that the action direction changes frequently and violently, which may not conform to the logic and continuity of normal actions; if the trajectory angle change rate is too small, it may indicate that the action is too rigid and lacks flexibility. Adjust the integrity parameter accordingly according to the comparison between the trajectory angle change rate and the reasonable range.

[0067] S203. The intelligent door lock performs progressive merging on the action segments in the action sequence whose integrity parameter exceeds the preset integrity threshold, where:

[0068] S2031. The intelligent door lock merges adjacent action segments for the action segments whose integrity parameter exceeds the preset integrity threshold;

[0069] Specifically, first determine the position of the current action segment whose integrity parameter exceeds the threshold in the entire action sequence, and then check whether its adjacent action segments (the previous one and the next one) meet the merging conditions. The merging conditions here are that in addition to the adjacent action segments themselves not being merged and having no restriction flags (such as forward restriction flags or backward restriction flags). After meeting these conditions, the intelligent door lock will merge the current action segment with the adjacent action segments to generate a new target action segment.

[0070] S2032. The intelligent door lock determines whether the integrity parameter of the merged target action segment exceeds the preset integrity threshold;

[0071] S2033. If it exceeds the preset integrity threshold, the intelligent door lock regards the target action segment as an action segment and executes step S2031;

[0072] S2034. If it does not exceed the preset integrity threshold, the intelligent door lock cancels the merge, adds a forward restriction flag to the action segment before the merge demarcation point, and adds a backward restriction flag to the action segment after the merge demarcation point. The forward restriction flag is used to prohibit the corresponding action segment from merging forward, and the backward restriction flag is used to prohibit the corresponding action segment from merging backward;

[0073] Specifically, first locate the position of the current target action segment that does not meet the integrity threshold in the action sequence, and then find the corresponding merge demarcation point according to the previous merge record to clarify which two action segments were merged before. Then, the intelligent door lock will perform the cancel merge operation, disassemble the merged target action segment into the original two independent action segments, and restore their respective original behavior characteristic data and integrity parameter information. After that, add a forward restriction flag to the action segment before the merge demarcation point (that is, the previous action segment that originally participated in the merge). For example, add a new boolean type field to its data structure and assign it a value of true, indicating that it is prohibited from merging forward; at the same time, add a backward restriction flag to the action segment after the merge demarcation point (the latter action segment that originally participated in the merge), and also set the corresponding boolean value to true to prevent it from merging backward, so as to avoid unreasonable merges from occurring again during subsequent analysis.

[0074] S2035. Until all action segments cannot be merged, several complete action sets are obtained;

[0075] S204. The intelligent door lock performs iterative trigger behavior recognition on the complete action set, where:

[0076] S2041. The intelligent door lock sequentially removes complete actions from the complete action set in chronological order;

[0077] Specifically, the intelligent door lock starts from the earliest complete action and sequentially removes it from the complete action set. After each removal of a complete action, subsequent trigger behavior judgment operations are performed on the remaining complete action set to observe whether a preset trigger behavior can be found in the remaining actions. By this way of sequentially removing in chronological order, the analysis action range is continuously adjusted, and actions that may not be trigger behaviors are gradually excluded, improving the accuracy and efficiency of trigger behavior recognition.

[0078] S2042. The intelligent door lock determines whether the complete action set after removal is a trigger behavior;

[0079] It should be noted that the principle and process of this step are similar to those of step S104. The relevant principles and processes can refer to step S104 and will not be limited here.

[0080] S2043. If it is not a trigger behavior, return to step S2041.

[0081] It can be seen that the intelligent door lock first obtains the action sequence of the real-time image. This action sequence covers multiple action segments, and each action segment corresponds to the user behavior characteristics within a preset sampling window, disassembling a series of user actions into analyzable units. Then, the integrity parameters of each action segment are calculated to measure the completeness of the action segment and provide a basis for subsequent judgment. Next, progressive merging is performed. For action segments with integrity parameters exceeding the preset threshold, adjacent action segments are merged, and the merged situation is continuously iteratively judged. If it does not meet the threshold, a restriction flag is added to avoid unreasonable merging until several complete action sets are obtained. Finally, through iterative trigger behavior recognition, complete actions are removed in chronological order to determine whether it is a trigger behavior. Effectively exclude the interference of transitional actions during the period from when the user enters the password to when the trigger behavior is about to be triggered, lock the real trigger behavior, enable the smart home to accurately respond according to the user's intention, avoid wrong operations caused by misjudgment, and make the entire control process smoother, more reasonable and efficient.

[0082] In daily practical usage scenarios, the following situation often occurs: when a new user enters a room, it often has a certain impact on the usage experience of the users already in the room. These changes may not necessarily match the current needs and preferences of the users already in the room. The users already in the room may be in a comfortable environment, engaged in activities such as reading or resting. The adjustment of the smart home state triggered by the entry of the new user breaks the original comfortable state, forcing them to readjust the relevant devices again, which undoubtedly brings inconvenience to the users already in the room and reduces the overall usage satisfaction.

[0083] Please refer to Figure 3 , Figure 3 which is another process schematic diagram of the smart home control method implemented based on the smart door lock in the embodiments of the present application;

[0084] Therefore, in some other embodiments, the smart home control method implemented based on the smart door lock includes:

[0085] S301. When the smart door lock detects a user, authenticate the user to obtain an authentication result;

[0086] S302. The smart door lock performs door lock permission verification according to the authentication result;

[0087] S303. When the door lock permission verification is passed, the smart door lock obtains the real-time image of the user;

[0088] S304. The smart door lock determines whether there are other people in the corresponding home by the historical image and the historical door lock permission verification result;

[0089] Specifically, the smart door lock will call the historical image data and historical door lock permission verification results stored in its internal storage for analysis. For the historical image, the smart door lock will use image recognition technology to identify whether there are people in the image and the feature information of the people. At the same time, combined with the historical door lock permission verification result, check which users have successfully entered the room at different time points, so as to infer whether there are other people in the corresponding home at the current moment. For example, if the historical image shows that there were people moving in the room not long ago, and the historical door lock permission verification result does not show a record of that person leaving, then it can be judged that there are other people in the room. Through this judgment, it provides a basis for subsequent operations such as whether to send a request for the affected area to the smart home, ensuring that the control of the smart home can fully consider the actual situation of the people in the room.

[0090] In some specific embodiments, step S304 specifically includes:

[0091] S3041. The smart door lock obtains the previous real-time image corresponding to the previous successful door lock permission verification;

[0092] S3042. The intelligent door lock extracts the direction determination results of all other persons from the previous real-time image to obtain an entry event;

[0093] Specifically, the intelligent door lock identifies all persons in the image through a target detection algorithm, and distinguishes which are the current users whose permissions are being verified and which are other persons. Then, for these other persons, a pose recognition algorithm is used to analyze their body movements, such as the orientation of the body and the moving direction of the footsteps, and at the same time, combined with their positions in the image (whether they are inside or outside the door, which side of the door they are close to, etc.), the direction determination results of each other person are comprehensively judged, that is, it is determined whether they are entering or leaving the room. Finally, the direction determination results of all other persons are integrated to form a complete record of the entry event. It should be noted that one person entering the door once is an entry event.

[0094] S3043. The intelligent door lock obtains the previous unauthenticated exit image of the door lock;

[0095] Among them, the previous unauthenticated exit image of the door lock refers to the image information that the intelligent door lock collected before the most recent successful door lock permission verification, which shows that there are people moving from inside the room towards the outside direction without going through the normal door lock permission verification process. These images record the possible situation of people leaving the room. For example, within a certain period of time, someone directly opens the door and goes out without passing through the identity verification link of the intelligent door lock. The image of this process collected by the intelligent door lock at that time is the previous unauthenticated exit image of the door lock, which can help analyze the situation of people going out and provide a reference for judging whether there are other people remaining in the room.

[0096] S3044. The intelligent door lock extracts the direction determination results of all other persons from the exit image to obtain an exit event;

[0097] It should be noted that the principle and process of this step are similar to those of step S3042. The relevant principles and processes can refer to step S3042 and will not be elaborated here.

[0098] S3045. The intelligent door lock performs a difference operation on the entry event and the exit event;

[0099] Specifically, then, the total number of persons in the entry event is used as the minuend, and the total number of persons in the exit event is used as the subtrahend for subtraction operation to obtain the difference operation result.

[0100] S3046. The intelligent door lock determines whether there are other persons in the corresponding home based on the difference operation result.

[0101] Specifically, if the result of the difference operation is greater than 0, it indicates that the number of people entering the room during the statistical period is more than the number of people leaving. Then, it can be preliminarily determined that there are likely other people in the corresponding home. If the result of the difference operation is equal to 0, it means that the number of people entering and leaving the room is the same, and it can be preliminarily determined that there are no other people in the corresponding home.

[0102] It can be seen that the intelligent door lock will obtain the previous real-time image corresponding to the last successful door lock permission verification, carefully extract the direction determination results of all other people from this real-time image, so as to accurately determine the door entry event and clearly understand the situation of people entering the room. At the same time, the intelligent door lock will also obtain the previous door exit image without door lock permission verification, and also use the corresponding technology to extract the direction determination results of all other people from the door exit image, so as to clarify the door exit event and grasp the relevant situation of people leaving the room. Subsequently, the obtained door entry event and door exit event are subjected to a difference operation to determine whether there are still other people in the corresponding home at present. It realizes the real-time monitoring of the personnel situation in the home in a logically clear and efficient manner, providing a reliable basis for reasonably controlling the state of the smart home and avoiding affecting the comfortable environment of the users already in the room.

[0103] S305. If there are other people in the corresponding home, the intelligent door lock sends a request for the affected area to the smart home, causing the smart home to send the affected area; the affected area is determined by the smart home according to whether the controlled home is activated and the area distribution information of the preset indoor scene;

[0104] In some embodiments, the smart home will first carefully check the activation status of various home appliances it controls to clarify which home appliances are currently in an activated state such as running or turned on. Subsequently, with the help of the association recognition function, it accurately locates the specific positions of these activated home appliances. On this basis, referring to the preset area distribution information of the indoor scene, which details the functions and scope definitions of different areas in various scenarios. By comprehensively analyzing these elements, the smart home system can accurately determine the area range that may be affected by new users entering for the other people already in the room, that is, the so-called affected area.

[0105] S306. After receiving the affected area, the intelligent door lock determines whether the area connected to the intelligent door lock is included in the affected area;

[0106] Specifically, the intelligent door lock will compare the area information it is connected to with the received affected area information. If all parts of the area connected to the intelligent door lock are within the range of the affected area, it means that this area may affect the people already in the room and further control strategies need to be considered; if it is not included in the affected area, the subsequent trigger behavior judgment and control operations can be carried out according to the normal process.

[0107] S307. If it is included in the affected area, end the control of the smart home;

[0108] S308. If it is not included in the affected area, the smart door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to a corresponding triggering instruction;

[0109] S309. If there is a triggering behavior, the smart door lock sends a triggering instruction corresponding to the triggering behavior and a connected area instruction to the smart home. The connected area instruction is used to guide the smart home to adjust the connected area according to the parameters included in the triggering instruction;

[0110] Among them, the connected area instruction is a kind of instruction specifically used to limit the control range. The connected area here refers to a specific spatial range where the smart door lock establishes a connection and can achieve effective control. For example, if the smart door lock is installed in the living room, its connected area is the living room area, which means that subsequent control operations only adjust the smart home devices within this specific living room area and will not affect the device status in other areas.

[0111] S310. If there is no triggering behavior, the smart door lock sends a personalized matching instruction and a connected area instruction to the smart home. The connected area instruction is used to guide the smart home to adjust the connected area according to the parameters included in the personalized matching instruction.

[0112] It can be seen that after the door lock permission verification is passed, the smart door lock starts the judgment process of the situation of other people in the home. If it is determined that there are other people, it sends a request for the affected area to the smart home. The smart home will determine the affected area based on whether the home it controls is activated and the area distribution information of the preset indoor scene. After receiving it, the smart door lock determines whether the area it is connected to is included in the affected area. If it is included, end the control of the smart home to avoid interfering with the status of the smart home in the area where the user is already indoors; if it is not included, when sending the triggering instruction or the personalized matching instruction, a connected area instruction will be attached to guide the smart home to adjust the corresponding area according to the parameters. In this way, by sensing the distribution of people in the home when a new user enters, the adjustment range of the smart home is reasonably controlled, effectively avoiding the random change of the comfortable environment of the users already indoors when a new user enters the room, maintaining the usage experience of different users in different scenarios, making the control of the smart home more in line with diverse actual usage scenarios, and improving the overall practicality and user satisfaction.

[0113] In real life, it is often the case that multiple users enter a room simultaneously. When the current smart door lock controls smart home devices, it usually takes the user who opens the door as the dominant one. However, this control method obviously does not fully consider the needs and expectations of other users who enter the room together. It may not be able to meet the personalized needs of other users, resulting in some users having to spend extra time manually adjusting the device status after entering the room, so that the convenience and intelligence advantages of smart home cannot be fully realized, affecting the overall user experience.

[0114] Please refer to Figure 4 , Figure 4 which is another flowchart of the smart home control method implemented based on the smart door lock in the embodiments of the present application;

[0115] A smart home control method implemented based on a smart door lock includes:

[0116] S401. When the smart door lock detects a user, perform identity verification on the user to obtain an identity verification result;

[0117] S402. The smart door lock performs door lock permission verification according to the identity verification result;

[0118] S403. When the door lock permission verification is passed, the smart door lock obtains the real-time image of the user;

[0119] S404. The smart door lock determines whether there are accompanying persons other than the user through the real-time image;

[0120] Specifically, the smart door lock identifies all individual persons in the recognized image and determines whether the number is greater than 2.

[0121] S405. If there are accompanying persons, the smart door lock performs identity verification on the accompanying persons to obtain an accompanying identity verification result;

[0122] Specifically, the smart door lock will successively start the corresponding identity verification process for each individual determined to be an accompanying person. Taking face recognition as an example, the smart door lock will activate the camera to capture the face of the accompanying person to obtain a clear face image, and then use the built-in face recognition algorithm to compare the image with the local database of legal user face images to check if there is a matching image. If the match is successful, this verification method for the accompanying person passes.

[0123] S406. The smart door lock performs door lock permission verification according to the accompanying identity verification result;

[0124] S407. The smart door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to a corresponding triggering instruction;

[0125] S408. If there is a triggering behavior, the intelligent door lock sends a triggering instruction corresponding to the triggering behavior to the smart home. The triggering instruction is used to guide the smart home to make adjustments according to the parameters included in the triggering instruction.

[0126] S409. If there is no triggering behavior, the intelligent door lock sends a first common instruction to the smart home. The first common instruction is the intersection of the instruction set corresponding to the authentication result and the instruction set corresponding to the follow-up authentication result. The first common instruction is used to guide the smart home to make adjustments according to the parameters included in the first common instruction.

[0127] Specifically, it is carried out in the scenario of comprehensively considering the permissions and preferences of all parties to create an indoor environment that makes everyone relatively satisfied. The intelligent door lock will first extract the instruction set corresponding to the authentication result. It should be noted that this instruction set contains multiple sets of instructions. The intelligent door lock will perform an intersection operation on these two instruction sets, that is, find the set of instructions that exist in both instruction sets at the same time. The operation parameters involved in these instructions are the content that can meet the needs of the primary user and the follow-up personnel at the same time.

[0128] It can be seen that after the intelligent door lock obtains the real-time image of the user, it will judge whether there are follow-up personnel other than the user based on the image. This judgment link plays a key role in discovering other accompanying personnel. If there are follow-up personnel, identity verification and door lock permission verification will be carried out in sequence. These two verification processes are like layers of checks to ensure the legality of the entering personnel. Then, the first common instruction is formed by taking the intersection of the instruction set corresponding to the authentication result and the instruction set corresponding to the follow-up authentication result. Based on this instruction, the smart home is adjusted, fully considering the situation of multiple users, avoiding being dominated by only the opening user, and improving the overall use experience.

[0129] Please refer to Figure 5 , Figure 5 which is another process schematic diagram of the smart home control method implemented based on the intelligent door lock in the embodiment of the present application;

[0130] In some embodiments, a smart home control method implemented based on an intelligent door lock includes:

[0131] S501. When the intelligent door lock detects a user, it performs identity verification on the user to obtain an authentication result.

[0132] S502. The intelligent door lock performs door lock permission verification according to the authentication result.

[0133] S503. When the door lock permission verification is passed, the intelligent door lock obtains the real-time image of the user.

[0134] S504. The intelligent door lock determines whether there are any followers other than the user through real-time images;

[0135] Specifically, the intelligent door lock determines whether the number of all individual persons identified in the image is greater than 2.

[0136] S505. If there are followers, the intelligent door lock authenticates the followers to obtain a follower authentication result;

[0137] S506. The intelligent door lock verifies the door lock permission according to the follower authentication result;

[0138] S507. The intelligent door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to a corresponding triggering instruction;

[0139] S508. If there is a triggering behavior, the intelligent door lock sends a triggering instruction corresponding to the triggering behavior to the smart home, and the triggering instruction is used to guide the smart home to make adjustments according to the parameters included in the triggering instruction;

[0140] S509. If there is no triggering behavior, the intelligent door lock sends a second common instruction to the smart home. The second common instruction is determined by the parameters set by the smart home when the user and the follower are both present. The second common instruction is used to guide the smart home to make adjustments according to the parameters included in the second common instruction.

[0141] Specifically, after the intelligent door lock determines that there is no triggering behavior, it will first query the local storage or the storage area associated with the smart home system for the record information of the settings of smart home devices when the past users and followers were both present. This query process may involve multi-dimensional retrieval methods such as by time and person identification to accurately locate the corresponding historical data. For example, the intelligent door lock will search in the local historical usage record database for the average value or the most frequently occurring stable values of device parameters such as the brightness of the living room lights and the temperature of the air conditioner whenever the user and the follower entered the room together in the past week. Then, the intelligent door lock will classify and organize these parameter information according to the device type, and organize the brightness parameters of the living room lights together to form a complete instruction set, that is, the second common instruction.

[0142] It can be seen that the process of the intelligent door lock determining the following person after obtaining the real-time image is started first. Once a following person is detected, identity verification and door lock permission verification are then carried out, laying a foundation for subsequent reasonable control. When the permission verification is passed, a second common instruction determined when both the user and the following person are present will be generated. Compared with the method of taking the intersection of the instruction set corresponding to the identity verification result and the instruction set corresponding to the following identity verification result for the first common instruction, the second common instruction avoids the embarrassing situation where there may be no intersection, resulting in the inability to generate an effective instruction. By focusing on comprehensive considerations such as the actual operation situation of the smart home when more than two people are present at the same time to determine the parameters, the effective generation of instructions is ensured, which can more stably and reliably guide the smart home to make adjustments that meet the needs of multiple people, fully taking into account the expectations of all users entering the room, and improving the rationality and user experience of the overall smart home control.

[0143] In some embodiments, step S509 specifically includes:

[0144] S5091. The smart home obtains the time period when the user and the following person are both present;

[0145] S5092. The smart home obtains the historical operation parameters within the time period

[0146] S5093. The smart home statistically analyzes the historical operation parameters according to the set frequency to obtain the parameter frequency distribution;

[0147] S5094. Select the parameter combination with the highest frequency of occurrence in the parameter frequency distribution as the parameters included in the second common instruction.

[0148] It can be seen that the smart home will accurately lock the time period when the user and the following person are both present, and obtain the historical operation parameters within this time period. These parameters carry the key information of the actual operation state of the smart home when multiple people were present in the past. Then, statistically analyze these historical operation parameters according to the set frequency to obtain the parameter frequency distribution, and finally select the parameter combination with the highest frequency of occurrence in the parameter frequency distribution as the parameters included in the second common instruction. This method based on statistical analysis of actual operation data can fully generate reasonable and effective instructions based on the past usage habits of multiple people.

[0149] Next, the smart home control system 600 implemented by the exemplary intelligent door lock provided in the embodiments of the present application will be introduced. Figure 6 It is a schematic diagram of the exemplary hardware structure of the smart home control system 600 implemented by the intelligent door lock provided in the embodiments of the present application.

[0150] In some embodiments, the smart home control system 600 implemented by the smart door lock is a computer device or the smart home control system 600 implemented by the smart door lock includes a computer device. The computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The network interface of the computer device is used to communicate with other external terminals or servers through a network connection. In some embodiments, the network interface can be a wired network interface, and in some embodiments, the network interface can also be a wireless network interface. When the computer program is executed by the processor, it implements the method in the embodiments of the present application.

[0151] Those skilled in the art can understand that Figure 6 the structure shown in is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0152] As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0153] As used in the above embodiments, depending on the context, the term "when..." can be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if detecting (the stated condition or event)" can be interpreted to mean "if determining..." or "in response to determining..." or "when detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)".

[0154] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid-state drive), etc.

[0155] Those of ordinary skill in the art can understand that all or part of the processes in the above method embodiments can be completed by a computer program instructing relevant hardware. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The aforementioned storage medium includes: various media that can store program codes such as ROM or random access memory RAM, magnetic disks, or optical discs.

Claims

1. A smart home control method implemented based on an intelligent door lock, characterized in that, Including: When the intelligent door lock detects a user, authenticate the user to obtain an authentication result; The intelligent door lock performs door lock permission verification according to the authentication result; When the door lock permission verification is passed, the intelligent door lock obtains the real-time image of the user; The intelligent door lock determines whether there is a triggering behavior in the real-time image; the triggering behavior is a triggering action preset by the user and corresponds to a corresponding triggering instruction; where: The intelligent door lock obtains the action sequence of the real-time image, where the action sequence includes multiple action segments, and each action segment corresponds to the user behavior characteristics within a preset sampling window; The intelligent door lock calculates the integrity parameters of each action segment in the action sequence; The intelligent door lock performs progressive merging on the action segments in the action sequence whose integrity parameters exceed the preset integrity threshold, where: The action segments whose integrity parameters exceed the preset integrity threshold merge adjacent action segments; The intelligent door lock determines whether the integrity parameter of the merged target action segment exceeds the preset integrity threshold; If it exceeds, the intelligent door lock regards the target action segment as an action segment and executes the step of merging adjacent action segments of the action segment whose integrity parameter exceeds the preset integrity threshold; If it does not exceed, the intelligent door lock cancels the merge and adds a forward restriction flag to the action segment before the merge demarcation point; and adds a backward restriction flag to the action segment after the merge demarcation point; the forward restriction flag is used to prohibit the corresponding action segment from merging forward; the backward restriction flag is used to prohibit the corresponding action segment from merging backward; Until all action segments cannot be merged, several complete action sets are obtained; The intelligent door lock performs iterative triggering behavior recognition on the complete action set, where: The intelligent door lock sequentially removes complete actions from the complete action set in chronological order; The intelligent door lock determines whether the complete action set after removal is a triggering behavior; If it is not a triggering behavior, return to the step of sequentially removing complete actions from the complete action set in chronological order; if there is a triggering behavior, the intelligent door lock sends a triggering instruction corresponding to the triggering behavior to the smart home, and the triggering instruction is used to guide the smart home to make adjustments according to the parameters included in the triggering instruction; If there is no triggering behavior, the intelligent door lock sends a personalized matching instruction, which is determined according to the authentication result, and the personalized matching instruction is used to guide the smart home to make adjustments according to the parameters included in the personalized matching instruction.

2. The method according to claim 1, characterized in that, After the steps when the door lock permission verification is passed, the method further includes: The intelligent door lock determines whether there are other people in the corresponding home through the historical image and the historical door lock permission verification result; If there are other people in the corresponding home, the intelligent door lock sends a request for the affected area to the smart home, so that the smart home sends the affected area; the affected area is determined by the smart home according to whether the controlled home is activated and the area distribution information of the preset indoor scene; After the intelligent door lock receives the affected area, it determines whether the area connected to the intelligent door lock is included in the affected area; If it is included in the affected area, end the control of the smart home; If not included in the affected area, the steps for the intelligent door lock to send a trigger instruction corresponding to the trigger behavior to the smart home specifically include: the intelligent door lock sends a trigger instruction corresponding to the trigger behavior and a connected area instruction to the smart home, and the connected area instruction is used to guide the smart home to adjust the connected area according to the parameters included in the trigger instruction; The steps for the intelligent door lock to send a personalized matching instruction to the smart home specifically include: The intelligent door lock sends a personalized matching instruction and a connected area instruction to the smart home, and the connected area instruction is used to guide the smart home to adjust the connected area according to the parameters included in the personalized matching instruction.

3. The method according to claim 2, wherein The steps for the intelligent door lock to determine whether there are other people in the corresponding home through historical images and historical door lock permission verification results specifically include: The intelligent door lock obtains the previous real-time image corresponding to the previous successful door lock permission verification; The intelligent door lock extracts the direction determination results of all other people from the previous real-time image to obtain an entry event; The intelligent door lock obtains the previous exit image without door lock permission verification; The intelligent door lock extracts the direction determination results of all other people from the exit image to obtain an exit event; The intelligent door lock performs a difference operation on the entry event and the exit event; The intelligent door lock determines whether there are other people in the corresponding home based on the difference operation result.

4. The method according to claim 1, wherein After the step of the intelligent door lock obtaining the real-time image of the user, it further includes: The intelligent door lock determines whether there are followers other than the user through the real-time image; If there are followers; the intelligent door lock authenticates the followers to obtain a follow-up authentication result; The intelligent door lock performs door lock permission verification according to the follow-up authentication result; In the case where the door lock permission verification is passed, the intelligent door lock sends a first common instruction to the smart home, and the first common instruction is the intersection of the instruction set corresponding to the authentication result and the instruction set corresponding to the follow-up authentication result, and the first common instruction is used to guide the smart home to make adjustments according to the parameters included in the first common instruction.

5. The method according to claim 1, characterized in that After the step of the intelligent door lock obtaining the real-time image of the user, it further includes: The intelligent door lock determines whether there are followers other than the user through the real-time image; If there are followers; the intelligent door lock authenticates the followers to obtain a follow-up authentication result; The intelligent door lock performs door lock permission verification according to the follow-up authentication result; In the case where the door lock permission verification is passed, the intelligent door lock sends a second common instruction to the smart home, and the second common instruction is determined by the parameters set by the smart home when the user and the followers exist at the same time, and the second common instruction is used to guide the smart home to make adjustments according to the parameters included in the second common instruction.

6. The method according to claim 5, wherein The steps for the second common instruction to be determined by the parameters set by the smart home when the user and the followers exist at the same time specifically include: The smart home obtains the time period when the user and the followers exist at the same time; The smart home obtains the historical operation parameters during the time period The smart home statistically analyzes the historical operation parameters at the set frequency to obtain a parameter frequency distribution; Select the parameter combination with the highest frequency of occurrence in the parameter frequency distribution as the parameters included in the second common instruction.

7. A smart home control system implemented based on an intelligent door lock, characterized in that, The smart home control system implemented based on the smart door lock includes: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to cause the smart home control system implemented based on the smart door lock to execute the method described in any one of claims 1-6.

8. A computer program product comprising instructions, characterized in that, When the computer program product runs on the smart home control system implemented based on the smart door lock, it causes the smart home control system implemented based on the smart door lock to execute the method described in any one of claims 1-6.

9. A computer-readable storage medium, comprising instructions, characterized in that, When the instruction runs on the smart home control system implemented based on the smart door lock, it causes the smart home control system implemented based on the smart door lock to execute the method described in any one of claims 1-6.

Images