Intelligent home system based on intelligent door lock as center control

Abstract

The invention relates to the technical field of intelligent door locks, and provides an intelligent home system based on an intelligent door lock as central control, the system comprises an intelligent door lock, a plurality of intelligent home devices and a remote control cloud; the intelligent door lock is connected with the multiple intelligent home devices and the remote control cloud. The intelligent door lock receives an emergency signal fed back by the intelligent home equipment and outputs the emergency signal to the remote control cloud, the remote control cloud issues an emergency money reward order, and when the intelligent door lock detects that terminal equipment receiving the emergency money reward order reaches a target area, the intelligent door lock receives an access user face image sent by the terminal equipment and sends the access user face image to the intelligent home equipment; and the intelligent door lock receives the access user face image and adds the access user face image to the stored authorized user characteristics, so that a person carrying the terminal equipment processes an emergency event corresponding to the emergency event signal, and the intelligent door lock deletes the added access user face image after the emergency event processing is finished. According to the invention, the response efficiency and the processing efficiency of emergency situations under the condition that no one is at home are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of smart door locks, and in particular to a smart home system based on a smart door lock as a central control. Background Art

[0002] With the development of smart technology, smart home devices have become very popular, such as smart curtains, smart TVs, smart lighting, smart refrigerators, smart speakers, smart air conditioners, smart door locks, etc. However, these devices often operate independently and lack coordination. The intelligent operation of smart home devices requires the status of whether there are people in the home or not as an important parameter. Smart door locks have a natural advantage in knowing this status, because smart door locks can optimally sense the entry and exit of people, thereby judging the situation of people in the home. Integrating the central control of the smart home system into the smart door lock can not only improve the working efficiency of smart devices, but also solve many practical problems in real life and better serve users.

[0003] The smart door locks used in existing smart home systems can identify people who knock on the door and open the door. When they are identified as strangers, they will automatically alarm to remind users. However, when the smart door lock determines that no one is at home, in case of emergency situations such as smoke, fire, water leakage, and gas leakage, it can only remotely alarm to notify relevant personnel who are far away to deal with the emergency. On the contrary, the downstairs neighbor who was the first to suffer losses due to the water leakage did not receive the alarm information. Even if the neighbor discovered the water leakage, he could not enter the room where the water leakage occurred in time to deal with it because he did not have the relevant authority; or when a fire occurred, the neighbor next door did not receive any alarm information. Even if the neighbor discovered the fire, he could not enter the room where the fire occurred in time to deal with it because he did not have the relevant authority; all these are due to the lack of cooperation between the security alarm equipment and the smart door lock, resulting in low efficiency in handling emergencies and failure to ensure safety. Summary of the invention

[0004] In view of this, the present invention proposes a smart home system based on a smart door lock as a central control, which monitors emergency situations through smart home devices and feeds back to the remote control cloud through the smart door lock, thereby issuing bounty orders to processing personnel to motivate them to respond quickly and allow the nearest processing personnel to quickly enter the room to handle the emergency, thereby solving the problem of low efficiency in handling emergencies of the smart home system when no one is at home.

[0005] The technical solution of the present invention is implemented as follows: the present invention provides a smart home system based on a smart door lock as a central control, the system comprising a smart door lock, a plurality of smart home devices and a remote control cloud;

[0006] The smart door lock is respectively connected to a plurality of smart home devices and a remote control cloud;

[0007] The smart door lock receives emergency signals fed back by smart home devices and outputs them to the remote control cloud. The remote control cloud issues an emergency bounty order. When the smart door lock detects that the terminal device that receives the emergency bounty order has arrived at the target area, the smart door lock receives the visiting user facial image sent by the terminal device, and adds the visiting user facial image to the stored authorized user features, so that the person carrying the terminal device can handle the emergency event corresponding to the emergency signal. After the emergency event is handled, the smart door lock deletes the added visiting user facial image.

[0008] On the basis of the above technical solution, preferably, the smart door lock includes a face recognition module;

[0009] The face recognition module uses a high-resolution camera to capture the face image of the visiting user, uses the Viola-Jones algorithm to locate the face area, applies the Active-Shape-Model face alignment algorithm to correct the face posture, uses the DeepFace deep learning model to extract the face features of the visiting user, compares the extracted face features of the visiting user with the stored authorized user features, obtains the first cosine similarity, sets the similarity threshold, and when the first cosine similarity exceeds the similarity threshold, it is determined that the identity authentication of the visiting user is passed, and outputs a door opening permission signal.

[0010] On the basis of the above technical solution, preferably, the Viola-Jones algorithm includes extracting a specific area pixel set of the access user's face image, calculating a pixel difference feature value of the specific area pixel set, converting the specific area pixel set into a specific area integral pixel set, and calculating an integral image of the specific area integral pixel set:

[0011] f 像差 =∑(x white )-∑(x black );

[0012] I(x,y)=i(x,y)+I(x-1,y)+I(x,y-1)-I(x-1,y-1);

[0013] Among them, f 像差 is the pixel difference eigenvalue, x white is the pixel value of the white area, x black is the pixel value of the black area, I(x,y) is the pixel value of the integral image at the coordinate (x,y), i(x,y) is the image pixel value of the pixel set in a specific area at the coordinate (x,y), I(x-1,y) is the pixel value of the integral image at the coordinate (x-1,y), I(x,y-1) is the pixel value of the integral image at the coordinate (x,y-1), and I(x-1,y-1) is the pixel value of the integral image at the coordinate (x-1,y-1).

[0014] Based on the above technical solution, preferably, the Active-Shape-Model face alignment algorithm includes initializing a shape model in an integral image of an integral pixel set in a specific area, searching for the local conditional optimal position of each local face feature point of the shape model, obtaining deformation parameters, and applying the deformation parameters to the integral image of the integral pixel set in the specific area to obtain a corrected face posture.

[0015] On the basis of the above technical solution, preferably, the smart door lock also includes a WIFI module;

[0016] The WIFI module performs data communication with multiple smart home devices and a remote control cloud, receives remote commands from the remote control cloud, and sends status information data of the smart door lock; the WIFI module adopts an ESP32 WIFI chip; the WIFI module performs data encryption by encrypting communication data through TLS.

[0017] On the basis of the above technical solution, preferably, the smart door lock includes a lock body control module;

[0018] The lock body control module receives the door opening permission signal, controls the opening and closing of the lock body through the equipped electric lock mechanism, performs the physical actions of opening and closing the door, and detects the status information data of the smart door lock and uploads it to the remote control cloud.

[0019] On the basis of the above technical solution, preferably, the smart door lock includes a central control center;

[0020] The central control center uses a microcontroller as a core processor to process data and control instructions from the face recognition module, the WIFI module and the lock body control module, and stores authorized user feature data and system configuration data through a non-volatile memory EEPROM.

[0021] On the basis of the above technical solution, preferably, the remote control cloud includes a smart home system user end and a remote cloud;

[0022] The smart home system user end is respectively connected to the remote cloud and the smart door lock signal, and the smart home system user end is used to receive and send emergency bounty orders;

[0023] The remote cloud is respectively connected to the smart home system user end and the smart door lock signal, and the remote cloud is used to record the receipt and release of emergency bounty orders.

[0024] On the basis of the above technical solution, preferably, the user terminal of the smart home system includes a master mobile terminal, a property mobile terminal, a neighbor mobile terminal and other user mobile terminals;

[0025] The owner's mobile terminal is respectively connected to the smart door lock and the remote cloud signal, and is used to send control signals to the smart door lock, receive all status information of the smart door lock, and issue emergency bounty orders to the remote cloud;

[0026] The property mobile terminal, neighbor mobile terminal and other user mobile terminals are all connected to the remote cloud signal to receive emergency bounty orders and receive some status information sent by the smart door lock;

[0027] The total state information includes partial state information and private state information.

[0028] On the basis of the above technical solution, preferably, the plurality of smart home devices include a smart receiving cabinet, a smart window, a smart air conditioner, a smart refrigerator, a smart kitchen and a smart security;

[0029] The smart receiving cabinet, the smart window, the smart air conditioner, the smart refrigerator, the smart kitchen and the smart security are all connected to the smart door lock signal, and output an emergency signal to the smart door lock when an emergency occurs.

[0030] The smart home system based on the smart door lock as the central control of the present invention has the following beneficial effects compared with the prior art:

[0031] (1) By connecting the smart door lock with multiple smart home devices and a remote control cloud, the smart door lock is supported to receive and transmit emergency signals to the remote control cloud to issue emergency bounty orders. When the arrival of the responder's terminal device is detected, the smart door lock temporarily authorizes the responder to enter and handle the emergency through face recognition, and deletes the temporary authorization information after the processing is completed, thereby improving the response efficiency and handling efficiency of emergencies when no one is at home;

[0032] (2) The face recognition module uses a high-resolution camera, Viola-Jones algorithm, Active-Shape-Model face alignment algorithm, and DeepFace deep learning model to achieve accurate face detection, alignment, and feature extraction. Combined with cosine similarity comparison and threshold determination, it ensures high accuracy and security of identity authentication.

[0033] (3) Through the collaborative work of smart door locks, remote control cloud and multiple smart home devices, a complete emergency response mechanism has been established. When a smart home device detects an emergency, it can send a signal to the remote control cloud through the smart door lock and quickly mobilize nearby personnel to handle the emergency through bounty orders, thereby improving the efficiency of emergency response;

[0034] (4) By distinguishing different user types such as the owner's mobile terminal, property mobile terminal, and neighbor's mobile terminal, differentiated access control and information acquisition permissions are achieved. The homeowner can obtain all status information and exercise comprehensive control, while other users can only obtain partial status information and have limited control permissions, effectively balancing system functionality and user privacy protection. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0036] Figure 1 This is a structural diagram of a smart home system based on a smart door lock as a central control of the present invention;

[0037] Figure 2 It is a structural diagram of the intelligent door lock of the present invention;

[0038] Figure 3 This is a structural diagram of the remote control cloud of the present invention;

[0039] Figure 4 It is a composition structure diagram of the smart home system user terminal of the present invention. DETAILED DESCRIPTION

[0040] The following will be combined with the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0041] Provides a smart home system based on smart door locks as central control, such as Figure 1 As shown, the system includes a smart door lock, multiple smart home devices, and a remote control cloud;

[0042] The smart door lock is respectively connected to a plurality of smart home devices and a remote control cloud;

[0043] The smart door lock receives emergency signals fed back by smart home devices and outputs them to the remote control cloud. The remote control cloud issues an emergency bounty order. When the smart door lock detects that the terminal device that receives the emergency bounty order has arrived at the target area, the smart door lock receives the visiting user facial image sent by the terminal device, and adds the visiting user facial image to the stored authorized user features, so that the person carrying the terminal device can handle the emergency event corresponding to the emergency signal. After the emergency event is handled, the smart door lock deletes the added visiting user facial image.

[0044] Specifically, this embodiment uses the smart door lock as the central control to quickly receive and forward emergency signals, and motivates nearby personnel to respond quickly through a bounty order mechanism, thereby improving the speed and efficiency of handling emergency events.

[0045] When no one is at home, the system can detect and handle emergencies in a timely manner, effectively reducing potential safety risks and improving the overall safety of the home. By temporarily adding and deleting access user facial images through smart door locks, intelligent temporary authorization of processing personnel is achieved, which not only ensures rapid processing in emergency situations, but also maintains family privacy and safety.

[0046] Using smart door locks as the central control, multiple smart home devices and remote control cloud are integrated, which improves the collaborative working ability of the entire smart home system and realizes more intelligent and efficient home management.

[0047] like Figure 2 As shown, the smart door lock includes a face recognition module;

[0048] The face recognition module uses a high-resolution camera to capture the face image of the visiting user, uses the Viola-Jones algorithm to locate the face area, applies the Active-Shape-Model face alignment algorithm to correct the face posture, uses the DeepFace deep learning model to extract the face features of the visiting user, compares the extracted face features of the visiting user with the stored authorized user features, obtains the first cosine similarity, sets the similarity threshold, and when the first cosine similarity exceeds the similarity threshold, it is determined that the identity authentication of the visiting user is passed, and outputs a door opening permission signal.

[0049] Specifically, this embodiment uses a high-resolution camera to capture facial images, combines the Viola-Jones algorithm and the Active-Shape-Model face alignment algorithm, achieves high-precision face positioning and posture correction, lays the foundation for facial feature extraction, uses the DeepFace deep learning model to extract facial features, and uses cosine similarity for feature comparison, thereby improving the accuracy of face recognition.

[0050] By setting the similarity threshold, the system can flexibly adjust the strictness of identity authentication and strike a balance between security and convenience. When the identity authentication is passed, the system automatically outputs a door opening permission signal, realizing intelligent access control and improving the user experience and the system's automation level.

[0051] The Viola-Jones algorithm includes extracting a specific area pixel set of the access user's face image, calculating a pixel difference feature value of the specific area pixel set, converting the specific area pixel set into a specific area integral pixel set, and calculating an integral image of the specific area integral pixel set:

[0052] f 像差 =∑(x white )-∑(x black );

[0053] I(x,y)=i(x,y)+I(x-1,y)+I(x,y-1)-I(x-1,y-1);

[0054] Among them, f 像差 is the pixel difference eigenvalue, x white is the pixel value of the white area, x black is the pixel value of the black area, I(x,y) is the pixel value of the integral image at the coordinate (x,y), i(x,y) is the image pixel value of the pixel set in a specific area at the coordinate (x,y), I(x-1,y) is the pixel value of the integral image at the coordinate (x-1,y), I(x,y-1) is the pixel value of the integral image at the coordinate (x,y-1), and I(x-1,y-1) is the pixel value of the integral image at the coordinate (x-1,y-1).

[0055] Specifically, this embodiment calculates the pixel difference feature value of the pixel set in the specific area, and the algorithm can quickly extract the key features in the face image, thereby improving the efficiency of face detection. The pixel set in the specific area is converted into an integral pixel set in the specific area using integral map technology, which reduces repeated calculations and improves the operation speed.

[0056] By calculating the integral image, the algorithm can quickly and accurately locate and calculate the pixel sum of any rectangular area, which helps to locate the face area more accurately.

[0057] The algorithm can adapt to face images under different lighting conditions by calculating the pixel difference eigenvalues, thus improving the robustness and adaptability of face detection.

[0058] The Active-Shape-Model face alignment algorithm includes initializing a shape model in an integral image of an integral pixel set in a specific area, searching for the local conditional optimal position of each local face feature point of the shape model, obtaining deformation parameters, and applying the deformation parameters to the integral image of the integral pixel set in the specific area to obtain a corrected face posture.

[0059] Specifically, this embodiment can accurately correct facial posture and improve the accuracy of face recognition by initializing the shape model in the integral image and searching for the optimal feature point position. By searching for the optimal position of each local facial feature point, it can adapt to facial images of different angles and expressions and has strong adaptability.

[0060] The integral image of the integral pixel set in a specific area is used for calculation, which reduces the amount of calculation and improves the calculation efficiency. By applying the obtained deformation parameters to the integral image, the algorithm can flexibly adjust the face model to adapt to the differences in facial features of different individuals, thereby improving the accuracy and versatility of face alignment.

[0061] like Figure 2 As shown, the smart door lock also includes a WIFI module;

[0062] The WIFI module performs data communication with multiple smart home devices and a remote control cloud, receives remote commands from the remote control cloud, and sends status information data of the smart door lock; the WIFI module adopts an ESP32 WIFI chip; the WIFI module performs data encryption by encrypting communication data through TLS.

[0063] Specifically, the WIFI module of this embodiment realizes wireless data communication between the smart door lock and multiple smart home devices and the remote control cloud, improves the connectivity and response speed of the entire smart home system, and realizes remote control of the smart door lock by receiving instructions from the remote control cloud, thereby enhancing the user convenience of the system.

[0064] The WIFI module can send the status information data of the smart door lock, so that the homeowner can grasp the working status of the door lock in real time, improving the monitorability and security of the system. The use of TLS encrypted communication data effectively protects the security of data transmission, prevents potential data leakage and hacker attacks, and improves the security performance of the entire system.

[0065] like Figure 2 As shown, the smart door lock includes a lock body control module;

[0066] The lock body control module receives the door opening permission signal, controls the opening and closing of the lock body through the equipped electric lock mechanism, performs the physical actions of opening and closing the door, and detects the status information data of the smart door lock and uploads it to the remote control cloud.

[0067] Specifically, the lock body control module of this embodiment automatically controls the opening and closing of the lock body according to the received door opening permission signal, thereby realizing the intelligent and automated operation of the door lock and improving user convenience. By equipping an electric lock mechanism, the reliability and safety of the lock body switch are ensured, thereby improving the physical safety performance of the entire smart door lock system.

[0068] The lock body control module can detect the status information of the smart door lock and upload the data to the remote control cloud, realizing real-time monitoring of the door lock status and enhancing the manageability and security of the system.

[0069] By uploading status information to the remote control cloud, the homeowner can understand the working status of the door lock at any time, realizing remote monitoring and management and improving the controllability of the system.

[0070] like Figure 2 As shown, the smart door lock includes a central control center;

[0071] The central control center uses a microcontroller as a core processor to process data and control instructions from the face recognition module, the WIFI module and the lock body control module, and stores authorized user feature data and system configuration data through a non-volatile memory EEPROM.

[0072] Specifically, the central control center of this embodiment serves as a core processing unit, centrally processing data and control instructions from the face recognition module, WIFI module and lock body control module, realizing unified management and coordination of various functional modules of the smart door lock, and improving the overall efficiency and stability of the system.

[0073] The use of a microcontroller as the core processor ensures the rapid processing capability of data from each module, improves the response speed and operating efficiency of the smart door lock, and stores authorized user feature data and system configuration data in the non-volatile memory EEPROM, ensuring that important data will not be lost in the event of a power outage, thereby improving the system's reliability and data security. The system configuration data is stored in the EEPROM, which facilitates flexible system parameter adjustment and updating, and improves the configurability of the smart door lock.

[0074] like Figure 3 As shown, the remote control cloud includes a smart home system user end and a remote cloud;

[0075] The smart home system user end is respectively connected to the remote cloud and the smart door lock signal, and the smart home system user end is used to receive and send emergency bounty orders;

[0076] The remote cloud is respectively connected to the smart home system user end and the smart door lock signal, and the remote cloud is used to record the receipt and release of emergency bounty orders.

[0077] Specifically, this embodiment receives and sends emergency bounty orders through the smart home system user terminal, thereby achieving rapid response and processing of emergency situations; and connects the smart home system user terminal and the smart door lock through remote control of the cloud, thereby achieving collaborative management among the owner, the cloud and the device, thereby improving the integration and management efficiency of the entire smart home system.

[0078] The remote cloud records the receipt and release of emergency bounty orders, enabling full tracking and management of the emergency incident handling process, and enhancing the controllability and transparency of the system.

[0079] The connection between the smart home system user end and the remote cloud and smart door locks provides users with a flexible interactive interface, allowing them to easily monitor and control the smart home system, improving the user experience.

[0080] like Figure 4 As shown, the user terminal of the smart home system includes the owner's mobile terminal, the property mobile terminal, the neighbor's mobile terminal and other user's mobile terminals;

[0081] The owner's mobile terminal is respectively connected to the smart door lock and the remote cloud signal, and is used to send control signals to the smart door lock, receive all status information of the smart door lock, and issue emergency bounty orders to the remote cloud;

[0082] The property mobile terminal, neighbor mobile terminal and other user mobile terminals are all connected to the remote cloud signal to receive emergency bounty orders and receive some status information sent by the smart door lock;

[0083] The total state information includes partial state information and private state information.

[0084] Specifically, this embodiment achieves differentiated access and control permissions for smart door locks for different users by distinguishing between the owner's mobile terminal and other user's mobile terminals (property, neighbors, etc.), thereby improving the security and privacy protection of the system.

[0085] Homeowners can issue emergency bounty orders, and property managers, neighbors, etc. can accept the orders, forming a fast and flexible emergency response network and improving the system's emergency handling capabilities. The owner's mobile terminal can receive all status information of the smart door lock, while other users can only receive partial status information, which not only realizes comprehensive status monitoring but also protects user privacy information.

[0086] When the smart door lock receives high-risk alarm information such as fire, water leakage, and gas leakage, in addition to pushing a bounty order to the mobile user closest to the alarm location in the system, the smart door lock also sends an alarm sound outside the homeowner to alert surrounding neighbors or passing takeaway, courier personnel, and property inspectors. People who hear the alarm can make a real-time video call with the homeowner by touching the doorbell button on the smart door lock. The homeowner can directly send a control signal to the smart door lock through the owner's mobile terminal to open the door, allowing the person who responds to the alarm to enter the room to handle the alarm, thus realizing remote control of the smart door lock and improving the convenience and flexibility of the system. At the same time, the system records the door opening video and the facial image of the person who responds to the alarm in this emergency to ensure the safety of users.

[0087] The plurality of smart home devices include a smart receiving cabinet, a smart window, a smart air conditioner, a smart refrigerator, a smart kitchen, and a smart security;

[0088] The smart receiving cabinet, the smart window, the smart air conditioner, the smart refrigerator, the smart kitchen and the smart security are all connected to the smart door lock signal, and output an emergency signal to the smart door lock when an emergency occurs.

[0089] In a specific embodiment, a smart door lock is used as the central control of the entire smart home system. One of the most critical functions of the smart door lock is to accurately determine whether there is someone at home, thereby affecting the operating status of other smart home devices. The specific steps are as follows:

[0090] Face recognition for leaving the house: Smart door locks use face recognition technology to identify when people leave the house.

[0091] Waiting time: The system will wait for about 5 minutes or longer to ensure that the person is not out for a short time (such as picking up a package).

[0092] Unmanned state determination: If no person is detected entering after the waiting time, the smart door lock will determine that the home is in an unmanned state.

[0093] Smart device control: Once it is determined that there is no one at home, the smart door lock will immediately send corresponding instructions to other smart devices:

[0094] Including controlling the closing of smart windows, turning off smart air conditioners, turning off other unnecessary electrical appliances, and activating security systems.

[0095] Furthermore, for the smart window:

[0096] Smart windows are an important part of smart home systems. Smart door locks send control instructions to smart windows according to environmental conditions and user needs, thereby achieving automatic adjustment. The following are specific examples of smart windows:

[0097] Response to unattended state: When the smart door lock determines that no one is at home, it will immediately send a closing command to the smart window, thereby preventing unexpected situations (such as sudden rain and snow) and improving home safety.

[0098] Weather response: When the smart door lock obtains windy and rainy weather information through the WIFI module, it will automatically issue a command to close the smart window, thereby preventing rain from entering the room and protecting indoor property.

[0099] Emergency response: In the event of an emergency such as a fire or gas leak, the smart door lock will send control commands to automatically open the smart windows to assist ventilation and evacuation.

[0100] For the smart air conditioner:

[0101] Unmanned energy-saving mode: When the smart door lock determines that no one is at home, it will immediately send a shutdown command to the smart air conditioner to ensure that the smart air conditioner does not waste energy when no one is at home.

[0102] For the smart kitchen:

[0103] Natural gas safety control: When the smart door lock determines that no one is at home, it will immediately send a command to the smart kitchen to close the main natural gas valve to prevent safety hazards caused by forgetting to turn off the stove.

[0104] Remote control: Users can send control signals to the smart door lock through the owner's mobile terminal, and the smart door lock sends them to the corresponding smart kitchen equipment in the smart kitchen to remotely control the smart kitchen equipment. For example, users can place the ingredients before going out, preheat the oven and start the rice cooker after calculating the time, so that they can enjoy hot meals when they get home.

[0105] Gas leak detection: When the smart door lock determines that no one is at home, if it detects that the main natural gas valve is open for too long, the smart kitchen will immediately send an alarm signal to notify the smart door lock, and the smart door lock will notify the owner's mobile terminal. When the owner's mobile terminal does not respond within the specified time, the smart door lock will issue an instruction to close the natural gas valve and open the smart window for ventilation.

[0106] Specifically, this implementation integrates multiple smart devices such as smart receiving cabinets, smart windows, smart air conditioners, smart refrigerators, smart kitchens and smart security, realizing comprehensive intelligent management of the home environment. By connecting all smart devices with smart door lock signals, it can output emergency signals to smart door locks in time when an emergency occurs, forming a fast and comprehensive home safety early warning network and improving the emergency response capability of the system.

[0107] With the smart door lock as the central node, various smart home devices are connected to achieve collaborative work and unified management among devices, thus improving the operating efficiency and consistency of the entire smart home system. By integrating the monitoring functions of various smart devices (such as smart security, smart windows, etc.), the system can monitor the safety status of the home environment from multiple dimensions, thus greatly improving the home safety performance.

[0108] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A smart home system based on smart door locks as central control, It is characterized in that The system includes a smart door lock, multiple smart home devices, and a remote control cloud; The smart door lock is respectively connected to a plurality of smart home devices and a remote control cloud; The smart door lock receives emergency signals fed back by smart home devices and outputs them to the remote control cloud. The remote control cloud issues an emergency bounty order. When the smart door lock detects that the terminal device that receives the emergency bounty order has arrived at the target area, the smart door lock receives the visiting user facial image sent by the terminal device, and adds the visiting user facial image to the stored authorized user features, so that the person carrying the terminal device can handle the emergency event corresponding to the emergency signal. After the emergency event is handled, the smart door lock deletes the added visiting user facial image.

2. A smart home system based on a smart door lock as a central control as claimed in claim 1, It is characterized in that The smart door lock includes a face recognition module; The face recognition module uses a high-resolution camera to capture the face image of the visiting user, uses the Viola-Jones algorithm to locate the face area, applies the Active-Shape-Model face alignment algorithm to correct the face posture, uses the DeepFace deep learning model to extract the face features of the visiting user, compares the extracted face features of the visiting user with the stored authorized user features, obtains the first cosine similarity, sets the similarity threshold, and when the first cosine similarity exceeds the similarity threshold, it is determined that the identity authentication of the visiting user is passed, and outputs a door opening permission signal.

3. A smart home system based on a smart door lock as a central control as claimed in claim 2, It is characterized in that The Viola-Jones algorithm includes extracting a specific area pixel set of the access user's face image, calculating a pixel difference feature value of the specific area pixel set, converting the specific area pixel set into a specific area integral pixel set, and calculating an integral image of the specific area integral pixel set: f 像差 =∑(x white )-∑(x black ); I(x,y)=i(x,y)+I(x-1,y)+I(x,y-1)-I(x-1,y-1); Among them, f 像差 is the pixel difference eigenvalue, x white is the pixel value of the white area, x black is the pixel value of the black area, I(x,y) is the pixel value of the integral image at the coordinate (x,y), i(x,y) is the image pixel value of the pixel set in a specific area at the coordinate (x,y), I(x-1,y) is the pixel value of the integral image at the coordinate (x-1,y), I(x,y-1) is the pixel value of the integral image at the coordinate (x,y-1), and I(x-1,y-1) is the pixel value of the integral image at the coordinate (x-1,y-1).

4. A smart home system based on a smart door lock as a central control as claimed in claim 3, It is characterized in that The Active-Shape-Model face alignment algorithm includes initializing a shape model in an integral image of an integral pixel set in a specific area, searching for the local conditional optimal position of each local face feature point of the shape model, obtaining deformation parameters, and applying the deformation parameters to the integral image of the integral pixel set in the specific area to obtain a corrected face posture.

5. A smart home system based on a smart door lock as a central control as claimed in claim 4, It is characterized in that The smart door lock also includes a WIFI module; The WIFI module performs data communication with multiple smart home devices and a remote control cloud, receives remote commands from the remote control cloud, and sends status information data of the smart door lock; the WIFI module adopts an ESP32 WIFI chip; the WIFI module performs data encryption by encrypting communication data through TLS.

6. A smart home system based on a smart door lock as a central control as claimed in claim 5, It is characterized in that The smart door lock includes a lock body control module; The lock body control module receives the door opening permission signal, controls the opening and closing of the lock body through the equipped electric lock mechanism, performs the physical actions of opening and closing the door, and detects the status information data of the smart door lock and uploads it to the remote control cloud.

7. A smart home system based on a smart door lock as a central control as claimed in claim 6, It is characterized in that The smart door lock includes a central control center; The central control center uses a microcontroller as a core processor to process data and control instructions from the face recognition module, the WIFI module and the lock body control module, and stores authorized user feature data and system configuration data through a non-volatile memory EEPROM.

8. A smart home system based on a smart door lock as a central control as claimed in claim 7, It is characterized in that The remote control cloud includes a smart home system user end and a remote cloud; The smart home system user end is respectively connected to the remote cloud and the smart door lock signal, and the smart home system user end is used to receive and send emergency bounty orders; The remote cloud is respectively connected to the smart home system user end and the smart door lock signal, and the remote cloud is used to record the receipt and release of emergency bounty orders.

9. A smart home system based on a smart door lock as a central control as claimed in claim 8, It is characterized in that The user terminals of the smart home system include the owner's mobile terminal, the property's mobile terminal, the neighbor's mobile terminal and other user's mobile terminals; The owner's mobile terminal is respectively connected to the smart door lock and the remote cloud signal, and is used to send control signals to the smart door lock, receive all status information of the smart door lock, and issue emergency bounty orders to the remote cloud; The property mobile terminal, neighbor mobile terminal and other user mobile terminals are all connected to the remote cloud signal to receive emergency bounty orders and receive some status information sent by the smart door lock; The total state information includes partial state information and private state information.

10. A smart home system based on a smart door lock as a central control as claimed in claim 9, It is characterized in that The plurality of smart home devices include a smart receiving cabinet, a smart window, a smart air conditioner, a smart refrigerator, a smart kitchen, and a smart security; The smart receiving cabinet, the smart window, the smart air conditioner, the smart refrigerator, the smart kitchen and the smart security are all connected to the smart door lock signal, and output an emergency signal to the smart door lock when an emergency occurs.

Images