Safety protection methods, devices, electronic equipment and storage media

Abstract

This application discloses a security protection method, device, electronic device, and storage medium. Specifically, it discloses: determining whether a non-whitelisted user exists in the indoor detection area based on real-time image information; wherein, a non-whitelisted user is a user whose identity information has not been saved; if a non-whitelisted user exists and their entry method is illegal intrusion, then the non-whitelisted user is determined to be an illegal user; determining the corresponding protection conditions based on the location of the illegal user, and obtaining the detection information corresponding to the protection conditions; and determining and activating the indoor protection strategy corresponding to the protection conditions based on the protection conditions and the detection information. Thus, by activating the corresponding protection strategy based on the specific location of the illegal user indoors, indoor security protection is achieved, protecting the personal and property safety of people inside the room.

Description

Technical Field

[0001] This application relates to the field of home security technology, and more specifically, to a security protection method, device, electronic device, and storage medium. Background Technology

[0002] With the development of science and technology, smart home devices are becoming increasingly popular in people's daily lives, and more and more users are using them.

[0003] Currently, security solutions can be built based on smart home devices to protect residential security. However, during the research and practice of related technologies, the inventors of this application discovered that existing security solutions only provide protection through user identification and alarms, but cannot take concrete security measures to protect indoor spaces, leaving significant security risks in the indoor environment. Summary of the Invention

[0004] In view of the above problems, this application proposes a security protection method, device, electronic device, and storage medium. To solve the above technical problems, the embodiments of this application provide the following technical solutions:

[0005] In a first aspect, embodiments of this application provide a security protection method, which includes: determining whether there are non-whitelisted users in an indoor detection area based on real-time image information; wherein, non-whitelisted users are users whose identity information has not been saved; if there are non-whitelisted users and their entry method is illegal intrusion, then the non-whitelisted users are determined to be illegal users; determining corresponding protection conditions based on the location of the illegal users and obtaining detection information corresponding to the protection conditions; and determining and activating an indoor protection strategy corresponding to the protection conditions based on the protection conditions and the detection information.

[0006] Secondly, embodiments of this application provide a security protection device, which includes: a detection module, used to determine whether there are non-whitelisted users in an indoor detection area based on real-time image information; wherein, non-whitelisted users are users whose identity information has not been saved; a first determination module, used to determine that if there are non-whitelisted users and the non-whitelisted users' entry method is illegal intrusion, then the non-whitelisted users are illegal users; a second determination module, used to determine the corresponding protection conditions and the detection information corresponding to the protection conditions based on the location of the illegal users; and a protection module, used to determine and activate the indoor protection strategy corresponding to the protection conditions based on the protection conditions and the detection information.

[0007] Thirdly, embodiments of this application provide an electronic device comprising: one or more processors, a memory, and one or more application programs. The one or more application programs are stored in the memory and configured to be executed by the one or more processors, and are configured to perform the aforementioned security protection method.

[0008] Fourthly, embodiments of this application provide a computer-readable storage medium storing program code, which can be invoked by a processor to execute the aforementioned security protection method.

[0009] The technical solution provided in this application determines whether there are non-whitelisted users in the indoor detection area based on real-time image information. Non-whitelisted users are those whose identity information has not been saved. If a non-whitelisted user exists and their entry method is illegal intrusion, then the non-whitelisted user is identified as an illegal user. The corresponding protection conditions are determined based on the location of the illegal user, and the detection information corresponding to these protection conditions is obtained. Based on the protection conditions and the detection information, an indoor protection strategy corresponding to the protection conditions is determined and activated. Thus, based on the specific location of the illegal user indoors, the corresponding protection strategy is activated to achieve indoor security protection and safeguard the personal and property safety of those inside. Attached Figure Description

[0010] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This is a schematic diagram of the security protection system provided in the embodiments of this application.

[0012] Figure 2 This is a flowchart illustrating the security protection method provided in the embodiments of this application.

[0013] Figure 3 This is a schematic diagram of the structure of the safety protection device provided in the embodiments of this application.

[0014] Figure 4 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application.

[0015] Figure 5 This is a schematic diagram of the structure of a computer-readable storage medium provided in an embodiment of this application. Detailed Implementation

[0016] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0017] With the development of science and technology, smart homes are becoming increasingly common in people's daily lives. Compared with traditional home appliances, smart home devices can provide a more intelligent and user-friendly experience, resulting in a growing number of users.

[0018] However, during the research and practice of related technologies, the inventors of this application discovered that existing security solutions built upon smart home devices can only provide user identification and alarm functions, but cannot provide truly effective protection for indoor spaces. For example, they cannot identify users through a smart control panel and issue an alarm when an unauthorized user is detected. Such security solutions cannot take concrete security measures to protect indoor spaces, leaving significant security risks unresolved.

[0019] Therefore, to address the aforementioned issues, this application embodiment determines whether non-whitelisted users exist in the indoor detection area based on real-time image information; whereby non-whitelisted users are those whose identity information has not been saved; if a non-whitelisted user exists and their entry method is illegal intrusion, then the non-whitelisted user is determined to be an illegal user; corresponding protection conditions are determined based on the location of the illegal user, and detection information corresponding to the protection conditions is obtained; based on the protection conditions and detection information, an indoor protection strategy corresponding to the protection conditions is determined and activated. Thus, by activating the corresponding protection strategy based on the specific location of the illegal user indoors, indoor security protection is achieved, safeguarding the personal and property safety of those inside.

[0020] The application environment of the security protection method provided in the embodiments of the present invention will be described below.

[0021] Please see Figure 1 , Figure 1 An embodiment of the present application illustrates a security protection system 100, which may include a server 110 and a terminal device 120.

[0022] In some implementations, server 110 can be used to store data required by terminal device 120 and to interact with terminal device 120. The interaction between server 110 and terminal device 120 can be via a network. The network is typically the Internet, but can also be any network, including but not limited to any combination of Local Area Network (LAN), Metropolitan Area Network (MAN), Wide Area Network (WAN), mobile, wired or wireless networks, private networks, or virtual private networks.

[0023] In some implementations, different terminal devices 120 can communicate and transmit data through specific communication protocols, including but not limited to BLE (Bluetooth Low Energy), WLAN (Wireless Local Area Network), Bluetooth, ZigBee, or Wi-Fi (Wireless Fidelity).

[0024] In some implementations, the terminal device 120 can be used to determine whether there are non-whitelisted users in the indoor detection area based on real-time image information; wherein, non-whitelisted users are users whose identity information has not been saved; if there are non-whitelisted users and the non-whitelisted users' entry method is illegal intrusion, then the non-whitelisted users are determined to be illegal users; the corresponding protection conditions are determined based on the area where the illegal users are located, and the detection information corresponding to the protection conditions is obtained; based on the protection conditions and the detection information, the indoor protection strategy corresponding to the protection conditions is determined and activated.

[0025] In other embodiments, the terminal device 120 may further include a master control device and a controlled device (not shown). The master control device refers to the device in the security protection system 100 used to control the controlled devices, such as a smart control panel, a tablet computer, etc.; the controlled devices refer to other devices in the security protection system 100 besides the master control device, which can be configured through the master control device. For example, the controlled devices may be smart door locks, sensors, cameras, alarms, smart TVs, smart air conditioners, smart lights, smart speakers, etc. The master control device can directly interact with the server 110 and the controlled devices; the controlled devices can indirectly interact with the server 110 through the master control device. It is understood that active and passive devices can be configured according to actual needs, and this application embodiment does not impose any limitations on this.

[0026] The following will provide a detailed description with reference to specific embodiments.

[0027] Please see Figure 2 , Figure 2 This is a flowchart illustrating the security protection method provided in this application embodiment, which includes steps S110 to S140.

[0028] In step S110, based on real-time image information, it is determined whether there are non-whitelisted users in the indoor detection area.

[0029] The security protection method provided in this application can be applied to terminal devices, such as smart control panels and tablet computers. For ease of explanation and description, the following text will use a smart control panel as an example.

[0030] In this embodiment, real-time image information refers to image information of the area where the user is located within the indoor detection area. This real-time image information can be acquired using a camera device, which can be a surveillance camera, webcam, or other device with video recording capabilities. It is understood that the installation location of the camera device can be determined according to actual needs, and this embodiment does not impose any restrictions on this.

[0031] In some implementations, the smart control panel can proactively acquire real-time image information from the camera device. Specifically, when a user is detected indoors, the smart control panel can proactively control the camera device to collect real-time image information of the area where the user is located to determine whether a non-whitelisted user exists in the indoor detection area.

[0032] In some implementations, the smart control panel can also passively receive real-time image information sent by the camera device. Specifically, after detecting the presence of a user indoors, the camera device can collect real-time image information of the area where the user is located and send it to the smart control panel, so that the smart control panel can determine whether there is a non-whitelisted user in the indoor detection area based on the received real-time image information.

[0033] Optionally, the presence of a user indoors can be determined using a human body sensor, such as an infrared sensor. Alternatively, facial recognition can also be used to determine the presence of a user indoors; for example, a human detection module can be incorporated into a camera device to detect the presence of a user in the indoor images captured by the camera.

[0034] In some implementations, the monitoring area of ​​the camera equipment can be a fixed area, meaning that the monitoring angle and installation position of the camera equipment are fixed and cannot be adjusted.

[0035] In other embodiments, the monitoring area of ​​the camera device is adjustable. Optionally, the monitoring angle of the camera device can be adjusted, thereby changing the monitoring area of ​​the camera device. For example, the camera device has a rotatable structure, and its initial monitoring area is a first area of ​​the room. The monitoring angle can then be changed by rotating the structure to transform the monitoring area into a second area different from the first area. Optionally, the position of the camera device can be adjusted, thereby changing the monitoring area of ​​the camera device. For example, the camera device is mounted on a slide rail, and its initial monitoring area is a first area. The position of the camera device can then be changed by sliding it on the slide rail to transform the monitoring area into a second area different from the first area. Optionally, both the position and the monitoring angle of the camera device can be adjusted. The methods for adjusting the position and the monitoring angle are similar to those described above and will not be repeated here.

[0036] Furthermore, the adjustment priority for camera position and monitoring angle can be set. For example, adjusting the monitoring angle can be prioritized over adjusting the position, so that whenever the monitoring area of ​​the camera needs to be adjusted, the monitoring angle is adjusted first, and the position is adjusted only if adjusting the monitoring angle cannot meet the requirements.

[0037] In some implementations, the camera device can adjust the monitoring area according to preset rules. Optionally, the monitoring area can be adjusted according to a preset period, for example, the monitoring area of ​​the camera device can be changed every 5 minutes. Optionally, the camera device can also change the monitoring area according to the user's adjustment instructions, for example, changing from a first area to a second area according to the user's adjustment instructions. Optionally, the camera device can also dynamically adjust the monitoring area according to the change of location of non-whitelisted users after determining that there are non-whitelisted users indoors.

[0038] In this embodiment, the indoor detection area refers to the area inside the room that can be monitored by the camera equipment. For example, if there are three rooms in the room: a bedroom, a kitchen, and a living room, and the camera equipment can monitor the bedroom and the living room, then the indoor detection area is the area of ​​the bedroom and the living room.

[0039] In this embodiment, a non-whitelisted user refers to a user whose identity information has not been stored, such as a user other than a resident's family member (friends, renovation workers, etc.); a whitelisted user refers to a user whose identity information has been pre-stored, such as a family member, cleaning staff, etc. In this embodiment, the identity information includes at least facial image information. Understandably, a user's identity information may also include voice information, fingerprint information, etc.

[0040] In some implementations, the identity information of whitelisted users can be stored in the smart control panel or in the server; this application does not impose any restrictions on this.

[0041] In some implementations, facial recognition of users in real-time image information can be used to determine whether a user is not on the whitelist, thereby determining whether there are non-whitelisted users in the indoor detection area. Specifically, facial recognition can involve comparing the extracted facial image information of the user in the real-time image information with the facial image information of pre-saved whitelisted users.

[0042] Optionally, facial recognition can be performed in the intelligent control panel. Specifically, after acquiring real-time image information, the intelligent control panel extracts the user's facial image information from the real-time image information and compares it sequentially with the facial image information of pre-saved whitelisted users. If no matching facial image information is found, the user in the real-time image information is determined to be a non-whitelisted user, thereby determining that a non-whitelisted user exists in the indoor detection area.

[0043] Optionally, facial recognition can be performed on the server. Specifically, after acquiring real-time image information, the intelligent control panel sends the real-time image information to the server. Upon receiving the real-time image information, the server extracts the user's facial image information and compares it sequentially with the facial image information of pre-saved whitelisted users. If no matching facial image information is found, the user in the real-time image information is determined to be a non-whitelisted user, and the matching result is then sent to the intelligent control panel, thereby confirming the presence of a non-whitelisted user in the indoor detection area.

[0044] In some implementations, a face extraction module can extract the user's facial image information from real-time image information, and a face recognition module can compare the user's facial image information from the real-time image information with the facial image information of users in a pre-saved whitelist. Understandably, both the face extraction module and the face recognition module exist within the device that requires face recognition.

[0045] For example, if face recognition is performed on the server, after receiving the real-time image information sent by the smart control panel, the server extracts the face image information of the users present in the image through the face extraction module, and then sends the face image information to the face recognition module. The face recognition module compares it with the face image information of the pre-saved whitelist users in turn. If no matching face image information is found, the user in the real-time image information is determined to be a non-whitelist user.

[0046] In step S120, if there are non-whitelisted users and their access method is illegal intrusion, then the non-whitelisted users are determined to be illegal users.

[0047] In this application's embodiments, illegal intrusion refers to entering a room through illegal means. In some implementations, users can unlock the smart lock through legal means such as entering a password, facial recognition, or fingerprint unlocking, thereby gaining access to the room.

[0048] Specifically, when the intelligent control panel determines, based on the real-time image information obtained, that there is a non-whitelisted user in the indoor detection area, and determines that the whitelisted user's entry method is illegal intrusion, the non-whitelisted user is identified as an illegal user.

[0049] In some implementations, illegal intrusion can be, for example, forced entry, entering through a window, or being followed into the home. It is understood that the specific methods of entry included in illegal intrusion can be determined by the administrator's settings, and this application does not limit such methods.

[0050] In some implementations, an administrator refers to a pre-selected whitelist of users who have the authority to modify relevant settings in the smart control panel. This could include the homeowner, their partner, or their parents. By setting up an administrator, it is possible to prevent other whitelisted users in the home (such as children or cleaning staff) from unauthorizedly altering or misoperating the settings in the smart control panel, thereby compromising the home's security.

[0051] As one implementation method, forced entry can refer to entering a room by forcibly opening a door or window. Examples include breaking locks, prying open doors or windows, etc. Optionally, door and window sensors (i.e., door / window magnetic sensors) can be used to determine whether a door or window has been illegally opened or moved.

[0052] As one implementation method, "entering through a window" can refer to entering a room by climbing through a window. Optionally, the window can be monitored in real time using installed camera equipment to determine if someone is entering through the window. Furthermore, the camera can detect the behavior of non-whitelisted users in the window area of ​​the indoor detection zone to determine whether it matches a preset window-climbing action.

[0053] As one implementation method, tailgating refers to a non-whitelisted user entering the house only after a preset interval has elapsed since a whitelisted user entered the indoor detection area and left the door open. The preset interval can be set by the administrator according to actual needs. Understandably, if a whitelisted user brings a friend (who is not on the whitelist) home, they usually come together. Therefore, the time interval between the whitelisted user and their friend entering the house will not be long. Thus, a preset interval can be set to identify non-whitelisted users who enter the house after the preset time as tailgating.

[0054] As another implementation method, whitelisted users can also manually set a preset number of non-whitelisted users to enter their home based on the number of friends visiting. This allows non-whitelisted users who enter after the preset number are identified as tailgating. For example, if a whitelisted user sets three non-whitelisted users to enter their home, the detection can begin from the whitelisted user's entry point, and any non-whitelisted users entering after the third entry are identified as tailgating.

[0055] In step S130, the corresponding protection conditions are determined based on the location of the unauthorized user, and the detection information corresponding to the protection conditions is obtained.

[0056] In this embodiment, the protection condition refers to the preset conditions required to activate the indoor protection strategy corresponding to the area where the unauthorized user is located; the detection information refers to the information that needs to be detected within the protection condition. The indoor protection strategy refers to the specific protective measures activated indoors, such as closing doors and windows, or issuing an alarm. For example, if the unauthorized user is located in the bedroom, and it is determined that the protection condition corresponding to the bedroom is the presence of an unauthorized user in the bedroom, then the detection information is the detection result of whether the unauthorized user is located in the bedroom.

[0057] Specifically, after determining that a user in the indoor detection area is an unauthorized user, the intelligent control panel acquires real-time image information of the area where the unauthorized user is located. Then, it determines the area where the unauthorized user is located indoors. Following this, it determines the corresponding protection conditions for that area based on a pre-defined correspondence between each indoor area and its corresponding protection conditions, and then acquires the detection information corresponding to those protection conditions. Specifically, the indoor detection area can be pre-divided into multiple areas, and a first correspondence between each area and its corresponding protection conditions can be established and saved. Therefore, after determining the area where the unauthorized user is located, the intelligent control panel can determine the corresponding protection conditions based on the first correspondence, and then determine the detection information to be acquired based on the protection conditions.

[0058] In some implementations, the detection information may include only one type of information, such as the identity of the whitelisted user; or it may include multiple types of information, such as the location information of the whitelisted user indoors, the status information of the whitelisted user, etc.

[0059] In some implementations, the location of an unauthorized user within the room can be determined based on the furniture placement and layout diagram in real-time image information. Specifically, a furniture layout diagram can be pre-determined and saved based on the placement of the main furniture in the room. Once an unauthorized user is identified within the detection area, the intelligent control device acquires real-time image information of the area where the unauthorized user is located and compares the furniture placement in the real-time image information with the furniture layout diagram to determine the specific location of the unauthorized user. The furniture layout diagram can be stored in the intelligent control panel or on a server, and the intelligent control panel can obtain the furniture layout diagram from the server via a network.

[0060] In some implementations, the location of an unauthorized user can be determined based on a human body sensor and a building layout map. Specifically, the building layout map can be saved in advance, and then, after determining that an unauthorized user exists indoors, the human body sensor can be activated to detect the unauthorized user, and the location of the unauthorized user can be determined by combining the building layout map.

[0061] In some implementations, the location of an unauthorized user can be determined based on the camera equipment acquiring the real-time image information and a second correspondence. Specifically, a unique identifier can be assigned to each camera equipment, and a second correspondence can be established between the identifier of each camera equipment, the monitoring area corresponding to each camera equipment, and the area to which each monitoring area belongs. The real-time image information carries the identifier of the camera equipment acquiring the image information. Thus, after the intelligent control panel obtains the real-time image information of the area where the unauthorized user is located, it can determine the camera equipment that sent the real-time image information based on the identifier carried in the real-time image information, and then determine the monitoring area where the unauthorized user is located based on the second correspondence, thereby determining the location of the unauthorized user.

[0062] In some embodiments, the location of an illegal user can be determined by comprehensively considering the information from the above multiple dimensions, but this embodiment does not impose any restrictions on this.

[0063] In step S140, based on the protection conditions and detection information, an indoor protection strategy corresponding to the protection conditions is determined and activated.

[0064] Specifically, after determining the protection conditions based on the location of the unauthorized user and obtaining the detection information corresponding to the protection conditions, the system determines whether the protection conditions are met based on the detection information. If met, the corresponding indoor protection conditions can be determined, and the indoor protection strategy can be activated. For example, if the unauthorized user is located in the living room, the protection condition corresponding to the living room is the presence of an unauthorized user in the living room. Therefore, when the detection information indicates the presence of an unauthorized user in the living room, the protection condition is met, thereby determining and activating the indoor protection strategy corresponding to that protection condition.

[0065] In some implementations, the correspondence between protection conditions and indoor protection strategies can be pre-stored. After acquiring detection information, if the detection information meets the protection conditions corresponding to the area where the unauthorized user is located, the smart control panel determines the corresponding indoor protection strategy based on the correspondence between the protection conditions and the indoor protection strategies, and activates the indoor protection strategy. For example, when the unauthorized user is in the bedroom, the corresponding protection condition is that an unauthorized user exists in the area, and the detection information indicates that an unauthorized user exists in the bedroom. Therefore, meeting the protection condition satisfies the condition for activating the indoor protection strategy. Thus, the indoor protection strategy corresponding to the protection condition is determined based on the correspondence between the protection conditions and the indoor protection strategies, and the indoor protection strategy is activated.

[0066] In some implementations, the indoor testing area can be pre-divided into several different zones, each with corresponding protective conditions. These protective conditions may be the same or different for different zones, and can be set according to actual testing needs; this application does not impose any restrictions on this.

[0067] In some implementations, the indoor detection area may include a first indoor area. An alarm will be triggered when an unauthorized user is detected in the first indoor area to warn the unauthorized user to leave immediately. Therefore, the protection condition corresponding to the first indoor area can be that the unauthorized user has not left the area within a preset time after the alarm is triggered. The detection information corresponding to the first indoor area is the duration of the unauthorized user's stay in the first indoor area. The first indoor area may be a bedroom (e.g., a master bedroom or a secondary bedroom).

[0068] Specifically, the intelligent control panel can determine the location information of unauthorized users based on real-time image information, and then determine whether the unauthorized user is located in the first indoor area based on the location information. If the user is located in the first indoor area, the corresponding protection condition is determined to be that the unauthorized user has not left the first indoor area within a preset time after the alarm is issued. The duration of the unauthorized user's stay in the first indoor area is obtained. If the duration of stay is greater than or equal to the preset duration, the protection condition is determined to be met. The corresponding indoor protection strategy can then be determined based on the correspondence between the protection condition and the indoor protection strategy, and the indoor protection strategy can be activated.

[0069] Optionally, the indoor protection strategy corresponding to the protection conditions of the first indoor area can be to close the door of the first indoor area and disable the door lock's opening permission. Specifically, if an unauthorized user is present in the bedroom and has not left the bedroom within a preset time after the alarm is triggered, the smart control panel will close the bedroom door and disable the door lock's opening permission, preventing the unauthorized user from escaping the bedroom. Furthermore, disabling the door lock's opening permission can disable the lock's internal opening permission, or it can disable both the lock's external and internal opening permissions simultaneously. After the door lock's opening permission is disabled, only the administrator can restore the access.

[0070] In some implementations, the protection condition corresponding to the first indoor area may also be that there are whitelisted users in the first indoor area and the doors in the first indoor area are closed. Thus, the detection information corresponding to this protection condition is the detection results of whitelisted users in the first indoor area and the opening and closing status of the doors.

[0071] Specifically, after the intelligent control panel determines that an unauthorized user is located in the first indoor area based on the real-time image information sent by the camera device, it determines that the protection conditions corresponding to this area are that a whitelisted user exists in the first indoor area and the door in the first indoor area is closed. In this way, it obtains the detection results of the whitelisted user in the first indoor area and the opening and closing status of the door. If there is indeed a whitelisted user in the first indoor area and the door is closed, it is determined that the protection conditions are met. Thus, the indoor protection strategy corresponding to the protection conditions can be determined and activated based on the correspondence between the protection conditions and the indoor protection strategy.

[0072] Optionally, the indoor protection strategy corresponding to the protection conditions in the first indoor area could be to open the door of the first indoor area, and immediately close the door of the first indoor area and disable the door lock's opening permission after an unauthorized user remains in the first indoor area but a whitelisted user leaves. This effectively prevents whitelisted users from being in the same area as unauthorized users, thus avoiding a security risk to the whitelisted user.

[0073] Furthermore, the indoor protection strategy corresponding to the protection conditions in the first indoor area may also include developing escape routes and opening the doors along those escape routes. The escape route may refer to the shortest path from the doorway of the room from which the whitelisted user escapes to the outside.

[0074] Specifically, after closing the door to the first indoor area and disabling the unlocking permission of the door lock, an escape route is determined, and the doors along the escape route are opened according to the obtained escape route. The escape route can be obtained through a path calculation module, which can be set in the intelligent control panel or in the server, depending on actual needs. This embodiment of the application does not impose any limitations on this.

[0075] Furthermore, upon detecting that a whitelisted user has passed through a door on an escape route, the system closes the door the whitelisted user has already passed through and disables the door lock's opening permission.

[0076] In some implementations, the indoor detection area may also include a second indoor area, which may refer to a specific area other than the first indoor area (e.g., a living room) or all areas other than the first indoor area.

[0077] In some implementations, the protective condition corresponding to the second indoor area can be the presence of a whitelisted user in the first indoor area who is physically stronger than the unauthorized user. The corresponding detection information is the detection result of the whitelisted user in the first indoor area. The detection result includes the presence of a whitelisted user in the first indoor area and a physical comparison result, i.e., whether a whitelisted user exists in the first indoor area, and whether that whitelisted user is physically stronger than the unauthorized user. The physical ratio can be determined comprehensively through comparisons of, but not limited to, height and / or gender and / or physical condition.

[0078] Specifically, after determining that an unauthorized user is located in the second indoor area, the corresponding protection condition for this area is determined to be the presence of a whitelisted user in the first indoor area whose height is greater than a preset value than the unauthorized user. If the detection result meets this protection condition, it is determined that the protection condition is met. Based on the correspondence between the protection condition and the indoor protection strategy, the corresponding indoor protection strategy is determined and activated. Optionally, the indoor protection strategy corresponding to this protection condition could be to close the door of the first indoor area and send the unauthorized user's height information to the mobile terminals of whitelisted users in the first indoor area.

[0079] The preset value must be at least greater than 0, for example, it could be 10cm (centimeter). Administrators can set this value according to their specific needs. Understandably, when a whitelisted user is taller than an unauthorized user, the whitelisted user is considered capable of subduing the unauthorized user. After closing the doors to the first indoor area, the whitelisted user can determine whether to leave and subdue the unauthorized user based on the received height information, or they can lock the doors to the first indoor area from the inside. For example, even if a whitelisted user is taller than the unauthorized user, but their current physical condition is not good, the whitelisted user can choose not to leave and lock the door from the inside to ensure their own safety.

[0080] In some implementations, the height information of whitelisted users can be included in their identity information, while the height information of non-whitelisted users can be determined through a height recognition module.

[0081] In some implementations, the protection condition corresponding to the second indoor area may also be that there are whitelisted users in the first indoor area who are in a state of pending protection, and the corresponding detection information is the detection result of the whitelisted users in the first indoor area. The detection result includes the presence and status results of the whitelisted users in the first indoor area.

[0082] Specifically, after determining that an unauthorized user is located in the second indoor area, the intelligent control panel determines that the corresponding protection conditions for that area are a whitelisted user located in the first indoor area and the whitelisted user's status being pending protection. Therefore, it can determine that the detection information to be obtained is the detection result of the whitelisted user in the first indoor area. If it is determined that a whitelisted user is located in the first indoor area and is in a pending protection status, then the protection conditions are met. Thus, based on the correspondence between the protection conditions and indoor protection strategies, the corresponding indoor protection strategy can be determined and activated.

[0083] The state to be protected could be, for example, a whitelisted user being in a sleep or showering state. Understandably, the specific scenarios included in the state to be protected can be configured by the administrator according to actual needs.

[0084] Optionally, the indoor protection strategy corresponding to the protection conditions in the second indoor area could be to close the door of the first indoor area and disable the external opening permission of the door lock, so that unauthorized users cannot open the door of the first indoor area normally from the outside. Understandably, if the door of the first indoor area is already closed, the external opening permission of the door lock is directly disabled.

[0085] Furthermore, to prevent whitelisted users in the first indoor area from unknowingly leaving their homes and encountering unauthorized users, thus posing a security risk, an alert message can be sent to whitelisted users in the first indoor area after the external unlocking permission on the door is disabled. This alert message can be sent as a text message to the terminal device used by the whitelisted user in the first indoor area, or it can be sent as an audio message to a playback device in the first indoor area.

[0086] In some implementations, the protection condition corresponding to the second indoor area can also be the presence of a whitelisted user in the first indoor area who is identified as a key protected user. This allows the corresponding detection information to be determined as the detection result of the whitelisted user in the first indoor area. The detection result can include the presence and identity of the whitelisted user in the first indoor area.

[0087] Specifically, after determining that an unauthorized user is located in the second indoor area, the intelligent control panel determines, based on the correspondence between indoor detection areas and protection conditions, that the protection condition corresponding to the second indoor area is the presence of a whitelisted user in the first indoor area, and that this whitelisted user is a key protected user. Therefore, the required detection information is the detection result of the whitelisted user in the first indoor area. If it is determined that a whitelisted user exists in the first indoor area and that this whitelisted user is a key protected user, then the protection condition is met. Thus, the corresponding indoor protection strategy can be determined and activated based on the correspondence between protection conditions and indoor protection strategies.

[0088] In some implementations, "key protected users" refers to whitelisted users who pose a high risk upon encountering unauthorized users; these could be, for example, children, the elderly, or whitelisted users with mobility issues. Understandably, the settings for key protected users can be configured by the administrator according to actual needs. Optionally, key protected users may also include whitelisted users whose status is currently pending protection, as mentioned above.

[0089] Optionally, the indoor protection strategy corresponding to the protection conditions in the second indoor area could be to close the door to the first indoor area and disable all opening permissions for the door lock, so that unauthorized users cannot open the door to the first indoor area from the outside, and key protected users cannot open the door from the inside, thereby ensuring the personal safety of key protected users. Understandably, if the door to the first indoor area is already closed, only disabling all opening permissions for the door lock may be necessary.

[0090] Furthermore, if an unauthorized user is detected lingering at the entrance of the first indoor area for a period exceeding a preset value, it can be assumed that the unauthorized user is attempting to enter the first indoor area, thus triggering an alarm to further reduce the possibility of key protected users encountering danger.

[0091] In some implementations, the indoor detection area may also include a third indoor area, which may be a key security room (such as a study or a storage room).

[0092] In some implementations, the protection condition corresponding to the third indoor area may be that there are no whitelisted users in the third indoor area. In this case, the detection information corresponding to the protection condition is the detection result of whitelisted users in the third indoor area, that is, whether there are whitelisted users or not in the third indoor area.

[0093] Specifically, after determining that an unauthorized user is located in the third indoor area, the intelligent control panel determines that the protection condition corresponding to that area is that there are no whitelisted users in that area. If the detection result shows that there are no whitelisted users in the third indoor area, the protection condition is met. Thus, the indoor protection policy corresponding to the protection condition can be determined and activated based on the correspondence between the protection condition and the indoor protection policy.

[0094] Optionally, the indoor protection strategy corresponding to the protection conditions in the third indoor area could be to close the door to the first indoor area and disable all access to the door lock, thereby trapping the unauthorized user in the third indoor area and facilitating their subsequent arrest. Understandably, if the door to the first indoor area is already closed, then all access to the door lock is directly disabled.

[0095] In some implementations, while closing the doors and disabling the access to the door locks in each area, the windows in that area can also be closed and the access to the window locks disabled to prevent unauthorized users from escaping or entering through the windows.

[0096] In some implementations, the smart control panel can communicate with the mobile terminals (e.g., mobile phones) of whitelisted users. Upon detecting an unauthorized user in the indoor detection area, it sends a warning message to the whitelisted user's mobile terminal, indicating that their home has been illegally accessed. This warning message can be, for example, text, images, or video. For instance, a text message could read, "Unauthorized personnel present in home; indoor security measures activated." Understandably, the specific content can be configured according to actual needs, and this application does not impose any limitations on this.

[0097] In some implementations, a corresponding warning message can be sent to the mobile terminal of a whitelisted user based on the specific location of the unauthorized user indoors. For example, when the unauthorized user is in the first indoor area, the message "Unauthorized user is in the first indoor area" can be sent; when the unauthorized user is in the second indoor area, the message "Unauthorized user is in the second indoor area" can be sent.

[0098] In some implementations, after receiving a warning message, the mobile terminal of a whitelisted user can confirm that it is aware of the unauthorized intrusion. If no confirmation message is received from the whitelisted user within a preset time, it can be assumed that the whitelisted user is unaware of the situation. Therefore, in order to promptly remind the whitelisted user, a call can be made to the whitelisted user to alert them that an unauthorized intrusion has occurred in their home.

[0099] Furthermore, call priorities can be set for whitelisted users, allowing calls to them to proceed from highest to lowest priority. For example, the call priorities could be, from highest to lowest, the homeowner, other administrators besides the homeowner, and the remaining whitelisted users. Additionally, if all whitelisted users are unable to make a call, an alarm can be triggered, such as notifying property management or calling the police.

[0100] In addition to providing security protection against unauthorized users entering the room, in some application scenarios, protection can also be provided before unauthorized users enter the room, in order to further reduce indoor security risks.

[0101] In some implementations, since ordinary strangers simply pass by someone's door without lingering for long, camera equipment can be used to monitor the outdoor environment in real time. After detecting a non-whitelisted user in the outdoor detection area, the duration of their stay is recorded. If the stay exceeds a preset monitoring threshold, the user is identified as a target monitoring user and requires focused monitoring. The outdoor detection area can be any area visible from the outside. Understandably, the intelligent control panel can also actively or passively acquire real-time outdoor image information (i.e., real-time outdoor image information).

[0102] In some implementations, a timing module may be included. Upon detecting a non-whitelisted user in the outdoor detection area, a timing signal can be sent to the timing module to record the duration of the non-whitelisted user's stay. When the stay duration exceeds a preset monitoring threshold, the timing module sends an alert signal to the intelligent control panel. The intelligent control panel can then determine from the alert signal that a target user is present in the outdoor detection area and requires focused monitoring. The timing module can be integrated into the intelligent control panel, a server, or exist as a standalone device within the security system.

[0103] Optionally, focusing on monitoring a target user can be achieved by zooming in on a preset area where the target user is located, allowing for clearer and more accurate monitoring. Alternatively, the target user can be marked as a key monitoring object, and the camera's monitoring angle can then be adjusted to follow the user's movement, ensuring the user remains within the camera's monitoring area until they leave the outdoor monitoring area. Furthermore, after confirming the target user has left the outdoor monitoring area, the camera can readjust its monitoring angle until it returns to its initial position.

[0104] In some implementations, after determining that there is a target monitoring user in the outdoor detection area, the intelligent control panel can also predict whether the target monitoring user has an intention to illegally intrude based on the user behavior of the target monitoring user in the outdoor real-time image information. If it is predicted that the target monitoring user has an intention to illegally intrude, the outdoor protection strategy is activated.

[0105] In some implementations, user behavior may refer to a user's body movements and / or facial expressions. The intelligent control panel may include a pre-trained behavior prediction module. By inputting real-time outdoor image information sent by the camera device into the behavior prediction module, prediction results can be obtained.

[0106] Optionally, the prediction result can be a binary classification result, i.e., whether there is an intent to illegally intrude or not; alternatively, the prediction result can also be a specific probability of the existence of an intent to illegally intrude, such as 80% or 90%. Furthermore, if the prediction result is a specific probability, it can be set that if the probability is greater than a preset probability, the target monitored user is considered to have an intent to illegally intrude, and then the outdoor protection strategy is activated.

[0107] In some implementations, user behavior can also refer to the duration a user stays in the outdoor monitoring area. Specifically, if the duration a target user stays in the outdoor monitoring area exceeds a preset dwell time threshold, it is determined that the target user has an intent to illegally intrude. The preset dwell time threshold is greater than a preset monitoring threshold. For example, the preset monitoring threshold is 1 minute, and the preset dwell time threshold is 2 minutes. Therefore, when a non-whitelisted user stays in the outdoor monitoring area for more than 1 minute, that non-whitelisted user is designated as a target monitoring user; when the dwell time exceeds 2 minutes, it can be considered that the target monitoring user has an intent to illegally intrude.

[0108] In some implementations, outdoor protection strategies may involve playing warning messages, such as "You have been staying here for too long. Please leave if there is nothing else to do," to alert the target user that their behavior is being monitored, thereby prompting them to leave promptly.

[0109] In some implementations, if it is determined that the target monitored user has an intent to illegally intrude, a corresponding outdoor protection strategy can be activated based on the real-time location of the target monitored user. Optionally, different outdoor protection strategies can be activated based on the distance of the target monitored user from the door or window. For example, when the target user with an intent to illegally intrude is 1 meter (m) away from the door or window, a warning voice is issued; when the distance is 0.5m, the volume of the warning voice is increased.

[0110] Optionally, the camera equipment inside the monitoring room can be turned on after it is determined that the target user outside the room has an intent to illegally intrude. Optionally, the camera equipment can be automatically turned on to monitor the indoor environment after a whitelisted user leaves the room.

[0111] As described above, this embodiment of the application determines whether there are non-whitelisted users in the indoor detection area based on real-time image information; where non-whitelisted users are users whose identity information has not been saved; if there are non-whitelisted users, and their entry method is illegal intrusion, then the non-whitelisted users are determined to be illegal users; the corresponding protection conditions are determined based on the location of the illegal users, and the detection information corresponding to the protection conditions is obtained; based on the protection conditions and the detection information, the indoor protection strategy corresponding to the protection conditions is determined and activated. Thus, the corresponding protection strategy is activated based on the specific location of the illegal user indoors to achieve indoor security protection and safeguard the personal and property safety of people inside the room.

[0112] Please see Figure 3 , Figure 3 This is a schematic diagram of the structure of the safety protection device 200 provided in the embodiments of this application. The safety protection device 200 may include a detection module 210, a first determination module 220, a second determination module 230, and a protection module 240. Specifically:

[0113] The detection module 210 can be used to determine whether there are non-whitelisted users in the indoor detection area based on real-time image information; where non-whitelisted users are users whose identity information has not been saved.

[0114] The first determination module 220 can be used to determine that if there are non-whitelisted users and the non-whitelisted users' access method is illegal intrusion, then the non-whitelisted users are identified as illegal users.

[0115] The second determining module 230 can be used to determine the corresponding protection conditions and the detection information corresponding to the protection conditions based on the location of the unauthorized user.

[0116] The protection module 240 can be used to determine and activate an indoor protection strategy corresponding to the protection conditions based on the protection conditions and detection information.

[0117] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device and module can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0118] In the several embodiments provided in this application, the coupling between modules can be electrical, mechanical, or other forms of coupling.

[0119] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0120] Please see Figure 4 , Figure 4 This is a schematic diagram of the structure of an electronic device 300 provided in an embodiment of this application. The electronic device 300 can be an electronic device capable of running applications, such as a smart control panel or a tablet computer. The electronic device 300 in this application may include one or more of the following components: a processor 310, a memory 320, and one or more applications, wherein the one or more applications can be stored in the memory 320 and configured to be executed by one or more processors 310, and the one or more applications are configured to perform the security protection method as described in the foregoing method embodiments.

[0121] Processor 310 may include one or more processing cores. Processor 310 connects to various parts within the electronic device 300 using various interfaces and lines, and performs various functions and processes data of the electronic device 300 by running or executing instructions, programs, code sets, or instruction sets stored in memory 320, and by calling data stored in memory 320. Optionally, processor 310 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). Processor 310 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the displayed content; and the modem handles wireless communication. It is understood that the modem may also not be integrated into processor 310 and may be implemented separately using a communication chip.

[0122] The memory 320 may include random access memory (RAM) or read-only memory (ROM). The memory 320 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 320 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a judgment function, a protection function, etc.), and instructions for implementing the various method embodiments described below. The data storage area may also store data created by the electronic device 300 during use (such as real-time image information, whitelisted user identity information, etc.).

[0123] Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of a computer-readable storage medium provided in an embodiment of this application. The computer-readable medium 400 stores program code, which can be called by a processor to execute the security protection method described in the above method embodiments.

[0124] The computer-readable storage medium 400 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 400 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 400 has storage space for program code 410 that performs any of the method steps described above. This program code can be read from or written to one or more computer program devices. The program code 410 may be compressed, for example, in a suitable form.

[0125] This application also provides a computer program device or computer program that includes computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the security protection methods described in the various optional embodiments above.

[0126] The security protection method, device, electronic equipment, and storage medium provided in this application determine whether there are non-whitelisted users in the indoor detection area based on real-time image information. Non-whitelisted users are those whose identity information has not been saved. If a non-whitelisted user exists and their entry method is illegal intrusion, then the non-whitelisted user is determined to be an illegal user. The corresponding protection conditions are determined based on the location of the illegal user, and the corresponding detection information is obtained. Based on the protection conditions and detection information, an indoor protection strategy corresponding to the protection conditions is determined and activated. Thus, based on the specific location of the illegal user indoors, the corresponding protection strategy is activated to achieve indoor security protection and safeguard the personal and property safety of people inside the room.

[0127] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A security protection method, characterized in that, The method includes: Based on real-time image information, determine whether there are non-whitelisted users in the indoor detection area; wherein, non-whitelisted users are users whose identity information has not been saved. If a non-whitelisted user exists, and the non-whitelisted user's access method is illegal intrusion, then the non-whitelisted user is determined to be an illegal user. Based on the location of the illegal user, the corresponding protection conditions are determined, and the detection information corresponding to the protection conditions is obtained. If the location is the second indoor area, the protection conditions are: there is a whitelisted user in the first indoor area who is in a state of pending protection, or there is a whitelisted user in the first indoor area whose identity is a key protected user. The detection information includes the detection results of the whitelisted user. The first indoor area and the second indoor area are different areas. Based on the protection conditions and the detection information, an indoor protection strategy corresponding to the protection conditions is determined and activated. The indoor protection strategy includes: when the detection result indicates that a whitelisted user exists in the first indoor area and the whitelisted user is in a state of pending protection, closing the door lock of the first indoor area and disabling the external opening permission of the door lock of the first indoor area, and sending a warning message to the terminal device used by the whitelisted user in the first indoor area as a text reminder or to the playback device in the first indoor area as a voice reminder; when the detection result indicates that a whitelisted user exists in the first indoor area and the whitelisted user is a key protected user, closing the door lock of the first indoor area and disabling all opening permissions of the door lock of the first indoor area.

2. The security protection method according to claim 1, characterized in that, The step of determining the corresponding protection conditions based on the location of the unauthorized user and obtaining the detection information corresponding to the protection conditions includes: Determine whether the location of the illegal user is within the first indoor area based on the location information of the illegal user; If the user is located in the first indoor area, then the protection conditions corresponding to the first indoor area are determined; wherein, the protection condition is that the unauthorized user does not leave the first indoor area within a preset time after the alarm is issued; Obtain the duration of the unauthorized user's stay in the first indoor area, corresponding to the protection conditions; The step of determining and activating an indoor protection strategy corresponding to the protection conditions based on the protection conditions and the detection information includes: Based on the protection conditions and the duration of stay, determine and activate the indoor protection strategy corresponding to the protection conditions.

3. The security protection method according to claim 1, characterized in that, The step of determining the corresponding protection conditions based on the location of the unauthorized user and obtaining the detection information corresponding to the protection conditions includes: Determine whether the location of the illegal user is within the first indoor area based on the location information of the illegal user; If located in the first indoor area, then the protection conditions corresponding to the first indoor area are determined; wherein, the protection conditions are that there is a whitelisted user in the first indoor area and the door in the first indoor area is closed, and the whitelisted user is a user whose identity information has been saved; Obtain the detection results of the whitelisted users in the first indoor area corresponding to the protection conditions, as well as the opening and closing status of the door; The step of determining and activating an indoor protection strategy corresponding to the protection conditions based on the protection conditions and the detection information includes: Based on the protection conditions, the detection results, and the opening / closing status, determine and activate the indoor protection strategy corresponding to the protection conditions.

4. The security protection method according to claim 1, characterized in that, The step of determining the corresponding protection conditions based on the location of the unauthorized user and obtaining the detection information corresponding to the protection conditions includes: Determine whether the location of the unauthorized user is within the third indoor area based on the location information of the unauthorized user; If located in the third indoor area, then the protection conditions corresponding to the third indoor area are determined; wherein, the protection condition is that there are no whitelisted users in the third indoor area, and the whitelisted users are users whose identity information has been saved; Obtain the detection results of the whitelisted users in the third indoor area corresponding to the protection conditions; The step of determining and activating an indoor protection strategy corresponding to the protection conditions based on the protection conditions and the detection information includes: Based on the protection conditions and the test results, determine and activate the indoor protection strategy corresponding to the protection conditions.

5. The security protection method according to any one of claims 1-4, characterized in that, Before determining whether a non-whitelisted user exists in the indoor detection area based on real-time image information, the method further includes: Determine whether a target monitoring user exists in the outdoor detection area; wherein, the target monitoring user is a non-whitelisted user whose stay time in the outdoor detection area exceeds a preset monitoring threshold; If so, then predict whether the target monitored user has any intention to illegally intrude based on the user behavior of the target monitored user; If it is predicted that the target monitored user has the intent to illegally intrude, then the outdoor protection strategy is activated.

6. A safety protection device, characterized in that, The device includes: The detection module is used to determine whether there are non-whitelisted users in the indoor detection area based on real-time image information; wherein, the non-whitelisted users are users whose identity information has not been saved. The first determining module is used to determine that if there is a non-whitelist user and the non-whitelist user's access method is illegal intrusion, then the non-whitelist user is an illegal user. The second determining module is used to determine the corresponding protection conditions and the detection information corresponding to the protection conditions based on the location of the illegal user. If the location is a second indoor area, the protection conditions are: there is a whitelisted user in a state of pending protection in the first indoor area, or there is a whitelisted user in the first indoor area whose identity is a key protected user. The detection information includes the detection results of the whitelisted user. The first indoor area and the second indoor area are different areas. The protection module is used to determine and activate an indoor protection strategy corresponding to the protection conditions based on the protection conditions and the detection information. The indoor protection strategy includes: when the detection result indicates that there is a whitelisted user in the first indoor area and the whitelisted user is in a protected state, closing the door lock of the first indoor area and disabling the external opening permission of the door lock of the first indoor area, and sending a warning message to the terminal device used by the whitelisted user in the first indoor area as a text reminder or to the playback device in the first indoor area as a voice reminder; when the detection result indicates that there is a whitelisted user in the first indoor area and the whitelisted user is a key protected user, closing the door lock of the first indoor area and disabling all opening permissions of the door lock of the first indoor area.

7. An electronic device, characterized in that, The electronic device includes: One or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications being configured to perform the security protection method as described in any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium contains program code, which can be invoked by a processor to execute the security protection method as described in any one of claims 1-5.

Images