Intelligent home control method, system, device and medium based on active sensing

Abstract

The application discloses an active perception-based smart home control method, system, device and medium, which determines a corresponding target image acquisition device after determining a current user identification result in combination with a smart gateway group, a smart door lock and an image acquisition device group; if the smart gateway group determines that a user corresponding to the current user identification result is a registered user, a target setting area corresponding to the target image acquisition device is acquired, and a target smart gateway corresponding to the target setting area is determined; the target smart gateway acquires a preset smart home control strategy corresponding to the current user identification result, and sends the preset smart home control strategy to a sweeping robot group and a smart air conditioner group, so as to intelligently control the sweeping robot group and the smart air conditioner group. The embodiment of the application can enable all smart home devices in a house to be stably connected to a home Internet of Things and be uniformly managed and accurately controlled through the smart gateway group when the smart home system is applied to a large-area and non-single-story house.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of smart home, and in particular to a smart home control method and system based on active sensing, a smart home control device and a medium. BACKGROUND

[0002] At present, smart home systems have been widely applied in home, office and other scenarios. For example, in a home scenario, a smart home system is generally applied to a single-story residential area with an area less than 150 square meters. By setting a smart gateway, centralized control of smart home devices deployed throughout the house can be realized. However, when a smart home system is applied to a large-area and non-single-story house, only through a smart gateway, due to the limited coverage area of the connection signal of the smart gateway, part of the smart home devices cannot be stably connected to the home Internet of Things, that is, it is impossible to uniformly manage and control all the smart home devices deployed in the large-area and non-single-story house. SUMMARY

[0003] The embodiments of the present application provide a smart home control method and system based on active sensing, a smart home control device and a medium, aiming at solving the problem that in the prior art, when a smart home system is applied to a large-area and non-single-story house, only through a smart gateway, due to the limited coverage area of the connection signal of the smart gateway, part of the smart home devices cannot be stably connected to the home Internet of Things, and it is impossible to uniformly manage and control all the smart home devices deployed in the large-area and non-single-story house.

[0004] In a first aspect, the embodiments of the present application provide a smart home control method based on active sensing, applied to a smart home system, wherein the smart home system includes a smart gateway group, a smart door lock, an image acquisition device group, a sweeping robot group and a smart air conditioner group, the image acquisition device group, the sweeping robot group and the smart air conditioner group are in communication connection with the smart gateway group; the smart home control method based on active sensing includes:

[0005] The smart door lock responds to an unlocking instruction and sends the unlocking instruction to the smart gateway group;

[0006] The smart gateway group receives the unlocking instruction, generates an active sensing control instruction based on the unlocking instruction and sends the active sensing control instruction to the image acquisition device group;

[0007] The image acquisition device group acquires a current user image set based on the active sensing control instruction and a preset image acquisition strategy and sends the current user image set to the smart gateway group;

[0008] The intelligent gateway group obtains a current user recognition result corresponding to the current user image set based on a local face image recognition model, and determines a target image acquisition device in the image acquisition device group that sends the current user image set;

[0009] If the intelligent gateway group determines that the user corresponding to the current user recognition result is a registered user, and the target image acquisition device corresponds to one image acquisition device in the image acquisition device group, the intelligent gateway group obtains a target setting area corresponding to the target image acquisition device, and determines a target intelligent gateway corresponding to the target setting area from the intelligent gateway group;

[0010] The target intelligent gateway obtains a preset smart home control strategy corresponding to the current user recognition result, and sends the preset smart home control strategy to the group of sweeping robots and the group of intelligent air conditioners, so as to correspondingly control the group of sweeping robots and the group of intelligent air conditioners.

[0011] In a second aspect, the embodiments of the present application also provide an active perception-based smart home control system configured in a smart home system, wherein the smart home system includes an intelligent gateway group, an intelligent door lock, an image acquisition device group, a group of sweeping robots and a group of intelligent air conditioners, and the image acquisition device group, the group of sweeping robots and the group of intelligent air conditioners are in communication connection with the intelligent gateway group.

[0012] The intelligent door lock is configured to send an unlocking instruction to the intelligent gateway group in response to the unlocking instruction.

[0013] The intelligent gateway group is configured to receive the unlocking instruction, generate an active perception control instruction based on the unlocking instruction and send the active perception control instruction to the image acquisition device group.

[0014] The image acquisition device group is configured to obtain a current user image set based on the active perception control instruction and a preset image acquisition strategy, and send the current user image set to the intelligent gateway group.

[0015] The intelligent gateway group is further configured to obtain a current user recognition result corresponding to the current user image set based on a local face image recognition model, and determine a target image acquisition device in the image acquisition device group that sends the current user image set.

[0016] The intelligent gateway group is further configured to obtain a target setting area corresponding to the target image acquisition device if it is determined that the user corresponding to the current user recognition result is a registered user, and the target image acquisition device corresponds to one image acquisition device in the image acquisition device group, and determine a target intelligent gateway corresponding to the target setting area from the intelligent gateway group.

[0017] The target intelligent gateway in the intelligent gateway group is further configured to acquire a preset intelligent home control strategy corresponding to the current user identification result, and send the preset intelligent home control strategy to the group of sweeping robots and the group of intelligent air conditioners, so as to intelligently control the group of sweeping robots and the group of intelligent air conditioners.

[0018] In a third aspect, an embodiment of the present application further provides a computer device, which comprises a memory and a processor, the memory stores a computer program, and the processor implements the method in the first aspect when executing the computer program.

[0019] In a fourth aspect, an embodiment of the present application further provides a computer readable storage medium, which stores a computer program, the computer program comprises program instructions, and the program instructions can implement the method in the first aspect when executed by a processor.

[0020] The embodiment of the present application provides an intelligent home control method and system based on active sensing, a device and a medium. The method comprises the following steps: a smart door lock responds to an unlocking instruction and sends the unlocking instruction to a group of intelligent gateways; the group of intelligent gateways receives the unlocking instruction, generates an active sensing control instruction based on the unlocking instruction, and sends the active sensing control instruction to a group of image acquisition devices; the group of image acquisition devices acquires a current user image set based on the active sensing control instruction and a preset image acquisition strategy, and sends the current user image set to the group of intelligent gateways; the group of intelligent gateways acquires a current user identification result corresponding to the current user image set based on a local face image recognition model, and determines a target image acquisition device in the group of image acquisition devices that sends the current user image set; if the group of intelligent gateways determines that the user corresponding to the current user identification result is a registered user and the target image acquisition device corresponds to one image acquisition device in the group of image acquisition devices, the group of intelligent gateways acquires a target setting area corresponding to the target image acquisition device, and determines a target intelligent gateway corresponding to the target setting area from the group of intelligent gateways; the target intelligent gateway acquires a preset intelligent home control strategy corresponding to the current user identification result, and sends the preset intelligent home control strategy to a group of sweeping robots and a group of intelligent air conditioners, so as to intelligently control the group of sweeping robots and the group of intelligent air conditioners. The embodiment of the present application can enable all intelligent home devices in a residence to be stably connected to a home Internet of Things and be uniformly managed and accurately controlled when an intelligent home system is applied to a large-area and non-single-story residence through the group of intelligent gateways. BRIEF DESCRIPTION OF DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiment description. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without creative labor.

[0022] Figure 1 An application scenario diagram of the intelligent home control method based on active sensing provided by the embodiment of the present application is shown in FIG. 1.

[0023] Figure 2 A flow diagram of the intelligent home control method based on active sensing provided by the embodiment of the present application is shown in FIG. 2.

[0024] Figure 3 A sub-flow diagram of the intelligent home control method based on active sensing provided by the embodiment of the present application is shown in FIG. 3.

[0025] Figure 4 A sub-flow diagram of the intelligent home control method based on active sensing provided by the embodiment of the present application is shown in FIG. 4.

[0026] Figure 5 A sub-flow diagram of the intelligent home control method based on active sensing provided by the embodiment of the present application is shown in FIG. 5.

[0027] Figure 6 A sub-flow diagram of the intelligent home control method based on active sensing provided by the embodiment of the present application is shown in FIG. 6.

[0028] Figure 7 A schematic block diagram of the intelligent home control system based on active sensing provided by the embodiment of the present application is shown in FIG. 7.

[0029] Figure 8 A schematic block diagram of the computer device provided by the embodiment of the present application is shown in FIG. 8. DETAILED DESCRIPTION

[0030] The technical solutions in the embodiments of the present application will be clearly and completely described with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0031] It should be understood that, when used in the specification and the appended claims, the terms "comprise" and "include" indicate the presence of described features, integers, steps, operations, elements, and / or components, but do not exclude one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0032] It should also be understood that the terms used in the present application specification are only for the purpose of describing particular embodiments and are not intended to limit the present application. As used in the present application specification and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms, unless the context clearly indicates otherwise.

[0033] It should be further understood that the term "and / or" used in the description and claims of the application means one or more of the associated listed items as well as all possible combinations of the items, and includes these combinations.

[0034] Please also refer to Figure 1 and Figure 2 , Figure 1 The scene diagram of the active perception-based smart home control method according to an embodiment of the application, Figure 2 The flowchart of the active perception-based smart home control method according to an embodiment of the application is shown in FIG. 2. The method is applied to a smart home system, which includes a smart gateway group 10, a smart door lock 20, an image acquisition device group 30, a sweeping robot group 40, and a smart air conditioner group 50. The image acquisition device group 30, the sweeping robot group 40, and the smart air conditioner group 50 are in communication connection with the smart gateway group 10.

[0035] The smart door lock 20 is arranged at the entrance of a residential area, and a user can open the smart door lock 20 in a fingerprint unlocking or face recognition unlocking manner. The smart gateway group 10 includes multiple smart gateways. For example, the residential area deployed by the smart home system is a multi-story residential area, and at least one smart gateway is deployed in each story area. Moreover, the smart gateways in different stories are in communication connection and networking.

[0036] Similarly, at least one image acquisition device is deployed in each story area to form the image acquisition device group, at least one sweeping robot is deployed in each story area to form the sweeping robot group, and at least one smart air conditioner is deployed in each story area to form the smart air conditioner group.

[0037] After the deployment of the smart home system as above is completed, the active perception-based smart home control method includes the following steps S110-S160, as shown in FIG. 2. Figure 2

[0038] S110, the smart door lock responds to an unlocking instruction and sends the unlocking instruction to the smart gateway group.

[0039] ​In this embodiment, for example, the smart lock is installed at the entrance of the first floor of the residential area. When a user unlocks the smart lock using methods such as fingerprint unlocking or facial recognition, an unlock command is generated at the smart lock, which then sends the unlock command to the smart gateway group. For example, because the distance between the smart gateway on the first floor of the residential area and the smart lock is the shortest, the smart lock can send the unlock command to the smart gateway located on the first floor of the residential area, following the principle of proximity in communication. The smart gateway on the first floor can then promptly receive, process, and respond to the unlock command.

[0040] S120. The smart gateway group receives the unlocking command, generates an active sensing control command based on the unlocking command, and sends it to the image acquisition device group.

[0041] In this embodiment, after the smart gateway group receives the unlock command, in order to enable the image acquisition device group to act as an active sensing device to detect the user's identity and location, an active sensing control command can be generated in the smart gateway group based on the unlock command and sent to the image acquisition device group. Upon receiving the active sensing control command, each image acquisition device in the image acquisition device group switches from sleep or low-power operating mode to normal operating mode to promptly detect the user's identity and location entering the residential area.

[0042] S130. The image acquisition device group acquires the current user image set based on the active perception control command and the preset image acquisition strategy, and sends it to the smart gateway group.

[0043] In this embodiment, after the image acquisition device group receives the active sensing control command, it needs to acquire images of the corresponding area within a specified time period based on the image acquisition strategy, thereby forming an image set (i.e., the current user image set) used to determine user identity information and locate user position. Then, to improve image recognition efficiency, the current user image set can be sent to the intelligent gateway group for face image recognition based on the higher device performance of the intelligent gateway group.

[0044] In one embodiment, such as Figure 3 As shown, step S130 includes:

[0045] S131. Obtain the image acquisition duration corresponding to the image acquisition strategy;

[0046] S132. Determine the initial acquisition time based on the first generation time of the active perception control command and the image acquisition strategy;

[0047] S133. Determine the current image acquisition time period based on the acquisition initial time and the image acquisition duration;

[0048] S134, acquiring user images in the current image acquisition time period to form the current user image set.

[0049] Each current user image included in the current user image set corresponds to an image acquisition device equipment number.

[0050] In the embodiment, for example, when the image acquisition strategy corresponds to a preset image acquisition duration of 10s, 15s, 30s, 45s, 60s, etc., and the first generation time of the active perception control instruction is determined, the delay time corresponding to the image acquisition strategy can also be acquired. The delay time represents that the time point at which the image acquisition device starts to acquire images after the user enters the door is not the first generation time, and the image acquisition in the normal working mode can be activated after the delay time, such as 20s, 30s, etc. When the acquisition initial time, the delay time, and the image acquisition duration are known, the first time point corresponding to the acquisition initial time+delay time can be taken as the starting time point in the current image acquisition time period, and the acquisition initial time+delay time+image acquisition duration can be taken as the ending time point in the current image acquisition time period.

[0051] After the current image acquisition time period is determined, each image acquisition device in the image acquisition device group acquires a plurality of user images in the current image acquisition time period to form the current user image set. Each current user image included in the current user image set corresponds to an image acquisition device equipment number. Moreover, the user image acquired by each image acquisition device in the current image acquisition time period is correspondingly added with the information of the image acquisition device equipment number, so as to ensure that the image source of each user image can be known in subsequent intelligent gateway teaming.

[0052] S140, the intelligent gateway group acquires a current user recognition result corresponding to the current user image set based on a local face image recognition model, and determines a target image acquisition device in the image acquisition device group to send the current user image set.

[0053] In the embodiment, after the current user image set is acquired in the intelligent gateway group, user face recognition can be performed on the current user image set based on a local face image recognition model to obtain a current user recognition result corresponding to the current user image set, so that the identity of the user currently entering the residential area can be determined. After a general user enters the residential area, the user may continue to stay in the original place or go to other areas of other floors of the residential area after a short stay in the living room area of the first floor of the residential area. Therefore, based on the image acquisition device corresponding to the current user image set, the stay position of the current user can be further analyzed, so that the intelligent gateway group can more accurately control the smart home devices.

[0054] In an embodiment, step S140 further includes:

[0055] If it is determined that the image acquisition device number corresponding to each current user image in the current user image set is the same device number, the corresponding image acquisition device number is acquired as the target image acquisition device number and saved.

[0056] In the embodiment, after the current user image set is acquired in the intelligent gateway group, image preprocessing is performed to delete images in which no face image exists from the current user image set. After it is determined that the image acquisition device number corresponding to each current user image in the current user image set is the same device number, it is indicated that the user stays in the same area of the residential area during this time period (such as a time period corresponding to the current image acquisition time period). At this time, the image acquisition device number corresponding to the current user images can be acquired as the target image acquisition device number and saved for use as data for subsequent determination of the target image acquisition device.

[0057] In an embodiment, as shown in Figure 4 Step S140 includes:

[0058] S141, based on the face image recognition model, acquiring a user recognition result corresponding to each current user image in the current user image set to form a current initial user recognition result set;

[0059] S142, if it is determined that each user recognition result in the current initial user recognition result set corresponds to the same user recognition result, taking any user recognition result in the current initial user recognition result set as the current user recognition result;

[0060] S143, determining the target image acquisition device in the image acquisition device group based on the target image acquisition device number.

[0061] In the embodiment, the local face image recognition model can be a convolutional neural network. Based on the convolutional neural network, a user recognition result corresponding to each current user image in the current user image set can be determined first to form a current initial user recognition result set.

[0062] Then, if it is determined that each user recognition result in the current initial user recognition result set corresponds to the same user recognition result, such as all corresponding to user A, any user recognition result in the current initial user recognition result set can be directly used as the current user recognition result.

[0063] Of course, the convolutional neural network may also have recognition errors, that is, a current user image in the current user image set is recognized as a user other than user A. S142 can also be replaced by: if it is determined that the proportion of user recognition results corresponding to the same user recognition result in the current initial user recognition result set exceeds a preset proportion threshold, the corresponding user recognition result is obtained and used as the current user recognition result. That is, among the user recognition results obtained in the current initial user recognition result set, more than 90% (for example, the preset proportion threshold is 90%) of the user recognition results correspond to the same user recognition result, and the user recognition result is used as the current user recognition result.

[0064] When the current user recognition result is determined based on the current initial user recognition result set, the user identity can be accurately determined. Moreover, the image collection device number can be obtained in the current user image corresponding to the current user recognition result in the current user image set. At this time, the image collection device number is used as a determination condition to determine the target image collection device in the image collection device group, and the target image collection device is used as the current main image collection device to continuously detect and actively perceive the current user. Through the above-mentioned manner, the target image collection device can be determined in the multiple image collection devices, and the target image collection device continues to maintain the normal working mode, and the other image collection devices in the image collection device group except the target image collection device are switched to the sleep mode or the low-power-consumption mode again.

[0065] S150, if the current user recognition result corresponds to a registered user, and the target image collection device corresponds to one image collection device in the image collection device group, the target setting area corresponding to the target image collection device is obtained, and the target intelligent gateway corresponding to the target setting area is determined from the intelligent gateway group.

[0066] In the embodiment, when the smart gateway group determines that the user corresponding to the current user recognition result is a registered user (for example, the face images of multiple permanent residents of the residential area are stored in the smart gateway group, and the multiple permanent residents are all regarded as registered users), and the target image collection device corresponds to one of the image collection device group, it indicates that the permanent user of the residential area has returned home, and multiple frames of user images are continuously collected by the target image collection device in the image collection device group. At this time, the area where the user stays for a long time can be determined by the target setting area corresponding to the target image collection device. Then, the target smart gateway is determined based on the target setting area, and the target smart gateway is used as the master smart gateway to perform subsequent smart home device control gateway. Moreover, the target smart gateway is often closest to the position where the current user stays, has the characteristics of stable connection signal and shorter communication distance with the smart home device to be controlled, and can be used as the master smart gateway to ensure better communication effect.

[0067] In an embodiment, as shown in Figure 5 S150 includes the following steps:

[0068] S151, acquiring a first mapping relationship between the image collection device and the device setting area set in advance, and acquiring a second mapping relationship between the device setting area set in advance and the smart gateway;

[0069] S152, determining the target setting area based on the first mapping relationship and the target image collection device;

[0070] S153, determining the target smart gateway based on the second mapping relationship and the target setting area.

[0071] In the embodiment, in order to determine which smart gateway in the smart gateway group is used as the master smart gateway to perform subsequent smart home device control gateway, after the target image collection device is determined, the target setting area can be determined based on the first mapping relationship and the target image collection device, and the target smart gateway can be determined in the smart gateway group based on the second mapping relationship and the target setting area.

[0072] For example, in the first mapping relationship, the image collection device A1 corresponds to the first layer A1 area of the residential area, the image collection device A2 corresponds to the first layer B1 area of the residential area, the image collection device A3 corresponds to the second layer A2 area of the residential area, the image collection device A4 corresponds to the second layer B2 area of the residential area, the image collection device A5 corresponds to the third layer A3 area of the residential area, the image collection device A6 corresponds to the third layer B3 area of the residential area, and the like. After determining that the target image collection device is the image collection device A4, the first mapping relationship can be used to determine that the second layer B2 area of the residential area is the target setting area. Similarly, the second mapping relationship sets the mapping relationship between the plurality of device setting areas and the intelligent gateway, and the target intelligent gateway can be determined from the second mapping relationship based on the target setting area as a retrieval condition. It can be seen that, based on the above manner, the target intelligent gateway is accurately determined based on the current user's stay position.

[0073] In an embodiment, after step S140, the method further comprises:

[0074] If the intelligent gateway group determines that the user corresponding to the current user identification result is a non-registered user, the intelligent gateway group obtains corresponding early warning information and sends the early warning information to a corresponding receiving terminal.

[0075] In the embodiment, if the intelligent gateway group determines that the user corresponding to the current user identification result is a non-registered user, it indicates that there may be a non-registered user entering the residential area. At this time, in order to timely prompt the main residents of the residential area, early warning information including at least the area entry time, personnel image and the like can be generated, and the early warning information is sent to the receiving terminal bound by the intelligent gateway group to timely notify the potential risk investigation.

[0076] S160, the target intelligent gateway obtains a preset smart home control strategy corresponding to the current user identification result, and sends the preset smart home control strategy to the group of sweeping robots and the group of intelligent air conditioners to correspondingly control the group of sweeping robots and the group of intelligent air conditioners.

[0077] In the embodiment, since the current user (such as the user A in the above example) is determined to be the target user entering the target setting area of the residential area, after the target intelligent gateway is determined in the intelligent gateway group, the target intelligent gateway can further obtain a preset smart home control strategy corresponding to the target user.

[0078] For example, the preset smart home control strategy set by the user A includes the following information: (1) when the user A is in the second floor B2 area of the residential area, the smart air conditioner is turned on and adjusted to the first preset temperature, and the sweeping robot staying in the second floor B2 area of the residential area is started for automatic cleaning; (2) when the user A is in the second floor B2 area of the residential area, the smart air conditioner is turned on and adjusted to the second preset temperature; (3) when the user A is in the second floor B2 area of the residential area, the smart air conditioner is turned on and adjusted to the third preset temperature, and the sweeping robot staying in the second floor B2 area of the residential area is started for automatic cleaning; (4) when the user A is in the third floor B3 area of the residential area, the smart air conditioner is turned on and adjusted to the fourth preset temperature; (5) when the user A is in the first floor A1 area of the residential area, the smart air conditioner is turned on and adjusted to the fifth preset temperature, and the sweeping robot staying in the first floor A1 area of the residential area is started for automatic cleaning. At this time, a preset smart home control strategy related to the target setting area such as the second floor B2 area of the residential area can be determined and sent to the sweeping robot group and the smart air conditioner group for corresponding intelligent control of the sweeping robot group and the smart air conditioner group, so that the target smart gateway serves as the master intelligent gateway to perform subsequent smart home device control.

[0079] In an embodiment, as shown in FIG. 1 1, step S160 includes: Figure 6

[0080] S161, if the target intelligent gateway determines that the current identified user corresponding to the current user identification result has multiple preset smart home control strategies in the local control strategy library, the target intelligent gateway acquires one of the smart home control strategies as the preset smart home control strategy based on a preset strategy recommendation model;

[0081] S162, the target smart air conditioner corresponding to the target setting area is acquired in the smart air conditioner group;

[0082] S163, the target sweeping robot corresponding to the target setting area is acquired in the sweeping robot group;

[0083] S164, the air conditioner control strategy in the preset smart home control strategy is sent to the target smart air conditioner, and the sweeping robot control strategy in the preset smart home control strategy is sent to the target sweeping robot.

[0084] ​In the embodiment, if the target intelligent gateway determines that the current identified user corresponding to the current user identification result has multiple smart home control strategies corresponding to the preset in the local control strategy library, for example, the user A has 5 smart home control strategies in the above example, and 3 of which are related to the current area (i.e. the second floor B2 area of the residential area) of the user A. Then, one of the above 3 smart home control strategies can be obtained as the preset smart home control strategy based on the preset strategy recommendation model (for example, the input parameters of the preset strategy recommendation model are input parameters composed of the current system time, the current indoor temperature, the current outdoor environment temperature and the like, and the preset strategy recommendation model can specifically use a random forest model), for example, "(1) User A opens the smart air conditioner and adjusts to the first preset temperature when in the second floor B2 area of the residential area, and starts the sweeping robot staying in the second floor B2 area of the residential area for automatic cleaning" in the above example. Finally, the target intelligent air conditioner corresponding to the target setting area is obtained in the smart air conditioner group, and the target sweeping robot corresponding to the target setting area is obtained in the sweeping robot group. The air conditioner control strategy (such as opening the smart air conditioner and adjusting to the first preset temperature) in the preset smart home control strategy is sent to the target intelligent air conditioner, and the sweeping robot control strategy (starting the sweeping robot staying in the second floor B2 area of the residential area for automatic cleaning) in the preset smart home control strategy is sent to the target sweeping robot. In this way, the accurate control of the smart home devices in the target setting area by the target intelligent gateway is realized.

[0085] After that, if the current user leaves the target setting area and goes to other areas, the target image acquisition device of the target setting area can quickly determine the user action trajectory prediction result (for example, the user image of the current user going upstairs has been collected in one frame of user image) that the current user is going upstairs or downstairs based on multiple continuous user images, and after determining the corresponding floor area, the user action trajectory prediction result is sent to the intelligent gateway of the corresponding floor area by the current target intelligent gateway. The next intelligent gateway of the corresponding floor area takes over the current target intelligent gateway as the master intelligent gateway to control the subsequent smart home devices.

[0086] In the above embodiments of the present application, the smart home system includes a smart gateway group, a smart door lock, an image acquisition device group, a sweeping robot group and a smart air conditioner group as an example to illustrate the technical solutions. In specific implementation, the sweeping robot group and the smart air conditioner group can be replaced by other smart home devices such as smart lamps, smart televisions, smart curtains, smart display panels, smart temperature control devices, smart security devices, etc., and the specific control process is also referred to the control process of the sweeping robot group and the smart air conditioner group.

[0087] It can be seen that the embodiment implementing the method can enable all smart home devices in the residence to be stably accessed to the home Internet of Things and uniformly managed and precisely controlled through the smart gateway group when the smart home system is applied to a large-area and non-single-story residence.

[0088] Figure 7 is a schematic block diagram of an active sensing-based smart home control system provided by an embodiment of the present application. As shown in Figure 7 Corresponding to the active sensing-based smart home control method described above, the present application also provides an active sensing-based smart home control system configured in a smart home system 1. The smart home system 1 includes a smart gateway group 10, a smart door lock 20, an image acquisition device group 30, a sweeping robot group 40, and a smart air conditioner group 50. The image acquisition device group 30, the sweeping robot group 40, and the smart air conditioner group 50 are all in communication connection with the smart gateway group 10.

[0089] The smart door lock 20 is arranged at the entrance of the residence area, and the user can open the smart door lock 20 in the manner of fingerprint unlocking and face recognition unlocking. The smart gateway group 10 includes multiple smart gateways. For example, the residence area deployed by the smart home system 1 is a multi-story residence, and at least one smart gateway can be deployed in each story area. Moreover, the smart gateways between different stories are also in communication connection and networking.

[0090] Similarly, at least one image acquisition device is also deployed in each story area to form the image acquisition device group 30, at least one sweeping robot is also deployed in each story area to form the sweeping robot group 40, and at least one smart air conditioner is also deployed in each story area to form the smart air conditioner group 50.

[0091] The smart door lock 20 is configured to respond to an unlocking instruction and send the unlocking instruction to the smart gateway group.

[0092] In this embodiment, for example, the smart door lock is arranged at the entrance of the first story of the residence area. After the user opens the smart door lock in the manner of fingerprint unlocking, face recognition unlocking, or the like, an unlocking instruction is generated at the smart door lock, and then the smart door lock sends the unlocking instruction to the smart gateway group. For example, because the distance between the smart gateway of the first story of the residence area and the smart door lock is the closest, the smart door lock can send the unlocking instruction to the smart gateway of the first story of the residence area in the smart gateway group, thereby following the closest principle of communication, and then the smart gateway of the first story of the residence area can timely receive the unlocking instruction and process and respond accordingly.

[0093] The intelligent gateway group 10 is configured to receive the unlocking instruction, generate an active sensing control instruction based on the unlocking instruction, and send the active sensing control instruction to the image acquisition device group.

[0094] In this embodiment, when the intelligent gateway group receives the unlocking instruction, in order to enable the image acquisition device group to detect the user identity and the user position as active sensing devices, the intelligent gateway group generates an active sensing control instruction based on the unlocking instruction and sends the active sensing control instruction to the image acquisition device group. After each image acquisition device in the image acquisition device group receives the active sensing control instruction, the image acquisition device switches from the sleep or low-power-consumption working mode to the normal working mode, so as to detect the user identity and the user position entering the residential area in time.

[0095] The image acquisition device group 30 is configured to acquire a current user image set based on the active sensing control instruction and a preset image acquisition strategy, and send the current user image set to the intelligent gateway group.

[0096] In this embodiment, after the image acquisition device group receives the active sensing control instruction, the image acquisition device group needs to acquire images of the corresponding area within a specified time period based on the image acquisition strategy, so as to form the image set (i.e., the current user image set) for determining the user identity information and locating the user position. Then, in order to improve the image recognition efficiency, the current user image set can be sent to the intelligent gateway group, and the face image recognition is performed based on the higher device performance of the intelligent gateway group.

[0097] In an embodiment, the image acquisition device group 30 is specifically configured to:

[0098] acquire an image acquisition duration corresponding to the image acquisition strategy;

[0099] determine an initial acquisition time based on a first generation time of the active sensing control instruction and the image acquisition strategy;

[0100] determine a current image acquisition time period based on the initial acquisition time and the image acquisition duration;

[0101] acquire user images within the current image acquisition time period to form the current user image set; each current user image included in the current user image set corresponds to an image acquisition device equipment number.

[0102] In the embodiment, for example, when the image acquisition strategy corresponds to a preset image acquisition duration of 10s, 15s, 30s, 45s, 60s, etc., after the first generation time of the active perception control instruction is determined, the delay time corresponding to the image acquisition strategy can also be obtained. The delay time represents that the time point at which the image acquisition device is activated to start image acquisition after the user enters the door is not from the first generation time, but after the delay time, such as 20s, 30s, etc., the image acquisition in the normal working mode is activated. After the acquisition initial time, the delay time and the image acquisition duration are known, the first time point corresponding to the acquisition initial time+delay time can be taken as the starting time point in the current image acquisition time period, and the acquisition initial time+delay time+image acquisition duration is taken as the termination time point in the current image acquisition time period.

[0103] After the current image acquisition time period is determined, each image acquisition device in the image acquisition device group acquires a plurality of user images in the current image acquisition time period to form the current user image set. Each current user image in the current user image set corresponds to an image acquisition device equipment number. Moreover, the user image acquired by each image acquisition device in the current image acquisition time period corresponds to the information of the image acquisition device equipment number, so that the image source of each user image can be known in subsequent intelligent gateway teaming.

[0104] The intelligent gateway group 10 is further configured to acquire a current user recognition result corresponding to the current user image set based on a local face image recognition model, and determine a target image acquisition device in the image acquisition device group that sends the current user image set.

[0105] In the embodiment, after the current user image set is acquired in the intelligent gateway group, user face recognition can be performed on the current user image set based on the local face image recognition model to obtain a current user recognition result corresponding to the current user image set, so that the identity of the user currently entering the residential area can be determined. Generally, after the user enters the residential area, the user may stay in the living room area of the first layer of the residential area for a short time, or go to other areas of other layers of the residential area. Therefore, based on the image acquisition device corresponding to the current user image set, the stay position of the current user can be further analyzed, so that the intelligent gateway group can more accurately control the smart home devices.

[0106] In an embodiment, the intelligent gateway group 10 is further configured to:

[0107] If it is determined that the image acquisition device equipment number corresponding to each current user image in the current user image set is the same equipment number, the corresponding image acquisition device equipment number is obtained as the target image acquisition device equipment number and saved.

[0108] In this embodiment, after the smart gateway group receives the current user image set, image preprocessing is performed to delete images in which no face image exists, to update the current user image set. Then, when the smart gateway group determines that the image acquisition device equipment number corresponding to each current user image in the current user image set is the same equipment number, it indicates that the user stays in the same area of the residential area during this time period (such as the time period corresponding to the current image acquisition time period). At this time, the image acquisition device equipment number corresponding to these current user images can be obtained as the target image acquisition device equipment number and saved, to be used as data for subsequent determination of the target image acquisition device.

[0109] In an embodiment, the smart gateway group 10 is specifically used for:

[0110] Based on the face image recognition model, the user recognition result corresponding to each current user image in the current user image set is obtained to form a current initial user recognition result set;

[0111] If it is determined that each user recognition result in the current initial user recognition result set corresponds to the same user recognition result, any user recognition result in the current initial user recognition result set is taken as the current user recognition result;

[0112] Based on the target image acquisition device equipment number, the target image acquisition device is determined in the image acquisition device group.

[0113] In this embodiment, the local face image recognition model can be a convolutional neural network. Based on the convolutional neural network, the user recognition result corresponding to each current user image in the current user image set can be determined first to form a current initial user recognition result set.

[0114] Then, if it is determined that each user recognition result in the current initial user recognition result set corresponds to the same user recognition result (such as all corresponding to user A), any user recognition result in the current initial user recognition result set can be directly taken as the current user recognition result.

[0115] Of course, there will be recognition errors in the convolutional neural network, i.e. one of the current user images should be identified as a user A current user image, S142 can also be replaced by: if it is determined that the user recognition result ratio corresponding to the same user recognition result in the current initial user recognition result set exceeds the preset proportion threshold, the corresponding user recognition result is obtained and used as the current user recognition result. That is, among the user recognition results obtained in the current initial user recognition result set, more than 90% (such as the preset proportion threshold is 90%) of the user recognition results correspond to the same user recognition result, and the user recognition result is used as the current user recognition result.

[0116] When the current user recognition result is determined based on the current initial user recognition result set, the user identity can be accurately determined. Moreover, in the current user image corresponding to the current user recognition result in the current user image set, the image acquisition device number can be correspondingly obtained, and at this time, the image acquisition device number is used as a determination condition to determine the target image acquisition device in the image acquisition device group, and the target image acquisition device is used as the current main image acquisition device to continuously detect and actively perceive the current user. Through the above-mentioned manner, the target image acquisition device can be determined in the multiple image acquisition devices, and the target image acquisition device continues to maintain the normal working mode, and the other image acquisition devices in the image acquisition device group are switched to the sleep mode or the low-power-consumption mode again.

[0117] The intelligent gateway group 10 is also used to: if it is determined that the current user recognition result corresponds to a registered user, and the target image acquisition device corresponds to one of the image acquisition devices in the image acquisition device group, the target setting area corresponding to the target image acquisition device is obtained, and the target intelligent gateway corresponding to the target setting area is determined from the intelligent gateway group.

[0118] In the embodiment, when the intelligent gateway group determines that the user corresponding to the current user recognition result is a registered user (for example, the face images of multiple permanent residents of the residential area are stored in the intelligent gateway group, and the multiple permanent residents are all regarded as registered users), and the target image collection device corresponds to one of the image collection device group, it indicates that the permanent user of the residential area has returned home, and multiple frames of user images are continuously collected by the target image collection device in the image collection device group. At this time, the area where the user stays for a long time can be determined by the target setting area corresponding to the target image collection device. Then, the target intelligent gateway is determined based on the target setting area, and the target intelligent gateway is used as the master intelligent gateway to perform subsequent smart home device control gateway. Moreover, the target intelligent gateway is often closest to the position where the current user stays, has the characteristics of stable connection signal and shorter communication distance with the smart home device to be controlled, and can be used as the master intelligent gateway to ensure better communication effect.

[0119] In an embodiment, the intelligent gateway group 10 is also specifically used for:

[0120] obtaining a first mapping relationship between the image collection device and the device setting area, and obtaining a second mapping relationship between the device setting area and the intelligent gateway;

[0121] determining the target setting area based on the first mapping relationship and the target image collection device;

[0122] determining the target intelligent gateway based on the second mapping relationship and the target setting area.

[0123] In the embodiment, in order to determine which intelligent gateway in the intelligent gateway group is used as the master intelligent gateway to perform subsequent smart home device control gateway, the target setting area can be determined based on the first mapping relationship and the target image collection device after the target image collection device is determined, and the target intelligent gateway is determined in the intelligent gateway group based on the second mapping relationship and the target setting area.

[0124] For example, in the first mapping relationship, the image collection device A1 corresponds to the first layer A1 area of the residential area, the image collection device A2 corresponds to the first layer B1 area of the residential area, the image collection device A3 corresponds to the second layer A2 area of the residential area, the image collection device A4 corresponds to the second layer B2 area of the residential area, the image collection device A5 corresponds to the third layer A3 area of the residential area, the image collection device A6 corresponds to the third layer B3 area of the residential area, and the like. After determining that the target image collection device is the image collection device A4, the first mapping relationship can be used to determine that the second layer B2 area of the residential area is the target setting area. Similarly, the second mapping relationship sets the mapping relationship between the plurality of device setting areas and the smart gateway, and the target smart gateway can be determined from the second mapping relationship based on the target setting area as a retrieval condition. It can be seen that, based on the above-mentioned manner, the target smart gateway is accurately determined based on the current user's stay position.

[0125] In an embodiment, the smart gateway group 10 is further specifically used for:

[0126] If it is determined that the user corresponding to the current user identification result is a non-registered user, the corresponding early warning information is obtained, and the early warning information is sent to the corresponding receiving terminal.

[0127] In the embodiment, if the smart gateway group determines that the user corresponding to the current user identification result is a non-registered user, it means that there may be a non-registered user entering the residential area. At this time, in order to timely prompt the main residents of the residential area, the early warning information including at least the area entering time, the personnel image and the like can be generated, and the early warning information is sent to the receiving terminal corresponding to the smart gateway group to timely notify the potential risk investigation.

[0128] The target smart gateway in the smart gateway group 10 is configured to obtain a preset smart home control strategy corresponding to the current user identification result, and send the preset smart home control strategy to the sweeping robot group and the smart air conditioner group, so as to correspondingly control the sweeping robot group and the smart air conditioner group.

[0129] In the embodiment, since the current user (such as the user A in the above example) is determined to be the target user entering the target setting area of the residential area, after the target smart gateway is determined in the smart gateway group, the target smart gateway can further obtain a preset smart home control strategy corresponding to the target user.

[0130] For example, the preset smart home control strategy set by the user A includes the following information: (1) when the user A is in the second floor B2 area of the residential area, the smart air conditioner is turned on and adjusted to the first preset temperature, and the sweeping robot staying in the second floor B2 area of the residential area is started for automatic cleaning; (2) when the user A is in the second floor B2 area of the residential area, the smart air conditioner is turned on and adjusted to the second preset temperature; (3) when the user A is in the second floor B2 area of the residential area, the smart air conditioner is turned on and adjusted to the third preset temperature, and the sweeping robot staying in the second floor B2 area of the residential area is started for automatic cleaning; (4) when the user A is in the third floor B3 area of the residential area, the smart air conditioner is turned on and adjusted to the fourth preset temperature; (5) when the user A is in the first floor A1 area of the residential area, the smart air conditioner is turned on and adjusted to the fifth preset temperature, and the sweeping robot staying in the first floor A1 area of the residential area is started for automatic cleaning. At this time, a preset smart home control strategy related to the target setting area such as the second floor B2 area of the residential area can be determined and sent to the sweeping robot group and the smart air conditioner group for corresponding intelligent control of the sweeping robot group and the smart air conditioner group, so that the target smart gateway serves as the master intelligent gateway to control the subsequent smart home devices.

[0131] In an embodiment, the target intelligent gateway is specifically used for:

[0132] If it is determined that the current identified user corresponding to the current user identification result has multiple preset smart home control strategies in the local control strategy library, one of the smart home control strategies is obtained as the preset smart home control strategy based on a preset strategy recommendation model;

[0133] A target smart air conditioner corresponding to the target setting area is obtained from the smart air conditioner group;

[0134] A target sweeping robot corresponding to the target setting area is obtained from the sweeping robot group;

[0135] The air conditioner control strategy in the preset smart home control strategy is sent to the target smart air conditioner, and the sweeping robot control strategy in the preset smart home control strategy is sent to the target sweeping robot.

[0136] In the embodiment, if the target intelligent gateway determines that the current identified user corresponding to the current user identification result has multiple smart home control strategies corresponding to the preset in the local control strategy library, for example, the user A has 5 smart home control strategies in the above example, and 3 of which are related to the current area (i.e. the second floor B2 area of the residential area) of the user A. Then, one of the above 3 smart home control strategies can be obtained as the preset smart home control strategy based on the preset strategy recommendation model (for example, the input parameters of the preset strategy recommendation model are input parameters composed of the current system time, the current indoor temperature, the current outdoor environment temperature and the like, and the preset strategy recommendation model can specifically use a random forest model), for example, "(1) User A opens the smart air conditioner and adjusts to the first preset temperature when in the second floor B2 area of the residential area, and starts the sweeping robot staying in the second floor B2 area of the residential area for automatic cleaning" in the above example. Finally, the target intelligent air conditioner corresponding to the target setting area is obtained in the smart air conditioner group, and the target sweeping robot corresponding to the target setting area is obtained in the sweeping robot group. The air conditioner control strategy (such as opening the smart air conditioner and adjusting to the first preset temperature) in the preset smart home control strategy is sent to the target intelligent air conditioner, and the sweeping robot control strategy (starting the sweeping robot staying in the second floor B2 area of the residential area for automatic cleaning) in the preset smart home control strategy is sent to the target sweeping robot. In this way, the accurate control of the smart home devices in the target setting area by the target intelligent gateway is realized.

[0137] After that, if the current user leaves the target setting area and goes to other areas, the target image acquisition device of the target setting area can quickly determine the user action trajectory prediction result (for example, the user image of the current user going upstairs has been collected in one frame of user image) that the current user is going upstairs or downstairs based on multiple continuous user images, and after determining the corresponding floor area, the user action trajectory prediction result is sent to the intelligent gateway of the corresponding floor area by the current target intelligent gateway. The next intelligent gateway of the corresponding floor area takes over the current target intelligent gateway as the master intelligent gateway to control the subsequent smart home devices.

[0138] In the above embodiments of the present application, the smart home system includes a smart gateway group, a smart door lock, an image acquisition device group, a sweeping robot group and a smart air conditioner group as an example to illustrate the technical solutions. In specific implementation, the sweeping robot group and the smart air conditioner group can be replaced by other smart home devices such as smart lamps, smart televisions, smart curtains, smart display panels, smart temperature control devices, smart security devices, etc., and the specific control process is also referred to the control process of the sweeping robot group and the smart air conditioner group.

[0139] It can be seen that the embodiment of the system can enable all smart home devices in a residence to be stably connected to a home Internet of Things and uniformly managed and precisely controlled through a smart gateway group when the smart home system is applied to a large-area and non-single-story residence.

[0140] The active-sensing-based smart home control system described above can be implemented in the form of a computer program, which can run on a computer device as shown in the drawings. Figure 8

[0141] Please refer to Figure 8 , Figure 8 is a schematic block diagram of a computer device provided by an embodiment of the present application. The computer device integrates any active-sensing-based smart home control system provided by an embodiment of the present application.

[0142] Please refer to Figure 8 , the computer device 400 includes a processor 402, a memory, and a network interface 405 connected through a system bus 401, wherein the memory can include a storage medium 403 and an internal memory 404.

[0143] The storage medium 403 can store an operating system 4031 and a computer program 4032. The computer program 4032 includes program instructions, which, when executed, can cause the processor 402 to perform the active-sensing-based smart home control method described above.

[0144] The processor 402 is configured to provide computing and control capabilities to support the operation of the entire computer device.

[0145] The internal memory 404 provides an environment for the running of the computer program 4032 in the storage medium 403, which, when executed by the processor 402, can cause the processor 402 to perform the active-sensing-based smart home control method described above.

[0146] The network interface 405 is configured to perform network communication with other devices. Those skilled in the art can understand that Figure 8 the structure shown in the drawings is only a block diagram of part of the structure related to the present application scheme, and does not constitute a limitation on the computer device to which the present application scheme is applied. The specific computer device can include more or fewer components than those shown in the drawings, or combine certain components, or have a different component arrangement.

[0147] The processor 402 is configured to run the computer program 4032 stored in the memory to implement the active-sensing-based smart home control method as described above.

[0148] ​It should be understood that in the embodiments of the present application, the processor 402 can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic components, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0149] It can be understood by those skilled in the art that all or part of the processes in the above-mentioned embodiments can be completed by a computer program instructing related hardware. The computer program includes program instructions, and the computer program can be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the computer system to implement the process steps of the above-mentioned embodiments.

[0150] Therefore, the present application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions. The program instructions are executed by a processor to make the processor execute the active sensing-based smart home control method as described above.

[0151] The computer-readable storage medium can be a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk, and various computer-readable storage media that can store program codes.

[0152] It can be understood by those skilled in the art that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware, computer software or a combination of both. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of the examples have been described in the above description in general terms. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0153] In several embodiments provided by the present application, it should be understood that the disclosed apparatus and method can be implemented in other manners. For example, the embodiments of the apparatus described above are merely schematic. For example, the division of the units is merely a logical function division. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In this way, the inventive idea can be implemented.

[0154] The steps in the method embodiments of the present application can be adjusted, combined and deleted in sequence according to actual needs. The units in the apparatus embodiments of the present application can be combined, divided and deleted according to actual needs. In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit.

[0155] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a storage medium. Based on such understanding, the technical solutions of the present application, essentially or in the contribution to the prior art, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (which can be a personal computer, a terminal, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.

[0156] The above describes only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any skilled person in the art can easily think of various equivalent modifications or replacements within the technical range disclosed by the present application, and these modifications or replacements should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An active sensing-based smart home control method applied to a smart home system, characterized by, The smart home system comprises a smart gateway group, a smart door lock, an image acquisition device group, a sweeping robot group and a smart air conditioner group, the image acquisition device group, the sweeping robot group and the smart air conditioner group are in communication connection with the smart gateway group; the residential area deployed by the smart home system is a multi-storey residential building, and at least one smart gateway is deployed in each layer area of the multi-storey residential building, and the smart gateways in different layers are in communication connection and networking; The smart home control method based on active perception comprises: The smart door lock sends the unlocking instruction to the smart gateway group in response to the unlocking instruction; The smart gateway group receives the unlocking instruction, generates an active perception control instruction based on the unlocking instruction and sends the active perception control instruction to the image acquisition device group; The image acquisition device group acquires a current user image set based on the active perception control instruction and a preset image acquisition strategy and sends the current user image set to the smart gateway group; The smart gateway group acquires a current user recognition result corresponding to the current user image set based on a local face image recognition model and determines a target image acquisition device in the image acquisition device group which sends the current user image set; If the smart gateway group determines that the user corresponding to the current user recognition result is a registered user and the target image acquisition device corresponds to one image acquisition device in the image acquisition device group, the smart gateway group acquires a target setting area corresponding to the target image acquisition device and determines a target smart gateway corresponding to the target setting area from the smart gateway group; The target smart gateway acquires a preset smart home control strategy corresponding to the current user recognition result and sends the preset smart home control strategy to the sweeping robot group and the smart air conditioner group to correspondingly control the sweeping robot group and the smart air conditioner group; The acquisition of the target setting area corresponding to the target image acquisition device and the determination of the target smart gateway corresponding to the target setting area from the smart gateway group comprise: Acquiring a first mapping relationship between the image acquisition device and the device setting area and a second mapping relationship between the device setting area and the smart gateway; Determining the target setting area based on the first mapping relationship and the target image acquisition device; Determining the target smart gateway based on the second mapping relationship and the target setting area; In the second mapping relationship, a plurality of mapping relationships between device setting areas and smart gateways are summarized, the target smart gateway is determined from the second mapping relationship based on the target setting area as a retrieval condition; the target smart gateway has the closest distance to the current user's stay position.

2. The method of claim 1, wherein, The acquisition of the current user image set based on the active perception control instruction and the preset image acquisition strategy comprises: Acquiring an image acquisition duration corresponding to the image acquisition strategy; Determining an initial acquisition time based on a first generation time of the active perception control instruction and the image acquisition strategy; Determining a current image acquisition time period based on the initial acquisition time and the image acquisition duration; Acquire user images in the current image acquisition time period to compose the current user image set; wherein each current user image included in the current user image set corresponds to an image acquisition device equipment number.

3. The method of claim 2, wherein, Before the step of acquiring, by the intelligent gateway group, a current user recognition result corresponding to the current user image set based on a local face image recognition model and determining, in the image acquisition device group, a target image acquisition device that sends the current user image set, the method further comprises: If it is determined that the image acquisition device equipment number corresponding to each current user image in the current user image set is the same equipment number, acquire the corresponding image acquisition device equipment number as the target image acquisition device equipment number and save it.

4. The method of claim 3, wherein, The step of acquiring, by the intelligent gateway group, a current user recognition result corresponding to the current user image set based on a local face image recognition model and determining, in the image acquisition device group, a target image acquisition device that sends the current user image set, comprises: Acquire, based on the face image recognition model, a user recognition result corresponding to each current user image in the current user image set to compose a current initial user recognition result set; If it is determined that each user recognition result in the current initial user recognition result set corresponds to the same user recognition result, use any user recognition result in the current initial user recognition result set as the current user recognition result; Determine the target image acquisition device in the image acquisition device group based on the target image acquisition device equipment number.

5. The method of claim 1, wherein, The step of acquiring, by the target intelligent gateway, a preset smart home control strategy corresponding to the current user recognition result and sending the preset smart home control strategy to the group of sweeping robots and the group of intelligent air conditioners to correspondingly intelligently control the group of sweeping robots and the group of intelligent air conditioners, comprises: If the target intelligent gateway determines that the current recognition user corresponding to the current user recognition result has multiple smart home control strategies preset in the local control strategy library, acquire one of the smart home control strategies based on a preset strategy recommendation model as the preset smart home control strategy; Acquire, in the group of intelligent air conditioners, a target intelligent air conditioner corresponding to the target setting area; Acquire, in the group of sweeping robots, a target sweeping robot corresponding to the target setting area; Send an air conditioner control strategy in the preset smart home control strategy to the target intelligent air conditioner and send a sweeping robot control strategy in the preset smart home control strategy to the target sweeping robot.

6. The method of claim 1, wherein, After the step of acquiring, by the intelligent gateway group, a current user recognition result corresponding to the current user image set based on a local face image recognition model and determining, in the image acquisition device group, a target image acquisition device that sends the current user image set, the method further comprises: If the intelligent gateway group determines that the user corresponding to the current user recognition result is a non-registered user, acquire corresponding early warning information and send the early warning information to a corresponding receiving terminal.

7. An active sensing-based smart home control system configured in a smart home system, the system comprising: The smart home system comprises a smart gateway group, a smart door lock, an image acquisition device group, a sweeping robot group and a smart air conditioner group, the image acquisition device group, the sweeping robot group and the smart air conditioner group are in communication connection with the smart gateway group; the residential area deployed by the smart home system is a multi-storey residential building, and at least one smart gateway is deployed in each layer area of the multi-storey residential building, and the smart gateways in different layers are in communication connection and networking; The smart door lock is used for sending the unlocking instruction to the smart gateway group in response to the unlocking instruction; The smart gateway group is used for receiving the unlocking instruction, generating a proactive sensing control instruction based on the unlocking instruction and sending the proactive sensing control instruction to the image acquisition device group; The image acquisition device group is used for acquiring a current user image set based on the proactive sensing control instruction and a preset image acquisition strategy and sending the current user image set to the smart gateway group; The smart gateway group is further used for acquiring a current user recognition result corresponding to the current user image set based on a local face image recognition model and determining a target image acquisition device in the image acquisition device group which sends the current user image set; The smart gateway group is further used for acquiring a target setting area corresponding to the target image acquisition device and determining a target smart gateway corresponding to the target setting area from the smart gateway group if it is determined that a user corresponding to the current user recognition result is a registered user and the target image acquisition device corresponds to one image acquisition device in the image acquisition device group; The target smart gateway in the smart gateway group is further used for acquiring a preset smart home control strategy corresponding to the current user recognition result and sending the preset smart home control strategy to the sweeping robot group and the smart air conditioner group to correspondingly control the sweeping robot group and the smart air conditioner group; When the smart gateway group acquires the target setting area corresponding to the target image acquisition device and determines the target smart gateway corresponding to the target setting area from the smart gateway group, the following steps are included: A first mapping relationship between an image acquisition device and a device setting area is acquired, and a second mapping relationship between a device setting area and a smart gateway is acquired; The target setting area is determined based on the first mapping relationship and the target image acquisition device; The target smart gateway is determined based on the second mapping relationship and the target setting area; In the second mapping relationship, mapping relationships between a plurality of device setting areas and smart gateways are summarized, the target smart gateway is determined from the second mapping relationship based on the target setting area as a retrieval condition; the target smart gateway has the closest distance to the current user's stay position.

8. A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor executes the computer program to realize the active sensing-based smart home control method in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program includes program instructions. When the program instructions are executed by the processor, the active sensing based smart home control method in any one of claims 1-6 is implemented.

Images