Smart home control method and device, electronic equipment and readable storage medium

Abstract

The invention provides a smart home control method and device, electronic equipment and a readable storage medium, the method is applied to a central control screen in a target room, and the method comprises the following steps: identifying image information of a user by using a deep learning algorithm, and determining behavior data of the user; determining the physiological state of the user according to the image information of the user and / or the environment information of the target room; under the condition that the physiological state is a sleep state and / or the behavior data meets a preset condition, switching the working mode of the central control screen into a privacy protection mode; under the condition that the working mode of the central control screen is the privacy protection mode, refusing video talkback requests initiated by other terminals to the central control screen; the other terminals comprise central control screens or terminal devices in other rooms except the target room; and converting the video talkback request into a voice talkback request and outputting the voice talkback request. Therefore, the problem that the video talkback request initiated by other terminals to the central control screen may disturb the user is solved, and the privacy of the user is protected.

Description

Technical Field

[0001] The present invention belongs to the technical field of smart homes, and in particular relates to a control method, device, electronic device and readable storage medium for a smart home. Background Art

[0002] With the popularity of smart home systems, smart central control screens have become an important interactive terminal in the home. Through smart central control screens, users can easily control various devices in the home, such as lighting, air conditioners, central control screens, etc.

[0003] In addition, the smart central control screen also integrates a video intercom function, allowing users to communicate in real time with family members or external visitors in other rooms of the home through the central control screen.

[0004] However, in some specific situations, video intercom requests may disturb users. Summary of the invention

[0005] The embodiments of the present invention provide a smart home control method, device, electronic device and readable storage medium, which can solve the problem that a video intercom request may disturb a user.

[0006] In a first aspect, the present application provides a smart home control method, which is applied to a central control screen in a target room, and the method includes:

[0007] Applied to the central control screen in the target room, the method includes:

[0008] Using deep learning algorithms to identify user image information and determine user behavior data;

[0009] Determining a physiological state of the user according to the image information of the user and / or the environmental information of the target room;

[0010] When the behavior data meets a preset condition and / or the physiological state is a sleeping state, switching the working mode of the central control screen to a privacy protection mode;

[0011] When the working mode of the central control screen is the privacy protection mode, reject the video intercom request initiated by other terminals to the central control screen; the other terminals include central control screens or terminal devices in other rooms except the target room;

[0012] The video intercom request is converted into a voice intercom request and outputted.

[0013] Optionally, the environmental information of the target room includes ambient sound inside the target room, and determining the physiological state of the user according to the image information of the user and / or the environmental information of the target room includes:

[0014] Identify the image information of the user and obtain the eye features of the user;

[0015] Determining the ambient sound volume of the ambient sound inside the target room;

[0016] When the eye feature indicates that the eyes are closed and the volume of the ambient sound is less than a preset volume threshold, it is determined that the physiological state of the user is a sleeping state.

[0017] Optionally, after determining the ambient sound volume of the ambient sound inside the target room, the method further includes:

[0018] When the volume of the ambient sound is less than a preset volume threshold, matching the ambient sound inside the target room with a preset sleep breathing voiceprint to obtain a first matching degree;

[0019] When the eye feature indicates that the eyes are closed and the first matching degree is greater than a preset matching degree threshold, it is determined that the physiological state of the user is a sleeping state.

[0020] Optionally, the environmental information of the target room includes heat source distribution and temperature inside the target room, and determining the physiological state of the user according to the image information of the user and / or the environmental information of the target room includes:

[0021] Determining the location of the user according to the heat source distribution inside the target room;

[0022] Determining a temperature change at the location of the user;

[0023] In a case where the position of the user is a designated position and the temperature of the position of the user increases, it is determined that the user is in a sleeping state.

[0024] Optionally, the environmental information of the target room includes light brightness inside the target room, and determining the physiological state of the user according to the image information of the user and / or the environmental information of the target room includes:

[0025] When the light brightness inside the target room changes and the brightness inside the target room is lower than a preset brightness threshold, it is determined that the user is in a sleeping state.

[0026] Optionally, the method further comprises:

[0027] In response to the user's behavior detection permission setting operation, turning off or turning on the behavior detection permission of the central control screen, the behavior detection permission is used to obtain the image information of the user and / or the ambient sound in the target room;

[0028] When the behavior detection permission is turned off, the physiological state of the user is determined based on the heat source distribution, temperature and light brightness inside the target room.

[0029] In a second aspect, the present application provides a smart home control method, which is applied to a terminal device, and the method includes:

[0030] In response to the user's first trigger operation, a working mode switching instruction is sent to the central control screen of any room, so that the control screen of any room changes the current working mode according to the working mode switching instruction; the working mode switching instruction includes switching the current working mode to a privacy protection mode or a normal working mode; when the working mode of the central control screen is the privacy protection mode, the video intercom request initiated by other terminals to the central control screen is rejected, and the other terminals include the control screen or terminal equipment except the control screen of any room, and the video intercom request is converted into a voice intercom request and output.

[0031] Optionally, the method further comprises:

[0032] In response to the second trigger operation of the user, the behavior detection permission of the central control screen in any room is turned off or on, and the behavior detection permission is used to obtain the image information of the user and / or the ambient sound of any room.

[0033] In a third aspect, the present application provides a smart home control device, which is applied to a central control screen in a target room, and the device includes:

[0034] A first determination module, configured to identify the user's image information using a deep learning algorithm and determine the user's behavior data;

[0035] A second determination module, configured to determine the physiological state of the user according to the image information of the user and / or the environmental information of the target room;

[0036] A first switching module, configured to switch the working mode of the central control screen to a privacy protection mode when the behavior data meets a preset condition and / or the physiological state is a sleep state;

[0037] A first control module is used to reject a video intercom request initiated by other terminals to the central control screen when the working mode of the central control screen is a privacy protection mode; the other terminals include central control screens or terminal devices in other rooms except the target room;

[0038] The second control module is used to convert the video intercom request into a voice intercom request and output it.

[0039] In a fourth aspect, the present application provides a smart home control device, which is applied to a terminal device, and the device includes:

[0040] The second switching module is used to respond to the user's first trigger operation to send a working mode switching instruction to the central control screen of any room, so that the control screen of any room changes the current working mode according to the working mode switching instruction; the working mode switching instruction includes switching the current working mode to the privacy protection mode or the normal working mode; when the working mode of the central control screen is the privacy protection mode, reject the video intercom request initiated by other terminals to the central control screen, and the other terminals include the control screen or terminal equipment except the control screen of any room, and convert the video intercom request into a voice intercom request and output it.

[0041] In a fifth aspect, the present application provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned smart home control method when executing the program.

[0042] In a sixth aspect, the present application provides a readable storage medium, which, when the instructions in the readable storage medium are executed by a processor of an electronic device, enables the electronic device to execute the above-mentioned smart home control method.

[0043] In the embodiment of the present application, first, the central control screen in the target room uses a deep learning algorithm to identify the user's image information and determine the user's behavior data; secondly, the user's physiological state is determined based on the user's image information and / or the environmental information of the target room; thirdly, when the behavior data meets the preset conditions and / or the physiological state is in a sleeping state, the working mode of the central control screen is switched to a privacy protection mode; then, when the working mode of the central control screen is in a privacy protection mode, the video intercom request initiated by other terminals to the central control screen is rejected; other terminals include central control screens or terminal devices in other rooms except the target room; finally, the video intercom request is converted into a voice intercom request and output. In this way, when the behavior data meets the preset conditions and / or the physiological state is in a sleeping state, the working mode of the central control screen is switched to a privacy protection mode. Since the video intercom request can be rejected and converted into a voice intercom request in the privacy protection mode, the problem that the video intercom request initiated by other terminals to the central control screen may disturb the user is solved, thereby protecting the user's privacy. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0045] Figure 1 It is a schematic diagram of an application scenario provided by an embodiment of the present application;

[0046] Figure 2 It is a flowchart of a smart home control method provided by an embodiment of the present application;

[0047] Figure 3 is a flowchart of another smart home control method provided by an embodiment of the present application;

[0048] Figure 4 This is a flowchart of another smart home control method provided by an embodiment of the present application;

[0049] Figure 5 It is a structural diagram of a smart home control system provided in an embodiment of the present application;

[0050] Figure 6 is a structural diagram of a smart home control device provided in an embodiment of the present application;

[0051] Figure 7 is a structural diagram of a smart home control device provided in an embodiment of the present application;

[0052] Figure 8 is a structural diagram of an electronic device provided in an embodiment of the present application;

[0053] Fig. 9 It is a structural diagram of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0055] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0056] In the description of the present disclosure, unless otherwise specified, "multiple" means two or more than two, and other quantifiers are similar thereto; "at least one item", "one item or multiple items" or similar expressions refer to any combination of these items, including any combination of single items or plural items. For example, at least one item a can represent any number of a; for another example, one item or multiple items among a, b and c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple; "and / or" is a kind of description of the association relationship of associated objects, indicating that there can be three kinds of relationships, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " indicates that the associated objects before and after are in an "or" relationship.

[0057] Although operations or steps are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood that it is required to perform these operations or steps in the specific order shown or in a serial order, or to perform all the operations or steps shown to obtain the desired results. In the embodiments of the present disclosure, these operations or steps can be performed in series; these operations or steps can also be performed in parallel; or some of these operations or steps can be performed.

[0058] First, an application scenario involved in an embodiment of the present application is described.

[0059] With the development of science and technology, smart devices are becoming more and more popular in people's lives. In order to control smart devices, each smart device is usually equipped with a corresponding smart home centralized control panel. When the user's home is large, or in scenarios with a large number of rooms such as hotels and office buildings, in order to control multiple smart devices, multiple control panels need to be equipped accordingly. However, there is a problem that the control panels of different smart devices are scattered and their functions are not centralized. In order to solve this problem, each room needs to be installed with a central control screen for controlling multiple smart home devices.

[0060] For example, the central control screen can be applied to the Internet of Things in application scenarios such as smart home (home automation), smart home, smart home device ecology, and smart residential ecology.

[0061] Exemplarily, the multiple smart home devices controlled by the central control screen may include: smart air conditioners, smart range hoods, smart refrigerators, smart ovens, smart stoves, smart washing machines, smart water heaters, smart washing equipment, smart dishwashers, smart projection equipment, smart TVs, smart clothes drying racks, smart curtains, smart audio and video, smart sockets, smart speakers, smart speakers, smart fresh air equipment, smart kitchen and bathroom equipment, smart bathroom equipment, smart sweeping robots, smart window cleaning robots, smart mopping robots, smart air purification equipment, smart steamers, smart microwave ovens, smart kitchen treasures, smart purifiers, smart water dispensers, smart cameras, etc.

[0062] See also Figure 1 The smart home control method provided in the embodiment of the present application can be applied to Figure 1 The hardware environment shown is composed of multiple central control screens 10 and terminal devices 20.

[0063] Optionally, the central control screen can be set in the bedroom near the bed, and the user's physiological state and / or behavioral data can be detected through the camera and microphone on the bedroom central control.

[0064] Optionally, the central control screen in each room may also be provided with sensors such as infrared sensors and temperature sensors, wherein the infrared sensor can be used to detect the distribution of heat sources in the room, and the temperature sensor can be used to detect temperature changes in the room.

[0065] Optionally, the central control screen 10 can have a built-in subscriber identity module (SIM) phone card to implement video dialing to realize video calls or voice calls.

[0066] Optionally, the central control screen 10 may also be integrated with a software development kit (SDK) for making and receiving voice and video calls over Long-Term Evolution (VoLTE).

[0067] Exemplarily, the central control screen 10 can be a 4-inch voice intelligent screen.

[0068] In this embodiment, the multiple central control screens 10 are connected through a network, and the terminal device 20 is connected to the multiple central control screens 10 through the network. The network may include: a wired network, a wireless network, a wired network may include: a wide area network, a metropolitan area network, a local area network, and a wireless network may include: WIFI (Wireless Fidelity) and Bluetooth.

[0069] In this embodiment, video calls or voice calls can be made between multiple central control screens 10, as well as between the terminal device 20 and any central control screen 10, through the VoLTE technology.

[0070] In some embodiments, the terminal device 20 accesses the central control screen 10 through an access interface. Exemplarily, the terminal device 20 may be a smart phone and a computer, and the access interface includes but is not limited to the World Wide Web (web), a mobile application (APP) and a mini-program, and the terminal device 20 may access the central control screen 10 through the web, APP and mini-program.

[0071] The following is a detailed description of the smart home control method provided in the embodiments of the present application.

[0072] Figure 2 is a flowchart of a smart home control method provided by an embodiment of the present application, and the smart home control method is applied to Figure 1 The central control screen in the target room, such as Figure 3 As shown, the method may include:

[0073] Step 101: Use a deep learning algorithm to identify the user's image information and determine the user's behavior data.

[0074] In some embodiments, step 101 may include: inputting image information into a preset image analysis model to obtain user behavior data output by the image analysis model; the preset image analysis model may be obtained by training with training samples that characterize user behavior.

[0075] Exemplarily, the preset image analysis model can be trained in the following manner: obtain a labeled image set, and divide the labeled image set into multiple labeled image subsets; obtain a standard user behavior set, wherein the standard user behavior set includes standard user behaviors corresponding to the multiple labeled image subsets; use a pre-built behavior model to generate a predicted user behavior set for a target labeled image subset among the multiple labeled image subsets; calculate the loss value between the standard user behavior corresponding to the target labeled image subset and the predicted user behavior set, and update the parameters of the behavior model according to the loss value to obtain a trained image analysis model.

[0076] In some other embodiments, step 101 may also include extracting target image features from the image information by using an image recognition method; and obtaining user behavior data based on the target image features.

[0077] Optionally, the user's behavior data may include the user's motion data, the user's location information, etc.

[0078] Step 102: Determine the user's physiological state based on the user's image information and / or the environment information of the target room.

[0079] In some embodiments, the environmental information of the target room may include the ambient sound inside the target room; the environmental information of the target room may also include the heat source distribution and temperature inside the target room; the environmental information of the target room may also include the light brightness inside the target room.

[0080] In some embodiments, the user's physiological state may include a sleeping state.

[0081] Optionally, step 102 may include determining the user's physiological state based on the user's image information and the environment information of the target room; step 102 may also include determining the user's physiological state based on the user's image information; step 102 may also include determining the user's physiological state based on the environment information of the target room.

[0082] Step 103: When the physiological state is a sleeping state and / or the behavior data meets a preset condition, the working mode of the central control screen is switched to a privacy protection mode.

[0083] Optionally, the preset conditions may include: the behavior data represents that the user is changing clothes, the data represents that the user is working, the behavior data represents that the user is closing his eyes to rest, etc.

[0084] In an embodiment of the present application, step 103 may include switching the working mode of the central control screen to the privacy protection mode when the physiological state is a sleep state and the behavioral data meets the preset conditions; step 103 may also include switching the working mode of the central control screen to the privacy protection mode when the physiological state is a sleep state; step 103 may also include switching the working mode of the central control screen to the privacy protection mode when the behavioral data meets the preset conditions.

[0085] In the embodiment of the present application, the working mode of the central control screen includes a privacy protection mode and a normal working mode. Among them, when the working mode of the central control screen is the normal working mode, the central control screen can receive video intercom requests initiated by other terminals or other central control screens.

[0086] Step 104: When the working mode of the central control screen is the privacy protection mode, the video intercom request initiated by other terminals to the central control screen is rejected.

[0087] In an embodiment of the present application, other terminals include central control screens or terminal devices in other rooms except the target room.

[0088] For example, when the target room is a bedroom, the other terminal may be a central control screen in the living room, the other terminal may be a central control screen at the entrance of a villa, or the other terminal may be a mobile phone or other device of the user.

[0089] It should be noted that in general homes, hotels or office buildings, central control screens are placed in different rooms, and video intercoms can be initiated between central control screens, such as the central control screen in the living room initiating an intercom with the central control screen in the bedroom, and the central control screen at the entrance of the villa initiating an intercom with the central control screen in a room upstairs. Taking the target room as the bedroom as an example, when a video intercom request is initiated from other places to the bedroom, the central control screen in the bedroom detects the user's physiological state and identifies the user's behavior data. When the user is in sleep state and / or the user's behavior data meets the preset conditions, the working mode of the central control screen is switched to privacy protection mode. In privacy protection mode, the central control screen in the bedroom can reject video intercom requests initiated from other places.

[0090] For example, when the central control screen in the target room is online, the central control screens in other rooms can directly establish a video call connection between the central control screen in the target room and the central control screens in other rooms through the video call platform, so that the video stream can be transmitted to realize video intercom; when the working mode of the central control screen in the target room is privacy protection mode, the video intercom request initiated by the central control screen in other rooms is rejected.

[0091] Step 105: Convert the video intercom request into a voice intercom request and output it.

[0092] In some embodiments, step 105 may include: establishing a communication connection relationship between the central control screen and other terminals so that the central control screen can conduct voice intercom with the other terminals.

[0093] For example, during the process of the central control screen in the target room making a voice call and answering with other terminals, the network address of the central control screen in the target room can be returned, and the network address can be an Internet Protocol (IP) address or a message authentication code (MAC) address, or other network addresses that can be used for network communication. In this way, other terminals can establish a communication connection relationship with the central control screen in the target room based on the IP address or MAC address, so that the central control screen and other terminals can realize the voice intercom function.

[0094] In some embodiments, step 105 may also include: converting the video intercom request into a voice intercom request and displaying the ID of other terminals on the incoming call display. In this way, the user can see at a glance which terminal is calling when the incoming call display is displayed, and can respond to or reject the voice intercom request in a timely manner.

[0095] In summary, the smart home control method in the embodiment of the present application is as follows: first, the central control screen in the target room uses a deep learning algorithm to identify the user's image information and determine the user's behavior data; second, the user's physiological state is determined based on the user's image information and / or the environmental information of the target room; third, when the behavior data meets the preset conditions and / or the physiological state is in a sleeping state, the working mode of the central control screen is switched to a privacy protection mode; then, when the working mode of the central control screen is in a privacy protection mode, the video intercom request initiated by other terminals to the central control screen is rejected; other terminals include central control screens or terminal devices in other rooms except the target room; finally, the video intercom request is converted into a voice intercom request and output. In this way, when the behavior data meets the preset conditions and / or the physiological state is in a sleeping state, the working mode of the central control screen is switched to a privacy protection mode. Since the video intercom request can be rejected and converted into a voice intercom request in the privacy protection mode, the problem that the video intercom request initiated by other terminals to the central control screen may disturb the user is solved, thereby protecting the user's privacy.

[0096] Figure 3 is a flowchart of another smart home control method provided by an embodiment of the present application, wherein the smart home control method is applied to a target device, such as Figure 3 As shown, the method may include:

[0097] Step 201: Use a deep learning algorithm to identify the user's image information and determine the user's behavior data.

[0098] The method of this step has been described in the aforementioned step 101 and will not be repeated here.

[0099] Step 202: Determine the user's physiological state based on the user's image information and the environment information of the target room.

[0100] Optionally, step 202 includes:

[0101] Sub-step 2021: Identify the user's image information and obtain the user's eye features.

[0102] Sub-step 2022: Determine the ambient sound volume of the ambient sound inside the target room.

[0103] Sub-step 2023: When the eye feature indicates that the eyes are closed and the volume of the ambient sound is less than a preset volume threshold, it is determined that the user's physiological state is a sleeping state.

[0104] Exemplarily, sub-step 2021 may include: identifying the user's eye closure through a facial recognition algorithm; when the user's eye closure is less than a preset closure threshold, the eye features indicate that the eyes are closed; when the user's eye closure is greater than or equal to the preset closure threshold, the eye features indicate that the eyes are open.

[0105] Exemplarily, sub-step 2022 may include: detecting the ambient sound inside the target room through the microphone on the central control screen; and determining the ambient sound volume of the ambient sound inside the target room.

[0106] Exemplarily, the preset volume threshold in sub-step 2023 may be 10 decibels (dB). Sub-step 2023 may include: when the eye feature indicates that the eyes are closed and the ambient sound volume is less than 10 decibels, determining that the user's physiological state is a sleeping state.

[0107] Through the above technical means, combined with the user's image information and the volume of ambient sound, the accuracy of determining the user's sleeping state can be improved.

[0108] In some embodiments, after sub-step 2022, the smart home control method further includes:

[0109] Sub-step A1: when the volume of the ambient sound is less than a preset volume threshold, matching the ambient sound inside the target room with the preset sleep breathing voiceprint to obtain a first matching degree;

[0110] Sub-step A2: when the eye feature indicates that the eyes are closed and the first matching degree is greater than a preset matching degree threshold, determining that the user's physiological state is a sleeping state.

[0111] Exemplarily, the preset matching degree threshold may be 90%.

[0112] Through the above-mentioned technical means, combined with the ambient sound volume and sleep breathing soundprint, the accuracy of determining the user's sleep state can be improved.

[0113] Step 203: Determine the user's physiological state based on the user's image information.

[0114] For example, step 203 may include: when the user is in bed, identifying the user's motion amplitude according to the user's image information; when the user's motion amplitude is less than a preset motion amplitude threshold, determining that the user's physiological state is a sleeping state.

[0115] For another example, step 203 may also include: when the user is in bed, identifying the degree of change in the user's expression based on the user's image information; when the degree of change in the user's expression indicates that the user's expression is calm, determining that the user's physiological state is a sleeping state.

[0116] Step 204: Determine the user's physiological state based on the environmental information of the target room.

[0117] In some embodiments, the environmental information of the target room includes the heat source distribution and temperature inside the target room, and step 204 may include:

[0118] Sub-step 2041: determining the user's location according to the heat source distribution inside the target room;

[0119] Sub-step 2042, determining the temperature change at the user's location;

[0120] Sub-step 2043: When the user's location is the designated location and the temperature at the user's location increases, determine that the user is in a sleeping state.

[0121] In the embodiment of the present application, the designated position is a position where the user can sleep and rest. The designated position can be a bed, a sofa, or a recliner, without specific limitation.

[0122] Exemplarily, in sub-step 2041, the heat source distribution inside the target room may be acquired through an infrared sensor, and in sub-step 2042, the temperature change at the user's location may be acquired through a temperature sensor.

[0123] Through the above technical means, combined with the heat source distribution inside the target room and the temperature change at the user's location, the accuracy of determining the user's sleeping state can be improved.

[0124] In some embodiments, the environment information of the target room includes the light brightness inside the target room, and step 204 may include:

[0125] Sub-step 2044: when the light brightness inside the target room changes and the brightness inside the target room is lower than a preset brightness threshold, it is determined that the user is in a sleeping state.

[0126] Exemplarily, in sub-step 2044, the light brightness inside the target room may be acquired through a brightness sensor.

[0127] Through the above technical means, when the light brightness inside the target room changes and the brightness inside the target room is lower than a preset brightness threshold, it is determined that the user is in a sleeping state, which can improve the accuracy of determining the user's sleeping state.

[0128] In some embodiments, before step 201, the smart home control method may further include:

[0129] Sub-step B1: in response to the user's behavior detection permission setting operation, turn off or turn on the behavior detection permission of the central control screen;

[0130] Sub-step B2: When the behavior detection permission is turned off, determine the user's physiological state based on the heat source distribution, temperature and light brightness inside the target room.

[0131] In an embodiment of the present application, the behavior detection permission is used to obtain the user's image information and / or the ambient sound in the target room; the behavior detection permission setting operation can be a click operation on a preset control in the central control screen.

[0132] It is understandable that in order to protect the privacy of the user, the behavior detection permissions of the central control screen can be set to turn on or off the camera and / or microphone on the central control screen.

[0133] For example, a "one-click blocking" control is set on the display interface of the central control screen. When the user clicks on the control, the behavior detection permission of the central control screen is turned off, that is, the camera and / or microphone on the central control screen is turned off.

[0134] Through the above technical means, when the behavior detection permission of the central control screen represents turning off the camera and / or microphone on the central control screen, the user's physiological state is determined only based on the sensor data, thereby protecting the user's privacy.

[0135] Step 205: When the physiological state is a sleeping state and / or the behavior data meets a preset condition, the working mode of the central control screen is switched to a privacy protection mode.

[0136] The method of this step has been described in the aforementioned step 103 and will not be repeated here.

[0137] In some embodiments, after step 205, the control method of the above-mentioned smart device may further include: sending a privacy protection mode switching instruction to the central control screen in other rooms, so that the central control screen in other rooms switches its own working mode to the privacy protection mode.

[0138] Exemplarily, the target room is the bedroom, and the other rooms are the living rooms. When the user is sleeping, in order not to disturb the user, the central control screen in the living room can also be switched to the privacy protection mode to achieve linkage between the central control screens in different rooms.

[0139] Step 206: When the working mode of the central control screen is the privacy protection mode, reject the video intercom request initiated by other terminals to the central control screen.

[0140] In this embodiment of the present application, other terminals include central control screens or terminal devices in other rooms except the target room.

[0141] The method of this step has been described in the aforementioned step 104 and will not be repeated here.

[0142] Step 207: Convert the video intercom request into a voice intercom request and output it.

[0143] The method of this step has been described in the aforementioned step 105 and will not be repeated here.

[0144] To sum up, the smart home control method in the embodiment of the present application adopts a diversified way to determine the user's sleep state, which can improve the accuracy of determining the user's sleep state. In addition, the behavior detection authority of the central control screen represents the situation of turning off the camera and / or microphone on the central control screen. The user's physiological state is determined only based on the sensor data, thereby protecting the user's privacy.

[0145] Figure 4 This is a flowchart of a smart home control method provided by an embodiment of the present application. Figure 1 Terminal devices in Figure 4 As shown, the method may include:

[0146] Step 301: In response to the user's first trigger operation, a working mode switching instruction is sent to the central control screen in any room.

[0147] In the embodiment of the present application, step 301 enables the control screen of any room to change the current working mode according to the working mode switching instruction.

[0148] In an embodiment of the present application, the first trigger operation may be a click operation of the user on the display interface of the terminal device.

[0149] In an embodiment of the present application, the working mode switching instruction includes switching the current working mode to a privacy protection mode or a normal working mode.

[0150] In an embodiment of the present application, when the working mode of the central control screen is the privacy protection mode, the video intercom request initiated by other terminals to the central control screen is rejected, and the video intercom request is converted into a voice intercom request and output, wherein the other terminals include the control screen or terminal device except any one room.

[0151] In some embodiments, the smart home control method further includes:

[0152] In response to the user's second trigger operation, the behavior detection permission of the central control screen in any room is turned off or on.

[0153] In the embodiment of the present application, the behavior detection permission is used to obtain the user's image information and / or the ambient sound of any room.

[0154] To sum up, the smart home control method in the embodiment of the present application can realize remote control of the central control screen in any room by switching the working mode of the central control screen through the terminal device. Since the central control screen can reject video intercom requests and convert them into voice intercom requests in the privacy protection mode, it solves the problem that video intercom requests initiated by other terminals to the central control screen may disturb the user, thereby protecting the user's privacy.

[0155] Figure 5 is a structural diagram of a smart home control system provided in an embodiment of the present application, such as Figure 5 As shown, the control system may include a sensor 41 , a privacy detection module 42 , an intercom shielding module 43 and a user interface 44 .

[0156] In the embodiment of the present application, the sensor 41 includes an environmental sensor, such as an infrared sensor, a temperature sensor, etc., which can sense changes in the user's environment and assist in privacy detection.

[0157] In the embodiment of the present application, the privacy detection module 42 has functions such as image recognition and behavior analysis. In the embodiment of the present application, the privacy detection module 42 can capture the user's image through the camera on the central control screen, use the deep learning algorithm to perform image recognition, detect the user's privacy behavior, and generate behavior data. The privacy detection module 42 can also combine the user's real-time behavior data, such as action, location, etc., to perform behavior analysis and determine whether the user is in a private state.

[0158] In the embodiment of the present application, the intercom shielding module 43 has an automatic one-key shielding function; the intercom shielding module 43 can automatically trigger the one-key shielding function when it is determined that the user is currently in a privacy state based on the privacy detection result of the privacy detection module. The intercom shielding module 43 also has a manual one-key shielding function, which responds to the user manually turning on or off the one-key shielding function by pressing the one-key shielding function button on the user interface 44 of the central control screen.

[0159] In the embodiment of the present application, a "one-key shielding" control is provided on the user interface 44, through which the user can conveniently turn on or off the privacy protection function, and the one-key shielding function can be realized. In response to the user triggering the one-key shielding function on the user interface 44 of the central control screen, the central control screen will reject the video intercom request initiated by other users to the central control, and convert it to a voice intercom request. The user interface 44 can also be provided with a status display bar, which is used to display the current status of the one-key shielding function in real time, so that the user can see the current working mode of the display at a glance. The user interface 44 can also be provided with a behavior detection permission setting control, which is used to respond to the user's behavior detection permission setting operation, and turn off or turn on the behavior detection permission of the central control screen.

[0160] In some embodiments, when the shielding function of the intercom shielding module 43 is turned on, if other users or visitors initiate a video intercom request, the intercom shielding module 43 can also output a notification message, which is used to notify other users or visitors that the current user is not convenient to answer the video intercom. For example, the notification message is a voice prompt of "The current user is not convenient to answer the video intercom, and it will be switched to a voice intercom request for you."

[0161] Optionally, the control system may further include other terminals 45. When the shielding function of the intercom shielding module 43 is turned on, the display interface of the other terminal 45 switches from the video intercom request interface to the voice intercom request interface, and outputs a voice prompt "The current user is not convenient to answer the video intercom, and you are switched to a voice intercom request".

[0162] Through the above control system, users can automatically block video intercom requests when conducting privacy activities, effectively protecting privacy and improving user experience. The system adopts intelligent and automated detection mechanisms to ensure the accuracy and stability of privacy protection, and can be seamlessly integrated with existing smart home systems, with broad application prospects.

[0163] Figure 6 : is a structural diagram of a smart home control device provided in an embodiment of the present application. The smart home control device 500 is applied to a central control screen in a target room. The smart home control device 500 may include:

[0164] A first determination module 501 is used to identify the user's image information using a deep learning algorithm and determine the user's behavior data;

[0165] A second determination module 502 is used to determine the user's physiological state based on the user's image information and / or the environment information of the target room;

[0166] The first switching module 503 is used to switch the working mode of the central control screen to the privacy protection mode when the behavior data meets the preset conditions and / or the physiological state is the sleep state;

[0167] The first control module 504 is used to reject the video intercom request initiated by other terminals to the central control screen when the working mode of the central control screen is the privacy protection mode; the other terminals include the central control screens or terminal devices in other rooms except the target room;

[0168] The second control module 505 is used to convert the video intercom request into a voice intercom request and output it.

[0169] Optionally, the environment information of the target room includes the ambient sound inside the target room, and the second determining module 502 includes:

[0170] The recognition submodule is used to recognize the user's image information and obtain the user's eye features;

[0171] The first determination submodule is used to determine the ambient sound volume of the ambient sound inside the target room;

[0172] The second determination submodule is used to determine that the user's physiological state is a sleeping state when the eye feature indicates that the eyes are closed and the volume of the ambient sound is less than a preset volume threshold.

[0173] Optionally, after determining the ambient sound volume of the ambient sound inside the target room, the smart home control device 500 further includes:

[0174] A matching module, configured to match the ambient sound inside the target room with a preset sleep breathing voiceprint when the ambient sound volume is less than a preset volume threshold, to obtain a first matching degree;

[0175] The third determination module is used to determine that the user's physiological state is a sleeping state when the eye feature indicates that the eyes are closed and the first matching degree is greater than a preset matching degree threshold.

[0176] Optionally, the environmental information of the target room includes the heat source distribution and temperature inside the target room. The second determining module 502 includes:

[0177] The third determination submodule is used to determine the user's location according to the heat source distribution inside the target room;

[0178] A fourth determination submodule is used to determine the temperature change of the user's location;

[0179] The fifth determination submodule is used to determine that the user is in a sleeping state when the user's position is a designated position and the temperature at the user's position rises.

[0180] Optionally, the environment information of the target room includes the light brightness inside the target room, and the second determining module 502 includes:

[0181] The sixth determination submodule is used to determine that the user is in a sleeping state when the light brightness inside the target room changes and the brightness inside the target room is lower than a preset brightness threshold.

[0182] Optionally, the smart home control device 500 further includes:

[0183] A third control module is used to close or open the behavior detection permission of the central control screen in response to the user's behavior detection permission setting operation, and the behavior detection permission is used to obtain the user's image information and / or the ambient sound in the target room;

[0184] The third determination module is used to determine the user's physiological state based on the heat source distribution, temperature and light brightness inside the target room when the behavior detection authority is turned off.

[0185] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0186] In summary, first, the central control screen in the target room uses a deep learning algorithm to identify the user's image information and determine the user's behavior data; second, the user's physiological state is determined based on the user's image information and / or the environmental information of the target room; third, when the behavior data meets the preset conditions and / or the physiological state is in a sleeping state, the working mode of the central control screen is switched to a privacy protection mode; then, when the working mode of the central control screen is in a privacy protection mode, the video intercom request initiated by other terminals to the central control screen is rejected; other terminals include central control screens or terminal devices in other rooms except the target room; finally, the video intercom request is converted into a voice intercom request and output. In this way, when the behavior data meets the preset conditions and / or the physiological state is in a sleeping state, the working mode of the central control screen is switched to a privacy protection mode. Since the video intercom request can be rejected and converted into a voice intercom request in the privacy protection mode, the problem that the video intercom request initiated by other terminals to the central control screen may disturb the user is solved, thereby protecting the user's privacy.

[0187] Figure 7 : is a structural diagram of a smart home control device provided in an embodiment of the present application. The smart home control device 600 is applied to a terminal device. The smart home control device 600 may include:

[0188] The second switching module 601 is used to respond to the user's first trigger operation and send a working mode switching instruction to the central control screen of any room, so that the control screen of any room changes the current working mode according to the working mode switching instruction; the working mode switching instruction includes switching the current working mode to the privacy protection mode or the normal working mode; when the working mode of the central control screen is the privacy protection mode, reject the video intercom request initiated by other terminals to the central control screen, and other terminals include the control screen or terminal equipment except any room, and convert the video intercom request into a voice intercom request and output it.

[0189] Optionally, the smart home control device 600 further includes:

[0190] The fourth control module is used to close or open the behavior detection permission of the central control screen in any room in response to the user's second trigger operation. The behavior detection permission is used to obtain the user's image information and / or the ambient sound of any room.

[0191] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0192] To summarize, by switching the working mode of the central control screen through the terminal device, remote control of the central control screen in any room can be achieved. Since the central control screen can reject video intercom requests and convert them into voice intercom requests in privacy protection mode, it solves the problem that video intercom requests initiated by other terminals to the central control screen may disturb users, thereby protecting user privacy.

[0193] The present application also provides an electronic device, see Figure 8 , the electronic device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0194] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0195] The memory 704 is used to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, multimedia, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0196] The power supply component 706 provides power to the various components of the electronic device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0197] The multimedia component 708 includes an interface that provides an output interface between the electronic device 700 and the user. In some embodiments, the interface may include a liquid crystal display (LCD) and a touch panel (TP). If the interface includes a touch panel, the interface may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a multimedia mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0198] The audio component 710 is used to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is used to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0199] The input / output I / O interface 712 provides an interface between the processing component 702 and the peripheral interface module, which may be a keyboard, a click wheel, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0200] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 700, the relative positioning of components, such as the display and keypad of the electronic device 700, and the sensor assembly 714 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0201] The communication component 716 is used to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 7G or 7G), or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0202] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to implement a smart home control method provided in an embodiment of the present application.

[0203] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by a processor 720 of an electronic device 700 to perform the above method. For example, the non-transitory storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0204] Fig. 98 is a block diagram of an electronic device 800 according to another embodiment of the present invention. For example, the electronic device 800 may be provided as a server. Fig. 9 , the electronic device 800 includes a processing component 822, which further includes one or more processors, and a memory resource represented by a memory 832, for storing instructions that can be executed by the processing component 822, such as an application. The application stored in the memory 832 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 822 is configured to execute instructions to execute a smart home control method provided in an embodiment of the present application.

[0205] The electronic device 800 may also include a power supply component 826 configured to perform power management of the electronic device 800, a wired or wireless network interface 850 configured to connect the electronic device 800 to a network, and an input / output (I / O) interface 858. The electronic device 800 may operate based on an operating system stored in the memory 832, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ or the like.

[0206] In an embodiment of the present application, the memory 832 may be used to store software programs and various data. The memory 832 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 832 may include a volatile memory or a non-volatile memory, or the memory 832 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 832 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0207] The processor may include one or more processing units; optionally, the processor integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor.

[0208] The present application also provides a readable storage medium. When the instructions in the readable storage medium are executed by a processor of an electronic device, the electronic device can execute the smart home control method of the aforementioned embodiment.

[0209] The embodiment of the present application also provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned smart home control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0210] It should be noted that the various information and data obtained in the embodiments of the present application are obtained with the authorization of the information / data holder. All actions of obtaining signals, information or data in the present application are carried out in compliance with the relevant data protection laws and policies of the country of residence and with the authorization of the corresponding device owner.

[0211] The algorithm and display provided herein are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the application is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to realize the content of the application described herein, and the description of the specific language above is for the purpose of disclosing the best mode of implementation of the application.

[0212] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0213] Similarly, it should be understood that in order to streamline the present application and help understand one or more of the various inventive aspects, in the above description of the exemplary embodiments of the present application, the various features of the present application are sometimes grouped together into a single embodiment, figure, or description thereof. However, the disclosed method should not be interpreted as reflecting the following intention: the claimed application requires more features than the features clearly stated in each claim. More specifically, as reflected in the claims below, the inventive aspects are less than all the features of the single embodiment disclosed above. Therefore, the claims following the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present application.

[0214] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0215] The various component embodiments of the present application can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all functions of some or all components in the sorting device according to the present application. The present application can also be implemented as a device or apparatus program for executing part or all of the methods described herein. Such a program implementing the present application can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0216] It should be noted that the above embodiments illustrate the present application rather than limit the present application, and that those skilled in the art may design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets should not be constructed as a limitation to the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of multiple such elements. The present application may be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In a unit claim that lists several devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names.

[0217] The user information (including but not limited to the user's device information, user personal information, etc.) and related data involved in this application are all information authorized by the user or by all parties.

[0218] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0219] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the protection scope of the present application.

[0220] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A control method for a smart home, characterized in that: Applied to the central control screen in the target room, the method includes: Using deep learning algorithms to identify user image information and determine user behavior data; Determining a physiological state of the user according to the image information of the user and / or the environmental information of the target room; When the behavior data meets a preset condition and / or the physiological state is a sleeping state, switching the working mode of the central control screen to a privacy protection mode; When the working mode of the central control screen is the privacy protection mode, reject the video intercom request initiated by other terminals to the central control screen; the other terminals include central control screens or terminal devices in other rooms except the target room; The video intercom request is converted into a voice intercom request and outputted.

2. The method according to claim 1, characterized in that The environmental information of the target room includes the ambient sound inside the target room, and determining the physiological state of the user according to the image information of the user and / or the environmental information of the target room includes: Identify the image information of the user and obtain the eye features of the user; Determining the ambient sound volume of the ambient sound inside the target room; When the eye feature indicates that the eyes are closed and the volume of the ambient sound is less than a preset volume threshold, it is determined that the physiological state of the user is a sleeping state.

3. The method according to claim 2, characterized in that After determining the ambient sound volume of the ambient sound inside the target room, the method further includes: When the volume of the ambient sound is less than a preset volume threshold, matching the ambient sound inside the target room with a preset sleep breathing voiceprint to obtain a first matching degree; When the eye feature indicates that the eyes are closed and the first matching degree is greater than a preset matching degree threshold, it is determined that the physiological state of the user is a sleeping state.

4. The method according to claim 1, characterized in that: The environmental information of the target room includes the heat source distribution and temperature inside the target room, and determining the physiological state of the user according to the image information of the user and / or the environmental information of the target room includes: Determining the location of the user according to the heat source distribution inside the target room; Determining a temperature change at the location of the user; In a case where the position of the user is a designated position and the temperature of the position of the user increases, it is determined that the user is in a sleeping state.

5. The method according to claim 1, characterized in that The environmental information of the target room includes the light brightness inside the target room, and determining the physiological state of the user according to the image information of the user and / or the environmental information of the target room includes: When the light brightness inside the target room changes and the brightness inside the target room is lower than a preset brightness threshold, it is determined that the user is in a sleeping state.

6. The method according to claim 1, characterized in that The method further comprises: In response to the user's behavior detection permission setting operation, turning off or turning on the behavior detection permission of the central control screen, the behavior detection permission is used to obtain the image information of the user and / or the ambient sound in the target room; When the behavior detection permission is turned off, the physiological state of the user is determined based on the heat source distribution, temperature and light brightness inside the target room.

7. A smart home control method, characterized in that: Applied to a terminal device, the method comprises: In response to the user's first trigger operation, a working mode switching instruction is sent to the central control screen of any room, so that the control screen of any room changes the current working mode according to the working mode switching instruction; the working mode switching instruction includes switching the current working mode to a privacy protection mode or a normal working mode; when the working mode of the central control screen is the privacy protection mode, the video intercom request initiated by other terminals to the central control screen is rejected, and the other terminals include the control screen or terminal equipment except the control screen of any room, and the video intercom request is converted into a voice intercom request and output.

8. The method according to claim 1, characterized in that The method further comprises: In response to the second trigger operation of the user, the behavior detection permission of the central control screen in any room is turned off or on, and the behavior detection permission is used to obtain the image information of the user and / or the ambient sound in any room.

9. A control device for a smart home, characterized in that: The central control screen used in the target room includes: A first determination module, configured to identify the user's image information using a deep learning algorithm and determine the user's behavior data; A second determination module, configured to determine the physiological state of the user according to the image information of the user and / or the environmental information of the target room; A first switching module, configured to switch the working mode of the central control screen to a privacy protection mode when the behavior data meets a preset condition and / or the physiological state is a sleep state; A first control module is used to reject a video intercom request initiated by other terminals to the central control screen when the working mode of the central control screen is a privacy protection mode; the other terminals include central control screens or terminal devices in other rooms except the target room; The second control module is used to convert the video intercom request into a voice intercom request and output it.

10. A control device for a smart home, characterized in that: Applied to a terminal device, the device comprises: The second switching module is used to respond to the user's first trigger operation to send a working mode switching instruction to the central control screen of any room, so that the control screen of any room changes the current working mode according to the working mode switching instruction; the working mode switching instruction includes switching the current working mode to the privacy protection mode or the normal working mode; when the working mode of the central control screen is the privacy protection mode, reject the video intercom request initiated by other terminals to the central control screen, and the other terminals include the control screen or terminal equipment except the control screen of any room, and convert the video intercom request into a voice intercom request and output it.

11. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the smart home control method as described in any one of claims 1 to 6 or 7 to 8 is implemented.

12. A readable storage medium, characterized in that: When the instructions or transactions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the smart home control method described in any one of claims 1 to 6 or 7 to 8.

Images