Smart home control method and device, electronic equipment and readable storage medium

Abstract

The application provides a smart home control method and device, electronic equipment and readable storage medium. The method is applied to a central control screen in a target room. The method comprises: identifying image information of a user by using a deep learning algorithm to determine behavior data of the user; determining a physiological state of the user according to the image information of the user and / or environment information of the target room; switching a working mode of the central control screen to a privacy protection mode in the case that the physiological state is a sleep state and / or the behavior data meets a preset condition; rejecting a video intercom request initiated by other terminals to the central control screen in the case that the working mode of the central control screen is the privacy protection mode; the other terminals comprise central control screens or terminal devices in other rooms except the target room; and converting the video intercom request to a voice intercom request and outputting. In this way, the problem that the video intercom request initiated by the other terminals to the central control screen may disturb the user is solved, and the privacy of the user is protected.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of smart home, and particularly relates to a smart home control method and device, an electronic device and a readable storage medium. BACKGROUND

[0002] With the popularization of smart home systems, smart central control screens have become an important interactive terminal in the home. Through the smart central control screen, users can conveniently control various devices in the home, such as lighting, air conditioning, central control screens, etc.

[0003] In addition, the smart central control screen also integrates a video intercom function, enabling users to communicate in real time with family members or external visitors in other rooms of the home through the central control screen.

[0004] However, in some specific situations, a video intercom request may disturb the user. SUMMARY

[0005] The embodiments of the present application provide a smart home control method and device, an electronic device and a readable storage medium, which can solve the problem that a video intercom request may disturb the user.

[0006] In a first aspect, the present application provides a smart home control method applied to a central control screen in a target room, the method comprising:

[0007] The method applied to the central control screen in the target room comprises:

[0008] The image information of the user is recognized by using a deep learning algorithm to determine the behavior data of the user;

[0009] The physiological state of the user is determined according to the image information of the user and / or the environmental information of the target room;

[0010] In the case that the behavior data meets a preset condition and / or the physiological state is a sleep state, the working mode of the central control screen is switched to a privacy protection mode;

[0011] In the case that the working mode of the central control screen is a privacy protection mode, a video intercom request initiated by other terminals to the central control screen is rejected; the other terminals include central control screens or terminal devices in other rooms except the target room;

[0012] The video intercom request is converted into a voice intercom request and output.

[0013] Optionally, the environmental information of the target room includes environmental sound inside the target room, and the physiological state of the user is determined according to the image information of the user and / or the environmental information of the target room, comprising:

[0014] identifying image information of the user to obtain eye features of the user;

[0015] determining an ambient sound volume of the ambient sound inside the target room;

[0016] in a case where the eye features indicate that the eyes are closed and the ambient sound volume is less than a preset volume threshold, determining that the physiological state of the user is a sleep state.

[0017] Optionally, after the determination of the ambient sound volume of the ambient sound inside the target room, the method further comprises:

[0018] in a case where the ambient sound volume is less than a preset volume threshold, matching the ambient sound inside the target room with a preset sleep breathing voiceprint to obtain a first matching degree;

[0019] in a case where the eye features indicate that the eyes are closed and the first matching degree is greater than a preset matching degree threshold, determining that the physiological state of the user is a sleep state.

[0020] Optionally, the environmental information of the target room includes heat source distribution and temperature inside the target room, and the determination of the physiological state of the user according to the image information of the user and / or the environmental information of the target room comprises:

[0021] determining the position of the user according to the heat source distribution inside the target room;

[0022] determining temperature variation of the position of the user;

[0023] in a case where the position of the user is a specified position and the temperature of the position of the user is increased, determining that the user is in a sleep state.

[0024] Optionally, the environmental information of the target room includes light brightness inside the target room, and the determination of the physiological state of the user according to the image information of the user and / or the environmental information of the target room comprises:

[0025] in a case where the light brightness inside the target room is changed and the brightness inside the target room is lower than a preset brightness threshold, determining that the user is in a sleep state.

[0026] Optionally, the method further comprises:

[0027] in response to a behavior detection permission setting operation of the user, turning off or on the behavior detection permission of the central control screen, the behavior detection permission being used to acquire image information of the user and / or ambient sound inside the target room;

[0028] In the case that the behavior detection permission is closed, a physiological state of the user is determined according to a heat source distribution, a temperature, and a light brightness inside the target room.

[0029] In a second aspect, the present application provides a control method of a smart home, applied to a terminal device, and the method comprises:

[0030] In response to a first trigger operation of a user, a working mode switching instruction is sent to a central control screen of an arbitrary room, so that the control screen of the arbitrary room changes a current working mode according to the working mode switching instruction; the working mode switching instruction comprises switching the current working mode to a privacy protection mode or a common working mode; in the case that the working mode of the central control screen is the privacy protection mode, a video intercom request initiated by other terminal to the central control screen is rejected, the other terminal comprises the control screen or the terminal device of the arbitrary room, and the video intercom request is converted into a voice intercom request and outputted.

[0031] Optionally, the method further comprises:

[0032] In response to a second trigger operation of the user, a behavior detection permission of the central control screen of the arbitrary room is closed or opened, and the behavior detection permission is used to acquire image information of the user and / or environmental sound of the arbitrary room.

[0033] In a third aspect, the present application provides a control device of a smart home, applied to a central control screen in a target room, and the device comprises:

[0034] A first determination module is configured to recognize image information of a user by using a deep learning algorithm, and determine behavior data of the user;

[0035] A second determination module is configured to determine a physiological state of the user according to the image information of the user and / or environmental information of the target room;

[0036] A first switching module is configured to switch a working mode of the central control screen to a privacy protection mode in the case that the behavior data meets a preset condition and / or the physiological state is a sleep state;

[0037] A first control module is configured to reject a video intercom request initiated by other terminal to the central control screen in the case that the working mode of the central control screen is the privacy protection mode; the other terminal comprises a central control screen or a terminal device in other room except the target room;

[0038] A second control module is configured to convert the video intercom request into a voice intercom request and output the voice intercom request.

[0039] In a fourth aspect, the present application provides a control device of a smart home, applied to a terminal device, the device comprising:

[0040] The second switching module is configured to, in response to a first triggering operation of a user, send a working mode switching instruction to a central control screen in an arbitrary room, so that the central control screen in the arbitrary room changes a current working mode according to the working mode switching instruction; the working mode switching instruction comprises switching the current working mode to a privacy protection mode or a normal working mode; in a case where the working mode of the central control screen is the privacy protection mode, the second switching module is configured to reject a video intercom request initiated by other terminal devices to the central control screen, the other terminal devices comprising the terminal device or the central control screen in the arbitrary room, and convert the video intercom request to a voice intercom request and output the voice intercom request.

[0041] In a fifth aspect, the present application provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned control method of the smart home when executing the program.

[0042] In a sixth aspect, the present application provides a readable storage medium, when instructions in the readable storage medium are executed by a processor of an electronic device, the electronic device can execute the above-mentioned control method of the smart home.

[0043] In the embodiments of the present application, first, the central control screen in the target room identifies image information of a user by using a deep learning algorithm, and determines behavior data of the user; second, according to the image information of the user and / or environmental information of the target room, a physiological state of the user is determined; third, in a case where the behavior data meets a preset condition and / or the physiological state is a sleep state, the working mode of the central control screen is switched to a privacy protection mode; then, in a case where the working mode of the central control screen is the privacy protection mode, the second switching module is configured to reject a video intercom request initiated by other terminal devices to the central control screen; the other terminal devices comprising the central control screen or the terminal device in the other room except the target room; finally, the video intercom request is converted to a voice intercom request and output. In this way, in a case where the behavior data meets the preset condition and / or the physiological state is the sleep state, the working mode of the central control screen is switched to the privacy protection mode, and since the video intercom request can be rejected and converted to the voice intercom request in the privacy protection mode, the problem that the video intercom request initiated by the other terminal devices to the central control screen may disturb the user is solved, and the user privacy is protected. BRIEF DESCRIPTION OF DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required by the embodiments or prior art description. Obviously, the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.

[0045] Figure 1 is a schematic diagram of an application scenario provided by an embodiment of the present application;

[0046] Figure 2 is a step flow chart of a control method of a smart home provided by an embodiment of the present application;

[0047] Figure 3 is a step flow chart of another control method of a smart home provided by an embodiment of the present application;

[0048] Figure 4 is a step flow chart of still another control method of a smart home provided by an embodiment of the present application;

[0049] Figure 5 is a structural diagram of a control system of a smart home provided by an embodiment of the present application;

[0050] Figure 6 is a structural diagram of a control device of a smart home provided by an embodiment of the present application;

[0051] Figure 7 is a structural diagram of a control device of a smart home provided by an embodiment of the present application;

[0052] Figure 8 is a structural diagram of an electronic device provided by an embodiment of the present application;

[0053] Figure 9 is a structural diagram of another electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0054] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0055] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than that illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of a kind and do not limit the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims indicates at least one of the connected objects, and " / " generally indicates that the front and rear associated objects are in an "or" relationship.

[0056] In the description of the present disclosure, unless otherwise specified, "multiple" means two or more than two, and other quantifiers are similar; "at least one", "one or more" or similar expressions mean any combination of these items, including any combination of single or multiple items. For example, at least one a can represent any number of a; for example, one or more of a, b and c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be single or multiple; "and / or" is a description of the associated objects, which means that there can be three relationships, for example, A and / or B can represent: A alone, A and B together, B alone, where A and B can be singular or plural. The character " / " indicates that the front and rear associated objects are in an "or" relationship.

[0057] In the embodiments of the present disclosure, although the operations or steps are described in a specific order in the drawings, it should not be understood as requiring the operations or steps to be performed in the specific order or serial order shown, or requiring all the operations or steps to be performed to obtain the desired results. In the embodiments of the present disclosure, the operations or steps can be performed in series; the operations or steps can also be performed in parallel; or a part of the operations or steps can be performed.

[0058] First, an application scenario related to an embodiment of the present application is described.

[0059] With the development of science and technology, intelligent devices in people's life are becoming more and more popular. In order to realize the control of intelligent devices, each intelligent device is usually equipped with a corresponding smart home control panel. When the residential space in a user's home is large, or in a hotel, office building or other room number is large, in order to control multiple intelligent devices, multiple control panels need to be correspondingly equipped, however, there is a problem of scattered location and non-centralized function of control panels of different intelligent devices. In order to solve this problem, a central control screen for controlling multiple smart home devices needs to be installed in each room.

[0060] For example, the central control screen can be applied to the Internet of Things (IoT) in application scenarios such as smart home (home automation), smart home, smart home device ecosystem, and smart house ecosystem.

[0061] For example, the multiple smart home devices controlled by the central control screen may include: smart air conditioners, smart range hoods, smart refrigerators, smart ovens, smart stoves, smart washing machines, smart water heaters, smart washing equipment, smart dishwashers, smart projectors, smart TVs, smart clothes racks, smart curtains, smart audio-visual equipment, smart sockets, smart speakers, smart speakers, smart fresh air systems, smart kitchen and bathroom equipment, smart bathroom fixtures, smart robot vacuum cleaners, smart window cleaning robots, smart mopping robots, smart air purifiers, smart steam ovens, smart microwave ovens, smart water heaters, smart air purifiers, smart water dispensers, smart cameras, etc.

[0062] See Figure 1 The smart home control method provided in this application embodiment can be applied to, for example... Figure 1 The hardware environment shown consists of multiple central control screens 10 and terminal devices 20.

[0063] Optionally, the central control screen can be placed near the bed in the bedroom, and the camera and microphone on the bedroom central control screen can detect the user's physiological state and / or behavioral data.

[0064] Optionally, each room's central control screen can also be equipped with sensors such as infrared sensors and temperature sensors. The infrared sensors can be used to detect the distribution of heat sources in the room, and the temperature sensors can be used to detect temperature changes in the room.

[0065] Optionally, the central control screen 10 can be equipped with a built-in Subscriber Identity Module (SIM) phone card to enable video or voice calls via video dialing.

[0066] Optionally, the central control screen 10 can also integrate a software development kit (SDK) for making and receiving Voice over Long-Term Evolution (VoLTE) voice and video calls.

[0067] For example, the central control screen 10 can be a 4-inch voice-activated smart screen.

[0068] In the embodiment, the plurality of central control screens 10 are connected through a network, and the terminal device 20 is connected with the plurality of central control screens 10 through the network. The network can include a wired network and a wireless network. The wired network can include a wide area network, a metropolitan area network, and a local area network. The wireless network can include WIFI (Wireless Fidelity) and Bluetooth.

[0069] In the embodiment, the plurality of central control screens 10 and the terminal device 20 and any one of the central control screens 10 can realize video call or voice call through VoLTE technology.

[0070] In some embodiments, the terminal device 20 accesses the central control screen 10 through an access interface. For example, the terminal device 20 can be a smart phone and a computer, and the access interface can include, but is not limited to, a web (World Wide Web), an APP (application), and a mini program. The terminal device 20 can access the central control screen 10 through the web, the APP, and the mini program.

[0071] The control method of the smart home provided in the embodiments of the present application will be described in detail below.

[0072] Figure 2 FIG. 1 is a step flowchart of a control method of a smart home provided in the embodiments of the present application. The control method of the smart home is applied to a central control screen in a target room, as shown in FIG. 1, and can include the following steps. Figure 1 Figure 3

[0073] In step 101, image information of a user is recognized by using a deep learning algorithm to determine behavior data of the user.

[0074] In some embodiments, step 101 can include inputting the image information into a preset image analysis model to obtain the behavior data of the user output by the image analysis model. The preset image analysis model can be obtained by training a training sample representing user behavior.

[0075] For example, the preset image analysis model can be trained in the following manner: a labeled image set is obtained, and the labeled image set is divided into a plurality of labeled image subsets; a standard user behavior set is obtained, wherein the standard user behavior set includes standard user behaviors corresponding to the plurality of labeled image subsets; a behavior model is pre-constructed to generate a predicted user behavior set of a target labeled image subset in the plurality of labeled image subsets; a loss value of the standard user behavior corresponding to the target labeled image subset and the predicted user behavior set is calculated, and parameters of the behavior model are updated according to the loss value to obtain a trained image analysis model.

[0076] ​​In some embodiments, step 101 can further include extracting a target image feature in the image information by an image recognition method; and obtaining the behavior data of the user according to the target image feature.

[0077] Optionally, the behavior data of the user can include action data of the user, location information of the user, and the like.

[0078] Step 102, determining a physiological state of the user according to the image information of the user and / or the environmental information of the target room.

[0079] In some embodiments, the environmental information of the target room can include environmental sound inside the target room; the environmental information of the target room can also include heat source distribution and temperature inside the target room; and the environmental information of the target room can further include light brightness inside the target room.

[0080] In some embodiments, the physiological state of the user can include a sleep state.

[0081] Optionally, step 102 can include determining the physiological state of the user according to the image information of the user and the environmental information of the target room; step 102 can also include determining the physiological state of the user according to the image information of the user; and step 102 can further include determining the physiological state of the user according to the environmental information of the target room.

[0082] Step 103, switching a working mode of the central control screen to a privacy protection mode in a case where the physiological state is a sleep state and / or the behavior data satisfies a preset condition.

[0083] Optionally, the preset condition can include that the behavior data indicates that the user is changing clothes, the behavior data indicates that the user is working, and the behavior data indicates that the user is resting with eyes closed.

[0084] In the embodiments of the present application, step 103 can include switching the working mode of the central control screen to the privacy protection mode in a case where the physiological state is the sleep state and the behavior data satisfies the preset condition; step 103 can also include switching the working mode of the central control screen to the privacy protection mode in a case where the physiological state is the sleep state; and step 103 can further include switching the working mode of the central control screen to the privacy protection mode in a case where the behavior data satisfies the preset condition.

[0085] In the embodiments of the present application, the working mode of the central control screen includes the privacy protection mode and a normal working mode. When the working mode of the central control screen is the normal working mode, the central control screen can receive a video intercom request initiated by other terminals or other central control screens.

[0086] Step 104, rejecting a video intercom request initiated by other terminals to the central control screen in a case where the working mode of the central control screen is the privacy protection mode.

[0087] In the embodiments of the present application, the other terminal includes a central control screen or a terminal device in a room other than the target room.

[0088] For example, when the target room is a bedroom, the other terminal can be a central control screen in a living room, the other terminal can also be a central control screen at the entrance of a villa, and the other terminal can also be a user's mobile phone or the like.

[0089] It should be noted that in a general family, a hotel or an office building, a central control screen will be placed in different rooms, and video intercom can be initiated between central control screens, such as a central control screen in a living room initiating a video intercom with a central control screen in a bedroom, and a central control screen at the entrance of a villa initiating a video intercom with a central control screen in a room upstairs. Taking the target room as a bedroom as an example, when a video intercom request for the bedroom is initiated from other places, the central control screen in the bedroom detects the user's physiological state, identifies the user's behavior data, and in the case that the user is in a sleep state and / or the user's behavior data meets a preset condition, switches the working mode of the central control screen to a privacy protection mode. In the privacy protection mode, the central control screen in the bedroom can refuse the video intercom request initiated from other places.

[0090] For example, when the central control screen in the target room is online, the central control screen in the other room can directly establish a video call connection between the central control screen in the target room and the central control screen in the other room through a video call platform, so that video streams can be transmitted to realize video intercom; in the case that the working mode of the central control screen in the target room is a privacy protection mode, the video intercom request initiated by the central control screen in the other room is refused.

[0091] Step 105, converting the video intercom request into a voice intercom request and outputting.

[0092] In some embodiments, step 105 can include that the central control screen establishes a communication connection relationship with the other terminal, so that the central control screen and the other terminal perform voice intercom.

[0093] For example, in the process of voice calling and answering between the central control screen in the target room and the other terminal, the network address of the central control screen in the target room can be returned, which can be an Internet Protocol (IP) address or a Message Authentication Code (MAC) address, or other network addresses that can be used for network communication. In this way, the other terminal can establish a communication connection relationship with the central control screen in the target room based on the IP address or the MAC address, so that the central control screen and the other terminal, thereby realizing the voice intercom function.

[0094] In some embodiments, step 105 can further include converting the video intercom request into a voice intercom request and displaying the identity of the other terminal. In this way, the user can see at a glance which terminal is calling when the call is displayed, and can respond or reject the voice intercom request in a timely manner.

[0095] To sum up, the smart home control method in the embodiments of the present application first uses a deep learning algorithm to identify image information of a user in a target room to determine behavior data of the user. Second, the physiological state of the user is determined according to the image information of the user and / or environmental information of the target room. Third, the working mode of the central control screen is switched to a privacy protection mode in the case that the behavior data meets a preset condition and / or the physiological state is a sleep state. Fourth, the video intercom request initiated by other terminals to the central control screen is rejected in the case that the working mode of the central control screen is the privacy protection mode. The other terminals include central control screens or terminal devices in other rooms except the target room. Finally, the video intercom request is converted into a voice intercom request and output. In this way, the working mode of the central control screen is switched to the privacy protection mode in the case that the behavior data meets the preset condition and / or the physiological state is the sleep state. Since the video intercom request can be rejected and converted into a voice intercom request in the privacy protection mode, the problem that the video intercom request initiated by other terminals to the central control screen may disturb the user is solved, and the privacy of the user is protected.

[0096] Figure 3 is a step flow chart of another smart home control method provided by the embodiments of the present application. The smart home control method is applied to a target device, such as Figure 3 As shown in the figure, the method can include:

[0097] Step 201, identifying image information of a user by using a deep learning algorithm to determine behavior data of the user.

[0098] The method of this step has been described in the foregoing step 101, and will not be repeated here.

[0099] Step 202, determining a physiological state of the user according to the image information of the user and environmental information of a target room.

[0100] Optionally, step 202 includes:

[0101] Sub-step 2021, identifying the image information of the user to obtain eye features of the user.

[0102] Sub-step 2022, determining an environmental sound volume of an environmental sound inside the target room.

[0103] Sub-step 2023, determining that the physiological state of the user is a sleep state in the case that the eye features represent that the eyes are closed and the environmental sound volume is less than a preset sound threshold.

[0104] For example, the substep 2021 can include: identifying the eye closure degree of the user by a facial recognition algorithm; in the case that the eye closure degree of the user is less than a preset closure threshold, the eye feature indicates eye closure; in the case that the eye closure degree of the user is greater than or equal to the preset closure threshold, the eye feature indicates eye opening.

[0105] For example, the substep 2022 can include: detecting the environmental sound inside the target room by a microphone on the central control screen; and determining the environmental sound volume of the environmental sound inside the target room.

[0106] For example, the preset volume threshold in the substep 2023 can be 10 decibels (dB). The substep 2023 can include: in the case that the eye feature indicates eye closure and the environmental sound volume is less than 10 dB, determining that the physiological state of the user is a sleep state.

[0107] By the above technical means, the accuracy of determining the sleep state of the user can be improved by combining the image information of the user and the environmental sound volume.

[0108] In some embodiments, after the substep 2022, the control method of the smart home further includes:

[0109] Substep A1, in the case that the environmental sound volume is less than a preset volume threshold, matching the environmental sound inside the target room with a preset sleep respiratory voiceprint to obtain a first matching degree;

[0110] Substep A2, in the case that the eye feature indicates eye closure and the first matching degree is greater than a preset matching degree threshold, determining that the physiological state of the user is a sleep state.

[0111] For example, the preset matching degree threshold can be 90%.

[0112] By the above technical means, the accuracy of determining the sleep state of the user can be improved by combining the environmental sound volume and the sleep respiratory voiceprint.

[0113] Step 203, determining the physiological state of the user according to the image information of the user.

[0114] For example, step 203 can include: in the case that the position of the user is on the bed, identifying the action amplitude of the user according to the image information of the user; in the case that the action amplitude of the user is less than a preset action amplitude threshold, determining that the physiological state of the user is a sleep state.

[0115] For example, step 203 can further include: in a case where the user's position is on a bed, identifying the degree of expression change of the user according to the image information of the user; and in a case where the degree of expression change of the user represents that the expression of the user is calm, determining that the physiological state of the user is the sleep state.

[0116] Step 204, determining the physiological state of the user according to the environmental information of the target room.

[0117] In some embodiments, the environmental information of the target room includes the heat source distribution and the temperature inside the target room, and step 204 can include:

[0118] Sub-step 2041, determining the position of the user according to the heat source distribution inside the target room.

[0119] Sub-step 2042, determining the temperature change of the position of the user.

[0120] Sub-step 2043, in a case where the position of the user is a specified position and the temperature of the position of the user rises, determining that the user is in the sleep state.

[0121] In the embodiments of the present application, the specified position is a position where the user can sleep and rest, and the specified position can be on a bed, the specified position can also be on a sofa, the specified position can also be on a recliner, and the like, without specific limitation.

[0122] For example, the heat source distribution inside the target room can be obtained by an infrared sensor in sub-step 2041, and the temperature change of the position of the user can be obtained by a temperature sensor in sub-step 2042.

[0123] Through the above technical means, in combination with the heat source distribution inside the target room and the temperature change of the position of the user, the accuracy of determining the sleep state of the user can be improved.

[0124] In some embodiments, the environmental information of the target room includes the light brightness inside the target room, and step 204 can include:

[0125] Sub-step 2044, in a case where the light brightness inside the target room changes and the brightness inside the target room is lower than a preset brightness threshold, determining that the user is in the sleep state.

[0126] For example, the light brightness inside the target room can be obtained by a brightness sensor in sub-step 2044.

[0127] Through the above technical means, in a case where the light brightness inside the target room changes and the brightness inside the target room is lower than a preset brightness threshold, determining that the user is in the sleep state, the accuracy of determining the sleep state of the user can be improved.

[0128] In some embodiments, before step 201, the above-mentioned method for controlling the smart home can further include:

[0129] Sub-step B1, in response to a behavior detection permission setting operation of the user, closing or opening the behavior detection permission of the central control screen;

[0130] Sub-step B2, in the case where the behavior detection permission is closed, determining the physiological state of the user according to the heat source distribution, temperature and light brightness inside the target room.

[0131] In the embodiments of the present application, the behavior detection permission is used to obtain image information of the user and / or environmental sound in the target room; and the behavior detection permission setting operation can be a click operation on a preset control in the central control screen.

[0132] It can be understood that, in order to protect the privacy of the user, the behavior detection permission of the central control screen can be set to open or close the camera and / or microphone on the central control screen.

[0133] For example, a "one-key shielding" control is provided on the display interface of the central control screen, and when the user clicks the control, the behavior detection permission of the central control screen is closed, that is, the camera and / or microphone on the central control screen is closed.

[0134] Through the above technical means, in the case where the behavior detection permission of the central control screen represents that the camera and / or microphone on the central control screen is closed, the physiological state of the user is determined only according to the data of the sensor, thereby protecting the privacy of the user.

[0135] Step 205, in the case where the physiological state is a sleep state and / or the behavior data meets a preset condition, switching the working mode of the central control screen to a privacy protection mode.

[0136] The method of this step has been described in the foregoing step 103, and will not be repeated here.

[0137] In some embodiments, after step 205, the above-mentioned method for controlling the smart device can further include: sending a privacy protection mode switching instruction to the central control screen of the other room, so as to make the central control screen of the other room switch its own working mode to a privacy protection mode.

[0138] For example, the target room is a bedroom, and the other room is a living room, and when the user is in a sleep state, the central control screen of the living room can also be switched to a privacy protection mode in order not to disturb the user, thereby realizing linkage between the central control screens of different rooms.

[0139] Step 206, in the case where the working mode of the central control screen is a privacy protection mode, rejecting a video intercom request initiated by other terminals to the central control screen.

[0140] In the embodiment of the present application, the other terminal includes a central control screen or a terminal device in a room other than the target room.

[0141] The method of this step has been described in the foregoing step 104, and will not be repeated here.

[0142] Step 207: converting the video intercom request into a voice intercom request and outputting.

[0143] The method of this step has been described in the foregoing step 105, and will not be repeated here.

[0144] To sum up, the smart home control method in the embodiment of the present application determines the sleep state of the user in a diversified manner, which can improve the accuracy of determining the sleep state of the user, and in the case where the behavior detection permission of the central control screen represents that the camera and / or microphone on the central control screen are closed, only the physiological state of the user is determined according to the data of the sensor, thereby protecting the privacy of the user.

[0145] Figure 4 is a step flowchart of a smart home control method provided in the embodiment of the present application, which is applied to the terminal device in the embodiment of the present application, as shown in Figure 1 The method can include the following steps. Figure 4

[0146] Step 301: in response to a first trigger operation of the user, sending a working mode switching instruction to the central control screen of any one room.

[0147] In the embodiment of the present application, step 301 can make the central control screen of any one room change the current working mode according to the working mode switching instruction.

[0148] In the embodiment of the present application, the first trigger operation can be a click operation of the user on the display interface of the terminal device.

[0149] In the embodiment of the present application, the working mode switching instruction includes switching the current working mode to the privacy protection mode or the normal working mode.

[0150] In the embodiment of the present application, in the case where the working mode of the central control screen is the privacy protection mode, the video intercom request initiated by the other terminal to the central control screen is rejected, the video intercom request is converted into a voice intercom request, and the voice intercom request is outputted, wherein the other terminal includes a central control screen or a terminal device in a room other than the target room.

[0151] In some embodiments, the above-mentioned smart home control method further includes:

[0152] In response to a second trigger operation of the user, closing or opening the behavior detection permission of the central control screen of any one room.

[0153] ​In the embodiments of the present application, the behavior detection permission is used to obtain image information of the user and / or environmental sound of any one room.

[0154] In summary, the smart home control method in the embodiments of the present application can realize remote control of the central control screen in any one room by switching the working mode of the central control screen through the terminal device. Since the central control screen can reject a video intercom request and convert it into a voice intercom request in the privacy protection mode, the problem that a video intercom request initiated by other terminals to the central control screen may disturb the user is solved, and the user privacy is protected.

[0155] Figure 5 is a structural diagram of a smart home control system provided by the embodiments of the present application, as shown in Figure 5 The control system can include a sensor 41, a privacy detection module 42, an intercom shielding module 43, and a user interface 44.

[0156] In the embodiments of the present application, the sensor 41 includes environmental sensors such as infrared sensors, temperature sensors, etc., which can sense the environmental changes of the user and assist in privacy detection.

[0157] In the embodiments of the present application, the privacy detection module 42 has functions of image recognition and behavior analysis. In the embodiments of the present application, the privacy detection module 42 can capture the image of the user through the camera on the central control screen, perform image recognition using a deep learning algorithm, detect the privacy behavior of the user, and generate behavior data. The privacy detection module 42 can also analyze the behavior by combining the real-time behavior data of the user, such as actions, positions, etc., to determine whether the user is in a privacy state.

[0158] In the embodiments of the present application, the intercom shielding module 43 has an automatic one-key shielding function; the intercom shielding module 43 can automatically trigger the one-key shielding function when it is determined that the user is currently in a privacy state according to the privacy detection result of the privacy detection module. The intercom shielding module 43 also has a manual one-key shielding function, which is manually opened or closed in response to the user opening / closing the one-key shielding function button on the user interface 44 of the central control screen.

[0159] In the embodiment of the present application, the user interface 44 is provided with a "one-key shielding" control, through which the user can conveniently turn on or turn off the privacy protection function, and the one-key shielding function can be realized. After the user triggers the one-key shielding function through the user interface 44 of the central control screen, the central control screen will reject the video intercom request initiated by other user terminals to the central control and convert it into a voice intercom request. The user interface 44 can also be provided with a state display bar, which is used to display the current state of the one-key shielding function in real time, so that the user can immediately understand the current working mode of the display screen. The user interface 44 can also be provided with a behavior detection permission setting control, which is used to turn off or turn on the behavior detection permission of the central control screen in response to the user's behavior detection permission setting operation.

[0160] In some embodiments, when the shielding function of the intercom shielding module 43 is turned on, if other users or visitors initiate a video intercom request, the intercom shielding module 43 can also output a notification message for notifying the other users or visitors that the current user is not convenient to answer the video intercom, for example, the notification message is a voice prompt "the current user is not convenient to answer the video intercom, and the voice intercom request is converted for you".

[0161] Optionally, the control system can also include other terminals 45. When the shielding function of the intercom shielding module 43 is turned on, the display interface of the other terminal 45 switches the video intercom request interface to the voice intercom request interface, and outputs the voice prompt "the current user is not convenient to answer the video intercom, and the voice intercom request is converted for you".

[0162] Through the above control system, the user can automatically shield the video intercom request when performing a private activity, effectively protecting privacy and improving user experience. The system uses an intelligent and automatic detection mechanism to ensure the accuracy and stability of privacy protection, and can be seamlessly integrated with existing smart home systems, and has a wide application prospect.

[0163] Figure 6 is a structure diagram of a control device of a smart home provided by an embodiment of the present application. The control device of the smart home 500 is applied to a central control screen in a target room, and can include:

[0164] The first determination module 501 is configured to recognize image information of a user by using a deep learning algorithm, and determine behavior data of the user.

[0165] The second determination module 502 is configured to determine a physiological state of the user according to the image information of the user and / or environmental information of the target room.

[0166] The first switching module 503 is configured to switch the working mode of the central control screen to the privacy protection mode when the behavior data meets the preset condition and / or the physiological state is the sleep state.

[0167] The first control module 504 is configured to reject a video intercom request initiated by other terminals on the central control screen when the working mode of the central control screen is the privacy protection mode; the other terminals include the central control screen or a terminal device in other rooms except the target room.

[0168] The second control module 505 is configured to convert the video intercom request into a voice intercom request and output the voice intercom request.

[0169] Optionally, the environmental information of the target room includes environmental sound inside the target room, and the second determination module 502 includes:

[0170] The identification sub-module is configured to identify the image information of the user to obtain eye features of the user.

[0171] The first determination sub-module is configured to determine an environmental sound volume of the environmental sound inside the target room.

[0172] The second determination sub-module is configured to determine that the physiological state of the user is the sleep state when the eye features represent that the eyes are closed and the environmental sound volume is less than a preset sound volume threshold.

[0173] Optionally, after determining the environmental sound volume of the environmental sound inside the target room, the control device 500 of the smart home further includes:

[0174] The matching module is configured to match the environmental sound inside the target room with a preset sleep respiratory voiceprint to obtain a first matching degree when the environmental sound volume is less than the preset sound volume threshold.

[0175] The third determination module is configured to determine that the physiological state of the user is the sleep state when the eye features represent that the eyes are closed and the first matching degree is greater than a preset matching degree threshold.

[0176] Optionally, the environmental information of the target room includes a heat source distribution situation and a temperature inside the target room, and the second determination module 502 includes:

[0177] The third determination sub-module is configured to determine the position of the user according to the heat source distribution situation inside the target room.

[0178] The fourth determination sub-module is configured to determine a temperature change situation of the position of the user.

[0179] The fifth determination sub-module is configured to determine that the user is in the sleep state when the position of the user is a specified position and the temperature of the position of the user increases.

[0180] Optionally, the environment information of the target room comprises light brightness inside the target room, the second determining module 502 comprises:

[0181] The sixth determining sub-module is configured to determine that the user is in a sleep state when the light brightness inside the target room changes and the brightness inside the target room is lower than a preset brightness threshold.

[0182] Optionally, the control device 500 of the smart home further comprises:

[0183] The third control module is configured to close or open the behavior detection permission of the central control screen in response to a behavior detection permission setting operation of the user, the behavior detection permission being used to acquire image information of the user and / or environment sound in the target room.

[0184] The third determining module is configured to determine the physiological state of the user according to the heat source distribution, temperature and light brightness inside the target room when the behavior detection permission is closed.

[0185] For the device embodiment, it is basically similar to the method embodiment, so the description is relatively simple, and the related parts are described in the method embodiment.

[0186] In summary, first, the central control screen in the target room identifies image information of the user by using a deep learning algorithm to determine behavior data of the user; second, the physiological state of the user is determined according to the image information of the user and / or environment information of the target room; third, the working mode of the central control screen is switched to a privacy protection mode when the behavior data meets a preset condition and / or the physiological state is a sleep state; fourth, a video intercom request initiated by other terminals to the central control screen is rejected when the working mode of the central control screen is the privacy protection mode; the other terminals comprise central control screens or terminal devices in other rooms except the target room; and fifth, the video intercom request is converted into a voice intercom request and output. In this way, the working mode of the central control screen is switched to the privacy protection mode when the behavior data meets the preset condition and / or the physiological state is the sleep state, and the video intercom request can be rejected and converted into the voice intercom request in the privacy protection mode, thereby solving the problem that the video intercom request initiated by the other terminals to the central control screen may disturb the user and protecting the privacy of the user.

[0187] Figure 7 is a structural diagram of a control device of a smart home provided by an embodiment of the present application. The control device of the smart home 600 is applied to a terminal device, and the control device of the smart home 600 can comprise:

[0188] The second switching module 601 is configured to, in response to a first trigger operation of the user, send a working mode switching instruction to the central control screen of any one room, so that the control screen of any one room changes the current working mode according to the working mode switching instruction; the working mode switching instruction comprises switching the current working mode to a privacy protection mode or a normal working mode; in the case that the working mode of the central control screen is the privacy protection mode, the video intercom request initiated by other terminals to the central control screen is rejected, and the video intercom request is converted into a voice intercom request and outputted.

[0189] Optionally, the control device 600 of the smart home further comprises:

[0190] The fourth control module is configured to, in response to a second trigger operation of the user, close or open the behavior detection permission of the central control screen of any one room, and the behavior detection permission is used to acquire image information of the user and / or environmental sound of any one room.

[0191] For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the related parts refer to the part of the method embodiment.

[0192] In summary, by switching the working mode of the central control screen through the terminal device, remote control of the central control screen of any one room can be realized, and since the central control screen can reject the video intercom request and convert it into a voice intercom request in the privacy protection mode, the problem that the video intercom request initiated by other terminals to the central control screen may disturb the user is solved, and the user privacy is protected.

[0193] The application also provides an electronic device, referring to Figure 8 The electronic device 700 can include one or more of the following components: a processing component 702, a memory 704, a power supply component 706, a multimedia component 708, an audio component 710, an input / output (I / O) interface 712, a sensor component 714, and a communication component 716.

[0194] The processing component 702 usually controls the overall operation of the electronic device 700, such as operations associated with displaying, making phone calls, data communications, camera operations, and recording operations. The processing component 702 can include one or more processors 720 to execute instructions to complete all or part of the steps of the methods described above. In addition, the processing component 702 can include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 can include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0195] The memory 704 is used for storing various types of data to support the operation of the electronic device 700. Examples of these data include instructions for any application programs or methods operating on the electronic device 700, contact data, phonebook data, messages, pictures, multimedia, etc. The memory 704 can be implemented by any type of volatile or nonvolatile memory devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0196] The power supply component 706 supplies power for various components of the electronic device 700. The power supply component 706 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 700.

[0197] The multimedia component 708 includes an interface for outputting various types of media content between the electronic device 700 and a user. In some embodiments, the interface can include a liquid crystal display (LCD) and a touch panel (TP). If the interface includes the touch panel, the interface can be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors for sensing touch, swiping, and gestures on the touch panel. The touch sensor can not only sense the boundary of a touch or swiping action, but also detect duration and pressure associated with the touch or swiping action. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. The front and rear cameras can receive external multimedia data when the electronic device 700 is in an operation mode, such as a photographing mode or a multimedia mode. Each of the front and rear cameras can be a fixed optical lens system or have a focal length and optical zoom capability.

[0198] The audio component 710 is for outputting and / or inputting audio signals. For example, the audio component 710 includes a microphone (MIC) for receiving external audio signals when the electronic device 700 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 704 or transmitted via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0199] The input / output (I / O) interface 712 provides an interface between the processing component 702 and peripheral interface modules, which can be a keyboard, a click wheel, a button, etc. These buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0200] The sensor component 714 includes one or more sensors for providing status assessments for various aspects of the electronic device 700. For example, the sensor component 714 can detect an open / closed position of the electronic device 700, relative positioning of components, such as a display and a keypad of the electronic device 700, a change in position of the electronic device 700 or a component of the electronic device 700, presence or absence of user contact with the electronic device 700, orientation or acceleration / deceleration / g-force and temperature of the electronic device 700. The sensor component 714 can include an optical sensor for detecting ambient light, a proximity sensor for detecting nearby objects without any physical touch, a CMOS or CCD image sensor for use in imaging applications, or an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor in some embodiments.

[0201] The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, a cellular network standard (such as 2G, 3G, 7G, or 7G), or a combination thereof. In an example embodiment, the communication component 716 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an example embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) techniques, infrared data association (IrDA) techniques, ultra-wideband (UWB) techniques, Bluetooth (BT) techniques, and other techniques.

[0202] In an example embodiment, the electronic device 700 can be implemented using one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic elements, to implement a method for controlling a smart home according to embodiments of the present application.

[0203] In an example embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 704 including instructions, is also provided, which can be executed by the processor 720 of the electronic device 700 to implement the above-described method. For example, the non-transitory storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.

[0204] Figure 9is a block diagram of an electronic device 800 according to another embodiment of the present application. For example, the electronic device 800 can be provided as a server. Referring to Figure 9 The electronic device 800 includes a processing component 822, which further includes one or more processors, and a memory resource represented by a memory 832, for storing instructions, such as application programs, executable by the processing component 822. The application programs stored in the memory 832 can include one or more than one module each corresponding to a set of instructions. In addition, the processing component 822 is configured to execute the instructions to perform a method for controlling a smart home according to an embodiment of the present application.

[0205] The electronic device 800 can further include a power component 826 configured to perform power management of the electronic device 800, a wired or wireless network interface 850 configured to connect the electronic device 800 to a network, and an input / output (I / O) interface 858. The electronic device 800 can operate based on an operating system stored in the memory 832, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0206] In the embodiments of the present application, the memory 832 can be used to store software programs and various data. The memory 832 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, etc.), and the like. In addition, the memory 832 can include a volatile memory or a non-volatile memory, or the memory 832 can include both volatile and non-volatile memories. The non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM), a Static RAM (SRAM), a Dynamic RAM (DRAM), a Synchronous DRAM (SDRAM), a Double Data Rate SDRAM (DDR SDRAM), an Enhanced SDRAM (ESDRAM), a Synch link DRAM (SLDRAM), and a Direct Rambus RAM (DRRAM). The memory 832 in the embodiments of the present application includes but is not limited to these and any other suitable types of memories.

[0207] The processor can include one or more processing units; optionally, the processor integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor.

[0208] The present application also provides a readable storage medium, when instructions in the readable storage medium are executed by a processor of an electronic device, the electronic device can execute the control method of the smart home of the foregoing embodiments.

[0209] The embodiment of the present application further provides a computer program product, which is stored in a storage medium, and is executed by at least one processor to implement each process of the control method of the smart home as described above, and achieve the same technical effects. To avoid repetition, details are not described herein.

[0210] It should be noted that the various information and data acquired in the embodiments of the present application are acquired with authorization of the information / data holder. All actions of acquiring signals, information or data in the present application are performed under the premise of complying with the corresponding data protection regulations and policies of the country where the device is located, and with authorization given by the corresponding device owner.

[0211] The algorithms and displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems can be used with these teachings, with the structure for a variety of such systems apparent from the description below. In addition, the present application is not described with reference to any particular programming language. It will be appreciated that a variety of programming languages can be used to implement the teachings of the present application as described herein, and any references below to specific languages are provided for disclosure of enablement of the present application.

[0212] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the application can be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

[0213] Similarly, it is to be understood that the bricrj of the present application and specific examples, while indicating embodiments of the present application, are intended to be illustrative only and in no way limit the scope of the application, as defined by the appended claims. Moreover, while the present application has been described in detail with respect to specific embodiments thereof, it will be apparent to those skilled in the art that various alterations, modifications and / or additions can be made thereto without departing from the spirit and scope of the application.

[0214] Those skilled in the art will appreciate that the modules in the apparatuses in the embodiments can be adapted and placed in one or more apparatuses other than those in the embodiments. The modules or units or components in the embodiments can be combined into one module or unit or component, and furthermore can be split into multiple sub-modules or sub-units or sub-components. Any combination of all the features disclosed in the specification (including the accompanying claims, abstract and drawings), and any method or apparatus so disclosed, can be made unless explicitly stated otherwise. Each feature disclosed in the specification (including the accompanying claims, abstract and drawings), can be replaced by alternative features providing the same, equivalent or similar functionality unless explicitly stated otherwise.

[0215] Embodiments of the various components of the present application can be implemented in hardware, or as software modules running in one or more processors, or combinations thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all of the functionality of some or all of the components in the sequencing apparatus according to the present application. The present application can also be implemented as a program for executing part or all of the methods described herein on a device or apparatus. Such a program(s) can be stored on a computer readable medium which can be any data storage medium known in the art. The program(s) can also be in the form of one or more signals on one or more carrier waves.

[0216] It should be noted that the above-mentioned embodiments illustrate rather than limit the application, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word 'comprising' does not exclude the presence of elements or steps other than those listed in a claim. The word 'a' or 'an' preceding an element does not exclude the presence of a plurality of such elements. The application can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the system claims enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words 'first','second', and 'third', etc. do not imply any order. These words are to be understood as names.

[0217] The user information (including but not limited to the user's device information, the user's personal information, etc.) and related data involved in the present application are information authorized by the user or authorized by each party.

[0218] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, and will not be described here.

[0219] The above only describes the preferred embodiments of the present application and is not intended to limit the present application. Any modification, equivalent replacement and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

[0220] The above only describes the specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A control method of a smart home, the method comprising: The method applied to a central control screen in a target room, comprising: recognizing image information of a user by using a deep learning algorithm to determine behavior data of the user; determining a physiological state of the user according to the image information of the user and / or environmental information of the target room; switching a working mode of the central control screen to a privacy protection mode in a case that the behavior data meets a preset condition and / or the physiological state is a sleep state; rejecting a video intercom request initiated by other terminals to the central control screen in a case that the working mode of the central control screen is the privacy protection mode; the other terminals include central control screens or terminal devices in other rooms except the target room; converting the video intercom request to a voice intercom request and outputting.

2. The method of claim 1, wherein, The environmental information of the target room includes environmental sound inside the target room, and the determining of the physiological state of the user according to the image information of the user and / or the environmental information of the target room comprises: recognizing the image information of the user to obtain eye features of the user; determining an environmental sound volume of the environmental sound inside the target room; determining that the physiological state of the user is a sleep state in a case that the eye features represent eye closure and the environmental sound volume is less than a preset volume threshold.

3. The method of claim 2, wherein, After the determining of the environmental sound volume of the environmental sound inside the target room, the method further comprises: matching the environmental sound inside the target room with a preset sleep breathing voiceprint to obtain a first matching degree in a case that the environmental sound volume is less than the preset volume threshold; determining that the physiological state of the user is a sleep state in a case that the eye features represent eye closure and the first matching degree is greater than a preset matching degree threshold.

4. The method of claim 1, wherein, The environmental information of the target room includes heat source distribution and temperature inside the target room, and the determining of the physiological state of the user according to the image information of the user and / or the environmental information of the target room comprises: determining a position of the user according to the heat source distribution inside the target room; determining a temperature change of the position of the user; determining that the user is in a sleep state in a case that the position of the user is a specified position and the temperature of the position of the user is increased.

5. The method of claim 1, wherein, The environmental information of the target room includes light brightness inside the target room, and the determining of the physiological state of the user according to the image information of the user and / or the environmental information of the target room comprises: determining that the user is in a sleep state in a case that the light brightness inside the target room is changed and the brightness inside the target room is lower than a preset brightness threshold.

6. The method of claim 1, wherein, The method further comprises: in response to a behavior detection permission setting operation of the user, closing or opening a behavior detection permission of the central control screen, the behavior detection permission being used to acquire the image information of the user and / or environmental sound inside the target room; in a case that the behavior detection permission is closed, determining the physiological state of the user according to the heat source distribution, temperature and light brightness inside the target room.

7. The method of claim 1, wherein, The method further comprises: In response to a first trigger operation of the user, a work mode switching instruction is sent to the central control screen of any one room, so that the control screen of the any one room changes the current work mode according to the work mode switching instruction; the work mode switching instruction includes switching the current work mode to a privacy protection mode or a normal work mode; in the case that the work mode of the central control screen is the privacy protection mode, a video intercom request initiated by other terminals to the central control screen is rejected, the other terminals including the control screen or the terminal device of the any one room, and the video intercom request is converted into a voice intercom request and output.

8. The method of claim 1, wherein, The method further comprises: In response to a second trigger operation of the user, the behavior detection permission of the central control screen of any one room is closed or opened, and the behavior detection permission is used to acquire image information of the user and / or environmental sound in the any one room. 9.A control device of a smart home, characterized by, The device applied to the central control screen in a target room comprises: A first determination module is configured to identify image information of the user by using a deep learning algorithm, and determine behavior data of the user; A second determination module is configured to determine a physiological state of the user according to the image information of the user and / or environmental information of the target room; A first switching module is configured to switch the work mode of the central control screen to a privacy protection mode in the case that the behavior data meets a preset condition and / or the physiological state is a sleep state; A first control module is configured to reject a video intercom request initiated by other terminals to the central control screen in the case that the work mode of the central control screen is the privacy protection mode; the other terminals include the central control screen or the terminal device in other rooms except the target room; A second control module is configured to convert the video intercom request into a voice intercom request and output.

10. The apparatus of claim 9, wherein, The device further comprises: A second switching module is configured to send a work mode switching instruction to the central control screen of any one room in response to a first trigger operation of the user, so that the control screen of the any one room changes the current work mode according to the work mode switching instruction; the work mode switching instruction includes switching the current work mode to a privacy protection mode or a normal work mode; in the case that the work mode of the central control screen is the privacy protection mode, a video intercom request initiated by other terminals to the central control screen is rejected, the other terminals including the control screen or the terminal device of the any one room, and the video intercom request is converted into a voice intercom request and output.

11. An electronic device, comprising: It comprises: A processor, a memory, and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the control method of the smart home according to any one of claims 1 to 8 when executing the program.

12. A readable storage medium, characterized by, When the instructions or transactions in the storage medium are executed by the processor of the electronic device, the electronic device can execute the control method of the smart home according to any one of claims 1 to 8.

Images