Household equipment control method, intelligent household system, user terminal and local equipment

Abstract

The embodiment of the invention provides a home equipment control method, a smart home system, a user terminal and local equipment. The method comprises the steps that the user terminal acquires voice data of a user; under the condition that the user terminal fails to control the home equipment through the Internet according to the voice data, the user terminal sends the voice data to local equipment; and the local equipment controls the home equipment locally according to the voice data. Under the condition that the user terminal cannot control the home equipment through the Internet, the user terminal can send the voice data to the local equipment and control the home equipment through the local equipment, so that the condition that a user cannot control the home equipment through the user terminal is avoided, and the user experience is improved. The normal use of the voice control function is ensured, and the user experience is improved.

Description

Technical Field

[0001] This application relates to the environmental field, and in particular to a home appliance control method, a smart home system, a user terminal, and a local device. Background Technology

[0002] With the development of science and technology and urban construction, voice recognition technology is gradually being applied to all aspects of people's lives. For example, in office buildings, apartments, schools, shopping malls and other places, devices that can be controlled based on voice, such as smart home devices based on voice control, are becoming increasingly popular.

[0003] Currently, in existing technologies for voice-based control of smart home devices, the user terminal sends voice commands issued by the user to a server via the internet. The server then recognizes and parses the voice commands to generate control instructions. The server then sends the generated control instructions to the local control device via the internet to control the smart home device.

[0004] It should be noted that the above introduction to the technical background is only for the purpose of providing a clear and complete explanation of the technical solutions of this application and facilitating understanding by those skilled in the art. It should not be assumed that these technical solutions are known to those skilled in the art simply because they have been described in the background section of this application. Summary of the Invention

[0005] The inventors discovered that in the prior art, user terminals need to control home appliances via the Internet. However, if the user terminal cannot connect to the Internet or the server malfunctions, the user will be unable to control the home appliances, thus reducing the user experience.

[0006] To address at least one of the aforementioned problems, embodiments of this application provide a home appliance control method, a smart home system, a user terminal, and a local device. When the user terminal is unable to control home appliances via voice over the internet, the user terminal can transmit voice data to the local device and control the home appliances through the local device. This avoids situations where users are unable to control home appliances through the user terminal, ensures the normal use of the voice control function, and improves the user experience.

[0007] According to a first aspect of the embodiments of this application, a method for controlling home appliances is provided, the method comprising: a user terminal acquiring voice data of a user; and, in the event that the user terminal fails to control the home appliances via the Internet based on the voice data, the user terminal sending the voice data to a local device; and the local device controlling the home appliances locally based on the voice data.

[0008] According to a second aspect of the embodiments of this application, a smart home system is provided, the smart home system including home devices, a user terminal, and a local device, wherein the user terminal acquires voice data of a user; and in the event that the user terminal fails to control the home devices via the Internet based on the voice data, the user terminal sends the voice data to the local device; the local device controls the home devices locally based on the voice data.

[0009] According to a third aspect of the embodiments of this application, a user terminal is provided, the user terminal comprising: an acquisition unit for acquiring user voice data; and a transmission unit for transmitting the voice data to a local device when the user terminal fails to control home devices via the Internet based on the voice data.

[0010] According to a fourth aspect of the embodiments of this application, a local device is provided, the local device comprising: a receiving unit that receives voice data sent by a user terminal in the event that the control of home appliances via the Internet based on voice data fails; and a control unit that controls the home appliances locally based on the voice data.

[0011] According to a fifth aspect of the present application, an electronic device is provided, the electronic device comprising: a memory storing a computer program; and a processor executing the computer program to implement the method described in the first aspect of the present application.

[0012] According to a sixth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the method described in the first aspect of the present application.

[0013] According to a seventh aspect of the embodiments of this application, a computer program product is provided, comprising a computer program, characterized in that, when the computer program is executed by a processor, it implements the method described in the first aspect of the embodiments of this application.

[0014] One of the beneficial effects of the embodiments of this application is that:

[0015] When a user terminal cannot control home appliances via the internet, the user terminal can transmit voice data to a local device and control the home appliances through the local device. This avoids situations where users cannot control home appliances through the user terminal, ensures the normal use of voice control functions, and improves the user experience.

[0016] Furthermore, the first local device receives and recognizes the voice data, generates a first control command, and controls the home appliances according to the first control command. Thus, multiple home appliances can be controlled through a single local device, reducing costs and making it more convenient to control home appliances.

[0017] Furthermore, the second local device receives and recognizes the voice data, generates a second control command, and sends the second control command to the third local device. The third local device controls the home appliances according to the second control command. Thus, the existing home control system can be fully utilized. For example, by adding a second local device with voice recognition function to the existing home control system, local voice control of home appliances can be realized without replacing or updating the central control device, thereby improving the flexibility and compatibility of the home system.

[0018] Furthermore, user terminals control home appliances via the internet, while local devices control them via local connections. This allows users to control home appliances even when they cannot connect to the internet, thus improving the user experience.

[0019] For example, even if there are multiple gateway devices, such as a main gateway and a secondary gateway, the connection can be switched to the secondary gateway if the main gateway fails. However, since both paths rely on the network, online voice control cannot be reliably completed even when the network is in poor condition or fails. In this embodiment, when the user terminal cannot connect to the Internet, the control of the furniture is switched to the local device. The two control paths have fewer common parts and a lower probability of failure, thus enabling smooth voice control using the local device and improving the user experience.

[0020] Furthermore, if the user terminal fails to control the home appliances via the network based on the voice data, it may fail to do so in at least one of the following ways: failing to upload the voice data to the server, failing to obtain control commands from the server, or failing to control the home appliances based on the control commands. This ensures that the user can control the home appliances via the voice control function of the user terminal in various scenarios that may lead to the failure of controlling the home appliances via the user terminal, thus guaranteeing the normal use of the user terminal's voice-based control.

[0021] Furthermore, the user terminal sends the voice data to the local device via short-range communication. Thus, even when the user terminal cannot connect to the Internet, it can still send out voice data and convert it into control commands, thereby successfully controlling the home appliances.

[0022] Furthermore, after controlling the home appliances, the system notifies the user that control of the home appliances is complete. This allows the user to be promptly informed that control of the home appliances has been completed, further enhancing the user experience.

[0023] Furthermore, after completing the control of the home appliances, the system notifies the user that the user terminal has failed to control the home appliances via the Internet. This allows the user to easily know that the online voice control mode has malfunctioned, and also to learn the cause of the malfunction, facilitating further repair or self-repair, thus further improving the user experience.

[0024] Furthermore, by determining the local device for sending the notification based on the user's current location, notifications can be sent to the user flexibly, improving the user experience.

[0025] Specific embodiments of this application are disclosed in detail with reference to the following description and accompanying drawings, indicating how the principles of this application can be adopted. It should be understood that the embodiments of this application are not limited in scope. Within the spirit and scope of the appended claims, embodiments of this application include many changes, modifications, and equivalents.

[0026] The feature information described and illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, combined with feature information in other embodiments, or substituted for feature information in other embodiments.

[0027] It should be emphasized that the term "including / comprises" as used herein refers to the presence of a feature, whole, step, or component, but does not exclude the presence or addition of one or more other features, wholes, steps, or components. Attached Figure Description

[0028] Many aspects of this application can be better understood by referring to the following accompanying drawings. The components in the drawings are not drawn to scale, but are only intended to illustrate the principles of this application. Corresponding portions in the drawings may be enlarged or reduced for ease of illustration and description of certain parts of this application. Elements and features described in one drawing or embodiment of this application may be combined with elements and features shown in one or more other drawings or embodiments. Furthermore, similar reference numerals in the drawings denote corresponding components in several drawings and can be used to indicate corresponding components used in more than one embodiment.

[0029] In the attached diagram:

[0030] Figure 1This is a schematic diagram of the control method for home appliances according to Embodiment 1 of this application;

[0031] Figure 2 This is a schematic diagram of a smart home system to which the home device control method of Embodiment 1 of this application is applied;

[0032] Figure 3 This is a flowchart of one embodiment of the control method for home appliances according to Embodiment 1 of this application;

[0033] Figure 4 This is a schematic diagram of the smart home system according to Embodiment 2 of this application;

[0034] Figure 5 This is a schematic diagram of a user terminal according to Embodiment 3 of this application;

[0035] Figure 6 This is a schematic diagram of a local device according to Embodiment 4 of this application;

[0036] Figure 7 This is a schematic block diagram of the system configuration of the electronic device of Embodiment 5 of this application. Detailed Implementation

[0037] The preferred embodiments of this application will now be described with reference to the accompanying drawings.

[0038] Example 1

[0039] Embodiment 1 of this application provides a method for controlling home appliances.

[0040] Figure 1 This is a schematic diagram of a control method for a home appliance according to Embodiment 1 of this application. Figure 1 As shown, the method includes:

[0041] Step 101: The user terminal acquires the user's voice data;

[0042] Step 102: If the user terminal fails to control home appliances via the internet based on voice data, the user terminal sends the voice data to the local device; and

[0043] Step 103: The local device controls home appliances locally based on the voice data.

[0044] In this way, when the user terminal cannot control home appliances via voice through the Internet, the user terminal can transmit voice data to the local device and control the home appliances through the local device. This avoids situations where users cannot control home appliances through the user terminal, ensures the normal use of the voice control function, and improves the user experience.

[0045] In this embodiment, the local device has a voice control function, and its voice control modes include a network (online) control mode and a local control mode.

[0046] For example, a local device can be a centralized controller. The network (online) control mode of the centralized controller refers to the following: the centralized controller sends the collected voice data to the server through a router. The server parses the voice data and generates control commands. The centralized controller then controls the home appliances according to these control commands. In other words, the centralized controller controls the home appliances online via the Internet or other networks using voice control.

[0047] For example, the local control mode of a centralized controller refers to the centralized controller parsing the collected voice data locally to generate control commands, and then controlling home appliances according to the control commands. In other words, the centralized controller controls home appliances locally via voice control.

[0048] In this embodiment, at least one home appliance is controlled by voice through the user terminal. The user terminal may be, for example, a user's smartphone, smart wearable device, or other terminal device with voice functionality.

[0049] For example, when using a user terminal for voice control, open the application (APP) installed on the user terminal, enter the relevant control page, and enable the voice control function, such as by clicking the voice icon on the control page.

[0050] In some embodiments, home appliances may be smart home appliances, such as at least one of air handling equipment, smart speakers, smart display devices, smart switches, smart curtains, smart lighting devices, sensors, valve assemblies, and smart pet devices.

[0051] In some embodiments, at least one air handling unit acts on the indoor space in the target space.

[0052] For example, at least one air handling device is provided in the target space, such as an indoor air conditioning unit installed in the indoor space. In some embodiments, indoor units are installed in each indoor space within the target space, or in a portion of the indoor spaces within the target space.

[0053] For example, air handling units can be associated with indoor spaces within a target space. This can be achieved by using the binding information of the air handling units to determine the correspondence between them and the indoor spaces. Alternatively, the correspondence between each air handling unit and an indoor space can be obtained through custom naming of local devices (such as wired controllers).

[0054] In some embodiments, the air handling unit may not be installed in the target space's interior space, but it may still affect the target space's interior space. For example, a fresh air unit with its main unit installed above the ceiling.

[0055] In some embodiments, the air handling equipment includes at least one of an indoor unit, a humidifier, a dehumidifier, a fresh air system, and a floor heating system.

[0056] In addition, air handling equipment can also be called air conditioning equipment.

[0057] In some embodiments, the indoor unit is an indoor unit in an air handling system that includes air handling equipment, and the air handling system may include a commercial air conditioning system or a residential air conditioning system.

[0058] In some embodiments, an air conditioning system may include at least one set of outdoor units and at least one indoor unit connected to each set of outdoor units. That is, an air conditioning system may include one or more sets of outdoor units, each set of outdoor units including at least one outdoor unit; for each set of outdoor units, the set of outdoor units is connected to at least one indoor unit.

[0059] For example, an air conditioning system includes an outdoor unit and an indoor unit connected to the outdoor unit.

[0060] For example, an air conditioning system includes an outdoor unit and at least two indoor units connected to the outdoor unit.

[0061] For example, an air conditioning system includes at least two outdoor units and at least two indoor units connected to the at least two outdoor units.

[0062] For example, a group of outdoor units and at least one indoor unit connected to the group of outdoor units constitute a refrigerant system, or multiple groups of outdoor units and at least one indoor unit connected to the multiple groups of outdoor units respectively constitute multiple refrigerant systems. Thus, an air conditioning system may include one refrigerant system or multiple refrigerant systems.

[0063] In some embodiments, the outdoor unit and the indoor unit can be air conditioning equipment of various models, types, forms, and capacities. For example, the indoor unit can be in the form of four-sided air outlet, two-sided air outlet, duct unit, floor air outlet, or skirting board air outlet, etc.; the outdoor unit can be in the form of single fan top air outlet, dual fan top air outlet, single fan front air outlet, or dual fan front air outlet, etc.

[0064] In some embodiments, the fresh air equipment includes at least one of a fresh air handling device, a total heat exchange device (e.g., with or without internal circulation function), and a ventilation device (e.g., with or without internal circulation function).

[0065] In some embodiments, at least one of the humidifying device and the dehumidifying device is disposed on the output side of the fresh air device to humidify or dehumidify the air output by the fresh air device, for example, to humidify or dehumidify the air output by the fresh air device, and to introduce the humidified or dehumidified air into the indoor space. For example, at least one of the humidifying device and the dehumidifying device has a heat exchanger that can operate as an evaporator.

[0066] In some embodiments, the underfloor heating system is connected to the outdoor unit via refrigerant piping, and to the indoor underfloor heating radiator piping via underfloor heating water piping. For example, the outdoor unit and the underfloor heating system form an air-source heat pump water heater, utilizing heat from the air and the operation of the compressor to heat water. The underfloor heating system may include a water-heat exchange unit, where refrigerant from the outdoor unit's compressor enters the unit via refrigerant piping to exchange heat with the water, thereby heating the water. The heated water is then introduced into the indoor underfloor heating radiator piping via the underfloor heating water piping to provide heating for the indoor space. In some embodiments, the outdoor unit and the underfloor heating system are separate units, or they are integrated.

[0067] In some embodiments, the valve assembly includes at least one of an air valve and a floor heating valve.

[0068] In some embodiments, the air valve for controlling the air volume of the indoor space is, for example, an air valve for controlling the amount of air supplied to the indoor space by the air supply device. For example, when the external circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the outdoor air introduced into the indoor space; when the internal circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the indoor air introduced into the indoor space.

[0069] In some embodiments, the floor heating valve is used to control the opening and closing of the inlet and outlet pipes in the floor heating system.

[0070] To facilitate a detailed description of the control method in the embodiments of this application, an exemplary description of a smart home system to which this control method is applied is provided below. However, the control method in the embodiments of this application is not limited to systems with the following structures; it can also be applied to other systems.

[0071] In this application embodiment, the home appliances and home systems are not only applicable to home scenarios, such as residences and apartments, but also to commercial or public scenarios such as office buildings, shopping malls, schools, and factories. This application embodiment does not limit the application scenarios of home appliances and home systems.

[0072] Figure 2This is a schematic diagram of a smart home system to which the home appliance control method of Embodiment 1 of this application is applied. Figure 2 As shown, the smart home system 100 includes one or more home devices 110, user terminals 120, central controllers 131, gateway devices 132, routers 140, the Internet 150, and first servers 161, second servers 162, etc.

[0073] In some embodiments, home appliance 110 may be a smart home appliance, for example, home appliances include at least one of air handling equipment, smart devices, sensors, and valve assemblies. The air handling equipment includes at least one of indoor unit, humidifier, dehumidifier, fresh air system, and underfloor heating system.

[0074] For example, smart devices include at least one of smart speakers, smart display devices, smart switches, smart curtains, smart lighting devices, and smart pet devices.

[0075] In some embodiments, such as Figure 2 As shown, the home appliances 111 to 115 are centrally controlled by the central controller 131 or the gateway device 132.

[0076] For example, the central controller 131 is a central controller with a display screen. In addition, the central controller 131 can also have voice control function, so it is also called a voice central controller.

[0077] For example, gateway device 132 is an intelligent gateway with centralized control functions.

[0078] In some embodiments, home appliance 110 can connect to and communicate with central controller 131 or gateway device 132 in various ways.

[0079] To distinguish between different connection or communication methods, such as Figure 2 As shown, the home appliance 110 includes multiple sets of home appliances 110-1, 110-2, 110-3, 110-4, and 110-5.

[0080] In some embodiments, home appliance 110-1 is connected to central controller 131 and gateway device 132 via wired connection. For example, home appliance 110-1 includes at least one of an outdoor air conditioner unit, an indoor air conditioner unit, a fresh air system, and a floor heating system. In addition, the indoor air conditioner unit can be connected to an air quality sensor and a wired controller, and the floor heating system can be connected to the wired controller.

[0081] In some embodiments, home device 110-2 is connected to voice central controller 131 and gateway device 132 via Wi-Fi. For example, home device 110-2 includes at least one of a home wall-mounted air conditioner, a wall-mounted / cabinet-style display unit, a humidification unit, a dehumidification unit, a smart pet device (e.g., a watchdog unit), and a sleep sensor.

[0082] In some embodiments, home device 110-3 is connected to voice central controller 131 via Bluetooth or Zigbee. For example, home device 110-3 includes at least one of smart curtains (e.g., motorized curtains, roller blinds) and smart lighting devices (e.g., dimmer lights).

[0083] In some embodiments, home appliances 110-4 are connected to a central controller 131 via a wired connection. For example, home appliances 110-4 include at least one of smart curtains (e.g., motorized curtains, roller blinds), smart lighting devices (e.g., ceiling lights), and floor heating valves.

[0084] In some embodiments, home device 110-5 is connected to router 140 via Wi-Fi, and thus connected to gateway device 132 via router 140. For example, home device 110-5 is an indoor air sensor.

[0085] In some embodiments, the home appliance may also include Figure 2 Devices not shown, such as smart speakers, smart TVs, etc., can be connected wirelessly or wired to at least one of the voice central controller 131 and gateway device 132.

[0086] In some embodiments, the control modes for home appliances include voice control modes and non-voice control modes (e.g., user-operated control modes).

[0087] In some embodiments, the voice control modes include an online voice control mode via the Internet and a local voice control mode implemented locally.

[0088] For example, in an online voice control mode via the internet, user terminal 120 collects voice data and sends it to first server 161 via router 140 and internet 150. First server 161 recognizes the voice data (e.g., through large-scale model recognition) to obtain corresponding text data, and sends the text data to second server 162. Second server 162 generates corresponding control commands based on the text data and sends them to gateway device 132 via internet 150 and router 140. Gateway device 132 then controls the relevant home appliances according to the control commands. However, this application is not limited to this. For example, the second server can also recognize the voice data to obtain text data, and the first server can generate control commands based on the text data.

[0089] In addition, the functions of the first server 161 and the second server 162 can also be performed by a single server, and this application embodiment does not limit this.

[0090] Alternatively, in the online voice control mode via the internet, the central controller 131 can collect voice data, transmit it through the router 140, and then via the internet 150 to the first server 161. The subsequent processing is similar to the process described above. Thus, the central controller 131 enables control of home appliances in the online voice control mode.

[0091] For example, in local voice control mode, voice data can be acquired by a local device to control home appliances 110, i.e., control can be performed without the internet. For example, the central controller 131 collects voice data, recognizes the voice device, obtains corresponding text data, generates corresponding control commands based on the text data, and then controls the relevant home appliances according to the control commands.

[0092] In the control method described in the embodiments of this application, if the user terminal fails to control the home appliances via the Internet based on voice data, that is, if the control fails when using the online voice control mode via the user terminal, the user terminal sends the voice data to the local device, and the local device controls the home appliances locally based on the voice data.

[0093] In this way, the user terminal controls home appliances via the Internet, and the local device controls home appliances via a local connection. Thus, even when the user terminal cannot connect to the Internet, the furniture and appliances can still be controlled using the local device, improving the user experience.

[0094] For example, even if there are multiple gateway devices, such as a main gateway and a secondary gateway, the connection can be switched to the secondary gateway if the main gateway fails. However, since both paths rely on the network, online voice control cannot be reliably completed even when the network is in poor condition or fails. In this embodiment, when the user terminal cannot connect to the Internet, the control of the furniture is switched to the local device. The two control paths have fewer common parts and a lower probability of failure, thus enabling smooth voice control using the local device and improving the user experience.

[0095] The control method will now be explained in detail, taking into account the system structure described above.

[0096] In step 101, the user terminal 120 acquires the user's voice data. For example, after the user enables the voice control function in the relevant APP running on the user terminal 120, voice monitoring is started, and the monitored voice data is acquired.

[0097] In some embodiments, the scope of the activated voice monitoring is the target space. Voice monitoring is activated after user confirmation before proceeding with voice monitoring of the target space.

[0098] For example, users can confirm or set the voice monitoring and voice control functions within the app on user terminal 120. Additionally, users can set the range for voice monitoring within the app.

[0099] In some embodiments, the target space is all the spaces of a place, such as the various rooms in a home, including the living room, bedroom, kitchen, bathroom, etc.

[0100] In some embodiments, the target space may also be a portion of a place, such as a specific space set by the user, like a room where the user spends a significant amount of time each day; or, the target space may also be a space occupied, such as a room where occupants are detected by a human body sensor. In some embodiments, the voice data may be in audio format, such as voice commands like "turn on the air conditioner," "turn off the television," "raise the temperature to 28 degrees," or "lower the humidity to 40%," but this application is not limited to these.

[0101] In step 102, if the user terminal fails to control the home appliances via the Internet based on voice data, the user terminal sends the voice data to the local device.

[0102] In some embodiments, the local device has at least one of voice recognition and centralized control functions.

[0103] For example, local devices include at least one of a smart gateway, a controller, an indoor air conditioning unit, a smart speaker, and a smart display device.

[0104] For example, the controller includes at least one of a central controller, a wired controller, and a remote controller, wherein the central controller and the wired controller are also known as fixed controllers, which are fixedly installed on the wall of an indoor space.

[0105] In some embodiments, the central controllers are respectively set in each space and can control the home appliances in the space where the central controller is located. For example, a first central controller is set in the living room, a second central controller is set in the bedroom, and a third central controller is set in the kitchen. The first central controller can control the home appliances in the living room, the second central controller can control the home appliances in the bedroom, and the third central controller can control the home appliances in the kitchen.

[0106] In some embodiments, the central controllers are respectively set in each space and can control the home appliances in all spaces. For example, a first central controller is set in the living room, a second central controller is set in the bedroom, and a third central controller is set in the kitchen. The first, second, and third central controllers can all control all home appliances in the living room, bedroom, and kitchen.

[0107] In some embodiments, a centralized controller is installed in only one specific space and can control home appliances in all spaces. Additionally, wired controllers can be installed in other spaces outside the specific space to control home appliances in their respective spaces. For example, a centralized controller can be installed in the living room to control all home appliances in the living room, bedrooms, and kitchen; wired controllers can be installed in the bedrooms and kitchen to control home appliances in those spaces respectively.

[0108] For example, local devices include Figure 2 The central controller 131, gateway device 132, indoor unit with voice function in home device 110-1, wall-mounted / cabinet-type display component in home device 110-2, and at least one of the following: smart speaker and smart TV (not shown).

[0109] For example, in the online voice control mode described above, there is a situation where the user terminal 120 controls the home appliance 110 based on voice data and through the Internet, meaning that the user fails to control the home appliance 110 through the user terminal 120.

[0110] In some embodiments, the failure of the user terminal 120 to control the home device 110 via the Internet 150 based on voice data includes at least one of the following: inability to upload voice data to the server, inability to obtain control instructions from the server, and inability to control the home device according to the control instructions.

[0111] In some embodiments, the user terminal 120 may determine whether a fault has occurred and the cause of the fault based on whether the user terminal 120 receives the corresponding information.

[0112] For example, if user terminal 120 does not receive a response from server 160 after sending out voice data, it can be determined that a fault has occurred: "unable to upload voice data to server".

[0113] For example, after sending out voice data, user terminal 120 receives a response message from server 160 indicating that the voice data has been received, but does not receive any control commands from server 160. In this case, it can be determined that a fault has occurred: "Unable to obtain control commands from the server".

[0114] For example, after receiving the control command sent by the server 160, the user terminal 120 sends the control command to the controlled home appliance 110, but does not receive any information about the control completion of the home appliance 110. In this case, it can be determined that a fault has occurred: "Unable to control the home appliance according to the control command".

[0115] In some embodiments, the inability to upload the voice data to the server includes at least one of the following situations:

[0116] The remote communication function of user terminal 120 is malfunctioning;

[0117] The communication connection between user terminal 120 and router 140 has failed;

[0118] Router 140 is malfunctioning;

[0119] The network connection between router 140 and server 160 has failed.

[0120] Server 160 experienced a failure.

[0121] In some embodiments, control instructions cannot be obtained from the server, including at least one of the following:

[0122] Server 160 has malfunctioned;

[0123] The network connection between router 140 and server 160 has failed.

[0124] Router 140 is malfunctioning;

[0125] The connection between router 140 and gateway device 132 has failed.

[0126] In some embodiments, home appliances cannot be controlled according to control instructions, including at least one of the following:

[0127] Gateway device 132 has malfunctioned;

[0128] The connection between gateway device 132 and home device 110 has failed.

[0129] Therefore, in various scenarios where control of home appliances 110 via user terminal 120 might fail, the system avoids situations where the user cannot control home appliances using the voice control function of the user terminal, ensuring the normal use of voice-based control by user terminal 120. Thus, if control of home appliances 110 via Internet 150 by user terminal 120 based on voice data fails, user terminal 120, after acquiring the user's voice data, sends the voice data to a local device. The local device then controls home appliances 110 locally based on this voice data.

[0130] In some embodiments, a local device (referred to as the first local device) that has both voice recognition and centralized control functions is provided locally, such as a centralized controller 131 with voice recognition function.

[0131] In this case, if the user terminal 120 cannot control the home appliance 110 via the Internet 150, the user terminal 120 will send the received voice data to the first local device (e.g., a centralized controller 131 with voice recognition function). The first local device will recognize the voice data, generate a first control command, and control the home appliance 110 according to the first control command.

[0132] In this scenario, the first local device simultaneously possesses voice recognition and centralized control capabilities. Therefore, multiple home appliances 110 can be controlled through a single local device, reducing costs and providing more convenient control over the home appliances 110.

[0133] Alternatively, in some embodiments, there is no local device that simultaneously possesses both voice recognition and centralized control functions. Instead, a second local device with voice recognition and a third local device with centralized control functions are provided. For example, the second local device is a smart speaker with voice recognition, and the third local device is a centralized controller 131 or a gateway device 132 without voice recognition.

[0134] In this scenario, if the user terminal 120 is unable to control the home appliance 110 via the Internet 150, the user terminal 120 sends the received voice data to a second local device. The second local device recognizes the voice data, generates a second control command, and sends the second control command to a third local device (e.g., a centralized controller 131 or gateway device 132 that does not have voice recognition functionality). The third local device then controls the home appliance 110 according to the second control command.

[0135] In this scenario, the second local device has voice recognition capabilities but lacks centralized control functionality, while the third local device has centralized control functionality but lacks voice recognition capabilities. Therefore, existing home control systems can be fully utilized. For example, by adding a second local device with voice recognition capabilities to an existing home control system, local voice control of home devices 110 can be achieved without replacing or updating the centralized control equipment, thus improving the flexibility and compatibility of the home system.

[0136] Alternatively, in some embodiments, the second local device communicating with the user terminal 120 does not have voice recognition functionality, the third local device does have voice recognition functionality (e.g., a built-in SDK module), and the fourth local device has centralized control functionality. When the user terminal 120 cannot control the home appliance 110 via the Internet 150, the user terminal 120 sends the received voice data to the second local device, the second local device sends the voice data to the third local device, the third local device recognizes the voice data, generates a second control command, and sends the second control command to the fourth local device (e.g., a centralized controller 131 or gateway device 132 without voice recognition functionality). The fourth local device then controls the home appliance 110 according to the second control command. In other words, the local device receiving the voice data (e.g., the second local device) and the local device recognizing the voice data (e.g., the third local device) can be different local devices.

[0137] In addition, in some embodiments, a local device may have at least one function of acquiring audio signals of speech and playing audio signals. For example, the local device may have at least one of a microphone and a speaker, but the local device may not have a speech recognition function, while another local device may have a speech recognition function (e.g., a built-in SDK module), which can receive audio signals from the aforementioned local device that acquires speech and convert them into control commands, and may also send audio signals that need to be played to the aforementioned local device for playback.

[0138] In some embodiments, the user terminal 120 controls the home appliance 110 via the Internet. The home appliance 110 is connected to a local device via a local connection, for example, the local device controls the home appliance 110 via a local connection. Thus, even when the Internet 150 is unavailable, the user can still control the home appliance 110 through the user terminal 120 and the local device, further improving the effectiveness and efficiency of controlling the home appliance 110 and enhancing the user experience.

[0139] In some embodiments, the user terminal 120 connects to the local device via short-range communication.

[0140] For example, short-range communication includes at least one of Wi-Fi, Bluetooth, Zigbee, infrared, NFC, and ultra-wideband communication.

[0141] Therefore, even when the user terminal 120 cannot connect to the Internet 150, voice data can still be sent out, and then the voice data can be converted into control commands, thus successfully controlling the home appliances.

[0142] In some embodiments, such as Figure 1 As shown, the control method may further include:

[0143] Step 104: After completing the control of the home appliance, notify the user of a message indicating that the control of the home appliance has been completed.

[0144] For example, after the central controller 131, acting as a local device, completes control of the air conditioner in the home appliance 110, it sends a message indicating that control is complete to the user terminal 120, and the user terminal 120 notifies the user of this information. For example, the user terminal 120 displays text such as "Control of the air conditioner has been completed" on the application's interface, or the user terminal 120 informs the user via voice broadcast, such as broadcasting "Control of the air conditioner has been completed."

[0145] For example, after the central controller 131, acting as a local device, completes control of the air conditioner in the home appliance 110, the central controller 131 notifies the user of a message indicating that control is complete. For example, the central controller 131 displays text such as "Control of the air conditioner has been completed" on the display screen. Alternatively, the central controller 131 may have a voice broadcast function, informing the user via voice broadcast, for example, the local device broadcasting a message such as "Control of the air conditioner has been completed".

[0146] This allows users to know immediately that control of home appliances has been completed, further enhancing the user experience.

[0147] In some embodiments, such as Figure 1 As shown, the control method also includes:

[0148] Step 105: After completing the control of the home appliance, notify the user that the user terminal has failed to control the home appliance via the Internet.

[0149] For example, user terminal 120 can display or announce messages such as "Failed to control air conditioner via Internet via mobile phone".

[0150] In some embodiments, such as Figure 1 As shown, the control method also includes:

[0151] Step 106: Notify the user of the reason for the failure.

[0152] For example, user terminal 120 can display or announce messages such as "Server malfunction".

[0153] This allows users to easily identify when the online voice control mode malfunctions, and further understand the cause of the malfunction, facilitating subsequent repair requests or self-repair, thus further enhancing the user experience.

[0154] Furthermore, steps 104 to 106 are optional steps. Figure 1 The dashed boxes indicate the locations. The home appliance control method of this application embodiment may include one or more of steps 104 to 106, and the order of steps 104, 105, and 106 may be arbitrarily changed. Alternatively, the control method may not include steps 104 to 106.

[0155] In some embodiments, the local device used to send the notification is determined based on the user's current location.

[0156] For example, the user's current location can be determined using sensors such as proximity sensors, sound sensors, and human perception sensors, or the positioning function of the user terminal 120. Based on the user's current location, the nearest local device can be determined and used to complete the notification. For example, proximity sensors, sound sensors, and human perception sensors can be installed in home appliances 110, central controllers 131, gateway devices 132, etc., or in any space or device indoors.

[0157] For example, after a user inputs voice data into user terminal 120 in the living room, they move to the bedroom. After controlling the corresponding home appliances, and determining that the user is currently in the bedroom, the local device in the bedroom (such as a central controller on the bedroom wall) sends a notification to the user indicating that control was completed or that control via the internet failed.

[0158] This allows for reliable notifications to users, improving the user experience.

[0159] In addition, in some embodiments, the local device that notifies the user may be at least one of the local device that controls the home appliances and the local device that performs voice recognition, or it may be other local devices besides the local device that controls the home appliances and the local device that performs voice recognition, such as a smart speaker, a smart screen, a smart TV, etc.

[0160] This allows for flexible notifications to users, improving the user experience.

[0161] Figure 3 This is a flowchart illustrating one implementation of the control method for home appliances according to Embodiment 1 of this application. Figure 3 As shown, the method includes:

[0162] Step 301: User terminal 120 acquires the user's voice data;

[0163] Step 302: Determine if the online voice control mode via the Internet 150 is normal; if the result is "yes", proceed to step 303; if the result is "no", proceed to step 309.

[0164] For example, specific judgment methods may include at least one of the following methods: judging whether the remote communication function of user terminal 120 is normal, such as whether there is an overdue payment; judging whether the communication between user terminal 120 and router 140 is normal; judging whether router 140 has malfunctioned; judging whether the communication between router 140 and server (e.g., first server 161) is normal; judging whether the server (e.g., first server 161) has malfunctioned, such as being unable to log in to the server or being unable to obtain response information from the server; judging whether the communication between router 140 and gateway device 132 is normal, etc.

[0165] Step 303: User terminal 120 sends the voice data to the first server 161;

[0166] For example, user terminal 120 sends the voice data to router 140, and router 140 sends the voice data to first server 161 via Internet 150. Alternatively, user terminal 120 connects to the Internet via its own remote communication network (such as a 5G network) and sends the voice data to first server 161 via the Internet.

[0167] Step 304: The first server 161 recognizes the voice data, obtains the corresponding text data, and sends the text data to the second server 162; for example, the text data includes "raise the temperature by 1 degree" and "turn on the fresh air".

[0168] Step 305: The second server 162 generates corresponding control instructions based on the text data and sends them to the gateway device 132 via the Internet 150 and router 140; for example, the control instructions include: "Raise the target temperature of the indoor unit of the air conditioner by 1 degree" and "Start the fresh air equipment";

[0169] Step 306: The gateway device 132 controls the relevant indoor air conditioning units and fresh air equipment according to the control command;

[0170] Step 307: Gateway device 132 sends control completion information to user terminal 120 through router 140, and user terminal 120 notifies user that control is complete;

[0171] Step 308: The user terminal 120 sends the voice data to the central controller 131;

[0172] Step 309: The central controller 131 recognizes the voice data, obtains the corresponding text data, and generates corresponding control commands based on the text data; for example, the text data includes "increase the temperature by 1 degree" and "turn on the fresh air"; the control commands include: "increase the target temperature of the indoor unit of the air conditioner by 1 degree" and "start the fresh air equipment".

[0173] Step 310: The central controller 131 controls the relevant indoor air conditioning units and fresh air equipment according to the control command;

[0174] Step 311: The central controller 131 sends control completion information to the user terminal 120, and the user terminal 120 notifies the user that control is complete;

[0175] Step 312: User terminal 120 notifies the user of a fault in the online voice control mode and informs them of the cause of the fault.

[0176] As can be seen from the above embodiments, when the user terminal cannot control home appliances via the Internet, the user terminal can transmit voice data to the local device and control the home appliances through the local device. This avoids the situation where the user cannot control the home appliances through the user terminal, ensures the normal use of the voice control function, and improves the user experience.

[0177] Example 2

[0178] Embodiment 2 of this application provides a smart home system, which corresponds to the control method for home devices described in Embodiment 1. Specific implementation can refer to the method described in Embodiment 1; details that are the same or related will not be repeated.

[0179] Figure 4This is a schematic diagram of the smart home system according to Embodiment 2 of this application. Figure 4 As shown, the smart home system 400 includes home devices 401, user terminal 402, and local device 403. User terminal 401 acquires user voice data. If the user terminal 401 fails to control the home devices via the Internet based on the voice data, the user terminal 401 sends the voice data to local device 402. Local device 402 controls the home devices locally based on the voice data.

[0180] In some embodiments, the specific configuration of the smart home system 400 can be as follows: Figure 2 As shown. For example, home device 401 includes at least one of home devices 110 in embodiment 1, user terminal 402 is user terminal 120 in embodiment 1, and local device includes at least one of central controller 131, gateway device 132, indoor unit with voice function in home device 110-1, wall-mounted / cabinet-type display component in home device 110-2, and smart speaker and smart TV (not shown). For example, the local device is central controller 131.

[0181] As can be seen from the above embodiments, when the user terminal cannot control home appliances via voice through the Internet, the user terminal can transmit voice data to the local device and control the home appliances through the local device. This avoids the situation where the user cannot control the home appliances through the user terminal, ensures the normal use of the voice control function, and improves the user experience.

[0182] Example 3

[0183] This application provides a user terminal in embodiment 3, which corresponds to the user terminal in embodiment 1 and embodiment 2. The specific implementation can be referred to the specific content recorded in embodiment 1 and embodiment 2. The same or related contents will not be repeated.

[0184] Figure 5 This is a schematic diagram of a user terminal according to Embodiment 3 of this application. Figure 5 As shown, the user terminal 500 includes an acquisition unit 501 and a transmission unit 502. For example, the user terminal 500 is the user terminal 120 in Embodiment 1 or the user terminal 402 in Embodiment 2.

[0185] The acquisition unit 501 is used to acquire the user's voice data. The voice data can be in the form of audio data. For example, the acquisition unit 501 can collect sound signals in the target space and use the collected sound signals as voice data.

[0186] The sending unit 502 is used to send voice data to a local device when the user terminal fails to control home appliances via the Internet based on voice data.

[0187] For example, if the user terminal 500 controls the home appliances via the Internet based on voice data without failure, the sending unit 502 can also send the voice data to the local device to control the home appliances.

[0188] As can be seen from the above embodiments, when the user terminal cannot control home appliances via voice through the Internet, the user terminal can transmit voice data to the local device and control the home appliances through the local device. This avoids the situation where the user cannot control the home appliances through the user terminal, ensures the normal use of the voice control function, and improves the user experience.

[0189] Example 4

[0190] Embodiment 4 of this application provides a local device, which corresponds to the control method of the home device described in Embodiment 1. The specific implementation can refer to the implementation of the method described in Embodiment 1. The same or related contents will not be repeated.

[0191] Figure 6 This is a schematic diagram of the local device 600 according to Embodiment 4 of this application. Figure 6 As shown, the local device 600 includes a receiving unit 601 and a control unit 602. For example, the local device 600 is the local device in Embodiment 1 or the local device 403 in Embodiment 2.

[0192] The receiving unit 601 is used to receive voice data sent by the user terminal when the control of home appliances via the Internet based on voice data fails.

[0193] The control unit 602 is used to control home appliances locally based on voice data.

[0194] For example, if local device 600 has voice recognition and centralized control functions, then local device 600 generates control commands based on voice data, and control unit 602 controls the home appliances according to these control commands. Alternatively, if local device 600 has centralized control functions but no voice recognition functions, then local device 600 sends the voice data to other devices with voice recognition functions. These other devices generate control commands based on the voice data and send them back to local device 600, and control unit 602 controls the home appliances according to these control commands.

[0195] As can be seen from the above embodiments, when the user terminal cannot control home appliances via voice through the Internet, the user terminal can transmit voice data to the local device and control the home appliances through the local device. This avoids the situation where the user cannot control the home appliances through the user terminal, ensures the normal use of the voice control function, and improves the user experience.

[0196] Example 5

[0197] Embodiment 5 of this application provides an electronic device corresponding to the control method for home appliances described in Embodiment 1. Specific implementation can refer to the method described in Embodiment 1; details that are identical or related will not be repeated.

[0198] Figure 7 This is a schematic block diagram of the system configuration of the electronic device according to Embodiment 5 of this application. Figure 7 As shown, electronic device 700 may include processor 710 and memory 720; memory 720 is coupled to processor 710. It is worth noting that this figure is exemplary; other types of structures may be used to supplement or replace this structure to achieve telecommunications functions or other functions.

[0199] In one embodiment, a processor is provided in both the user terminal and the local device to execute the steps performed by the user terminal and the local device, respectively. That is, the processor 710 includes a first sub-processor and a second sub-processor. For details regarding the user terminal and the local device, please refer to the relevant descriptions in Embodiments 1 to 4.

[0200] In one implementation, the first subprocessor may be configured to: acquire the user's voice data; and, in the event that the user terminal 120 fails to control the home appliance 110 via the Internet 150 based on the voice data, send the voice data to a local device.

[0201] In one implementation, the second subprocessor may be configured to: receive voice data sent by the user terminal 120 in the event that control of the home appliance 110 via the Internet 150 based on voice data fails; and control the home appliance 110 locally based on the voice data.

[0202] like Figure 7 As shown, the electronic device 700 may also include: a communication module 730, an input unit 740, a display 750, a speaker 760, a microphone 770, and a power supply 780. It is worth noting that the electronic device 700 does not necessarily need to include these components. Figure 7 All components shown; in addition, the electronic device 700 may also include Figure 7 For components not shown, please refer to relevant technologies.

[0203] like Figure 7 As shown, the processor 710, sometimes also referred to as a controller or operation control, may include a microprocessor or other processor device and / or logic device, which receives inputs and controls the operation of various components of the electronic device 700.

[0204] The memory 720 may be, for example, one or more of a cache, flash memory, hard drive, removable media, volatile memory, non-volatile memory, or other suitable means. It can store various types of data and, in addition, programs for executing related information. The processor 710 can execute the program stored in the memory 720 to perform information storage or processing, etc. The functions of other components are similar to those in existing systems and will not be described further here. The components of the electronic device 700 can be implemented using dedicated hardware, firmware, software, or a combination thereof without departing from the scope of this application.

[0205] As can be seen from the above embodiments, when the user terminal cannot control home appliances via voice through the Internet, the user terminal can transmit voice data to the local device and control the home appliances through the local device. This avoids the situation where the user cannot control the home appliances through the user terminal, ensures the normal use of the voice control function, and improves the user experience.

[0206] This application also provides a computer-readable program, wherein when the program is executed in an electronic device, the program causes the computer to perform the home appliance control method described in Embodiment 1 in the electronic device.

[0207] This application also provides a storage medium storing a computer-readable program, wherein the computer-readable program causes a computer to execute the control method of the home appliance described in Embodiment 1 in an electronic device.

[0208] The apparatus and methods described above in the embodiments of this application can be implemented in hardware or in combination with software. This application relates to a computer-readable program that, when executed by a logic component, enables the logic component to implement the apparatus or constituent parts described above, or to implement the various methods or steps described above.

[0209] This application also relates to storage media for storing the above programs, such as hard disks, magnetic disks, optical disks, DVDs, flash memory, etc.

[0210] The present application has been described above with reference to specific embodiments. However, those skilled in the art should understand that these descriptions are exemplary and not intended to limit the scope of protection of the present application. Those skilled in the art can make various modifications and variations to the present application based on its spirit and principles, and these modifications and variations are also within the scope of the present application.

Claims

1. A method for controlling home appliances, characterized in that, The method includes: User terminals acquire user voice data; In the event that the user terminal fails to control the home appliances via the internet based on the voice data, the user terminal will send the voice data to a local device; and The local device controls the home appliances locally based on the voice data.

2. The method according to claim 1, characterized in that, The local device controls the home appliances locally based on the voice data, including: A first local device receives and recognizes the voice data, generates a first control command, and controls the home appliances according to the first control command; or, The second local device receives the voice data and recognizes the voice data, generates a second control command, and sends the second control command to the third local device, which controls the home appliances according to the second control command.

3. The method according to claim 1, characterized in that, The user terminal controls home appliances via the Internet. The local device controls home appliances via a local connection.

4. The method according to claim 1, characterized in that, The user terminal fails to control the home appliances via the network based on the voice data, including at least one of the following: inability to upload the voice data to the server, inability to obtain control commands from the server, and inability to control the home appliances according to the control commands.

5. The method according to claim 4, characterized in that, The inability to upload the voice data to the server includes at least one of the following situations: The remote communication function of the user terminal is malfunctioning; The communication connection between the user terminal and the router failed. The router malfunctioned; The network connection between the router and the server failed. The server malfunctioned; The inability to obtain control commands from the server includes at least one of the following situations: The server malfunctioned; The network connection between the router and the server failed. The router malfunctioned; The connection between the router and the gateway device failed. The inability to control home appliances according to control commands includes at least one of the following situations: The gateway device malfunctioned; The connection between the gateway device and the home appliances failed.

6. The method according to claim 1, characterized in that, The user terminal sends the voice data to the local device, including: The user terminal sends the voice data to the local device via short-range communication.

7. The method according to claim 1, characterized in that, The method further includes: After completing the control of the home appliances, the user is notified that the control of the home appliances has been completed.

8. The method according to claim 7, characterized in that, Notify the user of information indicating that control of the home device is complete, including: The local device sends a control completion message to the user terminal, which then displays or verbally announces the control completion message; or... The local device displays or announces via voice that the control has been completed.

9. The method according to claim 1, characterized in that, The method further includes: After completing control of the home appliances, the user is notified that the user terminal has failed to control the home appliances via the Internet.

10. The method according to claim 9, characterized in that, The method further includes: The user is notified of the reason for the failure.

11. The method according to any one of claims 7-9, characterized in that, The method further includes: The local device used to send the notification is determined based on the user's current location.

12. The method according to any one of claims 1-10, characterized in that, The local device includes at least one of a controller, an indoor air conditioning unit, and a smart device. The controller includes at least one of a central controller, a wired controller, and a remote controller.

13. The method according to any one of claims 1-10, characterized in that, The home appliances include at least one of air handling equipment, smart devices, sensors, and valve assemblies.

14. A smart home system, the smart home system comprising home appliances, user terminals, and local devices, characterized in that, The user terminal acquires the user's voice data; In the event that the user terminal fails to control the home appliances via the internet based on the voice data, the user terminal will send the voice data to the local device; and The local device controls the home appliances locally based on the voice data.

15. A user terminal, characterized in that, The user terminal includes: The acquisition unit acquires the user's voice data; and The transmitting unit transmits the voice data to a local device when the user terminal fails to control the home appliances via the Internet based on the voice data.

16. A local device, characterized in that, The local device includes: A receiving unit that receives voice data sent by a user terminal in the event that control of home appliances via the Internet based on voice data fails; and A control unit that controls the home appliances locally based on the voice data.

17. An electronic device, characterized in that, The electronic device includes: Memory, which stores computer programs; and A processor that, when executing the computer program, implements the method described in any one of claims 1-13.

18. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1-13.

19. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1-13.

Images