Control method and control apparatus for home device, and smart home system
By switching between online and local voice modes, the problem of users being unable to control home appliances by voice when the internet connection is down or the server is malfunctioning is solved, achieving a more efficient and intelligent voice control experience.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- DAIKIN INDUSTRIES LTD
- Filing Date
- 2025-10-10
- Publication Date
- 2026-04-23
AI Technical Summary
In existing technologies, users cannot use voice control to control home appliances when local devices cannot connect to the internet or when servers malfunction, resulting in a degraded user experience.
A method for controlling home appliances is provided, which ensures that the system automatically switches to another mode when one mode is unavailable by switching between online voice mode and local voice mode, thereby achieving flexibility and reliability of voice control.
It improves the intelligence and applicability of voice control, avoids situations where users cannot control home appliances by voice, and enhances user experience and control efficiency.
Smart Images

Figure IB2025060290_23042026_PF_FP_ABST
Abstract
Description
Home appliance control methods, control devices, and smart home systems
[0001] This application relates to the environmental field, and in particular to a method, device, and smart home system for controlling home appliances.
[0002] With the development of science and technology and urban construction, voice recognition technology is gradually being applied to all aspects of people's lives. For example, in places such as office buildings, apartments, schools, and shopping malls, devices that can be controlled based on voice, such as smart home devices based on voice control, are becoming increasingly popular.
[0003] Currently, in existing technologies for voice-based smart home device control, the local device sends the user's voice commands to a server via the internet. The server then recognizes and parses the voice commands to generate control instructions. The server then sends these control instructions to the local control device via the internet, thus controlling the smart home devices.
[0004] It should be noted that the above introduction to the technical background is only for the purpose of providing a clear and complete explanation of the technical solutions of this application and facilitating understanding by those skilled in the art. It should not be assumed that these technical solutions are known to those skilled in the art simply because they have been described in the background section of this application.
[0005] The inventors discovered that in the prior art, local devices need to control home appliances via the Internet. However, if the local device cannot connect to the Internet or the server malfunctions, users will be unable to control home appliances by voice, thus reducing the user experience.
[0006] To address at least one of the aforementioned problems, embodiments of this application provide a method, device, and smart home system for controlling home devices. The online voice mode and local voice mode for controlling home devices based on voice data can be switched between each other. Therefore, when one voice control mode is unavailable, it can automatically switch to another, preventing situations where users cannot control home devices via voice, ensuring the normal use of voice control functions, improving the effectiveness and efficiency of controlling home devices, enhancing user experience, and increasing the intelligence of voice control due to the automatic switching without user intervention. Furthermore, the ability to flexibly switch voice modes according to different situations improves the applicability of the voice system.
[0007] According to a first aspect of the embodiments of this application, a method for controlling home appliances is provided, the method comprising: acquiring voice data; and controlling the home appliances via an online voice mode based on the voice data, or controlling the home appliances via a local voice mode based on the voice data, wherein the online voice mode and the local voice mode are switchable between each other.
[0008] According to a second aspect of the embodiments of this application, a smart home system is provided, the smart home system including home devices, a first local device and a second local device, wherein the first local device acquires voice data; and the first local device controls the home devices through an online voice mode based on the voice data; or, the second local device controls the home devices through an online voice mode based on the voice data from the first local device; or, the first local device controls the home devices through a local voice mode based on the voice data, wherein the online voice mode and the local voice mode can be switched between each other.
[0009] According to a third aspect of the embodiments of this application, a control device for home appliances is provided. The control device includes: an acquisition unit for acquiring voice data; a control unit for controlling the home appliances via an online voice mode or via a local voice mode based on the voice data; and a switching unit for switching between the online voice mode and the local voice mode.
[0010] According to a fourth aspect of the present application, an electronic device is provided, the electronic device comprising: a memory storing a computer program; and a processor executing the computer program to implement the method described in the first aspect of the present application.
[0011] According to a fifth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the method described in the first aspect of the present application.
[0012] According to a sixth aspect of the embodiments of this application, a computer program product is provided, comprising a computer program, characterized in that, when the computer program is executed by a processor, it implements the method described in the first aspect of the embodiments of this application.
[0013] One of the beneficial effects of the embodiments of this application is that:
[0014] The online voice mode and local voice mode, which control home appliances based on voice data, can switch between each other. This allows for automatic switching to the other voice control mode when one is unavailable, preventing situations where users cannot control home appliances by voice and ensuring the normal operation of the voice control function. This improves the effectiveness and efficiency of controlling home appliances, enhances the user experience, and, because the switching is automatic without user intervention, increases the intelligence of voice control. Furthermore, the ability to flexibly switch voice modes according to different situations improves the applicability of the voice system.
[0015] Furthermore, the online voice mode includes a first online voice mode in which the first local device sends the voice data to the server through a first network, and a second online voice mode in which the second local device sends the voice data to the server through either the first or second network. This allows for flexible switching between online voice modes based on different network types according to network conditions or user needs, maintaining the online voice control mode, fully utilizing the server's advantage in voice parsing, and further improving control effectiveness and user experience.
[0016] Furthermore, in the event of a malfunction in the first online voice mode, the system switches from the first online voice mode to the second online voice mode, or from the first online voice mode to the local voice mode. Thus, in the event of a malfunction in the first online voice mode, multiple voice modes can be switched, thereby preventing situations where users are unable to control home appliances via voice. This further ensures the normal use of the voice control function, improves the effectiveness and efficiency of controlling home appliances, and enhances the user experience.
[0017] Furthermore, in the event of a first type of fault in the first online voice mode, the system switches from the first online voice mode to the second online voice mode; in the event of a second type of fault in the first online voice mode, the system switches from the first online voice mode to the second online voice mode; and in the event of a third type of fault in the first online voice mode, the system switches from the first online voice mode to the local voice mode. Thus, in the event of different faults in the first online voice mode, different voice control modes can be switched, thereby enabling targeted switching of voice modes, further improving the effectiveness and efficiency of controlling home appliances, and enhancing the user experience.
[0018] Furthermore, the first network is the Internet, and the second network is the Internet of Things. Thus, the online voice mode includes two online voice modes based on different types of networks, which can flexibly switch between online voice modes based on different types of networks according to network conditions or user needs, maintain the control mode of online voice, make full use of the advantages of server-side voice parsing, and further improve the control effect and user experience.
[0019] Furthermore, after controlling the home appliances, the system notifies the user that control of the home appliances is complete. This allows the user to be promptly informed that control of the home appliances has been completed, further enhancing the user experience.
[0020] Furthermore, after controlling the home appliances, the system notifies the user that the first online voice mode has malfunctioned. This allows the user to easily learn that the online voice control mode has malfunctioned and to further understand the cause of the malfunction, facilitating further repair requests or self-repair, thus enhancing the user experience.
[0021] Specific embodiments of this application are disclosed in detail with reference to the following description and accompanying drawings, indicating how the principles of this application can be adopted. It should be understood that the embodiments of this application are not limited in scope. Within the spirit and scope of the appended claims, embodiments of this application include many changes, modifications, and equivalents.
[0022] The feature information described and illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, combined with feature information in other embodiments, or substituted for feature information in other embodiments.
[0023] It should be emphasized that the term "including / comprises" as used herein refers to the presence of a feature, whole, step, or component, but does not exclude the presence or addition of one or more other features, wholes, steps, or components.
[0024] Many aspects of this application can be better understood by referring to the following accompanying drawings. The components in the drawings are not drawn to scale, but are only intended to illustrate the principles of this application. Corresponding portions in the drawings may be enlarged or reduced for ease of illustration and description of certain parts of this application. Elements and features described in one drawing or embodiment of this application may be combined with elements and features shown in one or more other drawings or embodiments. Furthermore, similar reference numerals in the drawings denote corresponding components in several drawings and can be used to indicate corresponding components used in more than one embodiment.
[0025] Figure 1 is a schematic diagram of a home appliance control method according to Embodiment 1 of this application;
[0026] Figure 2 is a structural diagram of a smart home system to which the home device control method of Embodiment 1 of this application is applied;
[0027] Figure 3 is a flowchart of one embodiment of the control method for home appliances according to Embodiment 1 of this application;
[0028] Figure 4 is a flowchart of one embodiment of the method for controlling home appliances using a first online voice mode according to Embodiment 1 of this application;
[0029] Figure 5 is a flowchart of one embodiment of the method for controlling home appliances after switching to the second online voice mode according to Embodiment 1 of this application;
[0030] Figure 6 is a flowchart of one embodiment of the method for controlling home appliances after switching to local voice mode according to Embodiment 1 of this application;
[0031] Figure 7 is a schematic diagram of a smart home system according to Embodiment 2 of this application;
[0032] Figure 8 is a schematic diagram of a control device for a home appliance according to Embodiment 3 of this application;
[0033] Figure 9 is a schematic block diagram of the system configuration of the electronic device of Embodiment 4 of this application.
[0034] The preferred embodiments of this application will now be described with reference to the accompanying drawings. Example 1
[0035] Embodiment 1 of this application provides a method for controlling home appliances.
[0036] Figure 1 is a schematic diagram of a control method for a home appliance according to Embodiment 1 of this application. As shown in Figure 1, the method includes:
[0037] Step 101: Obtain the user's voice data; and
[0038] Step 102: Control home appliances via online voice mode or local voice mode based on voice data. The online voice mode and local voice mode can be switched between each other.
[0039] In this way, the online voice mode and the local voice mode, which control home appliances based on voice data, can switch between each other. Therefore, if one voice control mode fails, it can switch to the other, avoiding situations where users cannot control home appliances by voice, ensuring the normal use of the voice control function, improving the effectiveness and efficiency of controlling home appliances, enhancing the user experience, and because the switching is automatic without user intervention, it enhances the intelligence of voice control; in addition, because the voice mode can be flexibly switched according to different situations, the applicability of the voice system is improved.
[0040] In this application embodiment, the home appliances and home systems are not only applicable to home scenarios, such as residences and apartments, but also to commercial or public scenarios such as office buildings, shopping malls, schools, and factories. This application embodiment does not limit the application scenarios of home appliances and home systems.
[0041] In step 101, the user's voice data is acquired.
[0042] In some embodiments, user voice data can be acquired through various local devices with voice acquisition capabilities. Examples include smart speakers, centralized controllers with voice acquisition capabilities, smart screens, and smart TVs.
[0043] In this embodiment, at least one home appliance can be voice-controlled via a local device. This local device is, for example, a device having at least one of the following functions: voice control and centralized control.
[0044] In this application embodiment, multiple local devices can be set up and interconnected, but this application is not limited to this.
[0045] For example, multiple local devices include a first local device and a second local device, with the first local device connected to the second local device via short-range communication or via another device (such as a router).
[0046] For example, short-range communication includes at least one of Wi-Fi, Bluetooth, Zigbee, infrared, NFC, and ultra-wideband communication.
[0047] In step 102, home appliances are controlled either through an online voice mode or a local voice mode based on voice data. The online and local voice modes can be switched between each other. In other words, the voice control modes for controlling home appliances can include both online and local voice modes.
[0048] In this embodiment of the application, the online voice mode refers to the mode in which the local device sends the collected voice data to the server, the server parses the voice data and generates control commands, and the local device controls the home appliances according to the control commands. That is, the voice control mode in which the local device controls the home appliances through the network (external network).
[0049] For example, a local device can be a centralized controller. The centralized controller sends the collected voice data to a server through a router. The server parses the voice data and generates control commands. The centralized controller then controls the home appliances according to these commands. In other words, the centralized controller controls the voice control mode of home appliances online through networks such as the Internet.
[0050] In this embodiment of the application, the local voice mode refers to the mode in which the local device parses the collected voice data locally to generate control commands and controls home appliances according to the control commands. That is, the voice control mode in which the local device controls home appliances locally (without going through the network, i.e., the external network).
[0051] For example, the local device can be a centralized controller. The centralized controller parses the collected voice data locally and generates control commands, and controls home appliances according to the control commands. That is, the centralized controller controls the voice control mode of home appliances locally.
[0052] In some embodiments, the default or initial voice control mode is the online voice mode.
[0053] In some embodiments, the online voice mode includes a first online voice mode and a second online voice mode. The first online voice mode is a mode in which the first local device sends voice data to the server via a first network. The second online voice mode is a mode in which the second local device sends voice data to the server via either the first network or the second network.
[0054] In some embodiments, the first network and the second network are different types of networks; for example, "network" here refers to the external network.
[0055] For example, the first network is the Internet, and the second network is the Internet of Things (IoT). However, this embodiment of the invention does not limit this. The first network and the second network can be different types of external networks. For example, the first network is a metropolitan area network, and the second network is a blockchain network, etc.
[0056] Furthermore, the first network can include multiple different first networks provided by different operators, for example, multiple internet services provided by different operators. If the internet service provided by one operator becomes unavailable, users can switch to the internet service provided by another operator.
[0057] In this way, the online voice mode includes two online voice modes based on different types of networks (external network), which can flexibly switch between online voice modes based on different types of networks according to network conditions or user needs, maintain the control mode of online voice, make full use of the advantages of server voice parsing, and further improve the control effect and user experience.
[0058] For example, in the first online voice mode, the first local device connects to the Internet through a router, and sends the acquired voice data to the server through the Internet. The server recognizes the voice data, generates control commands, and sends the control commands to the first local device. The first local device then controls the home appliances according to the control commands.
[0059] For example, in the second online voice mode, the first local device sends the acquired voice data to the second local device. The second local device connects to the internet via a router or connects to the Internet of Things (IoT). The second local device then sends the voice data to a server via the internet or IoT. The server recognizes the voice data, generates control commands, and sends these commands to the second local device. The second local device then controls home appliances according to these control commands. For example, the second local device may preferentially use a first network (e.g., the internet) to send voice data to the server. If the first network (e.g., the internet) fails, the second local device may use a second network (e.g., the IoT) to send the voice data to the server.
[0060] For example, in the second online voice mode, after receiving a control command, the second local device sends the control command to the first local device, which then controls the home appliances according to the control command. For instance, the gateway device, acting as the second local device, receives a control command for the bedroom light, but since there is no connection between the gateway device and the bedroom light, it cannot control the light. In this case, the gateway device sends the control command to the bedroom's central controller, which then controls the bedroom light.
[0061] For example, in local voice mode, the first local device acquires voice data, recognizes the voice data to generate control commands, and controls home appliances according to the control commands.
[0062] For example, in local voice mode, a local device (such as a smart speaker) acquires voice data and sends it to another local device (such as a gateway device) for voice recognition to generate control commands for the kitchen air conditioner. If the other local device (such as the gateway device) cannot control the kitchen air conditioner, the control commands can be forwarded to yet another local device (such as the kitchen's central controller) via a router, which then controls the kitchen air conditioner. If the router malfunctions and cannot forward the commands, another local device (such as the gateway device) interconnects with other local devices and broadcasts the control commands. These commands are received by, for example, the kitchen's central controller, which then controls the kitchen air conditioner. Thus, control of all the devices in the house is achieved locally.
[0063] For example, the default mode for controlling home appliances is the first online voice mode, or the initial mode for controlling home appliances is the first online voice mode. However, this application is not limited to this, and the default mode or the initial mode for controlling home appliances can also be other modes.
[0064] In some embodiments, if the first online voice mode is unavailable, the system switches from the first online voice mode to the second online voice mode; or, if the first online voice mode is unavailable, the system switches from the first online voice mode to the local voice mode; or, if the first online voice mode is unavailable, the system switches from the first online voice mode to the second online voice mode, and when the second online voice mode is also unavailable, the system switches from the second online voice mode to the local voice mode.
[0065] Therefore, when the primary online voice mode is unavailable, multiple voice modes can be switched, thus preventing users from being unable to control home appliances by voice. This further ensures the normal use of the voice control function, improves the effectiveness and efficiency of controlling home appliances, and enhances the user experience.
[0066] In some embodiments, in the event of a first type of fault, the system switches from a first online voice mode to a second online voice mode, and the second local device sends voice data to the server via the first network.
[0067] In some embodiments, in the event of a second type of failure, the system switches from a first online voice mode to a second online voice mode, and the second local device sends voice data to the server via a second network.
[0068] In some embodiments, in the event of a third type of failure, the system switches from the first online voice mode to the local voice mode.
[0069] In some embodiments, if the type of fault cannot be determined, the system first attempts to switch from a first online voice mode to a second online voice mode. If the second online voice mode works normally, it is used to control the home appliances. If the second online voice mode also fails to work, the system then switches from the second online voice mode to the local voice mode to control the home appliances.
[0070] Therefore, in the event of different malfunctions, different voice control modes can be switched, thereby enabling targeted switching of voice modes, further improving the effectiveness and efficiency of controlling home appliances and enhancing the user experience.
[0071] In some embodiments, the modes are switched in the following order: a first online voice mode, a second online voice mode, and a local voice mode.
[0072] This ensures that online voice control is prioritized for home appliances, guaranteeing both efficiency and reliability.
[0073] For example, Type 1 faults include, but are not limited to, at least one of the following faults:
[0074] The Wi-Fi communication function of the first local device is malfunctioning;
[0075] The communication connection between the first local device and the router failed.
[0076] That is, when the first local device cannot connect to the Internet, it switches from the first online voice mode to the second online voice mode, and the second local device connects to the server via the Internet.
[0077] For example, type II faults include, but are not limited to, at least one of the following faults:
[0078] The router malfunctioned;
[0079] The initial network connection between the router and the server has failed.
[0080] That is, when the first local device cannot connect to the Internet and the second local device also cannot connect to the Internet, the system switches from the first online voice mode to the second online voice mode, and the second local device connects to the server via the Internet of Things.
[0081] For example, the third type of fault includes, but is not limited to, at least one of the following faults:
[0082] The server malfunctioned;
[0083] The first network connection between the router and the server failed, and the second network connection between the second local device and the server also failed.
[0084] That is, when the first local device cannot connect to the server and the second local device also cannot connect to the server, the system switches from the first online voice mode to the local voice mode.
[0085] Therefore, it can prevent users from being unable to control home appliances via voice mode in various scenarios that may cause the first online voice mode to malfunction, thus ensuring the normal use of the voice control function.
[0086] In some embodiments, home appliances may be smart home appliances, such as air handling units, smart devices, sensors, and valve assemblies. For example, air handling units may include at least one of indoor units, humidifiers, dehumidifiers, fresh air systems, and underfloor heating systems. For example, smart devices may include at least one of smart speakers, smart display devices, smart switches, smart curtains, smart lighting devices, and smart pet devices.
[0087] In some embodiments, at least one air handling unit acts on the indoor space in the target space.
[0088] For example, at least one air handling unit is provided in the target space, such as an indoor air conditioning unit installed in the indoor space. In some embodiments, indoor units are installed in each indoor space within the target space, or in a portion of the indoor spaces within the target space.
[0089] For example, air handling equipment can be associated with indoor spaces in a target space, such as by using the binding information of the air handling equipment or by using the user's settings to determine the correspondence between the air handling equipment and the indoor space.
[0090] In some embodiments, the air handling unit may not be located in the target space, but it may still affect the target space. For example, a fresh air unit with its main unit installed above the ceiling.
[0091] In some embodiments, the air handling equipment includes at least one of an indoor unit, a humidifier, a dehumidifier, a fresh air system, and a floor heating system.
[0092] In addition, air handling equipment can also be called air conditioning equipment.
[0093] In some embodiments, the indoor unit is an indoor unit in an air handling system that includes air handling equipment, and the air handling system may include a commercial air conditioning system or a residential air conditioning system.
[0094] In some embodiments, an air conditioning system may include at least one set of outdoor units and at least one indoor unit connected to each set of outdoor units. That is, an air conditioning system may include one or more sets of outdoor units, each set of outdoor units including at least one outdoor unit; for each set of outdoor units, the set of outdoor units is connected to at least one indoor unit.
[0095] For example, an air conditioning system includes an outdoor unit and an indoor unit connected to the outdoor unit.
[0096] For example, an air conditioning system includes an outdoor unit and at least two indoor units connected to the outdoor unit.
[0097] For example, an air conditioning system includes at least two outdoor units and at least two indoor units connected to the at least two outdoor units.
[0098] For example, a group of outdoor units and at least one indoor unit connected to the group of outdoor units constitute a refrigerant system, or multiple groups of outdoor units and at least one indoor unit connected to the multiple groups of outdoor units respectively constitute multiple refrigerant systems. Thus, an air conditioning system may include one refrigerant system or multiple refrigerant systems.
[0099] In some embodiments, the outdoor unit and the indoor unit can be air conditioning equipment of various models, types, forms, and capacities. For example, the indoor unit can be in the form of four-sided air outlet, two-sided air outlet, duct unit, floor air outlet, or skirting board air outlet, etc.; the outdoor unit can be in the form of single fan top air outlet, dual fan top air outlet, single fan front air outlet, or dual fan front air outlet, etc.
[0100] In some embodiments, the fresh air equipment includes at least one of a fresh air handling device, a total heat exchange device (e.g., with or without internal circulation function), and a ventilation device (e.g., with or without internal circulation function).
[0101] In some embodiments, at least one of the humidifying device and the dehumidifying device is disposed on the output side of the fresh air device to humidify or dehumidify the air output by the fresh air device, for example, to humidify or dehumidify the air output by the fresh air device, and to introduce the humidified or dehumidified air into the indoor space. For example, at least one of the humidifying device and the dehumidifying device has a heat exchanger that can operate as an evaporator.
[0102] In some embodiments, the underfloor heating system is connected to the outdoor unit via refrigerant piping, and to the indoor underfloor heating radiator piping via underfloor heating water piping. For example, the outdoor unit and the underfloor heating system form an air-source heat pump water heater, utilizing heat from the air and the operation of the compressor to heat water. The underfloor heating system may include a water-heat exchange unit, where refrigerant from the outdoor unit's compressor enters the unit via refrigerant piping to exchange heat with the water, thereby heating the water. The heated water is then introduced into the indoor underfloor heating radiator piping via the underfloor heating water piping to provide heating for the indoor space. In some embodiments, the outdoor unit and the underfloor heating system are separate units, or they are integrated.
[0103] In some embodiments, the valve assembly includes at least one of an air valve and a floor heating valve.
[0104] In some embodiments, the air valve for controlling the air volume of the indoor space is, for example, an air valve for controlling the amount of air supplied to the indoor space by the air supply device. For example, when the external circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the outdoor air introduced into the indoor space; when the internal circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the indoor air introduced into the indoor space.
[0105] In some embodiments, the floor heating valve is used to control the opening and closing of the inlet and outlet pipes in the floor heating system.
[0106] To facilitate a detailed description of the control method in the embodiments of this application, an exemplary description of a smart home system to which this control method is applied is provided below. However, the control method in the embodiments of this application is not limited to systems with the following structures; it can also be applied to other systems.
[0107] Figure 2 is a structural diagram of a smart home system to which the home device control method of Embodiment 1 of this application is applied. As shown in Figure 2, the smart home system 100 includes one or more home devices 110, a central controller 131, a gateway device 132, a router 140, the Internet 150, and a first server 161, a second server 162, etc.
[0108] In some embodiments, home appliance 110 may be a smart home appliance, such as at least one selected from air handling equipment, smart speaker, smart display device, smart switch, smart curtain, smart lighting device, sensor, and smart pet device. The air handling equipment includes at least one selected from indoor unit, humidifier, dehumidifier, fresh air system, and underfloor heating system.
[0109] In some embodiments, as shown in FIG2, the home appliances 110 are centrally controlled by a central controller 131 or a gateway device 132. For example, the central controller 131 is a first local device, and the gateway device 132 is a second local device.
[0110] For example, the central controller 131 is a central controller with a display screen. In addition, the central controller 131 can also have voice control function, so it is also called a voice central controller.
[0111] For example, gateway device 132 is an intelligent gateway with centralized control functions.
[0112] In some embodiments, home appliance 110 can connect to and communicate with central controller 131 or gateway device 132 in various ways.
[0113] To distinguish different connection or communication methods, as shown in Figure 2, home appliance 110 includes multiple sets of home appliances 110-1, 110-2, 110-3, 110-4, and 110-5.
[0114] In some embodiments, home appliance 110-1 is connected to central controller 131 and gateway device 132 via wired connection. For example, home appliance 110-1 includes at least one of an outdoor air conditioner unit, an indoor air conditioner unit, a fresh air system, and a floor heating system. In addition, the indoor air conditioner unit can be connected to an air quality sensor and a wired controller, and the floor heating system can be connected to the wired controller.
[0115] In some embodiments, home device 110-2 is connected to voice central controller 131 and gateway device 132 via Wi-Fi. For example, home device 110-2 includes at least one of a home wall-mounted air conditioner, a wall-mounted / cabinet-style display unit, a humidification unit, a dehumidification unit, a smart pet device (e.g., a watchdog unit), and a sleep sensor.
[0116] In some embodiments, home device 110-3 is connected to voice central controller 131 via Bluetooth or Zigbee. For example, home device 110-3 includes at least one of smart curtains (e.g., motorized curtains, roller blinds) and smart lighting devices (e.g., dimmer lights).
[0117] In some embodiments, home appliances 110-4 are connected to a central controller 131 via a wired connection. For example, home appliances 110-4 include at least one of smart curtains (e.g., motorized curtains, roller blinds), smart lighting devices (e.g., ceiling lights), and floor heating valves.
[0118] In some embodiments, home device 110-5 is connected to gateway device 132 via Wi-Fi. For example, home device 110-5 is an air sensor installed indoors.
[0119] In some embodiments, the home appliances may also include devices not shown in FIG2, such as smart speakers, smart TVs, etc., which can be connected wirelessly or wired to at least one of the voice central controller 131 and gateway device 132.
[0120] In some embodiments, the control modes for home appliances include voice control modes and non-voice control modes (e.g., user-operated control modes).
[0121] In some embodiments, the voice control modes include an online voice control mode via a network (external network) and a local voice control mode implemented locally.
[0122] For example, in the first online voice mode, the central controller 131 sends the collected voice data to the first server 161 via the router 140 and the Internet 150. The first server 161 recognizes the voice data (e.g., through large-scale model recognition) to obtain corresponding text data, and sends the text data to the second server 162. The second server 162 generates corresponding control commands based on the text data and sends them to the central controller 131 via the router 140 and the Internet 150. The central controller 131 then controls the relevant home appliances according to the control commands. However, this application is not limited to this. For example, the second server can also recognize the voice data to obtain text data, and the first server can generate control commands based on the text data.
[0123] In addition, the functions of the first server 161 and the second server 162 can also be performed by a single server, and this application embodiment does not limit this.
[0124] For example, in the second online voice mode, the central controller 131 sends the collected voice data to the gateway device 132 via short-range communication. The gateway device 132 connects to the first network (e.g., the Internet 150) via a router, or connects to the second network (e.g., the Internet of Things) via the gateway device 132. The gateway device 132 sends the voice data to the first server 161 via the Internet 150 or the Internet of Things. The first server 161 recognizes the voice data, obtains the corresponding text data, and sends the text data to the second server 162. The second server 162 generates corresponding control commands based on the text data and sends them to the gateway device 132 via the Internet 150 or the Internet of Things. The gateway device 132 controls the relevant home appliances according to the control commands.
[0125] For example, in local voice mode, the central controller 131 acquires voice data and performs voice recognition and control of home appliances 110 locally; that is, voice control is performed without a network (i.e., an external network, such as the Internet or the Internet of Things). For instance, the central controller 131 collects voice data, recognizes the voice device to obtain corresponding text data, generates corresponding control commands based on the text data, and then controls the relevant home appliances according to the control commands. In this case, the central controller 131 simultaneously possesses voice acquisition, voice recognition, and centralized control functions.
[0126] For example, in local voice mode, the central controller 131 may have only one or two of the following functions: voice acquisition, voice recognition, and centralized control. Functions not available in the central controller 131 may be implemented by one or more other local devices.
[0127] Furthermore, in this embodiment of the invention, the device for collecting voice data is not limited to the central controller 131. Other local devices with voice collection capabilities can also be used, such as smart speakers, smart TVs, and smart screens. After collecting the voice data, the local device can send the voice data to the central controller 131, which then sends the voice information to the server via the first network. The server generates control commands based on the voice data and sends the control commands to the central controller 131. The central controller 131 controls the home appliances according to the control commands (i.e., the first online voice mode). Alternatively, the central controller 131 can send the voice data to the gateway device 132, which then sends the voice information to the server via the first or second network. The server generates control commands based on the voice data and sends the control commands to the gateway device 132, which controls the home appliances according to the control commands (i.e., the second online voice mode). Or, the central controller 131 can generate control commands locally based on the voice data and control the home appliances according to the control commands (i.e., the local voice mode).
[0128] For example, in the first online voice mode, the central controller 131 has both voice acquisition and centralized control functions. Alternatively, the central controller 131 may have either voice acquisition or centralized control functions. Functions that the central controller 131 does not have may be implemented by another local device, and data may be transmitted between these local devices to complete the entire voice acquisition and centralized control process.
[0129] For example, in the second online voice mode, the gateway device 132 has both voice acquisition and centralized control functions. Alternatively, the gateway device 132 may have either voice acquisition or centralized control functions. Functions that the gateway device 132 does not have may be implemented by another local device, and data may be transmitted between these local devices to complete the entire voice acquisition and centralized control process.
[0130] The control method will now be explained in detail, taking into account the system structure described above.
[0131] In step 101, the central controller 131 acquires the user's voice data. For example, after the user enables the voice control function of the central controller 131, voice monitoring is activated, and the monitored voice data is acquired. Alternatively, the central controller 131 may have a control interface for user interaction, through which the user performs related operations.
[0132] For example, user voice data can also be obtained through local devices other than the central controller 131.
[0133] For example, the local device used to acquire voice data can be determined based on the user's current location.
[0134] For example, the user's current location can be determined using sensors such as proximity sensors, sound sensors, and human perception sensors, or the user terminal's positioning function. Based on the user's current location, the nearest local device can be identified, and this local device can be used to acquire voice data. For example, proximity sensors, sound sensors, and human perception sensors can be installed in home appliances 110, central controllers 131, gateway devices 132, or any space or device within the room.
[0135] In some embodiments, the scope of the activated voice monitoring is the target space. Voice monitoring is activated after user confirmation before proceeding with voice monitoring of the target space.
[0136] For example, the user can confirm or set the voice monitoring and voice control functions through the control interface of the central controller 131. Additionally, the user can set the range for voice monitoring within the control interface.
[0137] In some embodiments, the target space is all the spaces of a place, such as the various rooms in a home, including the living room, bedroom, kitchen, bathroom, etc.
[0138] In some embodiments, the target space may also be a portion of a place, such as a specific space set by the user, like a room where the user spends a significant amount of time each day; or, the target space may be a space occupied, such as a room where people are detected by a human body sensor. In some embodiments, the voice data may be audio data, such as voice commands like "turn on the air conditioner," "turn off the TV," "raise the temperature to 28 degrees," or "lower the humidity to 40%," or voice data in natural language expressing subjective feelings, such as "I'm so hot" or "It's so cold today," but this application is not limited to these.
[0139] In step 102, the central controller 131 controls the home appliances through online voice mode based on the voice data, or the central controller 131 controls the home appliances through local voice mode based on the voice data.
[0140] In some embodiments, the local device has at least one of voice recognition and centralized control functions. For example, the local device includes at least one of a smart gateway, a controller, an indoor air conditioning unit, and a smart device.
[0141] For example, the controller includes at least one of a central controller, a wired controller, and a remote controller, wherein the central controller and the wired controller are also known as fixed controllers, which are fixedly installed on the wall of an indoor space.
[0142] In some embodiments, the central controllers are respectively set in each space and can control the home appliances in the space where the central controller is located. For example, a first central controller is set in the living room, a second central controller is set in the bedroom, and a third central controller is set in the kitchen. The first central controller can control the home appliances in the living room, the second central controller can control the home appliances in the bedroom, and the third central controller can control the home appliances in the kitchen.
[0143] In some embodiments, the central controllers are respectively set in each space and can control the home appliances in all spaces. For example, a first central controller is set in the living room, a second central controller is set in the bedroom, and a third central controller is set in the kitchen. The first, second, and third central controllers can all control all home appliances in the living room, bedroom, and kitchen.
[0144] In some embodiments, a centralized controller is installed in only one specific space and can control home appliances in all spaces. Additionally, wired controllers can be installed in other spaces outside the specific space to control home appliances in their respective spaces. For example, a centralized controller can be installed in the living room to control all home appliances in the living room, bedrooms, and kitchen; wired controllers can be installed in the bedrooms and kitchen to control home appliances in those spaces respectively.
[0145] For example, smart devices include at least one of smart speaker devices, smart display devices, smart switches, smart curtains, smart lighting devices, and smart pet devices.
[0146] For example, local devices include at least one of the following: central controller 131 in Figure 2, gateway device 132, indoor unit with voice function in home device 110-1, wall-mounted / cabinet display component in home device 110-2, and smart speaker and smart TV (not shown).
[0147] In some embodiments, the first type of fault includes at least one of the following:
[0148] The Wi-Fi communication function of the central controller 131 is malfunctioning;
[0149] The communication connection between the central controller 131 and the router 140 has failed.
[0150] Type II failures include at least one of the following:
[0151] Router 140 is malfunctioning;
[0152] The internet connection between router 140 and server 160 has failed.
[0153] Type III failures include at least one of the following:
[0154] Server 160 has malfunctioned;
[0155] The Internet connection between router 140 and server 160 failed, and the Internet of Things connection between gateway device 132 and server 160 also failed.
[0156] Therefore, in various scenarios where the central controller 131 may fail to control the home appliances 110 via the network, the system can prevent users from being unable to control the home appliances via voice control, ensuring the normal operation of the central controller 131's voice-based control. Thus, if the central controller 131 fails to control the home appliances 110 via the Internet 150 based on voice data, the central controller 131 can either control the home appliances 110 locally after acquiring the user's voice data, or send the voice data to the gateway device 132 and then control the home appliances 110 via the network.
[0157] In some embodiments, the central controller 131 is connected to the gateway device 132 via short-range communication.
[0158] For example, short-range communication includes at least one of Wi-Fi, Bluetooth, Zigbee, infrared, NFC, and ultra-wideband communication.
[0159] Therefore, even when the central controller 131 cannot connect to the Internet 150, it can still send out voice data and then convert the voice data into control commands, thereby successfully controlling the home appliances.
[0160] In some embodiments, as shown in FIG1, the control method may further include:
[0161] Step 103: After completing the control of the home appliance, notify the user of a message indicating that the control of the home appliance has been completed.
[0162] For example, after the central controller 131, acting as the first local device, completes control of the air conditioner in the home appliance 110, the central controller 131 notifies the user of the completion of control. For instance, the central controller 131 displays text such as "Control of the air conditioner has been completed" on the application's user interface, or it informs the user via voice announcement, such as broadcasting "Control of the air conditioner has been completed." Alternatively, the central controller 131 may send the control completion information to the user's terminal device via a network or short-range communication, and the terminal device notifies the user of the control completion information via an app.
[0163] For example, after the gateway device 132, which acts as a second local device, completes the control of the air conditioner in the home appliance 110, the gateway device 132 sends a notification to the central controller 131 indicating that the control is complete, and then the central controller 131 notifies the user of the information.
[0164] This allows users to know immediately that control of home appliances has been completed, further enhancing the user experience.
[0165] In some embodiments, as shown in FIG1, the control method further includes:
[0166] Step 104: After completing the control of the home appliances, notify the user that either the first online voice mode or the second online voice mode is unavailable.
[0167] For example, the central controller 131 can display or announce messages such as "The central controller failed to control the air conditioner via the Internet" or "The first online voice mode is unavailable".
[0168] In some embodiments, as shown in FIG1, the control method further includes:
[0169] Step 105: Notify the user of information explaining why the first or second online voice mode is unavailable.
[0170] For example, the central controller 131 can display or announce messages such as "The server has failed".
[0171] This allows users to easily identify when the online voice control mode malfunctions, and further understand the cause of the malfunction, facilitating subsequent repair requests or self-repair, thus further enhancing the user experience.
[0172] In some embodiments, as shown in FIG1, the control method further includes:
[0173] Step 106: Prompt the user with information about troubleshooting.
[0174] For example, the central controller 131 can display or announce messages such as "Please restart the local device", "Restart the network device", "The xxx device has malfunctioned, please restart", "The xxx device has malfunctioned, please repair", etc.
[0175] This makes it easier for users to report repairs or perform self-repairs, further enhancing the user experience.
[0176] For example, the local device used to send the notification can be determined based on the user's current location.
[0177] For example, the user's current location can be determined using sensors such as proximity sensors, sound sensors, and human perception sensors, or the user terminal's positioning function. Based on the user's current location, the nearest local device can be identified and used to complete the notification. For example, proximity sensors, sound sensors, and human perception sensors can be installed in home appliances 110, central controllers 131, gateway devices 132, or any space or device indoors.
[0178] For example, after a user inputs voice data into the central controller 131 in the living room, they move to the bedroom. After controlling the corresponding home appliances, once it is determined that the user is currently in the bedroom, the local device in the bedroom (such as the central controller on the bedroom wall) notifies the user.
[0179] This allows for reliable notifications to users, improving the user experience.
[0180] Furthermore, steps 103 to 106 are optional steps, indicated by dashed boxes in Figure 1. The home appliance control method of this application embodiment may include one or more of steps 103 to 106, and the order of steps 103, 104, 105, and 106 can be arbitrarily changed. Alternatively, the control method may not include steps 103 to 106.
[0181] Figure 3 is a flowchart of one embodiment of the control method for home appliances according to Embodiment 1 of this application. As shown in Figure 3, the method includes:
[0182] Step 301: Acquire the user's voice data; for example, acquire the voice data through the central controller 131 or other local devices;
[0183] Step 302: Activate the default first online voice mode to control home appliances based on the collected voice data;
[0184] Step 303: When the first online voice mode cannot be used normally, determine the type of fault that occurred;
[0185] Step 304: Determine whether a first type of fault has occurred in the first online voice mode; if the determination result is "no", proceed to step 305; if the determination result is "yes", proceed to step 310.
[0186] For example, Type I faults include at least one of the following:
[0187] The Wi-Fi communication function of the central controller 131 is malfunctioning;
[0188] The communication connection between the central controller 131 and the router 140 has failed.
[0189] For example, specific judgment methods may include at least one of the following methods:
[0190] Determine if the remote communication function of the central controller 131 is normal;
[0191] Determine whether the communication between the central controller 131 and the router 140 is normal.
[0192] Step 305: Determine whether a second type of fault has occurred in the first online voice mode; if the determination result is "no", proceed to step 306; if the determination result is "yes", proceed to step 311.
[0193] For example, the second type of failure includes at least one of the following:
[0194] Router 140 is malfunctioning;
[0195] The internet connection between router 140 and server 160 has failed.
[0196] For example, specific judgment methods may include at least one of the following methods:
[0197] Determine if router 140 is functioning correctly;
[0198] Determine if the internet connection between router 140 and server 160 is normal.
[0199] Step 306: Determine whether a third type of fault has occurred in the first online voice mode; if the determination result is "no", proceed to step 307; if the determination result is "yes", proceed to step 312.
[0200] For example, the third type of failure includes at least one of the following:
[0201] Server 160 has malfunctioned;
[0202] The Internet connection between router 140 and server 160 failed, and the Internet of Things connection between gateway device 132 and server 160 also failed.
[0203] For example, specific judgment methods may include at least one of the following methods:
[0204] Determine if server 160 is functioning correctly;
[0205] Determine whether the Internet connection between router 140 and server 160 is normal, and whether the IoT connection between gateway device 132 and server 160 is normal.
[0206] Step 307: If the fault type cannot be determined, switch to the second online voice mode using the first network;
[0207] Step 308: Determine whether the second online voice mode using the first network can be used normally. If the determination result is "yes", proceed to step 310; if the determination result is "no", proceed to step 309.
[0208] Step 309: Determine whether the second online voice mode using the second network can be used normally. If the result is "yes", proceed to step 311; if the result is "no", proceed to step 312.
[0209] Step 310: Switch to using the second online voice mode and control the home device 110 based on the first network. For example, in this case, the gateway device 132 is connected to the server 160 via the Internet.
[0210] Step 311: Switch to using the second online voice mode and control the home device 110 based on the second network. For example, in this case, the gateway device 132 is connected to the server 160 via the Internet of Things.
[0211] Step 312: Switch to local voice mode to control home appliances 110, that is, the central controller 131 controls home appliances 110 locally.
[0212] Additionally, in actual operation, there may be situations where the default mode (e.g., the first online voice mode) fails to activate when the system is enabled. In this case, step 302 can be skipped, and the process can proceed directly to step 303 to determine the occurrence of the fault.
[0213] In addition, the judgment process of steps 304-306 is carried out synchronously with step 303. That is, when the default first online voice mode cannot be used normally, the judgment of steps 304-306 is performed.
[0214] In addition, after switching to the second online voice mode or local voice mode, fault information can be sent to the user or information prompting the user to troubleshoot the fault.
[0215] The following examples illustrate the online voice mode and the local voice mode.
[0216] Figure 4 is a flowchart of one embodiment of the method for controlling home appliances using a first online voice mode according to Embodiment 1 of this application. For example, a detailed description of steps 302 or 306 in Figure 3.
[0217] As shown in Figure 4, the method includes:
[0218] Step 401: The central controller 131 sends the acquired voice data to the first server 161 via the router 140 and the Internet 150;
[0219] Step 402: The first server 161 recognizes the voice data, obtains the corresponding text data, and sends the text data to the second server 162; for example, the text data includes "raise the temperature by 1 degree" and "turn on the fresh air".
[0220] Step 403: The second server 162 generates corresponding control instructions based on the text data and sends them to the central controller 131 via the Internet 150 and router 140; for example, the control instructions include: "Raise the target temperature of the indoor air conditioner by 1 degree" and "Start the fresh air equipment".
[0221] Step 404: The central controller 131 controls the relevant indoor air conditioning units and fresh air equipment according to the control command;
[0222] Step 405: The central controller 131 notifies the user that control is complete, for example, through voice broadcast or text display. Alternatively, the central controller 131 can send the control completion information to other local devices for broadcast, such as the central controller or other smart devices (e.g., smart speakers, smart TVs, or smart screens) in other spaces (the user's current location).
[0223] In the first online voice mode, after a first type of fault occurs, the system switches from the first online voice mode to the second online voice mode. Figure 5 is a flowchart of one embodiment of the method for controlling home appliances after switching to the second online voice mode according to Embodiment 1 of this application. For example, it is a specific description of step 307 or 308 in Figure 3.
[0224] As shown in Figure 5, the method includes:
[0225] Step 501: The central controller 131 sends the acquired voice data to the gateway device 132;
[0226] Step 502: Gateway device 132 sends voice data to first server 161 via Internet 150 or Internet of Things;
[0227] Step 503: The first server 161 recognizes the voice data, obtains the corresponding text data, and sends the text data to the second server 162; for example, the text data includes "raise the temperature by 1 degree" and "turn on the fresh air".
[0228] Step 504: The second server 162 generates corresponding control commands based on the text data and sends them to the gateway device 132 via the Internet 150 or the Internet of Things; for example, the control commands include: "Raise the target temperature of the indoor unit of the air conditioner by 1 degree" and "Start the fresh air equipment";
[0229] Step 505: Gateway device 132 sends the above control command to central controller 131;
[0230] Step 506: The central controller 131 controls the relevant indoor air conditioning units and fresh air equipment according to the control command;
[0231] Step 507: The central controller 131 notifies the user that control is complete; for example, through voice broadcast, text display, or other means. Alternatively, the central controller 131 can send the control completion information to other local devices for broadcast, such as the central controller or other smart devices (e.g., smart speakers, smart TVs, or smart screens) in other spaces (the user's current location) for notification.
[0232] Step 508: The central controller 131 notifies the user of a first-type fault or a second-type fault; for example, through voice broadcast, text display, or other means. Alternatively, the central controller 131 may send the information about the first-type fault or the second-type fault to other local devices for broadcast, such as the central controller or other smart devices (e.g., smart speakers, smart TVs, or smart screens) in other spaces (the user's current location) for notification.
[0233] In the first online voice mode, after a first type of fault occurs, the system switches from the first online voice mode to the second online voice mode. Figure 6 is a flowchart of one embodiment of the method for controlling home appliances after switching to local voice mode according to Embodiment 1 of this application. For example, a specific description of step 309 in Figure 3 is provided.
[0234] As shown in Figure 6, the method includes:
[0235] Step 601: The central controller 131 recognizes the voice data, obtains the corresponding text data, and generates corresponding control commands based on the text data;
[0236] Step 602: The central controller 131 controls the relevant indoor air conditioning units and fresh air equipment according to the control command;
[0237] Step 603: The central controller 131 notifies the user that control is complete; for example, through voice broadcast, text display, etc. Alternatively, the central controller 131 can send the control completion information to other local devices for broadcast, such as the central controller or other smart devices (e.g., smart speakers, smart TVs, or smart screens) in other spaces (the user's current location) for notification.
[0238] Step 604: The central controller 131 notifies the user of the occurrence of a third-type fault; for example, through voice broadcast, text display, or other means. Alternatively, the central controller 131 may send the information about the occurrence of a third-type fault to other local devices for broadcast, such as the central controller or other smart devices (e.g., smart speakers, smart TVs, or smart screens) in other spaces (the user's current location) for notification.
[0239] As can be seen from the above embodiments, the online voice mode and the local voice mode for controlling home appliances based on voice data can switch between each other. Therefore, when one voice control mode is unavailable, it can automatically switch to another voice control mode, avoiding situations where users cannot control home appliances by voice, ensuring the normal use of the voice control function, improving the effectiveness and efficiency of controlling home appliances, enhancing the user experience, and improving the intelligence of voice control because the switching is automatic without user operation. In addition, the ability to flexibly switch voice modes according to different situations improves the applicability of the voice system. Example 2
[0240] Embodiment 2 of this application provides a smart home system, which corresponds to the control method for home devices described in Embodiment 1. Specific implementation can refer to the method described in Embodiment 1; details that are the same or related will not be repeated.
[0241] Figure 7 is a schematic diagram of a smart home system according to Embodiment 2 of this application. As shown in Figure 7, the smart home system 700 includes home devices 701, a first local device 702, and a second local device 703. The first local device 702 acquires the user's voice data; the first local device 702 controls the home devices through an online voice mode based on the voice data; or, the second local device 703 controls the home devices 701 through an online voice mode based on the voice data from the first local device 702; or, the first local device 702 controls the home devices 701 through a local voice mode based on the voice data, wherein the online voice mode and the local voice mode can be switched between each other.
[0242] In some embodiments, the specific configuration of the smart home system 700 may be as shown in FIG2. For example, home device 701 includes at least one of the home devices 110 in Embodiment 1. The first local device 702 includes at least one of the following: a central controller 131, a gateway device 132, an indoor unit with voice function in home device 110-1, a wall-mounted / cabinet-style display component in home device 110-2, and a smart speaker or smart TV (not shown). For example, the first local device 702 is the central controller 131. The second local device 703 includes at least one of the following: a central controller 131, a gateway device 132, an indoor unit with voice function in home device 110-1, a wall-mounted / cabinet-style display component in home device 110-2, and a smart speaker or smart TV (not shown). For example, the second local device 703 is the gateway device 132.
[0243] As can be seen from the above embodiments, the online voice mode and the local voice mode for controlling home appliances based on voice data can switch between each other. Therefore, when one voice control mode is unavailable, it can automatically switch to another voice control mode, avoiding situations where users cannot control home appliances by voice, ensuring the normal use of the voice control function, improving the effectiveness and efficiency of controlling home appliances, enhancing the user experience, and improving the intelligence of voice control because the switching is automatic without user operation. In addition, the ability to flexibly switch voice modes according to different situations improves the applicability of the voice system. Example 3
[0244] Embodiment 3 of this application provides a control device for home appliances, which corresponds to the control method for home appliances described in Embodiment 1. The specific implementation can refer to the implementation of the method described in Embodiment 1. The same or related contents will not be repeated.
[0245] Figure 8 is a schematic diagram of a control device 800 for a home appliance according to Embodiment 3 of this application. As shown in Figure 8, the control device 800 includes an acquisition unit 801, a control unit 802, and a switching unit 803. For example, the control device 800 is the centralized controller 131 in Embodiment 1 or the first local device 702 in Embodiment 2.
[0246] The acquisition unit 801 is used to acquire voice data.
[0247] The control unit 802 is used to control home appliances via online voice mode based on voice data, or via local voice mode based on voice data.
[0248] The switching unit 803 is used to switch between online voice mode and local voice mode.
[0249] For example, if the control device 800 has voice recognition and centralized control functions, then the control device 800 generates control commands based on voice data, and the control unit 802 controls the home appliances based on the control commands.
[0250] As can be seen from the above embodiments, the online voice mode and the local voice mode for controlling home appliances based on voice data can switch between each other. Therefore, when one voice control mode is unavailable, it can automatically switch to another voice control mode, avoiding situations where users cannot control home appliances by voice, ensuring the normal use of the voice control function, improving the effectiveness and efficiency of controlling home appliances, enhancing the user experience, and improving the intelligence of voice control because the switching is automatic without user operation. In addition, the ability to flexibly switch voice modes according to different situations improves the applicability of the voice system. Example 4
[0251] Embodiment 4 of this application provides an electronic device corresponding to the control method for home appliances described in Embodiment 1. Specific implementation can refer to the method described in Embodiment 1; details that are identical or related will not be repeated.
[0252] Figure 9 is a schematic block diagram of the system configuration of the electronic device according to Embodiment 4 of this application. As shown in Figure 9, the electronic device 900 may include a processor 910 and a memory 920; the memory 920 is coupled to the processor 910. It is worth noting that this figure is exemplary; other types of structures may be used to supplement or replace this structure to achieve telecommunications functions or other functions.
[0253] In one embodiment, the processor 910 may be configured to: acquire voice data; control home appliances via an online voice mode or via a local voice mode based on the voice data; and switch between the online voice mode and the local voice mode.
[0254] As shown in Figure 9, the electronic device 900 may further include: a communication module 930, an input unit 940, a display 950, a speaker 960, a microphone 970, and a power supply 980. It is worth noting that the electronic device 900 does not necessarily include all the components shown in Figure 9; furthermore, the electronic device 900 may also include components not shown in Figure 9, which can be found in related technologies.
[0255] As shown in Figure 9, the processor 910, sometimes also referred to as a controller or operating control, may include a microprocessor or other processor device and / or logic device. The processor 910 receives input and controls the operation of various components of the electronic device 900.
[0256] The memory 920 may be, for example, one or more of a cache, flash memory, hard drive, removable media, volatile memory, non-volatile memory, or other suitable devices. It can store various types of data and, in addition, programs for executing related information. The processor 910 can execute the program stored in the memory 920 to perform information storage or processing, etc. The functions of other components are similar to those in existing systems and will not be described further here. The various components of the electronic device 900 can be implemented using dedicated hardware, firmware, software, or a combination thereof, without departing from the scope of this application.
[0257] As can be seen from the above embodiments, the online voice mode and the local voice mode for controlling home appliances based on voice data can switch between each other. Therefore, when one voice control mode is unavailable, it can automatically switch to another voice control mode, avoiding situations where users cannot control home appliances by voice, ensuring the normal use of the voice control function, improving the effectiveness and efficiency of controlling home appliances, enhancing the user experience, and improving the intelligence of voice control because the switching is automatic without user operation. In addition, the ability to flexibly switch voice modes according to different situations improves the applicability of the voice system.
[0258] This application also provides a computer-readable program, wherein when the program is executed in an electronic device, the program causes the computer to perform the home appliance control method described in Embodiment 1 in the electronic device.
[0259] This application also provides a storage medium storing a computer-readable program, wherein the computer-readable program causes a computer to execute the control method of the home appliance described in Embodiment 1 in an electronic device.
[0260] The apparatus and methods described above in the embodiments of this application can be implemented in hardware or in combination with software. This application relates to a computer-readable program that, when executed by a logic component, enables the logic component to implement the apparatus or constituent parts described above, or to implement the various methods or steps described above.
[0261] This application also relates to storage media for storing the above programs, such as hard disks, magnetic disks, optical disks, DVDs, flash memory, etc.
[0262] The present application has been described above with reference to specific embodiments. However, those skilled in the art should understand that these descriptions are exemplary and not intended to limit the scope of protection of the present application. Those skilled in the art can make various modifications and variations to the present application based on its spirit and principles, and these modifications and variations are also within the scope of the present application.
[0263] The control method and control device of this application can be applied to various home appliances and home systems.
[0264] 100: Smart home system; 110, 110-1, 110-2, 110-3, 110-4, 110-5: Home appliances; 131: Central controller; 132: Gateway device; 140: Router; 150: Internet; 161: First server; 162: Second server; 700: Smart home system; 701: Home appliance; 702: First local device; 703: Second local device; 800: Control device; 801: Acquisition unit; 802: Control unit; 803: Switching unit; 900: Electronic device; 910: Processor; 920: Memory; 930: Communication module; 940: Input unit; 950: Display; 960: Speaker; 970: Microphone; 980: Power supply.
Claims
A control method of a home device, characterized by, The method includes: acquiring voice data; and controlling home appliances via an online voice mode based on the voice data, or controlling the home appliances via a local voice mode based on the voice data, wherein the online voice mode and the local voice mode can be switched between each other. The method of claim 1, wherein The online voice modes include: a first online voice mode in which a first local device sends the voice data to a server via a first network; and a second online voice mode in which a second local device sends the voice data to a server via a first network or a second network. The method according to claim 2, characterized in that The method further includes: switching from the first online voice mode to the second online voice mode when the first online voice mode is unavailable; or switching from the first online voice mode to the local voice mode when the first online voice mode is unavailable; or switching from the first online voice mode to the second online voice mode when the first online voice mode is unavailable, and switching from the second online voice mode to the local voice mode when the second online voice mode is also unavailable. The method according to claim 3, characterized in that When switching from the first online voice mode to the second online voice mode, the first local device connects to the second local device via short-range communication, and the first local device sends the voice data to the second local device. The method according to any one of claims 2-4, characterized in that In the first online voice mode, the first local device connects to the first network via a router and connects to the server via the first network. In the second online voice mode, the second local device connects to the first network via a router and connects to the server via the first network, or the second local device connects to the server via the second network. The method according to claim 5, characterized in that In the first online voice mode or the second online voice mode, the server generates control commands based on the voice data, and the first local device or the second local device controls the home appliances based on the control commands. The method according to claim 1 or 3, characterized in that In the local voice mode, the first local device parses the voice data to generate control commands, and the first local device controls the home appliances according to the control commands. The method according to claim 3, characterized in that In the event of a first type of failure, the system switches from the first online voice mode to the second online voice mode, and the second local device sends the voice data to the server via the first network. In the event of a second type of failure, the system switches from the first online voice mode to the second online voice mode, and the second local device sends the voice data to the server via the second network. In the event of a third type of fault, the system switches from the first online voice mode to the local voice mode; if the first online voice mode is unusable and the fault type cannot be determined, the system switches from the first online voice mode to the second online voice mode. When the second online voice mode is usable, the second local device sends the voice data to the server through the first network or the second network. When the second online voice mode is unusable, the system switches from the second online voice mode to the local voice mode. The method according to claim 8, characterized in that The first type of fault includes at least one of the following faults: a Wi-Fi communication function failure of the first local device; and a communication connection failure between the first local device and the router; the second type of fault includes at least one of the following faults: a router failure; And the first network connection between the router and the server fails, the third type of failure includes at least one of the following: the server fails; And the first network connection between the router and the server fails, and the second network connection between the second local device and the server fails. The method according to claim 2 or 8 or 9, characterized in that The first network is the Internet, and the second network is the Internet of Things (IoT). The method of claim 1, wherein The method further includes: after completing the control of the home appliance, notifying the user of information indicating that the control of the home appliance is complete. The method according to claim 3, characterized in that The method further includes: after completing the control of the home device, notifying the user that either the first online voice mode or the second online voice mode is unavailable. The method of claim 12, wherein The method further includes: notifying the user of information indicating why the first online voice mode or the second online voice mode is unavailable. The method according to claim 2, characterized in that The first local device and the second local device include at least one of a controller, an indoor air conditioning unit, and a smart device, wherein the controller includes at least one of a central controller, a wired controller, and a remote controller. The method of claim 1, wherein The home appliances include at least one of air handling equipment, smart devices, sensors, and valve assemblies. A smart home system characterized in that, The smart home system includes home devices, a first local device, and a second local device. The first local device acquires voice data; and the first local device controls the home devices through an online voice mode based on the voice data; or, the second local device controls the home devices through an online voice mode based on the voice data from the first local device; or, the first local device controls the home devices through a local voice mode based on the voice data, wherein the online voice mode and the local voice mode can be switched between each other. A control device of a home device characterized by The device includes: a first local device for acquiring voice data; an acquisition unit for acquiring voice data; a control unit for controlling home appliances via an online voice mode or via a local voice mode based on the voice data; and a switching unit for switching between the online voice mode and the local voice mode. An electronic device, characterized by comprising: The electronic device includes: a memory storing a computer program; and a processor that, when executing the computer program, implements the method of any one of claims 1-15. A computer-readable storage medium having stored thereon a computer program, characterized in that When the computer program is executed by a processor, it implements the method described in any one of claims 1-15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, it implements the method described in any one of claims 1-15.
Citation Information
Patent Citations
Information processing unit, program and information processing method
JP2021173880A