Voice control method and apparatus, device, system, storage medium, and program product

Abstract

The present application provides a voice control method and apparatus, a device, a system, a storage medium, and a program product. Voice control can be performed on a home device by means of a first control link or the second control link. Thus, the fault tolerance and reliability of voice control can be improved, which helps to improve the user experience.

Description

Voice control methods, devices, equipment, systems, storage media, and software products

[0001] This application relates to the field of equipment control, and in particular to a voice control method, apparatus, device, system, storage medium, and program product.

[0002] With the development of science and technology and urban construction, voice recognition technology is gradually being applied to all aspects of people's lives. For example, in office buildings, apartments, schools, shopping malls and other places, devices that can be controlled based on voice, such as voice-controlled smart home devices, are becoming increasingly popular.

[0003] It should be noted that the above introduction to the technical background is only for the purpose of providing a clear and complete explanation of the technical solutions of this application and facilitating understanding by those skilled in the art. It should not be assumed that these technical solutions are known to those skilled in the art simply because they have been described in the background section of this application.

[0004] The inventors discovered that smart home systems typically only have a single control link for controlling home devices. If this control link fails, the normal operation of voice control cannot be guaranteed, affecting the user experience.

[0005] To address at least one of the aforementioned problems, embodiments of this application provide a voice control method, apparatus, device, system, storage medium, and program product.

[0006] According to a first aspect of the embodiments of this application, a voice control method is provided, the method comprising: performing voice control on a home appliance via a first control link or a second control link, wherein the first control link includes a first link device and the home appliance, and the second control link includes a second link device and the home appliance.

[0007] According to a second aspect of the embodiments of this application, a smart home system is provided. The system includes a first control link and a second control link. The first control link includes a first link device and a home appliance. The second control link includes a second link device and the home appliance. The system performs voice control on the home appliance through the first control link or the second control link.

[0008] According to a third aspect of the embodiments of this application, a voice control device is provided, the device comprising: a control unit that performs voice control on home appliances via a first control link or a second control link, wherein the first control link includes a first link device and the home appliances, and the second control link includes a second link device and the home appliances.

[0009] According to a fourth aspect of the present application, an electronic device is provided, the electronic device comprising: a memory storing a computer program; and a processor executing the computer program to implement the method described in the first aspect of the present application.

[0010] According to a fifth aspect of the present application, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the method described in the first aspect of the present application.

[0011] According to a sixth aspect of the embodiments of this application, a computer program product is provided, which includes a computer program that, when executed by a processor, implements the method described in the first aspect of the embodiments of this application.

[0012] One of the beneficial effects of the embodiments of this application is that home appliances can be controlled by voice through the first control link or the second control link, thereby improving the fault tolerance and reliability of voice control and helping to improve the user experience.

[0013] Furthermore, based on information related to voice control, the system switches between the first and second control links. This allows for flexible selection of appropriate control links or link devices to control home appliances via voice, enabling the system to autonomously resolve or avoid problems and further improving the fault tolerance of voice control. Moreover, it can adapt to various scenarios, such as unstable communication or the need to control home appliances in different target spaces, flexibly selecting control links or link devices to enhance the flexibility and stability of voice control.

[0014] Furthermore, during voice control, it is possible to select link devices or control links with a higher success rate over a certain period of time, thereby further improving the success rate of voice control.

[0015] Furthermore, during voice control, it is possible to select link devices or control links with lower average latency over a period of time, thereby further improving the efficiency of voice control.

[0016] Furthermore, during voice control, it is possible to select link devices or control links with lower real-time load, thereby further improving the efficiency of voice control.

[0017] Furthermore, during voice control, it is possible to select link devices or control links with larger remaining loads, thereby further improving the efficiency of voice control.

[0018] Furthermore, during voice control, the system can select the control device based on the object being controlled. Thus, the smart home system can automatically select the control device corresponding to the object being controlled by voice for different home devices (e.g., home devices located in different spaces), without requiring the user to distinguish or select multiple control devices, thereby improving the convenience of control and further enhancing the user experience.

[0019] Furthermore, when a control device fails, other control devices of the same type as the failed device can be prioritized for detection or selection. These selected devices can then replace the failed device. For example, if a central controller fails, another central controller can be prioritized; similarly, if a gateway device fails, another gateway device can be prioritized. Since control devices of the same type have identical or similar control actions (e.g., the format of control instructions and control steps used by control devices of the same type are identical or similar), switching between control devices of the same type can improve switching efficiency, simplify the switching process, and reduce the impact on other devices.

[0020] Furthermore, by establishing a short-range communication connection between the first link device and the second link device, when switching control links, control commands can be sent from the first link device to the second link device, or vice versa. This eliminates the need to forward the control commands through an external network or regenerate them through a server, thereby improving the efficiency of voice control and reducing system load.

[0021] Furthermore, the first link device and the second link device are connected through an external network. Thus, even if a short-distance communication connection is not established between the first link device and the second link device, control commands can be forwarded through the external network, thereby further improving the fault tolerance and reliability of voice control.

[0022] Furthermore, identifying the fault type corresponding to voice control failure helps to quickly resolve issues and improve the user experience.

[0023] Furthermore, the fault information can be prompted to the user through voice broadcast or message push, thereby enabling the user to understand the fault information of the control link, which will help with subsequent rapid maintenance.

[0024] Specific embodiments of this application are disclosed in detail with reference to the following description and accompanying drawings, indicating how the principles of this application can be adopted. It should be understood that the embodiments of this application are not limited in scope. Within the spirit and scope of the appended claims, embodiments of this application include many changes, modifications, and equivalents.

[0025] The feature information described and illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, combined with feature information in other embodiments, or substituted for feature information in other embodiments.

[0026] It should be emphasized that the term "including / comprises" as used herein refers to the presence of a feature, whole, step, or component, but does not exclude the presence or addition of one or more other features, wholes, steps, or components.

[0027] The home appliances and home systems of this application are not only applicable to home scenarios, such as residences and apartments, but also to commercial or public scenarios such as office buildings, shopping malls, schools, and factories. This application does not limit the application scenarios of the home appliances and home systems.

[0028] Many aspects of this application can be better understood by referring to the following accompanying drawings. The components in the drawings are not drawn to scale, but are only intended to illustrate the principles of this application. Corresponding portions in the drawings may be enlarged or reduced for ease of illustration and description of certain parts of this application. Elements and features described in one drawing or embodiment of this application may be combined with elements and features shown in one or more other drawings or embodiments. Furthermore, similar reference numerals in the drawings denote corresponding components in several drawings and can be used to indicate corresponding components used in more than one embodiment.

[0029] Figure 1 is a schematic diagram of a voice control method according to an embodiment of this application;

[0030] Figure 2 is a structural diagram of a smart home system to which the control method of this application is applied;

[0031] Figure 3 is another schematic diagram of the voice control method according to an embodiment of this application;

[0032] Figure 4 is another schematic diagram of the voice control method according to an embodiment of this application;

[0033] Figure 5 is a schematic diagram of a smart home system according to an embodiment of this application;

[0034] Figure 6 is a schematic diagram of a voice control device according to an embodiment of this application;

[0035] Figure 7 is a schematic diagram of an electronic device according to an embodiment of this application.

[0036] The preferred embodiments of this application will now be described with reference to the accompanying drawings. Example 1

[0037] Embodiment 1 of this application provides a voice control method.

[0038] Figure 1 is a schematic diagram of a voice control method according to an embodiment of this application. As shown in Figure 1, the method includes:

[0039] Step 101: Control home appliances by voice through the first control link or the second control link.

[0040] The first control link includes a first link device and the home appliance, and the second control link includes a second link device and the home appliance.

[0041] According to the above embodiments, home appliances can be voice-controlled via a first control link or a second control link. The first control link includes a first link device and the home appliance, and the second control link includes a second link device and the home appliance. Thus, multiple control links are set up for the home appliance. If one control link fails, the home appliance can be voice-controlled via other control links. Alternatively, if a link device in one control link fails, it can be replaced by another link device with the same function in other control links. This improves the fault tolerance and reliability of voice control, thus enhancing the user experience.

[0042] In some embodiments, the first link device is a device other than the home appliance in the first control link, and the second link device is a device other than the home appliance in the second control link. For example, the first link device or the second link device may have at least one of the following functions: acquiring voice data, uploading voice data to an external network (e.g., the Internet), generating control commands based on the voice data, receiving control commands from the external network, issuing control commands to the home appliance, and generating control commands locally based on the voice data. The above functions can be implemented by different devices, or multiple functions can be implemented by one device; this application does not impose specific limitations in this regard.

[0043] For example, the first link device may include a first control device, and the second link device may include a second control device. The first and second control devices have at least one identical function. For example, both the first and second control devices have at least the function of issuing control commands to home appliances, enabling control of the home appliances according to the control commands; for example, they may be a centralized controller or gateway device described later.

[0044] In some embodiments, the control command is generated based on voice data. For example, the control command may be generated based on voice data by a network device (e.g., a server, etc.) or a local device (e.g., a first control device or a second control device), and this application does not impose any specific limitations on this.

[0045] In some embodiments, home appliances may be smart home appliances, such as air handling equipment, smart devices, sensors, and valve assemblies.

[0046] In some embodiments, a smart device may include at least one of the following: a smart speaker, a smart display device, a smart switch, a smart curtain, a smart lighting device, and a smart pet device, etc.

[0047] In some embodiments, at least one air handling unit acts on the indoor space in the target space.

[0048] For example, at least one air handling device is provided in the target space, such as an indoor air conditioning unit installed in the indoor space. In some embodiments, indoor units are installed in each indoor space within the target space, or in a portion of the indoor spaces within the target space.

[0049] For example, air handling units can be associated with indoor spaces within a target area. This association can be established through the unit's binding information, or by using its name. For instance, a user can set the name of an air handling unit that includes information about the corresponding indoor space; for example, naming the air conditioner in a bedroom "Bedroom Air Conditioner."

[0050] In some embodiments, the air handling unit may not be installed in the target space's interior space, but it may still affect the target space's interior space. For example, a fresh air unit with its main unit installed above the ceiling.

[0051] In some embodiments, the air handling equipment includes at least one of an indoor unit, a humidifier, a dehumidifier, a fresh air system, and a floor heating system.

[0052] In some embodiments, the indoor unit is an indoor unit in an air handling system that includes air handling equipment, and the air handling system may include a commercial air conditioning system or a residential air conditioning system.

[0053] In some embodiments, an air conditioning system may include at least one set of outdoor units and at least one indoor unit connected to each set of outdoor units. That is, an air conditioning system may include one or more sets of outdoor units, each set of outdoor units including at least one outdoor unit; for each set of outdoor units, the set of outdoor units is connected to at least one indoor unit.

[0054] For example, an air conditioning system includes an outdoor unit and an indoor unit connected to the outdoor unit.

[0055] For example, an air conditioning system includes an outdoor unit and at least two indoor units connected to the outdoor unit.

[0056] For example, an air conditioning system includes at least two outdoor units and at least two indoor units connected to the at least two outdoor units.

[0057] For example, a group of outdoor units and at least one indoor unit connected to the group of outdoor units constitute a refrigerant system, or multiple groups of outdoor units and at least one indoor unit connected to the multiple groups of outdoor units respectively constitute multiple refrigerant systems. Thus, an air conditioning system may include one refrigerant system or multiple refrigerant systems.

[0058] In some embodiments, the outdoor unit and the indoor unit can be air conditioning equipment of various models, types, forms, and capacities. For example, the indoor unit can be in the form of four-sided air outlet, two-sided air outlet, duct unit, floor air outlet, or skirting board air outlet, etc.; the outdoor unit can be in the form of single fan top air outlet, dual fan top air outlet, single fan front air outlet, or dual fan front air outlet, etc.

[0059] In some embodiments, the fresh air equipment includes at least one of a fresh air handling device, a total heat exchange device (e.g., with or without internal circulation function), and a ventilation device (e.g., with or without internal circulation function).

[0060] In some embodiments, at least one of the humidifying device and the dehumidifying device is disposed on the output side of the fresh air device to humidify or dehumidify the air output by the fresh air device, for example, to humidify or dehumidify the air output by the fresh air device, and to introduce the humidified or dehumidified air into the indoor space. For example, at least one of the humidifying device and the dehumidifying device has a heat exchanger that can operate as an evaporator.

[0061] In some embodiments, the underfloor heating system is connected to the outdoor unit via refrigerant piping, and to the indoor underfloor heating radiator piping via underfloor heating water piping. For example, the outdoor unit and the underfloor heating system form an air-source heat pump water heater, utilizing heat from the air and the operation of the compressor to heat water. The underfloor heating system may include a water-heat exchange unit, where refrigerant from the outdoor unit's compressor enters the unit via refrigerant piping to exchange heat with the water, thereby heating the water. The heated water is then introduced into the indoor underfloor heating radiator piping via the underfloor heating water piping to provide heating for the indoor space. In some embodiments, the outdoor unit and the underfloor heating system are separate units, or they are integrated.

[0062] In some embodiments, the valve assembly includes at least one of an air valve and a floor heating valve.

[0063] In some embodiments, the air valve for controlling the air volume of the indoor space is, for example, an air valve for controlling the amount of air supplied to the indoor space by the air supply device. For example, when the external circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the outdoor air introduced into the indoor space; when the internal circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the indoor air introduced into the indoor space.

[0064] In some embodiments, the floor heating valve is used to control the opening and closing of the inlet and outlet pipes in the floor heating system.

[0065] To facilitate a detailed description of the control method in the embodiments of this application, an exemplary description of a smart home system to which this control method is applied is provided below. However, the control method in the embodiments of this application is not limited to systems with the following structures; it can also be applied to other systems.

[0066] Figure 2 is a structural diagram of a smart home system to which the control method of this application embodiment is applied. As shown in Figure 2, the smart home system 100 includes one or more home devices 110, a user terminal 120, a central controller 131, a gateway device 132, a router 140, the Internet 150, and a first server 161, a second server 162, etc.

[0067] In some embodiments, the home appliance 110 may be a smart home appliance, for example, the home appliance includes at least one of an air handling unit, a smart device, a sensor, and a valve assembly. The air handling unit includes at least one of an indoor unit, a humidifier, a dehumidifier, a fresh air system, and a floor heating system. The smart device includes at least one of a smart speaker, a smart display device, a smart switch, smart curtains, smart lighting equipment, and a smart pet device. The valve assembly includes at least one of a damper and a floor heating valve.

[0068] In some embodiments, the user terminal 120 may be, for example, a user's smartphone, smart wearable device, or other terminal device with voice functionality.

[0069] In some embodiments, as shown in FIG2, the home appliances 110-1 to 110-5 are centrally controlled by the central controller 131 or the gateway device 132.

[0070] In some embodiments, the central controller 131 is a controller with centralized control functions. For example, the central controller 131 can control multiple or various types of home appliances. The central controller 131 can be a fixed controller, for example, the central controller can be fixed in a preset location (e.g., a wall). The central controller 131 can receive user voice data and control at least one home appliance through the control commands corresponding to the voice data.

[0071] For example, the central controller 131 may include a voice input unit for receiving user voice data. The central controller 131 may also include a voice output unit for broadcasting voice data. Furthermore, the central controller 131 may also have a display screen.

[0072] In some embodiments, gateway device 132 is a gateway with centralized control functionality. Gateway device 132 can receive control commands corresponding to voice data sent from the network, and control at least one home appliance through these control commands.

[0073] In addition, in this embodiment, the central controller 131 and the gateway device 132 can also control home appliances through control commands corresponding to non-voice data.

[0074] In some embodiments, home appliance 110 can connect and communicate with central controller 131 or gateway device 132 in various ways.

[0075] To differentiate between different connection or communication methods, as shown in Figure 2, home appliance 110 includes multiple home appliances 110-1, 110-2, 110-3, 110-4, and 110-5. Home appliances 110-1, 110-2, 110-3, 110-4, and 110-5 can be connected to the central controller 131 and the gateway device 132 via a local network (i.e., a short-range communication network).

[0076] In some embodiments, home appliance 110-1 is connected to central controller 131 and gateway device 132 via wired connection. For example, home appliance 110-1 includes at least one of an outdoor air conditioner unit, an indoor air conditioner unit, a fresh air system, and a floor heating system. In addition, the indoor air conditioner unit can be connected to an air quality sensor and a wired controller, and the floor heating system can be connected to the wired controller.

[0077] In some embodiments, home device 110-2 is connected to central controller 131 and gateway device 132 via Wi-Fi. For example, home device 110-2 includes at least one of a home wall-mounted air conditioner, a wall-mounted / cabinet-style display unit, a humidification unit, a dehumidification unit, a smart pet device (e.g., a watchdog unit), and a sleep sensor.

[0078] In some embodiments, home device 110-3 is connected to central controller 131 via Bluetooth or Zigbee. For example, home device 110-3 includes at least one of smart curtains (e.g., motorized curtains, roller blinds) and smart lighting devices (e.g., dimmer lights).

[0079] In some embodiments, home appliances 110-4 are connected to a central controller 131 via a wired connection. For example, home appliances 110-4 include at least one of smart curtains (e.g., motorized curtains, roller blinds), smart lighting devices (e.g., ceiling lights), and floor heating valves.

[0080] In some embodiments, home device 110-5 is connected to gateway device 132 via Wi-Fi. For example, home device 110-5 is directly connected to gateway device 132 via Wi-Fi, or home device 110-5 is connected to router 140 via Wi-Fi, and then connected to gateway device 132 via router 140. Home device 110-5 is, for example, an indoor air sensor.

[0081] In some embodiments, the home appliances may also include devices not shown in FIG2, such as smart speakers, smart TVs, etc., which can be connected wirelessly or wired to at least one of the central controller 131 and the gateway device 132.

[0082] In addition, home appliances 110-1, 110-2, 110-3, 110-4, and 110-5 can also be connected to the central controller 131 and the gateway device 132 via external networks (e.g., the Internet). Thus, even if a home appliance does not have a short-range communication connection with the control device, control commands can be forwarded via an external network, thereby enabling control of that home appliance.

[0083] For example, home appliance 110-3 connects to the central controller 131 via Bluetooth or Zigbee. No short-range communication connection is established between home appliance 110-3 and gateway device 132, or between the central controller 131 and gateway device 132. Gateway device 132 can send control commands to the central controller 131 via an external network, and the central controller 131 then sends the control commands to home appliance 110-3, thereby enabling control of home appliance 110-3.

[0084] In some embodiments, the control modes for home appliances include voice control modes and non-voice control modes (e.g., user-operated control modes).

[0085] In some embodiments, the voice control modes include an online voice control mode via the Internet and a local voice control mode implemented locally.

[0086] For example, in an online voice control mode via the internet, user terminal 120 sends the collected voice data to first server 161 via router 140 and internet 150. First server 161 recognizes the voice device, obtains corresponding text data or control parameters, and sends the text data or control parameters to second server 162. Second server 162 generates corresponding control commands based on the text data or control parameters and sends them to gateway device 132 via internet 150 and router 140. Gateway device 132 then controls the relevant home appliances according to the control commands. Alternatively, second server 162 sends control commands via internet 150 and router 140 to central controller 131, which then controls the relevant home appliances according to the control commands. Furthermore, the functions of first server 161 and second server 162 can also be performed by a single server; this embodiment does not limit this.

[0087] Alternatively, in the online voice control mode via the internet, the central controller 131 can collect voice data, transmit it through the router 140, and then via the internet 150 to the first server 161. The subsequent processing is similar to the process described above. Thus, the central controller 131 enables control of home appliances in the online voice control mode.

[0088] For example, in local voice control mode, voice data can be acquired by local devices. For instance, the central controller 131 collects voice data, recognizes the voice device, obtains corresponding text data or control parameters, generates corresponding control commands based on the text data or control parameters, and then controls the relevant home appliances according to the control commands.

[0089] In some embodiments, the control link can be various control links that control home appliances according to control commands. This application embodiment does not specifically limit the method of generating control commands or the method of acquiring voice data. The control link and link device of this application will be described exemplarily below with reference to FIG2.

[0090] As shown in Figure 2, the control link may include a central controller 131, a router 140, a first server 161, a second server 162, a central controller 131, and home appliances 110. In this case, the link devices may include a central controller 131, a router 140, a first server 161, and a second server 162.

[0091] For example, in online voice control mode, the central controller 131 collects voice data, and the servers (first server 161 and second server 162) generate control commands based on the voice data. The central controller 131 then controls the relevant home appliances according to the control commands.

[0092] Alternatively, as shown in Figure 2, the control link may include a central controller 131 and home appliances 110. In this case, the link device may include the central controller 131.

[0093] For example, in local voice control mode, the central controller 131 collects voice data, generates control commands based on the voice data, and controls the relevant home appliances according to the control commands.

[0094] Alternatively, as shown in Figure 2, the control link may include user equipment 120, router 140, first server 161, second server 162, router 140, gateway device 132, and home appliance 110. In this case, the link devices may include user equipment 120, router 140, first server 161, second server 162, and gateway device 132.

[0095] For example, in online voice control mode, user device 120 collects voice data, servers (first server 161, second server 162) generate control commands based on the voice data, and gateway device 132 controls the relevant home appliances based on the control commands.

[0096] In addition, in the above control links, the server and gateway device 132, the server and user equipment 120, and the server and central controller 131 can also communicate directly without going through router 140.

[0097] The first control link or the second control link in the embodiments of this application can be any one of the control links described above. This application is not limited thereto; the first control link or the second control link can be other control links.

[0098] The control method of the present application embodiment will be described in detail below with reference to the above system structure.

[0099] In some embodiments, as shown in FIG1, the control method may further include:

[0100] Step 102: Based on the information related to voice control, switch between the first control link and the second control link.

[0101] Therefore, based on voice control-related information, appropriate control links or link devices can be flexibly selected to control home appliances via voice, thereby autonomously resolving or avoiding problems and further improving the fault tolerance of voice control. Furthermore, it can be combined with various scenarios, such as when communication is unstable or when controlling home appliances in different target spaces, to flexibly select control links or link devices, improving the flexibility and stability of voice control.

[0102] In some embodiments, switching control links may include partially switching control links or switching control links entirely.

[0103] For example, switching the first control link may include replacing at least one first link device in the first control link with at least one second link device in the second control link. For instance, when switching the first control link, the entire first control link can be switched to the second control link, that is, all second link devices in the second control link can be replaced with all first link devices in the first control link. As another example, when switching the first control link, a portion of the first control link can be switched to the second control link, that is, some second link devices in the second control link can be replaced with some first link devices in the first control link.

[0104] Similarly, switching the second control link may include replacing at least one second link device in the second control link with at least one first link device in the first control link.

[0105] The following example illustrates step 102 by taking the partial switching of the control link as an example.

[0106] In some embodiments, information related to voice control may include information about the type of voice control malfunction.

[0107] In this case, step 102 may include:

[0108] Based on the fault type information, determine the first link device in the first control link that corresponds to the fault type, and replace the first link device with the second link device in the second control link that can perform the corresponding operation; or, based on the fault type information, determine the second link device in the second control link that corresponds to the fault type, and replace the second link device with the first link device in the first control link that can perform the corresponding operation.

[0109] Taking the failure of the first control link and the need to switch the first control link as an example:

[0110] If the voice data fails to be successfully uploaded to the network, the device in the first control link that is capable of uploading voice data will be replaced by a device in the second control link that is capable of uploading voice data.

[0111] If control commands cannot be successfully received from the network, the device in the first control link that can receive control commands will be replaced by a device in the second control link that can receive control commands.

[0112] If control commands cannot be sent to home appliances, the device in the first control link that can send control commands can be replaced by a device in the second control link that can send control commands.

[0113] Taking the first control link as central controller 131, router 140, first server 161, second server 162, router 140, central controller 131, and home appliance 110, and the second control link as user equipment 120, router 140, first server 161, second server 162, router 140, gateway device 132, and home appliance 110 as an example:

[0114] In the first control link, if the central controller 131 and router 140 fail to upload voice data to the network, devices with network upload capabilities in the second control link, such as user equipment 120, router 140, and gateway device 132, can be used to replace the central controller 131 and router 140 in the first control link.

[0115] In the first control link, if the router 140 and the central controller 131 fail to receive control commands from the network, the devices that receive control commands in the second control link, such as the router 140 and the gateway device 132, can be used to replace the router 140 and the central controller 131 in the first control link.

[0116] In the first control link, if the control command is successfully received, but the central controller 131 cannot send the control command to the home appliance 110, for example, if the communication path between the central controller 131 and the home appliance 110 fails, the gateway device 132 in the second control link can be used to replace the central controller 131 in the first control link.

[0117] Taking the first control device in the first link device and the second control device in the second link device as an example, when the first control device fails, the second control device in the same network segment can be detected; or, when the second control device fails, the first control device in the same network segment can be detected.

[0118] If multiple second control devices are detected, select the second control device corresponding to the voice-controlled home appliance and replace the faulty first control device with the selected second control device; or, if multiple first control devices are detected, select the first control device corresponding to the voice-controlled home appliance and replace the faulty second control device with the selected first control device.

[0119] For example, taking a centralized controller 131 as the first control device and a gateway device 132 as the second control device, when the centralized controller 131 fails, the centralized controller 131 can use the router 140 to find the gateway device 132 within the same network segment, thereby continuing to control the home device 110 through the link "gateway device 132-home device 110". Here, "devices within the same network segment" can refer to devices within the same local area network (LAN). This application is not limited to this; the centralized controller 131 can also pre-store its corresponding gateway device 132; or, the centralized controller 131 can also detect other control devices through environmental detection (e.g., using Bluetooth broadcasting to receive responses from other devices to the broadcast) and then perform docking processing.

[0120] For example, taking a centralized controller 131 as the first control device and a gateway device 132 as the second control device, when the gateway device 132 fails, the gateway device 132 can search for the centralized controller 131 within the same network segment through the router 140. If multiple centralized controllers 131 are found, the gateway device 132 selects the centralized controller 131 corresponding to the home appliance whose voice control failed, and continues to control the home appliance 110 through that centralized controller 131. This application is not limited to this; the gateway device 132 can also pre-store the corresponding centralized controller 131; or, the gateway device 132 can also detect other control devices through environmental detection (e.g., using Bluetooth broadcast to receive responses from other devices to the broadcast) and then perform docking processing.

[0121] In some embodiments, when the first control device fails, a second control device of the same type as the first control device is preferentially detected or selected; or when the second control device fails, a first control device of the same type as the second control device is preferentially detected or selected.

[0122] For example, when a centralized controller fails, another centralized controller should be selected to replace the failed one; similarly, when a gateway device fails, another gateway device should be selected to replace the failed one. If no control device of the same type exists in the air handling system, another type of control device should be reliably detected or selected.

[0123] Since control devices of the same type have the same or similar control actions (for example, the control instructions, control steps, etc. used by control devices of the same type are the same or similar), switching between control devices of the same type can improve switching efficiency, simplify the switching process, and reduce the impact on other devices.

[0124] In some embodiments, the information related to voice control may also include at least one of the following:

[0125] The success rate of operations performed by link devices within a preset time period;

[0126] The average latency of link devices performing operations within a preset time period;

[0127] Real-time load of link devices; or

[0128] Maximum load of the link device.

[0129] Taking the success rate of the link device performing operations within a preset time period as an example, related information on voice control can be used to describe the following steps:

[0130] If the success rate of the first link device performing the operation is lower than a first threshold (the threshold for the success rate of the link device performing the operation) within a preset time period, the first link device is replaced by a second link device in the second control link that is capable of performing the corresponding operation; or,

[0131] If the success rate of the second link device performing the operation is lower than the first threshold within a preset time period, the second link device will be replaced by the first link device in the first control link that is capable of performing the corresponding operation.

[0132] Therefore, when using voice control, it is possible to select a link device with a higher success rate in performing operations over a certain period of time, thereby further improving the success rate of voice control.

[0133] The first threshold and other thresholds described below can be preset values ​​used to determine whether the conditions for actively switching the control link are met.

[0134] Taking the average latency of the link device performing operations within a preset time period as an example, related information for voice control can be included in step 102:

[0135] If the average latency of the first link device performing operations within a preset time period exceeds a second threshold (a threshold for the average latency of the link device performing operations), the first link device is replaced by a second link device in the second control link capable of performing the corresponding operation; or,

[0136] If the average latency of the second link device performing the operation within a preset time period exceeds a second threshold, the second link device is replaced by the first link device in the first control link that is capable of performing the corresponding operation.

[0137] Therefore, when using voice control, it is possible to select a link device with a lower average latency for performing operations over a period of time, thereby further improving the efficiency of voice control.

[0138] Taking voice control-related information as the real-time load of the link device as an example, step 102 may include:

[0139] If the real-time load of the first link device exceeds the third threshold (the threshold for the real-time load of the link device), the first link device is replaced by a second link device in the second control link that is capable of performing the corresponding operation; or,

[0140] If the real-time load of the second link device exceeds the third threshold, the second link device will be replaced by the first link device in the first control link that is capable of performing the corresponding operation.

[0141] Therefore, when using voice control, it is possible to select link devices with lower real-time load, i.e., relatively idle link devices, thereby further improving the efficiency of voice control.

[0142] Taking the maximum and real-time load of the link device as an example, which is related to voice control, step 102 may include:

[0143] If the difference between the maximum load and the real-time load of the first link device is less than the fourth threshold (the threshold for the remaining load of the link device), the first link device is replaced by a second link device in the second control link that is capable of performing the corresponding operation; or,

[0144] If the difference between the maximum load and the real-time load of the second link device is less than the fourth threshold, the second link device is replaced by the first link device in the first control link that is capable of performing the corresponding operation.

[0145] Therefore, when using voice control, it is possible to select link devices with larger remaining loads, i.e., link devices with higher current processing capabilities, thereby further improving the efficiency of voice control.

[0146] In some embodiments, the information related to voice control may also include: the object of voice control.

[0147] For example, in a smart home system, different home devices can be controlled by different control devices. If the object to be controlled by voice cannot be controlled by the current control device, then it is necessary to identify a control device that can control that object and replace the current control device with the identified control device.

[0148] Therefore, smart home systems can automatically select the control device corresponding to the voice-controlled object for different home devices (e.g., home devices located in different spaces), without requiring users to distinguish or select multiple control devices, thus improving the convenience of control and further enhancing the user experience.

[0149] For example, in smart home system 100, gateway device 132 can control all home devices 110 in smart home system 100. Smart home system 100 may include multiple central controllers 131, each controlling a portion of the home devices. For example, the central controller for the bedroom can control the air conditioner in the bedroom, and the central controller for the living room can control the air conditioner in the living room.

[0150] For example, a user issues a voice command to control the bedroom air conditioner from the living room. The central controller in the living room collects and uploads this voice data, and receives the control commands from the network. Since the central controller in the living room cannot control the bedroom air conditioner, the control is switched to the central controller in the bedroom, which then issues the control commands to the bedroom air conditioner.

[0151] In this way, the system can automatically switch control links based on the voice-controlled object, "the air conditioner in the bedroom," so users do not need to understand the correspondence between each central controller and home appliances, thus improving the user experience.

[0152] In some embodiments, when replacing the first link device with a second link device in the second control link that is capable of performing the corresponding operation (i.e., has the same function as the first link device), if there are multiple second link devices capable of performing the corresponding operation, at least one second link device may be selected based on at least one of the following: the success rate of the second link device performing the operation, the average latency of the operation, the real-time load, and the maximum load.

[0153] In some embodiments, when replacing a second link device with a first link device in a first control link that is capable of performing the corresponding operation (i.e., has the same function as the second link device), if there are multiple first link devices capable of performing the corresponding operation, at least one first link device is selected based on at least one of the following: the success rate of the first link device in performing the operation, the average latency of the operation, the real-time load, and the maximum load.

[0154] Therefore, it is possible to select a device with high success rate, short average latency, low real-time load, and high real-time processing capability from among multiple link devices that have the same functions as the link device being replaced. This improves the rationality of device selection and further enhances the efficiency and success rate of voice control.

[0155] Furthermore, multiple link devices with the same function can be selected to jointly control multiple home appliances. Taking the control device among the link devices as an example, when the object of voice control includes multiple home appliances, multiple control devices can be selected to control multiple home appliances respectively. This avoids communication link congestion and improves control efficiency and reliability.

[0156] For example, if a first control device needs to control multiple home appliances, and the first control device has a large real-time load, it can use multiple second control devices to perform distributed control of these multiple home appliances. For instance, the first control device can control some of the multiple home appliances and, through one or more second control devices, control another portion of the multiple home appliances; alternatively, the first control device may not control these home appliances and can only perform distributed control of the multiple home appliances through multiple second control devices.

[0157] For example, in the smart home system 100, the gateway device 132 controls the home appliances in the bedroom, living room, and kitchen. If the gateway device 132 is busy, the centralized controllers for the bedroom, living room, and kitchen can be selected to control the home appliances in those areas respectively. This means that multiple control devices can control multiple home appliances in a distributed manner. Furthermore, the gateway device 100 can also work with multiple control devices to control multiple home appliances simultaneously.

[0158] The following example illustrates step 102 by switching the control link as a whole.

[0159] In some embodiments, information related to voice control may include information indicating whether voice control was successfully executed.

[0160] For example, in step 102, if voice control fails through the first control link, the entire first control link is switched to the second control link, that is, all second link devices in the second control link are used to replace all first link devices in the first control link; or, if voice control fails through the second control link, the entire second control link is switched to the first control link, that is, all first link devices in the first control link are used to replace all second link devices in the second control link.

[0161] In some embodiments, the information related to voice control may also include at least one of the following:

[0162] The success rate of the voice control within a preset time period;

[0163] The average delay of the voice control within a preset time period;

[0164] Control the real-time load of the link; or

[0165] Control the maximum load on the link.

[0166] In this case, step 102 can be performed before or after step 101. For example, based on the success rate of voice control, average latency, or real-time or maximum load of each control link within a preset time period, the control link can be actively switched or selected. This allows for flexible switching of control links in various scenarios, such as those with unstable communication, improving the flexibility and stability of voice control.

[0167] For example, in step 102, if the success rate of the first control link in performing voice control within a preset time period is lower than the fifth threshold (the threshold for the success rate of the control link in performing voice control), the first control link is switched to the second control link as a whole; or, if the success rate of the second control link in performing voice control within a preset time period is lower than the fifth threshold, the second control link is switched to the first control link as a whole.

[0168] For example, in step 102, if the average delay of the first control link performing voice control within a preset time period exceeds the sixth threshold (the threshold for the average delay of the control link performing voice control), the first control link is switched to the second control link as a whole; or, if the average delay of the second control link performing voice control within a preset time period exceeds the sixth threshold, the second control link is switched to the first control link as a whole.

[0169] For example, in step 102, if the real-time load of the first control link is greater than the seventh threshold (the threshold for the real-time load of the control link), the first control link is switched to the second control link as a whole; or, if the real-time load of the second control link is greater than the seventh threshold, the second control link is switched to the first control link as a whole.

[0170] For example, in step 102, if the difference between the maximum load and the real-time load of the first control link is less than the eighth threshold (the threshold of the remaining load of the control link), the first control link is switched to the second control link as a whole; or, if the difference between the maximum load and the real-time load of the second control link is less than the eighth threshold, the second control link is switched to the first control link as a whole.

[0171] In some embodiments, the information related to voice control may also include: the object of voice control.

[0172] For example, in a smart home system, different home devices can be controlled through different control links. If the object to be controlled by voice cannot be controlled by the current control link, then it is necessary to determine the control link that can control the object and replace the current control link with the determined control link.

[0173] Therefore, the smart home system can automatically select the control link corresponding to the object controlled by voice, without requiring the user to distinguish or select multiple control links, thus improving the convenience of control and further enhancing the user experience.

[0174] In some embodiments, when the first control link is completely replaced by the second control link, if there are multiple second control links, at least one second control link can be selected based on at least one of the success rate, average latency, real-time load, and maximum load of the second control link.

[0175] In some embodiments, when the second control link is replaced entirely by the first control link, if there are multiple first control links, at least one first control link can be selected based on at least one of the success rate, average latency, real-time load, and maximum load of the first control link.

[0176] Therefore, it is possible to select links with high success rate, short average latency, low real-time load, and high real-time processing capability from multiple control links, thereby improving the rationality of link selection and further improving the efficiency and success rate of voice control.

[0177] Furthermore, multiple control links can be selected to jointly control multiple home devices. For example, when voice control involves multiple home devices, multiple control links can be selected to control each device separately. This avoids communication link congestion and improves control efficiency and reliability.

[0178] In some embodiments, the first link device and the second link device can be connected via short-range communication. By establishing a short-range communication connection between the first link device and the second link device, when switching control links, control commands can be sent from the first link device to the second link device, or vice versa. This eliminates the need to forward the control commands through an external network (e.g., the Internet 150) or to regenerate them through a server, thereby improving the efficiency of voice control and reducing system load.

[0179] This short-range communication method can include a wired connection. The wired connection can be based on various communication protocols, such as HBS, RS232, RS485, SOCKET, MQTT, etc. The wired connection can take various forms, such as LAN, USB interface, HDMI interface, Ethernet, and VGA interface.

[0180] This short-range communication method can also include wireless connectivity. This wireless connectivity can be based on various communication protocols, such as Wi-Fi, Bluetooth, Zigbee, infrared, NFC, and ultra-wideband communication.

[0181] In some embodiments, the first link device and the second link device can be connected via an external network. Therefore, even if a short-range communication connection is not established between the first link device and the second link device, control commands can be forwarded via an external network, thereby further improving the fault tolerance and reliability of voice control.

[0182] In some embodiments, if voice control still fails after switching the first control link or the second control link, multiple switching operations can be performed.

[0183] In some embodiments, if voice control still fails after switching some link devices in the first control link or the second control link, then all link devices in the first control link or the second control link can be switched. That is, if voice control still fails after partially switching the control link, then the entire control link can be switched.

[0184] In some embodiments, as shown in FIG1, the control method may further include:

[0185] Step 103: In the event of a failure of voice control via the first control link or the second control link, determine the fault type information corresponding to the voice control failure.

[0186] Identifying the fault type corresponding to voice control failure helps resolve issues quickly and improves the user experience.

[0187] In some embodiments, the fault type information may include link device fault, home device fault, line fault, etc.

[0188] In some embodiments, it can be determined whether the voice control has failed based on whether a first response message (e.g., a receipt message indicating that the control command has been successfully executed) has been received corresponding to the voice control.

[0189] For example, after a home appliance completes the operation corresponding to a control command, it can send a first response message indicating the completion of the control command to a first control device via a first control link, or send a first response message indicating the completion of the control command to a second control device via a second control link. If neither the first nor the second control device receives the first response message, the voice control is considered to have failed; otherwise, the voice control is considered to have succeeded.

[0190] In some embodiments, it can be determined whether the fault information is a communication line fault based on whether a second response message (e.g., a receipt message indicating that the control command has been received) has been received for the control command corresponding to the voice control.

[0191] For example, after the first or second control device sends a control command to the home appliance, the home appliance can send a second response message to the first control device via the first control link, or send a second response message to the second control device via the second control link. If the first or second control device does not receive the second response message, a communication line fault can be determined; or, if the first or second control device receives the second response message but does not receive the first response message, the home appliance itself may be faulty.

[0192] In the event of a communication line failure, the control link can be switched. Alternatively, in the event of a malfunction in the home appliance itself, the control link can also be switched to confirm whether the malfunction is indeed caused by the home appliance itself.

[0193] In some embodiments, as shown in FIG1, the control method may further include:

[0194] Step 104: Prompt the user with the fault information via voice broadcast or message push.

[0195] This allows users to understand the fault information of the control link, which helps with subsequent rapid maintenance.

[0196] In some embodiments, the fault information in step 104 can be notified to the user in various ways. For example, the fault information can be broadcast by voice (e.g., broadcast by the voice output unit of the central controller or other devices); or the fault information can be displayed by a display unit (e.g., displayed by the display screen of the central controller or other devices); or the fault information can be notified by message push (e.g., pushed to the user by the application on the user terminal), and so on.

[0197] Figure 3 is another schematic diagram of the voice control method according to an embodiment of this application. As shown in Figure 3, the method may include:

[0198] Step 301: The central controller 131 or user equipment 120 uploads the collected voice data to the server;

[0199] Step 302: The central controller 131 receives control commands from the server;

[0200] Step 303: The central controller 131 controls the home appliances 110 through the first control link;

[0201] Step 304: Determine whether the control was successful; if the determination is yes, proceed to step 305; otherwise, proceed to step 306.

[0202] Step 305: Control ends, and a message indicating successful control is displayed to the user;

[0203] Step 306: Determine whether gateway device 132 exists in the smart home system; if the determination is no, proceed to step 307; otherwise, proceed to step 308.

[0204] Step 307: Prompt the user to report a failure in the first control link;

[0205] Step 308: The central controller 131 sends control commands to the gateway device 132;

[0206] Step 309: Gateway device 132 controls home device 110 through the second control link.

[0207] Figure 4 is another schematic diagram of the voice control method according to an embodiment of this application. As shown in Figure 4, the method may include:

[0208] Step 401: The central controller 131 or user equipment 120 uploads the collected voice data to the server.

[0209] Step 402: Gateway device 132 receives control commands from the server;

[0210] Step 403: Gateway device 132 controls home device 110 through the second control link;

[0211] Step 404: Determine if the control is successful; if yes, proceed to step 405; otherwise, proceed to step 406.

[0212] Step 405: Control ends, and a message indicating successful control is displayed to the user;

[0213] Step 406: Determine whether a centralized controller 131 exists in the smart home system; if the determination is no, proceed to step 407; otherwise, proceed to step 408.

[0214] Step 407: Prompt the user to report a failure in the second control link;

[0215] Step 408: Gateway device 132 sends control commands to centralized controller 131;

[0216] Step 409: The central controller 131 controls the home appliances 110 through the first control link.

[0217] It is worth noting that the above figures are merely illustrative of embodiments of this application, and the application is not limited thereto. For example, the execution order between various operations can be appropriately adjusted, and other operations can be added or some operations can be removed (e.g., the operations or steps corresponding to the dashed boxes in the figures). Those skilled in the art can make appropriate modifications based on the above description, and are not limited to the description in the above figures.

[0218] The above embodiments are merely illustrative examples of embodiments of this application, but this application is not limited thereto, and appropriate modifications can be made based on the above embodiments. For example, the above embodiments can be used alone, or one or more of the above embodiments can be combined.

[0219] According to the above embodiments, home appliances can be voice-controlled via a first control link or a second control link. The first control link includes a first link device and the home appliance, and the second control link includes a second link device and the home appliance. This arrangement of multiple control links for home appliances improves the fault tolerance and reliability of voice control, thus enhancing the user experience.

[0220] Based on information related to voice control, the system switches between the first and second control links. This allows for flexible selection of appropriate control links or devices to control home appliances via voice, enabling the system to autonomously resolve or avoid problems and further improving the fault tolerance of voice control. Furthermore, it can adapt to various scenarios, such as unstable communication or the need to control home appliances in different target spaces, flexibly selecting control links or devices to enhance the flexibility and stability of voice control.

[0221] When using voice control, it is possible to select a link device or control link with a higher success rate over a certain period of time, thereby further improving the success rate of voice control.

[0222] When using voice control, it is possible to select a link device or control link with a low average latency over a period of time, thereby further improving the efficiency of voice control.

[0223] When using voice control, it is possible to select link devices or control links with lower real-time load, thereby further improving the efficiency of voice control.

[0224] When using voice control, it is possible to select link devices or control links with larger remaining loads, thereby further improving the efficiency of voice control.

[0225] When using voice control, the system can select the control device based on the object being controlled. As a result, the smart home system can automatically select the control device corresponding to the object being controlled by voice for different home devices (e.g., home devices located in different spaces), without requiring the user to distinguish or select multiple control devices, thus improving the convenience of control and further enhancing the user experience.

[0226] When a control device fails, other control devices of the same type as the failed device can be prioritized for detection or selection. These selected devices can then replace the failed device. For example, if a central controller fails, another central controller can be prioritized; similarly, if a gateway device fails, another gateway device can be prioritized. Since control devices of the same type have identical or similar control actions (e.g., the format of control instructions and control steps used by control devices of the same type are identical or similar), switching between control devices of the same type can improve switching efficiency, simplify the switching process, and reduce the impact on other devices.

[0227] By establishing a short-range communication connection between the first link device and the second link device, when switching control links, control commands can be sent from the first link device to the second link device, or vice versa. This eliminates the need to forward the control commands through an external network or regenerate them through a server, thereby improving the efficiency of voice control and reducing system load.

[0228] The first and second link devices are connected through an external network. Therefore, even if a short-distance communication connection is not established between the first and second link devices, control commands can still be forwarded through the external network, thereby further improving the fault tolerance and reliability of voice control.

[0229] Identifying the fault type corresponding to voice control failure helps resolve issues quickly and improves the user experience.

[0230] By notifying users of the fault information through voice broadcast or message push, users can understand the fault information of the control link, which helps to facilitate subsequent rapid repair. Example 2

[0231] Embodiment 2 of this application provides a smart home system, which corresponds to the method described in Embodiment 1. For details, please refer to the description in Embodiment 1.

[0232] Figure 5 is a schematic diagram of a smart home system according to an embodiment of this application. As shown in Figure 5, the smart home system 500 includes a first control link 510 (shown in the dotted-line box in Figure 5) and a second control link 520 (shown in the dashed-line box in Figure 5). The first control link 510 includes a first link device 511 and a home device 512, and the second control link 520 includes a second link device 521 and the home device 512. The smart home system 500 performs voice control on the home device 512 through the first control link 510 or the second control link 520.

[0233] The specific processing procedures for each of the above devices can be found in the relevant descriptions in Example 1, and will not be repeated here.

[0234] According to the above embodiments, home appliances can be voice-controlled via a first control link or a second control link. The first control link includes a first link device and the home appliance, and the second control link includes a second link device and the home appliance. This arrangement of multiple control links for home appliances improves the fault tolerance and reliability of voice control, thus enhancing the user experience.

[0235] Based on information related to voice control, the system switches between the first and second control links. This allows for flexible selection of appropriate control links or devices to control home appliances via voice, enabling the system to autonomously resolve or avoid problems and further improving the fault tolerance of voice control. Furthermore, it can adapt to various scenarios, such as unstable communication or the need to control home appliances in different target spaces, flexibly selecting control links or devices to enhance the flexibility and stability of voice control.

[0236] When using voice control, it is possible to select a link device or control link with a higher success rate over a certain period of time, thereby further improving the success rate of voice control.

[0237] When using voice control, it is possible to select a link device or control link with a low average latency over a period of time, thereby further improving the efficiency of voice control.

[0238] When using voice control, it is possible to select link devices or control links with lower real-time load, thereby further improving the efficiency of voice control.

[0239] When using voice control, it is possible to select link devices or control links with larger remaining loads, thereby further improving the efficiency of voice control.

[0240] When using voice control, the system can select the control device based on the object being controlled. As a result, the smart home system can automatically select the control device corresponding to the object being controlled by voice for different home devices (e.g., home devices located in different spaces), without requiring the user to distinguish or select multiple control devices, thus improving the convenience of control and further enhancing the user experience.

[0241] When a control device fails, other control devices of the same type as the failed device can be prioritized for detection or selection. These selected devices can then replace the failed device. For example, if a central controller fails, another central controller can be prioritized; similarly, if a gateway device fails, another gateway device can be prioritized. Since control devices of the same type have identical or similar control actions (e.g., the format of control instructions and control steps used by control devices of the same type are identical or similar), switching between control devices of the same type can improve switching efficiency, simplify the switching process, and reduce the impact on other devices.

[0242] By establishing a short-range communication connection between the first link device and the second link device, when switching control links, control commands can be sent from the first link device to the second link device, or vice versa. This eliminates the need to forward the control commands through an external network or regenerate them through a server, thereby improving the efficiency of voice control and reducing system load.

[0243] The first and second link devices are connected through an external network. Therefore, even if a short-distance communication connection is not established between the first and second link devices, control commands can still be forwarded through the external network, thereby further improving the fault tolerance and reliability of voice control.

[0244] Identifying the fault type corresponding to voice control failure helps resolve issues quickly and improves the user experience.

[0245] By notifying users of the fault information through voice broadcast or message push, users can understand the fault information of the control link, which helps to facilitate subsequent rapid repair. Example 3

[0246] Embodiment 3 of this application provides a voice control device. This voice control device corresponds to the voice control method described in Embodiment 1, and the specific details can be found in Embodiment 1.

[0247] Figure 6 is a schematic diagram of a voice control device according to an embodiment of this application. As shown in Figure 6, the device 600 includes a control unit 610.

[0248] The control unit 610 performs voice control of home appliances via a first control link or a second control link. The first control link includes a first link device and the home appliances, and the second control link includes a second link device and the home appliances.

[0249] The specific functions of each of the above units can be found in the relevant steps in Embodiment 1, and will not be repeated here.

[0250] It is worth noting that the above description only covers the components or modules relevant to this application, but this application is not limited thereto. The voice control device may also include other components or modules, or omit some components or modules (e.g., the components or modules corresponding to the dashed boxes in the figures). For details regarding these components or modules, please refer to related technologies.

[0251] Furthermore, for simplicity, the above figures only exemplify the connection relationships or signal flows between the various components or modules. However, those skilled in the art should understand that various related technologies, such as bus connections, can be employed. The aforementioned components or modules can be implemented using hardware facilities such as processors, memory, transmitters, and receivers; this application does not limit this implementation.

[0252] According to the above embodiments, home appliances can be voice-controlled via a first control link or a second control link. The first control link includes a first link device and the home appliance, and the second control link includes a second link device and the home appliance. This arrangement of multiple control links for home appliances improves the fault tolerance and reliability of voice control, thus enhancing the user experience.

[0253] Based on information related to voice control, the system switches between the first and second control links. This allows for flexible selection of appropriate control links or devices to control home appliances via voice, enabling the system to autonomously resolve or avoid problems and further improving the fault tolerance of voice control. Furthermore, it can adapt to various scenarios, such as unstable communication or the need to control home appliances in different target spaces, flexibly selecting control links or devices to enhance the flexibility and stability of voice control.

[0254] When using voice control, it is possible to select a link device or control link with a higher success rate over a certain period of time, thereby further improving the success rate of voice control.

[0255] When using voice control, it is possible to select a link device or control link with a low average latency over a period of time, thereby further improving the efficiency of voice control.

[0256] When using voice control, it is possible to select link devices or control links with lower real-time load, thereby further improving the efficiency of voice control.

[0257] When using voice control, it is possible to select link devices or control links with larger remaining loads, thereby further improving the efficiency of voice control.

[0258] When using voice control, the system can select the control device based on the object being controlled. As a result, the smart home system can automatically select the control device corresponding to the object being controlled by voice for different home devices (e.g., home devices located in different spaces), without requiring the user to distinguish or select multiple control devices, thus improving the convenience of control and further enhancing the user experience.

[0259] When a control device fails, other control devices of the same type as the failed device can be prioritized for detection or selection. These selected devices can then replace the failed device. For example, if a central controller fails, another central controller can be prioritized; similarly, if a gateway device fails, another gateway device can be prioritized. Since control devices of the same type have identical or similar control actions (e.g., the format of control instructions and control steps used by control devices of the same type are identical or similar), switching between control devices of the same type can improve switching efficiency, simplify the switching process, and reduce the impact on other devices.

[0260] By establishing a short-range communication connection between the first link device and the second link device, when switching control links, control commands can be sent from the first link device to the second link device, or vice versa. This eliminates the need to forward the control commands through an external network or regenerate them through a server, thereby improving the efficiency of voice control and reducing system load.

[0261] The first and second link devices are connected through an external network. Therefore, even if a short-distance communication connection is not established between the first and second link devices, control commands can still be forwarded through the external network, thereby further improving the fault tolerance and reliability of voice control.

[0262] Identifying the fault type corresponding to voice control failure helps resolve issues quickly and improves the user experience.

[0263] By notifying users of the fault information through voice broadcast or message push, users can understand the fault information of the control link, which helps to facilitate subsequent rapid repair. Example 4

[0264] Embodiment 4 of this application provides an electronic device. The steps executed by the processor of this electronic device correspond to all or part of the steps of the voice control method described in Embodiment 1, and the specific details can be found in the description of Embodiment 1.

[0265] Figure 7 is a schematic diagram of the configuration of an electronic device according to an embodiment of this application. As shown in Figure 7, the electronic device 700 may include a processor 710 and a memory 720; the memory 720 is coupled to the processor 710. It is worth noting that this figure is exemplary; other types of structures may also be used to supplement or replace this structure to implement telecommunications functions or other functions.

[0266] In one embodiment, the processor 710 may be configured to perform voice control of home appliances via a first control link or a second control link, wherein the first control link includes a first link device and the home appliances, and the second control link includes a second link device and the home appliances.

[0267] As shown in Figure 7, the electronic device 700 may further include: a communication module 730, an input unit 740, a display 750, a speaker 760, a microphone 770, and a power supply 780. It is worth noting that the electronic device 700 does not necessarily include all the components shown in Figure 7; furthermore, the electronic device 700 may also include components not shown in Figure 7, which can be found in related technologies.

[0268] As shown in Figure 7, the processor 710, sometimes also referred to as a controller or operation control, may include a microprocessor or other processor device and / or logic device. The processor 710 receives input and controls the operation of various components of the electronic device 700.

[0269] The memory 720 may be, for example, one or more of a cache, flash memory, hard drive, removable medium, volatile memory, non-volatile memory, or other suitable means. It can store various types of data, and also stores programs for executing related information. The processor 710 can execute the program stored in the memory 720 to perform information storage or processing, etc. The functions of other components are similar to those in existing systems and will not be described further here. The components of the electronic device 700 can be implemented using dedicated hardware, firmware, software, or a combination thereof without departing from the scope of the invention.

[0270] According to the above embodiments, home appliances can be voice-controlled via a first control link or a second control link. The first control link includes a first link device and the home appliance, and the second control link includes a second link device and the home appliance. This arrangement of multiple control links for home appliances improves the fault tolerance and reliability of voice control, thus enhancing the user experience.

[0271] Based on information related to voice control, the system switches between the first and second control links. This allows for flexible selection of appropriate control links or devices to control home appliances via voice, enabling the system to autonomously resolve or avoid problems and further improving the fault tolerance of voice control. Furthermore, it can adapt to various scenarios, such as unstable communication or the need to control home appliances in different target spaces, flexibly selecting control links or devices to enhance the flexibility and stability of voice control.

[0272] When using voice control, it is possible to select a link device or control link with a higher success rate over a certain period of time, thereby further improving the success rate of voice control.

[0273] When using voice control, it is possible to select a link device or control link with a low average latency over a period of time, thereby further improving the efficiency of voice control.

[0274] When using voice control, it is possible to select link devices or control links with lower real-time load, thereby further improving the efficiency of voice control.

[0275] When using voice control, it is possible to select link devices or control links with larger remaining loads, thereby further improving the efficiency of voice control.

[0276] When using voice control, the system can select the control device based on the object being controlled. As a result, the smart home system can automatically select the control device corresponding to the object being controlled by voice for different home devices (e.g., home devices located in different spaces), without requiring the user to distinguish or select multiple control devices, thus improving the convenience of control and further enhancing the user experience.

[0277] When a control device fails, other control devices of the same type as the failed device can be prioritized for detection or selection. These selected devices can then replace the failed device. For example, if a central controller fails, another central controller can be prioritized; similarly, if a gateway device fails, another gateway device can be prioritized. Since control devices of the same type have identical or similar control actions (e.g., the format of control instructions and control steps used by control devices of the same type are identical or similar), switching between control devices of the same type can improve switching efficiency, simplify the switching process, and reduce the impact on other devices.

[0278] By establishing a short-range communication connection between the first link device and the second link device, when switching control links, control commands can be sent from the first link device to the second link device, or vice versa. This eliminates the need to forward the control commands through an external network or regenerate them through a server, thereby improving the efficiency of voice control and reducing system load.

[0279] The first and second link devices are connected via an external network. Thus, even if a short-distance communication connection is not established between the first and second link devices, control commands can still be forwarded through the external network, thereby further improving the fault tolerance and reliability of voice control.

[0280] Identifying the fault type corresponding to voice control failure helps resolve issues quickly and improves the user experience.

[0281] By notifying users of the fault information through voice broadcast or message push, users can understand the fault information of the control link, which helps to facilitate subsequent rapid repair.

[0282] This application also provides a computer-readable program, wherein when the program is executed, the program causes the computer to perform the voice control method described in this application.

[0283] This application also provides a computer-readable storage medium storing a computer program that causes a computer to execute the voice control method described in this application.

[0284] This application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the voice control method described in this application.

[0285] The apparatus and methods described above in the embodiments of this application can be implemented in hardware or in combination with software. This application relates to a computer-readable program that, when executed by a logic component, enables the logic component to implement the apparatus or constituent parts described above, or to implement the various methods or steps described above.

[0286] This application also relates to storage media for storing the above programs, such as hard disks, magnetic disks, optical disks, DVDs, flash memory, etc.

[0287] It should be noted that the limitations on each step involved in this application are not considered as limiting the order of steps, provided that they do not affect the implementation of the specific solution. The steps listed first can be performed first, later, or even simultaneously. As long as the solution can be implemented, they should be considered to fall within the scope of protection of this application.

[0288] The present application has been described above with reference to specific embodiments. However, those skilled in the art should understand that these descriptions are exemplary and not intended to limit the scope of protection of the present application. Those skilled in the art can make various modifications and variations to the present application based on its spirit and principles, and these modifications and variations are also within the scope of the present application.

[0289] The voice control method, apparatus, device, storage medium, and program products of this application can be applied to various home appliances and home systems.

[0290] 100: Smart home system; 110, 110-1, 110-2, 110-3, 110-4, 110-5: Home appliances; 120: User terminal; 131: Central controller; 132: Gateway device; 140: Router; 150: Internet; 161: First server; 162: Second server; 500: Smart home system; 510: First control link; 520: Second control link; 511: First link device; 512: Home appliance; 521: Second link device; 600: Voice control device; 610: Control unit; 700: Electronic device; 710: Processor; 720: Memory; 730: Communication module; 740: Input unit; 750: Display; 760: Speaker; 770: Microphone; 780: Power supply.

Claims

A voice control method, characterized by, The method includes: voice control of home appliances via a first control link or a second control link, wherein the first control link includes a first link device and the home appliances, and the second control link includes a second link device and the home appliances. The method of claim 1, wherein The method further includes: switching the first control link or the second control link based on information related to the voice control. The method according to claim 2, characterized in that The switching of the first control link includes: replacing at least one first link device in the first control link with at least one second link device in the second control link; or the switching of the second control link includes: replacing at least one second link device in the second control link with at least one first link device in the first control link. The method according to claim 3, characterized in that Information related to the voice control includes information about the type of fault in the voice control. The method according to claim 4, characterized in that Switching between the first control link and the second control link based on information related to the voice control includes: determining a first link device in the first control link corresponding to the fault type based on the fault type information, and replacing the first link device with a second link device in the second control link capable of performing the corresponding operation; or determining a second link device in the second control link corresponding to the fault type based on the fault type information, and replacing the second link device with a first link device in the first control link capable of performing the corresponding operation. The method according to claim 5, characterized in that The first link device includes a first control device, and the second link device includes a second control device. When the first control device fails, the second control device within the same network segment is detected; or when the second control device fails, the first control device within the same network segment is detected. The method according to claim 6, characterized in that If multiple second control devices are detected, select the second control device corresponding to the voice-controlled home appliance and replace the faulty first control device with the selected second control device. Alternatively, if multiple first control devices are detected, the first control device corresponding to the voice-controlled home appliance is selected, and the selected first control device is used to replace the faulty second control device; or, if the first control device fails, a second control device of the same type as the first control device is detected or selected first; or if the second control device fails, a first control device of the same type as the second control device is detected or selected first. The method according to claim 3, characterized in that Information related to the voice control includes at least one of the following: the success rate of the link device performing operations within a preset time period; the average latency of the link device performing operations within a preset time period; the real-time load of the link device; or the maximum load of the link device. The method of claim 8, wherein Based on information related to the voice control, switching between the first control link and the second control link includes: replacing the first link device with a second link device capable of performing the corresponding operation within the second control link when the success rate of the first link device performing the operation within a preset time period is lower than a first threshold, or the average latency of the first link device performing the operation within the preset time period exceeds a second threshold, or the real-time load of the first link device is greater than a third threshold, or the difference between the maximum load and the real-time load of the first link device is less than a fourth threshold; or replacing the second link device with a first link device capable of performing the corresponding operation within the first control link when the success rate of the second link device performing the operation within the preset time period is lower than a first threshold, or the average latency of the second link device performing the operation within the preset time period exceeds a second threshold, or the real-time load of the second link device is greater than a third threshold, or the difference between the maximum load and the real-time load of the second link device is less than a fourth threshold. The method according to claim 5 or 9, characterized in that When replacing the first link device with a second link device capable of performing the corresponding operation in the second control link, if there are multiple second link devices capable of performing the corresponding operation, at least one second link device shall be selected based on at least one of the following: the success rate of the second link device performing the operation, the average latency of the operation, the real-time load, and the maximum load. Alternatively, when replacing the second link device with a first link device capable of performing the corresponding operation in the first control link, if there are multiple first link devices capable of performing the corresponding operation, at least one first link device shall be selected based on at least one of the following: the success rate of the first link device performing the operation, the average latency of the operation, the real-time load, and the maximum load. The method according to claim 3, characterized in that The information related to the voice control includes at least one of the following: information indicating whether the voice control was successfully executed; The success rate of the voice control within a preset time period; The average latency of the voice control within a preset time period; the real-time load of the control link; or the maximum load of the control link. The method of claim 11, wherein Switching between the first control link and the second control link based on information related to the voice control includes: replacing all first link devices in the first control link with all second link devices in the second control link when voice control via the first control link fails, or the success rate of voice control via the first control link within a preset time period is lower than a fifth threshold, or the average latency of the first control link within a preset time period exceeds a sixth threshold, or the real-time load of the first control link is greater than a seventh threshold, or the difference between the maximum load and the real-time load of the first control link is less than an eighth threshold; or replacing all second link devices in the second control link with all first link devices in the first control link when voice control via the second control link fails, or the success rate of voice control via the second control link within a preset time period is lower than a fifth threshold, or the average latency of the second control link within a preset time period exceeds a sixth threshold, or the real-time load of the second control link is greater than a seventh threshold, or the difference between the maximum load and the real-time load of the second control link is less than an eighth threshold. The method according to claim 2, characterized in that The first link device and the second link device are connected via short-range communication; or the first link device and the second link device are connected via an external network. The method of claim 1, wherein The method further includes: in the event of a failure of voice control via the first control link or the second control link, determining information on the fault type corresponding to the voice control failure. The method of claim 14, wherein The method further includes: prompting the user with information about the fault type through voice broadcast, message push, or display. A smart home system characterized by The system includes a first control link and a second control link. The first control link includes a first link device and a home appliance, and the second control link includes a second link device and the home appliance. The system performs voice control on the home appliance through the first control link or the second control link. A voice control device characterized by comprising: The device includes a control unit that performs voice control of home appliances via a first control link or a second control link, wherein the first control link includes a first link device and the home appliances, and the second control link includes a second link device and the home appliances. An electronic device, characterized by comprising: The electronic device includes: a memory storing a computer program; and a processor that, when executing the computer program, implements the method of any one of claims 1-15. A computer-readable storage medium having stored thereon a computer program, characterized in that When the computer program is executed by a processor, it implements the method described in any one of claims 1-15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, it implements the method described in any one of claims 1-15.

Images