Voice control method, device, equipment, system, storage medium and program product
By acquiring voice data related to user expectations and feelings to generate control commands, and controlling home appliances after accuracy determination, the problem of inaccurate control caused by unclear user intentions in existing technologies is solved, realizing intelligent and personalized voice control and improving user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- DAIKIN INDUSTRIES LTD
- Filing Date
- 2024-12-18
- Publication Date
- 2026-06-19
Smart Images

Figure CN122245304A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of equipment control, and in particular to a voice control method, apparatus, device, system, storage medium, and program product. Background Technology
[0002] With the development of science and technology and urban construction, voice recognition technology is gradually being applied to all aspects of people's lives. For example, in office buildings, apartments, schools, shopping malls and other places, devices that can be controlled based on voice, such as smart home devices based on voice control, are becoming increasingly popular.
[0003] As smart home devices become more widespread, users' demands for these devices are also gradually increasing. For example, users hope that home devices can be more intelligent and accurately understand their actual control intentions.
[0004] Current home appliance control systems can only control devices based on voice data that expresses precise control intentions. If the acquired voice data does not express precise control intentions, accurate control commands cannot be generated. When controlling devices based on these commands, the user experience is unsatisfactory and diminishes the overall user experience.
[0005] It should be noted that the above introduction to the technical background is only for the purpose of providing a clear and complete explanation of the technical solutions of this application and facilitating understanding by those skilled in the art. It should not be assumed that these technical solutions are known to those skilled in the art simply because they have been described in the background section of this application. Summary of the Invention
[0006] The inventors discovered that controlling home appliances based on voice data that expresses precise control intentions requires users to speak clear control commands, which places high demands on users and makes control difficult. In addition, control commands generated from voice data may not match the actual control scenario, such as being unreasonable, or the control commands generated from voice data may deviate significantly from the user's actual intention, such as being mismatched with the user's actual intention. If home appliances are controlled based on such control commands, it is easy to cause misoperation, fail to achieve the user's expected effect, and reduce the user experience.
[0007] To address at least one of the aforementioned problems, embodiments of this application provide a voice control method, apparatus, device, system, storage medium, and program product.
[0008] According to a first aspect of the embodiments of this application, a voice control method is provided, comprising: acquiring a control command for controlling home appliances generated based on voice data, wherein the voice data includes information related to the user's expected feelings; and determining the accuracy of the control command, and, if the control command is accurate, controlling the home appliances according to the control command.
[0009] According to a second aspect of the embodiments of this application, a voice control system is provided, comprising: a control device and at least one home appliance, wherein the control device acquires control instructions for controlling the home appliance generated based on voice data, wherein the voice data includes information related to the user's expected feelings, and, if the control instructions are accurate, controls the home appliance according to the control instructions.
[0010] According to a third aspect of the embodiments of this application, a voice control device is provided, comprising: an instruction acquisition unit that acquires control instructions for controlling home appliances generated based on voice data, wherein the voice data includes information related to the user's expected feelings; and a control unit that determines the accuracy of the control instructions and, if the control instructions are accurate, controls the home appliances according to the control instructions.
[0011] According to a fourth aspect of the present application, an electronic device is provided, the electronic device comprising: a memory storing a computer program; and a processor executing the computer program to implement the method described in the first aspect of the present application.
[0012] According to a fifth aspect of the present application, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the method described in the first aspect of the present application.
[0013] According to a sixth aspect of the embodiments of this application, a computer program product is provided, which includes a computer program that, when executed by a processor, implements the method described in the first aspect of the embodiments of this application.
[0014] One of the beneficial effects of the embodiments of this application is that:
[0015] For control commands generated based on inferences from voice data, including information related to the user's expected feelings, further verification is performed before execution; that is, the accuracy of the control command is determined. If the control command is accurate, the home appliances are controlled according to the control command.
[0016] On the one hand, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of devices, thereby reducing the threshold and difficulty for users to control home appliances, realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting users' personalized needs.
[0017] On the other hand, after generating control commands based on voice data including information related to the user's expected feelings, the accuracy of the control commands is determined. If the commands are accurate, the home appliances are controlled according to the commands. This significantly reduces the possibility of misoperation and ensures that the executed control commands match the user's actual intentions, further guaranteeing the user experience.
[0018] Furthermore, the accuracy of control commands is determined based on at least one of the rationality of the control command and the matching of the control command with the user's control intention. This allows for a comprehensive consideration of whether the control command meets the actual scenario requirements and whether the control command deviates too much from the user's actual intention, thus ensuring the user experience.
[0019] Furthermore, the aforementioned rationality is determined based on at least one of feasibility, comfort, and energy efficiency, thereby enabling a comprehensive consideration of factors such as equipment, users, environment, and cost in determining the rationality of control commands. This results in a more accurate rationality determination that aligns with the user's actual intentions.
[0020] Furthermore, by combining the actual situation of the target space to determine the feasibility, comfort, and energy efficiency of control commands, a variety of different usage scenarios and user needs can be comprehensively considered to make the above-mentioned rationality judgment, thereby further improving the accuracy of the rationality judgment results and the degree of alignment with the user's actual intentions.
[0021] Furthermore, by combining the actual capabilities of the first home appliance in the target space with the environmental parameters that need to be adjusted and their target values related to the control commands to determine the feasibility, the accuracy and reliability of the feasibility determination results can be guaranteed.
[0022] Furthermore, if the first home appliance in the target space cannot adjust all the necessary environmental parameters, the control command is considered unexecutable. That is, if even one environmental parameter cannot be adjusted, the control command is considered unexecutable. This allows for a rigorous determination of executability. From another perspective, a control command deemed executable can adjust all the necessary environmental parameters, thus ensuring the effectiveness of the control command and reliably achieving the user's expected experience.
[0023] Furthermore, if the first home appliance in the target space cannot adjust certain environmental parameters that require adjustment, and if there are many such unadjustable environmental parameters or if these are necessary / important environmental parameters, the control command can be considered unexecutable. Therefore, the executableness criteria can be appropriately relaxed, thereby improving the success rate of control commands and avoiding too many situations where control commands cannot be executed or where user interaction is required.
[0024] Furthermore, if the first home appliance in the target space cannot adjust all the necessary environmental parameters to the target value, the control command is considered unexecutable. That is, if even one environmental parameter cannot be adjusted to the target value, the control command is considered unexecutable. This allows for a rigorous determination of executability. From another perspective, a control command deemed executable can adjust all the necessary environmental parameters to the target value, thus ensuring the effectiveness of the control command and reliably achieving the user's expected experience.
[0025] Furthermore, if the first home appliance in the target space fails to adjust certain environmental parameters to the target value, and if there are many such parameters that cannot be adjusted to the target value, or if these parameters are necessary / important, then the control command can be considered unexecutable. Therefore, the executableness criteria can be appropriately relaxed, thereby improving the success rate of control commands and avoiding too many situations where control commands cannot be executed or where user interaction is required.
[0026] Furthermore, by combining information about the first home appliance in the target space with the environmental parameters that need to be adjusted and their target values related to the control commands to determine energy efficiency, the accuracy and reliability of the energy efficiency determination results can be guaranteed.
[0027] Furthermore, if a control command is unreasonable, the home appliances will not be controlled according to that command, thereby reducing the possibility of misoperation. Interacting with the user further clarifies the user's actual intentions, further ensuring a better user experience.
[0028] Furthermore, by interacting with users and providing them with information about unreasonable control commands, users can understand why the control commands cannot be executed, making it easier for them to perform subsequent operations in a targeted manner.
[0029] Furthermore, by interacting with users and providing them with recommended control commands, users can easily select the commands that match their desired experience, reducing the difficulty of control and ensuring a better user experience.
[0030] Furthermore, in the event that the control commands are not executable, generating recommended control commands based on the capabilities of the first home appliance in the target space can ensure the executableness of the recommended control commands, thereby helping to ensure the rationality of the recommended control commands.
[0031] Furthermore, when control commands lack comfort features, generating recommended control commands by combining comfort-related parameters of the target space can ensure the comfort of the recommended control commands, thereby helping to guarantee their rationality.
[0032] Furthermore, when control commands lack energy efficiency, generating recommended control commands by combining the energy efficiency-related parameters of the primary home appliances in the target space can ensure the energy efficiency of the recommended control commands, thereby helping to guarantee their rationality.
[0033] Furthermore, by interacting with users, updating control commands using recommended control instructions, and controlling home appliances based on the updated control commands, the actual intentions of users can be further clarified, which helps to reliably realize the user's expected experience and ensure the user's user experience.
[0034] Furthermore, when it is determined that the control command does not match the user's control intention, the system does not control the home appliances or interact with the user based on the control command. Instead, it corrects the control command based on the user's feedback and controls the home appliances according to the corrected command. This allows for control of home appliances in a way that more closely matches the user's actual control intention, helping to accurately meet the user's needs, reduce user inconvenience, improve the intelligence level of the voice control system, facilitate the refinement of user profiles, and provide customized services.
[0035] Furthermore, the accuracy of control commands is determined by the control equipment. Even if the external network or server fails or cannot be connected in the voice control system, the accuracy of the control commands can still be confirmed, thus improving the reliability of the voice control system.
[0036] Furthermore, the accuracy of control commands is determined by the server, which reduces the requirements for local control equipment, helps to reduce the cost of control equipment, and facilitates the widespread adoption of control equipment.
[0037] Specific embodiments of this application are disclosed in detail with reference to the following description and accompanying drawings, indicating how the principles of this application can be adopted. It should be understood that the embodiments of this application are not limited in scope. Within the spirit and scope of the appended claims, embodiments of this application include many changes, modifications, and equivalents.
[0038] The feature information described and illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, combined with feature information in other embodiments, or substituted for feature information in other embodiments.
[0039] It should be emphasized that the term "including / comprises" as used herein refers to the presence of a feature, whole, step, or component, but does not exclude the presence or addition of one or more other features, wholes, steps, or components. Attached Figure Description
[0040] Many aspects of this application can be better understood by referring to the following accompanying drawings. The components in the drawings are not drawn to scale, but are only intended to illustrate the principles of this application. Corresponding portions in the drawings may be enlarged or reduced for ease of illustration and description of certain parts of this application. Elements and features described in one drawing or embodiment of this application may be combined with elements and features shown in one or more other drawings or embodiments. Furthermore, similar reference numerals in the drawings denote corresponding components in several drawings and can be used to indicate corresponding components used in more than one embodiment.
[0041] In the attached diagram:
[0042] Figure 1 This is a schematic diagram of a voice control method according to an embodiment of this application;
[0043] Figure 2 This is another schematic diagram of the voice control method according to an embodiment of this application;
[0044] Figure 3 This is a schematic diagram of a voice control system according to an embodiment of this application;
[0045] Figure 4 This is a configuration diagram of the voice control system used in the control method of this application embodiment;
[0046] Figure 5 This is a schematic diagram of a voice control device according to an embodiment of this application;
[0047] Figure 6 This is a schematic diagram of an electronic device according to an embodiment of this application. Detailed Implementation
[0048] The preferred embodiments of this application will now be described with reference to the accompanying drawings.
[0049] Example 1
[0050] Embodiment 1 of this application provides a voice control method.
[0051] Figure 1 This is a schematic diagram of a voice control method according to an embodiment of this application. Figure 1 As shown, the method includes:
[0052] Step 101: Obtain control commands for controlling home appliances generated based on voice data, wherein the voice data includes information related to the user's expected feelings; and
[0053] Step 102: Determine the accuracy of the control command. If the control command is accurate, control the home appliances according to the control command.
[0054] According to the above embodiments, for control commands generated based on inferences from voice data including information related to the user's expected feelings, further confirmation is performed before executing the control command; that is, the accuracy of the control command is determined. If the control command is accurate, the home appliances are controlled according to the control command.
[0055] On the one hand, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of devices, thereby reducing the threshold and difficulty for users to control home appliances, realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting users' personalized needs.
[0056] On the other hand, after generating control commands based on voice data including information related to the user's expected feelings, the accuracy of the control commands is determined. If the commands are accurate, the home appliances are controlled according to the commands. This significantly reduces the possibility of misoperation and ensures that the executed control commands match the user's actual intentions, further guaranteeing the user experience.
[0057] The voice control method of this application is not only applicable to home scenarios, such as residences and apartments, but also to commercial or public scenarios such as office buildings, shopping malls, schools, and factories. This application does not limit the application scenarios of the voice control method.
[0058] The voice control method of this application embodiment is used to control home devices. The home devices in this application embodiment can be various devices deployed in various application scenarios such as home scenarios, commercial scenarios or public scenarios to adjust the indoor environment or meet user needs. This application embodiment does not limit the types of home devices.
[0059] The voice control method of this application embodiment can control home appliances in a target space, that is, the target space is an indoor space that serves as the target for environmental regulation.
[0060] The target space in this application embodiment may include one or more indoor spaces, such as a living room, bedroom, kitchen, bathroom, etc.
[0061] In some embodiments, home appliances may be smart home appliances, such as air handling equipment and smart devices.
[0062] For example, smart devices include at least one of smart speakers, smart display devices, smart switches, smart curtains, smart lighting devices, sensors, and smart pet devices.
[0063] In some embodiments, the air handling unit affects the indoor space within the target space.
[0064] For example, at least one air handling unit is installed in the target space. In some embodiments, indoor units are installed in each indoor space within the target space, or indoor units are installed in some indoor spaces within the target space.
[0065] For example, air handling equipment can be associated with indoor spaces in a target space. For instance, the correspondence between air handling equipment and indoor spaces can be determined through the binding information of the air handling equipment.
[0066] In some embodiments, the air handling unit may not be installed in the target space's interior space, but it may still affect the target space's interior space. For example, a fresh air unit with its main unit installed above the ceiling.
[0067] In some embodiments, the air handling equipment includes at least one of an indoor unit, a humidifier, a dehumidifier, a fresh air system, an air purifier, a fragrance component, a floor heating system, and a valve assembly.
[0068] In addition, air handling equipment can also be called air conditioning equipment.
[0069] In some embodiments, the indoor unit is an indoor unit in an air handling system that includes air handling equipment, and the air handling system may include a commercial air conditioning system or a residential air conditioning system.
[0070] In some embodiments, an air conditioning system may include at least one set of outdoor units and at least one indoor unit connected to each set of outdoor units. That is, an air conditioning system may include one or more sets of outdoor units, each set of outdoor units including at least one outdoor unit; for each set of outdoor units, the set of outdoor units is connected to at least one indoor unit.
[0071] For example, an air conditioning system includes an outdoor unit and an indoor unit connected to the outdoor unit.
[0072] For example, an air conditioning system includes an outdoor unit and at least two indoor units connected to the outdoor unit.
[0073] For example, an air conditioning system includes at least two outdoor units and at least two indoor units connected to the at least two outdoor units.
[0074] For example, a group of outdoor units and at least one indoor unit connected to the group of outdoor units constitute a refrigerant system, or multiple groups of outdoor units and at least one indoor unit connected to the multiple groups of outdoor units respectively constitute multiple refrigerant systems. Thus, an air conditioning system may include one refrigerant system or multiple refrigerant systems.
[0075] In some embodiments, the outdoor unit and the indoor unit can be air conditioning equipment of various models, types, forms, and capacities. For example, the indoor unit can be in the form of four-sided air outlet, two-sided air outlet, duct unit, floor air outlet, or skirting board air outlet, etc.; the outdoor unit can be in the form of single fan top air outlet, dual fan top air outlet, single fan front air outlet, or dual fan front air outlet, etc.
[0076] In some embodiments, the fresh air equipment includes at least one of a fresh air handling device, a total heat exchange device (e.g., with or without internal circulation function), and a ventilation device (e.g., with or without internal circulation function).
[0077] In some embodiments, at least one of the humidifying device and the dehumidifying device is disposed on the output side of the fresh air device to humidify or dehumidify the air output by the fresh air device, for example, to humidify or dehumidify the air output by the fresh air device, and to introduce the humidified or dehumidified air into the indoor space. For example, at least one of the humidifying device and the dehumidifying device has a heat exchanger that can operate as an evaporator.
[0078] In some embodiments, the underfloor heating system is connected to the outdoor unit via refrigerant piping, and to the indoor underfloor heating radiator piping via underfloor heating water piping. For example, the outdoor unit and the underfloor heating system form an air-source heat pump water heater, utilizing heat from the air and the operation of the compressor to heat water. The underfloor heating system may include a water-heat exchange unit, where refrigerant from the outdoor unit's compressor enters the unit via refrigerant piping to exchange heat with the water, thereby heating the water. The heated water is then introduced into the indoor underfloor heating radiator piping via the underfloor heating water piping to provide heating for the indoor space. In some embodiments, the outdoor unit and the underfloor heating system are separate units, or they are integrated.
[0079] In some embodiments, the valve assembly includes at least one of an air valve and a floor heating valve.
[0080] In some embodiments, the air valve for controlling the air volume of the indoor space is, for example, an air valve for controlling the amount of air supplied to the indoor space by the air supply device. For example, when the external circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the outdoor air introduced into the indoor space; when the internal circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the indoor air introduced into the indoor space.
[0081] In some embodiments, the floor heating valve is used to control the opening and closing of the inlet and outlet pipes in the floor heating system.
[0082] In some embodiments, control commands can be acquired in various ways in step 101. For example, one way is to generate control commands based on voice data, and another way is to receive control commands generated by other devices. This application does not impose specific limitations on this.
[0083] In some embodiments, the voice data used to generate control commands can be obtained from a local device.
[0084] In some embodiments, the local device includes at least one of a controller (also known as a control device), an indoor air conditioning unit, a smart device, and a user terminal.
[0085] In some embodiments, the controller includes at least one of a central controller, a wired controller, and a remote controller.
[0086] In some embodiments, the central controller and the wired controller are fixed controllers, for example, fixed to a wall in an indoor space.
[0087] In some embodiments, the central controller may be installed in multiple indoor spaces, that is, the central controller is configured to correspond to all or part of the indoor spaces.
[0088] This allows for the full utilization of various devices as local devices for voice data acquisition, improving the utilization rate of local devices, thereby reducing the cost of voice data acquisition and improving the efficiency and flexibility of voice data processing.
[0089] In some embodiments, smart devices include at least one of smart speakers, smart display devices, smart switches, smart curtains, smart lighting devices, sensors (e.g., air sensors, temperature sensors, humidity sensors, etc.), and smart pet devices.
[0090] In some embodiments, voice data may be acquired through a first local device, and the voice data may be an audio signal.
[0091] For example, the audio signal can be directly acquired by the first local device, or it can be acquired by the second local device and then sent to the first local device. For instance, the centralized controller can act as the first local device to directly acquire the audio signal, or an indoor air conditioning unit or smart device can act as the second local device to acquire the audio signal and then send the acquired audio data to the centralized controller, which is acting as the first local device. This application does not limit the method of acquiring voice data.
[0092] For example, after a user enables the voice control function of a first local device (e.g., a centralized controller), voice monitoring is activated to acquire the monitored voice data. Another example is that the first local device (e.g., the centralized controller) has a control interface that interacts with the user, allowing the user to perform related operations through the interface.
[0093] In some embodiments, the scope of the activated voice monitoring is a target space. Voice monitoring is activated after user confirmation before it can be performed on the target space. For example, the user can confirm or set the settings in the control interface of the central controller to activate the voice monitoring and voice control functions. Alternatively, the user can also set the scope of voice monitoring in the control interface.
[0094] In addition, the scope of the activated voice monitoring may not be the target space or may not be limited to the target space. For example, if the user is currently in the living room and wants to control the home appliances in the bedroom, then the target space is the bedroom, and the scope of the activated voice monitoring includes the living room, or includes both the living room and the bedroom.
[0095] In some embodiments, the voice data includes information related to the user's expected feelings.
[0096] In the embodiments of this application, "user's expected feeling" refers to an abstract description of the feeling that the user expects to experience.
[0097] In some embodiments, "expected" means that the user is willing or wants to obtain it.
[0098] In some embodiments, the sensation may include at least one of a bodily sensation and a mood sensation.
[0099] In some embodiments, bodily sensation refers to the body's perception of the environment, which may be associated with at least one of scene, location, weather, season, and time. Examples include "a summer breeze," "the West Lake in April," "the refreshing feeling after the rain," and "a mountain after a fresh rain."
[0100] In some embodiments, mood refers to at least one of the feelings and emotions evoked about things or people. For example, "the taste of love," "longing like the wind," or "the feeling of a sunny young man."
[0101] In this way, recognition can be performed on the voice data based on the aforementioned content of "user's expected feelings".
[0102] For ease of description, information related to the user's expected feelings will be referred to as first information. For example, the first information may include a first category of information related to the user's expectations and a second category of information related to the user's feelings.
[0103] The first category of information may include first descriptive information expressing an expectation or desire, such as first keywords. For example, "I want," "I expect," "I hope," "I want," "I think," "I need," "give me," "help me," "I hope," etc. Or, the first descriptive information may include sentences or phrases that have the meaning of "expectation or desire," such as "It would be great if I could..." "...it feels so good," etc.
[0104] The second category of information may include a second descriptive information expressing feelings. This second descriptive information may not include descriptive information related to home appliances or control commands. That is, the second category of descriptive information to be identified is an abstract description of feelings, rather than control commands for the appliances. The second descriptive information may include, for example, second keywords such as "April," "summer," or "sunny day," or it may include sentences or phrases with the meaning of "feeling," such as "after a rain in the empty mountains" or "the taste of love."
[0105] In this way, by abstracting the user's "expectations and feelings," it is possible to achieve automatic control that reflects the user's actual control intentions, further enhancing the intelligence and technological feel of voice control and improving the user experience.
[0106] The second descriptive information expressing a feeling may include at least one of a third descriptive information expressing a physical sensation and a fourth descriptive information expressing a mood. Specifically, the third descriptive information expressing a physical sensation includes at least one of scene, location, weather, season, and time, while the fourth descriptive information expressing a mood includes at least one of subjective experience and emotion.
[0107] In some embodiments, control commands can be generated from voice data in various ways. For example, first information related to the user's desired feeling can be identified in the voice data; control commands can be generated based on the identified first information.
[0108] The first information can be generated in various ways. For example, a first category of information and a second category of information can be identified in the voice data; if the voice data contains both first and second category information, the information obtained by combining the first and second category information can be used as the first information. This application does not specifically limit the method of identifying the first and second category information in the voice data. For example, the voice data can be converted into text data, and the first and second category information can be identified in the text data. Thus, the relevant information of "expected feelings" can be identified simply and quickly. Alternatively, the first and second category information can be identified in the voice data through sound wave matching. For example, sound wave matching is performed on the voice data, matching the sound waves of the voice data with preset sound wave data. If the match is successful, the first and second category information in the voice data are determined, thereby enabling the identification of the relevant information of "expected feelings" without recognizing the content of the voice data, reducing the risk of user privacy leakage.
[0109] Control commands can be generated based on the first information in various ways. For example, based on the first information, the environmental parameters that need to be adjusted and the target values of the environmental parameters are determined; control commands for the home appliances that need to be adjusted, the target values, and the home appliances used to adjust the environmental parameters are generated.
[0110] Furthermore, based on the capabilities of the home appliances within the target space, it can be determined whether the control based on the home appliances can adjust the environmental parameters within the target environment to the target value; and if it is determined that the environmental parameters within the target space can be adjusted to the target value, control instructions for the home appliances are generated based on the environmental parameters, the target values of the environmental parameters, and the home appliances used to adjust the environmental parameters. This application is not limited to this, and control instructions can also be generated in other ways.
[0111] In this way, when controlling the device based on first information related to the user's expected feelings, the system determines whether it is possible to adjust the environmental parameters in the target space to the target value based on the first information and the target value of the environmental parameters, and based on the capabilities of the home appliances in the target space. If it is determined that it is possible, the system performs the corresponding control, thereby taking into account the capabilities of the devices actually deployed on site to execute control that conforms to the actual situation.
[0112] In some embodiments, environmental parameters may include at least one of the following parameters: air quality parameter, light parameter, sound parameter, and odor parameter. For example, environmental parameters may be adjusted by at least one home appliance deployed within the target space.
[0113] For example, air quality parameters include at least one of the following: temperature, humidity, carbon dioxide concentration, fine particulate matter (e.g., PM2.5) concentration, inhalable particulate matter (e.g., PM10) concentration, volatile organic compound (VOC) concentration, indoor total organic matter (TVOC) concentration, nitrogen oxide concentration, ozone concentration, wind speed, and wind direction. Air quality parameters can be regulated by air handling equipment (e.g., at least one of indoor units, humidifiers, dehumidifiers, fresh air systems, air purifiers, fragrance diffusers, and underfloor heating systems) and cleaning equipment (e.g., robotic vacuum cleaners) within the target space.
[0114] For example, lighting parameters include at least one of the following: light intensity, color, direction, and range. Lighting parameters can be adjusted by lighting equipment, curtains, etc., within the target space.
[0115] For example, sound parameters include sound volume and sound content. These sound parameters can be adjusted by audio-visual devices within the target space, such as smart speakers and smart TVs.
[0116] For example, odor parameters include the various types of odors in the air and their concentrations. These odor parameters can be adjusted, for example, by fragrance components within the target space.
[0117] In some embodiments, the environmental parameters that need to be adjusted and the target values of those environmental parameters can be determined in various ways based on first information related to the user's expected feelings.
[0118] In some embodiments, first information or a question based on the first information can be input into a first model, which then outputs environmental parameters matching the first information and their target values. For example, the first model is a big data model, an AI question-answering model, or an AI search engine.
[0119] For example, if the "first information" is "a gentle breeze in the shade in summer", and the big data model is input with "a gentle breeze in the shade in summer", the big data model will output "temperature 26 degrees, no direct sunlight, wind force level 1".
[0120] For example, if the "first information" is "West Lake in April", and the AI question-answering model is input with "What are the air parameters of West Lake in April", the AI question-answering model will output "Temperature 18-20 degrees, humidity 70-80%, wind force 1-2".
[0121] For example, if the "first information" is "the taste of love", and you input "how to create the taste of love" into the AI question-answering model, the AI question-answering model will output "temperature 22-25 degrees, soft lighting, play light music".
[0122] In some embodiments, it can be determined whether the control based on the home appliances in the target space can adjust the environmental parameter in the target space to the target value, based on the capabilities of the home appliances in the target space.
[0123] For example, as mentioned above, if the "first information" is "a cool breeze in the shade during summer", the environmental parameters output by the big data model are "temperature 26 degrees, no direct sunlight, wind force level 1". The target space is a bedroom, which is equipped with an air conditioner that can adjust the temperature and wind force, smart curtains and smart lighting equipment. Therefore, it has the ability to adjust the environmental parameters in the target space to the target value.
[0124] For example, as mentioned above, in the case where the "first information" is "the West Lake in April", the environmental parameters output by the artificial intelligence question answering model are "temperature 18-20 degrees, humidity 70-80%, wind force 1-2". The target space is the living room, which is equipped with an air conditioner that can adjust the temperature, humidity and wind force, and also has a humidifier that can adjust the humidity. Therefore, it has the ability to adjust the environmental parameters in the target space to the target value.
[0125] For example, as mentioned above, when the "first information" is "the taste of love", the environmental parameters output by the AI question-answering model are "temperature 22-25 degrees, soft lighting, playing light music". The target space is the living room. However, the living room is only equipped with air conditioning and cannot automatically adjust the lighting and play light music. Therefore, it does not have the ability to adjust the environmental parameters in the target space to the target value.
[0126] In some embodiments, when it is determined that the environmental parameter within the target space can be adjusted to the target value, a first control command for the home appliance can be generated in various ways based on the environmental parameter, the target value of the environmental parameter, and the home appliance used to adjust the environmental parameter.
[0127] In some embodiments, environmental parameters, target values of the environmental parameters, and home appliances used to adjust the environmental parameters can be input into a second model, which then outputs a first control command. For example, the second model is a trained deep learning model.
[0128] For example, as mentioned above, for the case where the "first information" is "a cool breeze in the shade during summer", the environmental parameters output by the big data model are "temperature 26 degrees, no direct sunlight, wind force level 1". The first control command generated by the second model is "adjust the air conditioner temperature to 26 degrees, adjust the air volume to low, and close the sheer curtains in the curtains". In addition, based on the detection results of the user's location, the control command can also include instructions for adjusting the air conditioner's airflow direction.
[0129] For example, as mentioned above, for the case where the "first information" is "West Lake in April", the environmental parameters output by the AI question-answering model are "temperature 18-20 degrees, humidity 70-80%, wind force 1-2". The first control command generated by the second model is "adjust the air conditioner temperature to 20 degrees, adjust the air volume to low, and adjust the target humidity of the humidifier to 70%". In addition, based on the detection results of the user's location, the control command can also include instructions for adjusting the air conditioner's airflow direction.
[0130] In some embodiments, a control command database may be established, in which the first information, environmental parameters, target values, home appliances, and the corresponding first control commands are stored; or, the environmental parameters, target values, home appliances, and the corresponding first control commands are stored.
[0131] In this way, the environmental parameters matching the first information, their target values, and the first control command can be obtained by looking up a table.
[0132] In some embodiments, the accuracy of control commands is a performance metric used to characterize whether the control commands conform to the actual use scenario and the user's actual intentions.
[0133] In some embodiments, the accuracy of control commands is related to at least one of the reasonableness of the control commands and their consistency with the user's actual control intentions. For example, the reasonableness of control commands is related to the actual usage scenario.
[0134] In some embodiments, in step 102, the accuracy of the control command is determined based on at least one of the reasonableness of the control command and the matching of the control command with the user's control intention.
[0135] Therefore, it is possible to comprehensively consider whether the control command meets the actual scenario requirements and whether the control command deviates too much from the user's actual intention, thus ensuring the user experience.
[0136] For example, when determining accuracy based on reasonableness, a control instruction is accurate when it is reasonable, and inaccurate when it is unreasonable.
[0137] For example, when determining accuracy based on the matching between control instructions and control intentions, control instructions are accurate when there is a matching between the control instructions and the user's control intentions; and inaccurate when there is no matching between the control instructions and the user's control intentions.
[0138] For example, when determining a control instruction based on its rationality and its matching with the control intent, the control instruction is accurate when it possesses both rationality and matching. Alternatively, a comprehensive value can be determined based on a first value representing rationality, a second value representing matching, a first weight for rationality, and a second weight for matching. When the comprehensive value exceeds a preset value threshold, the control instruction is accurate.
[0139] The first and second weights can be equal values; or the first weight can be smaller than the second weight, in which case, when measuring the accuracy of control commands, more emphasis is placed on the degree of matching between the control command and the control intention, which is conducive to personalized control; or the first weight can be larger than the second weight, in which case, when measuring the accuracy of control commands, more emphasis is placed on the degree of matching between the control command and the actual scene of the target space, which is conducive to reasonable and reliable control.
[0140] In some embodiments, rationality may be determined based on at least one of feasibility, comfort, and energy efficiency.
[0141] In this way, factors such as equipment, users, environment, and cost can be comprehensively considered to determine the rationality of control commands, thereby making the results of the rationality determination more accurate and in line with the user's actual intentions.
[0142] For example, a control command can be deemed reasonable if it simultaneously possesses the qualities of enforceability, comfort, and energy efficiency; conversely, a control command can be deemed unreasonable if it lacks at least one of these qualities. This method allows for the rigorous and reliable selection of reasonable control commands. Controlling related home appliances according to these commands not only creates a comfortable environment for the user but also saves energy.
[0143] For example, a control command can be deemed reasonable if it possesses at least one of the following characteristics: executability, comfort, and energy efficiency; conversely, a control command can be deemed unreasonable if it lacks any of these three characteristics. Control commands selected in this way that demonstrate reasonableness can be applied to a wider range of scenarios and meet users' personalized needs.
[0144] For example, a user might want to do hot yoga in the summer. The ambient temperature for hot yoga is typically between 38°C and 42°C. If the current indoor temperature is below 38°C, the air conditioner needs to be set to heating mode in summer to maintain the indoor temperature between 38°C and 42°C. Although the control command to set the air conditioner to heating mode in summer is generally considered a comfort-unfriendly command, in order to meet the user's personalized needs, as long as the air conditioner in the target space has heating capabilities—that is, the command is executable—it can be considered reasonable.
[0145] For example, a user might want to maintain a comfortable indoor temperature and enjoy fresh air during winter. In this case, a possible control command would be to operate the air conditioner in heating mode and the fresh air system in external recirculation mode, i.e., to introduce fresh air from outdoors into the room. Since outdoor air temperatures are typically low in winter, the air conditioner's energy consumption increases to maintain the indoor temperature; therefore, this control command is generally considered energy-inefficient. However, to meet the user's individual needs, as long as the fresh air system in the target space has external recirculation functionality and the air conditioner has heating capabilities, i.e., the control command is executable, it can be considered reasonable. This application is not limited to this; the reasonableness of a control command can also be determined in other ways.
[0146] The following are exemplary descriptions of the methods for determining the executability, comfort, and energy efficiency of control commands.
[0147] Take executability as an example:
[0148] Executability refers to whether the control command can be executed by the first home appliance in the target space, that is, whether the first home appliance in the target space is capable of executing the control command.
[0149] Executability can be determined based on the compatibility between the control command and the capabilities of the first home appliances included in the target space. Thus, by combining the actual state information of the target space (e.g., the actual capabilities of the first home appliances within the target space) with the determination of the executability of the control command, it is possible to determine whether the control command matches the actual scenario requirements of the target space, thereby further improving the accuracy and reliability of the determination results.
[0150] For example, a control command is associated with at least one of the following: the environmental parameter that needs to be adjusted and the target value of the environmental parameter.
[0151] If there is no home appliance among the first home appliances in the target space capable of adjusting the environmental parameter, the control command is not executable. Alternatively, if there is a home appliance among the first home appliances in the target space capable of adjusting the environmental parameter, but the environmental parameter cannot be adjusted to the target value based on the control of the first home appliance, the control command is not executable.
[0152] In this way, by combining the actual capabilities of the first home appliance in the target space with the environmental parameters that need to be adjusted and their target values related to the control commands, the feasibility of the feasibility determination can be guaranteed to be accurate and reliable.
[0153] In some embodiments, the absence of home appliances capable of adjusting environmental parameters among the first home appliances included in the target space can be varied.
[0154] For example, if the first home appliance in the target space cannot adjust all the environmental parameters that need to be adjusted, it is determined that there is no home appliance in the first home appliance that can adjust the environmental parameters.
[0155] In other words, if any environmental parameter cannot be adjusted by the first home appliance within the target space, the first home appliance is considered to lack the ability to adjust that environmental parameter; that is, the control command is not executable. This allows for a rigorous determination of executability. From another perspective, a control command deemed executable can adjust all the necessary environmental parameters, thus ensuring the effectiveness of the control command and reliably achieving the user's expected experience.
[0156] For example, if the first home appliance cannot adjust an environmental parameter or a necessary environmental parameter that is above the first preset ratio among all the environmental parameters that need to be adjusted, it is determined that there is no home appliance in the first home appliance that can adjust the environmental parameters.
[0157] In other words, if the first home appliance in the target space cannot adjust certain environmental parameters that need adjustment, and if there are many such unadjustable environmental parameters or they are necessary / important environmental parameters, then the first home appliance is considered to lack the ability to adjust those environmental parameters; that is, the control command is not executable. Therefore, the executableness criteria can be appropriately relaxed, thereby improving the success rate of control commands and avoiding too many situations where control commands cannot be executed or where user interaction is required.
[0158] In some embodiments, the presence of home appliances capable of adjusting environmental parameters among the first home appliances included in the target space can be varied.
[0159] For example, if the first home appliance in the target space can adjust all the environmental parameters that need to be adjusted, it is determined that there is a home appliance in the first home appliance that can adjust the environmental parameters.
[0160] As mentioned earlier, this approach ensures the effectiveness of control commands and helps to reliably achieve the user's expected experience.
[0161] For example, if the first home appliance in the target space can adjust the environmental parameters or necessary environmental parameters that are at or above the second preset ratio among all the environmental parameters that need to be adjusted, it is determined that there is a home appliance in the first home appliance that can adjust the environmental parameters.
[0162] As mentioned earlier, this approach appropriately relaxes the criteria for determining executability, thereby improving the success rate of control commands and avoiding too many situations where control commands cannot be executed or where user interaction is required.
[0163] In some embodiments, a correspondence between home appliances and environmental parameters can be preset, and the ability of a first home appliance in the target space to adjust and control environmental parameters related to the command can be determined based on this correspondence. This application is not limited to this; other methods may also be used for determination.
[0164] In some embodiments, the inability to adjust environmental parameters within the target space to the target value can include various situations.
[0165] For example, if the first home appliance in the target space is unable to adjust all the environmental parameters that need to be adjusted in the target space to the corresponding target values, it is determined that the first home appliance is unable to adjust the environmental parameters in the target space to the target values.
[0166] In other words, if any environmental parameter cannot be adjusted to the target value, the first home appliance is considered unable to adjust the environmental parameter in the target space to the target value; that is, the control command is not executable. This allows for a rigorous determination of executability. From another perspective, a control command deemed executable can adjust all the necessary environmental parameters to the target value, thus ensuring the effectiveness of the control command and reliably achieving the user's expected experience.
[0167] For example, if the first home appliance in the target space is unable to adjust the environmental parameters or necessary environmental parameters in the target space that are above the third preset ratio to the corresponding target value, it is determined that the first home appliance is unable to adjust the environmental parameters in the target space to the target value.
[0168] In other words, if the first home appliance fails to adjust certain environmental parameters to their target values, and there are many such parameters, or if they are necessary / important parameters, then the first home appliance can be considered unable to adjust the environmental parameters within the target space to their target values; that is, the control command is not executable. Therefore, the executableness criteria can be appropriately relaxed, thereby improving the success rate of control commands and avoiding too many situations where control commands cannot be executed or where user interaction is required.
[0169] The first preset ratio, second preset ratio, third preset ratio, and necessary environmental parameters can be preset by the user, set through user interaction, or automatically updated based on at least one of the following: user habits, environment, current season, user status, and user feedback. This application does not restrict the specific values, content, or setting methods of the first preset ratio, second preset ratio, third preset ratio, and necessary environmental parameters.
[0170] In some embodiments, necessary environmental parameters refer to environmental parameters that must be adjusted to achieve the user's control intent. In other words, by adjusting all necessary environmental parameters, the user's main control intent or close to the user's control intent can be achieved.
[0171] In some embodiments, the necessary environmental parameters correspond to the user’s control intent, or to the “expected feeling” that embodies the control intent.
[0172] For example, if a user expresses their desired feeling as "wanting to be in love," then parameters such as lighting, background music, and fragrance are important or necessary for creating that feeling—in other words, indispensable in a sense; while parameters such as air temperature are secondary.
[0173] In some embodiments, necessary environmental parameters include environmental parameters of a preset category or environmental parameters with a preset priority among the environmental parameters that need to be adjusted.
[0174] Therefore, based on the type or priority of the environmental parameters that need to be adjusted, corresponding controls can be executed, thereby enabling the use of actually deployed equipment to achieve the user's main control intentions or close to the user's control intentions, thus maximizing the satisfaction of the user's control needs and further improving the user experience. In some embodiments, when determining whether a first home appliance can adjust a certain environmental parameter to a target value, the current environmental parameters can be considered. For example, if a control command instructs the operating parameters of a home appliance, it can be determined whether the environmental parameter can be adjusted to the target value based on the environmental parameters associated with the control command, the target value and current value of the environmental parameter, and the operating parameters indicated by the control command. For example, if the current indoor temperature is 20°C, and the control command instructs the air conditioner to operate in heating mode with a target temperature of 18°C, in this case, the indoor temperature cannot be adjusted to the target value, meaning the control command is not executable.
[0175] The following provides an exemplary description of the operation when the control instructions are not executable, categorized by case.
[0176] Scenario 1: The primary home appliance in the target space is unable to adjust all the environmental parameters that need to be adjusted.
[0177] In this case, the control command is not executed.
[0178] Scenario 2: The first piece of furniture in the target space can adjust some of the environmental parameters that need to be adjusted, but the environmental parameters that cannot be adjusted are the essential environmental parameters.
[0179] In this situation, if the control instruction is executed, the actual effect may deviate significantly from the user's expected experience. Therefore, the control instruction may not be executed.
[0180] Scenario 3: The first piece of furniture in the target space can adjust some of the necessary environmental parameters. These parameters are essential and can be adjusted to the target values.
[0181] In this situation, the actual execution effect of executing the control command may deviate little from the user's expected experience; therefore, the control command can be executed.
[0182] Scenario 4: The first piece of furniture in the target space can adjust all the environmental parameters that need to be adjusted, and can adjust all parameters to the target value.
[0183] In this case, execute the control command.
[0184] Scenario 5: The first piece of furniture in the target space can adjust all the environmental parameters that need to be adjusted; however, it can only adjust some of the environmental parameters to the target value. These are the necessary environmental parameters.
[0185] In this case, the target values of another part of the parameters can be modified, a new control command can be generated based on the modified target values, and the new control command can be executed.
[0186] Scenario 6: The first home appliance in the target space can adjust all the environmental parameters that need to be adjusted; however, it can only adjust some of the environmental parameters to the target value. The environmental parameters that cannot be adjusted to the target value are the necessary environmental parameters.
[0187] In this situation, if the control instruction is executed, the actual effect may deviate significantly from the user's expected experience. Therefore, the control instruction may not be executed.
[0188] This application is not limited to this; other methods may be used to determine whether control instructions are executable.
[0189] Take comfort as an example:
[0190] Comfort refers to whether controlling home appliances according to control commands affects or reduces the user's comfort.
[0191] Comfort can be determined based on the matching degree between the control command and at least one of the following: current environmental parameters, current season, current time, geographical information, user attributes, user status, and user usage habits. Thus, by combining the actual state information of the target space (which may include at least one of the following: current environmental parameters, current season, current time, geographical information, user attributes, user status, and user usage habits) to determine the comfort level of the control command, it is possible to ascertain whether the control command matches the actual scenario requirements of the target space, thereby further improving the accuracy and reliability of the determination results.
[0192] For details regarding environmental parameters, please refer to the aforementioned content; further explanation will not be provided here.
[0193] In some embodiments, user attributes may include at least one of the following: the user's gender, age, nationality, region, etc.
[0194] In some embodiments, a user's state may include at least one of the following: awake or asleep, healthy or sick, emotional state, etc.
[0195] The following is an example of a control command that does not provide comfort.
[0196] Example 1: Control instructions that contradict current environmental parameters. For example, a control instruction might instruct a home appliance to adjust environmental parameters from a comfortable first value range to an uncomfortable second value range. Or, a control instruction might instruct a home appliance to adjust environmental parameters from an uncomfortable second value range to an even more uncomfortable third value range, thus exacerbating the discomfort.
[0197] For example, if the current indoor humidity is 50%, the control command instructs the dehumidifier to operate and adjust the indoor humidity to 20%. The comfortable indoor humidity for humans is typically between 40% and 60%. Excessively low indoor humidity can negatively impact human health and the home environment, hindering user well-being and furniture maintenance. Since this control command adjusts the indoor humidity from a comfortable range to an uncomfortable one, it is deemed to lack comfort.
[0198] For example, if the current indoor temperature is 15℃, and the control command instructs the air conditioner to operate in cooling mode to adjust the indoor temperature to a lower level, the comfortable indoor temperature for humans is usually between 20-26℃. Instructing the air conditioner to cool when the indoor temperature is already 15℃ would exacerbate the user's discomfort. Therefore, the aforementioned control command is deemed to lack comfort.
[0199] Example 2: Control commands that contradict the current seasonal parameters. For example, a control command in summer instructs the air conditioner to turn on heating mode, or in winter instructs it to turn on cooling mode, or during the rainy season instructs the humidifier to operate. Because these control commands contradict the current season, they are deemed to lack comfort.
[0200] Example 3: Control commands that contradict time information. For example, a control command instructs the robot vacuum to clean the bedroom floor at night. Controlling the robot vacuum according to this command might disturb the user's rest; therefore, this control command is deemed not to provide comfort.
[0201] Example 4: Control commands that contradict geographical information. For example, in North China, a control command instructs the humidification equipment to dehumidify. Since the climate in North China is relatively dry, dehumidifying according to this control command would exacerbate user discomfort; therefore, the control command is deemed to lack comfort.
[0202] Example 5: Control instructions that contradict user attributes. For example, in an indoor space with elderly people or children, a control instruction might instruct the air conditioner or ventilation system to operate at high fan speed. Since the elderly or children have lower immunity, high fan speed can easily cause them to catch a cold; therefore, this control instruction is deemed to lack comfort.
[0203] Example 6: Control commands that contradict the user's condition. For example, if a user has a cold indoors, the control command instructs the air conditioner to cool and turn the fan on high. Since cooling and turning the fan on high is not conducive to the user's recovery and may even worsen the condition, the above control command is determined to be uncomfortable.
[0204] Example 7: Control commands that contradict user habits. For example, a user might prefer to sleep with the fan on silent mode, but the control command requests a strong fan. In this case, the control command is deemed not to provide comfort.
[0205] This application is not limited to this; other methods may be used to determine whether control commands are comfortable.
[0206] Take energy efficiency as an example:
[0207] Energy efficiency refers to whether the energy consumption required to control home appliances according to control commands meets energy-saving requirements.
[0208] Energy efficiency can be determined based on at least one of the following: operating power, operating duration, operating mode, number of devices, and device type of the home appliances associated with the control command. Thus, by combining the actual state information of the target space (for example, the actual state information of the target space may include at least one of the following: operating power, operating duration, operating mode, number of devices, and device type of the first home appliance associated with the control command within the target space) to determine the energy efficiency of the control command, it is possible to determine whether the control command matches the actual scenario requirements of the target space, thereby further improving the accuracy and reliability of the determination results.
[0209] For example, if the energy consumption of the first home appliance in the target space that is associated with the control command to adjust the environmental parameters to the target value exceeds a preset energy consumption threshold, or if the operating time exceeds a preset time threshold, or if the operating energy consumption exceeds the preset energy consumption threshold and the operating time exceeds the preset time threshold, the control command is determined to be not energy-saving.
[0210] For example, if the current indoor temperature is 28℃, and the control command instructs for cooling to 24℃ with silent fan, in scenarios with a significant temperature difference, using silent fan will take longer to reach the target temperature. Because the compressor runs continuously, it takes longer to quickly lower the temperature to the target temperature compared to using high fan speed, resulting in higher compressor energy consumption. If the required time or energy consumption is excessive, the control command is deemed not energy-efficient.
[0211] For example, if there are other first-class home appliances in the target space that can adjust the environmental parameters to the target value and operate with lower energy consumption or shorter operating time, the control command is determined to be not energy-efficient.
[0212] For example, the current outdoor temperature is 20°C, and the current indoor temperature is 28°C. The control command instructs the air conditioner to cool to 24°C. In addition to the air conditioner, the target space also has a fresh air system. Since the fresh air system operates in external recirculation mode, it can introduce cool outdoor air into the room, thus achieving the same cooling effect. Furthermore, the energy consumption of the fresh air system to lower the indoor temperature to 24°C is lower than the energy consumption of the air conditioner. In this case, the control command is determined to be energy-inefficient.
[0213] For example, if among the multiple first home appliances in the target space associated with the control command are home appliances that do not need to be operated, the control command is determined to be not energy-efficient.
[0214] For example, if a user is currently in the living room and a control command turns on the air conditioners in the living room, kitchen, and bedroom, this control command is deemed not energy-efficient.
[0215] For example, if there are contradictions in the operating states of multiple primary home appliances related to the control command within the target space, the control command is deemed not to be energy-efficient.
[0216] For example, in the height of summer, with strong sunlight and high outdoor temperatures, the control command instructs the air conditioner to cool. Furthermore, the command also instructs the curtains to be opened, allowing direct sunlight into the room, or it instructs the fresh air system to operate in external recirculation mode, introducing hot air into the room. Since lowering the indoor temperature requires more energy when the curtains are open or hot air is introduced, this control command is deemed not energy-efficient.
[0217] In this way, by combining information about the first home appliance in the target space with the environmental parameters that need to be adjusted and their target values related to the control commands, the energy efficiency assessment can be determined, ensuring the accuracy and reliability of the energy efficiency assessment results.
[0218] In some embodiments, such as Figure 1 As shown, the voice control method may further include:
[0219] Step 103: If it is determined that the control command is not reasonable, do not control the home appliances or interact with the user according to the control command.
[0220] This reduces the possibility of accidental operation. By interacting with the user, we can further clarify the user's actual intentions and further ensure the user experience.
[0221] In some embodiments, interacting with the user in step 103 may include at least one of the following: prompting the user with information that the control command is unreasonable; or prompting the user with recommended control commands.
[0222] By interacting with users and providing them with information about unreasonable control commands, users can understand why the commands cannot be executed, allowing them to take targeted actions in the future.
[0223] By interacting with users and providing them with recommended control commands, users can easily select commands that match their desired experience. This reduces the difficulty of control and ensures a better user experience.
[0224] In some embodiments, information regarding unreasonable control instructions may include at least one of the following: the control instructions are not executable, the reason why the control instructions are not executable, the control instructions are not comfortable, the reason why the control instructions are not comfortable, the control instructions are not energy-efficient, and the reason why the control instructions are not energy-efficient.
[0225] The reasons why the control command is not executable may include at least one of the reasons described above. For example, there is no home appliance in the first home appliance in the target space that can adjust the environmental parameter, or there is a home appliance in the first home appliance in the target space that can adjust the environmental parameter, but the environmental parameter cannot be adjusted to the target value based on the control of the first home appliance.
[0226] Furthermore, reasons why control commands are not executable can also include more detailed information. For example, a first environmental parameter that the first home appliance cannot adjust, a second environmental parameter that the first home appliance cannot adjust to a target value, and the range of the second environmental parameter that the first home appliance can actually adjust.
[0227] This allows users to receive more detailed information, enabling them to better understand the actual capabilities of the first home appliance in the target space and helping them to provide appropriate feedback.
[0228] The reasons why control instructions are not comfortable can include at least one of the reasons described above. For example, the control instructions do not match or contradict at least one of the following: current environmental parameters, current season, current time, geographic information, user attributes, user status, and user habits.
[0229] Furthermore, the reasons why control commands lack comfort can also include more detailed information. For example, which target values or operating parameters of the environmental parameters related to the control commands contradict information about the current state of the target space, the value of the target value, and the value of the corresponding current state of the target space.
[0230] This allows users to receive more detailed information, enabling them to better understand the current state of the target space and helping them to provide appropriate feedback.
[0231] The reasons why the control command is not energy-efficient may include at least one of the reasons described above. For example, the energy consumption of the first home appliance in the target space that is associated with the control command in adjusting the environmental parameters to the target value exceeds a preset energy consumption threshold, or the operating time exceeds a preset time threshold, or there are other first home appliances in the target space that can adjust the environmental parameters to the target value and have lower energy consumption or shorter operating time, or the multiple first home appliances in the target space that are associated with the control command include home appliances that do not need to be operated, or the operating states of the multiple first home appliances in the target space that are associated with the control command are contradictory, etc.
[0232] Furthermore, reasons why control commands are not energy-efficient can also include more detailed information. For example, the energy consumption / running time required for the first home appliance to adjust the environmental parameters to the target value, the energy consumption / running time required for other first home appliances, information on home appliances that do not need to run, and conflicting information on first home appliances, etc.
[0233] This allows users to receive more detailed information, enabling them to better understand the actual energy consumption of the first home appliance in the target space when executing the control command, thus helping users to provide appropriate feedback.
[0234] In some embodiments, recommended control instructions can be generated in various ways. For example, recommended control instructions can be generated specifically based on the reasons why a control instruction is deemed unreasonable.
[0235] In the absence of executable control instructions, at least one of the environmental parameters and target values related to the control instructions is adjusted based on the capabilities of the first home appliance in the target space. Recommended control instructions are then generated based on the adjusted environmental parameters, the target values of the environmental parameters, and the home appliance used to adjust the environmental parameters.
[0236] This ensures the executability of the recommended control instructions, thereby helping to guarantee their rationality.
[0237] For example, a control command instructs the air conditioner to switch to silent mode. If the air conditioner in the target space does not have a silent mode function, but has a similar function, such as a sleep mode function, then a recommended control command can be generated to instruct the air conditioner to switch to sleep mode.
[0238] If the control commands are not comfortable, adjust at least one of the environmental parameters and target values related to the control commands based on the current environmental parameters, current season, current time, geographical information, user attributes, user status, and user usage habits. Based on the adjusted environmental parameters, the target values of the environmental parameters, and the home appliances used to adjust the environmental parameters, generate recommended control commands.
[0239] In this way, when the control commands lack comfort, generating recommended control commands by combining comfort-related parameters of the target space can ensure the comfort of the recommended control commands, thereby helping to ensure the rationality of the recommended control commands.
[0240] For example, if the current indoor humidity is 50%, the control command instructs the dehumidifier to operate and adjust the indoor humidity to 20%. In this case, a recommended control command can be generated to instruct the dehumidifier to operate and adjust the indoor humidity to 40%. This satisfies the user's desire to reduce humidity while preventing excessively low humidity from affecting user comfort.
[0241] For example, the control command might instruct the robot vacuum to clean the bedroom floor at night. In this case, recommended control commands could be generated to instruct the robot vacuum to clean the bedroom floor during the daytime.
[0242] For example, in the presence of elderly people or children in the indoor space, the control command instructs the air conditioner or fresh air system to operate at high fan speed. In this case, a first recommended control command can be generated to instruct the air conditioner or fresh air system to operate at high fan speed to avoid direct airflow, a second recommended control command to instruct the air conditioner or fresh air system to operate at high fan speed at a suitable temperature, or a third recommended control command to instruct the air conditioner or fresh air system to operate at a lower fan speed, etc.
[0243] When the control command is not energy-efficient, at least one of the environmental parameters and the target value is adjusted based on the operating power, operating time, operating mode, number of devices, or device type of the first home appliance used to adjust the environmental parameters to the target value. Based on the adjusted environmental parameters, the target value of the environmental parameters, and the home appliance used to adjust the environmental parameters, a recommended control command is generated.
[0244] In this way, when the control commands are not energy-efficient, generating recommended control commands by combining the energy-efficient parameters of the first home appliance in the target space can ensure the energy efficiency of the recommended control commands, thereby helping to ensure the rationality of the recommended control commands.
[0245] For example, if the current indoor temperature is 28℃, the control command might be "Cooling 24℃ + Silent Fan". However, in scenarios with significant temperature differences, lowering the temperature to the target value using Silent Fan would take longer and consume more energy than using High Fan. Therefore, a recommended control command could be generated to "Cooling 24℃ + High Fan Speed".
[0246] For example, if the current outdoor temperature is 20°C and the current indoor temperature is 28°C, the control command instructs the air conditioner to cool to 24°C. Since the target space also has a fresh air system that can introduce cool outdoor air into the room, its energy consumption is lower than that of the air conditioner. In this case, a recommended control command can be generated to instruct the fresh air system to operate in external circulation mode.
[0247] For example, if a user is currently in the living room and the control command turns on the air conditioners in the living room, kitchen, and bedroom, then a recommended control command can be generated to turn on the living room air conditioner and turn off the air conditioners in the kitchen and bedroom.
[0248] For example, in the height of summer, with strong sunlight and high outdoor temperatures, the control command instructs the air conditioner to cool and also instructs the fresh air system to operate in external recirculation mode. Because the fresh air system brings hot outdoor air into the room, the air conditioner requires more energy to cool. In this situation, a recommended control command can be generated instructing the air conditioner to cool and the fresh air system to operate in internal recirculation mode.
[0249] In some embodiments, such as Figure 1 As shown, the voice control method may further include:
[0250] Step 104: Update control commands by interacting with the user using recommended control commands, and control home appliances according to the updated control commands.
[0251] This allows for a clearer understanding of the user's actual intentions, helps to reliably fulfill the user's expectations, and ensures a positive user experience.
[0252] For example, after a user is prompted with a recommended control command and confirms it, the user can use the recommended control command to update the control command and control the home appliances according to the updated control command.
[0253] For example, after a user is prompted to adjust a recommended control command, the adjusted recommended control command can be used to update the control command, and the home appliances can be controlled according to the updated control command.
[0254] In some embodiments, updated control commands can be stored in the user's data list. Since the updated control commands are user-confirmed, in subsequent control operations, if the same or similar voice data is obtained, control can be performed according to the updated control commands, thereby improving control efficiency and user experience.
[0255] For example, storing the user's voice data, or information from the voice data related to the user's expected feelings, along with the updated control commands.
[0256] For example, storing the user's voice data or information related to the user's expected feelings from the voice data, updated control commands, and the current actual situation of the target space.
[0257] In some embodiments, the matching between control commands and the user's control intent can be determined in various ways.
[0258] For example, it can interact with users and determine the match between control commands and control intentions based on user feedback.
[0259] For example, if the user expresses a desire to "feel relaxed," after generating the corresponding control command, such as "play classical music, turn on the aroma diffuser," the user is given a confirmation message, such as, "Would you like to perform the following control: play classical music, turn on the aroma diffuser?"
[0260] If the user provides positive feedback, the control command can be considered to match the control intent. If the user provides negative feedback, the control command can be considered to not match the control intent.
[0261] For example, the matching between control commands and control intentions can be determined based on the user's usage habits and preference information.
[0262] For example, a user might express a desire to "feel relaxed," and after generating a corresponding control command, such as "play classical music and turn on the aromatherapy diffuser," the user might not actually enjoy listening to classical music. In this case, the control command is likely to be mismatched with the user's intended experience.
[0263] In some embodiments, if it is determined that the control command does not match the user's control intention, the home appliances may not be controlled according to the control command and the user may be interacted with. The control command may be corrected based on the user's feedback and the home appliances may be controlled according to the corrected control command.
[0264] Therefore, home appliances can be controlled in a way that better matches the user's actual control intentions, which helps to accurately meet the user's needs, reduce the annoyance caused to the user, and also helps to improve the intelligence level of the voice control system, facilitate the improvement of user profiles, and provide users with customized services.
[0265] In some embodiments, similar to the aforementioned updated control instructions, the revised control instructions can also be stored in the user's data list. Since these revised control instructions are based on user feedback, in subsequent control operations, if the same or similar voice data is obtained, control can be performed according to these revised instructions, thereby improving control efficiency and user experience.
[0266] For example, storing the user's voice data, or information from the voice data related to the user's expected feelings, along with the corresponding modified control commands.
[0267] For example, storing the user's voice data or information related to the user's expected feelings from the voice data, the corrected control commands, and the current actual situation of the target space.
[0268] The voice control method of this application is described below by way of example:
[0269] In voice control, users express their "expected feelings," and the resulting integrated control commands, based on these expectations, may deviate significantly from the user's actual control intentions. This could be due to two reasons: firstly, the user's description of their expected feelings may be inaccurate (e.g., the user's description of their "expected feelings" is incorrect); secondly, the system may misunderstand the commands.
[0270] Therefore, after obtaining the control command corresponding to the "expected feeling", the rationality of the control command can be determined based on the actual scenario (i.e., the state information of the target space).
[0271] If a control command is deemed unreasonable, it can be withheld from execution initially, and the system can interact with the user. For example, the user can be alerted to the unreasonableness of the command (e.g., the command generated based on the user's "expected feelings" lacks feasibility, comfort, or energy efficiency, and the reasons for this). Suggestions can also be offered, such as recommended control commands. Through user interaction, the recommended control commands can be used to update the control commands, and the home appliances can be controlled according to the updated commands.
[0272] If the control command is reasonable, it can be executed first. If the user finds that the control based on the command does not conform to the actual control intention, feedback from the user can be received, and the control command can be revised based on the feedback, then control can be implemented according to the revised command. Alternatively, after controlling based on the command for a period of time, the user can be proactively asked whether they are satisfied, and control can continue based on the user's feedback, or the control command can be revised based on the user's feedback, then control can be implemented according to the revised command.
[0273] In some embodiments, the method may further include: notifying the user of the speech recognition results, for example, notifying the user of first information identified from the speech data that relates to the user's desired feeling. For example, notifying the user "You just mentioned wanting a cool breeze in the shade of summer."
[0274] In some embodiments, notifications may be sent to users through one or more of the following methods: display, broadcast, push notification, etc.
[0275] For example, the speech recognition results can be displayed through a local device with display capabilities, which can be displayed as text. The local device with display capabilities includes, but is not limited to, one or more of a central controller, a smart TV, and a smart screen.
[0276] For example, the speech recognition results can be broadcast through a local device with voice broadcasting capabilities. Such local devices include, but are not limited to, one or more of a central controller, a smart TV, and a smart speaker.
[0277] For example, the speech recognition results can be notified to the user by pushing a message to the user's mobile device.
[0278] In some embodiments, the method may further include: notifying the user of the control result, for example, notifying the user of information about the completion of control based on "first information related to the user's expected feelings", such as "the air conditioner temperature has been adjusted to 26 degrees, the air volume has been adjusted to low, and the curtains in the curtains have been closed, based on your request for a cool breeze in the shade during the summer".
[0279] In some embodiments, notifications may be sent to users through one or more of the following methods: display, broadcast, push notification, etc.
[0280] For example, the control results can be displayed through a local device with display capabilities, and these results can be displayed via text. Local devices with display capabilities include, but are not limited to, one or more of a central controller, a smart TV, and a smart screen.
[0281] For example, control results can be broadcast through a local device with voice broadcasting capabilities. Such local devices include, but are not limited to, one or more of a central controller, a smart TV, and a smart speaker.
[0282] For example, notifications of control results can be sent to users' mobile devices by pushing messages to them.
[0283] In some embodiments, the method may further include: engaging in voice interaction with a user, for example, engaging in voice interaction with a user when it is determined that the generated control commands are inaccurate or unreasonable.
[0284] For example, voice interaction with users can be achieved through local devices with voice broadcasting and data acquisition capabilities. These local devices include, but are not limited to, one or more of a central controller, a smart TV, and a smart speaker.
[0285] Figure 2 This is another schematic diagram of the voice control method according to an embodiment of this application. For example... Figure 2 As shown, the method includes:
[0286] Step 201: Obtain control commands generated from the voice data for controlling home appliances in the target space;
[0287] Step 202: Obtain the actual state information of the target space related to the control command;
[0288] Step 203: Based on the acquired actual status information, determine whether the control command is accurate; if the result is "yes", proceed to step 204; otherwise, proceed to step 205.
[0289] Step 204: Control home appliances according to control commands;
[0290] Step 205: Control home appliances without following control commands and interact with the user. For example, if the control command is unreasonable, the user can be prompted with information about the unreasonable control command and recommended control commands. If the control command does not match the control intention, the user can be prompted with information about the mismatch between the control command and the control intention.
[0291] Step 206: Update the control commands using recommended control instructions through interaction with the user, and control the home appliances according to the updated control commands; or, modify the control commands based on user feedback through interaction with the user, and control the home appliances according to the modified control commands; and
[0292] Step 207: Store the information in the voice data related to the user's expected feelings, along with the updated or corrected control commands, in the user's data list.
[0293] It is worth noting that the above figures are merely illustrative of embodiments of this application, and the application is not limited thereto. For example, the execution order between various operations can be appropriately adjusted, and other operations can be added or some operations can be removed (e.g., the operations or steps corresponding to the dashed boxes in the figures). Those skilled in the art can make appropriate modifications based on the above description, and are not limited to the description in the above figures.
[0294] The above embodiments are merely illustrative examples of embodiments of this application, but this application is not limited thereto, and appropriate modifications can be made based on the above embodiments. For example, the above embodiments can be used alone, or one or more of the above embodiments can be combined.
[0295] According to the above embodiments, for control commands generated based on inferences from voice data including information related to the user's expected feelings, further confirmation is performed before executing the control command; that is, the accuracy of the control command is determined. If the control command is accurate, the home appliances are controlled according to the control command.
[0296] On the one hand, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of devices, thereby reducing the threshold and difficulty for users to control home appliances, realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting users' personalized needs.
[0297] On the other hand, after generating control commands based on voice data including information related to the user's expected feelings, the accuracy of the control commands is determined. If the commands are accurate, the home appliances are controlled according to the commands. This significantly reduces the possibility of misoperation and ensures that the executed control commands match the user's actual intentions, further guaranteeing the user experience.
[0298] Example 2
[0299] Embodiment 2 of this application provides a voice control system, which corresponds to the method described in Embodiment 1. For details, please refer to the description in Embodiment 1.
[0300] Figure 3 This is a schematic diagram of a voice control system according to an embodiment of this application. Figure 3 As shown, the voice control system 300 includes: a control device 301 and at least one home appliance 302.
[0301] The control device 301 acquires control commands for controlling home appliances generated based on voice data, wherein the voice data includes information related to the user's expected feelings, and controls the home appliance 302 according to the control commands if the control commands are accurate.
[0302] In some embodiments, such as Figure 3 As shown, the voice control system 300 may also include a server 303.
[0303] In some embodiments, the accuracy of the control commands is determined by the control device 301 or by the server 303.
[0304] In some embodiments, the control commands are generated by the control device 301 or by the server 303.
[0305] For example, control device 301 generates control commands for controlling home appliances based on voice data; control device 301 determines the accuracy of the control commands, and if the control commands are accurate, control device 301 controls home appliances 302 according to the control commands.
[0306] For example, control device 301 generates control commands for controlling home appliances based on voice data and sends the control commands to server 303; server 303 determines the accuracy of the control commands, and if the control commands are accurate, control device 301 controls home appliance 302 according to the control commands.
[0307] For example, server 303 generates control instructions for controlling home appliances based on voice data and sends the control instructions to control device 301; control device 301 determines the accuracy of the control instructions, and if the control instructions are accurate, control device 301 controls home appliance 302 according to the control instructions.
[0308] For example, server 303 generates control commands for controlling home appliances based on voice data; server 303 determines the accuracy of the control commands, and if the control commands are accurate, control device 301 controls home appliance 302 according to the control commands.
[0309] When generating control commands for controlling home appliances based on voice data, the voice data can be acquired by the control device 301 or by other devices in the system 300.
[0310] In some embodiments, the control device may include at least one of a central controller, a wired controller, and a remote controller, wherein the central controller and the wired controller are also referred to as fixed controllers, which are fixedly installed on the wall of an indoor space.
[0311] In some embodiments, the central controller may be located within the indoor space in various ways.
[0312] For example, centralized controllers are set up in various spaces and can control the home appliances in the space where the centralized controller is located. For example, a first centralized controller is set up in the living room, a second centralized controller is set up in the bedroom, and a third centralized controller is set up in the kitchen. The first centralized controller can control the home appliances in the living room, the second centralized controller can control the home appliances in the bedroom, and the third centralized controller can control the home appliances in the kitchen.
[0313] For example, centralized controllers are set up in each space and can control the home appliances in all spaces. For instance, a first centralized controller is set up in the living room, a second centralized controller is set up in the bedroom, and a third centralized controller is set up in the kitchen. The first, second, and third centralized controllers can all control the home appliances in the living room, bedroom, and kitchen.
[0314] For example, a centralized controller can be installed in a specific space and control all home appliances in that space. Additionally, wired controllers can be installed in other spaces outside the designated central controller to control the appliances within those spaces. For instance, a centralized controller in the living room can control all home appliances in the living room, bedrooms, and kitchen; wired controllers can be installed in the bedrooms and kitchen to control the appliances in those spaces respectively.
[0315] This application is not limited to this; the control device may also include a gateway device. In some embodiments, the gateway device can control at least one home appliance according to control commands. For example, the gateway device can control all the home appliances in the voice control system, thereby enabling centralized control of home appliances by connecting home appliances in different spaces through a single gateway device. This application is not limited to this; the gateway device can control some of the home appliances in the voice control system. For example, when there are many home appliances in the voice control system, multiple gateway devices can be set up to control all the home appliances in the voice control system through multiple gateway devices.
[0316] In some embodiments, home appliances can be jointly controlled by a central controller and a gateway device. This allows for the inclusion of multiple control devices (e.g., a gateway device and a central controller) within the voice control system, thereby improving the reliability and fault tolerance of voice control.
[0317] In some embodiments, home devices may be smart home devices. For details regarding home devices, please refer to the relevant description in Embodiment 1, which will not be repeated here.
[0318] The specific processing procedures for each of the above devices can be found in the relevant descriptions in Example 1, and will not be repeated here.
[0319] Figure 4 This is a schematic diagram of a voice control system used in the control method of this application embodiment. Figure 4 As shown, the voice control system 100 includes one or more home appliances 110, user terminal 120, central controller 131, gateway device 132, router 140, Internet 150, and first server 161, second server 162, etc.
[0320] In some embodiments, the home appliance 110 may be a smart home appliance, for example, the home appliance includes at least one of an air handling unit, a smart device, a sensor, and a valve assembly. The air handling unit includes at least one of an indoor unit, a humidifier, a dehumidifier, a fresh air system, and a floor heating system. The smart device includes at least one of a smart speaker, a smart display device, a smart switch, smart curtains, smart lighting equipment, and a smart pet device. The valve assembly includes at least one of a damper and a floor heating valve.
[0321] In some embodiments, the user terminal 120 may be, for example, a user's smartphone, smart wearable device, or other terminal device with voice functionality.
[0322] In some embodiments, such as Figure 4 As shown, the home appliances 110-1 to 110-5 are centrally controlled by the central controller 131 or the gateway device 132.
[0323] In some embodiments, the central controller 131 is a controller with centralized control functions. For example, the central controller 131 can control multiple or various types of home appliances. The central controller 131 can be a fixed controller, for example, the central controller can be fixed in a preset location (e.g., a wall). The central controller 131 can receive user voice data and control at least one home appliance through the control commands corresponding to the voice data.
[0324] For example, the central controller 131 may include a voice input unit for receiving user voice data. The central controller 131 may also include a voice output unit for broadcasting voice data. Furthermore, the central controller 131 may also have a display screen.
[0325] In some embodiments, gateway device 132 is a gateway with centralized control functionality. Gateway device 132 can receive control commands corresponding to voice data sent from the network, and control at least one home appliance through these control commands.
[0326] In addition, in this embodiment, the central controller 131 and the gateway device 132 can also control home appliances through control commands corresponding to non-voice data.
[0327] In some embodiments, home appliance 110 can connect to and communicate with central controller 131 or gateway device 132 in various ways.
[0328] To distinguish between different connection or communication methods, such as Figure 4 As shown, home appliances 110 include multiple sets of home appliances 110-1, 110-2, 110-3, 110-4, and 110-5.
[0329] In some embodiments, home appliance 110-1 is connected to central controller 131 and gateway device 132 via wired connection. For example, home appliance 110-1 includes at least one of an outdoor air conditioner unit, an indoor air conditioner unit, a fresh air system, and a floor heating system. In addition, the indoor air conditioner unit can be connected to an air quality sensor and a wired controller, and the floor heating system can be connected to the wired controller.
[0330] In some embodiments, home device 110-2 is connected to central controller 131 and gateway device 132 via Wi-Fi. For example, home device 110-2 includes at least one of a home wall-mounted air conditioner, a wall-mounted / cabinet-style display unit, a humidification unit, a dehumidification unit, a smart pet device (e.g., a watchdog unit), and a sleep sensor.
[0331] In some embodiments, home device 110-3 is connected to central controller 131 via Bluetooth or Zigbee. For example, home device 110-3 includes at least one of smart curtains (e.g., motorized curtains, roller blinds) and smart lighting devices (e.g., dimmer lights).
[0332] In some embodiments, home appliances 110-4 are connected to a central controller 131 via a wired connection. For example, home appliances 110-4 include at least one of smart curtains (e.g., motorized curtains, roller blinds), smart lighting devices (e.g., ceiling lights), and floor heating valves.
[0333] In some embodiments, home device 110-5 is connected to gateway device 132 via Wi-Fi. For example, home device 110-5 is directly connected to gateway device 132 via Wi-Fi, or home device 110-5 is connected to router 140 via Wi-Fi, and then connected to gateway device 132 via router 140. Home device 110-5 is, for example, an indoor air sensor.
[0334] In some embodiments, the home appliance may also include Figure 4 Devices not shown, such as smart speakers, smart TVs, etc., can be connected wirelessly or wired to at least one of the central controller 131 and the gateway device 132.
[0335] In some embodiments, the control modes for home appliances include voice control modes and non-voice control modes (e.g., user-operated control modes).
[0336] In some embodiments, the voice control modes include an online voice control mode via the Internet and a local voice control mode implemented locally.
[0337] For example, in an online voice control mode via the internet, user terminal 120 sends the collected voice data to first server 161 via router 140 and internet 150. First server 161 recognizes the voice device, obtains corresponding text data or control parameters, and sends the text data or control parameters to second server 162. Second server 162 generates corresponding control commands based on the text data or control parameters and sends them to gateway device 132 via internet 150 and router 140. Gateway device 132 then controls the relevant home appliances according to the control commands. Alternatively, second server 162 sends control commands via internet 150 and router 140 to central controller 131, which then controls the relevant home appliances according to the control commands. Furthermore, the functions of first server 161 and second server 162 can also be performed by a single server; this embodiment does not limit this.
[0338] Alternatively, in the online voice control mode via the internet, the central controller 131 can collect voice data, transmit it through the router 140, and then via the internet 150 to the first server 161. The subsequent processing is similar to the process described above. Thus, the central controller 131 enables control of home appliances in the online voice control mode.
[0339] For example, in local voice control mode, voice data can be acquired by local devices. For instance, the central controller 131 collects voice data, recognizes the voice device, obtains corresponding text data or control parameters, generates corresponding control commands based on the text data or control parameters, and then controls the relevant home appliances according to the control commands.
[0340] According to the above embodiments, for control commands generated based on inferences from voice data including information related to the user's expected feelings, further confirmation is performed before executing the control command; that is, the accuracy of the control command is determined. If the control command is accurate, the home appliances are controlled according to the control command.
[0341] On the one hand, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of devices, thereby reducing the threshold and difficulty for users to control home appliances, realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting users' personalized needs.
[0342] On the other hand, after generating control commands based on voice data including information related to the user's expected feelings, the accuracy of the control commands is determined. If the commands are accurate, the home appliances are controlled according to the commands. This significantly reduces the possibility of misoperation and ensures that the executed control commands match the user's actual intentions, further guaranteeing the user experience.
[0343] Example 3
[0344] Embodiment 3 of this application provides a voice control device. This voice control device corresponds to the voice control method described in Embodiment 1, and the specific details can be found in Embodiment 1.
[0345] Figure 5 This is a schematic diagram of a voice control device according to an embodiment of this application. Figure 5 As shown, the device 500 includes an instruction acquisition unit 501 and a control unit 502. The instruction acquisition unit 501 acquires control instructions for controlling home appliances generated from voice data, wherein the voice data includes information related to the user's expected feelings. The control unit 502 determines the accuracy of the control instructions, and if the control instructions are accurate, controls the home appliances according to the control instructions.
[0346] The specific functions of each of the above units can be found in the relevant steps in Embodiment 1, and will not be repeated here.
[0347] It is worth noting that the above description only covers the components or modules relevant to this application, but this application is not limited thereto. The voice control device may also include other components or modules, or omit some components or modules (e.g., the components or modules corresponding to the dashed boxes in the figures). For details regarding these components or modules, please refer to related technologies.
[0348] Furthermore, for simplicity, the above figures only exemplify the connection relationships or signal flows between the various components or modules. However, those skilled in the art should understand that various related technologies, such as bus connections, can be employed. The aforementioned components or modules can be implemented using hardware facilities such as processors, memory, transmitters, and receivers; this application does not limit this implementation.
[0349] According to the above embodiments, for control commands generated based on inferences from voice data including information related to the user's expected feelings, further confirmation is performed before executing the control command; that is, the accuracy of the control command is determined. If the control command is accurate, the home appliances are controlled according to the control command.
[0350] On the one hand, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of devices, thereby reducing the threshold and difficulty for users to control home appliances, realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting users' personalized needs.
[0351] On the other hand, after generating control commands based on voice data including information related to the user's expected feelings, the accuracy of the control commands is determined. If the commands are accurate, the home appliances are controlled according to the commands. This significantly reduces the possibility of misoperation and ensures that the executed control commands match the user's actual intentions, further guaranteeing the user experience.
[0352] Example 4
[0353] Embodiment 4 of this application provides an electronic device. The steps executed by the processor of this electronic device correspond to all or part of the steps of the voice control method described in Embodiment 1, and the specific details can be found in the description of Embodiment 1.
[0354] Figure 6 This is a schematic diagram illustrating the configuration of an electronic device according to an embodiment of this application. Figure 6As shown, electronic device 600 may include processor 610 and memory 620; memory 620 is coupled to processor 610. It is worth noting that this figure is exemplary; other types of structures may be used to supplement or replace this structure to achieve telecommunications functions or other functions.
[0355] In one embodiment, the processor 610 may be configured to: acquire control instructions for controlling home appliances generated based on voice data, wherein the voice data includes information related to the user's expected feelings; determine the accuracy of the control instructions; and, if the control instructions are accurate, control the home appliances according to the control instructions.
[0356] like Figure 6 As shown, the electronic device 600 may also include: a communication module 630, an input unit 640, a display 650, a speaker 660, a microphone 670, and a power supply 680. It is worth noting that the electronic device 600 does not necessarily need to include these components. Figure 6 All components shown; in addition, the electronic device 600 may also include Figure 6 For components not shown, please refer to relevant technologies.
[0357] like Figure 6 As shown, processor 610, sometimes also referred to as controller or operation control, may include a microprocessor or other processor device and / or logic device, which receives input and controls the operation of various components of electronic device 600.
[0358] The memory 620 may be, for example, one or more of a cache, flash memory, hard drive, removable medium, volatile memory, non-volatile memory, or other suitable means. It can store various types of data, and also programs for executing related information. The processor 610 can execute the program stored in the memory 620 to perform information storage or processing, etc. The functions of other components are similar to those in existing systems and will not be described further here. The components of the electronic device 600 can be implemented using dedicated hardware, firmware, software, or a combination thereof without departing from the scope of the invention.
[0359] According to the above embodiments, for control commands generated based on inferences from voice data including information related to the user's expected feelings, further confirmation is performed before executing the control command; that is, the accuracy of the control command is determined. If the control command is accurate, the home appliances are controlled according to the control command.
[0360] On the one hand, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of devices, thereby reducing the threshold and difficulty for users to control home appliances, realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting users' personalized needs.
[0361] On the other hand, after generating control commands based on voice data including information related to the user's expected feelings, the accuracy of the control commands is determined. If the commands are accurate, the home appliances are controlled according to the commands. This significantly reduces the possibility of misoperation and ensures that the executed control commands match the user's actual intentions, further guaranteeing the user experience.
[0362] This application also provides a computer-readable program, wherein when the program is executed, the program causes the computer to perform the voice control method described in this application.
[0363] This application also provides a computer-readable storage medium storing a computer program that causes a computer to execute the voice control method described in this application.
[0364] This application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the voice control method described in this application.
[0365] The apparatus and methods described above in the embodiments of this application can be implemented in hardware or in combination with software. This application relates to a computer-readable program that, when executed by a logic component, enables the logic component to implement the apparatus or constituent parts described above, or to implement the various methods or steps described above.
[0366] This application also relates to storage media for storing the above programs, such as hard disks, magnetic disks, optical disks, DVDs, flash memory, etc.
[0367] It should be noted that the limitations on each step involved in this application are not considered as limiting the order of steps, provided that they do not affect the implementation of the specific solution. The steps listed first can be performed first, later, or even simultaneously. As long as the solution can be implemented, they should be considered to fall within the scope of protection of this application.
[0368] The present application has been described above with reference to specific embodiments. However, those skilled in the art should understand that these descriptions are exemplary and not intended to limit the scope of protection of the present application. Those skilled in the art can make various modifications and variations to the present application based on its spirit and principles, and these modifications and variations are also within the scope of the present application.
Claims
1. A voice control method, characterized in that, The method includes: Acquire control commands for controlling home appliances generated from voice data, wherein the voice data includes information related to the user's expected feelings; and The accuracy of the control command is determined, and if the control command is accurate, the home appliances are controlled according to the control command.
2. The method according to claim 1, characterized in that, The accuracy of the control command is determined based on at least one of the reasonableness of the control command and the matching of the control command with the user's control intention.
3. The method according to claim 2, characterized in that, The rationality is determined based on at least one of feasibility, comfort, and energy efficiency.
4. The method according to claim 3, characterized in that, The executability is determined based on the compatibility between the control commands and the capabilities of the first home appliances included in the target space; The comfort level is determined based on the compatibility of the control command with at least one of the following: current environmental parameters, current season, current time, geographic information, user attributes, user status, and user usage habits. The energy efficiency is determined based on at least one of the following: the operating power, operating time, operating mode, number of devices, and device type of the home appliances associated with the control command.
5. The method according to claim 4, characterized in that, The environmental parameters include at least one of the following: air quality parameters, light parameters, sound parameters, and odor parameters within the target space.
6. The method according to claim 4, characterized in that, The control command is associated with at least one of the following: the environmental parameter to be adjusted and the target value of the environmental parameter. If there is no home appliance capable of adjusting the environmental parameters among the first home appliances in the target space, or if there is a home appliance capable of adjusting the environmental parameters among the first home appliances in the target space, but the environmental parameters cannot be adjusted to the target value based on the control of the first home appliance, then the control command is not executable.
7. The method according to claim 6, characterized in that, The target space includes a first set of home appliances that do not contain any home appliances capable of adjusting the environmental parameters, including: The first home appliance cannot adjust all the environmental parameters that need to be adjusted; or The first home appliance cannot adjust environmental parameters or necessary environmental parameters that exceed the first preset ratio among all environmental parameters that need to be adjusted.
8. The method according to claim 6, characterized in that, The target space includes a first set of home appliances capable of adjusting the environmental parameters, including: The first home appliance can adjust all the environmental parameters that need to be adjusted; or The first home appliance can adjust environmental parameters or necessary environmental parameters that are at or above the second preset ratio among all environmental parameters that need to be adjusted. or, The inability to adjust the environmental parameters within the target space to the target value includes: The first home appliance cannot adjust all the environmental parameters that need to be adjusted within the target space to the corresponding target values; or The first home appliance cannot adjust any environmental parameter or necessary environmental parameter above the third preset ratio among all the environmental parameters that need to be adjusted in the target space to the corresponding target value.
9. The method according to claim 4, characterized in that, The control command is associated with at least one of the following: the environmental parameter to be adjusted and the target value of the environmental parameter. The control command is not energy-efficient if at least one of the following conditions is met: The first home appliance within the target space, which is associated with the control command, consumes more energy than a preset energy consumption threshold when adjusting the environmental parameters to the target value. The first home appliance in the target space, associated with the control command, adjusts the environmental parameters to the target value for a duration exceeding a preset time threshold. The target space contains other first home appliances that can adjust the environmental parameters to the target value and have lower operating energy consumption or shorter operating time; The target space contains a plurality of first home appliances associated with the control command, including home appliances that do not necessarily need to operate; or There is a contradiction between the operating states of multiple first home appliances within the target space that are associated with the control command.
10. The method according to claim 2, characterized in that, The method further includes: If it is determined that the control command is unreasonable, the home appliances will not be controlled or interacted with by the user according to the control command.
11. The method according to claim 10, characterized in that, The interaction with the user includes at least one of the following: Prompt the user to provide information indicating that the control command is unreasonable; or Prompt users to recommend control commands.
12. The method according to claim 11, characterized in that, In the event that the control command is not executable, the recommended control command is generated in the following manner: Based on the capabilities of the first home appliance in the target space, at least one of the environmental parameters and target values related to the control command is adjusted, and the recommended control command is generated based on the adjusted environmental parameters, the target values of the environmental parameters, and the home appliance used to adjust the environmental parameters. If the control commands lack comfort, the recommended control commands are generated as follows: Based on the current environmental parameters, current season, current time, geographical information, user attributes, user status, and user usage habits, at least one of the environmental parameters and target values related to the control command is adjusted. Based on the adjusted environmental parameters, the target values of the environmental parameters, and the home appliances used to adjust the environmental parameters, the recommended control command is generated. If the control command is not energy-efficient, the recommended control command is generated as follows: Based on the operating power, operating time, operating mode, number of devices or device type required to adjust the environmental parameters to the target value by the first home appliance in the target space, at least one of the environmental parameters and the target value is adjusted. Based on the adjusted environmental parameters, the target value of the environmental parameters and the home appliance used to adjust the environmental parameters, the recommended control command is generated.
13. The method according to claim 11, characterized in that, The method further includes: By interacting with the user, the recommended control instructions are used to update the control instructions, and the home appliances are controlled according to the updated control instructions.
14. The method according to claim 2, characterized in that, The method further includes: If it is determined that the control command does not match the user's control intention, the home appliances will not be controlled or interacted with according to the control command; Based on user feedback, the control commands are revised, and the home appliances are controlled according to the revised control commands.
15. A voice control system, characterized in that, The system includes a control device and at least one home appliance. The control device acquires control commands generated from voice data for controlling the home appliances, wherein the voice data includes information related to the user's expected feelings, and controls the home appliances according to the control commands if the control commands are accurate.
16. The system according to claim 15, characterized in that, The accuracy of the control commands is determined by the control device or by the server in the system.
17. A voice control device, characterized in that, The device includes: An instruction acquisition unit acquires control instructions for controlling home appliances generated based on voice data, wherein the voice data includes information related to the user's expected feelings; and The control unit determines the accuracy of the control commands and, if the control commands are accurate, controls the home appliances according to the control commands.
18. An electronic device, characterized in that, The electronic device includes: Memory, which stores computer programs; and A processor that, when executing the computer program, implements the method described in any one of claims 1-14.
19. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1-14.
20. A computer program product comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1-14.