Voice control method, voice control system, voice control device, and electronic device

Abstract

This application provides a voice control method, a voice control system, a voice control device, and an electronic device. The method includes: acquiring voice data; identifying first information related to a user's expected feelings in the voice data; generating a first control command based on the identified first information; and controlling home appliances in a target space according to the first control command. Therefore, voice control based on user expectations can accurately reflect the user's actual control intentions, achieving or approaching the user's desired environmental state through automatic control of devices, and preventing accidental control of devices, thus improving the user experience. Furthermore, it enables intelligent and flexible voice control, showcasing a technological feel and meeting the user's personalized needs.

Description

Technical Field

[0001] This application relates to the environmental field, and in particular to a voice control method, a voice control system, a voice control device, and an electronic device. Background Technology

[0002] With the development of science and technology and urban construction, voice recognition and voice control technologies are gradually being applied to all aspects of people's lives. For example, in office buildings, apartments, schools, shopping malls and other places, the application of various home appliances based on voice control is becoming more and more popular.

[0003] Currently, most existing voice control technologies control the corresponding devices by recognizing the control commands in the user's voice. For example, the air conditioner is controlled based on the user's voice commands such as "set the air conditioner to 16 degrees" or "turn the air conditioner fan down."

[0004] In recent years, voice control technology has also emerged that controls devices based on the user's description of their current physical condition. For example, air conditioners can be controlled based on information such as "too hot" or "a little cold" in the user's voice indicating their current physical condition.

[0005] It should be noted that the above introduction to the technical background is only for the purpose of providing a clear and complete explanation of the technical solutions of this application and facilitating understanding by those skilled in the art. It should not be assumed that these technical solutions are known to those skilled in the art simply because they have been described in the background section of this application. Summary of the Invention

[0006] The inventors discovered that in the existing technologies for controlling devices based on voice commands, users need to speak explicit control commands, which places high demands on them. However, users sometimes do not know what devices are installed in their room or all their functions, or they cannot determine which devices to use, or the appropriate operating mode or parameters. Therefore, the control commands spoken by the user may not reflect their actual control intentions, or the user may not know how to express their actual control intentions, resulting in poor performance and a reduced user experience.

[0007] In addition, in the existing technologies that control devices based on voice commands, users can often only express control commands for one or a few devices, and cannot make comprehensive use of multiple devices to achieve better control effects, which reduces the user experience.

[0008] In the aforementioned existing technologies that control devices based on the user's description of their current physical state, this control method infers the user's control intention based on their description of the current state, and cannot accurately reflect the user's actual control intention. For example, although the user is currently feeling hot, they may not actually want to turn on the air conditioner to lower the room temperature; or, for example, the phrase "It's too hot" uttered by the user may have other meanings, such as the user actually wanting to say that the tea they are drinking or the food they are eating is too hot, but uttering "It's too hot" will trigger a mis-control of the air conditioner; thus, it can easily lead to a degraded user experience or even user complaints.

[0009] To address one or more of the aforementioned problems, embodiments of this application provide a voice control method, a voice control system, a voice control device, and an electronic device. Voice control based on user expectations can accurately reflect the user's actual control intentions, achieving or approximating the user's desired environmental state through automatic device control, and preventing accidental device control, thereby improving the user experience. Furthermore, it enables intelligent and flexible voice control, showcasing a technological feel and meeting users' personalized needs.

[0010] According to a first aspect of the embodiments of this application, a voice control method is provided, the method comprising: acquiring voice data; identifying first information related to a user's expected feelings in the voice data; generating a first control command based on the identified first information; and controlling home appliances in a target space according to the first control command.

[0011] According to a second aspect of the embodiments of this application, a voice control system is provided, the voice control system including a voice acquisition device, a server, a control device, and at least one home appliance, wherein the voice acquisition device acquires voice data of a user; the server acquires the voice data, identifies first information related to the user's expected feelings in the voice data, generates a first control command based on the identified first information, and sends the first control command to the control device; the control device controls the home appliance in the target space according to the first control command.

[0012] According to a third aspect of the embodiments of this application, a voice control device is provided, the device comprising: an acquisition module for acquiring voice data; a recognition module for recognizing first information related to a user's expected feelings in the voice data; a generation module for generating a first control command based on the recognized first information; and a control module for controlling home appliances in a target space according to the first control command.

[0013] According to a fourth aspect of the present application, an electronic device is provided, the electronic device comprising: a memory storing a computer program; and a processor executing the computer program to implement the method described in the first aspect of the present application.

[0014] According to a fifth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the method described in the first aspect of the present application.

[0015] According to a sixth aspect of the embodiments of this application, a computer program product is provided, comprising a computer program, characterized in that, when the computer program is executed by a processor, it implements the method described in the first aspect of the embodiments of this application.

[0016] One of the beneficial effects of the embodiments of this application is that:

[0017] When information related to the user's expected feelings is identified in the user's voice data, i.e., the first information, control instructions are generated based on the first information and the home appliances in the target space are controlled. Since the user's expected feelings can accurately reflect the user's actual control intentions, voice control based on the user's expected feelings can achieve or approach the environmental state desired by the user and prevent accidental control of the devices, thereby improving the user experience.

[0018] In addition, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of the device, thereby realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting the personalized needs of users.

[0019] In addition, the voice control mode based on user expectations can identify the user's actual intention based on the user's abstract description of "expectations" and automatically convert it into the control command that needs to be executed to achieve the actual intention of "expectations". This control command may be a comprehensive control command for multiple devices. Therefore, users can achieve advanced control of multiple devices to achieve the actual intention of "expectations" through a short description (such as a sentence), which improves the user experience.

[0020] In addition, compared with the way users describe control commands and current physical state in traditional methods, the abstract description of "expected feelings" in the embodiments of the present invention can express the user's comprehensive feelings and needs. Moreover, this description contains more information, thus more fully reflecting the user's actual control intention.

[0021] In addition, users only need to say "what they expect to feel", without having to describe the device to be controlled or the specific control commands, which reduces the difficulty of operation and the threshold of use, and improves the user experience;

[0022] In addition, in the voice control mode based on user expectations, by analyzing and understanding the natural language expressed by the user, it is possible to identify the user's comprehensive and complex actual intentions. This solves the problem that users cannot fully describe their actual control intentions in the traditional voice control mode, making the control more precise and improving the user experience.

[0023] Furthermore, when both the first category of information related to the user's expectations and the second category of information related to the user's feelings are identified in the voice data, the combination of these two categories of information is taken as the first information related to the user's expected feelings. In this way, the "expected feelings" in the user's voice can be accurately captured, thereby enabling timely and accurate execution of corresponding controls and further improving the user experience.

[0024] Furthermore, the first category of information includes first descriptive information expressing the user's expected intention; the second category of information includes second descriptive information expressing the user's feelings, and does not include descriptive information related to home appliances or control commands. In this way, through the user's abstract description of "expected feelings", automatic control that reflects the user's actual control intention can be achieved, further enhancing the intelligence and technological feel of voice control and further improving the user experience.

[0025] Furthermore, the second descriptive information representing feelings includes at least one of a third descriptive information representing bodily sensations and a fourth descriptive information representing emotional sensations. The third descriptive information representing bodily sensations includes at least one of scene, location, weather, season, and time, while the fourth descriptive information representing emotional sensations includes at least one of subjective experience and emotion. In this way, users can express their personalized needs from multiple dimensions such as bodily sensations and emotional sensations, thereby satisfying users' comprehensive control needs and further improving the user experience.

[0026] Furthermore, by identifying the first and second categories of information based on the text data converted from the speech data, it is possible to easily and quickly identify information related to "expected feelings".

[0027] Furthermore, by matching the text data converted from voice data with a preset data table to identify the first category of information and the second category of information, it is possible to easily and quickly identify information related to "expected feelings".

[0028] Furthermore, by using sound wave matching to identify first-category and second-category information in voice data, it is possible to identify information related to "expected feelings" without recognizing the content of the voice data, thereby reducing the risk of user privacy leakage.

[0029] Furthermore, by using a Natural Language Processing (NLP)-based model to identify first-category and second-category information, it is possible to accurately identify information related to "expected feelings" and prevent omissions, thereby further improving the precision of device control.

[0030] Furthermore, when controlling the device based on first information related to the user's expected feelings, the system first determines whether the environmental parameters in the target space can be adjusted to the target value based on the first information and the target value of the environmental parameters, and then performs corresponding control if the ability of the home appliances in the target space is determined to be achievable. This allows the system to consider the capabilities of the devices actually deployed on-site and execute control that conforms to the actual situation.

[0031] Furthermore, when it is determined that the environmental parameters within the target space cannot be adjusted to the target value, it is determined whether the adjustable environmental parameters include the necessary environmental parameters. If the necessary environmental parameters are included, the corresponding control is executed. Thus, at least the necessary environmental parameters that achieve the user's expected experience can be adjusted to the target value, thereby maximizing or closely approximating the user's main control intention and further improving the user experience.

[0032] Furthermore, the necessary environmental parameters include preset environmental parameters among a variety of environmental parameters that need to be adjusted, or environmental parameters with preset priorities among a variety of environmental parameters that need to be adjusted. Therefore, based on the type or priority of the various environmental parameters that need to be adjusted, corresponding controls can be executed, thereby enabling the use of actually deployed equipment on-site to achieve the user's main control intent or close to the user's control intent, further improving the user experience.

[0033] Furthermore, the preset environmental parameters, the priority of the environmental parameters, and the preset priority used for the above determination can be set by the user, or set through interaction with the user, or automatically updated by learning from at least one of the user's usage habits, environment, current season, user status, and user feedback. In this way, the above ratios or priorities can be flexibly set in different scenarios, or the above ratios or priorities can be determined through self-learning, thereby improving the accuracy and rationality of the above ratios or priorities.

[0034] Furthermore, if it is determined that the environmental parameters within the target space cannot be adjusted to the target value, at least one of the environmental parameters at the target value is adjusted based on the capabilities of the home appliances within the target space. Corresponding controls are then implemented based on the adjusted environmental parameters and the target value. This allows for optimization of the parameters requiring adjustment (e.g., changing them to similar adjustable environmental parameters) and the target value (e.g., changing them to an achievable target value) using the actually deployed equipment on-site, even when the desired experience cannot be fully achieved. This results in an adjustment effect that closely approximates the desired experience. In other words, existing equipment is used to meet the user's personalized needs as much as possible, thus enhancing the user experience.

[0035] Furthermore, the accuracy of the first control command generated based on the first information related to the user's expected feelings is determined. If the command is determined to be accurate, the control is executed; if the command is determined to be inaccurate, the user is contacted for confirmation. This ensures that the control of the device conforms to the current situation and the user's actual intentions, avoids the execution of obviously inaccurate control commands, and thus guarantees the user experience.

[0036] Furthermore, the accuracy of the first control command is determined based on at least one of the rationality of the first control command and the matching of the first control command with the user's control intention; the rationality is determined based on at least one of the feasibility, comfort and energy saving, so that factors such as equipment, user, environment and cost can be comprehensively considered to determine the rationality of the control command, thereby making the result of the rationality determination more accurate and in line with the user's actual intention.

[0037] Furthermore, executability is determined based on the compatibility between the first control command and the capabilities of the home appliances within the target space; comfort is determined based on the compatibility between the first control command and at least one of the following: current environmental parameters, current season, current time, geographical information, user attributes, user status, and user usage habits; energy efficiency is determined based on at least one of the following: operating power, operating time, operating mode, number of devices, and device type of the home appliances related to the first control command. This comprehensive consideration of various usage scenarios and user needs allows for the determination of the above-mentioned rationality, thereby further improving the accuracy of the rationality determination results and their alignment with the user's actual intentions.

[0038] Furthermore, if the rationality of the first control command is deemed unreasonable, the first control command can be updated through interaction with the user, and the device can be controlled according to the updated first control command. This can promptly correct the deviation between the initially generated control command and the user's actual intention, ensuring that the control effect matches the user's actual intention and further improving the user experience.

[0039] Furthermore, after performing corresponding control based on the first control instruction, the first control instruction is corrected based on user feedback, and the obtained first corrected control instruction is stored in the control instruction database. When the first information corresponding to the first control instruction is identified again, the first corrected control instruction can be directly invoked to perform corresponding control, thereby enabling the user's actual intention to be determined quickly and accurately and the corresponding control to be executed, further improving the user experience.

[0040] Furthermore, in the control command database, the first information related to the user's expected experience, the corresponding first control command, and the modified first control command are stored in a corresponding manner according to different users, thereby meeting the personalized control needs of different users and further improving the user experience.

[0041] Furthermore, based on the first control command, multiple home appliances within the target space can be controlled, thereby enabling the coordinated control of multiple devices or multiple devices through a single command from the user, achieving a control effect that better matches the user's actual intentions.

[0042] Specific embodiments of this application are disclosed in detail with reference to the following description and accompanying drawings, indicating how the principles of this application can be adopted. It should be understood that the embodiments of this application are not limited in scope. Within the spirit and scope of the appended claims, embodiments of this application include many changes, modifications, and equivalents.

[0043] The feature information described and illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, combined with feature information in other embodiments, or substituted for feature information in other embodiments.

[0044] It should be emphasized that the term "including / comprises" as used herein refers to the presence of a feature, whole, step, or component, but does not exclude the presence or addition of one or more other features, wholes, steps, or components. Attached Figure Description

[0045] Many aspects of this application can be better understood by referring to the following accompanying drawings. The components in the drawings are not drawn to scale, but are only intended to illustrate the principles of this application. Corresponding portions in the drawings may be enlarged or reduced for ease of illustration and description of certain parts of this application. Elements and features described in one drawing or embodiment of this application may be combined with elements and features shown in one or more other drawings or embodiments. Furthermore, similar reference numerals in the drawings denote corresponding components in several drawings and can be used to indicate corresponding components used in more than one embodiment.

[0046] In the attached diagram:

[0047] Figure 1 This is a schematic diagram of a voice control method according to an embodiment of this application;

[0048] Figure 2 This is a schematic diagram of a method for implementing step 102 in an embodiment of this application;

[0049] Figure 3 This is a schematic diagram of a method for implementing step 103 in an embodiment of this application;

[0050] Figure 4 This is a flowchart of one implementation of the voice control method according to an embodiment of this application;

[0051] Figure 5 This is a schematic diagram of a voice control system according to an embodiment of this application;

[0052] Figure 6 This is a configuration diagram of the voice control system used in the voice control method of this application embodiment;

[0053] Figure 7 This is a schematic diagram of a voice control device according to an embodiment of this application;

[0054] Figure 8 This is a schematic block diagram of the system configuration of an electronic device according to an embodiment of this application. Detailed Implementation

[0055] The preferred embodiments of this application will now be described with reference to the accompanying drawings.

[0056] Example 1

[0057] Embodiment 1 of this application provides a voice control method.

[0058] Figure 1 This is a schematic diagram of a voice control method according to an embodiment of this application. Figure 1 As shown, the method includes:

[0059] Step 101: Acquire voice data;

[0060] Step 102: Identify the first information related to the user's expected feelings in the voice data;

[0061] Step 103: Generate a first control command based on the identified first information; and

[0062] Step 104: Control the home appliances in the target space according to the first control command.

[0063] In this way, when information related to the user's expected feelings is identified in the user's voice data, i.e., the first information, control instructions are generated based on the first information and the home appliances in the target space are controlled. Since the user's expected feelings can accurately reflect the user's actual control intentions, voice control based on the user's expected feelings can achieve or approach the environmental state desired by the user and prevent mis-control of the devices, thereby improving the user experience.

[0064] In addition, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of the device, thereby realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting the personalized needs of users.

[0065] In addition, the voice control mode based on user expectations can identify the user's actual intention based on the user's abstract description of "expectations" and automatically convert it into the control command that needs to be executed to achieve the actual intention of "expectations". This control command may be a comprehensive control command for multiple devices. Therefore, users can achieve advanced control of multiple devices to achieve the actual intention of "expectations" through a short description (such as a sentence), which improves the user experience.

[0066] In addition, compared with the way users describe control commands and current physical state in traditional methods, the abstract description of "expected feelings" in the embodiments of the present invention can express the user's comprehensive feelings and needs. Moreover, this description contains more information, thus more fully reflecting the user's actual control intention.

[0067] In addition, users only need to say "what they expect to feel", without having to describe the device to be controlled or the specific control commands, which reduces the difficulty of operation and the threshold of use, and improves the user experience;

[0068] In addition, in the voice control mode based on user expectations, by analyzing and understanding the natural language expressed by the user, it is possible to identify the user's comprehensive and complex actual intentions. This solves the problem that users cannot fully describe their actual control intentions in the traditional voice control mode, making the control more precise and improving the user experience.

[0069] The voice control method of this application is not only applicable to home scenarios, such as residences and apartments, but also to commercial or public scenarios such as office buildings, shopping malls, schools, and factories. This application does not limit the application scenarios of the voice control method.

[0070] The voice control method of this application embodiment is used to control home devices. The home devices in this application embodiment can be various devices deployed in various application scenarios such as home scenarios, commercial scenarios or public scenarios to adjust the indoor environment or meet user needs. This application embodiment does not limit the types of home devices.

[0071] The voice control method of this application embodiment can control home appliances in a target space, that is, the target space is an indoor space that serves as the target for environmental regulation.

[0072] The target space in this application embodiment may include one or more indoor spaces, such as a living room, bedroom, kitchen, bathroom, etc.

[0073] In some embodiments, home appliances may be smart home appliances, such as air handling equipment and smart devices.

[0074] For example, smart devices include at least one of smart speakers, smart display devices, smart switches, smart curtains, smart lighting devices, sensors, and smart pet devices;

[0075] For example, air handling equipment includes at least one of indoor units, humidifiers, dehumidifiers, fresh air systems, air purifiers, fragrance components, and underfloor heating systems.

[0076] In some embodiments, the air handling unit affects the indoor space within the target space.

[0077] For example, at least one air handling unit is installed in the target space. In some embodiments, indoor units are installed in each indoor space within the target space, or indoor units are installed in some indoor spaces within the target space.

[0078] For example, air handling equipment can be associated with indoor spaces in a target space. For instance, the correspondence between air handling equipment and indoor spaces can be determined through the binding information of the air handling equipment.

[0079] In some embodiments, the air handling unit may not be installed in the target space's interior space, but it may still affect the target space's interior space. For example, a fresh air unit with its main unit installed above the ceiling.

[0080] In some embodiments, the air handling equipment includes at least one of an indoor unit, a humidifier, a dehumidifier, a fresh air system, a floor heating system, and a valve assembly.

[0081] In addition, air handling equipment can also be called air conditioning equipment.

[0082] In some embodiments, the indoor unit is an indoor unit in an air handling system that includes air handling equipment, and the air handling system may include a commercial air conditioning system or a residential air conditioning system.

[0083] In some embodiments, an air conditioning system may include at least one set of outdoor units and at least one indoor unit connected to each set of outdoor units. That is, an air conditioning system may include one or more sets of outdoor units, each set of outdoor units including at least one outdoor unit; for each set of outdoor units, the set of outdoor units is connected to at least one indoor unit.

[0084] For example, an air conditioning system includes an outdoor unit and an indoor unit connected to the outdoor unit.

[0085] For example, an air conditioning system includes an outdoor unit and at least two indoor units connected to the outdoor unit.

[0086] For example, an air conditioning system includes at least two outdoor units and at least two indoor units connected to the at least two outdoor units.

[0087] For example, a group of outdoor units and at least one indoor unit connected to the group of outdoor units constitute a refrigerant system, or multiple groups of outdoor units and at least one indoor unit connected to the multiple groups of outdoor units respectively constitute multiple refrigerant systems. Thus, an air conditioning system may include one refrigerant system or multiple refrigerant systems.

[0088] In some embodiments, the outdoor unit and the indoor unit can be air conditioning equipment of various models, types, forms, and capacities. For example, the indoor unit can be in the form of four-sided air outlet, two-sided air outlet, duct unit, floor air outlet, or skirting board air outlet, etc.; the outdoor unit can be in the form of single fan top air outlet, dual fan top air outlet, single fan front air outlet, or dual fan front air outlet, etc.

[0089] In some embodiments, the fresh air equipment includes at least one of a fresh air handling device, a total heat exchange device (e.g., with or without internal circulation function), and a ventilation device (e.g., with or without internal circulation function).

[0090] In some embodiments, at least one of the humidifying device and the dehumidifying device is disposed on the output side of the fresh air device to humidify or dehumidify the air output by the fresh air device, for example, to humidify or dehumidify the air output by the fresh air device, and to introduce the humidified or dehumidified air into the indoor space. For example, at least one of the humidifying device and the dehumidifying device has a heat exchanger that can operate as an evaporator.

[0091] In some embodiments, the underfloor heating system is connected to the outdoor unit via refrigerant piping, and to the indoor underfloor heating radiator piping via underfloor heating water piping. For example, the outdoor unit and the underfloor heating system form an air-source heat pump water heater, utilizing heat from the air and the operation of the compressor to heat water. The underfloor heating system may include a water-heat exchange unit, where refrigerant from the outdoor unit's compressor enters the unit via refrigerant piping to exchange heat with the water, thereby heating the water. The heated water is then introduced into the indoor underfloor heating radiator piping via the underfloor heating water piping to provide heating for the indoor space. In some embodiments, the outdoor unit and the underfloor heating system are separate units, or they are integrated.

[0092] In some embodiments, the valve assembly includes at least one of an air valve and a floor heating valve.

[0093] In some embodiments, the air valve for controlling the air volume of the indoor space is, for example, an air valve for controlling the amount of air supplied to the indoor space by the air supply device. For example, when the external circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the outdoor air introduced into the indoor space; when the internal circulation function of the total heat exchanger is turned on, the air valve for controlling the air volume of the indoor space can control the air volume of the indoor air introduced into the indoor space.

[0094] In some embodiments, the floor heating valve is used to control the opening and closing of the inlet and outlet pipes in the floor heating system.

[0095] In step 101, voice data is acquired. In this embodiment, the voice data can be obtained through a local device.

[0096] In some embodiments, the local device includes at least one of a controller, an indoor air conditioning unit, a smart device, and a user terminal.

[0097] In some embodiments, the controller includes at least one of a central controller, a wired controller, and a remote controller.

[0098] In some embodiments, the central controller and the wired controller are fixed controllers, for example, fixed to a wall in an indoor space.

[0099] In some embodiments, the central controller may be installed in multiple indoor spaces, that is, the central controller is configured to correspond to all or part of the indoor spaces.

[0100] This allows for the full utilization of various devices as local devices for voice data acquisition, improving the utilization rate of local devices, thereby reducing the cost of voice data acquisition and improving the efficiency and flexibility of voice data processing.

[0101] In some embodiments, smart devices include at least one of smart speakers, smart display devices, smart switches, smart curtains, smart lighting devices, sensors (e.g., air sensors, temperature sensors, humidity sensors, etc.), and smart pet devices.

[0102] In some embodiments, in step 101, voice data is acquired through a first local device, and the voice data may be an audio signal.

[0103] For example, the audio signal can be directly acquired by the first local device, or it can be acquired by the second local device and then sent to the first local device. For instance, the centralized controller can act as the first local device to directly acquire the audio signal, or an indoor air conditioning unit or smart device can act as the second local device to acquire the audio signal and then send the acquired audio data to the centralized controller, which is acting as the first local device. This application does not limit the method of acquiring voice data.

[0104] For example, after a user enables the voice control function of a first local device (e.g., a centralized controller), voice monitoring is activated to acquire the monitored voice data. Another example is that the first local device (e.g., the centralized controller) has a control interface that interacts with the user, allowing the user to perform related operations through the interface.

[0105] In some embodiments, the scope of the activated voice monitoring is a target space. Voice monitoring is activated after user confirmation before it can be performed on the target space. For example, the user can confirm or set the settings in the control interface of the central controller to activate the voice monitoring and voice control functions. Alternatively, the user can also set the scope of voice monitoring in the control interface.

[0106] In addition, the scope of the activated voice monitoring may not be the target space or may not be limited to the target space. For example, if the user is currently in the living room and wants to control the home appliances in the bedroom, then the target space is the bedroom, and the scope of the activated voice monitoring includes the living room, or includes both the living room and the bedroom.

[0107] After acquiring the voice data, in step 102, first information related to the user's expected feelings is identified in the voice data.

[0108] In some embodiments, first information related to the user's expected feelings and control functions based on the first information are identified in the voice data, namely, voice control functions based on the user's expected feelings, which can be turned on or off through the user's settings.

[0109] In the embodiments of this application, "user's expected feeling" refers to an abstract description of the feeling that the user expects to experience.

[0110] In some embodiments, "expected" means that the user is willing or wants to obtain it.

[0111] In some embodiments, the sensation may include at least one of a bodily sensation and a mood sensation.

[0112] In some embodiments, bodily sensation refers to the body's perception of the environment, which may be associated with at least one of scene, location, weather, season, and time. For example, "a gentle breeze in the shade of summer," "the West Lake in April," "the refreshing feeling after the rain," "a mountain after a fresh rain," etc.

[0113] In some embodiments, mood refers to at least one of the feelings and emotions evoked about things or people. For example, "the taste of love," "longing like the wind," or "the feeling of a sunny young man."

[0114] In this way, recognition can be performed on the voice data based on the aforementioned content of "user's expected feelings".

[0115] Figure 2 This is a schematic diagram of a method for implementing step 102 of an embodiment of this application. For example... Figure 2 As shown, the method includes:

[0116] Step 201: Identify the first category of information and the second category of information in the speech data;

[0117] Step 202: If the voice data contains both the first category information and the second category information, the information obtained by combining the first category information and the second category information shall be used as the first information.

[0118] The first category of information is related to user expectations, while the second category of information is related to user feelings.

[0119] In this way, when both the first category of information related to the user's expectations and the second category of information related to the user's feelings are identified in the voice data, the combination of these two categories of information is used as the first information related to the user's expected feelings. This allows for the accurate capture of the "expected feelings" in the user's voice, enabling timely and accurate execution of corresponding controls and further improving the user experience.

[0120] In step 201, a first category of information and a second category of information are identified in the voice data. For example, descriptive information in the first category of information and the second category of information is identified. In some embodiments, the first category of information includes first descriptive information representing the user's expected intention; the first descriptive information includes, for example, first keywords, such as "I want", "I expect", "I hope", "I want", "I think", "I need", "give me", "help me", "I hope", etc.; or, the first descriptive information includes, for example, sentences or phrases with the meaning of "expected intention", such as "It would be great if I could...", "...it feels so good", etc.

[0121] The second category of information includes descriptive information expressing feelings, but does not include descriptive information related to home appliances or control commands. That is, the second category of descriptive information to be identified is an abstract description of feelings, not control commands for appliances. The second descriptive information may include, for example, second keywords such as "April," "summer," or "sunny day," or it may include sentences or phrases with the meaning of "feeling," such as "after a rain in the empty mountains" or "the taste of love."

[0122] In this way, by abstracting the user's "expectations and feelings," it is possible to achieve automatic control that reflects the user's actual control intentions, further enhancing the intelligence and technological feel of voice control and improving the user experience.

[0123] In some embodiments, the second descriptive information representing a feeling includes at least one of a third descriptive information representing a bodily feeling and a fourth descriptive information representing a mood feeling, wherein the third descriptive information representing a bodily feeling includes at least one of a scene, location, weather, season, and time, and the fourth descriptive information representing a mood feeling includes at least one of a subjective experience and an emotion.

[0124] In this way, users can express their personalized needs from multiple dimensions such as physical sensation and emotional state, thereby satisfying users' comprehensive control needs and further improving the user experience.

[0125] In some embodiments, during step 201, first category information and second category information are identified based on the text data converted from the speech data. For example, the speech data is converted into text data, and the first category information and second category information are identified in the text data. This allows for the simple and rapid identification of information related to "expected feelings."

[0126] In some embodiments, when identifying first category information and second category information based on text data converted from voice data, the text data can be matched with a preset data table. If the match is successful, the first category information and the second category information in the text data can be determined, thereby enabling simple and quick identification of information related to "expected feelings".

[0127] Alternatively, when identifying the first and second categories of information based on the text data converted from voice data, the text data can be input into a natural language processing-based model to output the first and second categories of information. This enables accurate identification of relevant information about "expected feelings" and prevents omissions, thereby further improving the precision of device control.

[0128] In some embodiments, when performing step 201, a first category of information and a second category of information are identified in the speech data by sound wave matching. For example, sound wave matching is performed on the speech data, matching the sound waves of the speech data with preset sound wave data. If the match is successful, the first category of information and the second category of information in the speech data are determined, thereby enabling the identification of information related to "expected feelings" without recognizing the content of the speech data, reducing the risk of user privacy leakage.

[0129] In some embodiments, the recognition of voice data in this application is applicable to scenarios with or without a wake word.

[0130] For example, in scenarios with a wake word, sound wave matching is used to identify whether the user's voice data includes a preset wake word. If the voice data includes a preset wake word, the voice data is converted into text data, and a first category of information and a second category of information are identified based on the text data; or, if the voice data includes a preset wake word, sound wave matching is used to identify the first category of information and the second category of information in the voice data.

[0131] For example, in a scenario without a wake word, when the user's voice data is detected, the first category of information and the second category of information are identified in the voice data. For example, the first category of information and the second category of information are identified based on the text data converted from the voice data, or the first category of information and the second category of information are identified in the voice data through sound wave matching.

[0132] In step 202, if the voice data contains both the first category of information and the second category of information, the information obtained by combining the first category of information and the second category of information is taken as the first information. That is, the first information identified from the voice data needs to have both the elements of "expectation" and "feeling" to reflect the user's true intention.

[0133] In some embodiments, steps 201-202 can be executed locally, for example, in one or more local devices; or, step 201 is executed in a local device, which performs sound wave matching on the voice data, or the local device uploads the converted text data to a server, and step 202 is executed on the server side; or, the local device uploads the collected voice data to the server, and steps 201-202 are all executed on the server side.

[0134] When the first information is identified from the voice data, in step 103, a first control command is generated based on the identified first information.

[0135] Figure 3 This is a schematic diagram of a method for implementing step 103 of an embodiment of this application. For example... Figure 3 As shown, the method includes:

[0136] Step 301: Based on the first information, determine the environmental parameter that needs to be adjusted and the target value of the environmental parameter;

[0137] Step 302: Based on the capabilities of the home appliances in the target space, determine whether control based on the home appliances can adjust the environmental parameter in the target space to the target value; and

[0138] Step 303: If it is determined that the environmental parameter in the target space can be adjusted to the target value, a first control command for the home appliance is generated based on the environmental parameter, the target value of the environmental parameter, and the home appliance used to adjust the environmental parameter.

[0139] In this way, when controlling the device based on the first information related to the user's expected feelings, the system first determines whether it is possible to adjust the environmental parameters in the target space to the target value based on the first information and the target value of the environmental parameters, and then performs the corresponding control if it is determined that it is possible to adjust the environmental parameters in the target space to the target value. This allows the system to take into account the capabilities of the devices actually deployed on site and perform control that conforms to the actual situation.

[0140] In some embodiments, environmental parameters may include at least one of the following parameters: air quality parameter, light parameter, sound parameter, and odor parameter. For example, environmental parameters may be adjusted by at least one home appliance deployed within the target space.

[0141] For example, air quality parameters include at least one of the following: temperature, humidity, carbon dioxide concentration, fine particulate matter (e.g., PM2.5) concentration, inhalable particulate matter (e.g., PM10) concentration, volatile organic compound (VOC) concentration, indoor total organic matter (TVOC) concentration, nitrogen oxide concentration, ozone concentration, wind speed, and wind direction. Air quality parameters can be regulated by air handling equipment (e.g., at least one of indoor units, humidifiers, dehumidifiers, fresh air systems, air purifiers, fragrance diffusers, and underfloor heating systems) and cleaning equipment (e.g., robotic vacuum cleaners) within the target space.

[0142] For example, lighting parameters include at least one of the following: light intensity, color, direction, and range. Lighting parameters can be adjusted by lighting equipment, curtains, etc., within the target space.

[0143] For example, sound parameters include volume, content, timbre, and tone. These parameters can be adjusted by audio-visual devices within the target space, such as smart speakers and smart TVs.

[0144] For example, odor parameters include the various types of odors in the air and their concentrations. These odor parameters can be adjusted, for example, by fragrance components within the target space.

[0145] In step 301, based on first information related to the user's expected experience, the environmental parameter that needs to be adjusted and its target value are determined. The environmental parameter that needs to be adjusted and its target value can be determined in various ways.

[0146] In some embodiments, first information or a question based on the first information can be input into a first model, which then outputs environmental parameters matching the first information and their target values. For example, the first model is a big data model, an AI question-answering model, or an AI search engine.

[0147] For example, if the "first information" is "a gentle breeze in the shade in summer", and the big data model is input with "a gentle breeze in the shade in summer", the big data model will output "temperature 26 degrees, no direct sunlight, wind force level 1".

[0148] For example, if the "first information" is "West Lake in April", and the AI ​​question-answering model is input with "What are the air parameters of West Lake in April", the AI ​​question-answering model will output "Temperature 18-20 degrees, humidity 70-80%, wind force 1-2".

[0149] For example, if the "first information" is "the taste of love", and you input "how to create the taste of love" into the AI ​​question-answering model, the AI ​​question-answering model will output "temperature 22-25 degrees, soft lighting, play light music".

[0150] In step 302, it can be determined whether the control based on the home appliances in the target space can adjust the environmental parameter in the target space to the target value, based on the capabilities of the home appliances in the target space.

[0151] For example, as mentioned above, if the "first information" is "a cool breeze in the shade during summer", the environmental parameters output by the big data model are "temperature 26 degrees, no direct sunlight, wind force level 1". The target space is a bedroom, which is equipped with an air conditioner that can adjust the temperature and wind force, smart curtains and smart lighting equipment. Therefore, it has the ability to adjust the environmental parameters in the target space to the target value.

[0152] For example, as mentioned above, in the case where the "first information" is "the West Lake in April", the environmental parameters output by the artificial intelligence question answering model are "temperature 18-20 degrees, humidity 70-80%, wind force 1-2". The target space is the living room, which is equipped with an air conditioner that can adjust the temperature, humidity and wind force, and also has a humidifier that can adjust the humidity. Therefore, it has the ability to adjust the environmental parameters in the target space to the target value.

[0153] For example, as mentioned above, when the "first information" is "the taste of love", the environmental parameters output by the AI ​​question-answering model are "temperature 22-25 degrees, soft lighting, playing light music". The target space is the living room. However, the living room is only equipped with air conditioning and cannot automatically adjust the lighting and play light music. Therefore, it does not have the ability to adjust the environmental parameters in the target space to the target value.

[0154] In step 303, if it is determined that the environmental parameter within the target space can be adjusted to the target value, a first control command for the home appliance is generated based on the environmental parameter, the target value of the environmental parameter, and the home appliance used to adjust the environmental parameter. The first control command can be generated in various ways.

[0155] In some embodiments, environmental parameters, target values ​​of the environmental parameters, and home appliances used to adjust the environmental parameters can be input into a second model, which then outputs a first control command. For example, the second model is a trained deep learning model.

[0156] For example, as mentioned above, for the case where the "first information" is "a cool breeze in the shade during summer", the environmental parameters output by the big data model are "temperature 26 degrees, no direct sunlight, wind force level 1". The first control command generated by the second model is "adjust the air conditioner temperature to 26 degrees, adjust the air volume to low, and close the sheer curtains in the curtains". In addition, based on the detection results of the user's location, the control command can also include instructions for adjusting the air conditioner's airflow direction.

[0157] For example, as mentioned above, for the case where the "first information" is "West Lake in April", the environmental parameters output by the AI ​​question-answering model are "temperature 18-20 degrees, humidity 70-80%, wind force 1-2". The first control command generated by the second model is "adjust the air conditioner temperature to 20 degrees, adjust the air volume to low, and adjust the target humidity of the humidifier to 70%". In addition, based on the detection results of the user's location, the control command can also include instructions for adjusting the air conditioner's airflow direction.

[0158] In some embodiments, a control command database may be established, in which the first information, environmental parameters, target values, home appliances, and the corresponding first control commands are stored; or, the environmental parameters, target values, home appliances, and the corresponding first control commands are stored.

[0159] Thus, in steps 301 and 303, environmental parameters matching the first information, their target values, and the first control command can be obtained by looking up a table.

[0160] After the first control command is generated, in step 104, the home appliances in the target space are controlled according to the first control command.

[0161] In some embodiments, step 104 is performed by the control device, that is, the control corresponding to the first control command is performed.

[0162] In some embodiments, the control device may include at least one of a central controller, a wired controller, and a remote controller, wherein the central controller and the wired controller are also referred to as fixed controllers, which are fixedly installed on the wall of an indoor space.

[0163] In some embodiments, the central controller may be located within the indoor space in various ways.

[0164] For example, centralized controllers are set up in various spaces and can control the home appliances in the space where the centralized controller is located. For example, a first centralized controller is set up in the living room, a second centralized controller is set up in the bedroom, and a third centralized controller is set up in the kitchen. The first centralized controller can control the home appliances in the living room, the second centralized controller can control the home appliances in the bedroom, and the third centralized controller can control the home appliances in the kitchen.

[0165] For example, centralized controllers are set up in each space and can control the home appliances in all spaces. For instance, a first centralized controller is set up in the living room, a second centralized controller is set up in the bedroom, and a third centralized controller is set up in the kitchen. The first, second, and third centralized controllers can all control the home appliances in the living room, bedroom, and kitchen.

[0166] For example, a centralized controller can be installed in a specific space and control all home appliances in that space. Additionally, wired controllers can be installed in other spaces outside the designated central controller to control the appliances within those spaces. For instance, a centralized controller in the living room can control all home appliances in the living room, bedrooms, and kitchen; wired controllers can be installed in the bedrooms and kitchen to control the appliances in those spaces respectively.

[0167] This application is not limited to this; the control device may also include a gateway device. In some embodiments, the gateway device can control at least one home appliance according to control commands. For example, the gateway device can control all the home appliances in the voice control system, thereby enabling centralized control of home appliances by connecting home appliances in different spaces through a single gateway device. This application is not limited to this; the gateway device can control some of the home appliances in the voice control system. For example, when there are many home appliances in the voice control system, multiple gateway devices can be set up to control all the home appliances in the voice control system through multiple gateway devices.

[0168] In some embodiments, home appliances can be jointly controlled by a central controller and a gateway device. This allows for the inclusion of multiple control devices (e.g., a gateway device and a central controller) within the voice control system, thereby improving the reliability and fault tolerance of voice control.

[0169] In some embodiments, the method may further include:

[0170] If it is determined that the multiple environmental parameters within the target space (i.e., the multiple environmental parameters that need to be adjusted as determined in step 301) cannot be adjusted to the corresponding target values, and the environmental parameters are multiple environmental parameters, it is determined whether the control based on the home appliance can adjust the necessary environmental parameter among the multiple environmental parameters to the corresponding target value.

[0171] When the necessary environmental parameter among the various environmental parameters can be adjusted to the corresponding target value, a first control command for the home appliance is generated based on the necessary environmental parameter, the target value of the necessary environmental parameter, and the home appliance used to adjust the necessary environmental parameter.

[0172] In some embodiments, necessary environmental parameters refer to environmental parameters that must be adjusted to achieve the user's control intent. In other words, by adjusting all necessary environmental parameters, the user's main control intent or close to the user's control intent can be achieved.

[0173] In some embodiments, the necessary environmental parameters correspond to the user’s control intent, or to the “expected feeling” that embodies the control intent.

[0174] In this way, when it is determined that it is impossible to adjust the environmental parameters that need to be adjusted within the target space to the target value, it is determined whether the adjustable environmental parameters include the necessary environmental parameters. If the necessary environmental parameters are included, the corresponding control is executed. Thus, at least the necessary environmental parameters that achieve the user's expected experience can be adjusted to the target value, thereby maximizing the satisfaction of the user's main control intention or close to the user's control intention, and further improving the user experience.

[0175] For example, if it is determined that the environmental parameters in the target space cannot be adjusted to the corresponding target values ​​by controlling the home appliances, it is determined whether the environmental parameters that can be adjusted to the corresponding target values ​​include the corresponding necessary environmental parameters; if so, a first control command for the home appliances is generated based on the environmental parameters that can be adjusted to the corresponding target values ​​(including the necessary environmental parameters), the target values ​​of the environmental parameters, and the home appliances used to adjust the environmental parameters.

[0176] For example, suppose the determined environmental parameters to be adjusted and their target values ​​include: temperature and target temperature value, humidity and target humidity value within the target space, air quality and target air quality index, and the corresponding necessary environmental parameter includes temperature. If it is determined that the environmental parameters that can be adjusted to the corresponding target values ​​include temperature and humidity, which include the necessary environmental parameters, then a first control command for the home appliance is generated.

[0177] Furthermore, the necessary environmental parameters include preset environmental parameters among a variety of environmental parameters that need to be adjusted, or environmental parameters with preset priorities among a variety of environmental parameters that need to be adjusted. Therefore, based on the type or priority of the various environmental parameters that need to be adjusted, corresponding controls can be executed, thereby enabling the use of the equipment actually deployed on-site to achieve the user's main control intent or close to the user's control intent, thus maximizing the satisfaction of the user's control needs and further improving the user experience.

[0178] For example, if it is impossible to adjust all the above-mentioned environmental parameters in the target space to the corresponding target values ​​by controlling the home appliances, it is determined whether the preset environmental parameters among the environmental parameters that need to be adjusted can be adjusted to the corresponding target values; if so, a first control command for the home appliances is generated based on the adjustable environmental parameters (including preset environmental parameters), the target values ​​of the corresponding environmental parameters, and the corresponding home appliances used to adjust the environmental parameters.

[0179] For example, assuming the "first information" is "the taste of love," the determined environmental parameters that need to be adjusted and their target values ​​include: temperature in the target space: 22-25 degrees Celsius, lighting: soft, music: light music; and the preset environmental parameters (necessary environmental parameters) for this situation include "lighting" and "music." If it is determined that the environmental parameters (necessary environmental parameters) that can be adjusted to the corresponding target values ​​include "lighting" and "music," then a first control command for the home appliance is generated.

[0180] For example, if it's impossible to adjust all the aforementioned environmental parameters in the target space to their corresponding target values ​​using home appliances, the system determines whether the environmental parameters with preset priorities can be adjusted to their corresponding target values. If so, it generates a first control command for the home appliances based on the adjustable environmental parameters (including those with preset priorities), their target values, and the corresponding home appliances used to adjust them. For instance, assuming the "first information" is "the taste of love," the determined environmental parameters to be adjusted and their target values ​​include: temperature in the target space: 22-25 degrees Celsius, light: soft, music: light music; and in this case, "light" has the first priority, "music" has the first priority, "temperature" has the second priority, and the preset priority is "first priority." If it's determined that the environmental parameters with the first priority (necessary environmental parameters), "music" and "light," can be adjusted to their corresponding target values, then a first control command for the home appliances is generated.

[0181] In some embodiments, when the necessary environmental parameter among the multiple environmental parameters (i.e., the multiple environmental parameters that need to be adjusted as determined in step 301) cannot be adjusted to the corresponding target value, the generation of the first control command is paused and the user is notified.

[0182] This avoids situations where the home appliances are controlled according to the generated first control command but fail to achieve the user's expected effect or meet the user's control needs, thus avoiding impacting the user experience.

[0183] In some embodiments, at least one of the preset environment parameters, the priority of the environment parameters, and the preset priority is preset by the user; or, at least one of the preset environment parameters, the priority of the environment parameters, and the preset priority is set through interaction with the user; or, at least one of the preset environment parameters, the priority of the environment parameters, and the preset priority is automatically updated by learning from at least one of the user's usage habits, environment, current season, user status, and user feedback.

[0184] In this way, necessary environmental parameters can be flexibly set in different scenarios, or the necessary environmental parameters can be determined through self-learning, thereby improving the accuracy and rationality of the setting of the necessary environmental parameters.

[0185] In some embodiments, the necessary environmental parameters may differ depending on the user's first information. For example, if the first information is "the taste of love", the necessary environmental parameters are "light" and "music"; if the first information is "a cool breeze in the shade of summer", the necessary environmental parameters are "temperature", "wind speed", and "light".

[0186] This allows for more flexible fulfillment of users' actual control intentions, further enhancing the user experience.

[0187] In some embodiments, if it is determined that the multiple environmental parameters (i.e., the multiple environmental parameters that need to be adjusted as determined in step 301) in the target space cannot be adjusted to the corresponding target values, and it is determined that the control of the home appliance can adjust the necessary environmental parameters among the multiple environmental parameters to the corresponding target values, it is determined whether the ratio of the adjustable environmental parameters among the environmental parameters to the environmental parameters to be adjusted is greater than or equal to a preset ratio. If so, a first control command for the home appliance is generated based on the adjustable environmental parameters (including the necessary environmental parameters), the target values ​​of the corresponding environmental parameters, and the corresponding home appliance used to adjust the environmental parameters.

[0188] For example, suppose the determined environmental parameters to be adjusted and their target values ​​include: temperature and target temperature value, humidity and target humidity value in the target space, air quality and target air quality index, and the necessary environmental parameter includes temperature, with the preset ratio being 60%. If it is determined that the environmental parameters that can be adjusted to the corresponding target value include temperature and humidity, including the necessary environmental parameter "temperature", and the ratio of the number of environmental parameters "2" that can be adjusted to the corresponding target value to the number of determined environmental parameters "3" that need to be adjusted is 66.6%, exceeding the preset ratio of 60%, then a first control command for the home appliance is generated.

[0189] This approach maximizes the satisfaction of users' control needs, ensures better control performance, and further enhances the user experience.

[0190] In some embodiments, multiple home appliances in the target space can be controlled according to the first control command, thereby enabling the linkage control of multiple devices or multiple devices through the user's "one sentence", achieving a control effect that better matches the user's actual intention.

[0191] For example, as mentioned above, in the case where the "first information" is "a gentle breeze in the shade during summer", the air conditioner and curtains are controlled in a coordinated manner through the first control command.

[0192] For example, as mentioned above, in the case where the "first information" is "the West Lake in April", the air conditioner and humidifier are controlled in a coordinated manner through the first control command.

[0193] This allows for a simpler way to achieve control effects that better match the user's actual intentions.

[0194] In some embodiments, the method further includes:

[0195] If it is determined that the environmental parameter in the target space cannot be adjusted to the target value, at least one of the environmental parameter and the target value shall be adjusted according to the capabilities of the home appliances in the target space;

[0196] Based on the adjusted environmental parameters, the target value of the environmental parameters, and the home appliances used to adjust the environmental parameters, a first control command is generated for the home appliances.

[0197] In this way, even when the desired experience cannot be fully achieved, the actual equipment deployed on-site can be used to optimize the parameters that need adjustment (e.g., changing them to similar adjustable environmental parameters) and the target values ​​(e.g., changing them to achievable target values), so that the adjustment effect is closer to the desired experience. In other words, existing equipment is used to meet the user's personalized needs as much as possible, thus improving the user experience.

[0198] For example, suppose the determined environmental parameters to be adjusted and the target values ​​of the environmental parameters include: temperature and target temperature value in the target space, humidity and target humidity value, air quality and target air quality index. However, the target humidity value exceeds the adjustment range of the home appliance used to adjust humidity. For example, the humidity value is greater than the upper limit of the humidity adjustment range of the home appliance used to adjust humidity. In this case, at least one environmental parameter and target value can be adjusted. For example, the target humidity value can be adjusted to the upper limit of the humidity adjustment range of the home appliance used to adjust humidity, and the target temperature value can be reduced. A first control command for the home appliance can be generated based on the adjusted target humidity value, the adjusted target temperature value, and the target air quality index.

[0199] In some embodiments, controlling home appliances within a target space according to the first control command includes:

[0200] The accuracy of the first control command is determined.

[0201] If the accuracy of the first control command is confirmed, the home appliances in the target space are controlled according to the first control command.

[0202] If it is determined that the first control command is inaccurate, the home appliances in the target space shall not be controlled or interacted with by the user in accordance with the first control command.

[0203] In this way, the accuracy of the first control command generated based on the first information related to the user's expected feelings is judged. If the judgment is accurate, the control is executed. If the judgment is inaccurate, the user is contacted for confirmation. This ensures that the control of the device conforms to the current situation and the user's actual intention, avoids the execution of obviously unreasonable control commands, and thus guarantees the user experience.

[0204] In some embodiments, the accuracy of control commands is a performance metric used to characterize whether the control commands conform to the actual use scenario and the user's actual intentions.

[0205] In some embodiments, the accuracy of control commands is related to at least one of the reasonableness of the control commands and their consistency with the user's actual control intentions. For example, the reasonableness of control commands is related to the actual usage scenario.

[0206] Furthermore, the accuracy of the first control command is determined based on at least one of the rationality of the first control command and the matching between the control command and the user's control intention. Thus, it is possible to comprehensively consider whether the first control command meets the actual scenario requirements and whether the first control command deviates too much from the user's actual intention, thereby ensuring the user's experience.

[0207] For example, when determining accuracy based on reasonableness, a control instruction is accurate when it is reasonable, and inaccurate when it is unreasonable.

[0208] For example, when determining accuracy based on the matching between control instructions and control intentions, control instructions are accurate when there is a matching between the control instructions and the user's control intentions; and inaccurate when there is no matching between the control instructions and the user's control intentions.

[0209] For example, when determining a control instruction based on its rationality and its matching with the control intent, the control instruction is accurate when it possesses both rationality and matching. Alternatively, a comprehensive value can be determined based on a first value representing rationality, a second value representing matching, a first weight for rationality, and a second weight for matching. When the comprehensive value exceeds a preset value threshold, the control instruction is accurate.

[0210] The first weight and the second weight can be equal values; or the first weight can be smaller than the second weight, so that when measuring the accuracy of the control command, more attention is paid to the degree of matching between the control command and the control intention, which helps to carry out personalized control; or the first weight can be larger than the second weight, so that when measuring the accuracy of the control command, more attention is paid to the degree of matching between the control command and the actual scene of the target space, which helps to carry out reasonable and reliable control.

[0211] In some embodiments, the rationality is determined based on at least one of feasibility, comfort, and energy efficiency. That is, by determining rationality based on at least one of feasibility, comfort, and energy efficiency, factors such as equipment, user, environment, and cost can be comprehensively considered in determining the rationality of control commands, resulting in more accurate and consistent rationality assessments that align with the user's actual intentions. Furthermore, this method allows for the rigorous and reliable selection of rational control commands. Controlling related home appliances according to these commands not only creates a comfortable environment for the user but also saves energy.

[0212] For example, if the first control command possesses at least one of the following characteristics—executability, comfort, and energy efficiency—it can be determined that the control command is reasonable; if the first control command lacks these three characteristics, it can be determined that the first control command is unreasonable. Reasonable control commands selected in this way can be applied to more scenarios. Controlling related home appliances according to these commands can not only create a comfortable environment for users but also save energy and meet users' personalized needs.

[0213] The following are exemplary descriptions of the methods for determining the executability, comfort, and energy efficiency of control commands.

[0214] In some embodiments, executability refers to whether the first control command can be executed by home appliances within the target space, that is, whether the home appliances within the target space are capable of executing the control command. In other words, executability is determined based on the compatibility between the first control command and the capabilities of the home appliances within the target space; that is, it can also be determined whether the home appliances within the target space can achieve the control effect of the "user's expected feeling" after the first control command is generated.

[0215] Executability can be determined based on the compatibility between the control command and the capabilities of the home appliances included in the target space. By combining the actual state information of the target space (which may include the actual capabilities of the home appliances within the target space) with the determination of the executability of the control command, it is possible to determine whether the control command matches the actual scenario requirements of the target space, thereby further improving the accuracy and reliability of the determination results.

[0216] For example, the first control command is associated with at least one of the following: the environmental parameter that needs to be adjusted and the target value of the environmental parameter.

[0217] If no home appliance capable of adjusting the environmental parameter exists within the target space, the control command is not executable. Alternatively, if a home appliance capable of adjusting the environmental parameter exists within the target space, but the environmental parameter cannot be adjusted to the target value based on the control of that home appliance, the control command is not executable.

[0218] In this way, by combining the actual capabilities of the home appliances in the target space with the environmental parameters that need to be adjusted and their target values ​​related to the control commands, the feasibility of the feasibility determination can be guaranteed to be accurate and reliable.

[0219] In some embodiments, the absence of home appliances capable of adjusting environmental parameters among the home appliances included in the target space can be varied.

[0220] For example, if the home appliances in the target space cannot adjust all the environmental parameters that need to be adjusted, it is determined that there are no home appliances in the home appliances that can adjust the environmental parameters.

[0221] In other words, if any environmental parameter cannot be adjusted by the home appliances within the target space, the home appliances are considered to lack the ability to adjust that environmental parameter; that is, the control command is not executable. This allows for a rigorous determination of executability. From another perspective, a control command deemed executable can adjust all the necessary environmental parameters, thus ensuring the effectiveness of the control command and reliably achieving the user's expected experience.

[0222] For example, if the home appliances cannot adjust the environmental parameters or necessary environmental parameters that are above the first preset ratio among all the environmental parameters that need to be adjusted, it is determined that there are no home appliances in the home appliances that can adjust the environmental parameters.

[0223] In other words, if home appliances within the target space cannot adjust certain environmental parameters to the target value, and if there are many such unadjustable parameters or if they are necessary / important parameters, then the home appliances are considered to lack the ability to adjust those parameters; that is, the control command is not executable. Therefore, the executableness criteria can be appropriately relaxed, thereby improving the success rate of control commands and avoiding too many situations where control commands cannot be executed or where user interaction is required.

[0224] In some embodiments, the presence of home appliances capable of adjusting environmental parameters within the target space can vary.

[0225] For example, if the home appliances in the target space can adjust all the environmental parameters that need to be adjusted, it is determined that there are home appliances in the home appliances that can adjust the environmental parameters.

[0226] As mentioned earlier, this approach ensures the effectiveness of control commands and helps to reliably achieve the user's expected experience.

[0227] For example, if the home appliances in the target space can adjust the necessary environmental parameters among all the environmental parameters that need to be adjusted, and the ratio of the adjustable environmental parameters to the environmental parameters that need to be adjusted is greater than or equal to a preset ratio, then it is determined that there are home appliances in the home appliances that can adjust the environmental parameters.

[0228] As mentioned earlier, this approach appropriately relaxes the criteria for determining executability, thereby improving the success rate of control commands and avoiding too many situations where control commands cannot be executed or where user interaction is required.

[0229] For example, if the home appliances in the target space can adjust environmental parameters or necessary environmental parameters at a second preset ratio or higher among all environmental parameters that need to be adjusted, it is determined that there are home appliances in the home appliances that can adjust environmental parameters.

[0230] As mentioned above, this approach further relaxes the criteria for determining executability, thereby improving the success rate of control commands and avoiding too many situations where control commands cannot be executed or where user interaction is required. In some embodiments, a correspondence between home appliances and environmental parameters can be pre-defined, and the ability of home appliances in the target space to adjust environmental parameters related to the control command can be determined based on this correspondence. This application is not limited to this, and other methods can also be used for determination.

[0231] In some embodiments, the inability to adjust environmental parameters within the target space to the target value can include various situations.

[0232] For example, if the home appliances in the target space cannot adjust all the environmental parameters that need to be adjusted in the target space to the corresponding target values, it is determined that the home appliances cannot adjust the environmental parameters in the target space to the target values.

[0233] In other words, if any environmental parameter cannot be adjusted to the target value, the home appliance is considered unable to adjust the environmental parameter in the target space to the target value; that is, the control command is not executable. This allows for a rigorous determination of executability. From another perspective, a control command deemed executable can adjust all the environmental parameters that need adjustment (i.e., the environmental parameters determined in step 301) to the target value, thus ensuring the effectiveness of the control command and reliably achieving the user's expected experience.

[0234] For example, if the home appliances in the target space cannot adjust the environmental parameters or necessary environmental parameters in the target space to the corresponding target values ​​at a third preset ratio or higher among all the environmental parameters that need to be adjusted, it is determined that the home appliances cannot adjust the environmental parameters in the target space to the target values.

[0235] In other words, if home appliances cannot adjust certain environmental parameters to target values, and there are many such parameters, or if they are necessary / important parameters, then the home appliances can be considered unable to adjust the environmental parameters in the target space to the target values; that is, the control command is not executable. Therefore, the executableness criteria can be appropriately relaxed, thereby improving the success rate of control commands and avoiding too many situations where control commands cannot be executed or where user interaction is required.

[0236] The first preset ratio, second preset ratio, third preset ratio, and necessary environmental parameters can be preset by the user, set through user interaction, or automatically updated based on at least one of the following: user habits, environment, current season, user status, and user feedback. This application does not restrict the specific values ​​or setting methods of the first preset ratio, second preset ratio, third preset ratio, and necessary environmental parameters.

[0237] In some embodiments, when determining whether a home appliance can adjust an environmental parameter to a target value, the current environmental parameters can be considered. For example, if a control command instructs the operating parameters of a home appliance, the determination of whether the environmental parameter can be adjusted to the target value can be made based on the environmental parameters associated with the control command, the target value and current value of the environmental parameter, and the operating parameters indicated by the control command. For instance, if the current indoor temperature is 20°C, and the control command instructs the air conditioner to operate in heating mode with a target temperature of 18°C, in this case, the indoor temperature cannot be adjusted to the target value, meaning the control command is not executable.

[0238] The following provides an exemplary description of the operation when the control instructions are not executable, categorized by case.

[0239] Scenario 1: The first home appliance in the target space cannot adjust all the environmental parameters that need to be adjusted.

[0240] In this case, the control command is not executed.

[0241] Scenario 2: The first home appliance in the target space can adjust some of the environmental parameters that need to be adjusted, but the environmental parameters that cannot be adjusted are the necessary environmental parameters.

[0242] In this situation, if the control instruction is executed, the actual effect may deviate significantly from the user's expected experience. Therefore, the control instruction may not be executed.

[0243] Scenario 3: The first home appliance in the target space can adjust some of the environmental parameters that need to be adjusted. The ability to adjust these environmental parameters is necessary, and it is possible to adjust them to the target value.

[0244] In this situation, the actual execution effect of executing the control command may deviate little from the user's expected experience; therefore, the control command can be executed.

[0245] Scenario 4: The first home appliance in the target space can adjust all the environmental parameters that need to be adjusted, and can adjust all parameters to the target value.

[0246] In this case, execute the control command.

[0247] Scenario 5: The first home appliance in the target space can adjust all the environmental parameters that need to be adjusted, but it can only adjust some of the environmental parameters to the target value. These environmental parameters are the necessary environmental parameters.

[0248] In this case, the target values ​​of another part of the parameters can be modified, a new control command can be generated based on the modified target values, and the new control command can be executed.

[0249] Scenario 6: The first home appliance in the target space can adjust all the environmental parameters that need to be adjusted. However, it can only adjust some of the environmental parameters to the target value. The environmental parameters that cannot be adjusted to the target value are the necessary environmental parameters.

[0250] In this situation, if the control instruction is executed, the actual effect may deviate significantly from the user's expected experience. Therefore, the control instruction may not be executed.

[0251] This application is not limited to this; other methods may be used to determine whether control instructions are executable.

[0252] In some embodiments, comfort refers to whether controlling home appliances according to control commands affects or reduces the user's comfort.

[0253] Comfort can be determined based on the matching degree between the control command and at least one of the following: current environmental parameters, current season, current time, geographical information, user attributes, user status, and user usage habits. Thus, by combining the actual state information of the target space (which may include at least one of the following: current environmental parameters, current season, current time, geographical information, user attributes, user status, and user usage habits) to determine the comfort level of the control command, it is possible to ascertain whether the control command matches the actual scenario requirements of the target space, thereby further improving the accuracy and reliability of the determination results.

[0254] For details regarding environmental parameters, please refer to the aforementioned explanations; they will not be repeated here.

[0255] In some embodiments, user attributes may include at least one of the following: the user's gender, age, nationality, region, etc.

[0256] In some embodiments, a user's state may include at least one of the following: awake or asleep, healthy or sick, emotional state, etc.

[0257] This application is not limited to this; other methods may be used to determine whether control commands are comfortable.

[0258] In some embodiments, energy efficiency refers to whether the energy consumption required to control home appliances according to control commands meets energy-saving requirements.

[0259] Energy efficiency can be determined based on at least one of the following: operating power, operating duration, operating mode, number of devices, and device type of the home appliances associated with the control command. Thus, by combining the actual state information of the target space (for example, the actual state information of the target space may include at least one of the following: operating power, operating duration, operating mode, number of devices, and device type of the first home appliance associated with the control command within the target space) to determine the energy efficiency of the control command, it is possible to determine whether the control command matches the actual scenario requirements of the target space, thereby further improving the accuracy and reliability of the determination results.

[0260] For example, if the energy consumption of a home appliance in the target space that is associated with the control command to adjust the environmental parameters to the target value exceeds a preset energy consumption threshold, or if the operating time exceeds a preset time threshold, or if the operating energy consumption exceeds the preset energy consumption threshold and the operating time exceeds the preset time threshold, the control command is determined to be not energy-efficient.

[0261] For example, if the current indoor temperature is 28℃, and the control command instructs for cooling to 24℃ with silent fan, in scenarios with a significant temperature difference, using silent fan will take longer to reach the target temperature. Because the compressor runs continuously, it takes longer to quickly lower the temperature to the target temperature compared to using high fan speed, resulting in higher compressor energy consumption. If the required time or energy consumption is excessive, the control command is deemed not energy-efficient.

[0262] For example, if there are other home appliances in the target space that can adjust the environmental parameters to the target value and operate with lower energy consumption or shorter operating time, the control command is determined to be not energy-efficient.

[0263] For example, the current outdoor temperature is 20°C, and the current indoor temperature is 28°C. The control command instructs the air conditioner to cool to 24°C. In addition to the air conditioner, the target space also has a fresh air system. Since the fresh air system operates in external recirculation mode, it can introduce cool outdoor air into the room, thus achieving the same cooling effect. Furthermore, the energy consumption of the fresh air system to lower the indoor temperature to 24°C is lower than the energy consumption of the air conditioner. In this case, the control command is determined to be energy-inefficient.

[0264] For example, if the control command is associated with multiple home appliances in the target space that are not required to operate, the control command is deemed not to be energy-efficient.

[0265] For example, if a user is currently in the living room and a control command turns on the air conditioners in the living room, kitchen, and bedroom, this control command is deemed not energy-efficient.

[0266] For example, if the operating states of multiple home appliances related to the control command within the target space are contradictory, the control command is deemed not to be energy-efficient.

[0267] For example, in the height of summer, with strong sunlight and high outdoor temperatures, the control command instructs the air conditioner to cool. Furthermore, the command also instructs the curtains to be opened, allowing direct sunlight into the room, or it instructs the fresh air system to operate in external recirculation mode, introducing hot air into the room. Since lowering the indoor temperature requires more energy when the curtains are open or hot air is introduced, this control command is deemed not energy-efficient.

[0268] In this way, by combining information about home appliances in the target space with the environmental parameters that need to be adjusted and their target values ​​related to the control commands, the energy efficiency assessment can be determined, ensuring the accuracy and reliability of the energy efficiency assessment results.

[0269] Therefore, by using the above-mentioned reasonableness determination method, we can comprehensively consider a variety of different usage scenarios and user needs to make the reasonableness determination, thereby further improving the accuracy of the reasonableness determination results and their relevance to the user's actual intentions.

[0270] In some embodiments, controlling the home appliances in the target space according to the first control instruction further includes: if it is determined that the first control instruction is not reasonable, updating the first control instruction through interaction with the user, and controlling the home appliances in the target space according to the updated first control instruction.

[0271] This allows for timely correction of any discrepancies between the initially generated control commands and the user's actual intentions, ensuring that the control effect matches the user's actual intent and further improving the user experience.

[0272] In some embodiments, the method further includes:

[0273] Based on the user's feedback, the first control command is modified to obtain a first modified control command, which is then stored in the control command database.

[0274] When the first information corresponding to the first control command is identified again, the home appliances in the target space are controlled according to the stored first modified control command.

[0275] That is, after performing corresponding control according to the first control instruction, the first control instruction is corrected based on user feedback, and the obtained first corrected control instruction is stored in the control instruction database. When the first information corresponding to the first control instruction is identified again, the first corrected control instruction can be directly invoked to perform corresponding control, thereby quickly and accurately determining the user's actual intention and executing the corresponding control, further improving the user experience.

[0276] In some embodiments, a control instruction database can be pre-established and stored, and a first control instruction can be generated based on first information using this database. The control instruction database may include index information related to the user's expected experience and the corresponding control instructions. This allows for convenient and efficient generation of the first control instruction.

[0277] In some embodiments, in the control command database, the first information corresponding to the first control command and the first correction control command corresponding to the first control command are stored according to different users.

[0278] For example, the control instruction database has a user data table created by user, in which the first information corresponding to the first control instruction and the first correction control instruction are stored.

[0279] This allows for the storage of first information, corresponding first control commands, and modified first control commands related to the user's expected experience, tailored to different users. This enables personalized control needs to be met for different users, further improving the user experience.

[0280] In addition, the user data table can also store the first information corresponding to the first control command, the first correction control command, and the state information of the target space.

[0281] For example, the control instruction database includes a user data table and a control instruction table. The user data table stores the first information and the first corrected control instruction, while the control instruction table stores index information and the first control instruction.

[0282] In some embodiments, the method may further include: acquiring second voice data, identifying second information related to the user's expected feelings in the second voice data, matching the second information with first information in a user data table, and, if the second information is included in the first information or a variant of the first information, directly controlling the home appliances according to the first corrected control command corresponding to the first information, thereby improving the response speed and accuracy of the control.

[0283] In some embodiments, the matching between the first control command and the user's control intent can be determined in various ways.

[0284] For example, it can interact with the user and determine the match between the first control command and the control intention based on the user's feedback.

[0285] For example, if the user expresses a desire to "feel relaxed," after generating the corresponding first control command, such as "play classical music, turn on the aroma diffuser," the user is given a confirmation message, such as, "Would you like to perform the following control: play classical music, turn on the aroma diffuser?"

[0286] If the user provides positive feedback, the first control command can be considered to match the control intent. If the user provides negative feedback, the first control command can be considered to not match the control intent.

[0287] For example, the matching between the first control command and the control intention can be determined based on the user's usage habits, preference information, etc.

[0288] For example, a user might express a desire to "feel relaxed," leading to the generation of a first control command, such as "Play classical music, turn on the aromatherapy diffuser." However, depending on the user's habits or preferences, they might not enjoy listening to classical music. In this case, the first control command is likely to be mismatched with the user's intended control.

[0289] In some embodiments, if it is determined that the first control command does not match the user's control intention, the home appliances may not be controlled according to the first control command and the user may not be interacted with. Instead, the first control command may be corrected based on the user's feedback, and the home appliances may be controlled according to the corrected first control command.

[0290] Therefore, home appliances can be controlled in a way that better matches the user's actual control intentions, which helps to accurately meet the user's needs, reduce the annoyance caused to the user, and also helps to improve the intelligence level of the voice control system, facilitate the improvement of user profiles, and provide users with customized services.

[0291] In some embodiments, similar to the aforementioned first corrected control command, the corrected first control command can also be stored in the user's data list. Since the corrected first control command is a first control command modified based on user feedback, in subsequent control operations, if the same or similar voice data is obtained, control can be performed according to the corrected first control command, thereby improving control efficiency and user experience.

[0292] For example, storing the user's voice data or information from the voice data related to the user's expected feelings, along with the corrected first control command.

[0293] For example, storing the user's voice data or information related to the user's expected feelings from the voice data, the corrected first control command, and the current actual situation of the target space.

[0294] In some embodiments, the method may further include: notifying the user of the speech recognition results, for example, notifying the user of first information identified from the speech data that relates to the user's desired feeling. For example, notifying the user "You just mentioned wanting a cool breeze in the shade of summer."

[0295] In some embodiments, notifications may be sent to users through one or more of the following methods: display, broadcast, push notification, etc.

[0296] For example, the speech recognition results can be displayed through a local device with display capabilities, which can be displayed as text. The local device with display capabilities includes, but is not limited to, one or more of a central controller, a smart TV, and a smart screen.

[0297] For example, the speech recognition results can be broadcast through a local device with voice broadcasting capabilities. Such local devices include, but are not limited to, one or more of a central controller, a smart TV, and a smart speaker.

[0298] For example, the speech recognition results can be notified to the user by pushing a message to the user's mobile device.

[0299] In some embodiments, the method may further include: notifying the user of the control result, for example, notifying the user of information about the completion of control based on "first information related to the user's expected feelings", such as "the air conditioner temperature has been adjusted to 26 degrees, the air volume has been adjusted to low, and the curtains in the curtains have been closed, based on your request for a cool breeze in the shade during the summer".

[0300] In some embodiments, notifications may be sent to users through one or more of the following methods: display, broadcast, push notification, etc.

[0301] For example, the control results can be displayed through a local device with display capabilities, and these results can be displayed via text. Local devices with display capabilities include, but are not limited to, one or more of a central controller, a smart TV, and a smart screen.

[0302] For example, control results can be broadcast through a local device with voice broadcasting capabilities. Such local devices include, but are not limited to, one or more of a central controller, a smart TV, and a smart speaker.

[0303] For example, notifications of control results can be sent to users' mobile devices by pushing messages to them.

[0304] In some embodiments, the method may further include: engaging in voice interaction with a user, for example, engaging in voice interaction with a user when it is determined that the generated control commands are inaccurate or unreasonable.

[0305] For example, voice interaction with users can be achieved through local devices with voice broadcasting and data acquisition capabilities. These local devices include, but are not limited to, one or more of a central controller, a smart TV, and a smart speaker.

[0306] Figure 4 This is a flowchart illustrating one implementation of the voice control method according to an embodiment of this application. Figure 4 As shown, the method includes:

[0307] Step 401: Acquire voice data;

[0308] Step 402: Convert the voice data into text data;

[0309] Step 403: Identify the first category of information and the second category of information in the text data;

[0310] Step 404: Determine whether the text data contains both first-category information and second-category information. If the determination result is "yes", proceed to step 405; if the determination result is "no", return to step 401.

[0311] Step 405: Combine the information from the first category with the information from the second category as the first information related to the user's expected feelings;

[0312] Step 406: Determine the environmental parameter that needs to be adjusted and the target value of the environmental parameter based on the first information;

[0313] Step 407: Based on the capabilities of the home appliances in the target space, determine whether the control based on the home appliances can adjust the environmental parameter in the target space to the target value; if the determination result is "yes", proceed to step 408; if the determination result is "no", proceed to step 411.

[0314] Step 408: Generate a first control command for the home appliance based on the environmental parameters, the target value of the environmental parameters, and the home appliance used to adjust the environmental parameters;

[0315] Step 409: Determine the accuracy of the first control command; if the first control command is determined to be accurate, i.e., the judgment result is "yes", proceed to step 410; if the first control command is determined to be inaccurate, i.e., the judgment result is "no", proceed to step 412.

[0316] Step 410: Control the home appliances in the target space according to the first control command;

[0317] Step 411: Pause the generation of the first control command and notify the user. Alternatively, as mentioned above, it is also possible to determine whether to generate the first control command based on whether the control of the home appliance can adjust the necessary environmental parameter among the various environmental parameters to the corresponding target value; or, at least one of the environmental parameter and the target value can be adjusted according to the capabilities of the home appliance in the target space, and the first control command for the home appliance can be generated based on the adjusted environmental parameter, the target value of the environmental parameter, and the home appliance used to adjust the environmental parameter.

[0318] Step 412: Control the home appliances in the target space without following the first control command and interact with the user; in addition, the control command can be regenerated and executed based on the result of the interaction with the user.

[0319] In addition, after executing the corresponding control according to the control command, it can also learn based on user feedback, for example, it also includes:

[0320] Step 413: Based on the user's feedback, the first control command is modified to obtain a first modified control command, which is then stored in the control command database. Thus, when the first information corresponding to the first control command is identified again, the home appliances in the target space can be controlled according to the stored first modified control command.

[0321] The specific implementation methods of steps 401-413 above can be found in the records of the relevant steps above, and will not be repeated here.

[0322] As can be seen from the above embodiments, when information related to the user's expected feelings, i.e., the first information, is identified in the user's voice data, a control command is generated based on the first information and the home appliances in the target space are controlled. Since the user's expected feelings can accurately reflect the user's actual control intention, voice control based on the user's expected feelings can achieve or approach the environmental state expected by the user and prevent mis-control of the equipment, thereby improving the user experience.

[0323] In addition, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of the device, thereby realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting the personalized needs of users.

[0324] In addition, the voice control mode based on user expectations can identify the user's actual intention based on the user's abstract description of "expectations" and automatically convert it into the control command that needs to be executed to achieve the actual intention of "expectations". This control command may be a comprehensive control command for multiple devices. Therefore, users can achieve advanced control of multiple devices to achieve the actual intention of "expectations" through a short description (such as a sentence), which improves the user experience.

[0325] In addition, compared with the way users describe control commands and current physical state in traditional methods, the abstract description of "expected feelings" in the embodiments of the present invention can express the user's comprehensive feelings and needs. Moreover, this description contains more information, thus more fully reflecting the user's actual control intention.

[0326] In addition, users only need to say "what they expect to feel", without having to describe the device to be controlled or the specific control commands, which reduces the difficulty of operation and the threshold of use, and improves the user experience;

[0327] In addition, in the voice control mode based on user expectations, by analyzing and understanding the natural language expressed by the user, it is possible to identify the user's comprehensive and complex actual intentions. This solves the problem that users cannot fully describe their actual control intentions in the traditional voice control mode, making the control more precise and improving the user experience.

[0328] Example 2

[0329] Embodiment 2 of this application provides a voice control system, which corresponds to the voice control method described in Embodiment 1. Specific implementation can refer to the implementation of the method described in Embodiment 1; details that are the same or related will not be repeated.

[0330] Figure 5 This is a schematic diagram of a voice control system according to an embodiment of this application. Figure 5As shown, the voice control system 500 includes a voice acquisition device 501, a server 502, a control device 503, and at least one home appliance 504. The voice acquisition device 501 acquires the user's voice data; the server 502 acquires the voice data, identifies first information related to the user's expected feelings in the voice data, generates a first control command based on the identified first information, and sends the first control command to the control device 503; the control device 503 controls the home appliance 504 in the target space according to the first control command.

[0331] In some embodiments, the voice acquisition device 501 includes, but is not limited to, at least one of a central controller, a wired controller, a remote controller, a user terminal, a smart speaker, and an air handling unit with voice acquisition function.

[0332] In some embodiments, some functions of server 502 may be implemented by a local speech recognition device. For example, the local speech recognition device acquires speech data and identifies a first category of information related to the user's expectations and a second category of information related to the user's feelings within the speech data. The remaining functions are still implemented by the server.

[0333] In some embodiments, the control device 503 includes, but is not limited to, at least one of a central controller and a gateway device.

[0334] In some embodiments, the voice acquisition device 501 and the control device 503 may be the same device. For example, both the voice acquisition device 501 and the control device 503 may be a centralized controller.

[0335] Alternatively, the voice acquisition device 501 and the control device 503 can be different devices. For example, the voice acquisition device 501 is a smart speaker, and the control device 503 is a central controller or gateway device.

[0336] In some embodiments, the home appliance 504 includes, but is not limited to, air handling equipment and smart devices, wherein the smart devices include, for example, at least one of smart speakers, smart display devices (e.g., smart screens, smart TVs, etc.), smart switches, smart curtains, smart lighting equipment, sensors (e.g., air sensors, temperature sensors, humidity sensors, etc.) and smart pet devices.

[0337] In some embodiments, the air handling equipment includes, but is not limited to, at least one of an indoor unit, a fresh air system, a humidity control system (e.g., a humidifier, a dehumidifier, etc.), and a floor heating system.

[0338] Figure 6 This is a structural diagram of the voice control system used in the voice control method of this application embodiment. For example... Figure 6As shown, the voice control system 600 includes one or more home appliances 610, user terminal 620, central controller 631, gateway device 632, router 640, Internet 650, and first server 661, second server 662, etc.

[0339] In some embodiments, home appliance 610 may be a smart home appliance. For example, home appliances include air handling equipment and smart devices. The smart devices include at least one of smart speakers, smart display devices (such as smart screens, smart TVs, etc.), smart switches, smart curtains, smart lighting equipment, sensors, and smart pet devices. The air handling equipment includes at least one of indoor units, humidifiers, dehumidifiers, fresh air systems, and underfloor heating systems.

[0340] In some embodiments, home appliance 610 can connect to and communicate with central controller 631 or gateway device 632 in various ways.

[0341] To distinguish between different connection or communication methods, such as Figure 6 As shown, home appliances 610 include multiple sets of home appliances 610-1, 610-2, 610-3, 610-4, and 610-5.

[0342] In some embodiments, home appliance 610-1 is connected to central controller 631 and gateway device 632 via wired connection. For example, home appliance 610-1 includes at least one of an outdoor air conditioner unit, an indoor air conditioner unit, a fresh air system, and a floor heating system. In addition, the indoor air conditioner unit can be connected to an air quality sensor and a wired controller, and the floor heating system can be connected to the wired controller.

[0343] In some embodiments, home device 610-2 is connected to voice central controller 631 and gateway device 632 via Wi-Fi. For example, home device 610-2 includes at least one of a home wall-mounted air conditioner, a wall-mounted / cabinet-style display component (e.g., LSM), a humidification component, a dehumidification component, a smart pet device (e.g., a watchdog component), and a sleep sensor.

[0344] In some embodiments, home device 610-3 is connected to voice central controller 631 via Bluetooth or Zigbee. For example, home device 610-3 includes at least one of smart curtains (e.g., motorized curtains, roller blinds) and smart lighting devices (e.g., dimmer lights).

[0345] In some embodiments, home appliance 610-4 is connected to central controller 631 via a wired connection. For example, home appliance 610-4 includes at least one of smart curtains (e.g., motorized curtains, roller blinds), smart lighting devices (e.g., ceiling lights), and floor heating valves.

[0346] In some embodiments, home device 610-5 is connected to gateway device 632 via Wi-Fi. For example, home device 610-5 is an air sensor installed indoors.

[0347] In some embodiments, the home appliance may also include Figure 6 Devices not shown, such as smart speakers, smart TVs, etc., can be connected wirelessly or wired to at least one of the voice central controller 631 and gateway device 632.

[0348] In some embodiments, such as Figure 6 As shown, the user's voice data is collected by the central controller 631 or the user terminal 620.

[0349] In some embodiments, such as Figure 6 As shown, the home appliance 610 is controlled by a central controller 631 or a gateway device 632.

[0350] In some embodiments, the central controller has voice control capabilities, including a network (online) control mode and a local control mode.

[0351] The network (online) control mode of the centralized controller refers to the following: the centralized controller sends the collected voice data to the server through the router. The server recognizes the voice data and generates control commands. The centralized controller then controls the home appliances according to the control commands. In other words, the centralized controller controls the home appliances online through the Internet or other networks via voice control mode.

[0352] For example, the central controller 631 collects voice data and sends it to the first server 661 via the router 640 and the Internet 650. The first server 661 recognizes the voice data (e.g., through a large model) to obtain the corresponding text data and sends the text data to the second server 662. The second server 662 generates corresponding control commands based on the text data and sends them to the central controller 631 via the router 640 and the Internet 650. The central controller 631 then controls the relevant home appliances according to the control commands.

[0353] The local control mode of the centralized controller refers to the centralized controller recognizing the collected voice data locally and generating control commands, and then controlling home appliances according to the control commands. In other words, the centralized controller controls home appliances locally via voice control.

[0354] For example, the central controller 631 collects voice data, recognizes the voice data locally (at the central controller 631 end), and sends the text data to the second server 662 via the router 640 and the Internet 650. The second server 662 generates corresponding control commands based on the text data and sends them to the central controller 631 via the Internet 650 and the router 641. The central controller 631 then controls the relevant home appliances according to the control commands.

[0355] In this way, the network (online) control mode and local control mode can be flexibly switched according to different scenarios or network conditions, improving the effectiveness and efficiency of voice control and enhancing the user experience.

[0356] Alternatively, user terminal 620 can collect voice data, which is then transmitted to first server 661 via router 640 and Internet 650. First server 661 recognizes the voice data (e.g., through a large model) to obtain corresponding text data, and sends the text data to second server 662. Second server 662 generates corresponding control commands based on the text data and transmits them to gateway device 632 via Internet 650 and router 640. Gateway device 632 then controls the relevant home appliances according to the control commands.

[0357] In addition, the functions of the first server 661 and the second server 662 can also be performed by a single server, and this application embodiment does not limit this.

[0358] In some embodiments, the central controller 631 is a central controller with a display screen.

[0359] In some embodiments, gateway device 632 is an intelligent gateway with centralized control functions.

[0360] In some embodiments, in addition to the central controller, control operations can also be performed by other controllers with control functions, such as at least one of a wired controller and a remote controller. The central controller and the wired controller are also known as fixed controllers, which are fixedly installed on the wall of an indoor space.

[0361] In some embodiments, the central controllers are respectively set in each space and can control the home appliances in the space where the central controller is located. For example, a first central controller is set in the living room, a second central controller is set in the bedroom, and a third central controller is set in the kitchen. The first central controller can control the home appliances in the living room, the second central controller can control the home appliances in the bedroom, and the third central controller can control the home appliances in the kitchen.

[0362] In some embodiments, the central controllers are respectively set in each space and can control the home appliances in all spaces. For example, a first central controller is set in the living room, a second central controller is set in the bedroom, and a third central controller is set in the kitchen. The first, second, and third central controllers can all control all home appliances in the living room, bedroom, and kitchen.

[0363] In some embodiments, a centralized controller is installed in only one specific space and can control home appliances in all spaces. Additionally, wired controllers can be installed in other spaces outside the specific space to control home appliances in their respective spaces. For example, a centralized controller can be installed in the living room to control all home appliances in the living room, bedrooms, and kitchen; wired controllers can be installed in the bedrooms and kitchen to control home appliances in those spaces respectively.

[0364] As can be seen from the above embodiments, when information related to the user's expected feelings, i.e., the first information, is identified in the user's voice data, a control command is generated based on the first information and the home appliances in the target space are controlled. Since the user's expected feelings can accurately reflect the user's actual control intention, voice control based on the user's expected feelings can achieve or approach the environmental state expected by the user and prevent mis-control of the equipment, thereby improving the user experience.

[0365] In addition, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of the device, thereby realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting the personalized needs of users.

[0366] In addition, the voice control mode based on user expectations can identify the user's actual intention based on the user's abstract description of "expectations" and automatically convert it into the control command that needs to be executed to achieve the actual intention of "expectations". This control command may be a comprehensive control command for multiple devices. Therefore, users can achieve advanced control of multiple devices to achieve the actual intention of "expectations" through a short description (such as a sentence), which improves the user experience.

[0367] In addition, compared with the way users describe control commands and current physical state in traditional methods, the abstract description of "expected feelings" in the embodiments of the present invention can express the user's comprehensive feelings and needs. Moreover, this description contains more information, thus more fully reflecting the user's actual control intention.

[0368] In addition, users only need to say "what they expect to feel", without having to describe the device to be controlled or the specific control commands, which reduces the difficulty of operation and the threshold of use, and improves the user experience;

[0369] In addition, in the voice control mode based on user expectations, by analyzing and understanding the natural language expressed by the user, it is possible to identify the user's comprehensive and complex actual intentions. This solves the problem that users cannot fully describe their actual control intentions in the traditional voice control mode, making the control more precise and improving the user experience.

[0370] Example 3

[0371] Embodiment 3 of this application provides a voice control device, which corresponds to the voice control method of Embodiment 1. Its specific implementation can be referred to the specific content described in Embodiment 1. The same or related contents will not be repeated.

[0372] Figure 7 This is a schematic diagram of a voice control device according to an embodiment of this application. Figure 7 As shown, the voice control device 700 includes:

[0373] The acquisition module 701 acquires voice data;

[0374] The recognition module 702 identifies first information in the voice data that relates to the user's expected feelings;

[0375] Generation module 703 generates a first control command based on the identified first information; and

[0376] The control module 704 controls the home appliances in the target space according to the first control command.

[0377] The specific functions of each of the above modules can be found in the relevant steps of Embodiment 1, and will not be repeated here.

[0378] As can be seen from the above embodiments, when information related to the user's expected feelings, i.e., the first information, is identified in the user's voice data, a control command is generated based on the first information and the home appliances in the target space are controlled. Since the user's expected feelings can accurately reflect the user's actual control intention, voice control based on the user's expected feelings can achieve or approach the environmental state expected by the user and prevent mis-control of the equipment, thereby improving the user experience.

[0379] In addition, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of the device, thereby realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting the personalized needs of users.

[0380] In addition, the voice control mode based on user expectations can identify the user's actual intention based on the user's abstract description of "expectations" and automatically convert it into the control command that needs to be executed to achieve the actual intention of "expectations". This control command may be a comprehensive control command for multiple devices. Therefore, users can achieve advanced control of multiple devices to achieve the actual intention of "expectations" through a short description (such as a sentence), which improves the user experience.

[0381] In addition, compared with the way users describe control commands and current physical state in traditional methods, the abstract description of "expected feelings" in the embodiments of the present invention can express the user's comprehensive feelings and needs. Moreover, this description contains more information, thus more fully reflecting the user's actual control intention.

[0382] In addition, users only need to say "what they expect to feel", without having to describe the device to be controlled or the specific control commands, which reduces the difficulty of operation and the threshold of use, and improves the user experience;

[0383] In addition, in the voice control mode based on user expectations, by analyzing and understanding the natural language expressed by the user, it is possible to identify the user's comprehensive and complex actual intentions. This solves the problem that users cannot fully describe their actual control intentions in the traditional voice control mode, making the control more precise and improving the user experience.

[0384] Example 4

[0385] Embodiment 4 of this application provides an electronic device corresponding to the voice control method described in Embodiment 1. Specific implementation can refer to the implementation of the method described in Embodiment 1; details that are the same or related will not be repeated.

[0386] Figure 8 This is a schematic block diagram of the system configuration of an electronic device according to an embodiment of this application. Figure 8 As shown, electronic device 800 may include processor 810 and memory 820; memory 820 is coupled to processor 810. It is worth noting that this figure is exemplary; other types of structures may be used to supplement or replace this structure to achieve telecommunications functions or other functions.

[0387] In one embodiment, the processor 810 may be configured to: acquire voice data; identify first information in the voice data related to a user's desired feeling; generate a first control command based on the identified first information; and control home appliances in a target space based on the first control command.

[0388] like Figure 8 As shown, the electronic device 800 may also include: a communication module 830, an input unit 840, a display 850, a speaker 860, a microphone 870, and a power supply 880. It is worth noting that the electronic device 800 does not necessarily need to include these components. Figure 8 All components shown; in addition, the electronic device 800 may also include Figure 8 For components not shown, please refer to relevant technologies.

[0389] like Figure 8 As shown, the processor 810, sometimes also referred to as a controller or operation control, may include a microprocessor or other processor device and / or logic device, which receives inputs and controls the operation of various components of the electronic device 800.

[0390] The memory 820 may be, for example, one or more of a cache, flash memory, hard drive, removable medium, volatile memory, non-volatile memory, or other suitable means. It can store various types of data, and also stores programs for executing related information. The processor 810 can execute the program stored in the memory 820 to perform information storage or processing, etc. The functions of other components are similar to those in existing systems and will not be described further here. The components of the electronic device 800 can be implemented using dedicated hardware, firmware, software, or a combination thereof without departing from the scope of the invention.

[0391] As can be seen from the above embodiments, when information related to the user's expected feelings, i.e., the first information, is identified in the user's voice data, a control command is generated based on the first information and the home appliances in the target space are controlled. Since the user's expected feelings can accurately reflect the user's actual control intention, voice control based on the user's expected feelings can achieve or approach the environmental state expected by the user and prevent mis-control of the equipment, thereby improving the user experience.

[0392] In addition, voice control based on user expectations provides a novel voice control mode. Users are not limited to using specific control commands or describing their current physical state, but can express their personalized needs by expressing their physical or mental expectations. This enables automatic control of the device, thereby realizing the intelligence and flexibility of voice control, reflecting the technological feel of voice control, and meeting the personalized needs of users.

[0393] In addition, the voice control mode based on user expectations can identify the user's actual intention based on the user's abstract description of "expectations" and automatically convert it into the control command that needs to be executed to achieve the actual intention of "expectations". This control command may be a comprehensive control command for multiple devices. Therefore, users can achieve advanced control of multiple devices to achieve the actual intention of "expectations" through a short description (such as a sentence), which improves the user experience.

[0394] In addition, compared with the way users describe control commands and current physical state in traditional methods, the abstract description of "expected feelings" in the embodiments of the present invention can express the user's comprehensive feelings and needs. Moreover, this description contains more information, thus more fully reflecting the user's actual control intention.

[0395] In addition, users only need to say "what they expect to feel", without having to describe the device to be controlled or the specific control commands, which reduces the difficulty of operation and the threshold of use, and improves the user experience;

[0396] In addition, in the voice control mode based on user expectations, by analyzing and understanding the natural language expressed by the user, it is possible to identify the user's comprehensive and complex actual intentions. This solves the problem that users cannot fully describe their actual control intentions in the traditional voice control mode, making the control more precise and improving the user experience.

[0397] This application also provides a computer-readable program, wherein when the program is executed in an electronic device, the program causes the computer to perform the voice control method described in Embodiment 1 in the electronic device.

[0398] This application also provides a storage medium storing a computer-readable program, wherein the computer-readable program causes a computer to execute the voice control method described in embodiment 1 in an electronic device.

[0399] The apparatus and methods described above in the embodiments of this application can be implemented in hardware or in combination with software. This application relates to a computer-readable program that, when executed by a logic component, enables the logic component to implement the apparatus or constituent parts described above, or to implement the various methods or steps described above.

[0400] This application also relates to storage media for storing the above programs, such as hard disks, magnetic disks, optical disks, DVDs, flash memory, etc.

[0401] The present application has been described above with reference to specific embodiments. However, those skilled in the art should understand that these descriptions are exemplary and not intended to limit the scope of protection of the present application. Those skilled in the art can make various modifications and variations to the present application based on its spirit and principles, and these modifications and variations are also within the scope of the present application.

Claims

1. A voice control method, characterized in that, The method includes: Acquire voice data; Identify first information related to the user's expected feelings from the voice data; Generate a first control command based on the identified first information; and The home appliances in the target space are controlled according to the first control command.

2. The method according to claim 1, characterized in that, Identifying first information related to the user's expected feelings from the voice data includes: Identify a first category of information and a second category of information in the speech data; When the voice data contains both the first category information and the second category information, the information obtained by combining the first category information and the second category information is taken as the first information. The first category of information is related to user expectations, while the second category of information is related to user feelings.

3. The method according to claim 2, characterized in that, The first category of information includes first descriptive information representing the expected intention; The second category of information includes a second descriptive information representing feelings.

4. The method according to claim 3, characterized in that, The second descriptive information representing a feeling includes at least one of a third descriptive information representing bodily sensation and a fourth descriptive information representing mood. The third descriptive information representing bodily sensation includes at least one of scene, location, weather, season, and time, while the fourth descriptive information representing emotional state includes at least one of subjective experience and emotion.

5. The method according to any one of claims 2-4, characterized in that, Identifying a first category of information and a second category of information in the speech data includes: The speech data is converted into text data, and first category information and second category information are identified in the text data; or The first category of information and the second category of information are identified in the speech data by sound wave matching.

6. The method according to claim 5, characterized in that, Identifying a first category of information and a second category of information in the text data includes: The text data is matched against a preset data table. If a match is successful, the first category information and the second category information in the text data are determined; or, The text data is input into a natural language processing-based model, which outputs the first category information and the second category information.

7. The method according to claim 1, characterized in that, Generate a first control command based on the identified first information, including: Based on the first information, determine the environmental parameters that need to be adjusted and the target values ​​of the environmental parameters; Based on the capabilities of the home appliances within the target space, determine whether control of the home appliances can adjust the environmental parameters within the target space to the target value; and If it is determined that the environmental parameters within the target space can be adjusted to the target value, a first control command for the home appliance is generated based on the environmental parameters, the target value of the environmental parameters, and the home appliance used to adjust the environmental parameters.

8. The method according to claim 7, characterized in that, The method further includes: If it is determined that the environmental parameters within the target space cannot be adjusted to the target value, and the environmental parameters are multiple environmental parameters, it is determined whether the control of the home appliance can adjust the necessary environmental parameter among the multiple environmental parameters to the corresponding target value; When the necessary environmental parameter among the various environmental parameters can be adjusted to the corresponding target value, a first control command for the home appliance is generated based on the necessary environmental parameter, the target value of the necessary environmental parameter, and the home appliance used to adjust the necessary environmental parameter. When the necessary environmental parameter among the various environmental parameters cannot be adjusted to the corresponding target value, the generation of the first control command is paused and the user is notified.

9. The method according to claim 8, characterized in that, The necessary environmental parameters include preset environmental parameters among the multiple environmental parameters, or environmental parameters with preset priorities among the multiple environmental parameters.

10. The method according to claim 9, characterized in that, At least one of the preset environment parameters, the priority of the environment parameters, and the preset priority is preset by the user; or, At least one of the preset environment parameters, the priority of the environment parameters, and the preset priority is set through interaction with the user; or, The preset environment parameters, the priority of the environment parameters, and the preset priority are automatically updated based on at least one of the user's usage habits, environment, current season, user status, and user feedback.

11. The method according to claim 7, characterized in that, The method further includes: If it is determined that the environmental parameters within the target space cannot be adjusted to the target value, at least one of the environmental parameters and the target value shall be adjusted according to the capabilities of the home appliances within the target space; Based on the adjusted environmental parameters, the target values ​​of the environmental parameters, and the home appliances used to adjust the environmental parameters, a first control command is generated for the home appliances.

12. The method according to claim 1, characterized in that, Controlling home appliances within the target space according to the first control command includes: The accuracy of the first control command is determined; If the accuracy of the first control command is confirmed, the home appliances in the target space are controlled according to the first control command. If it is determined that the first control command is inaccurate, the home appliances in the target space will not be controlled or interacted with by the user according to the first control command.

13. The method according to claim 12, characterized in that, The accuracy of the first control command is determined based on at least one of the reasonableness of the first control command and the matching between the first control command and the user's control intention. The rationality is determined based on at least one of feasibility, comfort and energy efficiency.

14. The method according to claim 13, characterized in that, The executability is determined based on the compatibility between the first control command and the capabilities of the home appliances within the target space; The comfort level is determined based on the compatibility between the first control command and at least one of the following: current environmental parameters, current season, current time, geographic information, user attributes, user status, and user usage habits. The energy efficiency is determined based on at least one of the following: the operating power, operating time, operating mode, number of devices, and device type of the home appliances associated with the first control command.

15. The method according to claim 12, characterized in that, Controlling home appliances within the target space according to the first control command also includes: If it is determined that the first control command is not reasonable, the first control command is updated through interaction with the user, and the home appliances in the target space are controlled according to the updated first control command.

16. The method according to claim 1, characterized in that, The method further includes: Based on the user's feedback, the first control command is modified to obtain a first modified control command, which is then stored in the control command database. When the first information corresponding to the first control command is identified again, the home appliances in the target space are controlled according to the stored first correction control command.

17. The method according to claim 16, characterized in that, In the control command database, the first information corresponding to the first control command and the first correction control command are stored according to different users.

18. The method according to claim 1, characterized in that, Controlling home appliances within the target space according to the first control command includes: According to the first control command, multiple home appliances in the target space are controlled.

19. A voice control system, characterized in that, The voice control system includes voice acquisition equipment, a server, control equipment, and at least one home appliance. The voice acquisition device collects the user's voice data; The server acquires the voice data, identifies first information related to the user's expected feelings in the voice data, generates a first control command based on the identified first information, and sends the first control command to the control device. The control device controls the home appliances in the target space according to the first control command.

20. A voice control device, characterized in that, The device includes: The acquisition module acquires voice data; A recognition module that identifies first information in the voice data that relates to the user's expected feelings; The generation module generates a first control command based on the identified first information; and The control module controls the home appliances in the target space according to the first control command.

21. An electronic device, characterized in that, The electronic device includes: Memory, which stores computer programs; and A processor that, when executing the computer program, implements the method described in any one of claims 1-18.

22. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1-18.

23. A computer program product having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1-18.

Images