Air conditioner control method and device based on multi-modal data fitting

Abstract

The application discloses an air conditioner control method and device based on multi-modal data fitting, and the method comprises the following steps: fitting first multi-modal behavior information of an air conditioner according to the first multi-modal behavior information sent by a user, obtaining first fitting parameters of the first multi-modal behavior information; determining control parameters of the air conditioner according to the first fitting parameters of the first multi-modal behavior information; and performing matched control operation on the air conditioner according to the control parameters of the air conditioner. It can be seen that the application can intelligently fit the corresponding first fitting parameters according to the first multi-modal behavior information of the user, and then determine the control parameters of the air conditioner according to the first fitting parameters to realize the control operation on the air conditioner. Therefore, the user can remotely control the air conditioner without the help of a remote control device nearby, the control efficiency of the air conditioner is improved, the control timeliness of the air conditioner is further improved, and the use experience of the user is improved.

Description

Technical Field

[0001] This invention relates to the field of intelligent air conditioning technology, and in particular to an air conditioning control method and device based on multimodal data fitting. Background Technology

[0002] With the rapid development of science and technology, more and more smart devices, such as smart air conditioners, are entering users' lives, making users increasingly feel the convenience and comfort brought by smart devices. This has greatly improved users' living environment and enhanced their user experience of smart devices.

[0003] Currently, users typically control smart air conditioners for cooling or heating via remote control devices to regulate the environment in their area. However, this control method requires the remote control device to be constantly nearby for timely operation, which hinders the improvement of control efficiency and consequently limits the user experience. Therefore, providing a method to enhance the control efficiency of smart air conditioners is crucial. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide an air conditioning control method and device based on multimodal data fitting, which allows users to control the air conditioner without the need for a remote control device, thereby improving the control efficiency and timeliness of the air conditioner, and thus enhancing the user experience.

[0005] To address the aforementioned technical problems, the first aspect of this invention discloses an air conditioning control method based on multimodal data fitting, the method comprising:

[0006] When the user sends first multimodal behavior information about the air conditioner, the user performs a fitting operation on the first multimodal behavior information to obtain first fitting parameters for the first multimodal behavior information; the first multimodal behavior information includes first voice modality information and / or first body movement modality information.

[0007] Based on the first fitting parameters of the first multimodal behavior information, control parameters for the air conditioner are determined;

[0008] Based on the control parameters of the air conditioner, perform matching control operations on the air conditioner.

[0009] As an optional implementation, in a first aspect of the invention, before determining the control parameters for the air conditioner based on the first fitting parameters of the first multimodal behavior information, the method further includes:

[0010] The environmental sensing parameters of the user are obtained; the environmental sensing parameters include at least one of environmental temperature sensing parameters, environmental humidity sensing parameters, and environmental air quality.

[0011] Based on the user's environmental perception parameters and the first fitting parameters of the first multimodal behavior information, it is determined whether the environmental perception parameters and the first fitting parameters match. If so, a list of fitting parameters corresponding to the air conditioner is obtained, and it is determined whether there are second fitting parameters for the second multimodal behavior information of the air conditioner issued by other users in the list of fitting parameters. The second multimodal behavior information includes second voice modality information and / or second body movement modality information.

[0012] When it is determined that the second fitting parameter does not exist, the operation of determining the control parameters for the air conditioner based on the first fitting parameter according to the first multimodal behavior information is performed.

[0013] As an optional implementation, in the first aspect of the present invention, the method further includes:

[0014] When it is determined that the second fitting parameter exists, the first control type corresponding to the first fitting parameter is determined, and the second control type corresponding to the second fitting parameter is determined; the first control type and the second control type both include one or more control types for the corresponding fitting parameter among runtime, start-up and shutdown time, temperature, wind speed, air volume, wind direction and function mode;

[0015] Based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter, determine whether there is a control type conflict between the first fitting parameter and the second fitting parameter;

[0016] When it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter, the control parameters for the air conditioner are determined based on the first fitting parameter and the second fitting parameter.

[0017] As an optional implementation, in a first aspect of the present invention, determining whether there is a control type conflict between the first fitting parameter and the second fitting parameter based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter includes:

[0018] Based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter, determine whether there is an intersection of control types between the first fitting parameter and the second fitting parameter;

[0019] When it is determined that there is no intersection of the control types, it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter;

[0020] When it is determined that there is an intersection of the control types, at least one intersection control type between the first fitting parameter and the second fitting parameter is determined based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter.

[0021] For each intersection control type, a first fitting sub-parameter matching the intersection control type is determined from the first fitting parameters, and a second fitting sub-parameter matching the intersection control type is determined from the second fitting parameters, and it is determined whether the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is greater than or equal to a preset coordination matching degree threshold.

[0022] When it is determined that the parameter coordination matching degree between the first fitting sub-parameter and the corresponding second fitting sub-parameter of each intersection control type is greater than or equal to the coordination matching degree threshold, it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter.

[0023] As an optional implementation, in the first aspect of the present invention, determining whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold includes:

[0024] When both the first and second fitted sub-parameters are fitted sub-parameters that match the control type of the start-up and stop-down times, based on the first start-up time point parameter, the first stop-down time point parameter in the first fitted sub-parameter, the second start-up time point parameter, and the second stop-down time point parameter in the second fitted sub-parameter, it is determined whether there is an overlap in the start-up and stop-down time periods between the first and second fitted sub-parameters. If not, it is determined that the parameter coordination matching degree between the first and second fitted sub-parameters is greater than or equal to the coordination matching degree threshold. If yes, based on the first stop-down time point parameter in the first fitted sub-parameter and the second stop-down time point parameter in the second fitted sub-parameter, the time point parameter difference between the first stop-down time point parameter and the second stop-down time point parameter is determined, and it is determined whether the time point parameter difference is greater than or equal to a preset first parameter difference threshold.

[0025] When it is determined that the difference between the time point parameters is greater than or equal to the first parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be less than a preset coordination matching degree threshold; when it is determined that the difference between the time point parameters is less than the first parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be greater than or equal to the coordination matching degree threshold.

[0026] As an optional implementation, in the first aspect of the present invention, the step of determining whether the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is greater than or equal to a preset coordination matching degree threshold further includes:

[0027] When both the first fitting sub-parameter and the second fitting sub-parameter are fitting sub-parameters that match the control type of the function mode, determine whether there is a function mode conflict between the first fitting sub-parameter and the second fitting sub-parameter.

[0028] When a functional mode conflict is detected, the parameter coordination degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be less than the coordination degree threshold; when no functional mode conflict is detected, the parameter coordination degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be greater than or equal to the coordination degree threshold.

[0029] As an optional implementation, in the first aspect of the present invention, the step of determining whether the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is greater than or equal to a preset coordination matching degree threshold further includes:

[0030] When both the first fitting sub-parameter and the second fitting sub-parameter are fitting sub-parameters that match one of the control types of temperature, wind speed, air volume and wind direction, determine the specific parameter difference between the first fitting sub-parameter and the second fitting sub-parameter, and determine whether the specific parameter difference is greater than or equal to the preset second parameter difference threshold.

[0031] When it is determined that the difference between the specific parameters is greater than or equal to the second parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be less than the coordination matching degree threshold; when it is determined that the difference between the specific parameters is less than the second parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be greater than or equal to the coordination matching degree threshold.

[0032] A second aspect of the present invention discloses an air conditioning control device based on multimodal data fitting, the device comprising:

[0033] The fitting module is used to, when receiving first multimodal behavioral information about the air conditioner issued by a user, perform a fitting operation on the first multimodal behavioral information to obtain first fitting parameters of the first multimodal behavioral information; the first multimodal behavioral information includes first voice modality information and / or first body movement modality information;

[0034] The determining module is used to determine control parameters for the air conditioner based on the first fitting parameters of the first multimodal behavior information;

[0035] The control module is used to perform matching control operations on the air conditioner according to the control parameters of the air conditioner.

[0036] As an optional implementation, in a second aspect of the invention, the apparatus further includes:

[0037] The acquisition module is used to acquire the user's environmental perception parameters before the determining module determines the control parameters for the air conditioner based on the first fitting parameters of the first multimodal behavior information; the environmental perception parameters include at least one of environmental temperature perception parameters, environmental humidity perception parameters, and environmental air perception conditions.

[0038] The first judgment module is used to determine whether the environmental perception parameters and the first fitting parameters match based on the user's environmental perception parameters and the first fitting parameters of the first multimodal behavior information.

[0039] The acquisition module is further configured to acquire the list of fitting parameters corresponding to the air conditioner when the judgment result of the first judgment module is yes;

[0040] The first judgment module is further configured to determine whether there is a second fitting parameter in the fitting parameter list that is a second multimodal behavioral information about the air conditioner issued by another user in advance; the second multimodal behavioral information includes second voice modality information and / or second body movement modality information;

[0041] The determining module is further configured to perform the operation of determining the control parameters for the air conditioner based on the first fitting parameters of the first multimodal behavior information when the first determining module determines the result of the determination is negative.

[0042] As an optional implementation, in a second aspect of the invention, the determining module is further configured to:

[0043] When the first judgment module determines that the second fitting parameter exists, it determines the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter; the first control type and the second control type both include one or more control types for the corresponding fitting parameter among runtime, start-up and shutdown time, temperature, wind speed, air volume, wind direction and function mode;

[0044] The device further includes:

[0045] The second judgment module is used to determine whether there is a control type conflict between the first fitting parameter and the second fitting parameter based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter.

[0046] The determining module is further configured to determine control parameters for the air conditioner based on the first fitting parameters and the second fitting parameters when the second determining module determines that there is no control type conflict between the first fitting parameters and the second fitting parameters.

[0047] As an optional implementation, in a second aspect of the present invention, the method by which the second determining module determines whether there is a control type conflict between the first fitting parameter and the second fitting parameter based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter specifically includes:

[0048] Based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter, determine whether there is an intersection of control types between the first fitting parameter and the second fitting parameter;

[0049] When it is determined that there is no intersection of the control types, it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter;

[0050] When it is determined that there is an intersection of the control types, at least one intersection control type between the first fitting parameter and the second fitting parameter is determined based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter.

[0051] For each intersection control type, a first fitting sub-parameter matching the intersection control type is determined from the first fitting parameters, and a second fitting sub-parameter matching the intersection control type is determined from the second fitting parameters, and it is determined whether the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is greater than or equal to a preset coordination matching degree threshold.

[0052] When it is determined that the parameter coordination matching degree between the first fitting sub-parameter and the corresponding second fitting sub-parameter of each intersection control type is greater than or equal to the coordination matching degree threshold, it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter.

[0053] As an optional implementation, in a second aspect of the present invention, the method by which the second determining module determines whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold specifically includes:

[0054] When both the first and second fitted sub-parameters are fitted sub-parameters that match the control type of the start-up and stop-down times, based on the first start-up time point parameter, the first stop-down time point parameter in the first fitted sub-parameter, the second start-up time point parameter, and the second stop-down time point parameter in the second fitted sub-parameter, it is determined whether there is an overlap in the start-up and stop-down time periods between the first and second fitted sub-parameters. If not, it is determined that the parameter coordination matching degree between the first and second fitted sub-parameters is greater than or equal to the coordination matching degree threshold. If yes, based on the first stop-down time point parameter in the first fitted sub-parameter and the second stop-down time point parameter in the second fitted sub-parameter, the time point parameter difference between the first stop-down time point parameter and the second stop-down time point parameter is determined, and it is determined whether the time point parameter difference is greater than or equal to a preset first parameter difference threshold.

[0055] When it is determined that the difference between the time point parameters is greater than or equal to the first parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be less than a preset coordination matching degree threshold; when it is determined that the difference between the time point parameters is less than the first parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be greater than or equal to the coordination matching degree threshold.

[0056] As an optional implementation, in a second aspect of the present invention, the method by which the second determining module determines whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold further includes:

[0057] When both the first fitting sub-parameter and the second fitting sub-parameter are fitting sub-parameters that match the control type of the function mode, determine whether there is a function mode conflict between the first fitting sub-parameter and the second fitting sub-parameter.

[0058] When a functional mode conflict is detected, the parameter coordination degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be less than the coordination degree threshold; when no functional mode conflict is detected, the parameter coordination degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be greater than or equal to the coordination degree threshold.

[0059] As an optional implementation, in a second aspect of the present invention, the method by which the second determining module determines whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold further includes:

[0060] When both the first fitting sub-parameter and the second fitting sub-parameter are fitting sub-parameters that match one of the control types of temperature, wind speed, air volume and wind direction, determine the specific parameter difference between the first fitting sub-parameter and the second fitting sub-parameter, and determine whether the specific parameter difference is greater than or equal to the preset second parameter difference threshold.

[0061] When it is determined that the difference between the specific parameters is greater than or equal to the second parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be less than the coordination matching degree threshold; when it is determined that the difference between the specific parameters is less than the second parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be greater than or equal to the coordination matching degree threshold.

[0062] A third aspect of the present invention discloses another air conditioning control device based on multimodal data fitting, the device comprising:

[0063] Memory containing executable program code;

[0064] A processor coupled to the memory;

[0065] The processor calls the executable program code stored in the memory to execute the air conditioning control method based on multimodal data fitting disclosed in the first aspect of the present invention.

[0066] The fourth aspect of the present invention discloses a computer storage medium storing computer instructions, which, when invoked, are used to execute the air conditioning control method based on multimodal data fitting disclosed in the first aspect of the present invention.

[0067] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0068] In this embodiment of the invention, based on the first multimodal behavior information of the user regarding the air conditioner, a fitting operation is performed on the first multimodal behavior information to obtain first fitting parameters for the first multimodal behavior information; based on the first fitting parameters of the first multimodal behavior information, control parameters for the air conditioner are determined; and based on the control parameters of the air conditioner, a matching control operation is performed on the air conditioner. It is evident that implementing this invention can intelligently fit the corresponding first fitting parameters based on the user's first multimodal behavior information, and then determine the control parameters for the air conditioner based on the first fitting parameters to achieve control operation of the air conditioner. This allows users to control the air conditioner without the need for a nearby remote control device, improving the control efficiency and timeliness of the air conditioner, thereby enhancing the user experience. Attached Figure Description

[0069] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0070] Figure 1 This is a schematic diagram of an air conditioning control scenario based on multimodal data fitting disclosed in an embodiment of the present invention;

[0071] Figure 2 This is a flowchart illustrating an air conditioning control method based on multimodal data fitting disclosed in an embodiment of the present invention.

[0072] Figure 3 This is a flowchart illustrating another air conditioning control method based on multimodal data fitting disclosed in an embodiment of the present invention;

[0073] Figure 4 This is a schematic diagram of the structure of an air conditioning control device based on multimodal data fitting disclosed in an embodiment of the present invention;

[0074] Figure 5 This is a schematic diagram of another air conditioning control device based on multimodal data fitting disclosed in an embodiment of the present invention;

[0075] Figure 6 This is a schematic diagram of the structure of another air conditioning control device based on multimodal data fitting disclosed in an embodiment of the present invention. Detailed Implementation

[0076] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0077] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or end that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or ends.

[0078] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0079] This invention discloses an air conditioner control method and device based on multimodal data fitting. Users can control the air conditioner without the need for a nearby remote control device, which improves the control efficiency and timeliness of the air conditioner, thereby enhancing the user experience.

[0080] Example 1

[0081] Please see Figure 2 , Figure 2 This is a flowchart illustrating an air conditioning control method based on multimodal data fitting disclosed in an embodiment of the present invention. Wherein, Figure 2 The described air conditioning control method based on multimodal data fitting can be applied to control air conditioners in various scenarios, and can also be applied to control air conditioners in the presence of one or more users. This invention does not impose limitations on this method. Optionally, this method can be implemented by an air conditioning control system, which can be integrated into a smart air conditioner or exist independently of the smart air conditioner. It can also be a local server or cloud server used to process the process of controlling the air conditioner based on multimodal data, etc. This invention does not impose limitations on this method. Figure 2As shown, the air conditioning control method based on multimodal data fitting may include the following operations:

[0082] 101. When receiving the first multimodal behavior information for the air conditioner sent by the user, perform a fitting operation on the first multimodal behavior information to obtain the first fitting parameters of the first multimodal behavior information.

[0083] In this embodiment of the invention, optionally, the first multimodal behavioral information includes first speech modality information and / or first limb movement modality information (e.g., gestures, overall body movements, etc.). Further, the first fitting parameter of the first multimodal behavioral information can be understood as semantic information fitted based on the first speech modality information and / or the first limb movement modality information, that is, the specific meaning of the corresponding modality information.

[0084] 102. Determine the control parameters for the air conditioner based on the first fitting parameters of the first multimodal behavior information.

[0085] In this embodiment of the invention, the control parameters of the air conditioner may optionally include fan speed control parameters, air volume control parameters, air direction control parameters, operation control parameters, temperature control parameters, function mode control parameters, start-up and shutdown control parameters, etc.

[0086] 103. Perform matching control operations on the air conditioner according to its control parameters.

[0087] In embodiments of the present invention, such as Figure 1 As shown, Figure 1 This is a schematic diagram of an air conditioning control scenario based on multimodal data fitting disclosed in an embodiment of the present invention. When the air conditioning control system integrated inside the air conditioner receives the first voice modal information (e.g., "It's so hot in summer!") and the first limb action modal information (e.g., "fanning with hands") issued by the user, the air conditioning control system immediately fits the first voice modal information and the first limb action modal information to fit the corresponding fitting parameters. For example, if it is determined that the user needs to cool down, the control parameters for the air conditioner are determined according to the fitting parameters, such as the cooling mode of 26°C, thereby realizing automated cooling control for the user.

[0088] As can be seen, implementing the embodiments of the present invention can intelligently fit the corresponding first fitting parameters based on the user's first multimodal behavior information, and then determine the control parameters for the air conditioner based on the first fitting parameters to realize the control operation of the air conditioner. In this way, the user can control the air conditioner without the need for a remote control device, which improves the control efficiency of the air conditioner, thereby improving the timeliness of the control of the air conditioner and enhancing the user's user experience.

[0089] Example 2

[0090] Please see Figure 3 , Figure 3 This is a flowchart illustrating an air conditioning control method based on multimodal data fitting disclosed in an embodiment of the present invention. Wherein, Figure 3 The described air conditioning control method based on multimodal data fitting can be applied to control air conditioners in various scenarios, and can also be applied to control air conditioners in the presence of one or more users. This invention does not impose limitations on this method. Optionally, this method can be implemented by an air conditioning control system, which can be integrated into a smart air conditioner or exist independently of the smart air conditioner. It can also be a local server or cloud server used to process the process of controlling the air conditioner based on multimodal data, etc. This invention does not impose limitations on this method. Figure 3 As shown, the air conditioning control method based on multimodal data fitting may include the following operations:

[0091] 201. When receiving the first multimodal behavior information for the air conditioner sent by the user, perform a fitting operation on the first multimodal behavior information to obtain the first fitting parameters of the first multimodal behavior information.

[0092] 202. Obtain the user's environmental awareness parameters.

[0093] In this embodiment of the invention, the environmental sensing parameters may optionally include at least one of environmental temperature sensing parameters, environmental humidity sensing parameters, and environmental air sensing conditions (such as sensed air pollution parameters, negative ion content in the air, etc.).

[0094] 203. Based on the user's environmental perception parameters and the first fitting parameters of the first multimodal behavior information, determine whether the environmental perception parameters and the first fitting parameters match. If they do, obtain the fitting parameter list corresponding to the air conditioner and determine whether there are second fitting parameters for the second multimodal behavior information of the air conditioner issued by other users in the fitting parameter list.

[0095] In this embodiment of the invention, optionally, the second multimodal behavioral information includes second voice modality information and / or second body movement modality information. Further, determining whether the environmental perception parameters match the first fitted parameters can be understood as determining whether the user's first multimodal behavioral information constitutes malicious behavior. If it is determined that the environmental perception parameters do not match the first fitted parameters, it means that the user does not actually perceive any discomfort in the environment, and therefore, the user's actual need for air conditioning control is not high.

[0096] 204. When it is determined that there is no second fitting parameter, the operation of determining the control parameters for the air conditioner based on the first fitting parameter according to the first multimodal behavior information is executed.

[0097] 205. Perform matching control operations on the air conditioner according to its control parameters.

[0098] In this embodiment of the invention, for other descriptions of steps 201, 204 and 205, please refer to the detailed description of steps 101-103 in Embodiment 1. This embodiment of the invention will not repeat them.

[0099] As can be seen, implementing the embodiments of the present invention can determine the validity of the first multimodal behavior information issued by the user based on the user's environmental perception parameters and the first fitting parameters, and determine the control parameters for the air conditioner based on the fitting parameter list. This helps to ensure the reliability and accuracy of the first multimodal behavior information issued by the user, thereby improving the reliability and accuracy of the determined control parameters for the air conditioner, and thus improving the reliability, accuracy and effectiveness of the air conditioner control.

[0100] In an optional embodiment, the method further includes:

[0101] When it is determined that a second fitting parameter exists, the first control type corresponding to the first fitting parameter is determined, and the second control type corresponding to the second fitting parameter is determined.

[0102] Based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter, determine whether there is a control type conflict between the first fitting parameter and the second fitting parameter.

[0103] When it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter, the control parameters for the air conditioner are determined based on the first fitting parameter and the second fitting parameter.

[0104] In this optional embodiment, the first control type and the second control type may each include corresponding fitting parameters for one or more control types among runtime, start-up and shutdown time, temperature, wind speed, air volume, wind direction, and functional mode.

[0105] Furthermore, the method also includes: when it is determined that there is a control type conflict between the first fitting parameter and the second fitting parameter, determining the conflict control type between the first fitting parameter and the second fitting parameter, and determining the first control permission level of the user for the conflict control type and the second control permission level of the other users for the conflict control type based on the user parameters of the user and the user parameters of other users; based on the first control permission level and the second control permission level, determining the target user with the highest corresponding control permission level from the user and other users, and determining the control parameters for the air conditioner based on the fitting sub-parameters for the conflict control type in the fitting parameters corresponding to the target user, so as to perform a matching control operation on the air conditioner according to the control parameters of the air conditioner.

[0106] As can be seen, this optional embodiment can determine the control type conflict between the first and second fitting parameters based on the first and second control types, thereby intelligently determining the control parameters for the air conditioner. In this way, by comprehensively determining the corresponding control types, the reliability and accuracy of the judgment on control type conflicts can be improved, thereby improving the reliability and accuracy of the determination of the control parameters for the air conditioner, thus realizing intelligent and precise control of the air conditioner.

[0107] In another optional embodiment, the step of determining whether there is a control type conflict between the first fitting parameter and the second fitting parameter based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter includes:

[0108] Based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter, determine whether there is an intersection of control types between the first fitting parameter and the second fitting parameter.

[0109] When it is determined that there is no overlap in control types, it is confirmed that there is no conflict in control types between the first fitting parameter and the second fitting parameter.

[0110] When it is determined that there is an intersection of control types, at least one intersection control type between the first fitting parameter and the second fitting parameter is determined based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter.

[0111] For each intersection control type, a first fitting sub-parameter matching the intersection control type is determined from the first fitting parameters, and a second fitting sub-parameter matching the intersection control type is determined from the second fitting parameters. It is then determined whether the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is greater than or equal to a preset coordination matching degree threshold.

[0112] When it is determined that the parameter coordination degree between the first fitting sub-parameter and the corresponding second fitting sub-parameter of each intersection control type is greater than or equal to the coordination degree threshold, it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter.

[0113] In this optional embodiment, further, the step of determining the control parameters for the air conditioner based on the first fitting parameters and the second fitting parameters includes:

[0114] When there is no intersection of control types between the first and second fitted parameters, a fusion fitted parameter that matches both the first and second fitted parameters is determined, and the control parameters for the air conditioner are determined based on the fusion fitted parameter. When there is an intersection of control types between the first and second fitted parameters, a coordinated fitted sub-parameter corresponding to each intersection control type is determined based on the first and second fitted sub-parameters corresponding to each intersection control type, and the control parameters for the air conditioner are determined based on the coordinated fitted sub-parameters corresponding to all intersection control types.

[0115] For example, if the first control type corresponding to the first fitted parameter includes a control type for runtime (e.g., running the air conditioner for 3 hours), and the second control type corresponding to the second fitted parameter is a control type for temperature (e.g., operating temperature 26℃), then it can be determined that there is no overlap in control types between the first and second fitted parameters. Therefore, the first and second fitted parameters are fused, such as running for 3 hours at an operating temperature of 26℃, thus achieving control of the air conditioner. However, if both the first control type corresponding to the first fitted parameter and the second control type corresponding to the second fitted parameter include fitted sub-parameters for temperature control (e.g., the former for operating temperature 26℃ and the latter for operating temperature 28℃), and the parameter coordination degree between them is greater than or equal to the coordination degree threshold, then the corresponding coordinated fitted sub-parameters between the first and second fitted sub-parameters corresponding to the overlapping control type can be determined, such as coordinating the operating temperature of both to 27℃, thus achieving control of the air conditioner.

[0116] As can be seen, this optional embodiment can determine whether the parameter coordination degree between the first and second fitting parameters is greater than or equal to a preset coordination degree threshold when there is an intersection of control types between the first and second fitting parameters, based on the first and second fitting sub-parameters corresponding to each intersection control type. This enables the determination of control type conflicts between the first and second fitting parameters, thereby improving the reliability and accuracy of the determination of parameter coordination degree between the corresponding fitting sub-parameters, and further improving the reliability and accuracy of the determination of control type conflicts between the first and second fitting parameters. In the case of fitting parameters corresponding to multiple users, this helps to reduce control conflicts and ensure the operational stability of the air conditioning control system.

[0117] In another optional embodiment, the step of determining whether the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is greater than or equal to a preset coordination matching degree threshold includes:

[0118] When both the first and second fitted sub-parameters are fitted sub-parameters that match the control type of the start-up and stop-up times, based on the first start-up time point parameter and the first stop-up time point parameter in the first fitted sub-parameters, and the second start-up time point parameter and the second stop-up time point parameter in the second fitted sub-parameters, it is determined whether there is an overlap in the start-up and stop-up time periods between the first and second fitted sub-parameters. If not, it is determined that the parameter coordination matching degree between the first and second fitted sub-parameters is greater than or equal to the coordination matching degree threshold. If so, based on the first stop-up time point parameter in the first fitted sub-parameters and the second stop-up time point parameter in the second fitted sub-parameters, the time point parameter difference between the first stop-up time point parameter and the second stop-up time point parameter is determined, and it is determined whether the time point parameter difference is greater than or equal to the preset first parameter difference threshold.

[0119] When it is determined that the difference between time point parameters is greater than or equal to the first parameter difference threshold, the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is determined to be less than the preset coordination matching degree threshold; when it is determined that the difference between time point parameters is less than the first parameter difference threshold, the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is determined to be greater than or equal to the coordination matching degree threshold.

[0120] In this optional embodiment, when there is no overlap in the start-up and shutdown time periods among the first start-up time point parameter, the first shutdown time point parameter in the first fitting sub-parameters, the second start-up time point parameter in the second fitting sub-parameters, and the second shutdown time point parameter, that is, there is no time conflict in the fitted time parameters; however, when there is an overlap in the start-up and shutdown time periods, and the difference between the two shutdown time point parameters is small, time coordination can be performed, such as using the later shutdown time point parameter as the time point parameter required to control the air conditioner to shut down; if the difference between the two shutdown time point parameters is large, it can be determined that there is a time conflict in the fitted time parameters, and when determining the corresponding control parameters later, it can be further determined based on the time control permission level of the corresponding user.

[0121] As can be seen, this optional embodiment can determine the parameter coordination and matching degree between the first and second fitted sub-parameters based on whether there is an overlap in the start-up and shutdown time periods between the first and second fitted sub-parameters and whether the difference between the corresponding shutdown time point parameters is too large. This helps to improve the comprehensiveness of the parameter coordination and matching degree determination operation, thereby improving the reliability and accuracy of the parameter coordination and matching degree determination operation, and thus effectively determining whether there is a control type conflict between the first and second fitted parameters.

[0122] In yet another optional embodiment, determining whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold further includes:

[0123] When both the first fitting sub-parameter and the second fitting sub-parameter are fitting sub-parameters that match the control type of the function mode, determine whether there is a function mode conflict between the first fitting sub-parameter and the second fitting sub-parameter.

[0124] When a functional mode conflict is detected, the parameter coordination degree between the first and second fitted sub-parameters is determined to be less than the coordination degree threshold; when no functional mode conflict is detected, the parameter coordination degree between the first and second fitted sub-parameters is determined to be greater than or equal to the coordination degree threshold.

[0125] In this optional embodiment, for example, when the first fitted sub-parameter is a cooling mode and the second fitted sub-parameter is a heating mode, it can be determined that there is a functional mode conflict between the first fitted sub-parameter and the second fitted sub-parameter; while when the first fitted sub-parameter is a cooling mode and the second fitted sub-parameter is a dehumidification mode, since the cooling mode can also achieve a certain dehumidification function, it can be determined that there is no functional mode conflict between the first fitted sub-parameter and the second fitted sub-parameter.

[0126] Furthermore, as an optional implementation, determining whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold further includes:

[0127] When both the first and second fitted parameters are fitted parameters that match one of the control types of temperature, wind speed, air volume, and wind direction, determine the specific parameter difference between the first and second fitted parameters, and determine whether the specific parameter difference is greater than or equal to the preset second parameter difference threshold.

[0128] When it is determined that the difference between specific parameters is greater than or equal to the threshold of the difference between the second parameter, the parameter coordination degree between the first fitted sub-parameter and the second fitted sub-parameter is determined to be less than the coordination degree threshold; when it is determined that the difference between specific parameters is less than the threshold of the difference between the second parameter, the parameter coordination degree between the first fitted sub-parameter and the second fitted sub-parameter is determined to be greater than or equal to the coordination degree threshold.

[0129] In this optional embodiment, when it is determined that the difference between specific parameters is greater than or equal to the second parameter difference threshold, it is difficult to coordinate and obtain coordinated fitting sub-parameters that match the user and other users based on the first fitting sub-parameters and the second fitting sub-parameters. Therefore, it can be determined that the parameter coordination matching degree between the first fitting sub-parameters and the second fitting sub-parameters is less than the coordination matching degree threshold.

[0130] As can be seen, this optional embodiment can also determine the functional mode conflict between the first fitting sub-parameter and the second fitting sub-parameter, the magnitude of the specific parameter difference, etc., which is conducive to further improving the reliability and accuracy of the parameter coordination and matching degree determination between the first fitting sub-parameter and the second fitting sub-parameter, and thus conducive to realizing the intelligent operation of parameter coordination and matching degree determination, thereby facilitating the smooth progress of the subsequent operation of determining the control type conflict between the first fitting parameter and the second fitting parameter.

[0131] Example 3

[0132] Please see Figure 4 , Figure 4 This is a schematic diagram of the structure of an air conditioning control device based on multimodal data fitting, as disclosed in an embodiment of the present invention. Figure 4 As shown, the air conditioning control device based on multimodal data fitting may include:

[0133] The fitting module 301 is used to, when receiving first multimodal behavioral information about the air conditioner sent by the user, perform a fitting operation on the first multimodal behavioral information to obtain first fitting parameters of the first multimodal behavioral information; the first multimodal behavioral information includes first voice modality information and / or first body movement modality information;

[0134] The determining module 302 is used to determine the control parameters for the air conditioner based on the first fitting parameters of the first multimodal behavior information;

[0135] The control module 303 is used to perform matching control operations on the air conditioner according to the control parameters of the air conditioner.

[0136] It is evident that implementation Figure 4 The described air conditioning control device based on multimodal data fitting can intelligently fit the first fitting parameters corresponding to the user's first multimodal behavior information, and then determine the control parameters for the air conditioner based on the first fitting parameters to realize the control operation of the air conditioner. In this way, the user can control the air conditioner without the need for a remote control device, which improves the control efficiency of the air conditioner, thereby improving the timeliness of the control and enhancing the user experience.

[0137] In an optional embodiment, the apparatus further includes:

[0138] The acquisition module 304 is used to acquire the user's environmental perception parameters before the determination module 302 determines the control parameters for the air conditioner based on the first fitting parameters of the first multimodal behavior information.

[0139] The first judgment module 305 is used to determine whether the environmental perception parameters and the first fitting parameters match based on the user's environmental perception parameters and the first fitting parameters of the first multimodal behavior information.

[0140] The acquisition module 304 is also used to acquire the list of fitting parameters corresponding to the air conditioner when the judgment result of the first judgment module 305 is yes;

[0141] The first judgment module 305 is also used to determine whether there are second fitting parameters in the fitting parameter list that are first sent by other users for the second multimodal behavior information of the air conditioner.

[0142] The determining module 302 is also used to perform an operation to determine the control parameters for the air conditioner based on the first fitting parameters of the first multimodal behavior information when the first judging module 305 judges the result as negative.

[0143] In this optional embodiment, the environmental perception parameters include at least one of environmental temperature perception parameters, environmental humidity perception parameters, and environmental air quality perception; the second multimodal behavioral information includes second voice modality information and / or second limb movement modality information.

[0144] It is evident that implementation Figure 5 The described air conditioning control device based on multimodal data fitting can determine the validity of the first multimodal behavior information issued by the user based on the user's environmental perception parameters and the first fitting parameters, and determine the control parameters for the air conditioner based on the fitting parameter list. This helps to ensure the reliability and accuracy of the first multimodal behavior information issued by the user, thereby improving the reliability and accuracy of the determined control parameters for the air conditioner, and thus improving the reliability, accuracy and effectiveness of the air conditioning control.

[0145] In another alternative embodiment, the determining module 302 is further configured to:

[0146] When the first judgment module 305 determines that a second fitting parameter exists, it determines the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter.

[0147] The device also includes:

[0148] The second judgment module 306 is used to determine whether there is a control type conflict between the first fitting parameter and the second fitting parameter based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter.

[0149] The determining module 302 is further configured to determine the control parameters for the air conditioner based on the first fitting parameters and the second fitting parameters when the second determining module 306 determines that there is no control type conflict between the first fitting parameters and the second fitting parameters.

[0150] In this optional embodiment, both the first control type and the second control type include corresponding fitting parameters for one or more control types among runtime, start-up and shutdown time, temperature, wind speed, air volume, wind direction, and functional mode.

[0151] It is evident that implementation Figure 5The described air conditioning control device based on multimodal data fitting can determine the control type conflict between the first and second fitting parameters according to the first and second control types, thereby intelligently determining the control parameters for the air conditioner. In this way, by comprehensively determining the corresponding control types, the reliability and accuracy of the judgment of control type conflict can be improved, which in turn can improve the reliability and accuracy of the determination of the control parameters for the air conditioner, thus realizing intelligent and precise control of the air conditioner.

[0152] In another optional embodiment, the second determination module 306 determines whether there is a control type conflict between the first fitting parameter and the second fitting parameter based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter. Specifically, this includes:

[0153] Based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter, determine whether there is an intersection of control types between the first fitting parameter and the second fitting parameter.

[0154] When it is determined that there is no overlap in control types, it is confirmed that there is no conflict in control types between the first fitting parameter and the second fitting parameter.

[0155] When it is determined that there is an intersection of control types, at least one intersection control type between the first fitting parameter and the second fitting parameter is determined based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter.

[0156] For each intersection control type, a first fitting sub-parameter matching the intersection control type is determined from the first fitting parameters, and a second fitting sub-parameter matching the intersection control type is determined from the second fitting parameters. It is then determined whether the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is greater than or equal to a preset coordination matching degree threshold.

[0157] When it is determined that the parameter coordination degree between the first fitting sub-parameter and the corresponding second fitting sub-parameter of each intersection control type is greater than or equal to the coordination degree threshold, it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter.

[0158] It is evident that implementation Figure 5The described air conditioning control device based on multimodal data fitting can determine whether the parameter coordination degree between the first and second fitted parameters is greater than or equal to a preset coordination degree threshold when there is an intersection of control types between the first and second fitted parameters. This improves the reliability and accuracy of determining the parameter coordination degree between the corresponding fitted sub-parameters, and further improves the reliability and accuracy of determining the control type conflict between the first and second fitted parameters. In the case of fitted parameters corresponding to multiple users, this helps to reduce control conflicts and ensure the operational stability of the air conditioning control system.

[0159] In another optional embodiment, the second determining module 306 determines whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold in the following specific ways:

[0160] When both the first and second fitted sub-parameters are fitted sub-parameters that match the control type of the start-up and stop-up times, based on the first start-up time point parameter and the first stop-up time point parameter in the first fitted sub-parameters, and the second start-up time point parameter and the second stop-up time point parameter in the second fitted sub-parameters, it is determined whether there is an overlap in the start-up and stop-up time periods between the first and second fitted sub-parameters. If not, it is determined that the parameter coordination matching degree between the first and second fitted sub-parameters is greater than or equal to the coordination matching degree threshold. If so, based on the first stop-up time point parameter in the first fitted sub-parameters and the second stop-up time point parameter in the second fitted sub-parameters, the time point parameter difference between the first stop-up time point parameter and the second stop-up time point parameter is determined, and it is determined whether the time point parameter difference is greater than or equal to the preset first parameter difference threshold.

[0161] When it is determined that the difference between time point parameters is greater than or equal to the first parameter difference threshold, the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is determined to be less than the preset coordination matching degree threshold; when it is determined that the difference between time point parameters is less than the first parameter difference threshold, the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is determined to be greater than or equal to the coordination matching degree threshold.

[0162] It is evident that implementation Figure 5The described air conditioning control device based on multimodal data fitting can determine the parameter coordination and matching degree between the first and second fitted sub-parameters based on whether there is an overlap in the start-up and shutdown time periods between the first and second fitted sub-parameters and whether the difference between the corresponding shutdown time point parameters is too large. This helps to improve the comprehensiveness of the parameter coordination and matching degree determination operation, thereby improving the reliability and accuracy of the parameter coordination and matching degree determination operation, and thus effectively determining whether there is a control type conflict between the first and second fitted parameters.

[0163] In yet another optional embodiment, the method by which the second determining module 306 determines whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold further includes:

[0164] When both the first fitting sub-parameter and the second fitting sub-parameter are fitting sub-parameters that match the control type of the function mode, determine whether there is a function mode conflict between the first fitting sub-parameter and the second fitting sub-parameter.

[0165] When a functional mode conflict is detected, the parameter coordination degree between the first and second fitted sub-parameters is determined to be less than the coordination degree threshold; when no functional mode conflict is detected, the parameter coordination degree between the first and second fitted sub-parameters is determined to be greater than or equal to the coordination degree threshold.

[0166] Furthermore, as an optional implementation, the second judgment module 306 further includes the following method for determining whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold:

[0167] When both the first and second fitted parameters are fitted parameters that match one of the control types of temperature, wind speed, air volume, and wind direction, determine the specific parameter difference between the first and second fitted parameters, and determine whether the specific parameter difference is greater than or equal to the preset second parameter difference threshold.

[0168] When it is determined that the difference between specific parameters is greater than or equal to the threshold of the difference between the second parameter, the parameter coordination degree between the first fitted sub-parameter and the second fitted sub-parameter is determined to be less than the coordination degree threshold; when it is determined that the difference between specific parameters is less than the threshold of the difference between the second parameter, the parameter coordination degree between the first fitted sub-parameter and the second fitted sub-parameter is determined to be greater than or equal to the coordination degree threshold.

[0169] It is evident that implementation Figure 5The air conditioning control device based on multimodal data fitting described herein can also determine the functional mode conflict and the magnitude of the specific parameter difference between the first and second fitted sub-parameters. This is beneficial to further improve the reliability and accuracy of the parameter coordination and matching degree determination between the first and second fitted sub-parameters, thereby facilitating the intelligentization of the parameter coordination and matching degree determination operation. This, in turn, is conducive to the smooth execution of the subsequent control type conflict determination operation between the first and second fitted parameters.

[0170] Example 4

[0171] Please see Figure 6 , Figure 6 This is a schematic diagram of another air conditioning control device based on multimodal data fitting disclosed in an embodiment of the present invention. Figure 6 As shown, the air conditioning control device based on multimodal data fitting may include:

[0172] Memory 401 storing executable program code;

[0173] Processor 402 coupled to memory 401;

[0174] The processor 402 calls the executable program code stored in the memory 401 to execute the steps in the air conditioning control method based on multimodal data fitting described in Embodiment 1 or Embodiment 2 of the present invention.

[0175] Example 5

[0176] This invention discloses a computer storage medium storing computer instructions. When these computer instructions are invoked, they are used to execute the steps in the air conditioning control method based on multimodal data fitting described in Embodiment 1 or Embodiment 2 of this invention.

[0177] Example 6

[0178] This invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform the steps in the air conditioning control method based on multimodal data fitting described in Embodiment 1 or Embodiment 2.

[0179] The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0180] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0181] Finally, it should be noted that the air conditioning control method and apparatus based on multimodal data fitting disclosed in the embodiments of the present invention are merely preferred embodiments of the present invention and are only used to illustrate the technical solutions of the present invention, not to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An air conditioning control method based on multimodal data fitting, characterized in that, The method includes: When the user sends first multimodal behavior information about the air conditioner, the user performs a fitting operation on the first multimodal behavior information to obtain first fitting parameters for the first multimodal behavior information; the first multimodal behavior information includes first voice modality information and / or first body movement modality information. The environmental sensing parameters of the user are obtained; the environmental sensing parameters include at least one of environmental temperature sensing parameters, environmental humidity sensing parameters, and environmental air quality. Based on the user's environmental perception parameters and the first fitting parameters of the first multimodal behavior information, it is determined whether the environmental perception parameters and the first fitting parameters match. If so, a list of fitting parameters corresponding to the air conditioner is obtained, and it is determined whether there are second fitting parameters for the second multimodal behavior information of the air conditioner issued by other users in the list of fitting parameters. The second multimodal behavior information includes second voice modality information and / or second body movement modality information. When it is determined that the second fitting parameter does not exist, the control parameters for the air conditioner are determined based on the first fitting parameter of the first multimodal behavior information. Based on the control parameters of the air conditioner, perform matching control operations on the air conditioner.

2. The air conditioning control method based on multimodal data fitting according to claim 1, characterized in that, The method further includes: When it is determined that the second fitting parameter exists, the first control type corresponding to the first fitting parameter is determined, and the second control type corresponding to the second fitting parameter is determined; the first control type and the second control type both include one or more control types for the corresponding fitting parameter among runtime, start-up and shutdown time, temperature, wind speed, air volume, wind direction and function mode; Based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter, determine whether there is a control type conflict between the first fitting parameter and the second fitting parameter; When it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter, the control parameters for the air conditioner are determined based on the first fitting parameter and the second fitting parameter.

3. The air conditioning control method based on multimodal data fitting according to claim 2, characterized in that, The step of determining whether there is a control type conflict between the first fitting parameter and the second fitting parameter based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter includes: Based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter, determine whether there is an intersection of control types between the first fitting parameter and the second fitting parameter; When it is determined that there is no intersection of the control types, it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter; When it is determined that there is an intersection of the control types, at least one intersection control type between the first fitting parameter and the second fitting parameter is determined based on the first control type corresponding to the first fitting parameter and the second control type corresponding to the second fitting parameter. For each intersection control type, a first fitting sub-parameter matching the intersection control type is determined from the first fitting parameters, and a second fitting sub-parameter matching the intersection control type is determined from the second fitting parameters, and it is determined whether the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is greater than or equal to a preset coordination matching degree threshold. When it is determined that the parameter coordination matching degree between the first fitting sub-parameter and the corresponding second fitting sub-parameter of each intersection control type is greater than or equal to the coordination matching degree threshold, it is determined that there is no control type conflict between the first fitting parameter and the second fitting parameter.

4. The air conditioning control method based on multimodal data fitting according to claim 3, characterized in that, The step of determining whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold includes: When both the first and second fitted sub-parameters are fitted sub-parameters that match the control type of the start-up and stop-down times, based on the first start-up time point parameter, the first stop-down time point parameter in the first fitted sub-parameter, the second start-up time point parameter, and the second stop-down time point parameter in the second fitted sub-parameter, it is determined whether there is an overlap in the start-up and stop-down time periods between the first and second fitted sub-parameters. If not, it is determined that the parameter coordination matching degree between the first and second fitted sub-parameters is greater than or equal to the coordination matching degree threshold. If yes, based on the first stop-down time point parameter in the first fitted sub-parameter and the second stop-down time point parameter in the second fitted sub-parameter, the time point parameter difference between the first stop-down time point parameter and the second stop-down time point parameter is determined, and it is determined whether the time point parameter difference is greater than or equal to a preset first parameter difference threshold. When it is determined that the difference between the time point parameters is greater than or equal to the first parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be less than a preset coordination matching degree threshold; when it is determined that the difference between the time point parameters is less than the first parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be greater than or equal to the coordination matching degree threshold.

5. The air conditioning control method based on multimodal data fitting according to claim 4, characterized in that, The step of determining whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold further includes: When both the first fitting sub-parameter and the second fitting sub-parameter are fitting sub-parameters that match the control type of the function mode, determine whether there is a function mode conflict between the first fitting sub-parameter and the second fitting sub-parameter. When a functional mode conflict is detected, the parameter coordination degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be less than the coordination degree threshold; when no functional mode conflict is detected, the parameter coordination degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be greater than or equal to the coordination degree threshold.

6. The air conditioning control method based on multimodal data fitting according to claim 4, characterized in that, The step of determining whether the parameter coordination matching degree between the first fitted sub-parameter and the second fitted sub-parameter is greater than or equal to a preset coordination matching degree threshold further includes: When both the first fitting sub-parameter and the second fitting sub-parameter are fitting sub-parameters that match one of the control types of temperature, wind speed, air volume and wind direction, determine the specific parameter difference between the first fitting sub-parameter and the second fitting sub-parameter, and determine whether the specific parameter difference is greater than or equal to the preset second parameter difference threshold. When it is determined that the difference between the specific parameters is greater than or equal to the second parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be less than the coordination matching degree threshold; when it is determined that the difference between the specific parameters is less than the second parameter difference threshold, the parameter coordination matching degree between the first fitting sub-parameter and the second fitting sub-parameter is determined to be greater than or equal to the coordination matching degree threshold.

7. An air conditioning control device based on multimodal data fitting, characterized in that, The apparatus is used to perform the air conditioning control method based on multimodal data fitting as described in any one of claims 1-6, and the apparatus comprises: The fitting module is used to, when receiving first multimodal behavioral information about the air conditioner issued by a user, perform a fitting operation on the first multimodal behavioral information to obtain first fitting parameters of the first multimodal behavioral information; the first multimodal behavioral information includes first voice modality information and / or first body movement modality information; The acquisition module is used to acquire the user's environmental perception parameters; the environmental perception parameters include at least one of environmental temperature perception parameters, environmental humidity perception parameters, and environmental air quality. The first judgment module is used to determine whether the environmental perception parameters and the first fitting parameters match based on the user's environmental perception parameters and the first fitting parameters of the first multimodal behavior information. The acquisition module is further configured to acquire a list of fitting parameters corresponding to the air conditioner when the first judgment module determines that the environmental perception parameters and the first fitting parameters do not match. The first judgment module is further configured to determine whether there is a second fitting parameter in the fitting parameter list that is a second multimodal behavioral information about the air conditioner issued by another user in advance; the second multimodal behavioral information includes second voice modality information and / or second body movement modality information; The determining module is used to determine the control parameters for the air conditioner based on the first fitting parameter of the first multimodal behavior information when the first determining module determines that the second fitting parameter does not exist. The control module is used to perform matching control operations on the air conditioner according to the control parameters of the air conditioner.

8. An air conditioning control device based on multimodal data fitting, characterized in that, The device includes: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the air conditioning control method based on multimodal data fitting as described in any one of claims 1-6.

9. A computer storage medium, characterized in that, The computer storage medium stores computer instructions, which, when invoked, are used to execute the air conditioning control method based on multimodal data fitting as described in any one of claims 1-6.

Images