Device control method, apparatus, storage medium, and program product

Abstract

This disclosure relates to a device control method, apparatus, storage medium, and program product. The method includes: receiving a user instruction indicating a first operation desired by the user, the first operation being used to adjust a target device to a first state; if the target device lacks the capability to perform the first operation, determining a second operation, the second operation being an operation executable by the target device that replaces the first operation, used to adjust the target device's target configuration parameters to a target value; controlling the target device to execute the second operation, such that the similarity between the state of the target device after execution and the first state is higher than the similarity when the second operation is not executed. This avoids the lack of feedback caused by direct refusal to execute due to insufficient device capability, meets user needs as much as possible, provides control effects close to expectations, and thus improves the user experience.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a device control method, apparatus, storage medium, and program product. Background Technology

[0002] In current smart device control processes, users often use natural language commands to adjust the device to a specific state. However, due to limitations in device hardware capabilities or functionality, the expected operations may not be executed directly, leading to a degraded user experience. Summary of the Invention

[0003] To overcome the problems existing in related technologies, this disclosure provides a device control method, apparatus, storage medium, and program product.

[0004] According to a first aspect of the present disclosure, a device control method is provided, comprising: Receive a user instruction, the user instruction indicating a first operation that the user wishes to perform, the first operation being used to adjust the target device to a first state; If the target device does not have the ability to perform the first operation, then a second operation is determined. The second operation is an operation that the target device can perform and that replaces the first operation, used to adjust the target configuration parameters of the target device to the target value. The target device is controlled to perform the second operation, such that the similarity between the state of the target device after the operation and the first state is higher than the similarity when the second operation is not performed.

[0005] In the above technical solution, when the target device lacks the capability to perform the user's desired operation, an achievable alternative operation is identified and executed, bringing the device state closer to the user's expected initial state. This avoids the lack of feedback caused by the device's inability to perform the operation, thus meeting user needs as much as possible, providing control effects close to expectations, and improving the user experience.

[0006] In some possible implementations, controlling the target device to perform the second operation includes: Generate a confirmation message, which is used to indicate that the first operation cannot be performed and to request the user to confirm whether to perform the second operation; In response to receiving a confirmation instruction from the user regarding the confirmation information, the target device is controlled to perform the second operation.

[0007] In the above technical solution, when the user's expected first operation cannot be performed directly, a confirmation request is sent to the user to inform the user of the current device's limitations and suggested alternatives. The operation is then performed only after obtaining the user's authorization. This can avoid the discomfort caused by unauthorized execution of alternative operations without the user's consent, and can also enhance the user's sense of control over the device's behavior, thereby improving the user experience.

[0008] In some possible implementations, controlling the target device to perform the second operation includes: Determine the similarity between the second state and the first state, where the second state is the expected state that the target device will reach after performing the second operation; If the similarity is greater than or equal to the similarity threshold, then the target device is controlled to perform the second operation; If the similarity is less than the similarity threshold, a confirmation message is generated, and in response to receiving a confirmation instruction from the user for the confirmation message, the target device is controlled to perform the second operation.

[0009] In the above technical solution, the similarity is used to adopt a differentiated execution strategy for the second operation, which reduces unnecessary human-computer interaction, ensures the user's right to know and operational autonomy in decision-making, and avoids user experience gap.

[0010] In some possible implementations, the second operation includes at least one executable instruction for adjusting at least one target configuration parameter of the target device to a corresponding target value.

[0011] In the above technical solution, configuration parameters can be precisely adjusted through one or more executable instructions, enabling flexible and configurable alternative operations. When device capabilities are limited, the solution can approximate user expectations to the greatest extent possible, thereby improving the success rate of instruction execution.

[0012] In some possible implementations, the method further includes: Obtain the device specification information of the target device, which is used to define the configurable parameters supported by the target device; If the configurable parameter involved in the first operation is not one of the configurable parameters, then it is determined that the target device does not have the ability to perform the first operation.

[0013] In the above technical solution, the ability of the target device to perform the first operation is determined by judging whether the configurable parameters involved in the first operation are configurable parameters. This can quickly and accurately identify the device capability boundary and thus improve the command response efficiency.

[0014] In some possible implementations, determining the second operation includes: From the configurable parameters of the target device, determine the target configuration parameters that have a preset mapping relationship with the first state; Based on the first state, the target value corresponding to the target configuration parameter is determined.

[0015] In the above technical solution, the target configuration parameters can be quickly determined by the preset mapping relationship, and the user intention can be transformed into specific parameters that the device can execute. Based on the characteristics of the first state, the specific target value corresponding to the target configuration parameters can be derived, so that the second operation can accurately approximate the user's expectations, thereby ensuring the user's satisfaction with the substitution effect.

[0016] In some possible implementations, the target device includes a lighting unit; determining the second operation if the target device does not have the capability to perform the first operation includes: If the first operation is used to adjust the color temperature of the target device, and the color temperature is not a configurable parameter of the target device, then brightness and / or color are determined as the target configuration parameters.

[0017] In the above technical solution, when the user wants to adjust the color temperature but the device does not have this capability, brightness or color is used as a substitute parameter to achieve a lighting effect close to the user's expectations, thereby improving the user experience.

[0018] In some possible implementations, the determination of the second operation further includes: Based on the first state, the corresponding brightness value and / or color value are mapped as the target value.

[0019] In the above technical solution, the intention to adjust the color temperature can be quantified into specific brightness or color parameter values ​​through mapping, thereby achieving precise parameterization of the second operation and enabling the target device to provide an operating experience close to the user's expectations.

[0020] In some possible implementations, the target device includes a lighting unit; determining the second operation if the target device does not have the capability to perform the first operation includes: If the first operation is used to adjust the color of the target device, and the color is not a configurable parameter of the target device, then brightness and / or color temperature are determined as the target configuration parameters.

[0021] In the above technical solution, when the user wants to adjust the color but the device does not have this capability, brightness or color temperature is used as a substitute parameter to achieve a lighting effect close to the user's expectations, so as to maximize the realization of the user's intention.

[0022] In some possible implementations, the determination of the second operation further includes: Based on the first state, the corresponding brightness value and / or color temperature value are mapped as the target value.

[0023] In the above technical solution, the color adjustment intention can be quantified into specific brightness or color temperature parameter values ​​through mapping, thereby achieving precise parameterization of the second operation and enabling the target device to provide an operating experience close to the user's expectations.

[0024] In some possible implementations, the target device includes a lighting unit; determining the second operation if the target device does not have the capability to perform the first operation includes: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then at least one of brightness, color temperature, and color is determined as the target configuration parameter.

[0025] In the above technical solution, when the user wants to adjust the operating mode but the device does not have that mode, brightness, color temperature or color is used as substitute parameters to achieve a lighting effect close to the user's expectations, so as to realize the user's intention to the greatest extent.

[0026] In some possible implementations, the determination of the second operation further includes: Based on the desired pattern, the corresponding brightness value, color temperature value, or color value is mapped as the target value.

[0027] In the above technical solution, the intention to adjust the desired mode can be quantified into specific brightness values, color temperature values, or color values, so that lighting units that do not have the capability of this mode can still provide a lighting experience close to the user's expectations.

[0028] In some possible implementations, the target device includes an air conditioner; determining the second operation if the target device does not have the capability to perform the first operation includes: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then wind speed and / or temperature are determined as the target configuration parameters.

[0029] In the above technical solution, when a user wants to adjust the air conditioner's operating mode but the device does not have that mode, by using temperature and fan speed as substitute parameters, an operating experience close to the user's expectations can be provided, thus avoiding complete unresponsiveness due to the lack of a mode.

[0030] In some possible implementations, the determination of the second operation further includes: Based on the desired pattern, the corresponding wind speed and / or temperature values ​​are mapped as the target values.

[0031] In the above technical solution, the desired mode intention can be quantified into specific temperature and wind speed values, so that air conditioners that do not have the capability of this mode can still provide an operating experience close to the user's expectations.

[0032] In some possible implementations, the target device includes an air conditioner; determining the second operation if the target device does not have the capability to perform the first operation includes: If the first operation is used to adjust the volume of the target device, and the volume is not a configurable parameter of the target device, then the wind speed is determined as the target configuration parameter.

[0033] In the above technical solution, when a user wants to adjust the volume of the air conditioner but the device does not have this capability, the wind speed is used as a substitute parameter. The change in wind noise caused by the change in wind speed is used to simulate the auditory effect of volume adjustment, so as to realize the user's intention to the greatest extent.

[0034] In some possible implementations, the determination of the second operation further includes: Based on the first state, the corresponding volume value is mapped as the target value.

[0035] In the above technical solution, the intention to adjust the volume can be quantified into a specific wind speed parameter, which can achieve precise parameterization of the second operation to provide an operating experience close to the user's expectations.

[0036] In some possible implementations, the target device includes a fan; determining the second operation if the target device does not have the capability to perform the first operation includes: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then the wind speed and / or swing angle are determined as the target configuration parameters.

[0037] In the above technical solution, when the user expects to adjust the operating mode of the fan but the device does not have that mode, the operating experience close to the user's expectation is provided by using wind speed and / or swing angle as alternative parameters, so as to avoid complete unresponsiveness due to the lack of a mode.

[0038] In some possible implementations, the determination of the second operation further includes: Based on the first state, the corresponding wind speed value and / or sway angle value are mapped as the target value.

[0039] In the above technical solution, the mode intent can be quantified into specific wind speed values ​​and / or swing angle values, so that fans that do not have the capability of this mode can still provide an operating experience close to the user's expectations.

[0040] In some possible implementations, the method further includes: Obtain the device specification information of the target device, which is used to define the configurable parameters supported by the target device and the corresponding allowed value range; If the configurable parameter involved in the first operation belongs to the configurable parameters and the first value does not belong to the corresponding allowed value range, then it is determined that the target device does not have the ability to perform the first operation, and the first value is the parameter value corresponding to the configurable parameter involved in the first operation.

[0041] In the above technical solution, by using the allowable range of parameter values ​​for verification, instructions that exceed the device's capability boundaries can be identified. Then, by determining feasible alternative operations, user needs can be met as much as possible, and the expected control effect can be provided.

[0042] In some possible implementations, determining the second operation includes: The parameters to be configured involved in the first operation are determined as the target configuration parameters.

[0043] The above technical solution simplifies the process of determining the second operation and improves processing efficiency.

[0044] In some possible implementations, the determination of the second operation further includes: If the numerical type of the first value is different from the numerical type defined in the corresponding allowed value range, then the preset value corresponding to the first value is determined as the target value.

[0045] The above technical solution can correctly convert ambiguous or non-standardized expressions in natural language into executable instructions, avoiding instruction execution failures due to type mismatch, and improving the flexibility of instruction input and the compatibility of device control.

[0046] In some possible implementations, the determination of the second operation further includes: If the first value does not belong to the set of valid values ​​supported by the target device, then the valid value in the set of valid values ​​that has the highest similarity to the first value is determined as the target value.

[0047] In the above technical solution, when the parameter value specified by the user is not in the set of valid values ​​supported by the device, the closest valid value is selected as the alternative target through similarity matching. This can approach the first state as closely as possible within the limits of device capabilities, thereby improving the user experience.

[0048] In some possible implementations, the configurable parameter is a user-adjustable parameter, or a parameter adjustable by a function key marked on the corresponding control device of the device.

[0049] The above technical solution enables rapid confirmation of configurable parameters.

[0050] In some possible implementations, determining the second operation includes: The user instruction is input into the inference model, and the second operation is obtained through the inference model. The inference model includes a mapping unit, which is used to extract the configurable parameters involved in the first operation and the parameter values ​​corresponding to the configurable parameters involved in the first operation, and to map the extracted content to obtain the second operation.

[0051] In the above technical solution, by utilizing the semantic understanding and mapping capabilities of large models, end-to-end conversion from user natural language to device operation commands can be achieved, thereby improving the system's ability to parse commands and enhancing the user experience.

[0052] In some possible implementations, the large inference model is trained in the following manner: A training sample set is obtained, which contains multiple sample pairs. Each sample pair includes a user instruction sample and a corresponding second operation sample. The second operation sample is an executable operation determined according to the device specification information of the sample device, and executing the second operation sample enables the sample device to reach a state equivalent to the operation indicated by the user instruction sample. The user instruction sample is used as input, and the second operation sample is used as the supervision target to train the initial model until the preset training termination condition is met.

[0053] In the above technical solution, training enables the large inference model to learn the mapping pattern between user instructions and alternative operations from a large number of labeled samples, thereby improving the model's generalization ability and generating a second operation for substitution in an efficient and accurate manner.

[0054] According to a second aspect of the present disclosure, a device control apparatus is provided, which is configured to perform the steps of the device control method provided in the first aspect of the present disclosure.

[0055] According to a third aspect of the present disclosure, a device control apparatus is provided, comprising: processor; Memory used to store processor-executable instructions; The processor is configured to execute the executable instructions in the memory to implement the steps of the device control method provided in the first aspect of this disclosure.

[0056] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps of the device control method provided in the first aspect of the present disclosure.

[0057] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps of the device control method provided in the first aspect of the present disclosure.

[0058] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0059] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0060] Figure 1 This is a flowchart illustrating a device control method according to an exemplary embodiment.

[0061] Figure 2 This is a flowchart illustrating a device control method according to an exemplary embodiment.

[0062] Figure 3 This is a block diagram illustrating a device control apparatus according to an exemplary embodiment.

[0063] Figure 4 This is a block diagram illustrating a device control apparatus according to an exemplary embodiment. Detailed Implementation

[0064] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0065] It should be noted that all actions involving the acquisition of signals, information, or data in this disclosure are performed with authorization from the owner of the relevant device.

[0066] Figure 1This is a flowchart illustrating a device control method according to an exemplary embodiment. This device control method can be applied to smart home systems, industrial automation control systems, or IoT device management platforms. Figure 1 As shown, the device control method may include steps S101 to S103.

[0067] In step S101, a user instruction is received.

[0068] This user instruction directs the user to perform a first operation, which is used to adjust the target device to a first state. This first state is the target device operating state that the user expects to achieve.

[0069] In one embodiment, the user can issue commands via a terminal device (such as a smart speaker, smartphone, or central control panel). These commands can be voice or text commands. For example, the user can say "adjust the bedroom light to cool light" or type "close the living room curtains".

[0070] In one embodiment, the user instruction is to adjust the bedroom light to cool light. The first operation that the user expects to perform can be to adjust the color temperature of the bedroom light to cool light, and the corresponding first state can be a cool white lighting state with a color temperature of 6000K.

[0071] In one embodiment, the user command is to close the living room curtains. The first operation the user expects to perform can be to fully close the electric curtains in the living room. The corresponding first state can be a light-blocking state with a curtain closure rate of 100%.

[0072] In step S102, if the target device does not have the capability to perform the first operation, then the second operation is determined.

[0073] The second operation is an executable operation of the target device that replaces the first operation, used to adjust the target configuration parameters of the target device to the target value. The second operation differs from the first operation, but within the capabilities of the target device, it can adjust one or more configurable parameters to make the state of the target device as close as possible to the first state expected by the first operation.

[0074] In one embodiment, the user command is to adjust the bedroom light to cool light, and the target device is an LED light that supports brightness adjustment but not color temperature adjustment. Since the target device does not have color temperature adjustment capability, a second operation can be determined to replace the first operation. For example, the second operation can be to adjust the brightness of the LED light to its maximum value (e.g., 100% brightness) to simulate the bright and refreshing visual experience brought by cool light. This second operation is used to adjust the target configuration parameter (i.e., brightness) of the target device to the target value (i.e., 100%).

[0075] The second operation includes at least one executable instruction used to adjust at least one target configuration parameter of the target device to a corresponding target value. Thus, by precisely adjusting the configuration parameters through one or more executable instructions, flexible and configurable alternative operations can be achieved, maximizing the approximation of user expectations when device capabilities are limited, and improving the instruction execution success rate.

[0076] For example, if the first operation is to mute the air conditioner, but the target device does not support volume adjustment, the second operation could be to adjust the fan speed to the lowest setting. This second operation includes an executable instruction to adjust the target configuration parameter (fan speed) to the target value (lowest setting). As another example, if the first operation is to adjust the air conditioner to comfort mode, but the target device does not support comfort mode, the second operation could be to set the temperature to 26°C and the fan speed to medium to simulate the feeling of comfort mode. This second operation includes two executable instructions, one for adjusting the temperature to the target value of 26°C and the other for adjusting the fan speed to medium.

[0077] In step S103, the target device is controlled to perform a second operation, such that the similarity between the state of the target device after the operation and the first state is higher than the similarity when the second operation is not performed.

[0078] In one embodiment, the similarity between the state of the device before and after performing the second operation and the first state can be determined by a preset similarity calculation model or by the weighted difference between device state parameters.

[0079] In one embodiment, the user command is to adjust the bedroom light to cool light, and the second operation is to adjust the brightness of the bedroom light to 100%. The user's desired first state is a cool light illumination state with a color temperature of 6000K. The state of the target device after executing the second operation has a high degree of similarity to the first state in terms of user perception, while the similarity is low if the second operation is not executed.

[0080] In another embodiment, the user command is to mute the air conditioner, and the second operation is to adjust the fan speed to the lowest setting. The user's desired first state is the minimum volume state. After executing the second operation, the fan noise is reduced, and the volume similarity to the first state is increased. If the second operation is not executed, the similarity is low.

[0081] In the above technical solution, when the target device lacks the capability to perform the user's desired operation, an achievable alternative operation is identified and executed, bringing the device state closer to the user's expected initial state. This avoids the lack of feedback caused by the device's inability to perform the operation, thus meeting user needs as much as possible, providing control effects close to expectations, and improving the user experience.

[0082] In some possible implementations, in step S103, controlling the target device to perform a second operation includes: Generate a confirmation message, which is used to indicate that the first operation cannot be performed and to request the user to confirm whether to perform the second operation; In response to receiving a confirmation instruction from the user regarding the confirmation information, the target device is controlled to perform the second operation.

[0083] In one embodiment, the user command is to mute the air conditioner, and the second operation is to adjust the fan speed to the lowest setting. Before the target device executes the second operation, a confirmation message can be generated: "The air conditioner does not support silent mode. Please confirm whether to adjust the fan speed to the lowest setting to reduce noise." This confirmation message can be presented through a visual pop-up window or voice interaction, and the user can confirm by clicking or replying with a voice.

[0084] Therefore, when the user's expected first action cannot be performed directly, a confirmation request is sent to the user to inform them of the current device's limitations and suggested alternatives. The operation is then performed only after obtaining the user's authorization. This avoids the discomfort caused by unauthorized execution of alternative operations without the user's consent and enhances the user's sense of control over the device's behavior, thereby improving the user experience.

[0085] In some possible implementations, in step S103, controlling the target device to perform a second operation includes: Determine the similarity between the second state and the first state, where the second state is the expected state that the target device will reach after the second operation is performed; If the similarity is greater than or equal to the similarity threshold, then the target device is controlled to perform the second operation; If the similarity is less than the similarity threshold, a confirmation message is generated, and in response to receiving the user's confirmation instruction for the confirmation message, the target device is controlled to perform a second operation.

[0086] In one embodiment, the similarity threshold can be preset based on experience or experimental data, for example, it can be set to 80%. If the similarity is greater than or equal to the similarity threshold, it can be determined that the gap between the second operation and the user's expectations is small, and direct execution will not cause user discomfort. Therefore, it can be executed directly without user confirmation to improve response efficiency and reduce interaction costs. If the similarity is less than the similarity threshold, it can be determined that the gap between the second operation and the user's expectations is large, and direct execution may cause user confusion or dissatisfaction. Therefore, a confirmation message can be generated to request user authorization before execution to avoid a gap in user experience.

[0087] In one embodiment, the user command is to adjust the bedroom light to cool light, and the second operation is to adjust the brightness of the bedroom light to 100%. The similarity between the corresponding second state (high brightness) and the first state (6000K cool light) is 65%, which is less than the threshold of 80%. Then, a confirmation message "Your device does not support cool light adjustment. You can adjust the brightness to the highest level to simulate the cool light effect. Do you want to continue?" can be generated. After receiving the user's confirmation command, the bedroom light is controlled to perform the second operation.

[0088] In another embodiment, the user command is to mute the air conditioner, and the second operation is to adjust the fan speed to the lowest level. The sound similarity between the corresponding second state (lowest fan speed) and the first state (lowest volume state) is 85%, which is greater than the threshold of 80%. Therefore, the air conditioner can be directly controlled to perform the second operation without user confirmation.

[0089] In this way, by using similarity to adopt differentiated execution strategies for the second operation, unnecessary human-computer interaction is reduced, while ensuring the user's right to know and operational autonomy in decision-making, thus avoiding a gap in user experience.

[0090] Figure 2 This is a flowchart illustrating a device control method according to an exemplary embodiment. Figure 2 As shown, the device control method may include steps S201 to S211.

[0091] In step S201, a user instruction is received, which indicates a first operation that the user expects to perform, the first operation being used to adjust the target device to a first state.

[0092] In step S202, the device specification information (spce, specification) of the target device is obtained.

[0093] This device specification information defines the configurable parameters supported by the target device and their corresponding allowable value ranges. These configurable parameters are either user-adjustable or adjustable via function keys on the device's corresponding control unit. For example, for lighting fixtures, configurable parameters may include user-adjustable brightness and color temperature, with allowable value ranges of 0-100% and 2000K-6500K, respectively. As another example, for air conditioners, configurable parameters include temperature, fan speed, and operating mode corresponding to function keys on the remote control, with allowable value ranges of 16-30℃, 1-5 levels, and operating modes such as cooling / heating / fan mode, respectively.

[0094] In step S203, it is determined whether the parameter to be configured involved in the first operation is a configurable parameter. If not, it is determined that the target device does not have the ability to perform the first operation and step S204 is executed; if yes, step S206 is executed.

[0095] For example, if the user command is to adjust the bedroom light to cool light, the first operation involves configuring the color temperature as the parameter to be configured. If the configurable parameters defined in the target device's specifications include brightness and color, but not color temperature, then it can be determined that color temperature is not a configurable parameter. Therefore, it is determined that the target device does not have the ability to perform the first operation. In this case, step S204 can be executed to determine the second operation. If the configurable parameters defined in the target device's specifications include color temperature, then it is determined that the parameter to be configured is a configurable parameter. Step S206 can be executed to further determine whether the target device has the ability to perform the first operation using the allowable value range corresponding to the color temperature in the device specifications.

[0096] In this way, by first determining whether the parameters to be configured involved in the first operation are configurable parameters, it is possible to determine whether the target device has the ability to perform the first operation. This can quickly and accurately identify the device's capability boundaries, thereby improving command response efficiency.

[0097] In step S204, target configuration parameters that have a preset mapping relationship with the first state are determined from the configurable parameters of the target device.

[0098] The preset mapping relationships can be pre-set based on expert knowledge, empirical rules, or experimental data. For example, for the user's desired "cool light" first state, if the target device's spotlight does not support color temperature adjustment, a mapping relationship can be set between the brightness parameter and the "cool light" state, simulating the brightness of cool light by adjusting the brightness to the maximum value. As another example, for the user's desired "minimum volume" first state, if the target device's air conditioner does not support volume adjustment, a mapping relationship can be set between the fan speed parameter and the "minimum volume" state, reducing air conditioner operating noise by adjusting the fan speed to the lowest setting.

[0099] For example, the preset mapping relationship can also be a personalized mapping rule learned from the user's historical behavior data. For instance, based on the user's past behavior of manually adjusting the brightness of the light to 20% in a sleep scenario, a mapping relationship between the sleep state and the brightness of the light at 20% can be established.

[0100] In this way, the target configuration parameters can be quickly determined through the preset mapping relationship, the user's intention can be transformed into specific parameters that the device can execute, and a reliable second operation can be generated quickly.

[0101] In step S205, the target value corresponding to the target configuration parameter is determined based on the first state.

[0102] For example, if the user command is to mute the air conditioner, the first state is the lowest volume setting, and the target configuration parameter is fan speed, based on the low noise characteristic of the lowest volume setting, the target fan speed value can be determined to be the lowest setting (e.g., level 1). As another example, if the user command is to adjust the bedroom light to cool light, the first state is cool light illumination, and the target configuration parameter is brightness, based on the bright and stimulating visual characteristics of cool light, the target brightness value can be determined to be the maximum brightness value.

[0103] Thus, based on the characteristics of the first state, the specific target value corresponding to the target configuration parameter can be derived, so that the second operation can accurately approximate the user's expectations, thereby ensuring user satisfaction with the substitution effect.

[0104] In step S206, it is determined whether the first value falls within the allowed range of the corresponding configurable parameter. If not, it is determined that the target device does not have the capability to perform the first operation and step S207 is executed; if yes, step S210 is executed.

[0105] The first value is the parameter value corresponding to the parameter to be configured involved in the first operation.

[0106] For example, the user command is to adjust the brightness of the bedroom light to 120%, with 120% as the first value. If the allowed brightness range for the bedroom light is 0%-100%, then 120% does not fall within this range, indicating that the bedroom light does not have the capability to perform the first operation. In this case, steps S207 to S209 can be executed to determine an alternative operation. If the allowed brightness range is 0%-150%, then the brightness falls within this range, indicating that the bedroom light has the capability to perform the first operation, and step S210 can be executed to meet the user's needs.

[0107] In this way, by using the allowable range of parameter values ​​for verification, instructions that exceed the device's capability boundaries can be identified. Then, by determining feasible alternative operations, user needs can be met as much as possible, and control effects close to expectations can be provided.

[0108] In step S207, the parameters to be configured involved in the first operation are determined as target configuration parameters.

[0109] For example, if the user command is to adjust the brightness of the bedroom light to 120%, the first operation involves configuring the brightness parameter. Since the bedroom light supports brightness adjustment, the brightness can be directly set as the target configuration parameter without additional mapping. This simplifies the determination process for the second operation and improves processing efficiency.

[0110] In step S208, if the numerical type of the first value is different from the numerical type defined in the corresponding allowed value range, then the preset value corresponding to the first value is determined as the target value.

[0111] For example, if a user command is to set the air conditioner fan speed to 50%, the first value 50% is a percentage value, while the allowed fan speed range is defined as an enumeration type, such as low, medium, and high. Since the numerical type and the enumeration type are different, 50% can be mapped to the closest fan speed setting, such as mapping 50% to medium as the target value.

[0112] In this way, ambiguous or non-standardized expressions in natural language can be correctly converted into device-executable instructions, avoiding instruction execution failures due to type mismatch, and improving the flexibility of instruction input and the compatibility of device control.

[0113] In step S209, if the first value does not belong to the set of valid values ​​supported by the target device, then the valid value with the highest similarity to the first value in the set of valid values ​​is determined as the target value.

[0114] For example, if the user command is to set the air conditioner temperature to 23.1℃, and the set of valid temperature values ​​supported by the air conditioner is an integer (such as 22℃, 23℃, 24℃, 25℃, etc.), and 23.1℃ is not in the set, then the absolute value of the difference between 23.1℃ and each valid value can be calculated, and the closest 23℃ can be determined as the target value.

[0115] For example, if the user command is to set the air conditioner temperature to 16℃, and the set of valid temperature values ​​supported by the air conditioner is an integer from 20℃ to 30℃, then 16℃ is lower than the minimum value of 20℃. In this case, 16℃ is not in the set of valid values ​​and exceeds the lower limit of the allowed value range. Therefore, the closest boundary valid value of 20℃ can be determined as the target value.

[0116] For example, if the user command is to adjust the bedroom light to a sunset yellow color, the first value, sunset yellow, is a semantic description of the color. The set of valid color values ​​supported by the bedroom light consists of several discrete color values ​​in the RGB color gamut (such as red #FF0000, green #00FF00, blue #0000FF, etc.). If sunset yellow is not in this set, the similarity between sunset yellow and each valid color value can be determined, and the valid color value with the highest similarity (such as yellow #FFFF00) can be determined as the target value.

[0117] Thus, when the parameter value specified by the user is not in the set of valid values ​​supported by the device, the closest valid value is selected as the alternative target through similarity matching. This can approach the first state as closely as possible within the device's capabilities, thereby improving the user experience.

[0118] In step S210, the target device is controlled to perform the first operation.

[0119] In step S211, the target device is controlled to perform a second operation.

[0120] For example, a standard control command can be sent to the target device. This standard control command can be generated based on the target device and the operation to be performed (a first operation or a second operation). The standard control command is an executable command conforming to the target device's interface protocol, including the target device's unique identifier, the target configuration parameter identifier corresponding to the operation to be performed, and the target value of the target configuration parameter. If the target device executes successfully, it returns a success response; if it fails, it generates and outputs a failure message.

[0121] exist Figure 2 In the technical solution shown, when the device capability is insufficient, the second operation can be used to make the target device state as close as possible to the first state expected by the first operation, thereby reducing execution failures caused by parameter format mismatch or exceeding the range, and thus improving the user experience.

[0122] In some possible implementations, the second operation can be determined in step S102 in the following manner: The user's instructions are input into the inference model, and the second operation is obtained through the inference model.

[0123] The inference model includes a mapping unit, which is used to extract the parameters to be configured involved in the first operation and the parameter values ​​corresponding to the parameters to be configured involved in the first operation, and to map the extracted content to obtain the second operation.

[0124] This large-scale inference model can be built upon a large language model (LLM). This model can be trained using machine learning methods. The input information to the large-scale inference model can include user commands, and the output information can be standard control commands for the second operation. This large-scale inference model can be stored locally on the electronic device and invoked locally each time it is used, or it can be stored on a third-party platform and invoked from the third party each time it is used; no specific limitation is made here.

[0125] For example, if the user command is to mute the air conditioner, the mapping unit extracts the air conditioner volume as the parameter to be configured, and the parameter value is mute. The mapping unit then maps this to an alternative operation that the target device can perform, such as adjusting the fan speed to the lowest setting.

[0126] In this way, by leveraging the semantic understanding and mapping capabilities of large models, end-to-end conversion from user natural language to device operation commands can be achieved, thereby improving the system's ability to parse commands and enhancing the user experience.

[0127] In one embodiment, the large inference model can be trained in the following manner: Obtain a training sample set, which contains multiple sample pairs. Each sample pair includes a user instruction sample and a corresponding second operation sample. The second operation sample is an executable operation determined based on the device specification information of the sample device, and executing the second operation sample enables the sample device to reach a state equivalent to the operation indicated by the user instruction sample. The initial model is trained by taking user command samples as input and second operation samples as supervision targets until the preset training termination conditions are met.

[0128] For example, a sample user instruction is to switch the bedroom light to cool light, and a sample second operation is to adjust the brightness to 100%; a sample user instruction is to mute the air conditioner, and a sample second operation is to adjust the fan speed to the lowest setting. By training the model with a large number of such samples, the model can learn to map user intentions to executable alternative operations under device capability constraints.

[0129] In this way, training allows the large inference model to learn the mapping pattern between user commands and alternative operations from a large number of labeled samples, thereby improving the model's generalization ability and generating a second operation for achieving the substitution efficiently and accurately.

[0130] The following will provide examples for different target devices, specifically for cases where the parameters to be configured in the first operation are not configurable parameters of that device, to clearly demonstrate the specific implementation of this disclosure in determining the second operation in different scenarios.

[0131] It should be noted that all parameters that can be identified as target configuration parameters are configurable parameters of the target device. If a parameter (such as color) is not a configurable parameter of the device, it cannot be selected as a target configuration parameter even if it is related to the first state. Instead, other alternative parameters will be selected from the existing configurable parameters.

[0132] In some possible implementations, the target device includes a lighting unit, such as a ceiling light, table lamp, or floor lamp.

[0133] In one embodiment, in step S102, if the target device does not have the capability to perform the first operation, then a second operation is determined, including: If the first operation is used to adjust the color temperature of the target device, and the color temperature is not a configurable parameter of the target device, then brightness and / or color are determined as the target configuration parameters.

[0134] For example, if the user command is to adjust the bedroom light to cool light, the first operation is to adjust the color temperature to cool light. However, if the target device supports brightness adjustment but not color temperature adjustment, then brightness can be set as the target configuration parameter, and the brightness can be adjusted to the maximum value to simulate the brightness of cool light.

[0135] For example, if the user command is to adjust the living room light to warm light, the first operation is to adjust the color temperature to warm light. However, if the target device does not support color temperature adjustment but supports color adjustment, then the color can be set as the target configuration parameter, and the visual effect of warm light can be simulated by adjusting the color to yellow.

[0136] Thus, when a user wants to adjust the color temperature but the device does not have this capability, brightness or color can be used as a substitute parameter to achieve a lighting effect close to the user's expectations, thereby improving the user experience.

[0137] Correspondingly, in step S102, determining the second operation further includes: Based on the first state, the corresponding brightness value and / or color value are mapped as the target value.

[0138] For example, the user command is to adjust the bedroom light to cool light. The first state is a cool white lighting state with a color temperature of 6000K. According to the preset mapping rules, the cool light state can be mapped to a brightness value of 100% (maximum value) to simulate the bright and refreshing visual experience brought by cool light.

[0139] For example, if the user command is to adjust the living room light to warm light, the first state is a warm light lighting state with a color temperature of 2700K. According to the preset mapping rules, the warm light lighting state can be mapped to a yellow color value, and the brightness value can be mapped to 80% to create a warm and soft lighting atmosphere.

[0140] In this way, the intention to adjust the color temperature can be quantified into specific brightness or color parameter values ​​through mapping, thereby achieving precise parameterization of the second operation and enabling the target device to provide an operating experience close to the user's expectations.

[0141] In another embodiment, in step S102, if the target device does not have the capability to perform the first operation, then a second operation is determined, including: If the first operation is used to adjust the color of the target device, and the color is not a configurable parameter of the target device, then brightness and / or color temperature are determined as the target configuration parameters.

[0142] For example, if the user command is to adjust the living room light to yellow, the first operation is to adjust the color to yellow. However, if the target device does not support color adjustment but supports color temperature adjustment, then the color temperature can be set as the target configuration parameter. By adjusting the color temperature to warm light, the warm and cozy visual feeling brought by yellow can be simulated.

[0143] For example, if the user command is to switch the living room light to white light, the first operation is to adjust the color to white. However, if the target device does not support color adjustment or color temperature adjustment, but does support brightness adjustment, then brightness can be set as the target configuration parameter. By adjusting the brightness to the maximum value, the bright and clear lighting effect brought by white light can be simulated.

[0144] Thus, when a user wants to adjust the color but the device does not have this capability, brightness or color temperature can be used as alternative parameters to achieve a lighting effect close to the user's expectations, thereby maximizing the fulfillment of the user's intentions.

[0145] Correspondingly, in step S102, determining the second operation further includes: Based on the first state, the corresponding brightness value and / or color temperature value are mapped as the target value.

[0146] For example, the user command is to adjust the living room light to yellow. The first state is yellow lighting. According to the preset mapping rules, the yellow lighting state is mapped to a color temperature value of 2700K (warm light) to simulate the warm and cozy visual feeling brought by yellow.

[0147] For example, if the user commands the living room light to switch to white light, the first state is white illumination. According to the preset mapping rules, the white state is mapped to a brightness value of 100% (maximum value) to simulate the bright and clear lighting effect brought by white light. If the device supports color temperature adjustment, the color temperature value can also be mapped to 5000K to reproduce the visual effect of white light.

[0148] In this way, color adjustment intentions can be quantified into specific brightness or color temperature parameter values ​​through mapping, thereby achieving precise parameterization of the second operation and enabling the target device to provide an operating experience close to the user's expectations.

[0149] In one embodiment, in step S102, if the target device does not have the capability to perform the first operation, then a second operation is determined, including: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then at least one of brightness, color temperature, and color is determined as the target configuration parameter.

[0150] For example, if the user command is to switch the bedroom light to sleep mode, and the desired mode is sleep mode, but the target device does not include sleep mode in its configurable operating modes, then brightness and color temperature can be set as the target configuration parameters. The dim, warm lighting atmosphere of sleep mode can be simulated by reducing brightness and adjusting the color temperature to warm light.

[0151] For example, if the user command is to switch the desk lamp to reading mode, and the desired mode is reading mode, but the target device does not include reading mode in its configurable operating modes, then brightness and color can be set as the target configuration parameters. By increasing the brightness and adjusting the light color to white, the bright, clear, and fatigue-reducing lighting effect of reading mode can be simulated.

[0152] Thus, when a user wants to adjust the operating mode but the device does not have that mode, brightness, color temperature, or color can be used as alternative parameters to achieve a lighting effect close to the user's expectations, thereby maximizing the fulfillment of the user's intentions.

[0153] Correspondingly, in step S102, determining the second operation further includes: Based on the desired pattern, the corresponding brightness value, color temperature value, or color value is mapped as the target value.

[0154] For example, the user command is to switch the bedroom light to sleep mode. The desired mode is sleep mode. According to the preset mapping rules, the sleep mode can be mapped to a brightness value of 20% and a color temperature value of 2700K (warm light) to create a dim, warm, and sleep-friendly lighting atmosphere.

[0155] For example, if the user command is to switch the desk lamp to reading mode, and the desired mode is reading mode, then according to the preset mapping rules, the reading mode can be mapped to a brightness value of 80% and a color of white to provide a bright, clear, and sunlight-like lighting environment and reduce eye strain.

[0156] In this way, the desired adjustment intention can be quantified into specific brightness, color temperature, or color values, so that lighting units that do not have the capability of that mode can still provide a lighting experience close to the user's expectations.

[0157] In other possible implementations, the target device includes an air conditioner.

[0158] In one embodiment, in step S102, if the target device does not have the capability to perform the first operation, then a second operation is determined, including: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then wind speed and / or temperature are determined as the target configuration parameters.

[0159] For example, if the user command is to switch the air conditioner to the default mode, and the desired mode is the default mode, but the default mode is not included in the configurable operating modes of the air conditioner, then temperature and fan speed can be determined as the target configuration parameters to simulate the comfortable and balanced operating state in the default mode.

[0160] For example, if the user's instruction is to switch the air conditioner to energy-saving mode, and the desired mode is energy-saving mode, but the air conditioner does not support energy-saving mode, then temperature and fan speed can be set as target configuration parameters to adjust the compressor's operating frequency to achieve the purpose of energy saving.

[0161] For example, if the user's instruction is to switch the air conditioner to comfort mode, and the desired mode is comfort mode, but the air conditioner does not support comfort mode, then the temperature and fan speed are set as the target configuration parameters to simulate the user experience of a comfortable temperature and gentle airflow in comfort mode.

[0162] In this way, when a user wants to adjust the air conditioner's operating mode but the device does not have that mode, by using temperature and fan speed as substitute parameters, it can provide an operating experience close to the user's expectations and avoid the device becoming completely unresponsive due to the lack of a mode.

[0163] Correspondingly, in step S102, determining the second operation further includes: Based on the desired pattern, the corresponding wind speed and / or temperature values ​​are mapped as target values.

[0164] For example, the user command is to switch the air conditioner to the default mode. The desired mode is the default mode. According to the preset mapping rules, the default mode can be mapped to a temperature value of 26℃ and a fan speed value of low, so as to simulate a balanced and comfortable operating state.

[0165] For example, if the user command is to switch the air conditioner to energy-saving mode and the desired mode is energy-saving mode, according to the preset mapping rules, the energy-saving mode can be mapped to a temperature value of 26℃ and a fan speed value of low, so as to reduce energy consumption and achieve energy-saving effect.

[0166] For example, if the user's instruction is to switch the air conditioner to comfort mode and the desired mode is comfort mode, according to the preset mapping rules, the comfort mode can be mapped to a temperature value of 26℃ and a fan speed value of medium, so as to provide a user experience with a suitable temperature and gentle airflow.

[0167] In this way, the desired mode intent can be quantified into specific temperature and wind speed values, enabling air conditioners that do not have the capability for this mode to still provide an operating experience close to the user's expectations.

[0168] In another embodiment, in step S102, if the target device does not have the capability to perform the first operation, then a second operation is determined, including: If the first operation is used to adjust the volume of the target device, and the volume is not a configurable parameter of the target device, then the wind speed is determined as the target configuration parameter.

[0169] For example, if the user command is to mute the fan, the first operation is to turn the volume down to the minimum. However, since volume is not a configurable parameter, the fan speed can be set as the target configurable parameter. By reducing the fan speed, wind noise is reduced, simulating a silent effect.

[0170] Thus, when a user wants to adjust the air conditioner volume but the device does not have this capability, the user can use the wind speed as a substitute parameter and utilize the wind noise change caused by the wind speed change to simulate the auditory effect of volume adjustment, so as to achieve the user's intention to the greatest extent.

[0171] Correspondingly, in step S102, determining the second operation further includes: Based on the first state, the corresponding volume value is mapped as the target value.

[0172] For example, the user command is to turn the fan to silent mode. The first state is the minimum volume state. According to the preset mapping rules, the minimum volume state can be mapped to the lowest fan speed value (such as level 1) to generate the minimum wind noise and simulate a quiet environment.

[0173] In this way, the intention to adjust the volume can be quantified into a specific wind speed parameter, enabling precise parameterization of the second operation to provide an operating experience close to the user's expectations.

[0174] In yet another possible implementation, the target device includes a fan.

[0175] In one embodiment, in step S102, if the target device does not have the capability to perform the first operation, then a second operation is determined, including: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then the wind speed and / or swing angle are determined as the target configuration parameters.

[0176] For example, if the user command is to switch the fan to sleep mode, and the desired mode is sleep mode, but sleep mode is not included in the fan's configurable operating modes, then the fan speed and / or swing angle can be determined as the target configuration parameters. By reducing the fan speed, the gentle airflow sensation of sleep mode can be simulated.

[0177] For example, if the user commands the fan to switch to recirculation mode, and the desired mode is recirculation mode, but the fan does not support recirculation mode, then the fan speed and swing angle can be set as the target configuration parameters. Increasing the fan speed and widening the swing angle can promote indoor air circulation and simulate the effect of recirculation.

[0178] Thus, when a user wants to adjust the fan's operating mode but the device does not have that mode, the device provides an operating experience close to the user's expectations by using wind speed and / or swing angle as alternative parameters, thus avoiding complete unresponsiveness due to the lack of a mode.

[0179] Correspondingly, in step S102, determining the second operation further includes: Based on the first state, the corresponding wind speed value and / or sway angle value are mapped as the target value.

[0180] For example, if the user command is to switch the fan to sleep mode and the desired mode is sleep mode, the sleep mode can be mapped to a medium fan speed (such as level 2) according to the preset mapping rules to simulate a gentle airflow and adapt to the sleep state.

[0181] For example, the user command is to switch the fan to the circulating mode. The desired mode is the circulating mode. According to the preset mapping rules, the circulating mode is mapped to a high wind speed (such as level 3) and a full swing angle to promote air circulation and achieve the circulation effect.

[0182] In this way, the mode intent can be quantified into specific wind speed and / or swing angle values, so that fans that do not have the capability of this mode can still provide an operating experience close to the user's expectations.

[0183] Figure 3 This is a block diagram illustrating a device control apparatus according to an exemplary embodiment. (Refer to...) Figure 3 The equipment control device 300 includes: The receiving module 301 is used to receive a user instruction, the user instruction indicating a first operation that the user expects to perform, the first operation being used to adjust the target device to a first state; The first determining module 302 is used to determine a second operation if the target device does not have the ability to perform the first operation. The second operation is an operation that the target device can perform and that replaces the first operation, and is used to adjust the target configuration parameters of the target device to the target value. The control module 303 is used to control the target device to perform the second operation, such that the similarity between the state of the target device after the operation and the first state is higher than the similarity when the second operation is not performed.

[0184] In the above technical solution, when the target device lacks the capability to perform the user's desired operation, an achievable alternative operation is identified and executed, bringing the device state closer to the user's expected initial state. This avoids the lack of feedback caused by the device's inability to perform the operation, thus meeting user needs as much as possible, providing control effects close to expectations, and improving the user experience.

[0185] In some possible implementations, the control module 303 includes: The first generation submodule is used to generate confirmation information, which is used to prompt that the first operation cannot be executed and to request the user to confirm whether to execute the second operation. The first control submodule is used to control the target device to perform the second operation in response to receiving a confirmation instruction from the user for the confirmation information.

[0186] In some possible implementations, the control module 303 includes: The first determining submodule is used to determine the similarity between the second state and the first state, wherein the second state is the expected state that the target device will reach after the second operation is performed; The second control submodule is used to control the target device to perform the second operation if the similarity is greater than or equal to the similarity threshold. The third control submodule is used to generate confirmation information if the similarity is less than the similarity threshold, and to control the target device to perform the second operation in response to receiving a confirmation instruction from the user for the confirmation information.

[0187] In some possible implementations, the second operation includes at least one executable instruction for adjusting at least one target configuration parameter of the target device to a corresponding target value.

[0188] In some possible implementations, the device control unit 300 further includes: The first acquisition module is used to acquire the device specification information of the target device, wherein the device specification information is used to define the configurable parameters supported by the target device; The second determining module is used to determine that the target device does not have the ability to perform the first operation if the configurable parameter involved in the first operation does not belong to the configurable parameters.

[0189] In some possible implementations, the first determining module 302 includes: The second determining submodule is used to determine, from the configurable parameters of the target device, a target configuration parameter that has a preset mapping relationship with the first state; The third determining submodule is used to determine the target value corresponding to the target configuration parameter based on the first state.

[0190] In some possible implementations, the target device includes a lighting unit; the first determining module 302 is configured to determine the second operation in the following manner: If the first operation is used to adjust the color temperature of the target device, and the color temperature is not a configurable parameter of the target device, then brightness and / or color are determined as the target configuration parameters.

[0191] In some possible implementations, the first determining module 302 is further configured to determine the second operation in the following manner: Based on the first state, the corresponding brightness value and / or color value are mapped as the target value.

[0192] In some possible implementations, the target device includes a lighting unit; the first determining module 302 is configured to determine the second operation in the following manner: If the first operation is used to adjust the color of the target device, and the color is not a configurable parameter of the target device, then brightness and / or color temperature are determined as the target configuration parameters.

[0193] In some possible implementations, the first determining module 302 is further configured to determine the second operation in the following manner: Based on the first state, the corresponding brightness value and / or color temperature value are mapped as the target value.

[0194] In some possible implementations, the target device includes a lighting unit; the first determining module 302 is configured to determine the second operation in the following manner: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then at least one of brightness, color temperature, and color is determined as the target configuration parameter.

[0195] In some possible implementations, the first determining module 302 is further configured to determine the second operation in the following manner: Based on the desired pattern, the corresponding brightness value, color temperature value, or color value is mapped as the target value.

[0196] In some possible implementations, the target device includes an air conditioner; the first determining module 302 is configured to determine the second operation in the following manner: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then wind speed and / or temperature are determined as the target configuration parameters.

[0197] In some possible implementations, the first determining module 302 is further configured to determine the second operation in the following manner: Based on the desired pattern, the corresponding wind speed and / or temperature values ​​are mapped as the target values.

[0198] In some possible implementations, the target device includes an air conditioner; the first determining module 302 is configured to determine the second operation in the following manner: If the first operation is used to adjust the volume of the target device, and the volume is not a configurable parameter of the target device, then the wind speed is determined as the target configuration parameter.

[0199] In some possible implementations, the first determining module 302 is further configured to determine the second operation in the following manner: Based on the first state, the corresponding volume value is mapped as the target value.

[0200] In some possible implementations, the target device includes a fan; the first determining module 302 is configured to determine the second operation in the following manner: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then the wind speed and / or swing angle are determined as the target configuration parameters.

[0201] In some possible implementations, the first determining module 302 is further configured to determine the second operation in the following manner: Based on the first state, the corresponding wind speed value and / or sway angle value are mapped as the target value.

[0202] In some possible implementations, the device control device 300 further includes: The second acquisition module is used to acquire the device specification information of the target device, wherein the device specification information is used to define the configurable parameters supported by the target device and the corresponding allowed value range; The third determining module is used to determine that the target device does not have the ability to perform the first operation if the configurable parameter involved in the first operation belongs to the configurable parameter and the first value does not belong to the corresponding allowed value range. The first value is the parameter value corresponding to the configurable parameter involved in the first operation.

[0203] In some possible implementations, the first determining module 302 includes: The fourth determination submodule determines the parameters to be configured involved in the first operation as the target configuration parameters.

[0204] In some possible implementations, the first determining module 302 includes: The fifth determining submodule determines the target value if the numerical type of the first value is different from the numerical type defined in the corresponding allowed value range definition.

[0205] In some possible implementations, the first determining module 302 includes: The sixth determining submodule, if the first value does not belong to the set of valid values ​​supported by the target device, then determines the valid value in the set of valid values ​​that has the highest similarity to the first value as the target value.

[0206] In some possible implementations, the configurable parameter is a user-adjustable parameter, or a parameter adjustable by a function key marked on the corresponding control device of the device.

[0207] In some possible implementations, the first determining module 302 includes: The reasoning submodule is used to input the user command into the reasoning big model, and obtain the second operation through the reasoning big model; The inference model includes a mapping unit, which is used to extract the configurable parameters involved in the first operation and the parameter values ​​corresponding to the configurable parameters involved in the first operation, and to map the extracted content to obtain the second operation.

[0208] In some possible implementations, the large inference model is trained in the following manner: A training sample set is obtained, which contains multiple sample pairs. Each sample pair includes a user instruction sample and a corresponding second operation sample. The second operation sample is an executable operation determined according to the device specification information of the sample device, and executing the second operation sample enables the sample device to reach a state equivalent to the operation indicated by the user instruction sample. The user instruction sample is used as input, and the second operation sample is used as the supervision target to train the initial model until the preset training termination condition is met.

[0209] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0210] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0211] In another exemplary embodiment, this disclosure also provides a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the steps of the device control method provided in this disclosure.

[0212] In another exemplary embodiment, this disclosure also provides a computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the device control method described above when executed by the programmable device.

[0213] Figure 4 This is a block diagram illustrating a device control apparatus 1900 according to an exemplary embodiment. For example, apparatus 1900 may be provided as a server. (Refer to...) Figure 4 The device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by memory 1932 for storing instructions, such as application programs, that can be executed by the processing component 1922. The application programs stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 1922 is configured to execute instructions to perform device control methods.

[0214] Device 1900 may also include a power supply component 1926 configured to perform power management of device 1900, a wired or wireless network interface 1950 configured to connect device 1900 to a network, and an input / output interface 1958. Device 1900 can operate on an operating system stored in memory 1932.

[0215] Those skilled in the art will also understand that the various illustrative logical blocks and steps listed in the embodiments of this application can be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented through hardware or software depends on the specific application and the overall system design requirements. Those skilled in the art can implement the described functionality using various methods for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of this application.

[0216] It should be understood that, unless otherwise specifically indicated, features of various embodiments of this disclosure described herein can be combined with each other. As used herein, the term “and / or” includes any one of the relevant listed items and any combination of any two or more; similarly, “at least one of…” includes any one of the relevant listed items and any combination of any two or more.

[0217] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In this description, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0218] Furthermore, the term “exemplary” is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as advantageous compared to other aspects or designs. Rather, the use of the term “exemplary” is intended to present the concept in a concrete manner. As used herein, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from the context, “X applies A or B” is intended to mean any of the natural inclusive arrangements. That is, “X applies A or B” satisfies any of the foregoing instances if X applies A; X applies B; or both X applies A and B. Additionally, unless otherwise specified or clear from the context to refer to the singular form, the articles “a” and “an” as used in this application and the appended claims are generally understood to mean “one or more.”

[0219] Similarly, although this disclosure has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art upon reading and understanding this specification and the accompanying drawings. This disclosure includes all such modifications and variations and is limited only by the scope of the claims. In particular, with respect to the various functions performed by the components described above (e.g., elements, resources, etc.), unless otherwise indicated, the terminology used to describe such components is intended to correspond to any component (functionally equivalent) that performs the specific function of the described component, even if structurally not equivalent to the disclosed structure. Furthermore, although specific features of this disclosure may have been disclosed with respect to only one of several implementations, such features may be combined with one or more other features of other implementations, as may be desired and advantageous to any given or particular application. Moreover, with regard to the terms “comprising,” “owning,” “having,” “having,” or variations thereof as used in the detailed description or claims, such terms are intended to be inclusive in a manner similar to the term “including.”

[0220] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.

[0221] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A device control method, characterized in that, include: Receive a user instruction, the user instruction indicating a first operation that the user wishes to perform, the first operation being used to adjust the target device to a first state; If the target device does not have the ability to perform the first operation, then a second operation is determined. The second operation is an operation that the target device can perform and that replaces the first operation, used to adjust the target configuration parameters of the target device to the target value. The target device is controlled to perform the second operation, such that the similarity between the state of the target device after the operation and the first state is higher than the similarity when the second operation is not performed.

2. The method according to claim 1, characterized in that, The control of the target device to perform the second operation includes: Generate a confirmation message, which is used to indicate that the first operation cannot be performed and to request the user to confirm whether to perform the second operation; In response to receiving a confirmation instruction from the user regarding the confirmation information, the target device is controlled to perform the second operation.

3. The method according to claim 1, characterized in that, The control of the target device to perform the second operation includes: Determine the similarity between the second state and the first state, where the second state is the expected state that the target device will reach after performing the second operation; If the similarity is greater than or equal to the similarity threshold, then the target device is controlled to perform the second operation; If the similarity is less than the similarity threshold, a confirmation message is generated, and in response to receiving a confirmation instruction from the user for the confirmation message, the target device is controlled to perform the second operation.

4. The method according to claim 1, characterized in that, The second operation includes at least one executable instruction for adjusting at least one target configuration parameter of the target device to a corresponding target value.

5. The method according to claim 1, characterized in that, The method further includes: Obtain the device specification information of the target device, which is used to define the configurable parameters supported by the target device; If the configurable parameter involved in the first operation is not one of the configurable parameters, then it is determined that the target device does not have the ability to perform the first operation.

6. The method according to claim 5, characterized in that, The determination of the second operation includes: From the configurable parameters of the target device, determine the target configuration parameters that have a preset mapping relationship with the first state; Based on the first state, the target value corresponding to the target configuration parameter is determined.

7. The method according to claim 1, characterized in that, The target device includes a lighting unit; if the target device does not have the capability to perform the first operation, then determining the second operation includes: If the first operation is used to adjust the color temperature of the target device, and the color temperature is not a configurable parameter of the target device, then brightness and / or color are determined as the target configuration parameters.

8. The method according to claim 7, characterized in that, The determination of the second operation also includes: Based on the first state, the corresponding brightness value and / or color value are mapped as the target value.

9. The method according to claim 1, characterized in that, The target device includes a lighting unit; if the target device does not have the capability to perform the first operation, then determining the second operation includes: If the first operation is used to adjust the color of the target device, and the color is not a configurable parameter of the target device, then brightness and / or color temperature are determined as the target configuration parameters.

10. The method according to claim 9, characterized in that, The determination of the second operation also includes: Based on the first state, the corresponding brightness value and / or color temperature value are mapped as the target value.

11. The method according to claim 1, characterized in that, The target device includes a lighting unit; if the target device does not have the capability to perform the first operation, then determining the second operation includes: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then at least one of brightness, color temperature, and color is determined as the target configuration parameter.

12. The method according to claim 11, characterized in that, The determination of the second operation also includes: Based on the desired pattern, the corresponding brightness value, color temperature value, or color value is mapped as the target value.

13. The method according to claim 1, characterized in that, The target device includes an air conditioner; if the target device does not have the capability to perform the first operation, then determining the second operation includes: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then wind speed and / or temperature are determined as the target configuration parameters.

14. The method according to claim 13, characterized in that, The determination of the second operation also includes: Based on the desired pattern, the corresponding wind speed and / or temperature values ​​are mapped as the target values.

15. The method according to claim 1, characterized in that, The target device includes an air conditioner; if the target device does not have the capability to perform the first operation, then determining the second operation includes: If the first operation is used to adjust the volume of the target device, and the volume is not a configurable parameter of the target device, then the wind speed is determined as the target configuration parameter.

16. The method according to claim 15, characterized in that, The determination of the second operation also includes: Based on the first state, the corresponding volume value is mapped as the target value.

17. The method according to claim 1, characterized in that, The target device includes a fan; if the target device does not have the capability to perform the first operation, then determining the second operation includes: If the first operation is used to adjust the operating mode of the target device, and the configurable operating modes of the target device do not include the desired mode indicated by the user, then the wind speed and / or swing angle are determined as the target configuration parameters.

18. The method according to claim 17, characterized in that, The determination of the second operation also includes: Based on the first state, the corresponding wind speed value and / or sway angle value are mapped as the target value.

19. The method according to claim 1, characterized in that, The method further includes: Obtain the device specification information of the target device, which is used to define the configurable parameters supported by the target device and the corresponding allowed value range; If the configurable parameter involved in the first operation belongs to the configurable parameters and the first value does not belong to the corresponding allowed value range, then it is determined that the target device does not have the ability to perform the first operation, and the first value is the parameter value corresponding to the configurable parameter involved in the first operation.

20. The method according to claim 19, characterized in that, The determination of the second operation includes: The parameters to be configured involved in the first operation are determined as the target configuration parameters.

21. The method according to claim 19, characterized in that, The determination of the second operation also includes: If the numerical type of the first value is different from the numerical type defined in the corresponding allowed value range, then the preset value corresponding to the first value is determined as the target value.

22. The method according to claim 19, characterized in that, The determination of the second operation also includes: If the first value does not belong to the set of valid values ​​supported by the target device, then the valid value in the set of valid values ​​that has the highest similarity to the first value is determined as the target value.

23. The method according to any one of claims 5-22, characterized in that, The configurable parameters are user-adjustable parameters or parameters that can be adjusted by function keys marked on the corresponding control device of the equipment.

24. The method according to claim 1, characterized in that, The determination of the second operation includes: The user instruction is input into the inference model, and the second operation is obtained through the inference model. The inference model includes a mapping unit, which is used to extract the configurable parameters involved in the first operation and the parameter values ​​corresponding to the configurable parameters involved in the first operation, and to map the extracted content to obtain the second operation.

25. The method according to claim 24, characterized in that, The large-scale inference model is trained in the following way: A training sample set is obtained, which contains multiple sample pairs. Each sample pair includes a user instruction sample and a corresponding second operation sample. The second operation sample is an executable operation determined according to the device specification information of the sample device, and executing the second operation sample enables the sample device to reach a state equivalent to the operation indicated by the user instruction sample. The user instruction sample is used as input, and the second operation sample is used as the supervision target to train the initial model until the preset training termination condition is met.

26. A device control apparatus, characterized in that, The device control apparatus is configured to implement the steps of the device control method according to any one of claims 1-25.

27. A device control apparatus, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to execute the executable instructions in the memory to implement the steps of the device control method according to any one of claims 1-25.

28. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the device control method according to any one of claims 1-25.

29. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the steps of the device control method according to any one of claims 1-25.

Images