Equipment control method and device and storage medium

Abstract

The invention relates to an equipment control method and device and a storage medium. The device control method comprises: in response to determining that a user needs to set a trigger execution TAP rule for controlling a device, generating a target TAP rule based on a TAP rule template, the target TAP rule being a TAP rule represented in a natural language form, the TAP rule template comprising the TAP rule represented in the natural language form, and the TAP rule being a TAP rule represented in the natural language form; the TAP rule comprises a trigger class condition and an execution class task; and recommending the target TAP rule to a user so as to control the equipment based on the trigger class condition and the execution class task corresponding to the target TAP rule when the user sets the target TAP rule. According to the technical scheme provided by the invention, the target TAP rule of the equipment can be automatically generated and recommended to the user for use under the condition that the user does not need to understand program logic and also does not need to understand functions or specific attributes of the equipment.

Description

Technical Field

[0001] The present disclosure relates to the field of smart home technology, and in particular to a device control method, apparatus, and storage medium. Background Art

[0002] Smart homes are a manifestation of the Internet of Things (IoT). Using IoT technology, they connect various home devices, such as audio and video equipment, lighting systems, curtain controls, and air conditioning controls, providing a variety of functions and methods, including appliance control, lighting control, telephone remote control, indoor and outdoor remote control, burglar alarms, and environmental monitoring.

[0003] In related technologies, users face a high technical barrier to entry when customizing or creating new home automation rules. This requires an understanding of procedures and processes, device functions and features, and home scenario planning. This undoubtedly poses many challenges to the widespread adoption of smart home automation. Summary of the Invention

[0004] To overcome the problems existing in the related art, the present disclosure provides a device control method, apparatus and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a device control method is provided, including: in response to determining that a user needs to set a trigger execution TAP rule for controlling a device, generating a target TAP rule based on a TAP rule template, wherein the target TAP rule is a TAP rule expressed in a natural language form, and the TAP rule template includes a TAP rule expressed in a natural language form, and the TAP rule includes a trigger-type condition and an execution-type task; recommending the target TAP rule to the user so that when the user sets the target TAP rule, the device is controlled based on the trigger-type condition and the execution-type task corresponding to the target TAP rule.

[0006] In one embodiment, the TAP rule template is created in the following manner: the devices in the device set for which TAP rules have been set are divided into trigger-type devices and execution-type devices, and the functional attributes supported by each device in the device set are obtained; the functional attributes corresponding to the trigger-type devices are trigger-type condition functions, and the functional attributes corresponding to the execution-type devices are execution-type task functions; the trigger-type condition functions supported by the trigger-type devices are converted into trigger-type condition descriptions expressed in natural language form, and the execution-type condition functions supported by the execution-type devices are converted into execution-type task descriptions expressed in natural language form; based on the trigger-type condition descriptions and the execution-type task descriptions expressed in natural language form, a TAP rule template is obtained.

[0007] In one embodiment, the trigger condition description and the execution task description expressed in natural language form are used to obtain a TAP rule template, including: based on the fixed collocation and / or executable logic between the trigger condition and the execution task, combining the trigger condition description and the execution task description expressed in natural language form to obtain a first TAP rule, wherein the first TAP rule is a TAP rule that conforms to the fixed collocation and / or executable logic; and using the TAP rule that conforms to the fixed collocation and / or executable logic as a TAP rule template.

[0008] In one embodiment, the method further includes: generating a second TAP rule different from the first TAP rule based on the first TAP rule, wherein the second TAP rule is complementary to the first TAP rule and is a TAP rule that conforms to a fixed collocation and / or executable logic; and using the second TAP rule as a TAP rule template.

[0009] In one embodiment, before recommending the target TAP rule to the user, the method further includes: if an instruction from the user to set rule parameters is received, converting the rule parameters corresponding to the instruction into a trigger condition description and / or an execution task description expressed in natural language form; based on the trigger condition description and / or the execution task description expressed in natural language form, generating a TAP rule that conforms to a fixed collocation and / or executable logic.

[0010] In one embodiment, recommending the target TAP rule to the user includes: recommending the target TAP rule to the user in a natural language of a combination of trigger-type conditions and execution-type tasks; and / or simplifying the natural language of the combination of trigger-type conditions and execution-type tasks to obtain a simplified language, and recommending the target TAP rule to the user in the simplified language.

[0011] According to the second aspect of an embodiment of the present disclosure, a device control apparatus is provided, comprising: a processing unit for determining that a user needs to set a trigger execution TAP rule for controlling a device, and generating a target TAP rule based on a TAP rule template, wherein the target TAP rule is a TAP rule expressed in a natural language form, and the TAP rule template includes a TAP rule expressed in a natural language form, and the TAP rule includes a trigger-type condition and an execution-type task; a recommendation unit for recommending the target TAP rule to the user, so that when the user sets the target TAP rule, the device is controlled based on the trigger-type condition and the execution-type task corresponding to the target TAP rule.

[0012] In one embodiment, the TAP rule template is created in the following manner: the devices in the device set for which TAP rules have been set are divided into trigger-type devices and execution-type devices, and the functional attributes supported by each device in the device set are obtained; the functional attributes corresponding to the trigger-type devices are trigger-type condition functions, and the functional attributes corresponding to the execution-type devices are execution-type task functions; the trigger-type condition functions supported by the trigger-type devices are converted into trigger-type condition descriptions expressed in natural language form, and the execution-type condition functions supported by the execution-type devices are converted into execution-type task descriptions expressed in natural language form; based on the trigger-type condition descriptions and the execution-type task descriptions expressed in natural language form, a TAP rule template is obtained.

[0013] In one embodiment, the processing unit obtains a TAP rule template based on the trigger condition description and the execution task description expressed in natural language form in the following manner: based on the fixed collocation and / or executable logic between the trigger condition and the execution task, the trigger condition description and the execution task description expressed in natural language form are combined to obtain a first TAP rule, which is a TAP rule that conforms to the fixed collocation and / or executable logic; the TAP rule that conforms to the fixed collocation and / or executable logic is used as a TAP rule template.

[0014] In one embodiment, the processing unit is further used to: generate a second TAP rule different from the first TAP rule based on the first TAP rule, the second TAP rule is complementary to the first TAP rule, and is a TAP rule that conforms to a fixed collocation and / or executable logic; and use the second TAP rule as a TAP rule template.

[0015] In one embodiment, before recommending the target TAP rule to the user, the processing unit is also used to: if an instruction from the user to set rule parameters is received, convert the rule parameters corresponding to the instruction into a trigger condition description and / or an execution task description expressed in natural language form; based on the trigger condition description and / or the execution task description expressed in natural language form, generate a TAP rule that conforms to a fixed collocation and / or executable logic.

[0016] In one embodiment, the recommendation unit recommends the target TAP rule to the user in the following manner: recommending the target TAP rule to the user in a natural language of a combination of trigger-type conditions and execution-type tasks; and / or simplifying the natural language of a combination of trigger-type conditions and execution-type tasks to obtain a simplified language, and recommending the target TAP rule to the user in the simplified language.

[0017] According to a third aspect of an embodiment of the present disclosure, there is provided a device control apparatus, including:

[0018] a processor; a memory for storing instructions executable by the processor;

[0019] The processor is configured to call the instructions stored in the memory to execute the device control method as described in the first aspect or any one of the embodiments of the first aspect.

[0020] According to the fourth aspect of an embodiment of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the device control method described in the first aspect or any one of the embodiments of the first aspect.

[0021] The technical solutions provided by the embodiments of the present disclosure can achieve the following beneficial effects: When it is determined that a user needs to set a trigger execution TAP rule for controlling a device, the target TAP rule can be automatically generated and recommended to the user based on a TAP rule template. This allows the target TAP rule to be automatically generated to control the device without the user needing to understand the trigger conditions and execution tasks corresponding to the device or possess programming skills. Furthermore, the target TAP rule can be generated in natural language, which alleviates the user's understanding of various devices.

[0022] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0024] Figure 1 The figure is a flow chart showing a method for controlling a device according to an exemplary embodiment.

[0025] Figure 2 The figure is a flow chart of a method for creating a TAP rule template according to an exemplary embodiment.

[0026] Figure 3 is a flow chart showing a method for creating a TAP rule template based on fixed collocation and / or executable logic according to an exemplary embodiment.

[0027] Figure 4 The figure is a flow chart of a method for generating complementary rules according to an exemplary embodiment.

[0028] Figure 5The figure is a flow chart of a method for setting rule parameters according to an exemplary embodiment.

[0029] Figure 6 The figure is a flow chart of a method for recommending to a user according to an exemplary embodiment.

[0030] Figure 7 The figure is a flow chart of a method for controlling a smart home device according to an exemplary embodiment.

[0031] Figure 8 The figure is a block diagram of a device control apparatus according to an exemplary embodiment.

[0032] Figure 9 The present invention is a block diagram showing an apparatus for controlling a device according to an exemplary embodiment. DETAILED DESCRIPTION

[0033] Exemplary embodiments are described in detail herein, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numerals in different drawings represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present disclosure.

[0034] With the continuous advancement of technology, smart home automation technology has gradually matured. Smart home automation technology refers to the automated control and management of the home environment through various intelligent devices and systems. These devices and systems can achieve a variety of functions, such as home security, energy conservation and environmental protection, comfort and convenience. Smart home automation technology has been widely used in various types of homes, including residences, apartments, and villas. It has also been applied in commercial spaces, hotels, and other fields. A variety of smart home products are already on the market, including smart lighting, smart door locks, smart curtains, smart speakers, and more. These products can be connected via the internet to form a complete smart home system.

[0035] The mainstream paradigm for smart home automation rules is the unified TAP (Trigger-Action Programming) or ECA (Event-Condition-Action) paradigm, which is the trigger execution process of Trigger-Action Programming. Therefore, some devices are used to determine the trigger conditions in Trigger-Action Programming.

[0036] Customizing or creating new home automation rules currently requires a high technical barrier to entry. This requires an understanding of procedures and processes, device functions and features, and home scenario planning. This undoubtedly poses significant challenges to the widespread adoption of smart home automation. The average user lacks programming skills or programming concepts, and may even lack an understanding of device functions and attributes.

[0037] In view of this, the present disclosure provides a device control method that can automatically generate target TAP rules and recommend them to users without the users having to understand program logic or the functions or specific properties of the device.

[0038] It is understandable that the devices involved in this disclosure may be smart home devices such as audio and video equipment, lighting systems, curtain control, air conditioning control, security systems, digital cinema systems, audio and video servers, and video cabinet systems in the same Internet of Things, but this is not limited here.

[0039] Furthermore, the execution subject of the present disclosure may be a control center, such as a terminal device, which displays the generated target TAP rules for users to browse. Alternatively, the generated target TAP rules may be directly transmitted to a smart home device for execution, which is not limited here.

[0040] Figure 1 is a flow chart of a device control method according to an exemplary embodiment. Figure 1 As shown, the following steps are included.

[0041] In step S11 , in response to determining that the user needs to set a trigger-execution TAP rule for controlling the device, a target TAP rule is generated based on a TAP rule template.

[0042] In the embodiment of the present disclosure, when it is determined that the user needs to set a trigger execution TAP rule for controlling the device, a target TAP rule is generated based on a TAP rule template.

[0043] Among them, TAP rules include trigger condition rules and execution task rules.

[0044] Furthermore, the TAP rules include TAP rules expressed in natural language form, and the target TAP rules are TAP rules expressed in natural language form. The natural language form converts the programming rule description of the device into a rule description that can be understood by the user, which solves the user's understanding barriers of various types of devices. Among them, this process can help disassemble and translate the programming rule description of the device into a rule description that can be understood by the user through a natural language processing model, for example, it can be a generative pre-trained Transformer model (Generative Pre-Trained Transformer, GPT), but this is not limited here.

[0045] In step S12 , target TAP rules are recommended to the user.

[0046] In the embodiment of the present disclosure, after the target TAP rule is generated, the target TAP rule is recommended to the user so that when the user sets the target TAP rule, the device is controlled based on the triggering conditions and execution tasks corresponding to the target TAP rule.

[0047] In the disclosed embodiments, when it is determined that a user needs to set a trigger-execution TAP rule for controlling a device, a target TAP rule can be automatically generated based on a TAP rule template and recommended to the user. This allows the target TAP rule to be automatically generated to control the device without the user needing to understand the trigger conditions and execution tasks corresponding to the device, nor requiring programming skills. Furthermore, the target TAP rule can be generated in natural language, eliminating the user's understanding of various devices.

[0048] In the embodiment of the present disclosure, devices are divided into trigger-type devices and execution-type devices. The functional attributes corresponding to the trigger-type devices are trigger-type condition functions, and the functional attributes corresponding to the execution-type devices are execution-type task functions. Based on the trigger-type condition description and the execution-type task description expressed in natural language form, a TAP rule template is obtained.

[0049] Figure 2 FIG. 1 is a flow chart of a method for creating a TAP rule template according to an exemplary embodiment. Figure 2 As shown, the following steps are included.

[0050] In step S21 , the devices in the device set for which TAP rules have been set are divided into triggering devices and execution devices, and the function attributes supported by each device in the device set are obtained.

[0051] In the disclosed embodiments, each device in a device set with TAP rules is categorized as a triggering device, an execution device, or a device with both triggering and execution attributes. Triggering devices may include devices such as human presence sensors and temperature sensors, while execution devices may include devices such as desk lamps, air conditioners, and door locks. Devices with both triggering and execution attributes may include advanced desk lamps with light sensors, etc., without limitation.

[0052] Furthermore, the functional attributes supported by each device in the device set are obtained, for example, attribute information such as device category, naming information, room information, and functional information such as home appliance control, lighting control, and environmental monitoring, which are not limited here.

[0053] In step S22, the trigger condition functions supported by the trigger device are converted into a trigger condition description expressed in natural language, and the trigger condition functions supported by the execution device are converted into an execution task description expressed in natural language.

[0054] In the embodiment of the present disclosure, the trigger condition functions supported by the trigger type device are converted into a trigger condition description that is easy for users to understand through a natural language processing model, and the trigger condition functions supported by the execution type device are converted into an execution type task description that is easy for users to understand.

[0055] For example, a human presence sensor has the following functional description for trigger-type devices: Detecting when someone enters; Detecting when someone leaves. Using a natural language processing model, this functional description is broken down into user-understandable trigger conditions: When someone enters the room; When someone leaves the room.

[0056] For example, a desk lamp in a room has the following functional descriptions: Turn on the lamp; Turn off the lamp; Adjust the brightness to a certain value; Adjust the color temperature to a certain value. Using a natural language processing model, this functional description is broken down into user-understandable task descriptions: Turn on the desk lamp; Turn off the desk lamp; Read in the room.

[0057] In step S23, a TAP rule template is obtained based on the trigger condition description and the execution task description expressed in natural language.

[0058] In the embodiment of the present disclosure, a TAP rule template is generated based on a plurality of trigger condition descriptions and a plurality of execution task descriptions that are understandable to a user.

[0059] The trigger condition description and the execution task description may be combined based on a fixed combination and / or executable logic between the trigger condition and the execution task.

[0060] Figure 3FIG. 1 is a flow chart showing a method for creating a TAP rule template based on fixed collocation and / or executable logic according to an exemplary embodiment. Figure 3 As shown, the following steps are included.

[0061] In step S31 , based on the fixed collocation and / or executable logic between the trigger condition and the execution task, the trigger condition description and the execution task description expressed in natural language are combined to obtain a first TAP rule.

[0062] In step S32 , TAP rules that conform to fixed collocations and / or executable logic are used as TAP rule templates.

[0063] In the disclosed embodiment, based on the pre-existing fixed pairing and / or executable logic between trigger conditions and execution tasks, a user-understandable description of the trigger conditions and the execution task is combined to generate a first TAP rule. The first TAP rule is a TAP rule that conforms to the fixed pairing and / or executable logic. The TAP rule that conforms to the fixed pairing and / or executable logic is then used as a TAP rule template.

[0064] Typically, users' smart home automation TAP rules have fixed combinations. For example, only when the PM2.5 level in the current room is detected to be above a certain value, the air purifier in the current room will be turned on instead of off. Another example is that when the air conditioner in the current room is turned on, all windows in the room must be closed. This fixed combination is also in line with common sense and logic.

[0065] In the embodiment of the present disclosure, a second TAP rule may be generated based on the first TAP rule, and the second TAP rule is a TAP rule complementary to the first TAP rule.

[0066] Figure 4 FIG. 1 is a flow chart of a method for generating complementary rules according to an exemplary embodiment. Figure 4 As shown, the following steps are included.

[0067] In step S41 , a second TAP rule different from the first TAP rule is generated based on the first TAP rule.

[0068] In step S42, the second TAP rule is used as a TAP rule template.

[0069] In the disclosed embodiment, a second TAP rule is generated based on the first TAP rule. The second TAP rule is complementary to the first TAP rule and is a TAP rule that conforms to a fixed collocation and / or executable logic. The second TAP rule is stored in a TAP rule template.

[0070] In the disclosed embodiment, after the mainstream first TAP rule is created, there is usually a second TAP rule with a complementary if else condition to complete the automation scenario for the user to choose. For example, in the smart home automation rule, the combination rule of the trigger condition description of "when someone enters the study" and the execution task description of "turn on the study lamp" will automatically generate a complementary rule of the trigger condition description of "when there is no one in the study / when someone leaves the study" and the execution task description of "turn off the study lamp". The complementary combination rule is a fixed combination and conforms to common sense logic. The user can choose whether to add it to the target TAP rule according to needs.

[0071] In the embodiment of the present disclosure, before the target TAP rule is recommended to the user, the user can freely choose whether to set various parameters of the rule according to needs.

[0072] Figure 5 FIG. 1 is a flow chart of a method for setting rule parameters according to an exemplary embodiment. Figure 5 As shown, the following steps are included.

[0073] In step S51, if a user instruction for setting rule parameters is received, the rule parameters corresponding to the instruction are converted into a trigger condition description and / or an execution task description expressed in a natural language form.

[0074] In the disclosed embodiments, after the conditional function is converted into a user-understandable conditional description, the user can freely choose whether to set the various parameters of the rule according to their needs. If the user chooses to set the rule parameters for a device, the rule parameters for the device are obtained and the corresponding one or more rule parameters are converted into a user-understandable trigger condition description and / or execution task description through a natural language processing model.

[0075] For example, the function of triggering a device that needs to monitor a certain parameter can be summarized and refined into specific conditions that the user can understand: if the study is dark and needs lighting, generally according to the indoor lighting design standard, when the illuminance is lower than 100 lux, the lights need to be turned on, then "when the study is dark" corresponds to the parameter condition of illuminance lower than 100 lux.

[0076] For example, functions that require the execution of certain parameters in execution-type devices can be summarized and refined into specific user-understandable requirements based on different usage scenarios: a desk lamp in a study usually has parameters such as brightness, color temperature, and frequency, which require input for execution. In this case, you can choose to preset a universal "eye protection mode" value based on the reading scene to match the usage scenario. However, users usually only understand the brightness of "eye protection mode" but do not understand the specific parameter values ​​behind "eye protection mode". After converting the rule parameters into a description expressed in natural language, it can be understood that the color temperature of "eye protection mode" is neutral (color temperature 4000k), the illuminance is bright enough (illuminance 1000lux+), and ultra-high frequency 1920Hz PWM dimming is used.

[0077] In step S52, based on the trigger condition description and / or the execution task description expressed in natural language, TAP rules that conform to fixed collocation and / or executable logic are generated.

[0078] In step S53 , TAP rules that comply with fixed collocations and / or executable logic are recommended to the user.

[0079] In the embodiment of the present disclosure, after the rule parameters are set, TAP rules that conform to fixed collocation and / or executable logic are generated based on the trigger condition description and / or the execution task description, and are recommended to the user.

[0080] Furthermore, in addition to recommending target TAP rules based on a combination of trigger conditions and execution tasks to users, the natural language of the combination of trigger conditions and execution tasks can also be simplified and recommended to users.

[0081] Figure 6 FIG. 1 is a flow chart of a method for recommending to a user according to an exemplary embodiment. Figure 6 As shown, the following steps are included.

[0082] In step S61 , in response to determining that the user needs to set a triggered execution TAP rule for controlling the device, a target TAP rule is generated based on a TAP rule template.

[0083] In step S62, the target TAP rule is recommended to the user in natural language in the form of a combination of trigger-type conditions and execution-type tasks.

[0084] In step S63, the natural language of the combination of trigger conditions and execution tasks is simplified to obtain a simplified language, and the target TAP rule is recommended to the user in the simplified language.

[0085] In the embodiment of the present disclosure, after generating the target TAP rule, in addition to recommending the natural language composed of trigger-type conditions and execution-type tasks to the user, the natural language composed of trigger-type conditions and execution-type tasks can also be simplified to obtain simplified language, and the simplified language can be recommended to the user.

[0086] For example, a door lock with a sensor is a device with both triggering and execution properties. The device can monitor the length of time the user is away from home. The trigger condition description for the user being away from home for a short time can be commuting mode, and the trigger condition description for the user being away from home for a long time can be business trip mode. The execution task corresponding to the commuting mode can be turning off certain devices in the home for a short period of time, such as desk lamps, air conditioners, etc., and the execution task corresponding to the business trip mode can be turning off certain devices in the home for a long period of time, such as water heaters, windows, etc. Among them, the combination of the above two trigger conditions and execution tasks can be combined and simplified into "away mode" and displayed on the terminal screen, which is simpler and clearer than the step-by-step selection and creation of rules in related technologies, and is easier for users to understand.

[0087] The embodiments of the present disclosure will exemplarily illustrate the device control method involved in the above embodiments in conjunction with smart home scenarios.

[0088] Figure 7 is a flow chart of a method for controlling a smart furniture device according to an exemplary embodiment. Figure 7 As shown, the following steps are included.

[0089] In step S701, creation starts.

[0090] In step S702, the types, attributes and functions of the networked devices are analyzed.

[0091] In this disclosed embodiment, the user's configured smart home devices are obtained and automatically categorized as trigger-type devices, execution-type devices, or devices with both trigger and execution attributes. Attribute information, such as device category, naming information, and room information, is also obtained for these smart home devices. For example, a human presence sensor in a study is a trigger-type device, while a desk lamp in the study is an execution-type device. Some high-end desk lamps have light sensors that have both trigger and execution attributes.

[0092] In step S703 , the function description is converted into a description expressed in a natural language form.

[0093] In the embodiments of the present disclosure, for example, a trigger-type device, the human presence sensor in the study has the following functional description: determine if someone enters, determine if someone leaves, etc. The conditional requirements expressed in a natural language form that can be perceived by the user are described as follows (the room where the network distribution device is located needs to be added to complete): when someone enters the study; when someone leaves the study, etc. For example, an execution-type device, the desk lamp in the study has the following functional description: execute the light on; execute the light off; execute the light brightness to a certain value; execute the light color temperature to a certain value, etc. The functional requirements expressed in a natural language form that can be perceived by the user are described as follows: turn on the study desk lamp; turn off the study desk lamp; read in the study, etc.

[0094] In step S704, it is determined whether there is a parameter selection.

[0095] In step S705, if the user chooses to set parameters, the parameters corresponding to each category are obtained and queried.

[0096] In step S706, parameter options expressed in natural language are generated.

[0097] In the disclosed embodiments, the functions of triggering devices that require setting certain parameters are summarized and refined into specific conditions expressed in natural language that are perceptible to the user. For example, if a study is dark and needs lighting, according to indoor lighting design standards, the lights should be turned on when the illuminance is less than 100 lux. Therefore, "when the study is dark" corresponds to the parameter condition of illuminance less than 100 lux.

[0098] In the embodiment of the present disclosure, the functions of the execution type devices that need to execute certain parameters are summarized and refined into specific requirements expressed in the form of natural language that can be perceived by the user according to different usage scenarios. For example, the above-mentioned study desk lamp has brightness value, color temperature value, frequency value, etc. that need to be input before it can be executed, so the general "eye protection" value will be preset according to the reading scene to match the usage scenario. For example, users can only understand the lighting for eye protection, but the lighting values ​​behind eye protection, such as color temperature is neutral color (color temperature 4000k), bright enough (illuminance 1000lux+), ultra-high frequency 1920Hz PWM dimming, and other common parameter values ​​in the industry.

[0099] In step S707, trigger conditions and execution tasks of fixed combinations or common sense logic are automatically matched.

[0100] In the disclosed embodiments, the user's smart home automation needs will have fixed combinations. For example, when the PM2.5 in the air is only above a certain value, the purifier must be turned on rather than turned off. For example, when the air conditioner in the same room is turned on, all the windows in the room must be closed, so the fixed combination is also in line with common sense logic. Continuing with the above case, this fixed combination must be a combination of "when someone enters the study" and "turn on the study lamp" or a combination of "when someone enters the study" and "reading in the study".

[0101] In step S708, if the user does not choose to set parameters, the fixed combinations or common sense logic between each category of equipment or conditions are obtained and queried, and step S707 is executed again.

[0102] In step S709 , the user may choose to freely match the combination of trigger conditions and execution tasks, or may choose to accept the recommended automatically generated TAP rules.

[0103] In the embodiment of the present disclosure, the user can be prompted or guided to create smart home automation rules according to user needs, or fixed smart home automation rules can be automatically recommended based on the user's existing devices.

[0104] In step S710 , it is determined whether the combination of the trigger condition and the execution task can generate a complementary if-else rule.

[0105] In step S711 , if a complementary rule can be generated, the complementary rule is recommended to the user.

[0106] In this disclosed embodiment, the if...else clause in the created automation rule determines whether it is a fixed combination and conforms to common sense logic, and then automatically recommends complementary smart home automation rules. For example, based on the first TAP rule of "When someone enters the study" and "Turn on the study lamp," the if...else clause automatically generates a second TAP rule with the complementary rules of "When no one is in the study / When someone leaves the study" and "Turn off the study lamp." This second TAP rule is a fixed combination and conforms to common sense logic, and users can choose whether to add it as needed.

[0107] In step S712 , a final complete target TAP rule is generated.

[0108] In the embodiment of the present disclosure, the rules are generated as standard TAP general template structure rules, that is, the condition requirement description or the function requirement description is converted into the function options of the corresponding device to form the TAP rules.

[0109] In step S713, end.

[0110] In the disclosed embodiments, each smart home device in a set of smart home devices for which TAP rules have been set is classified as a triggering device or an execution device, or as a device with both triggering and execution attributes. Functional attributes supported by each device in the set are then obtained. Using a natural language processing model, the triggering condition functions supported by the triggering devices are converted into user-friendly descriptions of the triggering conditions, and the triggering condition functions supported by the execution devices are converted into user-friendly descriptions of the execution tasks.

[0111] Furthermore, based on pre-existing fixed combinations and / or executable logic between trigger conditions and execution tasks, a user-understandable description of the trigger conditions and the execution task is combined to generate a first TAP rule. A second TAP rule complementary to the first TAP rule is generated based on the first TAP rule, and the first and second TAP rules serve as TAP rule templates.

[0112] For example, a desk lamp in a smart home device set may be an execution-type device, and the execution-type task functions of the execution-type desk lamp are "execution light on" and "execution light off". The execution-type conditional functions supported by the execution-type desk lamp are converted into execution-type task descriptions expressed in natural language form as "turn on the room desk lamp" and "turn off the room desk lamp". Automatically match trigger-type conditions of fixed collocations and / or executable logic with execution-type tasks, that is, generate the first TAP rule of "when someone enters the room" and "turn on the room desk lamp". And based on the first TAP rule, generate a second TAP rule complementary to the first TAP rule, a combination of "when there is no one in the room / someone leaves the room" and "turn off the room desk lamp" as a TAP rule template for the execution-type desk lamp.

[0113] In the embodiment of the present disclosure, when it is determined that the user needs to set a trigger execution TAP rule for controlling the smart furniture device, the current target TAP rule is generated based on the above-mentioned TAP rule template and recommended to the user.

[0114] For example, when a user purchases a new desk lamp and configures the network for it, the terminal determines that the user needs to set trigger execution TAP rules for controlling the lamp. Based on the previously configured TAP rule template, it automatically generates the target TAP rule for the current lamp and displays it on the screen. Compared to related technologies, this eliminates the need to set detailed information such as the trigger conditions for turning on the lamp, including brightness, color temperature, and frequency. Rules such as "When someone enters the room / When someone leaves the room" and "Turn on the room lamp / Turn off the room lamp" can be displayed directly on the terminal screen.

[0115] In the disclosed embodiments, when it is determined that a user needs to set a trigger-execution TAP rule for controlling a device, a target TAP rule can be automatically generated based on a TAP rule template and recommended to the user. This allows the target TAP rule to be automatically generated to control the device without the user needing to understand the trigger conditions and execution tasks corresponding to the device, nor requiring programming skills. Furthermore, the target TAP rule can be generated in natural language, eliminating the user's understanding of various devices.

[0116] Based on the same concept, an embodiment of the present disclosure also provides a device control apparatus.

[0117] It is understandable that the device control device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of the various examples disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0118] Figure 8 FIG. 1 is a block diagram of a device control apparatus 100 according to an exemplary embodiment. Figure 8 , the device includes a processing unit 101 and a recommendation unit 102.

[0119] Processing unit 101 is used to determine that the user needs to set a trigger execution TAP rule for controlling the device, and generate a target TAP rule based on the TAP rule template. The target TAP rule is a TAP rule expressed in natural language form. The TAP rule template includes TAP rules expressed in natural language form. The TAP rule includes trigger-type conditions and execution-type tasks.

[0120] The recommendation unit 102 is configured to recommend a target TAP rule to the user, so that when the user sets the target TAP rule, the device is controlled based on the triggering condition and the execution task corresponding to the target TAP rule.

[0121] In the disclosed embodiment, a TAP rule template is created by dividing the devices in a device set for which a TAP rule has been set into trigger devices and execution devices, and obtaining the functional attributes supported by each device in the device set. The functional attributes corresponding to the trigger devices are trigger condition functions, and the functional attributes corresponding to the execution devices are execution task functions. The trigger condition functions supported by the trigger devices are converted into trigger condition descriptions expressed in natural language, and the execution condition functions supported by the execution devices are converted into execution task descriptions expressed in natural language. Based on the trigger condition descriptions and execution task descriptions expressed in natural language, a TAP rule template is obtained.

[0122] In the disclosed embodiment, the processing unit 101 obtains a TAP rule template based on a trigger condition description and an execution task description expressed in natural language in the following manner: based on a fixed collocation and / or executable logic between the trigger condition and the execution task, the trigger condition description and the execution task description expressed in natural language are combined to obtain a first TAP rule, where the first TAP rule is a TAP rule that conforms to the fixed collocation and / or executable logic. The TAP rule that conforms to the fixed collocation and / or executable logic is used as the TAP rule template.

[0123] In the embodiment of the present disclosure, the processing unit 101 is further configured to generate a second TAP rule based on the first TAP rule, which is different from the first TAP rule, wherein the second TAP rule is complementary to the first TAP rule and is a TAP rule that conforms to a fixed collocation and / or executable logic, and use the second TAP rule as a TAP rule template.

[0124] In the disclosed embodiment, before recommending the target TAP rule to the user, the processing unit 101 is further configured to: upon receiving a user instruction to set rule parameters, convert the rule parameters corresponding to the instruction into a trigger condition description and / or an execution task description expressed in natural language. Based on the trigger condition description and / or execution task description expressed in natural language, generate a TAP rule that conforms to fixed collocations and / or executable logic.

[0125] In the disclosed embodiment, the recommendation unit 102 recommends target TAP rules to the user in the following manner: The target TAP rules are recommended to the user in natural language representing a combination of trigger conditions and execution tasks. The target TAP rules are recommended to the user in simplified language by simplifying the natural language representing the combination of trigger conditions and execution tasks.

[0126] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0127] Figure 9 2 is a block diagram illustrating a device control apparatus 200 according to an exemplary embodiment. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0128] Reference Figure 9 , apparatus 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0129] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0130] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0131] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 200.

[0132] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0133] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC) that is configured to receive external audio signals when the device 200 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, the audio component 210 further includes a speaker for outputting audio signals.

[0134] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0135] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200. The sensor assembly 214 can also detect changes in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200, and temperature changes of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 214 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0136] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0137] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.

[0138] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as the memory 204 including instructions, which can be executed by the processor 220 of the apparatus 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0139] It is understood that in this disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of related objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include the plural forms, unless the context clearly indicates otherwise.

[0140] It will be further understood that the terms "first," "second," and the like are used to describe various types of information, but such information should not be limited to these terms. These terms are used solely to distinguish information of the same type from one another and do not indicate a particular order or level of importance. In fact, the terms "first," "second," and the like are fully interchangeable. For example, first information could be referred to as second information, and similarly, second information could be referred to as first information without departing from the scope of this disclosure.

[0141] It can be further understood that the terms "center", "longitudinal", "lateral", "front", "back", "up", "down", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship, are based on the orientation or position relationship shown in the accompanying drawings, and are only for the convenience of describing this embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation.

[0142] It is further understood that, unless otherwise specified, “connection” includes a direct connection where there are no other components between the two elements, and also includes an indirect connection where there are other elements between the two elements.

[0143] It is further understood that although operations are described in a particular order in the drawings in the embodiments of the present disclosure, this should not be construed as requiring that the operations be performed in the particular order shown or in a serial order, or that all of the operations shown be performed to obtain the desired results. In certain circumstances, multitasking and parallel processing may be advantageous.

[0144] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein.

[0145] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A device control method, characterized in that: include: In response to determining that the user needs to set a trigger execution TAP rule for controlling the device, generating a target TAP rule based on a TAP rule template, wherein the target TAP rule is a TAP rule expressed in a natural language form, the TAP rule template includes a TAP rule expressed in a natural language form, and the TAP rule includes a trigger condition and an execution task; The target TAP rule is recommended to the user, so that when the user sets the target TAP rule, the device is controlled based on the triggering condition and the execution task corresponding to the target TAP rule.

2. The method according to claim 1, characterized in that The TAP rule template is created in the following way: The devices in the device set for which TAP rules have been set are divided into trigger devices and execution devices, and the function attributes supported by each device in the device set are obtained; The functional attribute corresponding to the trigger type device is a trigger type condition function, and the functional attribute corresponding to the execution type device is an execution type task function; Converting the trigger condition function supported by the trigger device into a trigger condition description expressed in a natural language, and converting the execution condition function supported by the execution device into an execution task description expressed in a natural language; Based on the trigger condition description and the execution task description expressed in natural language, a TAP rule template is obtained.

3. The method according to claim 2, characterized in that The trigger condition description and the execution task description expressed in natural language form are used to obtain a TAP rule template, including: Based on the fixed collocation and / or executable logic between the trigger condition and the execution task, the trigger condition description and the execution task description expressed in natural language are combined to obtain a first TAP rule, where the first TAP rule is a TAP rule that conforms to the fixed collocation and / or executable logic; The TAP rules that conform to the fixed collocation and / or executable logic are used as TAP rule templates.

4. The method according to claim 3, characterized in that The method further comprises: generating a second TAP rule different from the first TAP rule based on the first TAP rule, wherein the second TAP rule is complementary to the first TAP rule and is a TAP rule that complies with a fixed collocation and / or executable logic; The second TAP rule is used as a TAP rule template.

5. The method according to any one of claims 1 to 4, characterized in that: Before recommending the target TAP rule to the user, the method further includes: If an instruction from a user to set rule parameters is received, the rule parameters corresponding to the instruction are converted into a trigger condition description and / or an execution task description expressed in a natural language form; Based on the trigger condition description and / or the execution task description expressed in natural language, TAP rules that conform to fixed collocation and / or executable logic are generated.

6. The method according to claim 1, characterized in that The recommending the target TAP rule to the user includes: Recommending the target TAP rule to the user in natural language of a combination of triggering conditions and execution tasks; and / or The natural language of the combination of trigger-type conditions and execution-type tasks is simplified to obtain a simplified language, and the target TAP rule is recommended to the user in the simplified language.

7. A device control device, characterized in that: include: a processing unit, configured to determine a trigger execution TAP rule that a user needs to set for controlling a device, and generate a target TAP rule based on a TAP rule template, wherein the target TAP rule is a TAP rule expressed in a natural language form, wherein the TAP rule template includes a TAP rule expressed in a natural language form, and wherein the TAP rule includes a trigger condition and an execution task; The recommendation unit is used to recommend the target TAP rule to the user, so that when the user sets the target TAP rule, the device is controlled based on the triggering condition and the execution task corresponding to the target TAP rule.

8. The device according to claim 7, characterized in that The TAP rule template is created in the following way: The devices in the device set for which TAP rules have been set are divided into trigger devices and execution devices, and the function attributes supported by each device in the device set are obtained; The functional attribute corresponding to the trigger type device is a trigger type condition function, and the functional attribute corresponding to the execution type device is an execution type task function; Converting the trigger condition function supported by the trigger device into a trigger condition description expressed in a natural language, and converting the execution condition function supported by the execution device into an execution task description expressed in a natural language; Based on the trigger condition description and the execution task description expressed in natural language, a TAP rule template is obtained.

9. The device according to claim 8, characterized in that The processing unit obtains a TAP rule template based on the trigger condition description and the execution task description expressed in natural language in the following manner: Based on the fixed collocation and / or executable logic between the trigger condition and the execution task, the trigger condition description and the execution task description expressed in natural language are combined to obtain a first TAP rule, where the first TAP rule is a TAP rule that conforms to the fixed collocation and / or executable logic; The TAP rules that conform to the fixed collocation and / or executable logic are used as TAP rule templates.

10. The device according to claim 9, characterized in that The processing unit is also used for: generating a second TAP rule different from the first TAP rule based on the first TAP rule, wherein the second TAP rule is complementary to the first TAP rule and is a TAP rule that complies with a fixed collocation and / or executable logic; The second TAP rule is used as a TAP rule template.

11. The device according to any one of claims 7 to 10, characterized in that Before recommending the target TAP rule to the user, the processing unit is further configured to: If an instruction from a user to set rule parameters is received, the rule parameters corresponding to the instruction are converted into a trigger condition description and / or an execution task description expressed in a natural language form; Based on the trigger condition description and / or the execution task description expressed in natural language, TAP rules that conform to fixed collocation and / or executable logic are generated.

12. The device according to claim 7, characterized in that The recommendation unit recommends the target TAP rule to the user in the following manner: Recommending the target TAP rule to the user in natural language of a combination of triggering conditions and execution tasks; and / or The natural language of the combination of trigger-type conditions and execution-type tasks is simplified to obtain a simplified language, and the target TAP rule is recommended to the user in the simplified language.

13. A device control device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: The device control method according to any one of claims 1 to 6 is executed by calling the instructions stored in the memory.

14. A storage medium, characterized in that: The storage medium stores instructions, and when the instructions in the storage medium are executed by a processor of the electronic device, the electronic device is enabled to execute the device control method according to any one of claims 1 to 6.

Images