Equipment control method and device, equipment and storage medium

Abstract

The embodiment of the invention provides an equipment control method and device, equipment and a storage medium. The method comprises the following steps: receiving a voice control instruction including a custom name; determining a target area corresponding to the voice control instruction; determining at least two target devices corresponding to the custom name from the devices in the target area; generating a target device control instruction according to the at least two target devices and the voice control instruction; and controlling the corresponding target equipment by adopting the target equipment control instruction. According to the embodiment of the invention, different devices are allowed to adopt repeated self-defined naming, grouping control of the target devices with the same name is realized, a plurality of target devices with the same name can be quickly controlled through a single voice instruction without presetting scene configuration, specifying an area range and enumerating device types by using qualifiers such as'all ', and the user experience is improved. And the convenience and efficiency of smart home control are remarkably improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a device control method and device, an electronic device and a storage medium. BACKGROUND

[0002] In recent years, the smart home voice control technology has made significant progress, so that users can achieve convenient control through voice instructions after the home appliance devices complete the network configuration and access the home network. With the continuous increase in the number of home smart devices, especially the increase in the same type of devices, the control selection operation for specific target devices becomes more frequent, and the user's demand for group device control is increasingly highlighted. The existing group control scheme mainly has two implementation methods: one is to pre-establish a scene, and then realize group control by clicking the scene interface or calling a voice scene instruction; the other is to use "all" instruction for batch control, such as "turn on all air conditioners in the living room" or "turn on all lights". However, these methods cannot accurately specify multiple specific devices to perform the same operation through a single voice instruction.

[0003] Under this background, how to realize more flexible and efficient group control of smart home devices has become a key problem to be solved in the technical field. SUMMARY

[0004] The embodiments of the present application provide a device control method to solve the problem of how to realize more flexible and efficient group control of smart home devices.

[0005] Correspondingly, the embodiments of the present application also provide a device control device, an electronic device and a storage medium to ensure the implementation and application of the above method.

[0006] In order to solve the above problem, the embodiments of the present application disclose a device control method applied to a smart home system, wherein the smart home system is in communication connection with a device, the device has a custom name, and the method comprises the following steps:

[0007] receiving a voice control instruction including the custom name;

[0008] determining a target area corresponding to the voice control instruction;

[0009] determining at least two target devices corresponding to the custom name from the devices in the target area;

[0010] generating a target device control instruction according to the at least two target devices and the voice control instruction;

[0011] controlling the corresponding target devices by using the target device control instruction.

[0012] In an optional embodiment of the present application, the smart home system comprises a camera, the camera has a corresponding physical area, the determining the target area corresponding to the voice control instruction comprises:

[0013] When the voice control instruction is received, the camera is turned on;

[0014] The camera picture taken by the camera is obtained;

[0015] The camera picture is identified;

[0016] If a user with a preset facial expression is identified in the camera picture, the physical area corresponding to the camera taking the camera picture is determined as the target area.

[0017] In an optional embodiment of the present application, the device comprises a voice portal device, the voice portal device is used to collect the voice control instruction, the voice portal device has a corresponding physical area, the determining the target area corresponding to the voice control instruction comprises:

[0018] The target voice portal device collecting the voice control instruction is determined;

[0019] The physical area corresponding to the target voice portal device is determined as the target area.

[0020] In an optional embodiment of the present application, the physical area has a corresponding device list, the determining at least two target devices corresponding to the custom name from the devices in the target area comprises:

[0021] The target device list corresponding to the target area is determined from the device list; the target device list comprises the custom name of the device in the target area;

[0022] According to the custom name, at least two target devices corresponding to the target device list are determined.

[0023] In an optional embodiment of the present application, the target device list further comprises the device type of the device in the target area, and the generating a target device control instruction according to at least two target devices and the voice control instruction comprises:

[0024] According to the target device list, the device type corresponding to at least two target devices is determined respectively;

[0025] The device type is used to replace the custom name in the voice control instruction to obtain a type control instruction;

[0026] The target device control instruction is generated according to the type control instruction.

[0027] In an optional embodiment of the present application, the target device control instruction is generated according to the type control instruction, comprising:

[0028] A semantic analysis model is acquired, and the semantic analysis model is used to convert a text instruction into a device control instruction.

[0029] The type control instruction is converted into the target device control instruction by using the semantic analysis model.

[0030] In an optional embodiment of the present application, after the target device control instruction is generated according to the at least two target devices and the voice control instruction, the method comprises:

[0031] It is judged whether the target device control instruction matches the target device or not.

[0032] If the target device control instruction does not match the target device, the target device control instruction is confirmed as an invalid instruction of the target device.

[0033] The invalid instruction is removed.

[0034] In an optional embodiment of the present application, the target device list comprises a device physical address of a device in the target area, and the target device control instruction is used to control the corresponding target device, comprising:

[0035] The target device physical address of the target device is determined from the target device list.

[0036] The target device control instruction is sent to the target device physical address, so that the target device executes the target device control instruction.

[0037] In an optional embodiment of the present application, after the target device control instruction is used to control the corresponding target device, the method comprises:

[0038] An execution result of the target device executing the target device control instruction is acquired.

[0039] Notification information corresponding to the execution result is sent.

[0040] Embodiments of the present application also disclose a device control apparatus applied to a smart home system, wherein the smart home system is in communication connection with a device, the device has a self-defined name, and the apparatus comprises:

[0041] A voice receiving module is configured to receive a voice control instruction comprising a self-defined name.

[0042] a region determining module configured to determine a target region corresponding to the voice control instruction;

[0043] a device determining module configured to determine at least two target devices corresponding to the customized name from devices in the target region;

[0044] an instruction generating module configured to generate a target device control instruction according to the at least two target devices and the voice control instruction;

[0045] a device control module configured to control the corresponding target device by using the target device control instruction.

[0046] The embodiments of the present application also disclose an electronic device, comprising: a processor; and a memory having stored executable codes, when the executable codes are executed, the processor executes the device control method according to one or more of the embodiments of the present application.

[0047] The embodiments of the present application also disclose one or more machine readable media having stored executable codes, when the executable codes are executed, the processor executes the device control method according to one or more of the embodiments of the present application.

[0048] Compared with the prior art, the embodiments of the present application have the following advantages:

[0049] In the embodiments of the present application, a voice control instruction including a customized name is received, a target region corresponding to the voice control instruction is determined, at least two target devices corresponding to the customized name are determined from devices in the target region, a target device control instruction is generated according to the at least two target devices and the voice control instruction, and the corresponding target device is controlled by using the target device control instruction. The embodiments of the present application allow different devices to adopt repeated customized naming, so that the customized name in the voice control instruction can correspond to multiple different devices, and then multiple target devices with the same name in the target region can be located according to the voice control instruction including the customized name, and the target device control instruction is generated and issued in parallel according to the multiple target devices and the voice control instruction, so as to realize group control of the target devices with the same name, without presetting scene configuration, without specifying a region range, without using the limiting word "all" to enumerate device types, and without using a single voice instruction to quickly control multiple target devices with the same name, which significantly improves the convenience and efficiency of smart home control. BRIEF DESCRIPTION OF DRAWINGS

[0050] Figure 1 is a related technical flow chart of a device control method embodiment of the present application;

[0051] Figure 2is a step flow chart of a control method embodiment of a device of the present application;

[0052] Figure 3 is a device control flow chart of a control method embodiment of a device of the present application;

[0053] Figure 4 is a structure block diagram of a control device embodiment of a device of the present application;

[0054] Figure 5 is a structure schematic diagram of an apparatus provided by an embodiment of the present application. DETAILED DESCRIPTION

[0055] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the present application will be further described in detail below with reference to the drawings and specific embodiments.

[0056] In recent years, the smart home voice control technology has made significant progress, so that users can achieve convenient control through voice instructions after the home appliance devices complete the network configuration and access the home network. With the continuous increase in the number of home smart devices in the smart home system, especially the increase in the same type of devices, the control selection operation for specific target devices becomes increasingly frequent, and the user's demand for group device control is also increasingly highlighted. The existing group control scheme mainly exists in the following implementation ways.

[0057] One is to pre-establish a scene, and then to realize group control by clicking the scene interface or calling a voice scene instruction. When the user needs to turn on multiple devices of different types in the home, for example, to turn on two air conditioners and all the lights in the living room, first, a scene is newly created through the scene function page in the application program corresponding to the smart home system. The application program corresponding to the smart home system has pre-stored device information of all controllable devices in the home network, and the scene function page can use these device information to newly create or edit a scene. The two air conditioners and all the lights in the living room are added to the scene, and the corresponding actions of the two air conditioners and all the lights in the living room in the scene are set. The scene is named "home mode" and saved. Subsequently, the user can trigger the two air conditioners and all the lights in the living room to turn on by clicking the "home mode" scene through the application program, or directly trigger the group control of the two air conditioners and all the lights in the living room by the voice instruction "execute home mode". This method needs to set a scene to realize the accurate specification of multiple specific devices to execute the preset operation, and the setting process is tedious, which results in poor user experience.

[0058] Second, use the "all" instruction for batch control, for example, the user directly voice instruction "turn on all air conditioners in the living room" or "turn on all lights", and the smart home system controls to turn on all air conditioners in the living room or all lights. This method cannot accurately control which air conditioners in the living room to turn on, and cannot control which air conditioners and which lights in the living room to turn on at the same time through a voice instruction.

[0059] Third, set a non-repetitive, unique custom name for each existing controllable device in the smart home system, and the user controls the target device through the unique custom name.

[0060] Referring to Figure 1 , it is a related technical flowchart of an embodiment of a device control method of the present application.

[0061] In the case that the custom name of each device cannot be the same, assuming that there is an air conditioner in the living room named "Xiaobai", the user issues the voice control instruction "turn on Xiaobai", and the smart home system receives the voice control instruction request after converting the voice input into a text instruction. Since the custom name of each device cannot be the same, the target device is matched to the target air conditioner in the living room through the custom name "Xiaobai", the custom name "Xiaobai" in the text instruction is replaced by the device type of the target air conditioner to obtain a device control instruction, the request semantics of the device control instruction is parsed using a language understanding model, and a target device control instruction that the device can understand is obtained. The target device corresponding to the target device physical address matched by the custom name "Xiaobai" is obtained, and the target device control instruction is issued to the target device for execution. When the air conditioner "Xiaobai" is turned on, the reply is organized and broadcast. However, this method can only specify one target device to perform an operation through a single voice instruction, and cannot achieve voice group control of a single instruction.

[0062] In order to solve the problem that flexible and efficient group control of smart home devices cannot be achieved in the related art, an embodiment of the present application proposes a device control method, which allows different devices to have repetitive custom names, so that the custom name in the voice control instruction can correspond to multiple different devices, and then multiple target devices with the same name can be located in a target area according to a voice control instruction containing the custom name, and a target device control instruction can be generated according to the multiple target devices and the voice control instruction and issued in parallel, to achieve group control of target devices with the same name. Without pre-configuring a scene, without specifying a range, without using "all" or other limiters to enumerate device types, a single voice instruction can quickly control multiple target devices with the same name, significantly improving the convenience and efficiency of smart home control.

[0063] Referring to Figure 2 , it is a step flowchart of an embodiment of a device control method of the present application, including the following steps:

[0064] Step 201, receiving a voice control instruction including a custom name.

[0065] The device control method shown in the embodiments of the present application is applied to a smart home system. The smart home system pre-stores device information of all controllable devices in a home network. The smart home system is in communication connection with the devices, and the devices can be controlled to perform operations through the smart home system. Each controllable device has a custom name, and the custom name can be set for the controllable device in the smart home system. In the embodiments, the custom name of the device can be repeated. For example, there are 3 air conditioners, 5 lamps, 2 purifiers, and 1 fan in a living room, and the 2 air conditioners, 3 lamps, 1 purifier, and 1 fan in the living room can all be named “Xiaobai”.

[0066] In step 201, when a user needs to group control target devices of multiple different device types, a voice control instruction including custom names of the target devices can be issued, and the custom names of the target devices are the same. For example, if the user wants to control the 2 air conditioners, 3 lamps, 1 purifier, and 1 fan named “Xiaobai” in the living room to be turned on, the voice control instruction can be “turn on Xiaobai”.

[0067] In an embodiment, the voice control instruction can be processed by voice-to-text to obtain a text instruction corresponding to the voice control instruction.

[0068] Step 202, determining a target area corresponding to the voice control instruction.

[0069] In step 202, according to the position where the voice control instruction is issued, i.e., the position where the user issues the voice control instruction, a target area where the target devices the user wants to control are located is determined, so as to determine the target devices from the devices in the target area.

[0070] Step 203, determining at least two target devices corresponding to the custom name from the devices in the target area.

[0071] In step 203, there are multiple devices in the target area. Since the custom names of different devices can be repeated in the embodiments of the present application, when the user needs to group control the devices, at least two target devices corresponding to the custom name in the devices in the target area are matched according to the custom name in the voice control instruction.

[0072] Step 204, generating a target device control instruction according to the at least two target devices and the voice control instruction.

[0073] In step 204, after determining the target device corresponding to the voice control instruction, a target device control instruction can be determined according to the at least two target devices and the voice control instruction. The target device control instruction is an instruction that can be understood by the device and used to control the target device to perform the corresponding operation in the voice control instruction.

[0074] In step 205, the target device control instruction is used to control the corresponding target device.

[0075] In step 205, the target device control instruction is sent to the target device, and the target device control instruction is used to control the corresponding target device to perform the operation. In an embodiment, the smart home system has a device control service, and after the target device control instruction is generated, the target device control instruction can be sent to the corresponding target device via the device control service, so as to control the corresponding target device to perform the operation by using the target device control instruction.

[0076] In an embodiment of the present application, a voice control instruction including a custom name is received, a target area corresponding to the voice control instruction is determined, at least two target devices corresponding to the custom name are determined from the devices in the target area, a target device control instruction is generated according to the at least two target devices and the voice control instruction, and the target device control instruction is used to control the corresponding target device. The embodiments of the present application allow different devices to use repeated custom names, so that the custom name in the voice control instruction can correspond to multiple different devices, and then multiple target devices with the same name can be located in the target area according to the voice control instruction including the custom name, and the target device control instruction can be generated and sent in parallel according to the multiple target devices and the voice control instruction, so as to realize group control of the target devices with the same name, without the need to preset scene configuration, without the need to specify the area range, without the need to use the limiting word “all” to enumerate the device types, and without the need to use a single voice instruction to quickly control multiple target devices with the same name, which significantly improves the convenience and efficiency of smart home control.

[0077] In an embodiment of the present application, the smart home system includes a camera, the camera has a corresponding physical area, and step 202 specifically includes:

[0078] When the voice control instruction is received, the camera is turned on.

[0079] The camera captures a camera picture.

[0080] The camera picture is identified.

[0081] If a user with a preset facial expression is identified in the camera picture, the physical area corresponding to the camera that captures the camera picture is determined as the target area.

[0082] In this embodiment, the home visual system in the smart home system can be called to determine the target area. Specifically, different areas in the user's home can be pre-installed with multiple cameras as the home visual system, and the user needs to assign corresponding areas to the cameras in the smart home system, i.e., pre-calibrate the physical areas (such as "living room", "bedroom", etc.) in the camera pictures, and assign the physical area where each device is located. When receiving the voice control instruction issued by the user, the camera pictures of different areas in the home are captured, and the camera pictures are identified. When a person with a preset expression is identified in the camera picture, the physical area corresponding to the camera that captures the camera picture is determined as the target area, and the target device in the target area that matches the custom name in the voice control instruction is screened.

[0083] In an embodiment, since the user will have an open-mouth expression when issuing a voice control instruction, the preset expression of the user can be open-mouth. When the camera captures a person with an open-mouth expression, it can be judged that this is the user issuing a voice control instruction, so that the physical area corresponding to the camera that captures the camera picture is determined as the target area.

[0084] The embodiments of the present application can determine the target area where the user is located when issuing a voice control instruction through the camera picture, so as to further determine the target device that the user wants to control according to the position of the user, accurately position and control the target device, and the user does not need to indicate which area the target device is in the voice control instruction, which facilitates the user to use a short voice control instruction to realize group control of the device, and improves the user experience.

[0085] In an embodiment of the present application, the device includes a voice portal device, and the voice portal device is used to collect the voice control instruction. The voice portal device has a corresponding physical area, and the step 202 specifically further includes:

[0086] determining a target voice portal device that collects the voice control instruction;

[0087] determining the physical area corresponding to the target voice portal device as the target area.

[0088] In this embodiment, the target area can be determined through the voice portal device. The voice portal device refers to a core device through which the user can interact with the smart home system through voice instructions, such as a smart voice speaker, a smart voice central control screen, a smart air conditioner with voice control function, etc. The voice portal device can collect the voice control instruction of the user. In the smart home system, the user can assign a corresponding area to the voice portal device, i.e., pre-calibrate the physical area (such as "living room", "bedroom", etc.) to which the voice portal device belongs, and assign the physical area where each device is located.

[0089] When the smart home system receives a voice control instruction issued by a user, the smart home system can determine a target voice portal device that receives the voice control instruction, obtain device information of the target voice portal device, such as a media access control address (mac), a home ID (homeID), a room ID (roomID), and the like, determine a physical area corresponding to the target voice portal device according to the device information of the target voice portal device, determine the physical area as a target area, and screen a target device in the target area that matches a custom name in the voice control instruction.

[0090] In an embodiment, if there is no target device that matches the custom name in the target area determined according to the home vision system and / or the target voice portal device, all devices in the home that match the custom name are determined as the target device. For example, there are multiple devices named "Xiaobai" in a living room, but there is no device named "Xiaobai" in a bedroom. If a user issues a voice control instruction "turn on Xiaobai" in the bedroom, the target device is determined as the multiple devices named "Xiaobai" in the living room.

[0091] The embodiment of the present application can determine a target area in which a user is located when the user issues a voice control instruction, and further determine a target device that the user wants to control according to the location of the user, so as to accurately locate and control the target device. The user does not need to indicate the target device in which area in the voice control instruction, which facilitates the user to use a short voice control instruction to realize group control of devices, and improves user experience.

[0092] In an embodiment of the present application, the physical area has a corresponding device list, and the step 203 specifically includes:

[0093] determining a target device list corresponding to the target area from the device list; the target device list includes the custom name of the device in the target area;

[0094] determining at least two target devices in the target device list according to the custom name.

[0095] In the embodiment, each physical area in a user's home has a corresponding device list. The device list includes device information of all devices in the physical area, such as a custom name of the device, a device type, a device physical address (i.e., mac), and the like. The device information of a certain device in the physical area can be found through the device list of the physical area.

[0096] After the target region is determined, a target device list corresponding to the target region can be acquired. The custom name in the voice control instruction is matched with the custom name of the device in the target device list, so that at least two target devices with the same name in the target region and which the user needs to perform group control are determined.

[0097] Embodiments of the present application determine, according to the device information in the target device list of the target region, a plurality of target devices in the target region with the same name as the custom name in the voice control instruction, and subsequently issue a target device control instruction to the target devices for control.

[0098] In an embodiment of the present application, the target device list further includes the device type of the device in the target region, and the step 204 specifically includes:

[0099] According to the target device list, the device type corresponding to each of the at least two target devices is determined.

[0100] The device type is used to replace the custom name in the voice control instruction to obtain a type control instruction.

[0101] The target device control instruction is generated according to the type control instruction.

[0102] In the embodiment, the device type of each of the target devices corresponding to the custom name in the voice control instruction can be determined according to the device type of all the devices in the physical region included in the device list. The device type corresponding to each of the target devices is used to replace the custom name in the voice control instruction to obtain a type control instruction, and the target device control instruction is generated according to the type control instruction.

[0103] For example, if the voice control instruction of the user in the living room is “turn on Xiaobai”, and according to the target device list, it can be determined that the device types of the target device named “Xiaobai” in the living room include air conditioner, lamp, purifier and fan. The device type is used to replace the custom name in the voice control instruction one by one to obtain the type control instructions of “turn on air conditioner”, “turn on lamp”, “turn on purifier” and “turn on fan”, and the target device control instruction is generated according to the type control instruction.

[0104] Embodiments of the present application determine the device type of the target device according to the device type in the device list, replace the custom name in the voice control instruction one by one with the device type, obtain the type control instruction for different device types, and generate the target device control instruction subsequently.

[0105] In an embodiment of the present application, the generation of the target device control instruction according to the type control instruction includes:

[0106] Obtain a semantic parsing model, which is used to convert text instructions into device control instructions;

[0107] The semantic parsing model is used to convert the type control instructions into the target device control instructions.

[0108] In this embodiment, since the device cannot directly understand text such as "turn on the air conditioner," a semantic parsing model is needed to convert the text commands into device control commands that the device can understand in order to control the device. The purpose of the semantic parsing model is to parse the user's human language input into semantics that the program can understand and generate corresponding device control commands, so as to complete the issuance and execution of the corresponding device control commands. In one embodiment, the semantic parsing model can be a preset template matching model, LSTM (Long Short-Term Memory), GRU (Gated Recurrent Unit), BERT (Bidirectional Encoder Representations from Transformers), or other models.

[0109] Specifically, multiple control commands of different types, converted to text, are input into a semantic parsing model in parallel. The semantic parsing model parses these multiple control commands in parallel and outputs multiple corresponding target device control commands. For example, inputting the control commands "turn on the air conditioner," "turn on the light," "turn on the air purifier," and "turn on the fan" into the semantic parsing model yields the target device control commands corresponding to "turn on the air conditioner," "turn on the light," "turn on the air purifier," and "turn on the fan," respectively. For instance, "turn on the air conditioner" will result in the target device control command "Air-Conditioner: Control-on."

[0110] In one embodiment, the target device control instructions generated after inputting type control instructions vary depending on the type of semantic parsing model. For example, the type control instruction "turn up the living room light" can be parsed as: {"device":"light","location":"living_room","action":"increase_brightness","value":"20%"}, or it can be parsed as: {"Service":light","room":"living room","intent":"turn up","value":"20"}.

[0111] This application uses a semantic parsing model to convert type control instructions into target device control instructions that the device can understand, thereby enabling the control of the device using the target device control instructions.

[0112] In one embodiment of this application, after step 204, the method includes:

[0113] Determine whether the target device control command matches the target device;

[0114] If the target device control command does not match the target device, then the target device control command is determined to be an invalid command of the target device;

[0115] Remove the invalid instruction.

[0116] The target device control command obtained from a voice control instruction may not be an instruction that the target device can execute. For example, if two air conditioners, three lights, one air purifier, and one fan in a living room are all named "Xiaobai," and the user's voice control command is "Xiaobai, turn on fan speed 3," then the corresponding control commands will be "Air conditioner, turn on fan speed 3," "Lights, turn on fan speed 3," and "Fan, turn on fan speed 3." Clearly, the target device "Xiaobai" light cannot execute the target device control command derived from "Lights, turn on fan speed 3." To address this, this embodiment of the application, after obtaining the target device control command, needs to determine whether the target device control command matches the corresponding device function. If the target device control command does not match the corresponding device function, then the target device cannot execute this target device control command; that is, the target device control command is an invalid command and is discarded. For example, the target device control command derived from "Lights, turn on fan speed 3" is an invalid command and needs to be discarded.

[0117] In this embodiment, after obtaining the target device control command, the system determines whether the target device control command is invalid based on whether the target device can execute the target device control command, and removes invalid commands to avoid sending invalid commands to unsupported target devices, thereby ensuring that the target device control command is executable and improving the user experience.

[0118] In one embodiment of this application, the target device list includes the physical addresses of devices in the target region, and step 205 specifically includes:

[0119] Determine the target device physical address of the target device from the list of target devices;

[0120] The target device control command is sent to the target device's physical address so that the target device executes the target device control command.

[0121] In the embodiment, the target device physical address of the target device corresponding to the custom name in the voice control instruction can be determined according to the target device physical address of all the devices in the target area included in the target device list. The device physical address is a unique device identifier of each device in the smart home system, and one device physical address can uniquely locate one device. Therefore, after the target device physical address of the corresponding target device is determined according to the custom name, when the target device control instruction needs to be issued to the target device, the target device control instruction can be issued according to the corresponding target device physical address, so that the target device executes the target device control instruction.

[0122] For example, if the device called "Xiaobai" in the system includes air conditioners A, B, and C, and fans D and E, when the user issues the voice control instruction "turn on Xiaobai", the target device list is obtained, which includes device information such as the custom name of the device, the device type, and the device physical address. When the device type is used to replace the custom name in the voice control instruction, the device type and the device physical address corresponding to "Xiaobai" can be obtained according to the device information in the target device list. Therefore, it can be known that the air conditioners called "Xiaobai" are A, B, and C, and the corresponding type control instruction should be "turn on the air conditioner"; the fans called "Xiaobai" are D and E, and the corresponding type control instruction should be "turn on the fan". The target device control instruction obtained according to the type control instruction "turn on the air conditioner" should be issued according to the target device physical addresses of the target devices A, B, and C; the target device control instruction obtained according to the type control instruction "turn on the fan" should be issued according to the target device physical addresses of the target devices D and E.

[0123] According to the target device physical address of the target device, the embodiment of the present application can realize accurate group control of the target devices with the same name, and significantly improve the convenience and efficiency of smart home control.

[0124] In an embodiment of the present application, after step 205, the method comprises:

[0125] obtaining an execution result obtained by the target device executing the target device control instruction;

[0126] sending notification information corresponding to the execution result.

[0127] In the embodiment, after the target device executes the target device control instruction to obtain an execution result, the notification information corresponding to the execution result can also be sent to the user. In an embodiment, the notification information corresponding to the execution result can be sent to the user in the form of voice broadcast.

[0128] In an example, since device group control generally involves more target devices, if all execution result corresponding notification information is spliced, it needs to be broadcast for a long time, affecting user experience. Embodiments of the application can count the execution results of all target devices, including execution success, timeout, state mutual exclusion, not supporting target function, device offline, etc., and determine the notification information according to the most quantity execution result. For example: if all target devices execute successfully, the notification information can be "all help you operate"; if all target devices are offline, the notification information can be "all white are offline"; if there are multiple execution results, such as 3 target devices offline, 2 target devices successful, and 1 target device mutual exclusion, the notification information can be spliced as "target device part offline, part execution success, part exists mutual exclusion state".

[0129] Embodiments of the application notify the user of the execution result of the target device executing the target device control instruction, so that the user can know the execution result of the target device executing the target device control instruction in time, improving the user experience.

[0130] In the following, the control flow of the device group control implemented by embodiments of the application will be explained with reference to Figure 3 The control flow of the device control method embodiment of the application is shown in FIG. 1. Figure 3 The control flow of the device control method embodiment of the application is shown in FIG. 1.

[0131] The custom name of the device in the smart home system of embodiments of the application can be repeated. The user sends a request speech to the smart home system through a voice control instruction including a custom name. The smart home system matches multiple devices with the same custom name according to the custom name in the voice control instruction, and then determines multiple target devices with the same name according to the current location of the user. According to the device type (i.e. category) of the target device, the custom name in the voice control instruction is replaced to obtain multiple type control instructions (i.e. replacement speech). The multiple type control instructions are input into a semantic analysis model in parallel to request multiple target device control instructions (i.e. semantic analysis). According to whether the target device can execute the target device control instruction, it is judged whether the target device control instruction is an invalid instruction. The valid target device control instruction is matched with the device type of the corresponding target device, so as to complete the parallel delivery of multiple target device control instructions to multiple target devices, so that the target device executes the target device control instruction. The smart home system organizes a reply to the user according to the delivery result and the execution result of the target device control instruction, and replies to the user in the form of broadcast.

[0132] In the embodiment of the present application, a voice control instruction including a custom name is received, a target area corresponding to the voice control instruction is determined, at least two target devices corresponding to the custom name are determined from devices in the target area, target device control instructions are generated according to the at least two target devices and the voice control instruction, and the corresponding target devices are controlled by using the target device control instructions. In the embodiment of the present application, different devices are allowed to use repeated custom names, so that the custom name in the voice control instruction can correspond to multiple different devices, and then multiple target devices with the same name in a target area can be located according to the voice control instruction including the custom name, target device control instructions are generated according to the multiple target devices and the voice control instruction and are issued in parallel, and group control of the target devices with the same name is realized, without presetting scene configuration, without specifying a range of areas, without using a limiting word such as "all" to enumerate device types, and without using a single voice instruction to quickly control multiple target devices with the same name, thereby significantly improving the convenience and efficiency of smart home control.

[0133] It should be noted that, for the method embodiments, in order to simply describe, they are all described as a series of action combinations, but those skilled in the art should know that the embodiments of the present application are not limited to the order of the actions described, because according to the embodiments of the present application, certain steps can be performed in other order or at the same time. Secondly, those skilled in the art should know that the embodiments described in the specification all belong to preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

[0134] On the basis of the above-mentioned embodiments, the present embodiment further provides a device control apparatus applied to terminal devices, servers and other electronic devices.

[0135] Reference Figure 4 is a structural block diagram of an embodiment of a device control apparatus of the present application, and can specifically include the following modules:

[0136] The voice receiving module 401 is configured to receive a voice control instruction including a custom name.

[0137] The area determining module 402 is configured to determine a target area corresponding to the voice control instruction.

[0138] The device determining module 403 is configured to determine at least two target devices corresponding to the custom name from devices in the target area.

[0139] The instruction generating module 404 is configured to generate target device control instructions according to the at least two target devices and the voice control instruction.

[0140] The device control module 405 is configured to control the corresponding target devices by using the target device control instructions.

[0141] In an optional embodiment of the present application, the smart home system comprises a camera, the camera has a corresponding physical area, the area determining module 402 comprises:

[0142] The camera opening submodule is configured to turn on the camera when the voice control instruction is received.

[0143] The picture acquisition submodule is configured to acquire a camera picture captured by the camera.

[0144] The picture recognition submodule is configured to recognize the camera picture.

[0145] The first area determining submodule is configured to determine the physical area corresponding to the camera that captures the camera picture as the target area if a user with a preset facial expression is recognized in the camera picture.

[0146] In an optional embodiment of the present application, the device comprises a voice portal device, the voice portal device is configured to collect the voice control instruction, the voice portal device has a corresponding physical area, and the area determining module 402 comprises:

[0147] The voice portal device determining submodule is configured to determine a target voice portal device that collects the voice control instruction.

[0148] The second area determining submodule is configured to determine a physical area corresponding to the target voice portal device as the target area.

[0149] In an optional embodiment of the present application, the physical area has a corresponding device list, and the device determining module 403 comprises:

[0150] The device list determining submodule is configured to determine a target device list corresponding to the target area from the device list, and the target device list comprises the custom name of the device in the target area.

[0151] The target device determining submodule is configured to determine at least two target devices corresponding to the target device list according to the custom name.

[0152] In an optional embodiment of the present application, the target device list further comprises a device type of the device in the target area, and the instruction generating module 404 comprises:

[0153] The device type determining submodule is configured to determine a device type corresponding to at least two target devices respectively according to the target device list.

[0154] The name replacing submodule is configured to replace the custom name in the voice control instruction with the device type to obtain a type control instruction.

[0155] The target instruction generating submodule is configured to generate the target device control instruction according to the type control instruction.

[0156] In an optional embodiment of the present application, the target instruction generating submodule is specifically configured to

[0157] The semantic analysis model is configured to convert a text instruction into a device control instruction.

[0158] The semantic analysis model is configured to convert a text instruction into a device control instruction.

[0159] In an optional embodiment of the present application, the apparatus comprises:

[0160] The instruction matching module is configured to determine whether the target device control instruction matches the target device.

[0161] The invalid instruction determining module is configured to determine that the target device control instruction is an invalid instruction of the target device if the target device control instruction does not match the target device.

[0162] The instruction eliminating module is configured to eliminate the invalid instruction.

[0163] In an optional embodiment of the present application, the target device list comprises a device physical address of a device in the target area, and the device control module 405 comprises:

[0164] The physical address determining submodule is configured to determine a target device physical address of the target device from the target device list.

[0165] The instruction issuing submodule is configured to issue the target device control instruction to the target device physical address, so that the target device executes the target device control instruction.

[0166] In an optional embodiment of the present application, the apparatus comprises:

[0167] The execution result obtaining module is configured to obtain an execution result of the target device executing the target device control instruction.

[0168] The result notifying module is configured to send notification information corresponding to the execution result.

[0169] In the embodiments of the present application, a voice control instruction including a custom name is received, a target area corresponding to the voice control instruction is determined, at least two target devices corresponding to the custom name are determined from devices in the target area, a target device control instruction is generated according to the at least two target devices and the voice control instruction, and the corresponding target device is controlled by using the target device control instruction. The embodiments of the present application allow different devices to use repeated custom naming, so that the custom name in the voice control instruction can correspond to multiple different devices, and then multiple target devices with the same name in the target area can be located according to the voice control instruction including the custom name, and the target device control instruction is generated according to the multiple target devices and the voice control instruction and is issued in parallel, so as to realize group control of the target devices with the same name, without presetting scene configuration, without specifying a range of area, without using a limiting word such as "all" to enumerate device types, and without using a single voice instruction to quickly control multiple target devices with the same name, thereby significantly improving the convenience and efficiency of smart home control.

[0170] The embodiments of the present application also provide a non-volatile readable storage medium, which stores one or more programs, and when the one or more programs are applied to a device, the device can execute instructions of the steps of the methods in the embodiments of the present application.

[0171] The embodiments of the present application provide one or more machine readable media, which store instructions, and when executed by one or more processors, make an electronic device execute the methods in one or more of the above embodiments. In the embodiments of the present application, the electronic device includes terminal devices, servers (clusters), and other types of devices.

[0172] The embodiments of the present application can be implemented as devices configured in any desired manner using any appropriate hardware, firmware, software, or any combination thereof, and the devices can include terminal devices, servers (clusters), and other electronic devices. Figure 5 An exemplary device 500 that can be used to implement various embodiments described in the present application is schematically illustrated.

[0173] For one embodiment, Figure 5 An exemplary device 500 is illustrated, which has one or more processors 502, a control module (chipset) 504 coupled to at least one of the processor(s) 502, a memory 506 coupled to the control module 504, a non-volatile memory (NVM) / storage device 508 coupled to the control module 504, one or more input / output devices 510 coupled to the control module 504, and a network interface 512 coupled to the control module 504.

[0174] The processor 502 can include one or more single core or multicore processors, which can include any combination of general-purpose processors or dedicated processors (e.g., graphics processors, application processors, baseband processors, etc.). In some embodiments, the apparatus 500 can function as a terminal device, a server (cluster), etc. as described in the embodiments herein.

[0175] In some embodiments, the apparatus 500 can include one or more computer readable media (e.g., the memory 506 or the NVM / storage 508) with instructions 514 and one or more processors 502 incorporated with the one or more computer readable media configured to execute the instructions 514 to implement modules to perform the actions described in the present disclosure.

[0176] For one embodiment, the control module 504 can include any suitable interface controllers to provide for any suitable interface to at least one of the processor(s) 502 and / or any suitable device or component in communication with the control module 504.

[0177] The control module 504 can include a memory controller module to provide an interface to the memory 506. The memory controller module can be a hardware module, a software module, and / or a firmware module.

[0178] The memory 506 can be used to, for example, load and store data and / or instructions 514 for the apparatus 500. For one embodiment, the memory 506 can include any suitable volatile memory, such as suitable DRAM. In some embodiments, the memory 506 can include double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).

[0179] For one embodiment, the control module 504 can include one or more input / output controllers to provide an interface to the NVM / storage 508 and the input / output device(s) 510.

[0180] The NVM / storage 508 can be used to, for example, store data and / or instructions 514. The NVM / storage 508 can include any suitable non-volatile memory (e.g., flash memory) and / or can include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives (HDDs), one or more compact disk (CD) drives, and / or one or more digital versatile disk (DVD) drives).

[0181] The NVM / storage device 508 can include storage resources that are physically part of the device on which the apparatus 500 is installed or that is accessed remotely and / or via a network, as described herein. For example, the NVM / storage device 508 can be accessed over a network via the input / output device(s) 510.

[0182] The input / output device(s) 510 can provide an interface between the apparatus 500 and any other suitable device, and can include communication components, audio components, sensor components, and so on. The network interface 512 can provide an interface between the apparatus 500 and one or more networks, and the apparatus 500 can communicate wirelessly with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols, such as to access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, 5G, and so on, or a combination thereof.

[0183] For one embodiment, at least one of the processor(s) 502 can be packaged together with logic of one or more controllers of the control module 504, such as a memory controller module. For one embodiment, at least one of the processor(s) 502 can be packaged together with logic of one or more controllers of the control module 504 to form a system in a package (SiP). For one embodiment, at least one of the processor(s) 502 can be integrated on the same die with logic of one or more controllers of the control module 504. For one embodiment, at least one of the processor(s) 502 can be integrated on the same die with logic of one or more controllers of the control module 504 to form a system on a chip (SoC).

[0184] In various embodiments, the apparatus 500 can be, but is not limited to, a terminal device such as a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, the apparatus 500 can have more or less components, and / or different architectures. For example, in some embodiments, the apparatus 500 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an application-specific integrated circuit (ASIC), and a speaker.

[0185] In various embodiments, the apparatus 500 can be, but is not limited to, a terminal device such as a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, the apparatus 500 can have more or less components, and / or different architectures. For example, in some embodiments, the apparatus 500 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an application-specific integrated circuit (ASIC), and a speaker.

[0186] For apparatus embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts are referred to the part of the description of the method embodiments.

[0187] Each of the embodiments in the present specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other.

[0188] The embodiments of the present application are described with reference to flowcharts and / or block diagrams according to the method, terminal device (system), and computer program product of the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of the flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to the processor of the control terminal device of the general-purpose computer, special-purpose computer, embedded processor, or other programmable device to generate a machine, so that the instructions executed by the processor of the computer or other programmable device control terminal device produce a machine that implements the flow Figure 1 one or more flows and / or blocks Figure 1 an apparatus that performs the functions specified in one or more blocks.

[0189] These computer program instructions can also be stored in a computer-readable memory that can guide the computer or other programmable device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including instruction apparatus, which implements the flow Figure 1 one or more flows and / or blocks Figure 1 an apparatus that performs the functions specified in one or more blocks.

[0190] These computer program instructions can also be loaded into the computer or other programmable device, so that a series of operation steps are performed on the computer or other programmable terminal device to generate a computer-implemented process, so that the instructions executed on the computer or other programmable terminal device provide a process for implementing the flow Figure 1 one or more flows and / or blocks Figure 1 an apparatus that performs the functions specified in one or more blocks.

[0191] Although the preferred embodiments of the present application have been described, those skilled in the art can make additional changes and modifications to the embodiments once they know the basic creative concept. Therefore, the appended claims are intended to include the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present application.

[0192] Finally, it is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting; it is not intended to exclude myriad other embodiments of the present application that other inventors can develop based on the same general inventive concepts embodied by the present application. That is, although the present application is described in terms of particular embodiments and implementations, it is to be understood that the terminology used is for the purpose of descriptive clarity and that it should be taken in its broadest possible sense. For example, the terms "first" and "second" are used herein only to differentiate one element from another, without necessarily requiring or implying any actual relationship or order between or among the elements. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the presence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0193] The control method and apparatus of a device, the electronic device, and the storage medium provided by the present application are described in detail above. The principles and implementation manners of the present application are described by using specific examples. The above description of the embodiments is only used to help understand the method of the present application and its core idea. Meanwhile, for those skilled in the art, the specific implementation manners and application ranges can be changed according to the idea of the present application. In summary, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A method for controlling a device, characterized in that, Applied to a smart home system, wherein the smart home system is communicatively connected to a device, the device having a custom name, the method includes: Receive voice control commands including custom names; Determine the target area corresponding to the voice control command; Identify at least two target devices corresponding to the custom name from the devices in the target region; Generate target device control instructions based on at least two target devices and the voice control instructions; The target device is controlled using the target device control command.

2. The method according to claim 1, characterized in that, The smart home system includes a camera, which has a corresponding physical area. Determining the target area corresponding to the voice control command includes: Upon receiving the voice control command, the camera is activated; Acquire the video footage captured by the camera; The camera footage is then identified; If a user with a preset facial expression is identified in the video footage, the physical area corresponding to the camera that captured the video footage is determined as the target area.

3. The method according to claim 1, characterized in that, The device includes a voice input device for collecting voice control commands. The voice input device has a corresponding physical area. Determining the target area corresponding to the voice control command includes: Identify the target voice input device for collecting the voice control commands; The physical area corresponding to the target voice entry device is defined as the target area.

4. The method according to any one of claims 2-3, characterized in that, The physical region has a corresponding device list, and determining at least two target devices corresponding to the custom name from the devices in the target region includes: A target device list corresponding to the target region is determined from the device list; the target device list includes the custom names of the devices in the target region; Based on the custom name, at least two target devices corresponding to the target device list are determined.

5. The method according to claim 4, characterized in that, The target device list also includes the device types of devices in the target area, and the step of generating target device control instructions based on at least two target devices and the voice control instructions includes: Based on the target device list, determine the device type corresponding to at least two of the target devices respectively; Replace the custom name in the voice control command with the device type to obtain the type control command; The target device control instruction is generated based on the type control instruction.

6. The method according to claim 5, characterized in that, The step of generating the target device control instruction according to the type control instruction includes: Obtain a semantic parsing model, which is used to convert text instructions into device control instructions; The semantic parsing model is used to convert the type control instructions into the target device control instructions.

7. The method according to claim 1, characterized in that, After generating target device control commands based on at least two target devices and the voice control commands, the method includes: Determine whether the target device control command matches the target device; If the target device control command does not match the target device, then the target device control command is determined to be an invalid command of the target device; Remove the invalid instruction.

8. The method according to claim 4, characterized in that, The target device list includes the physical addresses of devices in the target area, and the step of controlling the corresponding target device using the target device control command includes: Determine the target device physical address of the target device from the list of target devices; The target device control command is sent to the target device's physical address so that the target device executes the target device control command.

9. The method according to claim 1, characterized in that, After controlling the corresponding target device using the target device control command, the method includes: Obtain the execution result obtained by the target device executing the target device control command; Send the notification information corresponding to the execution result.

10. A control device for an equipment, characterized in that, Applied to a smart home system, the smart home system is communicatively connected to a device, the device having a custom name, the device comprising: A voice receiving module is used to receive voice control commands, including those with custom names. The region determination module is used to determine the target region corresponding to the voice control command; A device determination module is used to determine at least two target devices corresponding to the custom name from the devices in the target area; The instruction generation module is used to generate target device control instructions based on at least two target devices and the voice control instructions; The device control module is used to control the corresponding target device using the target device control command.

11. An electronic device, characterized in that, include: processor; and A memory having executable code stored thereon, which, when executed, causes the processor to perform a control method for the device as described in one or more of claims 1-9.

12. One or more machine-readable media having executable code stored thereon, which, when executed, causes a processor to perform a control method of the device as claimed in one or more of claims 1-9.

Images