Device control method, apparatus and system

By associating the command code and identification information of the device control instructions in the record table, the problem that existing devices are difficult to control voice is solved, and the voice control capability of the device is realized, reducing costs and improving user experience.

CN112885340BActive Publication Date: 2024-11-22ALIBABA GROUP HOLDING LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201911198664.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-11-29
Publication Date
2024-11-22
Estimated Expiration
2039-11-29

AI Technical Summary

Technical Problem

Existing devices lack voice interaction capabilities and text-to-command code conversion capabilities, making it difficult to incorporate into the voice control system, making it difficult to control through voice interaction.

Method used

By recording the entity name and synonym fields in the table, the command code of the control instruction is associated with the control instruction, the identification information in the control request is identified, and the corresponding command code is sent in the control message to realize the voice control of the device.

Benefits of technology

The voice control of the device is realized at a lower cost, which improves the functional diversity of the device and user interaction experience without the need for underlying changes to existing devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112885340B_ABST
    Figure CN112885340B_ABST
Patent Text Reader

Abstract

A device control method, apparatus and system are disclosed. On a server, an instruction code of a control instruction is recorded in association with identification information of the control instruction, and the instruction code can be recognized by the device. The instruction code can be recorded in an entity name field of a record table, and the identification information can be recorded in a synonym field of the record table. The entity name field is designed to record the entity name of the control instruction, and the synonym field is designed to record the synonym of the entity name. The identification information of the control instruction is identified from a control request. The server sends a control message, and a designated field of the control message includes an instruction code corresponding to the identification information. The audio module extracts the instruction code that can be recognized by the device from the designated field of the received control message, and transparently transmits the instruction code to the device. Then, the device receives the instruction code and performs a corresponding control operation based on the instruction code. Thus, voice control of the device is achieved at a relatively low cost and with relatively few changes to the existing solution.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a device control method, apparatus and system. Background Art

[0002] With the continuous advancement of Internet technology, solutions such as smart home and smart office have been widely developed and applied.

[0003] Users can interact with smart devices or control devices and control smart devices through voice. The user's voice can be processed locally or on the server through voice recognition, natural language understanding, etc. to determine the user's intention, and then control the smart device or send data to it.

[0004] For example, when the user says "turn on the light", the voice is processed and recognized as a control request for the device "light", the control object is "light", and the command is "turn on". Therefore, a light turn-on command can be sent to the light device to control the light to turn on.

[0005] For another example, when a user says "play the full moon on the 15th", the voice is processed and recognized as an audio playback instruction, thereby outputting the audio data of the song "The Full Moon on the 15th" to an audio playback device such as a speaker or a loudspeaker.

[0006] After the control command is recognized from the user's voice, the local control terminal or the device itself needs to convert the control command text (such as "open", "close") into a corresponding command code (such as a hexadecimal string). The device performs the corresponding operation based on the command code. In this way, the control of the device is realized.

[0007] In this way, the local control terminal or the device itself needs to have the ability to convert the instruction text into instruction code.

[0008] However, most traditional devices (especially those that have already been sold) are controlled by touch or buttons, have relatively simple functions, have no or only a small amount of voice interaction capabilities, and do not have the above-mentioned text-to-command conversion capabilities. These devices are difficult to incorporate into voice control systems and difficult to control through voice interaction.

[0009] Therefore, there is still a need for a device control solution that can implement voice control of a device at a lower cost. Summary of the invention

[0010] A technical problem to be solved by the present disclosure is to provide a device control solution, which can realize voice control of the device at a lower cost and with less changes to the existing solution.

[0011] According to the first aspect of the present disclosure, a device control method is provided, comprising: recording an instruction code of the control instruction in association with identification information of the control instruction, wherein the instruction code can be recognized by the device; identifying identification information of the control instruction from a control request; and sending a control message, wherein a designated field of the control message includes the instruction code corresponding to the identification information.

[0012] Optionally, the instruction code is recorded in the entity name field of the record table, and the identification information is recorded in the synonym field of the record table.

[0013] Optionally, the entity name field is a field designed to record the entity name of the control instruction, and the synonym field is a field designed to record the synonym of the entity name.

[0014] Optionally, the identification information includes at least one of the following: entity name; synonym; specified audio; specified action.

[0015] Optionally, the device control method may further include: searching for identification information from a synonym field of a record table; if the identification information is found, obtaining an instruction code recorded in a corresponding entity name field; and writing the instruction code in a designated field of a control message.

[0016] Optionally, the device control method may further include: providing a configuration form; for the control instruction to be configured, instructing the configuration personnel to fill in the instruction code of the control instruction in the entity name field and fill in the identification information of the control instruction in the synonym field.

[0017] Optionally, the device control method may further include: receiving a configuration request from a client-side routing device, the configuration request including specified content of identification information to be set as a specified control instruction.

[0018] Optionally, the configuration request is a voice configuration request.

[0019] Optionally, the device control method may further include: determining identification information of the user for the control instruction based on historical control requests of the user; or determining identification information of the control instruction based on historical control requests of multiple users.

[0020] Optionally, the device control method may also include: if the first identification information identified from the control request is not found in the recorded identification information, searching for second identification information similar to the first identification information in the recorded identification information; sending a prompt message on whether to execute the control instruction corresponding to the second identification information; and in response to a confirmation message confirming the execution of the control instruction corresponding to the second identification information, sending a control message, the designated field of the control message including the instruction code corresponding to the second identification information.

[0021] Optionally, the device control method may further include: recording the first identification information in association with the instruction code corresponding to the second identification information.

[0022] Optionally, the device control method may further include: extracting device information of a device targeted by the control instruction from the control request; and adding a device code of the device corresponding to the device information to the control message.

[0023] Optionally, the device control method may further include: setting specific identification information for a specific device; determining the specific device targeted by the control instruction based on the specific identification information identified from the control request; and adding a device code of the specific device in the control message.

[0024] Optionally, for different devices that are provided with the same instruction code, at least one different piece of identification information is respectively set for the same instruction code.

[0025] Optionally, the control request may be a voice control request.

[0026] Optionally, the instruction code may be a hexadecimal string.

[0027] Optionally, the control request comes from a client-side routing device, and the control message is sent to the client-side routing device.

[0028] Optionally, the device control method may also include: counting the number of times that the user's control request includes specified identification information; and determining a first value corresponding to the user and / or a second value corresponding to a third party based on the number of times, wherein the third party is a third party associated with the specified identification information.

[0029] According to a second aspect of the present disclosure, there is provided a device control method, comprising: extracting an instruction code recognizable by the device from a designated field of a received control message; and sending the instruction code to the device.

[0030] Optionally, the device control method may further include: receiving a control request and forwarding the control request to a server; and / or receiving a message and determining whether the message is a control message for the device.

[0031] Optionally, the device control method may further include: extracting a device code from a control message, wherein the instruction code is sent to a device corresponding to the device code.

[0032] According to a third aspect of the present disclosure, there is provided a device control method, comprising: in response to a control message, extracting an instruction code recognizable by the device from a specified field of the control message; and performing a device control operation based on the instruction code.

[0033] According to a fourth aspect of the present disclosure, a device control method is provided, comprising: receiving a configuration request, the configuration request including specified content to be set as identification information of a specified control instruction; and recording the specified content as identification information of the specified control instruction, and in association recording an instruction code of the control instruction, wherein the instruction code can be recognized by the device.

[0034] Optionally, the device control method may also include: providing a configuration form; for the control instruction to be configured, instructing the configuration personnel to fill in the instruction code of the control instruction in the entity name field, and fill in the identification information of the control instruction in the synonym field, wherein the entity name field is a field designed to record the entity name of the control instruction, and the synonym field is a field designed to record the synonyms of the entity name.

[0035] Optionally, the device control method may further include: receiving a configuration request from a client-side routing device.

[0036] Optionally, the configuration request is a voice configuration request.

[0037] Optionally, the device control method may further include: determining identification information of the user for the control instruction based on historical control requests of the user; or determining identification information of the control instruction based on historical control requests of multiple users.

[0038] Optionally, the device control method may also include: receiving a control request; identifying first identification information of the control instruction from the control request; if the first identification information is not found in the recorded identification information, searching for second identification information similar to the first identification information in the recorded identification information; sending a prompt message on whether to execute the control instruction corresponding to the second identification information; and in response to a confirmation message confirming the execution of the control instruction corresponding to the second identification information, recording the first identification information as the identification information of the control instruction corresponding to the second identification information.

[0039] According to a fifth aspect of the present disclosure, a device control method is provided, comprising: setting designated content as identification information of a designated control instruction for a device, and when a control request includes the designated content, sending an instruction code of the designated control instruction to the device; counting the number of times the designated content is included in the user's control request; and determining a first value corresponding to the user based on the number of times.

[0040] According to a sixth aspect of the present disclosure, a device control method is provided, comprising: setting designated content as identification information of a designated control instruction for a device, and sending an instruction code of the designated control instruction to the device when the designated content is included in a control request; counting the number of times the designated content is included in the user's control request; and determining a second value corresponding to a third party based on the number of times, where the third party is a third party associated with the designated content.

[0041] According to the seventh aspect of the present disclosure, a server for device control is provided, comprising: a recording device for recording an instruction code of the control instruction in association with identification information of the control instruction, wherein the instruction code can be recognized by the device; an identification device for identifying identification information of the control instruction from a control request; and a sending device for sending a control message, wherein a designated field of the control message includes the instruction code corresponding to the identification information.

[0042] According to an eighth aspect of the present disclosure, there is provided a device control apparatus, comprising: a code extraction apparatus for extracting an instruction code recognizable by the device from a specified field of a received control message; and a code sending apparatus for sending the instruction code to the device.

[0043] According to a ninth aspect of the present disclosure, a device is provided, comprising: a code extraction device for extracting an instruction code recognizable by the device from a specified field of a control message in response to a control message; and a code execution device for executing a device control operation based on the instruction code.

[0044] According to the tenth aspect of the present disclosure, an audio module is provided, comprising: a first communication module for receiving a control message; a processor for extracting an instruction code recognizable by a device from a specified field of the control message; and a second communication module connected to the device to communicate with the device and send an instruction code to the device.

[0045] Optionally, the audio module may also include: an audio input module for receiving voice, which is uploaded to a server for voice processing; and / or an audio output module for outputting audio data to an audio playback device when the first communication module receives audio playback data.

[0046] According to the eleventh aspect of the present disclosure, a device control system is provided, including a server and a device, wherein the server records an instruction code of the control instruction in association with identification information of the control instruction for the device, and the instruction code can be recognized by the device; the server identifies the identification information of the control instruction from a control request; and the server sends a control message, and a designated field of the control message includes the instruction code corresponding to the identification information.

[0047] Optionally, the device control system may further include: a control unit that receives a control message, extracts an instruction code recognizable by the device from a specified field of the received control message, and sends the instruction code to the device, and the device performs a device control operation based on the instruction code.

[0048] Optionally, the device extracts an instruction code recognizable to the device from a designated field of the control message, and performs a device control operation based on the instruction code.

[0049] According to a twelfth aspect of the present disclosure, a computing device is provided, comprising: a processor; and a memory on which executable codes are stored, and when the executable codes are executed by the processor, the processor executes the methods described in the first to sixth aspects above.

[0050] According to the thirteenth aspect of the present disclosure, a non-temporary machine-readable storage medium is provided, on which executable code is stored. When the executable code is executed by a processor of an electronic device, the processor executes the method described in the first to sixth aspects above.

[0051] As a result, voice control of the device can be achieved at a lower cost and with fewer changes to existing solutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The above and other objects, features and advantages of the present disclosure will become more apparent through a more detailed description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, wherein like reference numerals generally represent like components in the exemplary embodiments of the present disclosure.

[0053] Figure 1 A system architecture to which the device control solution of the present disclosure can be applied is shown.

[0054] Figure 2 A schematic flow chart of the device control method of the present disclosure is shown.

[0055] Figure 3 A schematic block diagram of a server of the present disclosure is shown.

[0056] Figure 4 A schematic block diagram of a device control apparatus of the present disclosure is shown.

[0057] Figure 5 A schematic block diagram of a controlled device in an embodiment of the present disclosure is shown.

[0058] Figure 6 A schematic block diagram of an audio module of the present disclosure is shown.

[0059] Figure 7 A common instruction configuration scheme is shown.

[0060] Figure 8 An instruction configuration scheme according to the present disclosure is shown.

[0061] Fig. 9 An intended configuration scenario is shown.

[0062] Fig.10 An example of a specific configuration of the intent of opening the instruction is shown.

[0063] Fig.11A schematic diagram of the structure of a computing device that can be used to implement the above-mentioned device control method according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0064] The preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the preferred embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0065] Figure 1 A system architecture to which the device control solution of the present disclosure can be applied is shown.

[0066] Figure 2 A schematic flow chart of the device control method of the present disclosure is shown.

[0067] like Figure 1 and Figure 2 As shown, configuration personnel, such as platform staff or customers (such as manufacturers or sellers of equipment) or equipment users, can log in to the server page of the control platform through a web page or APP to configure instructions and configure instructions on the server.

[0068] Figure 3 A schematic block diagram of a server of the present disclosure is shown.

[0069] like Figure 3 As shown, the server 300 of the present disclosure may include a recording device 310 , an identification device 320 , a search device 330 , and a sending device 340 .

[0070] During the configuration process, a configuration form may be provided to the configuration personnel, so that the configuration personnel can perform configuration on the platform web page, and record the entity name and synonyms of each control instruction and other related parameters in association with each controlled device.

[0071] like Figure 2 As shown, in step S210, the server, for example, through the recording device 310, records the instruction code of the control instruction in association with the entity name of the control instruction. The instruction code recorded here is an executable code that can be recognized by the device. The instruction code can be a hexadecimal string.

[0072] When configuring voice commands on the platform, there can be entity names and synonyms. The entity name corresponds to the textual representation of a voice command, for example, it can be the standard expression of the command. The synonym represents other textual representations corresponding to the voice command.

[0073] The instruction code may be recorded in the entity name field of the record table on the server, and the entity name may be recorded in the synonym field of the record table. In addition, the synonym field may also record the synonym of the entity name. Furthermore, any identification information that can be used to distinguish and identify the control instruction may be recorded in the synonym field.

[0074] The above describes an example of using entity names and synonym texts as identification information of control instructions. It should be understood that the identification information of control instructions may also include other various contents that can be used to express control intentions.

[0075] For example, such content may include meaningful speech or meaningless audio, and the control intention may be distinguished by its audio information.

[0076] For another example, such content may include user actions. For example, a user's action video may be collected, and the specified action performed by the user may be used as identification information of the control instruction. When it is detected that the user has performed the specified action, it may be considered that a control request with the specified action as identification information has been issued.

[0077] Here, the entity name field can be a field originally designed to record the entity name of the control instruction, and the synonym field can be a field originally designed to record the synonym of the entity name. In this way, there is no need to make underlying changes to the configuration scheme of the existing device control method. Only the content recorded in each field needs to be adjusted to achieve the effect of associating the instruction code of the control instruction with the identification information of the control instruction. Therefore, the control message sent can directly include the instruction code, and the client-side routing device can directly pass it to the corresponding device without the need for the client-side routing device to obtain the instruction code through operations such as parsing and looking up the table.

[0078] Reference below Figure 7 and Figure 8 Describe the difference between the instruction configuration scheme disclosed in the present invention and the common instruction configuration scheme.

[0079] Figure 7 A common instruction configuration scheme is shown.

[0080] For the control instruction to be configured, the configuration personnel may be instructed to fill in the instruction code of the control instruction in the entity name field and fill in the entity name of the control instruction in the synonym field.

[0081] like Figure 7 As shown, the corresponding Chinese of the control instruction, such as "close" / "open", is written in the entity name field, and other expressions corresponding to the control instruction, such as "turn off" / "open", is written in the synonym field.

[0082] Figure 8An instruction configuration scheme according to the present disclosure is shown.

[0083] like Figure 8 As shown, a command code that can be directly recognized by the client device is written in the entity name field. The command code can be an instruction code executable by the device, or in other words, an executable code of the device.

[0084] For example, the string corresponding to the hexadecimal number, for example, "0001" corresponds to the close instruction, and "0002" corresponds to the open instruction.

[0085] On the other hand, various expressions corresponding to the control instruction, i.e. identification information, are written into the synonym field, including Figure 7 Entity names and synonyms in the general schema shown.

[0086] For example, for a close instruction, write "close" and "turn off", and for an open instruction, write "open" and "turn on".

[0087] In addition, as mentioned above, the identification information may also include audio or motion information, etc.

[0088] Then, further configure the intent of the control instruction to call the corresponding entity, such as Fig. 9 and Fig.10 shown.

[0089] Fig. 9 shows the intent configuration scheme, Fig.10 An example of a specific configuration of the intent of opening the instruction is shown.

[0090] For instructions that need to be transparently transmitted to the device, a specific code can be added to the intent name, for example, the intent name can be set to start with "pass_". In this way, in response to the intent name in the received message having the specific code, the control module, control module or control unit connected to the device can forward the corresponding parameters or data in the message to the corresponding device.

[0091] For example, "pass_action_device" indicates that the intent is to pass data to a device.

[0092] Set up a common corpus to record the entity name corresponding to the control instruction intent, such as "open" and "device". In other words, multiple entity names are combined here to describe a control instruction intent.

[0093] When the end user says "open the device", this intent will be hit and converted into physical content and sent to the device.

[0094] As an example, Fig.10The corresponding parameters of the corpus "open" are shown, such as parameter name, associated entity, value, question statement, possible reply statement, default value and other information. Fig.10 As shown in the figure, "open" corresponds to the entity set "action", and the parameter name, associated entity, and value can all be set to "action". The corpus "device" can also be configured accordingly.

[0095] In this way, configuration personnel can directly configure voice commands and corresponding hexadecimal command strings that can be recognized by customer devices on the web, thereby meeting customer customization and personalized needs.

[0096] The above describes the instruction configuration scheme on the server side.

[0097] The following briefly describes the device control scheme based on the above instruction configuration.

[0098] return Figure 1 In addition to the server and the device as the control object, the control system of the present disclosure may also include an AI module, i.e., an artificial intelligence module, as a control module or a control unit. In some embodiments, the AI ​​module may be an audio module. In addition, the AI ​​module may also serve as a client-side routing device, uploading control requests for the device to the server and receiving control messages from the server.

[0099] The AI ​​module can be composed of a chip or a chip and a hardware PCB, and communicate with the artificial intelligence server through the network. Customers (such as equipment manufacturers) can communicate with the AI ​​module through wired or wireless communication.

[0100] The AI ​​module can integrate artificial intelligence voice solutions, integrating software and hardware. External devices can communicate with the AI ​​module through the serial port.

[0101] By adding this AI module, traditional equipment can be transformed into artificial intelligence equipment, thereby improving product competitiveness.

[0102] The AI ​​module may include a digital signal processor DSP and a microcontroller unit MCU.

[0103] like Figure 1 As shown, the device control system may also have a microphone. The microphone may also be included in the AI ​​module (audio module) as an audio input module (not shown in the figure) for receiving voice.

[0104] The audio input module is used to receive voice.

[0105] Users can speak into the microphone, such as "turn on the lights", "play the full moon", etc.

[0106] The microphone receives the user's voice and sends the voice data to the digital signal processor (DSP) for voice processing, which includes wake-up, noise cancellation, and voice detection (VAD).

[0107] return Figure 2 In step S110, after the DSP of the AI ​​module is awakened by detecting the awakening keyword, it performs voice processing on the received voice data. The DSP can also communicate directly with the server.

[0108] The DSP sends the subsequent voice data to the microcontroller unit (MCU) for processing.

[0109] In step S120, the MCU of the AI ​​module can upload the voice data to the server.

[0110] In other words, the AI ​​module can receive the user's voice control request and forward the control request to the server.

[0111] In step S220, the server receives the voice control request and identifies the identification information of the control instruction from the control request, for example, through the identification device 320. As described above, the identification information of the control instruction may include the entity name, synonyms, specified audio, specified action, etc. of the control instruction.

[0112] Here, the server recognizes the voice data and identifies the control instruction from the received voice data.

[0113] In step S230, the server searches for identification information from the synonym field of the record table, for example, through the search device 330. If found, the instruction code of the corresponding entity name field record is obtained. In this way, the instruction code can be written in the specified field of the control message.

[0114] Here, the server determines the instruction code corresponding to the control instruction according to the instruction configuration record. As mentioned above, the instruction code is a code that can be recognized and executed by the device that the user desires to control.

[0115] In this way, the server can convert the control request in the voice data into corresponding text and instructions. The text and instructions sent can be in the form of Json strings.

[0116] In step S240, the server, for example, through the sending device 340, sends a control message to the AI ​​module or device, and the designated field of the control message includes an instruction code corresponding to the identification information.

[0117] In addition, the control request may also include device information of the device desired to be controlled. The server may extract the device information of the device targeted by the control instruction from the control request, and add the device code of the device corresponding to the extracted device information to the control message.

[0118] In addition, the device to be controlled can also be distinguished by the identification information itself. For example, specific identification information can be set for a specific device. For example, for different devices with the same instruction code, at least one different identification information can be set for the same instruction code.

[0119] The server may determine the specific device to which the control instruction is directed based on the specific identification information identified from the control request, thereby adding the device code of the specific device to the control message.

[0120] In this way, the identification information can not only be used to identify the control instruction and obtain the instruction code, but also be used to determine which specific device among multiple similar devices is desired to be controlled.

[0121] Figure 4 A schematic block diagram of a device control apparatus of the present disclosure is shown.

[0122] like Figure 4 As shown, the device control apparatus 400 includes a code extracting device 410 and a code sending device 420 .

[0123] Figure 6 A schematic block diagram of an audio module of the present disclosure is shown.

[0124] like Figure 6 As shown, the audio module 600 may include a first communication module 610 , a processor 620 , and a second communication module 630 .

[0125] The first communication module 610 is used to receive a control message from the server 300 .

[0126] The processor 620 is configured to extract an instruction code recognizable by the device from a specified field of the control message.

[0127] The second communication module 630 is connected to the device to communicate with the device and send instruction codes to the device.

[0128] In addition, the processor 620 may also extract a device code from the control message to determine the device that is desired to be controlled this time, and instruct the second communication module 630 to send an instruction code to the device corresponding to the device code.

[0129] The processor 620 may include, for example, Figure 1 The MCU shown in the figure can have a protocol parsing module, a recording control module, a media playback module, and an instruction transmission module.

[0130] Figure 4 The device control device 400 shown may be included in Figure 6The code extracting device 410 may be included in a protocol parsing module or an instruction transparent transmission module, and the code sending device 420 may be included in an instruction transparent transmission module or a second communication module 630.

[0131] return Figure 2 In step S130 , the audio module receives a message from the server 300 , for example, through the first communication module 610 .

[0132] In response to receiving the message from the server, the protocol parsing module parses the message and determines the type of the received message in step S140 to determine whether the message is a control message for the device.

[0133] In the case of a control message, data needs to be passed through (transparently transmitted) to the device. In step S150, for example, the processor 620 of the audio module or the code extraction device 410 of the device control device 400 extracts the instruction code recognizable by the device from the specified field of the received control message.

[0134] As described above, the intent name of the intent field in the message that requires transparent data transmission can be set to contain a specific code at a specific position. When the intent name is detected to contain a specific code, such as starting with "pass_", it is determined that the intent of the message requires transparent data or parameters or instruction codes to be transmitted to the device.

[0135] Then, in step S160, the instruction code is sent (transmitted) to the device, for example, through the second communication module 630 of the audio module or the code sending device 420 of the device control device 400.

[0136] Devices, such as lights, receive command codes from the AI ​​module and perform corresponding device control operations based on the command codes.

[0137] As described above, the device may recognize the instruction code and may execute the code to perform a corresponding operation.

[0138] On the other hand, when the message is not a control message, corresponding processing is performed. For example, the audio module 600 may also have an audio output module (not shown in the figure). The audio output module is used to output audio data to the audio playback device when the first communication module receives audio playback data. The audio playback device can be, for example, a device capable of playing audio, such as a speaker, a sound box, or headphones. If the message is a music or prompt tone playback instruction, it is transferred to the "media playback" module, and then passed to the Codec to convert the digital signal into an analog audio signal, so that music or prompt tones are played through the audio output module, such as a speaker.

[0139] In addition, if the message involves recording control, the MCU can transfer the recording control instruction to the DSP to perform the corresponding control operation.

[0140] The following examples illustrate the differences between the control scheme of the present disclosure and the common scheme.

[0141] Set the wake-up word to "XXXX".

[0142] In the common scenario, the end user says "XXXX, turn on the device". After being processed by the server and sent down, the AI ​​module can receive the following string:

[0143] {"slots":[{"name":"action","domainSlot":"action:action","liveTime":0,"value":"open","norm":"open"}],"domain":"serial port transparent transmission","speechRecgText":"XXXX open device","intent":"pass_action_device"}.

[0144] where the value of the "norm" field corresponds to Figure 7 The content filled in the "Entity Name" field in is the entity name.

[0145] When parsing, you need to parse the intent pass_action_device and the value value inside it, for example, get the value of the "norm" field as "open".

[0146] Then, the AI ​​module can convert the parsed value "open" into a hexadecimal instruction code recognizable by the client device and then pass it to the client device.

[0147] Similarly, in a common solution, the end user says "XXXX, turn off the device". After being processed by the server and sent down, the AI ​​module can receive the following string:

[0148] {"slots":[{"name":"action","domainSlot":"action:action","liveTime":0,"value":"Close","norm":"Close"}],"domain":"Serial port transparent transmission","speechRecgText":"XXXX Close device","intent":"pass_action_device"}

[0149] You also need to reparse the intent pass_action_device and the value value inside it, for example, get the value "off" of the "norm" field.

[0150] Then, the AI ​​module converts the parsed value "close" into a hexadecimal instruction code recognizable by the client device and passes it to the client device.

[0151] In the control scheme disclosed in the present invention, the end user says "XXXX, turn on the device". After being processed by the server and sent down, the AI ​​module can receive the following string:

[0152] {"slots":[{"name":"action","domainSlot":"action:action","liveTime":0,"value":"Open","norm":"0002"}],"domain":"Serial port transparent transmission","speechRecgText":"XXXX open device","intent":"pass_action_device"}

[0153] where the value of the "norm" field corresponds to Figure 8 The content filled in the "Entity Name" field in is the instruction code "0002" of the open instruction.

[0154] The control scheme of this disclosure says "XXXX, turn off the device". After being processed by the server and sent down, the AI ​​module can receive the following string:

[0155] {"slots":[{"name":"action","domainSlot":"action:action","liveTime":0,"value":"Close","norm":"0001"}],"domain":"Serial port transparent transmission","speechRecgText":"XXXX Close device","intent":"pass_action_device"}

[0156] where the value of the "norm" field corresponds to Figure 8 The content filled in the "Entity Name" field in the command is the instruction code "0001" of the close instruction.

[0157] It is only necessary to specify that the intent of the pass-through instruction starts with "pass_". There is no need to parse what follows pass_, that is, there is no need to parse the specific intent pass_action_device and the value value inside, etc. Directly extract the string corresponding to "norm" to obtain the executable instruction code that the device can recognize, thereby completing the parsing.

[0158] Then, the extracted instruction code is directly transmitted to the corresponding device without any processing. After receiving the instruction code, the device can directly execute the operation corresponding to the control instruction.

[0159] Whether it is an AI module or a device, there is no need to further analyze or convert the command intent.

[0160] In this way, by adjusting the configuration plan during instruction configuration, the AI ​​module extracts the instruction segment marked with specific characters, and can extract the instruction code from the control message and directly transmit it to the device without modifying the AI ​​module, thereby achieving the purpose of completely separating user configuration and AI module, making platformization and scalability possible.

[0161] This solution targets the characteristics of custom skills currently provided by the server. Without modifying the server logic or affecting other shipped devices, it re-plans the configuration method of the user's web page on the platform and the device-side parsing method, so that the AI ​​module can directly pass executable instructions to the customer's external device. While meeting the differentiated needs of customers, the module side does not need to be modified, which provides a foundation for the platformization and scale of the module.

[0162] The above describes the control scheme in which the AI ​​module (audio module) receives control messages from the server, extracts instruction codes, and transmits them to the device.

[0163] In another embodiment, the device may receive a control message from a server, extract an instruction code from the control message, and perform a corresponding control operation.

[0164] Figure 5 A schematic block diagram of a controlled device in an embodiment of the present disclosure is shown.

[0165] like Figure 5 As shown, the device 500 includes a code extracting device 510 and a code executing device 520 .

[0166] In response to the control message, the code extracting means 510 extracts the instruction code recognizable by the device from a designated field of the control message.

[0167] The code execution device 520 executes the corresponding device control operation based on the extracted instruction code.

[0168] The method for configuring instructions in the device control scheme is further described below.

[0169] The above has described a solution for performing instruction configuration by issuing a configuration request by filling in a configuration page provided by the server.

[0170] In addition, command configuration may also be performed based on the user's configuration request, such as through a voice configuration request from a client-side routing device (such as the AI ​​module described below).

[0171] The audio input module on the client side, such as a microphone or a smart speaker, receives the user's configuration request, requesting that the identification information of the specified control instruction be set to the specified content.

[0172] For example, the user utters a voice “set the light on command to 'good evening'”. That is, it is desired to set the designated content “good evening” as the identification information of the light on control command.

[0173] Alternatively, when a camera is provided on the client side, the user may also make a designated action toward the camera, such as making an "OK" gesture with the right hand and waving toward the camera, etc., to request that the designated action be configured as identification information of the designated control instruction.

[0174] The client-side routing device may forward the configuration request to the server.

[0175] The server records the specified content as identification information of the above-mentioned specified control instruction, and records the instruction code of the control instruction in association. As mentioned above, the instruction code is an instruction code that can be recognized by the device.

[0176] In addition, the server can also determine the user's identification information for the control command based on the user's historical control requests. For example, the user has historically often used the voice control request "turn off the lights" to request to turn off the lights. When it is identified based on the user's historical control behavior that the user said "turn off the lights" and wanted to "turn off the lights", it can be determined that the user's identification information for the control command to turn off the lights is "turn off the lights". In this way, personalized instruction identification information can be identified, recorded in the above-mentioned synonym field, and stored in association with the instruction code of the control instruction. In the future, when the user issues a "turn off the lights" voice control command again, the server can recognize that the intention is to "turn off" the lights, and send a control message containing the instruction code of the control command to turn off the lights.

[0177] Alternatively, the server may also determine the identification information of the control instruction based on the historical control requests of multiple users (e.g., a large number of device users). For example, the identification information of the control instructions commonly used by a large number of users may be obtained, or the identification information of the control instructions commonly used by a certain region or a certain group of people may be identified. The obtained control instruction identification information is recorded in association with the instruction code of the control instruction, so that the instruction identification information can be easily expanded.

[0178] In addition, as described below, after receiving a control request from the client-side routing device, the server identifies the first identification information of the control instruction from the control request and searches for the first identification information in the recorded identification information.

[0179] If no second identification information is found, the second identification information similar to the first identification information can be searched in the recorded identification information. Here, "similar" can refer to similar meanings, such as synonyms, synonyms, or words containing the same or similar characters, or similar pronunciations, etc.

[0180] At this time, a prompt message may be sent to the client side asking whether to execute the control instruction corresponding to the second identification information.

[0181] If the user confirms to execute the control instruction corresponding to the second identification information, the client-side routing device may upload a confirmation message. In this way, it can be considered that the user desires to add the "first identification information" as the identification information of the control instruction corresponding to the second identification information, and the first identification information may be recorded in association with the instruction code of the control instruction corresponding to the second identification information. In other words, the second identification information may be added to the corresponding synonym field.

[0182] In this way, the control instruction identification information that the user expects to use can be easily expanded.

[0183] In addition, in addition to setting some contents representing control instructions that are frequently used by users as identification information and recording them in the synonym field, any desired content may also be set as identification information of the control instruction.

[0184] For example, the designated content of the identification information set as the control command may be a word or phrase indicating a certain mood ("happy", "want to cry") or a certain state ("it's getting dark").

[0185] In addition, the designated content may also be a statement set by the platform or a third party, for example, with a predetermined promotional effect, such as a designated advertising slogan.

[0186] In other words, a designated advertising slogan or promotional slogan can be set as identification information of a designated control instruction. For example, a user can be informed through a smart speaker or display screen that a corresponding control instruction can be issued by speaking the advertising slogan or promotional slogan to achieve a corresponding control purpose.

[0187] When the user speaks the advertising slogan or promotional slogan, the server can recognize that the user desires to execute the specified control instruction, and thus sends a corresponding control message to achieve the control purpose.

[0188] In this way, on the one hand, users can feel happy and be more willing to use this method to control the corresponding device. On the other hand, the corresponding advertising or publicity effect can be achieved more efficiently. The advertising slogans or publicity slogans actively spoken by users have a better advertising or publicity effect than those merely heard by the ears.

[0189] In addition, the number of times the user's control request includes the above-mentioned specified content, such as an advertising slogan or a promotional slogan, may also be counted.

[0190] On the one hand, a first value corresponding to the user, such as points, rewards, etc., can be determined based on the counted number of times, to encourage and stimulate the user to use this method to control the device more often.

[0191] On the other hand, when the designated content corresponds to a third party, such as an advertisement or slogan designated by a third party, a second value corresponding to the third party can be determined based on the counted number of times. The second value can, for example, reflect the contribution of the device control solution to the third party.

[0192] Fig.11 A schematic diagram of the structure of a computing device that can be used to implement the above-mentioned device control method according to an embodiment of the present invention is shown.

[0193] See also Fig.11 , the computing device 1100 includes a memory 1110 and a processor 1120 .

[0194] The processor 1120 may be a multi-core processor or may include multiple processors. In some embodiments, the processor 1120 may include a general-purpose main processor and one or more special coprocessors, such as a graphics processing unit (GPU), a digital signal processor (DSP), etc. In some embodiments, the processor 1120 may be implemented using a customized circuit, such as an application-specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[0195] The memory 1110 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. Among them, ROM can store static data or instructions required by the processor 1120 or other modules of the computer. The permanent storage device may be a readable and writable storage device. The permanent storage device may be a non-volatile storage device that does not lose the stored instructions and data even after the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (such as a magnetic or optical disk, flash memory) as a permanent storage device. In some other embodiments, the permanent storage device may be a removable storage device (such as a floppy disk, optical drive). The system memory may be a readable and writable storage device or a volatile readable and writable storage device, such as a dynamic random access memory. The system memory may store some or all instructions and data required by the processor at run time. In addition, the memory 1110 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and / or optical disks may also be used. In some embodiments, the memory 1110 may include a readable and / or writable removable storage device, such as a laser disc (CD), a read-only digital versatile disc (such as a DVD-ROM, a double-layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (such as an SD card, a mini SD card, a Micro-SD card, etc.), a magnetic floppy disk, etc. The computer-readable storage medium does not include carrier waves and transient electronic signals transmitted wirelessly or wired.

[0196] The memory 1110 stores executable codes, and when the executable codes are processed by the processor 1120 , the processor 1120 can execute the device control method mentioned above.

[0197] The device control scheme according to the present invention has been described above in detail with reference to the accompanying drawings.

[0198] In addition, the method according to the present invention may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing the above steps defined in the above method of the present invention.

[0199] Alternatively, the present invention may also be implemented as a non-temporary machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) on which executable code (or computer program, or computer instruction code) is stored. When the executable code (or computer program, or computer instruction code) is executed by a processor of an electronic device (or computing device, server, etc.), the processor executes the various steps of the above-mentioned method according to the present invention.

[0200] Those skilled in the art will further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or a combination of both.

[0201] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system and method according to multiple embodiments of the present invention. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or code, and the part of the module, program segment or code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0202] The embodiments of the present invention have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein are selected to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A device control method, include: Recording an instruction code of the control instruction in association with identification information of the control instruction, wherein the instruction code can be recognized by the device, wherein the instruction code is recorded in an entity name field of a record table, and the identification information is recorded in a synonym field of the record table, wherein the entity name field is a field designed to record the entity name of the control instruction, and the synonym field is a field designed to record the synonym of the entity name; Identification information for identifying the control instruction from the control request; and A control message is sent, wherein a designated field of the control message includes an instruction code corresponding to the identification information.

2. The device control method according to claim 1, in, The identification information includes at least one of the following: the name of the entity; said synonyms; Specify audio; Specify the action.

3. The device control method according to claim 1, further comprising: include: searching the identification information from the synonym field of the record table; If found, obtain the instruction code of the corresponding entity name field record; as well as The instruction code is written in a designated field of the control message.

4. The device control method according to claim 1, further comprising: include: Provide configuration tables; as well as For the control instruction to be configured, the configuration personnel are instructed to fill in the instruction code of the control instruction in the entity name field and fill in the identification information of the control instruction in the synonym field.

5. The device control method according to claim 1, further comprising: include: A configuration request from a client-side routing device is received, wherein the configuration request includes specified content of identification information to be set as a specified control instruction.

6. The device control method according to claim 5, in, The configuration request is a voice configuration request.

7. The device control method according to claim 1, further comprising: include: Determining identification information of the user for the control instruction based on the user's historical control requests; or Based on historical control requests of a plurality of users, identification information of the control instruction is determined.

8. The device control method according to claim 1, further comprising: include: If the first identification information identified from the control request is not found in the recorded identification information, searching the recorded identification information for second identification information similar to the first identification information; Sending a prompt message of whether to execute the control instruction corresponding to the second identification information; as well as In response to a confirmation message confirming execution of the control instruction corresponding to the second identification information, a control message is sent, wherein a designated field of the control message includes an instruction code corresponding to the second identification information.

9. The device control method according to claim 8, further comprising: include: The first identification information is recorded in association with the instruction code corresponding to the second identification information.

10. The device control method according to claim 1, further comprising: include: Extracting device information of the device targeted by the control instruction from the control request; as well as The device code of the device corresponding to the device information is added to the control message.

11. The device control method according to claim 1, further comprising: include: Set specific identification information for specific devices; determining the specific device to which the control instruction is directed based on the specific identification information identified from the control request; as well as A device code of the specific device is added to the control message.

12. The device control method according to claim 11, in, For different devices that are provided with the same instruction code, at least one different piece of identification information is respectively set for the same instruction code.

13. The device control method according to any one of claims 1 to 12, in, The control request is a voice control request.

14. The device control method according to any one of claims 1 to 12, in, The instruction code is a hexadecimal string.

15. The device control method according to any one of claims 1 to 12, in, The control request comes from a client-side routing device, and the control message is sent to the client-side routing device.

16. The device control method according to any one of claims 1 to 12, further comprising: include: Count the number of times the user's control request contains the specified identification information; as well as A first value corresponding to the user and / or a second value corresponding to a third party associated with the specified identification information is determined based on the number of times.

17. A device control method, include: Extracting an instruction code recognizable by the device from a designated field of a received control message, the control message being received from a server, the designated field corresponding to an entity name field in a record table of the server that is designed to record an entity name of a control instruction; and The instruction code is sent to the device.

18. The device control method according to claim 17, further comprising: include: receiving a control request and forwarding the control request to a server; and / or A message is received from the server, and it is determined whether the message is a control message for a device.

19. The device control method according to claim 17, further comprising: include: Extract the device code from the control message, Wherein, the instruction code is sent to the device corresponding to the device code.

20. A device control method, include: In response to the control message, extracting an instruction code recognizable by the device from a specified field of the control message, wherein the specified field corresponds to an entity name field in a record table of the server designed to record an entity name of the control instruction; and A device control operation is performed based on the instruction code.

21. A device control method, include: receiving a configuration request, the configuration request including specified content of identification information to be set as a specified control instruction; as well as Recording the specified content as identification information of the specified control instruction, and recording the instruction code of the control instruction in association, wherein the instruction code can be recognized by the device, Among them, the instruction code is recorded in the entity name field of the record table, and the identification information is recorded in the synonym field of the record table. The entity name field is a field designed to record the entity name of the control instruction, and the synonym field is a field designed to record the synonym of the entity name.

22. The device control method according to claim 21, further comprising: include: Provide configuration tables; For the control instruction to be configured, instruct the configuration personnel to fill in the instruction code of the control instruction in the entity name field and fill in the identification information of the control instruction in the synonym field. The entity name field is a field designed to record the entity name of the control instruction, and the synonym field is a field designed to record the synonym of the entity name.

23. The device control method according to claim 21, further comprising: include: The configuration request is received from a client-side routing device.

24. The device control method according to claim 23, in, The configuration request is a voice configuration request.

25. The device control method according to claim 21, further comprising: include: Determining identification information of the user for the control instruction based on the user's historical control requests; or Based on historical control requests of a plurality of users, identification information of the control instruction is determined.

26. The device control method according to claim 21, further comprising: include: receiving a control request; Identify first identification information of the control instruction from the control request; If the first identification information is not found in the recorded identification information, searching the recorded identification information for second identification information that is similar to the first identification information; Sending a prompt message of whether to execute the control instruction corresponding to the second identification information; as well as In response to a confirmation message confirming the execution of the control instruction corresponding to the second identification information, the first identification information is recorded as the identification information of the control instruction corresponding to the second identification information.

27. A device control method, include: The designated content is set as identification information of a designated control instruction for a device, and when the control request includes the designated content, an instruction code of the designated control instruction is sent to the device, wherein the instruction code is recorded in an entity name field of a record table, and the identification information is recorded in a synonym field of the record table, wherein the entity name field is a field designed to record an entity name of a control instruction, and the synonym field is a field designed to record a synonym of the entity name; Counting the number of times the specified content is included in the user's control request; A first value corresponding to the user is determined based on the number of times.

28. A device control method, include: The designated content is set as identification information of a designated control instruction for a device, and when the control request includes the designated content, an instruction code of the designated control instruction is sent to the device, wherein the instruction code is recorded in an entity name field of a record table, and the identification information is recorded in a synonym field of the record table, wherein the entity name field is a field designed to record an entity name of a control instruction, and the synonym field is a field designed to record a synonym of the entity name; Counting the number of times the specified content is included in the user's control request; A second value corresponding to a third party is determined based on the number of times, the third party being a third party associated with the designated content.

29. A server for device control, include: A recording device, used for recording an instruction code of the control instruction in association with identification information of the control instruction, wherein the instruction code can be recognized by the device, wherein the instruction code is recorded in an entity name field of a recording table, and the identification information is recorded in a synonym field of the recording table, wherein the entity name field is a field designed to record the entity name of the control instruction, and the synonym field is a field designed to record the synonym of the entity name; an identification device for identifying identification information of a control instruction from a control request; and The sending device is used to send a control message, wherein the designated field of the control message includes an instruction code corresponding to the identification information.

30. A device control device, include: a code extraction device, configured to extract an instruction code recognizable by the device from a designated field of a received control message, wherein the control message is received from a server, and the designated field corresponds to an entity name field in a record table of the server, which is designed to record an entity name of a control instruction; and The code sending device is used to send the instruction code to the device.

31. A device, include: A code extraction device, for extracting, in response to a control message, an instruction code recognizable by a device from a specified field of the control message, the specified field corresponding to an entity name field in a record table of the server designed to record an entity name of the control instruction; as well as The code execution device is used to execute the device control operation based on the instruction code.

32. An audio module, include: A first communication module, configured to receive a control message from a server; A processor, configured to extract an instruction code recognizable by a device from a designated field of the control message, wherein the designated field corresponds to an entity name field in a record table of the server, which is designed to record an entity name of a control instruction; as well as The second communication module is connected to the device to communicate with the device and send the instruction code to the device.

33. The audio module according to claim 32, further comprising: include: An audio input module, for receiving speech, which is uploaded to a server for speech processing; and / or The audio output module is used to output the audio data to the audio playback device when the first communication module receives the audio playback data.

34. A device control system, comprising a server and a device, The server records an instruction code of the control instruction in association with identification information of the control instruction for the device, wherein the instruction code can be recognized by the device. in, Recording the instruction code in an entity name field of a record table, and recording the identification information in a synonym field of the record table, wherein the entity name field is a field designed to record the entity name of the control instruction, and the synonym field is a field designed to record the synonym of the entity name; The server identifies identification information of the control instruction from the control request; and The server sends a control message, and a designated field of the control message includes an instruction code corresponding to the identification information.

35. The device control system according to claim 34, further comprising: include: a control unit, receiving the control message, extracting an instruction code recognizable by the device from a specified field of the received control message, and sending the instruction code to the device, The device performs a device control operation based on the instruction code.

36. The device control system according to claim 34, in, The device extracts an instruction code recognizable by the device from a designated field of the control message, and performs a device control operation based on the instruction code.

37. A computing device, include: processor; as well as A memory having executable codes stored thereon, which, when executed by the processor, causes the processor to perform the method according to any one of claims 1 to 28.

38. A non-transitory machine-readable storage medium having executable codes stored thereon, which, when executed by a processor of an electronic device, cause the processor to perform the method according to any one of claims 1 to 28.