Home appliance control methods, devices, remote controls, set-top boxes, and furniture equipment
By storing an offline command dictionary on the remote control and using the StarFlash module for fully offline control, the problem of home voice control failure caused by network congestion or Bluetooth instability is solved, enabling efficient control of home devices in the absence of network access and improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- CHINA MOBILEHANGZHOUINFORMATION TECH CO LTD
- Filing Date
- 2024-12-27
- Publication Date
- 2026-06-30
AI Technical Summary
In existing technologies, network congestion or unstable Bluetooth connections can cause home voice control to fail, resulting in a poor user experience.
The remote control stores an offline command dictionary, matches voice commands with the remote control itself, and outputs control commands to enable control of home devices in the absence of network. It uses the StarFlash module for fully offline control and transmits status synchronization information between the remote control and the control center to avoid duplicate commands.
Even without a network connection, voice control of home appliances is possible, improving the success rate of control and user experience, and avoiding repetitive operations by the devices.
Smart Images

Figure CN122316809A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of smart home technology, and in particular to a method, device, remote control, set-top box, and furniture control system for home appliances. Background Technology
[0002] With the continuous development of smart home technology, voice control has become increasingly common for smart home control.
[0003] Currently, the common method for home voice control is to use a remote control equipped with a Bluetooth module. The remote control relies on the network connection and Bluetooth connection between the Bluetooth module and the paired device (such as a set-top box, smart TV, etc.) to transmit the voice commands received by the remote control to the paired device via Bluetooth. The paired device then parses the voice commands and generates control commands to control the corresponding home devices.
[0004] However, if there is network congestion or unstable Bluetooth connection, home voice control will fail, resulting in a poor user experience. Summary of the Invention
[0005] This invention provides a home appliance control method, device, remote control, set-top box, and furniture device to solve the defects of existing technologies that cause home voice control failure due to network congestion or unstable Bluetooth connection, and to realize voice control of the remote control in a completely independent state where there is no network and no connection to the control center.
[0006] This invention provides a home appliance control method applied to a remote control, comprising: receiving a voice command input by a user; matching the voice command with an offline command dictionary to obtain a command word matching result; and, if the command word matching result is a match, outputting a first control command and status synchronization information; the first control command is used to instruct a target home appliance to perform an operation; the status synchronization information is used to instruct the control center not to output a second control command; and the second control command is determined by the control center based on the semantic parsing result of the voice command.
[0007] According to a home appliance control method provided by the present invention, when the command word matching result is a mismatch, the target home appliance performs an operation under the instruction of the second control command.
[0008] According to a home appliance control method provided by the present invention, the step of outputting a first control command includes: if it is determined based on the command word matching result that the target home appliance belongs to the Digital Home Alliance device, then outputting a first Star Flash command while the target home appliance is in a Star Flash connection state; if it is determined based on the command word matching result that the target home appliance does not belong to the Digital Home Alliance device, then outputting a first infrared command.
[0009] According to a home appliance control method provided by the present invention, the remote controller, the control center, and the target home appliance have the same data domain format; the data domain format includes, in sequence, a start packet format, a data packet format, and a receive packet format.
[0010] According to a home appliance control method provided by the present invention, the step of matching the voice command with an offline command dictionary to obtain command word matching results includes: classifying the voice command based on an onboard classification network to obtain classification words and their scores; sorting the classification words in descending order of scores, and extracting a preset number of classification words sequentially based on the sorting results; determining the intent corresponding to the preset number of classification words based on rule matching; and matching the preset number of classification words and their corresponding intents with the offline command dictionary to obtain the command word matching results.
[0011] The present invention also provides a home appliance control method applied in a control center, comprising: receiving status synchronization information; the status synchronization information being output by a remote control when the command word matching result is a match; the command word matching result being obtained by the remote control after matching a user-input voice command with an offline command word library; the status synchronization information being used to instruct the control center not to output a second control command; the second control command being determined by the control center based on the semantic parsing result of the voice command; the second control command being used to instruct a target home appliance to perform an operation; and when the command word matching result is a match, the target home appliance performs the operation under the instruction of a first control command output by the remote control.
[0012] According to a home appliance control method provided by the present invention, when the command word matching result is not a match, a second control command is output.
[0013] According to a home appliance control method provided by the present invention, the step of outputting a second control command includes: if it is determined based on the semantic parsing result that the target home appliance belongs to the Digital Home Alliance device, then outputting a second Star Flash command while the target home appliance is in a Star Flash connection state; if it is determined based on the semantic parsing result that the target home appliance does not belong to the Digital Home Alliance device, then outputting a second infrared command.
[0014] According to a home appliance control method provided by the present invention, the output of the second control command includes: if it is determined based on the semantic parsing result that the target home appliance belongs to a Digital Home Alliance device, then, when not in a StarFlash connection state with the target home appliance, broadcasting target device information so that other home appliances within the broadcast range can receive and parse the target device information, so that the target home appliance, when in a StarFlash connection state with the other home appliances, ultimately receives the second StarFlash command; the target device information carries the StarFlash connection information of the target home appliance and the second StarFlash command.
[0015] According to a home appliance control method provided by the present invention, before receiving the status synchronization information, the method further includes: outputting search failure status information if the search for the home appliance to be added based on the star connection information of the home appliance to be added fails; the star connection information is determined by the cloud server after analyzing the device addition request of the home appliance to be added; the search failure status information is used to instruct the cloud server to determine a first offline command model suitable for infrared home appliances; receiving and forwarding the first offline command model to the remote controller, so that the remote controller updates the offline command dictionary based on the first offline command model.
[0016] According to a home appliance control method provided by the present invention, before receiving the status synchronization information, the method includes: if the search for the home appliance to be added based on the StarFlash connection information of the home appliance to be added is successful, and the home appliance to be added is in a StarFlash connection state, outputting a support instruction acquisition request; the support instruction acquisition request is used to instruct the home appliance to be added to return a controlled device support instruction; if the controlled device support instruction is successfully received, outputting support success status information; the support success status information is used to instruct a cloud server to determine a second offline command model suitable for digital home alliance devices; receiving and forwarding the second offline command model to the remote controller, so that the remote controller updates the offline command dictionary based on the second offline command model.
[0017] According to a home appliance control method provided by the present invention, after the output support command acquisition request, the method further includes: outputting support failure status information in the event that the received support command for the controlled device fails; the support failure status information is used to instruct the cloud server to determine a first offline command model suitable for the infrared home appliance; receiving and forwarding the first offline command model to the remote controller, so that the remote controller updates the offline command dictionary based on the first offline command model.
[0018] This invention also provides a home appliance control method, applied to home appliances, the method comprising: receiving a first control command output by a remote control when the command word matching result is a match; the command word matching result is obtained by the remote control matching the user-input voice command with an offline command word library; and receiving a second control command output by a control center when the command word matching result is a mismatch; the second control command is determined by the control center based on the semantic parsing result of the voice command.
[0019] According to a home appliance control method provided by the present invention, the step of receiving the second control command output by the control center further includes: receiving the second Star Flash command forwarded by the control center through the other home appliances when the other home appliances are in a Star Flash connection state; the other home appliances are home appliances within the broadcast range of the target device information broadcast by the control center; the second Star Flash command is obtained by the other home appliances after receiving and parsing the target device information; the target device information is broadcast by the control center when it is not in a Star Flash connection state with the target home appliances.
[0020] The present invention also provides a home appliance control device, deployed in a remote control, comprising: The system includes a voice receiving module for receiving voice commands input by the user; a command word matching module for matching the voice commands with an offline command word library to obtain command word matching results; and a command sending module for outputting a first control command and status synchronization information when the command word matching result is a match. The first control command is used to instruct the target home appliance to perform an operation. The status synchronization information is used to instruct the control center not to output a second control command. The second control command is determined by the control center based on the semantic parsing result of the voice command.
[0021] The present invention also provides a remote control, comprising: the aforementioned home appliance control device deployed on the remote control and a first satellite flash module; the first satellite flash module is used to realize satellite flash connection between the remote control and the set-top box and home appliances.
[0022] The present invention also provides a home appliance control device, deployed in a control center, comprising: a synchronization information receiving module for receiving status synchronization information; the status synchronization information is output by the remote control when the command word matching result is a match; the command word matching result is obtained by the remote control after matching the user-input voice command with an offline command word library; the status synchronization information is used to instruct the control center not to output a second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command; the second control command is used to instruct the target home appliance to perform an operation; when the command word matching result is a match, the target home appliance performs the operation under the instruction of the first control command output by the remote control.
[0023] The present invention also provides a set-top box, including: the aforementioned home appliance control device deployed in the control center and a second satellite flash module; the second satellite flash module is used to realize satellite flash connection between the set-top box and the remote control and home appliances.
[0024] The present invention also provides a home appliance control device, deployed in a home appliance, comprising: an instruction receiving module, configured to receive a first control instruction output by a remote control when the command word matching result is a match; the command word matching result is obtained by the remote control matching a user-input voice instruction with an offline command word library; the instruction receiving module is further configured to receive a second control instruction output by a control center when the command word matching result is a mismatch; the second control instruction is determined by the control center based on the semantic parsing result of the voice instruction.
[0025] The present invention also provides a home appliance, including: the home appliance control device deployed on the home appliance and a third star flash module; the third star flash module is used to realize the star flash connection between the home appliance and the remote control and the set-top box.
[0026] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program to implement the home appliance control method as described above.
[0027] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the home appliance control method as described above.
[0028] The present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the home appliance control method as described above.
[0029] The home appliance control method, device, remote controller, set-top box, and furniture equipment provided by this invention utilize an offline command dictionary stored on the remote controller. First, the remote controller matches voice commands with the offline command dictionary. When a successful match is found with the target home appliance, the remote controller sends a first control command to control the target home appliance. Even in a completely independent state without network access or connection to a control center, voice control of home appliances can be achieved, improving the success rate of home appliance control, enabling rapid home appliance control, and enhancing the user experience. Furthermore, by simultaneously outputting status synchronization information to the control center while sending control commands to the target home appliance, the system instructs the control center not to send control commands to the target home appliance, preventing the target home appliance from repeatedly performing operations under the instructions of the first and second control commands. Attached Figure Description
[0030] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.
[0031] Figure 1 This is one of the flowcharts illustrating the home appliance control method provided by the present invention.
[0032] Figure 2 This is the second flowchart illustrating the home appliance control method provided by the present invention.
[0033] Figure 3 This is one of the flowcharts for adding home appliances provided by the present invention.
[0034] Figure 4 This is the second schematic diagram of the process for adding home appliances provided by the present invention.
[0035] Figure 5 This is the third flowchart of the process for adding home appliances provided by the present invention.
[0036] Figure 6 This is the third flowchart of the home appliance control method provided by the present invention.
[0037] Figure 7 This is one of the structural schematic diagrams of the home appliance control device provided by the present invention.
[0038] Figure 8 This is a schematic diagram of the structure of the remote control provided by the present invention.
[0039] Figure 9 This is the second structural schematic diagram of the home appliance control device provided by the present invention.
[0040] Figure 10 This is a schematic diagram of the set-top box provided by the present invention.
[0041] Figure 11 This is the third structural schematic diagram of the home appliance control device provided by the present invention.
[0042] Figure 12 This is a structural schematic diagram of the home appliance provided by the present invention.
[0043] Figure 13 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation
[0044] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.
[0045] It should be noted that, in the description of this invention, the term "comprising" or any other variations thereof is intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Those skilled in the art will understand the specific meaning of the above terms in this invention according to the specific circumstances.
[0046] The terms "first," "second," etc., used in this invention are used to distinguish similar objects, not to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class, without limiting the number of objects; for example, a first object can be one or more. Furthermore, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0047] The following is combined Figures 1-13 The present invention describes a home appliance control method, apparatus, remote control, set-top box, and furniture appliance.
[0048] Figure 1 This is one of the flowcharts illustrating the home appliance control method provided by the present invention, such as... Figure 1As shown, the home appliance control method is applied to a remote control, including but not limited to steps 101 to 103.
[0049] Step 101: Receive voice commands input by the user.
[0050] Step 102: Match the voice command with the offline command dictionary to obtain the command word matching result.
[0051] Step 103: If the command word matching result is a match, output the first control command and status synchronization information.
[0052] A control command is an instruction used to instruct a target home appliance to perform an operation. The first control command is output by the remote control and instructs the target home appliance to perform an operation; the second control command is output by the control center and instructs the target home appliance to perform an operation. In other words, the first control command is used to instruct the target home appliance to perform an operation; the second control command is used to instruct the target home appliance to perform an operation.
[0053] The status synchronization information is used to instruct the control center not to output the second control command; the second control command is determined by the control center based on the semantic parsing results of the voice command.
[0054] The offline command dictionary is stored in the remote control's hardware-based offline command module, which has a certain offline voice processing and recognition capability.
[0055] Target home appliances include, but are not limited to, air conditioners, televisions, stereos, refrigerators, table lamps, and other home appliances.
[0056] Specifically, when a user uses a remote control to control a target home appliance via voice, the remote control collects the user's voice commands, uses an offline command module to match the voice commands with an offline command dictionary, and obtains the command matching results corresponding to the target home appliance from the offline command dictionary.
[0057] Optionally, the remote control includes a microphone module for acquiring and encoding voice commands. For example, the microphone module acquires voice commands via a microphone.
[0058] If the offline command module successfully processes the voice command, the command word matching result will include the target home appliance's device type, control mode (such as infrared mode, Bluetooth mode, Star Flash mode, etc.), command information (such as digital alliance control commands, infrared commands), Star Flash connection information, etc. At this point, the command word matching result will not be empty, indicating that the command word matching result is a match.
[0059] Understandably, if the processing and recognition of voice commands exceeds the offline voice processing and recognition capabilities of the offline command module, the offline command module will fail to process the voice commands, resulting in an empty command word matching result, which also indicates that the command word matching result is not a match.
[0060] If the command word matching result is a match, the remote control determines the first control command based on the instruction information in the command word matching result, and determines the status synchronization information of successfully processing the offline voice command, so as to synchronize the status synchronization information with the control center. On the one hand, the remote control outputs the first control command through communication modules such as the flash module, infrared module, and Bluetooth module, which is received by the target home device and performs the operation under the instruction of the first control command; on the other hand, the remote control outputs status synchronization information through communication modules such as the flash module, which is received by the control center, and under the instruction of the status synchronization information, it does not output the second control command, so the target home device will not receive the second control command.
[0061] Understandably, if the control center does not receive status synchronization information, it will output a second control command.
[0062] The reason why the control center can output a second control command without receiving status synchronization information is that after the remote control receives the user's voice command, in addition to using the offline command module to match the voice command with the offline command dictionary, it also uses the communication module to send the voice command to the cloud server through the control center.
[0063] Optionally, while the offline command module matches the voice commands with the offline command dictionary, the communication module sends the voice commands to the control center.
[0064] Optionally, if the offline command module takes longer than a preset time to match the voice command with the offline command dictionary, the communication module will send the voice command to the control center.
[0065] After receiving a voice command, the cloud server performs precise speech recognition and parsing, generates a semantic analysis result, and returns the result to the control center. Because the cloud server can utilize more computing resources, its speech parsing capability is stronger than that of the offline command module. For voice commands that the offline module cannot parse successfully, the cloud server can perform precise semantic analysis.
[0066] Similarly, the semantic parsing results also include the target home appliance's device type, control mode (such as infrared mode, Bluetooth mode, star flash mode, etc.), command information (such as digital alliance control commands, infrared control commands), star flash connection information, and so on.
[0067] After receiving the semantic parsing results returned by the cloud server, the control center can determine the second control command based on the instruction information in the semantic parsing results and send the second control command to the target home device.
[0068] However, once the control center receives the status synchronization information, it means that the remote control itself is already capable of voice control of the furniture. Therefore, after receiving the status synchronization information, the control center will not output a second control command. The control command received by the target home appliance will only be the first control command from the remote control, thus avoiding the target home appliance from repeatedly performing operations under the instructions of the first and second control commands.
[0069] Optionally, after receiving the status synchronization information, the control center can achieve the effect of not outputting a second control command by ignoring the semantic parsing result returned by the cloud server.
[0070] Optionally, after receiving the status synchronization information, the control center generates a second control command based on the semantic parsing result but does not output the second control command, thereby achieving the effect of not outputting the second control command.
[0071] The home appliance control method provided by this invention stores an offline command dictionary on the remote control. First, the remote control itself matches voice commands with the offline command dictionary. When the remote control successfully matches a target home appliance, it sends a first control command to control the target home appliance. Even in a completely independent state without network access or connection to a control center, voice control of home appliances can be achieved, improving the success rate of home appliance control, enabling rapid home appliance control, and enhancing the user experience. By simultaneously outputting status synchronization information to the control center while sending control commands to the target home appliance, the method instructs the control center not to output control commands to the target home appliance, preventing the target home appliance from repeatedly performing operations under the instructions of the first and second control commands.
[0072] Based on the above embodiments, as an optional embodiment, if the command word matching result is not a match, the target home appliance performs the operation under the instruction of the second control command.
[0073] Specifically, when the command word matching result is a mismatch, the remote control naturally cannot generate and output status synchronization information and the first control command. At this time, the control program of the control center is not affected by the status synchronization information and can generate the second control command based on the semantic parsing result returned by the cloud server. Then, it outputs the second control command through the control center's own communication modules such as the star flash module, infrared module, and Bluetooth module, so that the home devices can receive the second control command and perform the operation, thereby realizing the user's voice control of the home devices.
[0074] Optionally, after the control center generates the second control command, it can directly send the second control command to the target home appliance so that the target home appliance can receive and respond to the first control command, thereby enabling the user to remotely control the home appliance via voice.
[0075] Optionally, after the control center generates the second control command, it first sends the second control command to the remote control, and then the remote control forwards the second control command to the target home device, so that the target home device receives and responds to the first control command, thereby enabling the user to remotely control the home device via voice.
[0076] The home appliance control method provided by this invention sends a second control command to control the target home appliance only when the remote control itself fails to match the target home appliance. This reduces the possibility of home appliance control failure due to network congestion or unstable communication connections, improves the success rate of home appliance control, and enhances the user experience. Furthermore, when the remote control itself fails to match the target home appliance, voice recognition is performed by the cloud server instead of the control center. This fully utilizes the cloud server's ability to access more computing resources to handle more complex tasks while avoiding the use of the control center's computing resources for voice recognition tasks. This improves the stability of communication between the control center and the remote control or home appliance, thereby increasing the success rate of home appliance control.
[0077] In one embodiment, the cloud server generates a semantic parsing result based on the voice command, including but not limited to the following steps: performing precise semantic parsing on the voice command to determine the home appliance information of the target home appliance; obtaining control command information of the target home appliance from the device database based on the home appliance information; and determining the semantic parsing result based on the home appliance information and the control command information.
[0078] Based on the above embodiments, as an optional embodiment, the output of the first control command includes: If the target home device is determined to belong to the Digital Home Alliance device based on the command word matching result, then the first Star Flash command is output when the target home device is in Star Flash connection state; If the target home device is determined not to belong to the Digital Home Alliance device based on the command word matching result, then the first infrared command is output.
[0079] Depending on the method of remote control, the first control command includes the first star flash command and the first infrared command.
[0080] StarScan technology is a short-range wireless communication technology used for data interaction in applications such as smart homes, smart cars, smart terminals, and smart manufacturing. A StarScan module consists of three parts: the StarScan access layer, the basic service layer, and the basic application layer. The StarScan access layer can also be referred to as the StarScan bottom layer, while the basic service layer and the basic application layer constitute the StarScan upper layer.
[0081] The SparkLink access layer is divided into management nodes (G nodes) and terminal nodes (T nodes) based on their functionalities. The G nodes provide access layer services such as connection management, resource allocation, and information security to the T nodes under their coverage. Considering the diverse transmission requirements of different business scenarios for short-range wireless communication, the SparkLink access layer currently provides two communication interfaces for the upper layer: SparkLink Basic (SLB) and SparkLink-LowEnergy (SLE).
[0082] SLB employs multiple technologies, including ultra-short frames, multi-point synchronization, two-way authentication, fast interference coordination, encryption protection, and cross-layer scheduling optimization, to support service scenarios with transmission requirements such as low latency (20µs), high reliability, precise synchronization, high concurrency, and high security. SLB information security defines the information security features required for secure communication between SLB devices, such as authentication credential configuration, authentication and security parameter negotiation, air interface communication security protection, and cryptographic algorithms, providing strong authentication and authorization as well as high-security transmission protection.
[0083] SLE employs Polar channel coding to improve transmission reliability, reduce retransmissions, and save power. It supports a maximum transmission bandwidth of 4MHz, a maximum of 8PSK modulation, one-to-many reliable multicast, 4kHz short-latency interaction, secure pairing, and privacy protection. While maximizing transmission efficiency, it also fully considers energy conservation, making it suitable for service scenarios with low power consumption requirements. SLE information security defines the information security features required for secure communication between SLE devices, such as pairing and authentication management, security control, privacy management, and cryptographic algorithms. It provides six pairing and authentication methods: digital comparison, input-free authentication, passcode input, password verification, out-of-band authentication, and pre-configured key PSK.
[0084] In home appliance control, the data communication content of the StarShine module includes, but is not limited to, voice commands, control command information, command word status information, remote control firmware upgrade information, remote control device information, and home appliance information.
[0085] Digital Home Alliance devices, also known as Digital Home Alliance Library home devices, are all equipped with a third Star Flash module, which enables Star Flash connection with remote controls equipped with a first Star Flash module and control centers equipped with a second Star Flash module, thereby realizing voice control of home devices based on Star Flash connection.
[0086] Among them, the first Star Flash module is the default terminal node, the second Star Flash module is the default management node, and the third Star Flash module is the default terminal node.
[0087] Specifically, the command word matching result obtained after the remote control processes the voice command locally includes the device type and command information of the target home appliance. This information, such as device type and command information, determines whether the target home appliance belongs to the Digital Home Alliance. If the target home appliance belongs to the Digital Home Alliance, it means that a third-party satellite flashing module is installed and supports satellite flashing remote control functionality. If the target home appliance does not belong to the Digital Home Alliance, it may mean that a third-party satellite flashing module is installed, but satellite flashing remote control functionality is not supported because it does not belong to the Digital Home Alliance; or it may mean that a third-party satellite flashing module is not installed. In either case, satellite flashing remote control is not possible, and only infrared remote control is possible.
[0088] If the target home device is determined not to belong to the Digital Home Alliance based on the command word matching result, the remote control determines the first infrared command as the first control command based on the command word matching result, and directly sends the first infrared command to the target home device to instruct the target home device to perform the operation, thereby realizing voice remote control of the home device in the form of infrared control.
[0089] If the target home device is determined to belong to the Digital Home Alliance based on the command word matching result, the remote control uses the first Star Flash module to search for the target home device according to the Star Flash connection information such as the home device node code in the command word matching result.
[0090] If the search is successful, the first Star Flash module changes from T node to G node, realizing the role change of the remote control, and establishes a Star Flash connection with the third Star Flash module on the target home device. This enables the remote control to output the first Star Flash command to the target home device while in a Star Flash connection state, thereby realizing voice remote control of the home device through Star Flash control.
[0091] If the search fails, it confirms that the StarFlash connection has failed, and the remote control will prompt the user with a voice notification regarding the remote control status.
[0092] Optionally, after receiving the first control command, the target home appliance will send a feedback command back to the remote control; the remote control, after issuing the first control command, will start a remote control timer and, based on the feedback command from the target home appliance, will prompt the user with a voice notification regarding the remote control status.
[0093] Optionally, the remote control uses different prompting methods (such as flashing indicator lights or a buzzer) to indicate different voice control statuses to the user. For example, when confirming that the StarFlash connection has failed, the remote control uses a flashing red light; when confirming that feedback instructions have been received from the target home appliance, the remote control uses a flashing green light; and when confirming that no feedback instructions have been received from the target home appliance within the timeout period, the remote control uses a buzzer.
[0094] The home appliance control method provided by this invention, by setting a star flash module on the remote control, utilizes the characteristic of star flash to transform from a terminal node to a management node, to achieve fully offline control of target home appliances controlled by infrared control and / or star flash control. It also enables fully offline and reliable star flash control of home appliances belonging to the Digital Home Alliance. Even in a completely independent state where the remote control has a weak network, no network, or is completely disconnected from the control center, voice control of home appliances can still be achieved, thereby improving the success rate of home control and enhancing the user experience.
[0095] Based on the above embodiments, as one example, the remote control, the control center, and the target home appliance have the same data domain format; The data field format includes, in sequence, the start packet format, the data packet format, and the receive packet format.
[0096] Specifically, when the target home device belongs to the Digital Home Alliance, in order to enable remote control, control center, etc. to control the Digital Home Alliance device via Star Flash, when performing Star Flash control based on the Star Flash module, the remote control, control center and target home device have the same data domain format. The data domain format includes the start packet format, data packet format and receive packet format in sequence, and all three formats are the same.
[0097] Table 1 is a field table of the starting packet format provided by the present invention. As shown in Table 1, the starting packet includes the following fields arranged in sequence: starting packet identifier field, file block start field, file length field, data block sequence number field, and check value field. The starting packet identifier field has a length of 1 byte, the file block start field has a length of 1 byte, the file length field has a length of 4 bytes, the data block sequence number field has a length of 1 byte, and the check value field has a length of 4 bytes.
[0098] Table 1
[0099] Table 2 is a field table of the data packet format provided by the present invention. As shown in Table 2, the data packet includes a data packet identifier field, a file content request code field, a data packet sequence number field, and a block file length field arranged in sequence. The field length of the data packet identifier field is 1 byte, the field length of the file content request code field is 1 byte, the field length of the data packet sequence number field is 2 bytes, and the field length of the block file length field is len-4 bytes.
[0100] Table 2
[0101] Table 3 is a field table of the received packet format provided by the present invention. As shown in Table 3, the received packet includes a received packet identifier field and a last packet request code field arranged in sequence. The field length of the received packet identifier field is 1 byte, and the field length of the last packet request code field is 1 byte.
[0102] Table 3
[0103] The home appliance control system provided by this invention enables control of data home alliance devices using a single remote control by setting the same start packet format, data packet format, and receive packet format for the remote control, control center, and home appliance flashing module, thereby improving the user's operating experience.
[0104] Based on the above embodiments, as an optional embodiment, the step of matching the voice command with an offline command dictionary to obtain command word matching results includes: The voice commands are classified based on the built-in classification network to obtain classification words and their scores; The classification words are sorted in descending order of their scores, and a preset number of classification words are extracted sequentially based on the sorting results. The intent corresponding to the preset number of category words is determined based on rule matching; The preset number of category words and their corresponding intents are matched with the offline command word library to obtain the command word matching results.
[0105] By formulating a series of rules and using these rules to combine command words to form effective control instructions, the rules include, but are not limited to, the order, number, and relationship of command words. Furthermore, different matching rules are specified according to different scenarios, and the combination and matching are performed with reference to scenarios, actions, device names, device locations, etc.
[0106] Specifically, after the user presses the voice button, the remote control's voice pickup module collects the voice command and extracts its voice features. After extraction, the features are input into the classification network pre-installed in the offline command module to classify the voice command and score and rank the classified words.
[0107] Taking the voice command "turn on the bedroom light" as an example, the classification network processes the classification words including "open, open, open bedroom, open bedroom, bedroom, bedroom light", and after scoring and sorting, it obtains the three top-ranked classification words "open, bedroom, light" based on the ranking results.
[0108] After classification is completed, a preset number of classification words are input into the rule matching network. Based on the rule matching, word slots are segmented and combined to determine the intent corresponding to each classification word.
[0109] For example, the intent corresponding to "open" is an action, the intent corresponding to "bedroom" is the location of the device, and the intent corresponding to "light" is the name of the device.
[0110] After completing the rule matching, a preset number of category words and their corresponding intents are matched with the offline command word library to obtain the command word matching results.
[0111] For example, retrieve the control instructions, control modes, and connection information corresponding to the light (home appliance) turned on (action) in the bedroom (location) from the offline command dictionary to obtain the command word matching results.
[0112] The home appliance control system provided by this invention improves the offline hit rate and control efficiency by using discrete multi-rule combination for hit detection when the remote control recognizes voice commands offline. Furthermore, by flexibly setting matching rules, it can perform a greater degree of generalization recognition, down to temperature, angle, gear, etc., thereby improving the success rate of home appliance control and enhancing the user's operating experience.
[0113] Figure 2 This is the second flowchart illustrating the home appliance control method provided by the present invention, as shown below. Figure 2 As shown, the home appliance control method is applied to a control center, including but not limited to step 201.
[0114] Step 201: Receive status synchronization information.
[0115] The status synchronization information is output by the remote control when the command word matching result is a match; the command word matching result is obtained by the remote control after matching the user's voice command with the offline command word library; The status synchronization information is used to instruct the control center not to output the second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command; the second control command is used to instruct the target home appliance to perform the operation. If the command word matching result is a match, the target home appliance will perform the operation under the instruction of the first control command output by the remote control.
[0116] It should be noted that the home appliance control method for the control center provided by the present invention corresponds to the home appliance control method for the remote control in any of the above embodiments in specific implementation, and will not be described in detail in this embodiment.
[0117] The home appliance control method provided by this invention stores an offline command dictionary on the remote control. First, the remote control itself matches voice commands with the offline command dictionary. When the remote control successfully matches a target home appliance, it sends a first control command to control the target home appliance. Even in a completely independent state without network access or connection to a control center, voice control of home appliances can be achieved, improving the success rate of home appliance control, enabling rapid home appliance control, and enhancing the user experience. By simultaneously outputting status synchronization information to the control center while sending control commands to the target home appliance, the method instructs the control center not to output control commands to the target home appliance, preventing the target home appliance from repeatedly performing operations under the instructions of the first and second control commands.
[0118] Based on the above embodiments, as an optional embodiment, the home appliance control method applied to the control center further includes: If the command word matching result is not a match, a second control command is output.
[0119] Specifically, when the command word matching result is a mismatch, the remote control naturally cannot generate and output status synchronization information and the first control command. At this time, the control program of the control center is not affected by the status synchronization information and can generate the second control command based on the semantic parsing result returned by the cloud server. Then, it outputs the second control command through the control center's own communication modules such as the star flash module, infrared module, and Bluetooth module, so that the home devices can receive the second control command and perform the operation, thereby realizing the user's voice control of the home devices.
[0120] Optionally, after the control center generates the second control command, it can directly send the second control command to the target home appliance so that the target home appliance can receive and respond to the first control command, thereby enabling the user to remotely control the home appliance via voice.
[0121] Optionally, after the control center generates the second control command, it first sends the second control command to the remote control, and then the remote control forwards the second control command to the target home device, so that the target home device can receive and respond to the second control command, thereby enabling the user to remotely control the home device via voice.
[0122] The home appliance control method provided by this invention sends a second control command to control the target home appliance only when the remote control itself fails to match the target home appliance. This reduces the possibility of home appliance control failure due to network congestion or unstable communication connections, improves the success rate of home appliance control, and enhances the user experience. Furthermore, when the remote control itself fails to match the target home appliance, voice recognition is performed by the cloud server instead of the control center. This fully utilizes the cloud server's ability to access more computing resources to handle more complex tasks while avoiding the use of the control center's computing resources for voice recognition tasks. This improves the stability of communication between the control center and the remote control or home appliance, thereby increasing the success rate of home appliance control.
[0123] Based on the above embodiments, as an optional embodiment, the output of the second control command includes: If the semantic parsing result determines that the target home device belongs to the Digital Home Alliance, then a second Star Flash command is output when the target home device is in a Star Flash connection state. If the semantic parsing result determines that the target home device does not belong to the Digital Home Alliance device, then a second infrared command is output.
[0124] When using the StarFlash module to enable communication between the control center and remote control / home appliances, the control center is equipped with a second StarFlash module that is set as the G node by default.
[0125] Specifically, after receiving the semantic parsing results from the cloud server, the control center obtains information including whether the target home device is a Digital Home Alliance device. The result parsing module analyzes the semantic parsing results to determine whether the target home device belongs to the Digital Home Alliance.
[0126] If the target home device is not a Digital Home Alliance device, it means that the target home device and the control center do not support the Star Flash control function. In this case, the control center uses the semantic parsing result to generate a second infrared command and sends it to the target home device. The target home device receives and responds to the second infrared command, thereby enabling the control center to remotely control the home device by voice when the remote control cannot successfully process the voice command.
[0127] If the target home appliance is a Digital Home Alliance device, it means that the target home appliance and the control center support the Star Flash control function. The second Star Flash module establishes a Star Flash connection with the third Star Flash module of the target home appliance, realizing the Star Flash connection between the control center and the target home appliance. When the control center and the target home appliance are in the Star Flash connection state, the control center sends a second Star Flash command, which is received and responded to by the target home appliance through the third Star Flash module. Thus, when the remote control cannot successfully process the voice command, the control center can realize voice remote control of the home appliance through Star Flash control.
[0128] Optionally, the situation where the target home device and the control center do not support the Star Flash control function includes both the situation where the target home device does not have a third Star Flash module and the situation where the target home device has a third Star Flash module but has not joined the Digital Home Alliance.
[0129] The home appliance control system provided by this invention determines whether the target home appliance belongs to the Digital Home Alliance device during the process of generating the second control command based on the semantic parsing results in the control center. It then generates a star flash command or an infrared command to achieve voice control of the home appliance. Furthermore, the process of the control center generating different control commands based on the semantic parsing results is imperceptible to the user, requiring no additional operation from the user. It can also achieve different modes of voice control for different home appliances, thereby improving the success rate of home control and enhancing the user experience.
[0130] Based on the above embodiments, as an optional embodiment, the output of the second control command includes: If the semantic parsing result determines that the target home device belongs to the Digital Home Alliance, then when the target home device is not in a StarFlash connection state, the target device information is broadcast so that other home devices within the broadcast range can receive and parse the target device information, so that when the target home device is in a StarFlash connection state with the other home devices, it will eventually receive the second StarFlash command; the target device information carries the StarFlash connection information of the target home device and the second StarFlash command.
[0131] Specifically, after the control center analyzes the semantic parsing results returned by the cloud server and determines that the target home device belongs to the Digital Home Alliance, it can control the target home device through the Star Flash mode. At this time, the control center is required to establish a Star Flash connection with the target home device.
[0132] However, control centers are often fixed in a certain location. Due to factors such as excessive communication distance and mismatched communication frequencies, the second satellite flash module may not be able to establish a satellite flash connection with the third satellite flash module. In this case, other methods are needed to enable the control center to control the target home devices.
[0133] If the control center cannot establish a StarFlash connection with the target home device, that is, based on the semantic parsing results, it is determined that the target home device belongs to the Digital Home Alliance and is not in a StarFlash connection state with the target home device, the control center uses the target home device's device type, control mode (such as infrared mode, Bluetooth mode, StarFlash mode, etc.), command information (such as Digital Alliance control commands, infrared commands), StarFlash connection information, etc. obtained from the semantic parsing results to generate target device information for the target home device, and broadcasts the target device information through the second StarFlash module. Other home devices within the broadcast range of the second StarFlash module will receive the target device information through the third StarFlash module.
[0134] After receiving the target device information, other home appliances parse the target device information to obtain the target home appliance's Star Flash connection information and the second Star Flash command used to control the target home appliance.
[0135] Furthermore, other home appliances, through their third StarFlash module, use the parsed StarFlash connection information to search for the target home appliance. If the search is successful, the third StarFlash module of the other home appliance changes from a T-node to a G-node, realizing a role reversal. Then, a StarFlash connection is established between the third StarFlash modules of the other home appliance and the target home appliance. While the other home appliance and the target home appliance are in a StarFlash connection state, the other home appliance sends a second StarFlash command to the target home appliance, so that the target home appliance can ultimately receive the second StarFlash command and realize voice control of the target home appliance.
[0136] The home appliance control method provided by this invention, by setting up a StarFlash module on the home appliance, allows the control center to establish a StarFlash connection with the target home appliance and forward the second control command when the control center is unable to send a second control command to the target home appliance due to factors such as excessive communication distance or communication frequency mismatch. As long as any other home appliance within the StarFlash broadcast range can establish a StarFlash connection with the target home appliance, the control center can achieve voice control of the target home appliance in StarFlash mode, greatly improving the success rate of home appliance control. Furthermore, the process of the control center achieving StarFlash control of the target home appliance through other home appliances is imperceptible to the user, but the user can achieve unified control of all smart home appliances in the house using a single remote control, which can increase the frequency of remote control use, increase the convenience of interaction, and thus enhance user interaction stickiness and home control experience.
[0137] Based on the above embodiments, as an optional embodiment, before receiving the state synchronization information, the method further includes: If the search for the home device to be added based on the StarFlash connection information fails, a search failure status message is output; the StarFlash connection information is determined by the cloud server after analyzing the device addition request of the home device to be added; the search failure status message is used to instruct the cloud server to determine the first offline command model suitable for the infrared home device. The first offline command model is received and forwarded to the remote controller, so that the remote controller updates the offline command dictionary based on the first offline command model.
[0138] The first offline command model refers to the offline command model applicable to infrared home devices.
[0139] Specifically, Figure 3 This is one of the flowcharts illustrating the process of adding home appliances provided by the present invention, such as... Figure 3 As shown, before you can use voice control to control home appliances, you need to add the command words for the home appliances to the offline command dictionary of the remote control's offline command module. In other words, you need to complete the process of adding home appliances.
[0140] Users initiate a device addition request using the remote control. This request is forwarded from the control center to the cloud server. Upon receiving the request, the cloud server analyzes it to obtain information such as the device manufacturer, type, and model of the device. Based on this information, it retrieves full device information for the device from the cloud device database to determine its StarFlash connection information. The cloud server then returns this full device information, including the StarFlash connection information, to the control center.
[0141] After receiving the complete device information for the home appliances to be added, the second StarFlash module in the control center searches for the home appliances to be added as StarFlash terminal nodes based on StarFlash connection information such as home appliance node codes and home appliance models. If the search fails, it means that the home appliance to be added is a regular infrared device, and the control center sends a search failure status message to the cloud server.
[0142] After receiving and responding to the search failure status information, the cloud server determines that the home device to be added is an infrared device, and generates a first offline command model based on the infrared device and applicable to infrared devices, according to the full device information of the home device to be added.
[0143] The cloud server returns the first offline command model to the control center, which then forwards it to the remote control. The remote control's offline command module updates the offline command dictionary stored locally on the remote control based on the first offline command model, thus completing the addition operation of the home device to be added.
[0144] The updated offline command dictionary includes, but is not limited to, device types, device names, device commands, control modes, infrared control commands, digital home alliance control commands, and StarFlash connection information for home devices.
[0145] In one embodiment, the offline command module has an initial offline command dictionary, where each command term should have a clear semantic meaning and function. Commonly used command terms include on, off, toggle, adjust lights, etc.
[0146] Taking an air conditioner as an example of a home appliance to be added, after updating the offline command module using the offline command model generated by the cloud server, the offline command dictionary will include the device name "air conditioner", common command words such as "setting, temperature, mode, fan speed, increase, decrease", device location such as "living room, bedroom, kitchen", scene name such as "coming home, leaving home, watching a movie", etc.
[0147] The home appliance control method provided by this invention generates an offline command model for infrared devices based on whether the added home appliance is an infrared device or not when adding the device, and uses the offline command model for infrared devices to update the offline command dictionary. This improves the speed and accuracy of the offline command module matching voice commands in the home appliance and control process, thereby increasing the success rate of infrared device home appliance control and enhancing the user experience.
[0148] Based on the above embodiments, as an optional embodiment, before receiving the status synchronization information, the following steps are included: If the search for the home device to be added is successful based on the Star Flash connection information of the home device to be added, and the home device to be added is in a Star Flash connection state, a support instruction acquisition request is output; the support instruction acquisition request is used to instruct the home device to be added to return a controlled device support instruction. Upon successful receipt of the controlled device support command, a support success status message is output; the support success status message is used to instruct the cloud server to determine a second offline command model suitable for the Digital Home Alliance device; The second offline command model is received and forwarded to the remote controller, so that the remote controller updates the offline command dictionary based on the second offline command model.
[0149] The second offline command model refers to the offline command model applicable to Digital Home Alliance devices.
[0150] Specifically, Figure 4 This is the second schematic diagram of the process for adding home appliances provided by the present invention, such as... Figure 4 As shown, during the process of adding home devices, if the control center successfully searches for the home device to be added as a StarFlash terminal node after receiving all device information of the device to be added, based on the StarFlash connection information, it means that the home device to be added is a StarFlash device with StarFlash functionality. However, at this point, it cannot be determined whether the home device to be added belongs to the Digital Home Alliance. If the home device to be added does not belong to the Digital Home Alliance, voice control of the home device to be added cannot be achieved through StarFlash control.
[0151] Therefore, when the second Star Flash module in the control center finds the home appliance to be added, it establishes a Star Flash connection with the Star Flash module (third Star Flash module) of the home appliance to be added, confirms that the second Star Flash module and the home appliance to be added are in a Star Flash connection state, and sends a support command acquisition request to the home appliance to be added.
[0152] Furthermore, if the home device to be added belongs to the Digital Home Alliance, then after receiving the support instruction request, the home device to be added will return a controlled device support instruction; if the home device to be added does not belong to the Digital Home Alliance, then the home device to be added will not be able to receive the support instruction request and return a controlled device support instruction.
[0153] If the control center successfully receives the controlled device support instruction from the home device to be added, it means that the home device to be added belongs to the Digital Home Alliance. Then the control center sends a support success status message to the cloud server.
[0154] The cloud server receives and responds with a support success status message, determines that the home device to be added belongs to the Digital Home Alliance, and generates a second offline command model based on the StarFlash device and applicable to Digital Home Alliance devices, according to the full device information of the home device to be added.
[0155] The cloud server returns the second offline command model to the control center, which then forwards it to the remote control. The remote control's offline command module updates the offline command dictionary stored locally on the remote control based on the second offline command model, thus completing the addition of the home device to be added.
[0156] The home appliance control system provided by this invention generates an offline command model for digital home alliance devices based on whether the added home appliance is a digital home alliance device or not, and uses the offline command model for digital home alliance devices to update the offline command dictionary. This improves the speed and accuracy of the offline command module matching voice commands in the home appliance and control process, thereby increasing the success rate of home appliance control of digital home alliance devices and enhancing the user experience.
[0157] Based on the above embodiments, as an optional embodiment, after the output support instruction acquisition request, the method further includes: If the controlled device fails to receive a support command, a support failure status message is output; the support failure status message is used to instruct the cloud server to determine a first offline command model suitable for the infrared home device. The first offline command model is received and forwarded to the remote controller, so that the remote controller updates the offline command dictionary based on the first offline command model.
[0158] Specifically, Figure 5 This is the third flowchart of the process for adding home appliances provided by the present invention, such as... Figure 5 As shown, after the control center sends a support command request to the home appliance to be added, if the control center fails to receive the controlled device support command returned by the home appliance to be added (i.e., no controlled device support command is received), it means that although the home appliance to be added supports the Star Flash function, it is not a digital home alliance device and can only be controlled by voice via infrared control. At this time, the control center sends a support failure status information to the cloud server.
[0159] The cloud server receives and responds with support failure status information, determines that the home device to be added is an infrared device, and generates a first offline command model based on infrared devices and applicable to infrared devices based on the full device information of the home device to be added.
[0160] The cloud server returns the first offline command model to the control center, which then forwards it to the remote control. The remote control's offline command module updates the offline command dictionary stored locally on the remote control based on the first offline command model, thus completing the addition operation of the home device to be added.
[0161] The home appliance control method provided by this invention generates an offline command model suitable for infrared devices for home appliances with star flash functionality but not belonging to the Digital Home Alliance. The offline command dictionary is updated using the offline command model for infrared devices. This improves the speed and accuracy of the offline command module in the home appliance and control process in controlling home appliances with star flash functionality but not belonging to the Digital Home Alliance, thereby increasing the success rate of home appliance control for Digital Home Alliance devices and enhancing the user experience.
[0162] Based on the above embodiments, as an optional embodiment, the remote control includes a rotatable camera module; the device addition request includes a device image of the home appliance to be added; The camera module is used to capture images of the device.
[0163] Specifically, when a user initiates a device addition request using a remote control, the user uses the rotatable camera module attached to the remote control to rotate the camera to the back of the remote control and take pictures of the model, device QR code, product serial number, and complete shape of the device to be added, obtaining a device image of the device to be added. The captured device image, along with other information, is used to generate a device addition request, which is then transmitted to the control center and forwarded to the cloud server through the first star flash module.
[0164] When the cloud server receives a device addition request, it performs feature extraction and analysis on the device image to obtain key information about the home appliance to be added. Based on this key information, it extracts the full device information of the home appliance to be added from the device database to perform subsequent home appliance addition operations.
[0165] The home appliance control system provided by this invention improves the flexibility and operability for users when adding home appliances using the remote control by setting a camera on the remote control, thereby enhancing the user's operating experience.
[0166] Figure 6 This is the third flowchart of the home appliance control method provided by the present invention, as shown below. Figure 6 As shown, the home appliance control method is applied to home appliances, including but not limited to steps 601 and 602.
[0167] Step 601: If the command word matching result is a match, receive the first control command output by the remote control.
[0168] The command word matching result is obtained by the remote control matching the user's voice command with the offline command word library.
[0169] Step 602: If the command word matching result is not a match, receive the second control command output by the control center.
[0170] The second control command is determined by the control center based on the semantic parsing result of the voice command.
[0171] It should be noted that the home appliance control method provided by the present invention, when specifically implemented, corresponds to the home appliance control method applied to the remote control in any of the above embodiments, or to the home appliance control method applied to the control center in any of the above embodiments. This embodiment will not elaborate on this aspect.
[0172] The home appliance control method provided by this invention stores an offline command dictionary on the remote control. First, the remote control itself matches voice commands with the offline command dictionary. When the remote control successfully matches a target home appliance, it sends a first control command to control the target home appliance. Even in a completely independent state without network access or connection to a control center, voice control of home appliances can be achieved, improving the success rate of home appliance control, enabling rapid home appliance control, and enhancing the user experience. By simultaneously outputting status synchronization information to the control center while sending control commands to the target home appliance, the method instructs the control center not to output control commands to the target home appliance, preventing the target home appliance from repeatedly performing operations under the instructions of the first and second control commands.
[0173] Based on the above embodiments, as an optional embodiment, the receiving of the second control command output by the control center further includes: When connected to other home appliances via StarFlash, receive a second StarFlash command forwarded by the control center through the other home appliances; The other home devices are those within the broadcast range of the target device information broadcast by the control center; the second Star Flash command is obtained by the other home devices after receiving and parsing the target device information; the target device information is broadcast by the control center when it is not in a Star Flash connection state with the target home device.
[0174] The home appliance control method provided by this invention, by setting up a StarFlash module on the home appliance, allows the control center to establish a StarFlash connection with the target home appliance and forward the second control command when the control center is unable to send a second control command to the target home appliance due to factors such as excessive communication distance or communication frequency mismatch. As long as any other home appliance within the StarFlash broadcast range can establish a StarFlash connection with the target home appliance, the control center can achieve voice control of the target home appliance in StarFlash mode, greatly improving the success rate of home appliance control. Furthermore, the process of the control center achieving StarFlash control of the target home appliance through other home appliances is imperceptible to the user, but the user can achieve unified control of all smart home appliances in the house using a single remote control, which can increase the frequency of remote control use, increase the convenience of interaction, and thus enhance user interaction stickiness and home control experience.
[0175] Based on the above embodiments, as an optional embodiment, after receiving the first control command output by the remote controller, or after receiving the second control command output by the control center, the home appliance sends a feedback command indicating successful reception of the first control command or the second control command; the feedback command is used to instruct the remote controller to terminate the remote control timer indicating control failure.
[0176] Specifically, after receiving the first or second control command, the home appliance sends a feedback command indicating that the control command has been successfully received.
[0177] Furthermore, the control center receives the feedback command and forwards it to the remote control, triggering the remote control to stop the remote control timer. Based on the feedback command from the target home appliance, the system returns a status update and prompts the user regarding the voice control status.
[0178] Alternatively, the remote control can directly receive feedback commands, thereby triggering the remote control to terminate the remote control timer.
[0179] The home appliance control method provided by this invention improves the user's home control experience by sending a feedback instruction after receiving a control instruction, controlling the remote control to stop the remote control timer after receiving the feedback instruction, and accurately providing feedback to the user on the control status of the target home appliance.
[0180] Figure 7 This is one of the structural schematic diagrams of the home appliance control device provided by the present invention, such as... Figure 7 As shown, the home appliance control device is deployed on the remote control, including but not limited to a voice receiving module 701, a command word matching module 702, and an instruction sending module 703.
[0181] The voice receiving module 701 is used to receive voice commands input by the user.
[0182] The command word matching module 702 is used to match the voice command with an offline command word library to obtain the command word matching result.
[0183] The instruction sending module 703 is used to output a first control instruction and status synchronization information when the command word matching result is a match.
[0184] The first control command is used to instruct the target home appliance to perform an operation; the status synchronization information is used to instruct the control center not to output the second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command.
[0185] It should be noted that the home appliance control device deployed on the remote control provided by the present invention can execute the home appliance control method applied to the remote control as described in any of the above embodiments during specific operation, which will not be elaborated in this embodiment.
[0186] The home appliance control device provided by this invention stores an offline command dictionary on the remote control. First, the remote control itself matches voice commands with the offline command dictionary. When the remote control successfully matches a target home appliance, it sends a first control command to control the target home appliance. Even in a completely independent state without network access or connection to a control center, voice control of home appliances can be achieved, improving the success rate of home control, enabling rapid home control, and enhancing the user experience. By simultaneously outputting status synchronization information to the control center while sending control commands to the target home appliance, the device instructs the control center not to output control commands to the target home appliance, preventing the target home appliance from repeatedly performing operations under the instructions of the first and second control commands.
[0187] Figure 8 This is a schematic diagram of the structure of the remote control provided by the present invention, as shown below. Figure 8 As shown, the remote control includes the home appliance control device 801 and the first star flash module 802 deployed on the remote control as described in any of the above embodiments.
[0188] The first star flash module 802 is used to realize the star flash connection between the remote control and the set-top box and home appliances.
[0189] Figure 9 This is a second structural schematic diagram of the home appliance control device provided by the present invention, as shown below. Figure 9 As shown, the home appliance control device is deployed in the control center, including but not limited to the synchronization information receiving module 901.
[0190] The synchronization information receiving module 901 is used to receive status synchronization information.
[0191] The status synchronization information is output by the remote control when the command word matching result is a match; the command word matching result is obtained by the remote control after matching the user's voice command with the offline command word library.
[0192] The status synchronization information is used to instruct the control center not to output the second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command; the second control command is used to instruct the target home device to perform an operation.
[0193] If the command word matching result is a match, the target home appliance performs the operation under the instruction of the first control command output by the remote control.
[0194] It should be noted that the home appliance control device deployed in the control center provided by the present invention can execute the home appliance control method applied to the control center as described in any of the above embodiments during specific operation, which will not be elaborated in this embodiment.
[0195] The home appliance control device provided by this invention stores an offline command dictionary on the remote control. First, the remote control itself matches voice commands with the offline command dictionary. When the remote control successfully matches a target home appliance, it sends a first control command to control the target home appliance. Even in a completely independent state without network access or connection to a control center, voice control of home appliances can be achieved, improving the success rate of home control, enabling rapid home control, and enhancing the user experience. By simultaneously outputting status synchronization information to the control center while sending control commands to the target home appliance, the device instructs the control center not to output control commands to the target home appliance, preventing the target home appliance from repeatedly performing operations under the instructions of the first and second control commands.
[0196] Figure 10 This is a structural schematic diagram of the set-top box provided by the present invention, as shown below. Figure 10 As shown, the set-top box includes the home appliance control device 1001 and the second star module 1002 deployed in the control center as described in any of the above embodiments.
[0197] The second star-flash module 1002 is used to realize the star-flash connection between the set-top box and the remote control and home appliances.
[0198] Figure 11 This is the third structural schematic diagram of the home appliance control device provided by the present invention, as shown below. Figure 11 As shown, the home appliance control device is deployed on the home appliance, including but not limited to the instruction receiving module 1101.
[0199] The instruction receiving module 1101 is used to receive and respond to the first control instruction output by the remote control when the command word matching result is a match.
[0200] The command word matching result is obtained by the remote control matching the user's voice command with the offline command word library.
[0201] The instruction receiving module 1101 is further configured to receive a second control instruction output by the control center when the command word matching result is a mismatch.
[0202] The second control command is determined by the control center based on the semantic parsing result of the voice command.
[0203] It should be noted that the home appliance control device provided by the present invention, when deployed in home appliances, can execute the home appliance control method applied to home appliances as described in any of the above embodiments during specific operation, which will not be elaborated in this embodiment.
[0204] The home appliance control device provided by this invention stores an offline command dictionary on the remote control. First, the remote control itself matches voice commands with the offline command dictionary. When the remote control successfully matches a target home appliance, it sends a first control command to control the target home appliance. Even in a completely independent state without network access or connection to a control center, voice control of home appliances can be achieved, improving the success rate of home control, enabling rapid home control, and enhancing the user experience. By simultaneously outputting status synchronization information to the control center while sending control commands to the target home appliance, the device instructs the control center not to output control commands to the target home appliance, preventing the target home appliance from repeatedly performing operations under the instructions of the first and second control commands.
[0205] Figure 12 This is a structural schematic diagram of the home appliance provided by the present invention, such as... Figure 12 As shown, the home appliance includes the home appliance control device 1201 and the third star flash module 1202 deployed in the home appliance as described in any of the above embodiments.
[0206] The third star-flash module 1202 is used to realize the star-flash connection between the home appliances and the remote control and set-top box.
[0207] Figure 13 This is a schematic diagram of the structure of the electronic device provided by the present invention, such as... Figure 13As shown, the electronic device may include: a processor 1310, a communications interface 1320, a memory 1330, and a communication bus 1340, wherein the processor 1310, the communications interface 1320, and the memory 1330 communicate with each other through the communication bus 1340. The processor 1310 can call logical instructions in the memory 1330 to execute the home appliance control method provided in any of the above embodiments. The home appliance control method includes, but is not limited to, the following steps: receiving a voice command input by a user; matching the voice command with an offline command dictionary to obtain a command word matching result; if the command word matching result is a match, outputting a first control command and status synchronization information; the first control command is used to instruct the target home appliance to perform an operation; the status synchronization information is used to instruct the control center not to output a second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command. Alternatively, status synchronization information can be received; the status synchronization information is output by the remote control when the command word matching result is a match; the command word matching result is obtained by the remote control after matching the user's input voice command with an offline command word library; the status synchronization information is used to instruct the control center not to output a second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command; the second control command is used to instruct the target home device to perform an operation; when the command word matching result is a match, the target home device performs the operation under the instruction of the first control command output by the remote control; Alternatively, if the command word matching result is a match, a first control command output by the remote control is received; the command word matching result is obtained by the remote control matching the user's voice command with an offline command word library; if the command word matching result is a mismatch, a second control command output by the control center is received; the second control command is determined by the control center based on the semantic parsing result of the voice command.
[0208] Furthermore, the logical instructions in the aforementioned memory 1330 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0209] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the home appliance control method provided in any of the above embodiments. The home appliance control method includes, but is not limited to, the following steps: receiving a voice command input by a user; matching the voice command with an offline command dictionary to obtain a command word matching result; and, if the command word matching result is a match, outputting a first control command and status synchronization information; the first control command is used to instruct the target home appliance to perform an operation; the status synchronization information is used to instruct the control center not to output a second control command; and the second control command is determined by the control center based on the semantic parsing result of the voice command. Alternatively, status synchronization information can be received; the status synchronization information is output by the remote control when the command word matching result is a match; the command word matching result is obtained by the remote control after matching the user's input voice command with an offline command word library; the status synchronization information is used to instruct the control center not to output a second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command; the second control command is used to instruct the target home device to perform an operation; when the command word matching result is a match, the target home device performs the operation under the instruction of the first control command output by the remote control; Alternatively, if the command word matching result is a match, a first control command output by the remote control is received; the command word matching result is obtained by the remote control matching the user's voice command with an offline command word library; if the command word matching result is a mismatch, a second control command output by the control center is received; the second control command is determined by the control center based on the semantic parsing result of the voice command.
[0210] In another aspect, the present invention also provides a non-transitory computer-readable storage medium storing a computer program thereon. When executed by a processor, the computer program implements the home appliance control method provided in any of the above embodiments. The home appliance control method includes, but is not limited to, the following steps: receiving a voice command input by a user; matching the voice command with an offline command dictionary to obtain a command word matching result; and, if the command word matching result is a match, outputting a first control command and status synchronization information; the first control command is used to instruct the target home appliance to perform an operation; the status synchronization information is used to instruct the control center not to output a second control command; and the second control command is determined by the control center based on the semantic parsing result of the voice command. Alternatively, status synchronization information can be received; the status synchronization information is output by the remote control when the command word matching result is a match; the command word matching result is obtained by the remote control after matching the user's input voice command with an offline command word library; the status synchronization information is used to instruct the control center not to output a second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command; the second control command is used to instruct the target home device to perform an operation; when the command word matching result is a match, the target home device performs the operation under the instruction of the first control command output by the remote control; Alternatively, if the command word matching result is a match, a first control command output by the remote control is received; the command word matching result is obtained by the remote control matching the user's voice command with an offline command word library; if the command word matching result is a mismatch, a second control command output by the control center is received; the second control command is determined by the control center based on the semantic parsing result of the voice command.
[0211] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.
[0212] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.
[0213] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A home device control method characterized by, Applied to a remote control, the method includes: Receive voice commands input by the user; The voice command is matched with an offline command dictionary to obtain the command word matching result; If the command word matching result is a match, the first control command and status synchronization information are output; The first control command is used to instruct the target home appliance to perform an operation; the status synchronization information is used to instruct the control center not to output the second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command.
2. The home device control method according to claim 1, characterized by, If the command word matching result is not a match, the target home appliance performs the operation under the instruction of the second control command.
3. The home device control method according to claim 1, wherein The output of the first control command includes: If the target home device is determined to belong to the Digital Home Alliance device based on the command word matching result, then the first Star Flash command is output when the target home device is in Star Flash connection state; If the target home device is determined not to belong to the Digital Home Alliance device based on the command word matching result, then the first infrared command is output.
4. The home device control method according to claim 3, characterized by, The remote control, the control center, and the target home appliance have the same data field format; The data field format includes, in sequence, the start packet format, the data packet format, and the receive packet format.
5. The home device control method according to claim 1, wherein The step of matching the voice command with an offline command dictionary to obtain command word matching results includes: The voice commands are classified based on the built-in classification network to obtain classification words and their scores; The classification words are sorted in descending order of their scores, and a preset number of classification words are extracted sequentially based on the sorting results. The intent corresponding to the preset number of category words is determined based on rule matching; The preset number of category words and their corresponding intents are matched with the offline command word library to obtain the command word matching results.
6. A home equipment control method characterized by, Applied to a control center, the method includes: Receive status synchronization information; the status synchronization information is output by the remote control when the command word matching result is a match; the command word matching result is obtained by the remote control after matching the user's voice command with the offline command word library; The status synchronization information is used to instruct the control center not to output the second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command; the second control command is used to instruct the target home appliance to perform an operation; If the command word matching result is a match, the target home appliance performs the operation under the instruction of the first control command output by the remote control.
7. The home device control method according to claim 6, wherein The method further includes: If the command word matching result is not a match, a second control command is output.
8. The home device control method according to claim 7, characterized by, The output of the second control command includes: If the semantic parsing result determines that the target home device belongs to the Digital Home Alliance, then a second Star Flash command is output when the target home device is in a Star Flash connection state. If the semantic parsing result determines that the target home device does not belong to the Digital Home Alliance device, then a second infrared command is output.
9. The home device control method according to claim 7, wherein The output of the second control command includes: If the semantic parsing result determines that the target home device belongs to the Digital Home Alliance, then when the target home device is not in a StarFlash connection state, the target device information is broadcast so that other home devices within the broadcast range can receive and parse the target device information, so that when the target home device is in a StarFlash connection state with the other home devices, it will eventually receive the second StarFlash command; the target device information carries the StarFlash connection information of the target home device and the second StarFlash command. 10.The home device control method of claim 6, wherein, Before receiving the status synchronization information, the following is also included: If the search for the home device to be added based on the StarFlash connection information fails, a search failure status message is output; the StarFlash connection information is determined by the cloud server after analyzing the device addition request of the home device to be added; the search failure status message is used to instruct the cloud server to determine the first offline command model suitable for the infrared home device. The first offline command model is received and forwarded to the remote controller, so that the remote controller updates the offline command dictionary based on the first offline command model. 11.The home device control method of claim 6, wherein, Before receiving the status synchronization information, the following is included: If the search for the home device to be added is successful based on the Star Flash connection information of the home device to be added, and the home device to be added is in a Star Flash connection state, a support instruction acquisition request is output; the support instruction acquisition request is used to instruct the home device to be added to return a controlled device support instruction. Upon successful receipt of the controlled device support command, a support success status message is output; the support success status message is used to instruct the cloud server to determine a second offline command model suitable for the Digital Home Alliance device; The second offline command model is received and forwarded to the remote controller, so that the remote controller updates the offline command dictionary based on the second offline command model. 12.The home device control method of claim 11, wherein, Following the output support instruction retrieval request, the following is also included: If the controlled device fails to receive a support command, a support failure status message is output; the support failure status message is used to instruct the cloud server to determine a first offline command model suitable for the infrared home device. The first offline command model is received and forwarded to the remote controller, so that the remote controller updates the offline command dictionary based on the first offline command model.
13. A home device control method characterized by, Applied to home appliances, the method includes: If the command word matching result is a match, the first control command output by the remote control is received; the command word matching result is obtained by the remote control after matching the user's voice command with the offline command word library; If the command word matching result is not a match, a second control command output by the control center is received; the second control command is determined by the control center based on the semantic parsing result of the voice command. 14.The home device control method of claim 13, wherein, The second control command output by the receiving control center also includes: When connected to other home appliances via StarFlash, receive a second StarFlash command forwarded by the control center through the other home appliances; The other home devices are those within the broadcast range of the target device information broadcast by the control center; the second Star Flash command is obtained by the other home devices after receiving and parsing the target device information; the target device information is broadcast by the control center when it is not in a Star Flash connection state with the target home device.
15. A home device control apparatus characterized by comprising: Deployed on the remote controller, including: The voice receiving module is used to receive voice commands input by the user. The command word matching module is used to match the voice command with an offline command word library to obtain the command word matching result; The instruction sending module is used to output a first control instruction and status synchronization information when the command word matching result is a match; The first control command is used to instruct the target home appliance to perform an operation; the status synchronization information is used to instruct the control center not to output the second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command.
16. A remote control, characterized in that include: The home appliance control device and the first star-flash module as described in claim 15; The first star-flash module is used to enable star-flash connection between the remote control and the set-top box and home appliances.
17. A home device control apparatus characterized by comprising: Deployed in the control center, including: A synchronization information receiving module is used to receive status synchronization information; the status synchronization information is output by the remote control when the command word matching result is a match; the command word matching result is obtained by the remote control after matching the user's voice command with an offline command word library; The status synchronization information is used to instruct the control center not to output the second control command; the second control command is determined by the control center based on the semantic parsing result of the voice command; the second control command is used to instruct the target home appliance to perform an operation; If the command word matching result is a match, the target home appliance performs the operation under the instruction of the first control command output by the remote control.
18. A set-top box, characterized by include: The home appliance control device and the second star flash module as described in claim 17; The second star-flash module is used to enable star-flash connection between the set-top box and the remote control and home appliances.
19. A home device control apparatus characterized by comprising: Deployed in home appliances, including: The instruction receiving module is used to receive the first control instruction output by the remote control when the command word matching result is a match; the command word matching result is obtained by the remote control after matching the user's voice instruction with an offline command word library; The instruction receiving module is further configured to receive a second control instruction output by the control center when the command word matching result is a mismatch; the second control instruction is determined by the control center based on the semantic parsing result of the voice instruction.
20. A home device, comprising: include: The home appliance control device and the third star flash module as described in claim 19; The third star-flash module is used to enable star-flash connection between the home appliances and the remote control and set-top box.
21. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein, When the processor executes the computer program, it implements the home appliance control method as described in any one of claims 1 to 14. 22.A non-transitory computer-readable storage medium having stored thereon a computer program. When the computer program is executed by a processor, it implements the home appliance control method as described in any one of claims 1 to 14.
23. A computer program product comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the home appliance control method as described in any one of claims 1 to 14.