Smart home control system and method of operating the same

Abstract

This application relates to the field of smart home control technology, providing a smart home control system and its operation method. The smart home control system includes: a smart headset for acquiring audio stream data; a control center for decoding the audio stream data to obtain pulse code modulation data; a cloud service platform for data interaction with the control center via a network, performing speech recognition and semantic analysis on the pulse code modulation data to obtain analysis results, and generating a first control command if a matching home device exists in the digital home alliance database; and a first home device for executing the function corresponding to the first control command. The smart home control system and its operation method provided by this application enable direct remote control of home devices via a smart headset, offering more convenient operation and improved control efficiency.

Description

Technical Field

[0001] This application relates to the field of smart home control technology, specifically to a smart home control system and its operation method. Background Technology

[0002] Currently, smart devices are becoming increasingly common in home life and have more and more functions.

[0003] In related technologies, voice input, remote control, or controls on smart home appliances are typically used to trigger different functions of smart home appliances. When it is necessary to switch home appliance functions multiple times, the number of user operations increases accordingly. Furthermore, when using voice or remote control to switch smart home appliance functions, the distance is limited, making it impossible to control the use of smart home appliances from a greater distance, resulting in low efficiency of automatic control of smart home appliances. Summary of the Invention

[0004] This application provides a smart home control system and its operation method to solve the technical problems of cumbersome operation of existing smart home appliances, inability to control smart home appliances remotely, and low control efficiency of smart home appliances.

[0005] In a first aspect, embodiments of this application provide a smart home control system, including:

[0006] A smart headset, used to collect audio stream data;

[0007] The control center is connected to the smart headset via Bluetooth and is used to decode the audio stream data to obtain pulse code modulation data.

[0008] A cloud service platform is communicatively connected to the control center. The cloud service platform is used to perform speech recognition and semantic analysis on the pulse code modulation data to obtain the analysis result. If a home device corresponding to the analysis result exists in the digital home alliance library, a first control command is generated. The analysis result is used to indicate the type of home device to be controlled.

[0009] The first home appliance is communicatively connected to the cloud service platform. The first home appliance belongs to the home appliances in the digital home alliance library. The first home appliance is used to perform the function corresponding to the first control command.

[0010] In one embodiment, the smart headset and the home device have an infrared communication module;

[0011] The cloud service platform is also used to send the infrared key value to the control center when there is no home device corresponding to the parsing result in the digital home alliance library, but there is an infrared key value corresponding to the home device to be controlled in the infrared code library.

[0012] The cloud service platform is also used to send a first prompt message to the control center when there is no home device corresponding to the parsing result in the digital home alliance library and no infrared key value corresponding to the home device to be controlled in the infrared code library.

[0013] The control center is also used to generate a prompt message upon receiving the infrared key value, and send the infrared key value to the smart headset;

[0014] The smart headset is also used to establish an infrared connection with a second home device via an infrared communication module upon receiving the infrared key value. The second home device is not a home device in the digital home alliance library.

[0015] In one embodiment, the smart headset includes:

[0016] A first control unit is used to perform audio decoding and transmission of the audio stream data based on the Bluetooth audio transmission protocol;

[0017] The second control unit is used to continuously collect the audio stream data and send the audio stream data to the control center.

[0018] The control center is also used to identify valid audio stream data in the audio stream data and send the valid audio stream data to the cloud service platform.

[0019] A third control unit is configured to acquire the audio stream data by receiving a first input from the user.

[0020] In one embodiment, the smart home control system further includes:

[0021] At least one APP application, the at least one APP application interacts with the cloud service platform via a network, and the at least one APP application is used to send a request instruction to the cloud service platform based on a second input from the user;

[0022] The cloud service platform is also used to send the request command to the smart headset through the control center;

[0023] The smart headset is also used to perform firmware upgrades according to the requested instructions.

[0024] In one embodiment, the smart headset is further configured to generate device information according to the request instruction, and send the device information to the at least one APP application sequentially through the control center and the cloud service platform;

[0025] The at least one APP application is also used to display the device information.

[0026] Secondly, embodiments of this application provide a method for operating a smart home control system, comprising:

[0027] The audio stream data collected by the smart headset is sent to the control center;

[0028] Based on the control center's decoding of the audio stream data, pulse code modulation data is obtained;

[0029] The pulse code modulation data is sent to the cloud service platform;

[0030] Based on the cloud service platform, speech recognition and semantic analysis are performed on the pulse code modulation data to obtain the analysis result. If a home device corresponding to the analysis result exists in the digital home alliance library, a first control command is generated. The analysis result is used to indicate the type of home device to be controlled. The first control command is used to control a first home device to perform the function corresponding to the first control command. The first home device belongs to the home devices in the digital home alliance library.

[0031] In one embodiment, after obtaining the parsing result, the method further includes:

[0032] If no home device corresponding to the parsing result exists in the digital home alliance database, but an infrared key value corresponding to the home device to be controlled exists in the infrared code database, the infrared key value is sent to the control center.

[0033] When the control center generates a prompt message by receiving the infrared key value, it controls the control center to send the infrared key value to the smart headset;

[0034] When the smart headset receives the infrared key value, it controls the smart headset to establish an infrared connection with the home device.

[0035] In one embodiment, the method further includes:

[0036] When at least one APP application generates a request instruction by receiving a second input from the user, the at least one APP application is controlled to send the request instruction to the cloud service platform.

[0037] When the cloud service platform sends the request instruction to the smart headset through the control center, it controls the smart headset to perform a firmware upgrade according to the request instruction.

[0038] Thirdly, embodiments of this application provide an electronic device, including a processor and a memory storing a computer program, wherein the processor executes the program to implement the steps of the operation method of the smart home control system described in the second aspect.

[0039] Sixthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the steps of the operation method of the smart home control system described in the second aspect.

[0040] The smart home control system and its operation method provided in this application embodiment, by establishing Bluetooth communication between the smart headset and the control center, decodes, performs speech recognition and semantic analysis on the audio stream data collected by the headset to obtain the corresponding analysis results, and generates a first control command when the analysis results match the home devices, can directly realize remote control of home devices through the smart headset, making the operation more convenient and improving the control efficiency of home devices. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 This is one of the structural schematic diagrams of the smart home control system provided in the embodiments of this application;

[0043] Figure 2 This is a second schematic diagram of the structure of the smart home control system provided in the embodiments of this application;

[0044] Figure 3 This is one of the flowcharts illustrating the operation method of the smart home control system provided in this application embodiment;

[0045] Figure 4 This is a schematic diagram showing the working modes of the smart headset provided in this application embodiment;

[0046] Figure 5 This is a second schematic flowchart of the operation method of the smart home control system provided in the embodiments of this application;

[0047] Figure 6This is a schematic diagram of the communication timing of a smart headset provided in an embodiment of this application;

[0048] Figure 7 This is the third flowchart illustrating the operation method of the smart home control system provided in this application embodiment;

[0049] Figure 8 A schematic diagram of the physical structure of an electronic device is provided.

[0050] Figure label:

[0051] 110: Smart headset; 120: Control center; 130: Cloud service platform;

[0052] 140: First Home Appliances; 150: APP Application. Detailed Implementation

[0053] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0054] Figure 1 This is one of the structural schematic diagrams of the smart home control system provided in the embodiments of this application; in Figure 1 In the embodiments shown, this application provides a smart home control system, including: a smart headset 110, a control center 120, a cloud service platform 130, and a first home device 140.

[0055] Among them, the smart headset 110 is used to collect audio stream data.

[0056] Figure 2 This is the second structural schematic diagram of the smart home control system provided in the embodiments of this application. Figure 2 In the illustrated embodiment, the smart headset 110 includes a Bluetooth module, which enables the smart headset 110 to communicate with other terminals equipped with Bluetooth modules via Bluetooth.

[0057] In this embodiment, the smart headset 110 also includes a sound pickup module, which is used to collect audio stream data input by the user.

[0058] In this embodiment, the pickup module of the smart headset 110 can also use the Adaptive Differential Pulse Code Modulation (ADPCM) protocol to compress the audio stream data and send the compressed audio stream data to the control center 120 via the Bluetooth module.

[0059] In this embodiment, the smart headset 110 can send audio stream data or pulse code modulation data in a packet-based manner.

[0060] In this embodiment, the packet format includes a start packet, a data packet, and an end packet.

[0061] In this embodiment, the start packet, data packet, and end packet each include corresponding packet data, packet identifier, and packet length, wherein the packet identifier includes the sequence number of the data block, the checksum of the data block to be released, etc.

[0062] The first home device 140 is connected to the smart headset 110 via Bluetooth. The first home device 140 is also connected to the cloud service platform 130. The first home device 140 is a home device in the digital home alliance library. The first home device 140 is used to execute the function corresponding to the first control command.

[0063] In this embodiment, home appliances include common smart devices, such as smart speakers, smart TVs, smart refrigerators, and smart fans.

[0064] exist Figure 2 In the embodiment shown, the home device includes a Bluetooth module for Bluetooth communication with the smart headset 110. After receiving the control command sent by the smart headset 110, the home device activates the corresponding function according to the corresponding control instruction.

[0065] The control center 120 is connected to the smart headset 110. The control center 120 is used to decode the audio stream data to obtain pulse code modulation data.

[0066] In this embodiment, the control center 120 includes a Bluetooth module, and the control center 120 establishes Bluetooth communication with the smart headset 110 through the Bluetooth module to realize data interaction.

[0067] In this embodiment, the smart headset 110 and the home control center 120 can transmit and receive data through the GATT (Generic Attribute Profile) specification of Bluetooth Low Energy (BLE).

[0068] In this embodiment, the control center 120 further includes a logic module for decoding audio stream data to obtain Pulse Code Modulation (PCM) data.

[0069] exist Figure 2 In the embodiment shown, the control center 120 includes a communication module for sending pulse code modulation data to the cloud service platform 130.

[0070] In this embodiment, the control center 120 can also send pulse code modulation data to the cloud service platform 130 via packet assembly. The packet assembly format includes a start packet, a data packet, and an end packet, which is similar to the packet assembly method sent to the control center 120 via the smart headset 110 described above. This embodiment will not repeat the details.

[0071] The cloud service platform 130 communicates with the control center 120. The cloud service platform 130 is used to perform speech recognition and semantic analysis on pulse code modulation data, obtain the analysis result, and generate a first control command if the home device corresponding to the analysis result exists in the digital home alliance library; wherein, the analysis result is used to indicate the type of home device to be controlled.

[0072] exist Figure 2 In the embodiment shown, the cloud service platform 130 includes a communication module for receiving pulse code modulation data sent by the control center 120.

[0073] In this embodiment, the cloud service platform 130 also includes a logic module for performing speech recognition and semantic parsing on pulse code modulation data, and generating corresponding speech parsing results.

[0074] In this embodiment, when the cloud server receives PCM data sent by the control center 120, it first determines the PCM data type through speech recognition and then uses Natural Language Processing (NLP) technology to perform semantic parsing on the PCM data.

[0075] In this embodiment, the speech recognition process corrects the hot words related to smart home. For example, during speech recognition, hot words with higher weight are forcibly converted. The semantic parsing process performs word slot segmentation based on the hot words after forced conversion of the speech recognition results, and converts the relevant hot words into executable instructions.

[0076] In this embodiment, hot words include common home appliances such as smart air conditioners, humidifiers, and robot vacuum cleaners.

[0077] In this embodiment, hot words are forcibly converted to facilitate unified management of different types of hot word names. For example, the term "humidification meter" is corrected to "humidifier".

[0078] In this embodiment, the hot words after forced conversion are segmented by word slots. This can be done by classifying the identified hot words according to different word types, such as classifying them according to types like "action to be performed", "execution object", and "location of execution object".

[0079] For example, the cloud server will segment the detected phrase "turn on the bedroom air conditioner" into "turn on", "bedroom" and "air conditioner".

[0080] In this embodiment, the cloud service platform 130 can directly access the digital home alliance database, which includes device information for various home devices. The device information may include the name, model, installation location, and production date of the home device.

[0081] In this embodiment, the cloud server can match the home device corresponding to the parsing result with the information of various home devices pre-stored in the digital home alliance database. If there is a home device in the digital home alliance database that corresponds to the parsing result, the cloud server generates a first control command and sends the first control command to the first home device 140 to be controlled. After receiving the first control command, the first home device 140 executes the corresponding function.

[0082] In this embodiment, the cloud server obtains the parsing results of "turn on the air conditioner in the bedroom" as "turn on", "bedroom" and "air conditioner", and if it detects that the air conditioner installed in the bedroom is working properly, the cloud server directly sends the command "turn on the air conditioner" to the air conditioner in the bedroom to turn on the air conditioner.

[0083] The smart home control system provided in this application embodiment, by establishing Bluetooth communication between the smart headset 110 and the control center 120, decodes, performs voice recognition and semantic analysis on the audio stream data collected by the headset to obtain the corresponding analysis results, and generates a first control command when the analysis results match the home device 140. This enables direct remote control of the home device 140 through the smart headset 110, making the operation more convenient and improving the control efficiency of the home device 140.

[0084] In some embodiments, the smart headset 110 and the home device are equipped with infrared communication modules; the cloud service platform 130 is further configured to send an infrared key value to the control center 120 when there is no home device corresponding to the parsing result in the digital home alliance library, but there is an infrared key value corresponding to the home device to be controlled in the infrared code library; the cloud service platform is further configured to send a first prompt message to the control center when there is no home device corresponding to the parsing result in the digital home alliance library, and there is no infrared key value corresponding to the home device to be controlled in the infrared code library; the control center 120 is further configured to generate a second prompt message upon receiving the infrared key value, and send the infrared key value to the smart headset 110; the smart headset 110 is further configured to establish an infrared connection with a second home device through the infrared communication module upon receiving the infrared key value, wherein the second home device is not a home device in the digital home alliance library.

[0085] In this embodiment, the smart headset 110 can also establish an infrared connection with home appliances through an infrared communication module. The smart headset 110 transmits control commands of the home appliances through infrared to achieve direct control of the home appliances by the smart headset 110.

[0086] In this embodiment, the cloud service platform 130 can directly access the infrared code library.

[0087] In this embodiment, if there is no home device in the digital home alliance library that corresponds to the parsing result, the cloud service platform 130 can detect whether there is an infrared key value in the infrared code library that corresponds to the home device to be controlled. If there is, the infrared key value is sent to the smart headset 110 through the control center 120. The smart headset 110 establishes an infrared connection with the home device to be controlled through the infrared key value.

[0088] Figure 3 This is one of the flowcharts illustrating the operation method of the smart home control system provided in this application embodiment. Figure 3In the illustrated embodiment, the smart headset 110 collects the user's input voice and generates corresponding audio stream data (corresponding to the voice stream). When the smart headset 110 establishes a Bluetooth connection with the control center 120, it sends the voice stream to the control center 120. Upon receiving the voice stream, the control center 120 decodes it into raw PCM stream and sends it to the cloud service platform 130. The cloud server receives the voice stream and performs speech recognition and semantic analysis (corresponding to speech semantic analysis). If no controllable home device is found, the server directly prompts the user that no controllable device can be found. If a corresponding device model is found in the digital home alliance database... If the controllable device is a regular infrared device, the control center 120 will generate a first control command to control the first home appliance 140. If the controllable device is a regular infrared device, the control center 120 will query the corresponding infrared key value based on the parsing result. If no infrared key value corresponding to the parsing result exists, the control center 120 will generate a first prompt message to indicate that the function command cannot be executed. If the key value exists, the control center 120 will send the corresponding infrared key value to the control center 120. The control center 120 will generate a second prompt message and send the infrared key value to the smart headset 110. After receiving the infrared key value, the smart headset 110 will send the infrared key value to the second home appliance through the infrared communication module. After receiving the infrared key value, the second home appliance will execute the corresponding function.

[0089] The smart home control system provided in this application embodiment can establish an infrared connection between the smart headset 110 and the second home device by detecting that the cloud service platform 130 detects that there is no corresponding home device in the parsing result, but there is an infrared key value corresponding to the parsing result. This enables the smart headset 110 to control the home device via infrared, increases the means of controlling different home devices, and improves control efficiency.

[0090] In some embodiments, the smart headset 110 includes: a first control unit, which is used to decode and transmit audio stream data based on the Bluetooth audio transmission protocol; a second control unit, which is used to continuously collect audio stream data and send the audio stream data to a control center 120; wherein the control center 120 is also used to identify valid audio stream data in the audio stream data and send the valid audio stream data to a cloud service platform 130; and a third control unit, which is used to collect audio stream data by receiving a first input from a user.

[0091] In this embodiment, the Bluetooth audio transmission protocol includes A2DP (Advanced Audio Distribution Profile, Bluetooth audio transmission model).

[0092] In this embodiment, the smart headset 110 includes three different working modes: normal mode, home control mode, and home control power saving mode. In the home control mode, continuous sound pickup can be used to perform multiple home control operations until the home control mode is exited. In the home control power saving mode, home control can be performed once by triggering the start and end of sound pickup.

[0093] exist Figure 2 In the illustrated embodiment, the smart headset 110 also includes a button module. For example, the smart headset 110 is equipped with a "mic control", which performs the function of collecting and sending audio stream data by receiving the user's first input.

[0094] In this embodiment, the smart headset 110 executes three different working modes through the first control unit, the second control unit, and the third control unit, respectively.

[0095] Figure 4 This is a schematic diagram showing the working modes of the smart headset 110 provided in this application embodiment. Figure 4 In the illustrated embodiment, the first control unit corresponds to the normal mode. In the normal mode, the smart headset 110 supports the A2DP protocol, collects audio stream data through the pickup module, and performs audio encoding and decoding transmission on the audio stream data. The second control unit corresponds to the home control mode. In the home control mode, the smart headset 110 can continuously collect mic audio and transmit the mic audio to the control center 120. The home control center 120 determines whether it is a valid audio stream and transmits it to the cloud for voice semantic recognition. The third control unit corresponds to the home control power-saving mode. In the home control mode, the smart headset 110 needs to collect mic audio once by receiving the user's first input of pressing the function control "mic button" and then send the mic audio to the home control center 120. In this mode, the power consumption of the smart headset 110 is low.

[0096] The smart home control system provided in this application embodiment enables the switching of multiple working modes by setting a first control unit, a second control unit, and a third control unit in the smart headset 110, which can reduce power consumption and extend the service life of the smart headset 110.

[0097] In some embodiments, the smart home control system further includes: at least one APP application, which interacts with the cloud service platform 130 via a network, and is used to send a request instruction to the cloud service platform 130 based on a second input from the user; the cloud service platform 130 is also used to send a request instruction to the smart headset 110 through the control center 120; the smart headset 110 is also used to perform a firmware upgrade based on the request instruction.

[0098] In this embodiment, the APP application 150 includes a logic module, which generates a corresponding request instruction based on the user's second input.

[0099] In this embodiment, the user's second input is input to the application interface of at least one APP application, and the application responds to the second input by sending a request instruction to the cloud service platform 130.

[0100] In this embodiment, the APP application 150 includes a communication module for establishing a network connection with the cloud service platform 130. The APP application 150 sends request instructions to the cloud service platform 130 through the communication module.

[0101] In this embodiment, the APP application 150 also includes a device management module, which allows the user to manage and store the device information of the first home device 140 and the ordinary infrared second home device in the digital home alliance library.

[0102] Figure 5 This is the second flowchart illustrating the operation method of the smart home control system provided in this application embodiment. Figure 5 In the illustrated embodiment, home devices are divided into first home devices 140 in the digital home alliance library and ordinary infrared second home devices. Users can add home device information through the application by following steps: 1) The application receives the user's second input and sends a request instruction to the cloud service platform 130 to "add first home device". If the requested home device belongs to the digital home alliance library, the device information is saved in the application; if the requested home device does not belong to the digital home alliance library, and the infrared code library contains a device model corresponding to the home device, the cloud service platform 130 sends the infrared code library to the control center 120. When the control center 120 receives the infrared key value corresponding to the requested home device, it sends the infrared key value to the home device through the smart headset 110. When the smart headset 110 determines that it can establish an infrared connection with the home device, it saves the home device information to be added and the infrared code library in the cloud service platform 130. Otherwise, the user is prompted to confirm the model again. If the model is supported, the user is prompted that the addition was successful, and the device information and the corresponding infrared code library are saved in the cloud.

[0103] In this embodiment, the smart headset 110 requests and transmits the current version information through the home control center 120. The terminal of the application displays the current version information and queries for upgrades. After receiving the firmware file, the smart headset 110 assembles and saves it, and performs firmware upgrades after verifying the integrity and legality of the file.

[0104] The smart home control system provided in this application embodiment optimizes the control process of smart home devices by setting up an APP application 150 to uniformly manage the firmware upgrades and device connection status of the smart headset 110.

[0105] In some embodiments, the smart headset 110 is also used to generate device information according to the request instruction, and send the device information to at least one APP application 150 in sequence through the control center 120 and the cloud service platform 130; at least one APP application 150 is also used to display the device information.

[0106] In this embodiment, the user queries the device information of the smart headset 110 through the APP, such as the device name, Bluetooth name, and firmware version of the smart headset 110. After the cloud service platform 130 receives the device information request from the APP, it communicates with the smart headset 110 through the control center 120. The smart headset 110 returns the device information to the control center 120 and sends the data to the APP for display through the cloud service platform 130.

[0107] The smart home control system provided in this application embodiment allows for the visual management of device information of the smart headset 110 through an APP application 150, facilitating query and operation by end users.

[0108] Figure 6 This is a communication timing diagram of the smart headset 110 provided in an embodiment of this application. Figure 6 In the illustrated embodiment, when the smart headset 110 is in home control mode or home control power-saving mode, the control center 120 actively pairs and connects with the smart headset 110. After successfully establishing a Bluetooth connection, a GATT service is established, and data is read and written according to the characteristic values ​​conforming to the protocol. Audio streams are transmitted via Bluetooth. After receiving the audio stream from the smart headset 110, the control center 120 establishes network communication with the cloud service platform 130. The cloud service platform 130 performs speech recognition and semantic parsing, and after parsing, determines whether to directly issue commands to... Home devices still send data to the control center 120 to enable the smart headset 110 to control home devices via infrared. Users can query the device information of the smart headset 110 through the APP, such as: device name, Bluetooth name, and firmware version of the smart headset 110. After receiving the device information request from the APP, the cloud service communicates with the smart headset 110 through the control center 120. The smart headset 110 returns the device information to the control center 120 and sends the device information to the APP for display through the cloud service platform 130. The APP can also control the smart headset 110 to perform firmware updates and home control.

[0109] The operation method of the smart home control system provided in the embodiments of this application is described below. The operation method of the smart home control system described below can be referred to in correspondence with the smart home control system described above.

[0110] Figure 7 This is the third flowchart illustrating the operation method of the smart home control system provided in this application embodiment, as shown below. Figure 7 As shown, the operation method of this smart home control system includes the following steps:

[0111] Step 710: Send the audio stream data collected by the smart headset to the control center.

[0112] In this step, the smart headset includes a Bluetooth module, which allows it to communicate with other terminals equipped with Bluetooth modules.

[0113] In this embodiment, the smart headset also includes a microphone module for collecting audio stream data input by the user.

[0114] In this embodiment, the smart headset's pickup module can also use the Adaptive Differential Pulse Code Modulation (ADPCM) protocol to compress the audio stream data and send the compressed audio stream data to the control center via the Bluetooth module.

[0115] Step 720: Based on the control center's decoding of the audio stream data, obtain pulse code modulation data.

[0116] In this step, the control center interacts with the smart headset via Bluetooth to decode the audio stream data and obtain pulse code modulation data.

[0117] In this embodiment, the control center includes a Bluetooth module, which establishes Bluetooth communication with the smart headset to achieve data interaction.

[0118] In this embodiment, the smart headset and home control center can achieve data transmission and reception through the GATT (Generic Attribute Profile) specification of Bluetooth Low Energy (BLE).

[0119] In this embodiment, the control center also includes a logic module, which is used to decode the audio stream data to obtain Pulse Code Modulation (PCM) data.

[0120] Step 730: Send pulse code modulation data to the cloud service platform.

[0121] In this embodiment, the control center includes a communication module, which is used to send pulse code modulation data to a cloud service platform.

[0122] In this embodiment, the control center can also send pulse code modulation data to the cloud service platform in a packet format; wherein the packet format includes a start packet, a data packet, and an end packet.

[0123] Step 740: Based on the cloud service platform, perform speech recognition and semantic parsing on the pulse code modulation data to obtain the parsing result. If there is a matching home device in the digital home alliance library that matches the parsing result, generate a first control command. The parsing result is used to indicate the type of home device to be controlled. The first control command is used to control the first home device to perform the function corresponding to the first control command. The first home device belongs to the home devices in the digital home alliance library.

[0124] In this step, the cloud service platform interacts with the control center via the network.

[0125] In this embodiment, the cloud service platform includes a communication module for receiving pulse code modulation data sent by the control center.

[0126] In this embodiment, the cloud service platform also includes a logic module for performing speech recognition and semantic parsing on pulse code modulation data, and generating corresponding speech parsing results.

[0127] In this embodiment, when the cloud server receives PCM data sent by the control center, it first determines the PCM data type through speech recognition and then uses Natural Language Processing (NLP) technology to perform semantic parsing on the PCM data.

[0128] In this embodiment, the speech recognition process corrects the hot words related to smart home. For example, during speech recognition, hot words with higher weight are forcibly converted. The semantic parsing process performs word slot segmentation based on the hot words after forced conversion of the speech recognition results, and converts the relevant hot words into executable instructions.

[0129] In this embodiment, the cloud service platform can directly access the Digital Home Alliance Library, which includes device information for various home appliances. The device information may include the name, model, installation location, and production date of the home appliance.

[0130] In this embodiment, the cloud server can match the home device corresponding to the parsing result with the information of various home devices pre-stored in the digital home alliance database. If there is a home device in the digital home alliance database that corresponds to the parsing result, the cloud server generates a first control command and sends the first control command to the first home device. After receiving the first control command, the first home device executes the corresponding function.

[0131] In this embodiment, the cloud server obtains the parsing results of "turn on the air conditioner in the bedroom" as "turn on", "bedroom" and "air conditioner", and if it detects that the air conditioner installed in the bedroom is working properly, the cloud server directly sends the command "turn on the air conditioner" to the air conditioner in the bedroom to turn on the air conditioner.

[0132] The operating method of the smart home control system provided in this application embodiment, by establishing Bluetooth communication between the smart headset and the control center, decodes, performs voice recognition and semantic analysis on the audio stream data collected by the headset to obtain the corresponding analysis results, and generates a first control command when the analysis results match the home devices, can directly realize remote control of home devices through the smart headset, making the operation more convenient and improving the control efficiency of home devices.

[0133] In some embodiments, after obtaining the parsing result, the method further includes: if there is no home device corresponding to the parsing result in the digital home alliance library, but there is an infrared key value corresponding to the home device to be controlled in the infrared code library, sending the infrared key value to the control center; if the control center generates a prompt message by receiving the infrared key value, controlling the control center to send the infrared key value to the smart headset; and if the smart headset receives the infrared key value, controlling the smart headset to establish an infrared connection with the home device.

[0134] In this embodiment, the smart headset can also establish an infrared connection with home appliances via an infrared communication module. The smart headset transmits control commands to the home appliances via infrared to achieve direct control of the home appliances by the smart headset.

[0135] In this embodiment, the cloud service platform can directly access the infrared code library.

[0136] In this embodiment, if no home device corresponding to the parsing result exists in the digital home alliance database, the cloud service platform can detect whether there is an infrared key value corresponding to the home device to be controlled in the infrared code library. If it exists, the infrared key value is sent to the smart headset through the control center, and the smart headset establishes an infrared connection with the home device to be controlled through the infrared key value.

[0137] The smart home control system operation method provided in this application embodiment detects that no corresponding home device exists in the analysis result on the cloud service platform. If an infrared key value corresponding to the analysis result exists, an infrared connection between the smart headset and the home device is established through the infrared key value. This enables the smart headset to control the home device via infrared, increases the control means of the home device, and improves control efficiency.

[0138] In some embodiments, the method further includes: when at least one APP application generates a request instruction by receiving a second input from the user, controlling at least one APP application to send the request instruction to a cloud service platform; and when the cloud service platform sends the request instruction to the smart headset through a control center, controlling the smart headset to perform a firmware upgrade according to the request instruction.

[0139] In this embodiment, the APP application includes a logic module, which generates corresponding request instructions based on the user's second input.

[0140] In this embodiment, the user's second input is input to the application interface of at least one APP application, and the application responds to the second input by sending a request instruction to the cloud service platform.

[0141] In this embodiment, the APP application includes a communication module for establishing a network connection with the cloud service platform. The APP application sends request instructions to the cloud service platform through the communication module.

[0142] In this embodiment, the APP application also includes a device management module, which allows users to manage and store device information for home devices and ordinary infrared home devices in the Digital Home Alliance database.

[0143] In this embodiment, the smart headset requests and transmits the current version information through the control center. The application terminal displays the current version information and queries for upgrades. After receiving the firmware file, the smart headset assembles and saves it, and performs firmware upgrades after verifying the integrity and legality of the file.

[0144] In some embodiments, the smart headset is also used to generate device information according to the request instruction, and send the device information to at least one APP application in sequence through the control center and the cloud service platform; at least one APP application is also used to display the device information.

[0145] In this embodiment, the user queries the device information of the smart headset through the APP, such as the device name, Bluetooth name, and firmware version of the smart headset. After the cloud service platform receives the device information request from the APP, it communicates with the smart headset through the control center. The smart headset returns the device information to the control center and sends data to the APP for display through the cloud service platform.

[0146] The smart home control system provided in this application embodiment enables visualized management of smart headset device information through an APP application, optimizing the control process of smart home devices and facilitating end-user query and operation.

[0147] Figure 8 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 8 As shown, the electronic device may include a processor 810, a communication interface 820, a memory 830, and a communication bus 840. The processor 810, communication interface 820, and memory 830 communicate with each other via the communication bus 840. The processor 810 can call a computer program in the memory 830 to execute the steps of the smart home control system's operation method, such as: sending audio stream data collected by a smart headset to a control center; decoding the audio stream data based on the control center's analysis to obtain pulse code modulation (PCM) data; sending the PCM data to a cloud service platform; performing speech recognition and semantic analysis on the PCM data based on the cloud service platform to obtain the analysis result; and generating a first control command if a matching home device exists in the digital home alliance database, where the analysis result indicates the type of home device to be controlled; the first control command is used to control a first home device to perform a function corresponding to the first control command, and the first home device belongs to the home devices in the digital home alliance database.

[0148] Furthermore, the logical instructions in the aforementioned memory 830 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0149] On the other hand, this application also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can perform the steps of the operation method of the smart home control system provided in the above embodiments, such as: sending audio stream data collected by a smart headset to a control center; decoding the audio stream data based on the control center to obtain pulse code modulation data; sending the pulse code modulation data to a cloud service platform; performing speech recognition and semantic analysis on the pulse code modulation data based on the cloud service platform to obtain the analysis result, and generating a first control instruction if a home device matching the analysis result exists in the digital home alliance library. The analysis result is used to indicate the type of home device to be controlled, and the first control instruction is used to control the first home device to perform the function corresponding to the first control instruction. The first home device belongs to the home devices in the digital home alliance library.

[0150] On the other hand, embodiments of this application also provide a processor-readable storage medium storing a computer program. The computer program is used to cause a processor to execute the steps of the operating method of the smart home control system provided in the above embodiments, including, for example: sending audio stream data collected by a smart headset to a control center; decoding the audio stream data based on the control center's processing to obtain pulse code modulation (PCM) data; sending the PCM data to a cloud service platform; performing speech recognition and semantic analysis on the PCM data based on the cloud service platform to obtain a parsing result, and generating a first control command if a matching home device exists in the digital home alliance database corresponding to the parsing result, wherein the parsing result indicates the type of home device to be controlled; sending the first control command to the home device to be controlled, and controlling the home device to perform a target function.

[0151] The processor-readable storage medium can be any available medium or data storage device that the processor can access, including but not limited to magnetic memory (e.g., floppy disk, hard disk, magnetic tape, magneto-optical disk (MO)), optical memory (e.g., CD, DVD, BD, HVD), and semiconductor memory (e.g., ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state drive (SSD)).

[0152] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0153] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0154] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A smart home control system, characterized by, include: A smart headset, used to collect audio stream data; The smart headset includes: A first control unit is used to perform audio decoding and transmission of the audio stream data based on the Bluetooth audio transmission protocol; The second control unit is used to continuously collect the audio stream data and send the audio stream data to the control center. The control center is also used to identify valid audio stream data in the audio stream data and send the valid audio stream data to the cloud service platform. A third control unit is configured to acquire the audio stream data by receiving a first input from the user; The first control unit corresponds to the normal mode; the second control unit corresponds to the home control mode, in which the smart headset is used to continuously collect mic audio and send it to the control center to realize multiple home control operations until the home control mode is exited; the third control unit corresponds to the home control power saving mode, in which the smart headset uses low power consumption to collect mic audio once by receiving the user's first input to perform home control. The control center is connected to the smart headset via Bluetooth and is used to decode the audio stream data to obtain pulse code modulation data. A cloud service platform is communicatively connected to the control center. The cloud service platform is used to perform speech recognition and semantic analysis on the pulse code modulation data to obtain the analysis result. If a home device corresponding to the analysis result exists in the digital home alliance library, a first control command is generated. The analysis result is used to indicate the type of home device to be controlled. The first home appliance is communicatively connected to the cloud service platform. The first home appliance belongs to the home appliances in the digital home alliance library. The first home appliance is used to perform the function corresponding to the first control command.

2. The smart home control system of claim 1, wherein, The smart headset and home device are equipped with an infrared communication module; The cloud service platform is also used to send the infrared key value to the control center when there is no home device corresponding to the parsing result in the digital home alliance library, but there is an infrared key value corresponding to the home device to be controlled in the infrared code library. The cloud service platform is also used to send a first prompt message to the control center when there is no home device corresponding to the parsing result in the digital home alliance library and no infrared key value corresponding to the home device to be controlled in the infrared code library. The control center is also used to generate a second prompt message upon receiving the infrared key value, and send the infrared key value to the smart headset; The smart headset is also used to establish an infrared connection with a second home device via an infrared communication module upon receiving the infrared key value. The second home device is not a home device in the digital home alliance library.

3. The smart home control system of claim 1, wherein, The smart home control system also includes: At least one APP application, the at least one APP application interacts with the cloud service platform via a network, and the at least one APP application is used to send a request instruction to the cloud service platform based on a second input from the user; The cloud service platform is also used to send the request command to the smart headset through the control center; The smart headset is also used to perform firmware upgrades according to the requested instructions.

4. The smart home control system of claim 3, wherein, The smart headset is also used to generate device information according to the request instruction, and send the device information to the at least one APP application in sequence through the control center and the cloud service platform; The at least one APP application is also used to display the device information.

5. A method of operating a smart home control system, characterized in that include: The audio stream data collected by the smart headset is sent to the control center; The smart headset includes: A first control unit is used to perform audio decoding and transmission of the audio stream data based on the Bluetooth audio transmission protocol; The second control unit is used to continuously collect the audio stream data and send the audio stream data to the control center. The control center is also used to identify valid audio stream data in the audio stream data and send the valid audio stream data to the cloud service platform. A third control unit is configured to acquire the audio stream data by receiving a first input from the user; The first control unit corresponds to the normal mode; the second control unit corresponds to the home control mode, in which the smart headset is used to continuously collect mic audio and send it to the control center to realize multiple home control operations until the home control mode is exited; the third control unit corresponds to the home control power saving mode, in which the smart headset uses low power consumption to collect mic audio once by receiving the user's first input to perform home control. Based on the control center's decoding of the audio stream data, pulse code modulation data is obtained; The pulse code modulation data is sent to the cloud service platform; Based on the cloud service platform, speech recognition and semantic analysis are performed on the pulse code modulation data to obtain the analysis result. If a home device corresponding to the analysis result exists in the digital home alliance library, a first control command is generated. The analysis result is used to indicate the type of home device to be controlled. The first control command is used to control the first home device to perform the function corresponding to the first control command. The first home device belongs to the home devices in the digital home alliance library.

6. The operation method of the smart home control system according to claim 5, wherein After obtaining the parsing result, the method further includes: If no home device corresponding to the parsing result exists in the digital home alliance database, but an infrared key value corresponding to the home device to be controlled exists in the infrared code database, the infrared key value is sent to the control center. When the control center generates a prompt message by receiving the infrared key value, it controls the control center to send the infrared key value to the smart headset; When the smart headset receives the infrared key value, it controls the smart headset to establish an infrared connection with the home device. 7.The method of Claim 5, wherein, The method further includes: When at least one APP application generates a request instruction by receiving a second input from the user, the at least one APP application is controlled to send the request instruction to the cloud service platform. When the cloud service platform sends the request instruction to the smart headset through the control center, it controls the smart headset to perform a firmware upgrade according to the request instruction.

8. An electronic device comprising a processor and a memory having a computer program stored therein, characterized in that, When the processor executes the computer program, it implements the steps of the operation method of the smart home control system according to any one of claims 5 to 7.

9. A computer program product comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the operation method of the smart home control system according to any one of claims 5 to 7.

Images