Dual-mode voice transmission method and system based on star flash and Bluetooth

Abstract

The invention discloses a dual-mode voice transmission method and system based on star flash and Bluetooth, and the method comprises the steps: S1, building a connection between a voice remote controller and an intelligent set top box through a Bluetooth protocol, and generating a Bluetooth connection state; s2, establishing connection between the voice remote controller and the adapter through a star flash protocol, and generating a star flash connection state; s3, according to the control mode selected by the user, the voice remote controller records and encodes voice data, and transmits the voice data to the intelligent set top box through Bluetooth or transmits the voice data to the adapter through star flash; s4, if in the set top box control mode, the intelligent set top box decodes and processes the voice data, and generates an instruction to control the set top box; if in the television control mode, the adapter decodes the audio data and then transmits the audio data to the smart television, and the television processes the voice data and executes corresponding operation. Therefore, the user can freely switch the control modes according to requirements, the operation flexibility is improved, the control process is simplified, and the use convenience and the user experience are remarkably improved.

Description

Technical Field

[0001] The present invention relates to the field of smart set-top boxes and smart televisions, and in particular to a dual-mode voice transmission method and system based on Starflash and Bluetooth. Background Art

[0002] With the rapid development of smart home technology, smart set-top boxes and smart TVs have become indispensable entertainment devices in modern families. In order to improve the user experience, voice interaction functions are widely used in these devices, allowing users to conveniently control the devices through voice commands. However, there is a significant technical limitation in the voice control systems currently on the market: the voice remote control only supports a single Bluetooth transmission path. This single transmission method leads to the following problems:

[0003] Poor connection flexibility: A voice remote control can only establish a Bluetooth connection with one device (smart set-top box or smart TV) at the same time and cannot connect to multiple devices at the same time. Cumbersome device switching: When the user needs to switch from controlling the set-top box to controlling the TV, the Bluetooth pairing with the set-top box must be unpaired first, and then a new pairing connection must be established with the TV. The operation process is complicated. Poor user experience: The frequent unpairing and re-pairing process is not only time-consuming, but also prone to technical problems such as pairing failure, which seriously affects the user experience. Limited usage scenarios: In a modern home environment with multiple smart devices, users often need to frequently switch control objects, and existing technologies cannot meet this demand for fast switching.

[0004] In the existing technical solutions, the transmission path of voice data is highly dependent on the Bluetooth protocol. After the user presses the voice button, the remote control collects the voice through the microphone, and transmits it to the paired device via Bluetooth after encoding and compression. The receiving device then decompresses and decodes the data and finally converts it into PCM data that can be used by the voice assistant. Although this process is mature in technology, the exclusivity of Bluetooth connection greatly limits the flexibility and convenience of the system.

[0005] Therefore, there is an urgent need for a dual-mode voice transmission method and system based on StarFlash and Bluetooth. Summary of the invention

[0006] The present invention provides a dual-mode voice transmission method and system based on Starflash and Bluetooth to solve the above problems existing in the prior art.

[0007] In order to achieve the above object, the present invention provides the following technical solutions:

[0008] A dual-mode voice transmission method based on Starflash and Bluetooth, comprising:

[0009] S1: The voice remote control establishes a connection with the smart set-top box through the Bluetooth protocol and generates a Bluetooth connection state;

[0010] S2: The voice remote control and the adapter establish a connection through the Star Flash protocol, generating a Star Flash connection state;

[0011] S3: According to the control mode selected by the user, the voice remote controller records and encodes the voice data and transmits it to the smart set-top box via Bluetooth or to the adapter via Star Flash;

[0012] S4: If in the set-top box control mode, the smart set-top box decodes and processes the voice data and generates instructions to control the set-top box;

[0013] If in TV control mode, the adapter decodes and transmits the audio data to the smart TV, and the TV processes the voice data and performs corresponding operations.

[0014] Among them, step S1 includes:

[0015] S11: The voice remote control enables the Bluetooth protocol, sets the local Bluetooth MAC address and broadcast format data, and starts Bluetooth broadcasting;

[0016] S12: The smart set-top box starts the Bluetooth module, scans the voice remote control, and initiates a connection request to the voice remote control;

[0017] S13: After the voice remote controller responds to the connection request, the smart set-top box initiates a pairing request to the voice remote controller, and the voice remote controller responds and saves the MAC address of the smart set-top box, completing the Bluetooth connection and pairing.

[0018] Among them, step S2 includes:

[0019] S21: The voice remote control and the adapter enable the Star Flash protocol and complete the initialization of the Star Flash protocol;

[0020] S22: Based on the initialization state of the Star Flash protocol, the voice remote controller initiates a pairing broadcast, and the adapter discovers the device and initiates a connection request;

[0021] S23: After the voice remote controller responds to the connection request, the adapter initiates a pairing request, and the voice remote controller saves the pairing information of the adapter, completing the Star Flash connection and pairing.

[0022] The recorded voice data in step S3 includes:

[0023] S31: When the voice button is pressed, the voice remote controller initializes the microphone driver and starts recording;

[0024] S32: converting the recorded sound into digital audio data through digital-to-analog conversion;

[0025] S33: When the voice button is released, the microphone driver is deinitialized and recording is stopped;

[0026] During the recording process, audio data is continuously encoded and sent over the selected transmission channel.

[0027] The encoded speech data in step S3 includes:

[0028] S34: receiving original audio data obtained after the voice remote controller picks up the sound;

[0029] S35: uses the SBC encoding algorithm to compress the original audio data, with a sampling rate of 16kHz, a block size of 16, mono, and 8 sub-bands;

[0030] S36: Generate encoded voice data.

[0031] The transmission to the smart set-top box via Bluetooth in step S3 includes:

[0032] S37: Based on the Bluetooth connection status, the voice remote control creates and starts a GATT service as the server, generating a Bluetooth transmission channel;

[0033] S38: The smart set-top box discovers GATT services and characteristics as a client and prepares to receive data;

[0034] S39: The voice remote controller sends the encoded voice data packet to the smart set-top box through the GATT interface to complete the Bluetooth protocol transmission.

[0035] The transmission to the adapter through Starflash in step S3 includes:

[0036] S3-1: Based on the Star Flash connection status, the voice remote control creates and starts the SSAP service as the server to establish the Star Flash transmission channel;

[0037] S3-2: The adapter, as the client, discovers the attribute structure of the SSAP service and initiates a read request, preparing to receive data;

[0038] S3-3: The voice remote control sends the encoded voice data packet to the adapter through the SSAP interface to complete the Star Flash protocol transmission.

[0039] Among them, step S4 includes:

[0040] S41: In the set-top box control mode, the smart set-top box decodes the voice data using the SBC decoding algorithm to generate PCM clear stream data;

[0041] S42: In TV control mode, the adapter decodes the voice data using the SBC decoding algorithm to generate PCM clear stream data;

[0042] S43: In the TV control mode, the adapter transmits the PCM clear stream data to the smart TV via the UAC protocol.

[0043] Among them, the TV processing of voice data in step S4 includes:

[0044] S44: The smart TV transmits the PCM clear stream data to the voice platform. The voice platform converts the audio data into text, performs word segmentation processing, understands the intention, retrieves data, and generates operation instructions.

[0045] Among them, a dual-mode voice transmission system based on StarFlash and Bluetooth includes:

[0046] A Bluetooth connection module, used for the voice remote control and the smart set-top box to establish a connection through the Bluetooth protocol and generate a Bluetooth connection status;

[0047] A StarFlash connection module, used for the voice remote control and the adapter to establish a connection through the StarFlash protocol and generate a StarFlash connection status;

[0048] An interaction control module, used to record and encode voice data by the voice remote control according to the selected control mode and transmit it to the smart set-top box through Bluetooth or to the adapter through StarFlash;

[0049] A data processing module, used for:

[0050] If in the set-top box control mode, the smart set-top box decodes and processes the voice data to generate instructions to control the set-top box;

[0051] If in the TV control mode, the adapter decodes and then transmits the audio data to the smart TV, and the TV processes the voice data and performs corresponding operations.

[0052] Compared with the prior art, the present invention has the following advantages:

[0053] A dual-mode voice transmission method based on StarFlash and Bluetooth includes: S1: The voice remote control and the smart set-top box establish a connection through the Bluetooth protocol to generate a Bluetooth connection status; S2: The voice remote control and the adapter establish a connection through the StarFlash protocol to generate a StarFlash connection status; S3: According to the selected control mode, the voice remote control records and encodes voice data and transmits it to the smart set-top box through Bluetooth or to the adapter through StarFlash; S4: If in the set-top box control mode, the smart set-top box decodes and processes the voice data to generate instructions to control the set-top box; if in the TV control mode, the adapter decodes and then transmits the audio data to the smart TV, and the TV processes the voice data and performs corresponding operations. Users can freely switch the control mode according to their needs, which not only improves the flexibility of operation but also simplifies the control process, thus significantly enhancing the usability and user experience.

[0054] Other features and advantages of the present invention will be described in the subsequent specification, and part of them will become obvious from the specification or be understood by implementing the present invention.

[0055] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Description of the Drawings

[0056] The accompanying drawings are used to provide a further understanding of the present invention, and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention, but do not constitute a limitation to the present invention. In the accompanying drawings:

[0057] Figure 1 It is a flowchart of a dual - mode voice transmission method based on StarFlash and Bluetooth in an embodiment of the present invention;

[0058] Figure 2 It is a flowchart of generating a Bluetooth connection status in an embodiment of the present invention;

[0059] Figure 3 It is a structural diagram of a dual - mode voice transmission system based on StarFlash and Bluetooth in an embodiment of the present invention. Detailed Embodiments

[0060] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0061] An embodiment of the present invention provides as Figure 1 shown, a dual - mode voice transmission method based on StarFlash and Bluetooth, including:

[0062] S1: The voice remote control establishes a connection with the smart set - top box through the Bluetooth protocol to generate a Bluetooth connection status;

[0063] S2: The voice remote control establishes a connection with the adapter through the StarFlash protocol to generate a StarFlash connection status;

[0064] S3: According to the control mode selected by the user, the voice remote control records and encodes voice data, and transmits it to the smart set - top box through Bluetooth or to the adapter through StarFlash;

[0065] S4: If in the set - top box control mode, the smart set - top box decodes and processes the voice data to generate an instruction to control the set - top box;

[0066] If in the TV control mode, the adapter decodes and then transmits the audio data to the smart TV, and the TV processes the voice data and performs corresponding operations.

[0067] The working principle of the above - mentioned technical solution is: S1. The voice remote control establishes a connection with the smart set - top box through the Bluetooth protocol to generate a Bluetooth connection status

[0068] When the voice remote controller is started, it calls the enable_ble interface to enable the Bluetooth protocol. The function of this interface is to start the Bluetooth protocol stack. The voice remote controller calls the gap_ble_set_local_addr interface to set the local Bluetooth MAC address. The function of this interface is to configure the device identification address used in the Bluetooth pairing process. Then, the voice remote controller calls the gap_ble_set_adv_data interface to set the relevant parameters of the broadcast. The function of this interface is to configure the broadcast data format and content used in Bluetooth pairing.

[0069] After the smart set-top box is started, the function of the onboard Bluetooth module is started, the pairing state is entered, the device scanning parameters are set, and the scanning interface is called to start the device scan; after the smart set-top box scans the remote control device, the connection interface is called to initiate a connection request to the voice remote control, and the voice remote control responds to the connection request; after the smart set-top box detects the connection response, it calls the gap_ble_pair_remote_device interface to initiate a pairing request to the voice remote control. The function of this interface is to pair with the onboard Bluetooth module of the set-top box; the voice remote control responds to the pairing request and saves the pairing information of the smart set-top box (such as MAC address) to the internal storage of the remote control; through the above steps, the voice remote control and the smart set-top box complete the Bluetooth connection pairing process, establish a stable Bluetooth communication link, and generate a Bluetooth connection state.

[0070] S2. The voice remote control and the adapter establish a connection through the Star Flash protocol, generating the Star Flash connection status

[0071] The voice remote control and adapter enable the Star Flash protocol during the startup process; when the voice remote control enters the pairing state, it initiates a pairing broadcast and calls the public device interface to disclose the remote control device information; when the adapter enters the pairing state, it calls the device discovery interface to discover the voice remote control device to be connected and paired in the surrounding environment;

[0072] After the adapter finds the voice remote control device, it calls the connection request interface to initiate a connection request; after receiving the connection request, the voice remote control responds to the adapter's connection request; after the adapter detects that the connection is successful, it calls the pairing interface to initiate a pairing request; the voice remote control processes the pairing request and saves the adapter's pairing information (such as the unique identifier MAC address) to the remote control's internal storage; through the above steps, the voice remote control and the adapter complete the Star Flash connection pairing process, establish a stable Star Flash communication link, and generate a Star Flash connection status.

[0073] S3. The user selects the control mode through the voice remote control button or voice command, and the remote control records the code and transmits the voice data

[0074] The selection of the control mode includes: the user selects "set-top box control mode" or "TV control mode" through the physical buttons on the voice remote controller or through voice commands; the system transmits the user's selection to the control chip of the voice remote controller for subsequent determination of the transmission channel of the voice data;

[0075] The steps of recording by the voice remote control include: when the user presses the voice button of the remote control, the voice remote control initializes the microphone-related driver, and after the initialization, the microphone records the user's voice and converts the sound signal into digital audio data through a digital-to-analog conversion method; when the voice button is released, the voice remote control deinitializes the microphone and stops recording the user's voice;

[0076] The steps of encoding the voice data include: obtaining the original audio data after the voice remote control picks up the sound. At this time, the amount of audio data is large. In order to ensure stable transmission on the Bluetooth or Star Flash protocol, it is necessary to use an audio encoding algorithm to encode and compress the audio data; the encoding algorithm used is the SBC algorithm, and its sampling rate is set to 16kHz, the block size is 16, the mono channel, and the number of sub-bands is 8; the SBC algorithm divides the audio data into sub-band data of different frequency bands, and then converts the sub-band data into baseband data through frequency shifting, and finally samples, quantizes and encodes them to form compressed audio data; by setting the sampling rate, bit depth, number of channels, number of sub-bands, block length, allocation method and minimum allocation unit of the SBC algorithm, the encoding interface of the encoding algorithm is called to encode and compress the audio data to generate encoded voice data;

[0077] Depending on the selected control mode, there are two ways to transmit voice data: if the set-top box control mode is selected, the voice data is transmitted through the Bluetooth GATT service; if the TV control mode is selected, the voice data is transmitted through the Star Flash SSAP service;

[0078] The steps for sending voice data via Bluetooth GATT include: The Bluetooth protocol transmits data through the GATT service. Here, the voice remote control is the Server side, and the smart set-top box is the Client side. The voice remote control calls the gatts_register_server interface to create a Server. The function of this interface is to register the Generic Attribute Profile Server for the data transmission service side. According to the agreed UUID value (c1764e61-a0bc-4e0c-0dcf-23b4338b7901), the voice remote control uses the gatts_add_service interface to create a Service. The function of this interface is to add a service for the server to send data. Then it calls the gatts_add_characteristic interface to add a characteristic value to the created service. The function of this interface is to add a characteristic to the added service, and subsequent data transmission filters data through this characteristic. It uses the gatts_add_descriptor interface to add descriptor information to the characteristic in the service. The function of this interface is to add descriptive information to the corresponding characteristic, including configuration information, data format, etc. Finally, it calls the gatts_start_service interface to start the service. The function of this interface is to officially start the content of the server side, indicating that voice data can be transmitted. The smart set-top box calls the gattc_register_client interface to create a Client. The function of this interface is to register the Generic Attribute Profile client. Then it calls the gattc_discovery_service interface to discover the service. The function of this interface is to discover the service with the UUID of c1764e61-a0bc-4e0c-0dcf-23b4338b7901. Then it calls the gattc_discovery_character interface to discover the characteristic. The function of this interface is to discover the characteristic for voice data transmission. Finally, it calls the gattc_discovery_descriptor interface to discover the descriptor. The function of this interface is to discover the descriptor information corresponding to the voice data transmission characteristic. Through the above interfaces, the service, characteristic, and descriptor attribute information of the voice remote control are obtained, and the MTU size request is interacted. After the voice remote control service and the smart set-top box service are connected, the remote control sends a voice start packet, voice data packets, and a voice end packet. Among them, the voice start packet is sent when the voice key is pressed, and the voice end packet is sent when the voice key is released. Voice data packets are continuously sent between the voice start and end packets. The voice data packets are sent to the smart set-top box through the gatts_notify_indicate interface. The function of this interface is to send voice data. After the smart set-top box receives the voice data, it processes the data;

[0079] The steps for sending voice data through SparkLink SSAP are as follows: The SparkLink system transmits data through the SSAP general specification. Among them, the voice remote control is the Server side, and the adapter connected to the smart TV is the Client side; The voice remote control calls the ssaps_register_server interface to create a Server. The function of this interface is to register a server for transmitting voice data; Create a Service using the ssaps_add_service_sync interface according to the agreed UUID. The function of this interface is to add a service service to the server; Then call the ssaps_add_property_sync interface to add characteristic values to the created service. The function of this interface is to add characteristic values for carrying voice data to the service; Use the ssaps_add_descriptor_syn interface to add descriptor information to the characteristics in the service. The function of this interface is to add description information for the characteristics carrying voice data, such as configuration information and format, etc.; Finally, call the ssaps_start_service interface to start the service. The function of this interface is to officially start the server for voice data transmission; The adapter calls the ssapc_register_client interface to create a Client. The function of this interface is to register a client for receiving voice data; Recursively call the ssapc_find_structure interface to find the voice remote control property data. The function of this interface is to find the service, characteristics, and descriptor information corresponding to the characteristics carrying voice data; Finally, send a ssapc_read_req request to the voice remote control. The function of this interface is to receive the voice data sent from the server; After the voice remote control service and the adapter service are connected, the voice remote control first sends a voice start packet, voice data packets, and voice end packet. Among them, the voice start packet is sent when the voice key is pressed, and the voice end packet is sent when the voice key is released. Voice data is continuously sent between the voice start packet and the end packet; The voice data packets are sent to the adapter through the ssaps_notify_indicate interface. The function of this interface is for the server to transmit voice data to the client; After receiving the voice data, the adapter sends it to the TV through UAC.

[0080] S4. The smart set-top box or adapter decodes and processes the voice data and performs corresponding operations

[0081] If in the set-top box control mode, the steps for decoding voice data include: after the smart set-top box receives the encoded audio data, it cannot be directly used, and the SBC encoding algorithm needs to be used to decompress and decode the audio data; during the decoding process, by setting the same SBC algorithm parameters as those during encoding, including attributes such as sampling rate, bit depth, number of channels, number of subbands, block length, allocation method, and minimum allocation unit, the decoding interface of the encoding algorithm is called to decode the audio data; the decoding process specifically includes: first parsing the audio frame, then decoding the frame header information, then decoding the subband signal, and finally reconstructing the time-domain signal, and finally obtaining the PCM clear stream data for subsequent processing;

[0082] The steps for using voice data include: the voice assistant in the smart set-top box transmits the audio data to the voice platform, the voice platform performs natural speech translation on the audio data, performs word segmentation on the translated natural speech, and understands the user's intention after word segmentation; after parsing and segmenting the audio text data, extract the feature words, according to the extracted intention features, compare with the live channel and media asset corpus pre-stored in the voice server, and then perform data retrieval according to the user's intention; finally, convert the retrieved data into an operation instruction to realize the voice control operation of the smart set-top box;

[0083] If in the TV control mode, the steps for the voice data to be sent to the TV through UAC include: the adapter decodes and decompresses the received voice data to obtain the PCM clear stream data; the decoding process is the same as the above set-top box decoding process, and the SBC algorithm is also used; the decoded PCM clear stream data is transmitted to the smart TV system through the standard interface of the USB audio transmission protocol (UAC), and finally read and used by the voice assistant application built into the TV;

[0084] The steps for the TV to process voice data and execute corresponding operations include: after the smart TV receives the audio data, the built-in voice assistant transmits the audio data to the voice platform for processing; the processing process is similar to the steps for the set-top box to process voice data, including natural speech translation, word segmentation processing, user intention understanding, data retrieval, and instruction generation; finally, control the smart TV to execute corresponding operations according to the generated instructions, such as switching channels, adjusting the volume, opening applications, etc.

[0085] S5. The voice remote control transmits voice data through Bluetooth and XingShan dual-mode transmission to realize the control of the smart set-top box and the smart TV

[0086] The voice remote control has both Bluetooth connection capabilities and XingShan connection capabilities, and establishes communication links with the smart set-top box and the smart TV (through an adapter) through these two different connection methods respectively; when the voice remote control is in the set-top box control mode, the voice remote control transmits voice data to the smart set-top box through the Bluetooth channel; when the voice remote control is in the TV control mode, the voice remote control transmits voice data to the adapter through the XingShan channel, and then the adapter transmits it to the smart TV;

[0087] By switching the control mode, users can use the same voice remote control to control the smart set-top box and the smart TV respectively, realizing the dual-mode control function of the voice remote control; the Bluetooth mode is mainly used for connection and control with the smart set-top box, and the XingShan mode is mainly used for connection and control with the smart TV; the voice remote control realizes the ability to transmit voice data in both Bluetooth and XingShan dual modes, meeting the need to control multiple devices with one remote control.

[0088] The beneficial effects of the above technical solution are as follows: by combining XingShan and Bluetooth technologies, the voice remote control can flexibly select to transmit voice data to the smart set-top box through the Bluetooth protocol or transmit audio data to the adapter through the XingShan protocol, thereby realizing voice control of the smart set-top box and the smart TV. This dual-mode transmission mechanism solves the problem of the single transmission path of traditional remote controls. Users can freely switch the control mode according to their needs, which not only improves the flexibility of operation but also simplifies the control process, thus significantly enhancing the usability and user experience.

[0089] In another embodiment, as Figure 2 shown, step S1 includes:

[0090] S11: The voice remote control enables the Bluetooth protocol, sets the local Bluetooth MAC address and broadcast format data, and starts Bluetooth broadcasting;

[0091] S12: The smart set-top box starts the Bluetooth module. After scanning the voice remote control, it sends a connection request to the voice remote control;

[0092] S13: After the voice remote control responds to the connection request, the smart set-top box sends a pairing request to the voice remote control. The voice remote control responds and saves the MAC address of the smart set-top box, completing the Bluetooth connection and pairing.

[0093] The working principle of the above technical solution is as follows: After the voice remote control is started, it first calls the enable_ble interface to enable the Bluetooth protocol. The function of this interface is to activate the built-in Bluetooth protocol stack of the remote control, making the Bluetooth module in a working state. After enabling, the voice remote control calls the gap_ble_set_local_addr interface to set the local Bluetooth MAC address. The function of this interface is to configure the unique identifier used by the remote control during the pairing process. Subsequently, the remote control calls the gap_ble_set_adv_data interface to set the relevant parameters of the broadcast. This interface is used to configure the format, content, and broadcast interval time (usually any value between 100 ms and 500 ms) of the Bluetooth broadcast data packet. The broadcast data packet contains the device type identifier (voice remote control), manufacturer information, and supported service list of the remote control, etc., so that the smart set-top box can identify and distinguish other Bluetooth devices. After the configuration is completed, the voice remote control starts Bluetooth broadcasting and periodically sends broadcast data packets to the surrounding environment.

[0094] After the smart set-top box is started, it automatically activates the on-board Bluetooth module and enters the device scanning state. The set-top box first sets the scanning parameters, including the scanning window (any value between 10 ms and 30 ms) and the scanning interval (any value between 30 ms and 100 ms), and then calls the scanning interface to start device scanning. During the scanning process, the set-top box receives Bluetooth broadcast data packets in the surrounding environment and analyzes the content of the data packets. When the set-top box detects a broadcast data packet from the voice remote control, it extracts the MAC address and device information of the remote control and verifies whether its device type is a voice remote control. After the verification is passed, the set-top box calls the connection interface to initiate a connection request to the voice remote control. The connection request contains information such as the MAC address of the set-top box, connection parameters (such as connection interval, timeout time, and slave device latency), etc.

[0095] After the voice remote control receives the connection request, it verifies the request parameters, including whether the connection interval is within the acceptable range (between 20 ms and 50 ms) and whether the timeout time is reasonable (between 2000 ms and 5000 ms). After the verification is passed, the voice remote control sends a connection response data packet, accepts the connection request, and enters the connection state. At this time, a preliminary Bluetooth connection is established between the remote control and the set-top box, but the pairing process has not been completed.

[0096] After the smart set-top box detects the connection response, it calls the gap_ble_pair_remote_device interface to initiate a pairing request to the voice remote control. The function of this interface is to perform a secure pairing with the voice remote control on the basis of an established connection and exchange encryption keys. The pairing request contains information such as the security level, encryption method, and pairing method supported by the set-top box. After receiving the pairing request, the voice remote control verifies the pairing parameters and stores the MAC address and pairing information of the set-top box in the non-volatile memory for quick reconnection later. Subsequently, the voice remote control sends a pairing response data packet to the set-top box to confirm the acceptance of the pairing request.

[0097] After the pairing is completed, a secure Bluetooth connection channel is established between the voice remote control and the smart set-top box, and the two parties can exchange data through this channel. After the connection is established, the voice remote control will send a connection parameter update request regularly (the interval is usually between 500 ms and 1000 ms) to optimize the connection parameters and ensure connection stability and low-power operation. When the voice remote control detects a low battery state (the battery level is lower than 20%), it will automatically adjust the connection parameters and extend the connection interval (increased to between 100 ms and 200 ms) to reduce power consumption and extend the battery usage time.

[0098] During subsequent use, when the voice remote control is restarted, it will first check the stored pairing information. If there is a paired set-top box MAC address, it will directly initiate a directed broadcast to this address to accelerate the reconnection process. After receiving the directed broadcast, the smart set-top box recognizes that it is a paired remote control and will give priority to establishing a connection without having to perform a complete pairing process again, thus improving the user experience.

[0099] When the distance between the smart set-top box and the voice remote control exceeds the communication range (usually 10 meters), the connection will be automatically disconnected. At this time, the remote control will re-enter the broadcast state, and the set-top box will enter the scanning state. When the two parties approach each other again within the communication range, the connection can be automatically re-established. If the reconnection fails continuously for more than 3 times, the voice remote control will clear the stored pairing information, and the user needs to perform a complete pairing process again.

[0100] The beneficial effects of the above technical solution are as follows: Through the broadcast, connection, and pairing mechanisms of the Bluetooth protocol, the voice remote control can establish a stable and reliable connection with the smart set-top box. This connection method supports the efficient transmission of voice data and ensures the stability and security of data transmission. Therefore, users can use a single remote control to accurately control the smart set-top box through Bluetooth technology, solving the problem of the single connection method of traditional remote controls and improving the fluency and convenience of operations.

[0101] In another embodiment, step S2 includes:

[0102] S21: The voice remote control and the adapter enable the SparkLink protocol to complete the initialization of the SparkLink protocol.

[0103] S22: Based on the initialization status of the SparkLink protocol, the voice remote control initiates a pairing broadcast, and the adapter discovers the device and initiates a connection request.

[0104] S23: After the voice remote control responds to the connection request, the adapter initiates a pairing request, and the voice remote control saves the pairing information of the adapter to complete the SparkLink connection and pairing.

[0105] Among them, step S22 includes:

[0106] In the initialization state, the voice remote control generates a pairing broadcast signal containing the device unique identifier, supported protocol version, and current available bandwidth information through communication with the SparkLink protocol communication module configured inside the device, and broadcasts this signal through the SparkLink protocol.

[0107] After receiving the pairing broadcast signal, the adapter parses the device unique identifier, protocol version, and current available bandwidth information in the signal, determines whether it is compatible with its own protocol version, and generates device discovery confirmation data based on the current available bandwidth information.

[0108] Based on the device discovery confirmation data and combined with its own voice transmission requirements, the adapter generates a connection request signal containing expected bandwidth allocation parameters and sends it to the voice remote control through the SparkLink protocol.

[0109] After receiving the connection request signal, the voice remote control establishes a connection with the adapter according to the expected bandwidth allocation parameters contained therein and configures an adaptive bandwidth allocation strategy to dynamically adjust the bandwidth according to the voice transmission requirements.

[0110] The generation of the pairing broadcast signal includes broadcasting signal packets at a preset time interval, which can be configured as any value between 1 second and 5 minutes, and the number of broadcast groups is M groups, where M is greater than or equal to 2, so that the adapter can resample the signal to improve the accuracy of device discovery.

[0111] The configuration of the adaptive bandwidth allocation strategy includes retrieving the policy data corresponding to the expected bandwidth allocation parameters from a pre-constructed bandwidth allocation policy library; among them, the bandwidth allocation policy library is constructed by professional personnel based on a large amount of voice transmission scenario data in advance, and the expected bandwidth allocation parameters in the library are in one-to-one correspondence with the policy data.

[0112] The expected bandwidth allocation parameters include the expected voice transmission rate, latency requirements, and packet priority; to improve the stability of the connection, time data can also be added, that is, parameter data representing the current time is added when generating the connection request signal.

[0113] The SparkLink protocol utilizes its high-bandwidth feature to support the real-time transmission of extended information in the pairing broadcast signal during the initialization phase. The extended information includes the operating status of the device and the voice transmission priority, aiming to optimize the device discovery efficiency of the adapter.

[0114] The working principle of the above technical solution is as follows: S21: During the startup process, the voice remote control and the adapter first need to enable the SparkLink protocol. Specifically, after the voice remote control is powered on and starts up, its internal microprocessor will execute a preset initialization program, call the initialization function of the SparkLink protocol stack, and allocate necessary system resources for the SparkLink protocol, including memory buffers, communication interfaces, and protocol state machines, etc. At the same time, the voice remote control will load the pre-stored SparkLink protocol parameter configurations, such as communication frequency bands, transmit power, receive sensitivity, and other parameters. The adapter also executes similar SparkLink protocol initialization steps during startup to ensure that it uses the same version of the SparkLink protocol as the voice remote control and configures compatible communication parameters. After the initialization is completed, both the voice remote control and the adapter enter the protocol ready state and have the ability to communicate based on the SparkLink protocol.

[0115] S22: Based on the SparkLink protocol initialization status, when the voice remote control needs to establish a connection with the adapter, it enters the pairing state and actively initiates a pairing broadcast. Specifically, the voice remote control broadcasts its own device information into the surrounding environment through the public device interface function of the SparkLink protocol stack. This broadcast information includes the unique identifier of the voice remote control (such as device ID or MAC address), device type identifier, protocol version number, and supported service list, etc. The broadcast frames are sent periodically at a preset time interval (usually between 100 milliseconds and 500 milliseconds) to increase the probability of being discovered.

[0116] Meanwhile, the adapter in the pairing state continuously scans the device broadcast information in the surrounding environment by calling the device discovery interface function of the SparkLink protocol stack. When the adapter receives the broadcast frame sent by the voice remote control, it will parse the frame content, extract the device information of the voice remote control, and match it with the preset connectable device types. If it is confirmed as a valid voice remote control device, the adapter will send a connection request data packet to the target voice remote control through the connection request interface function of the SparkLink protocol stack. This request packet contains the device identifier of the adapter, supported communication parameters, and security verification information, etc.

[0117] S23: After receiving the connection request sent by the adapter, the voice remote control first verifies whether the security information in the request is valid. After passing the verification, the voice remote control sends a connection response data packet to the adapter through the connection response interface function of the SparkLink protocol stack, indicating that it accepts the connection request. At this time, a basic communication link is established between the voice remote control and the adapter, but the complete pairing process has not been completed.

[0118] After the adapter detects that the connection is successfully established, it further calls the pairing interface function of the NearLink protocol stack to send a pairing request data packet to the voice remote control. This data packet contains detailed configuration information of the adapter, communication parameters, and encryption keys for subsequent communication. The voice remote control receives and processes the pairing request, and saves the pairing information of the adapter, including but not limited to the unique identifier of the adapter (such as MAC address), device type, supported function list, and communication encryption key, etc. to the non-volatile memory. At the same time, the voice remote control sends a pairing confirmation message to the adapter, indicating that the pairing information has been successfully saved.

[0119] At this point, the NearLink connection and pairing process between the voice remote control and the adapter are all completed, and a secure communication channel is established between the two devices, and normal communication operations such as subsequent command transmission and status feedback can be started. Since the pairing information is persistently stored, even after the device is restarted, the connection can be quickly re-established based on the saved pairing information without repeating the complete pairing process.

[0120] The beneficial effects of the above technical solution are: through the initialization and pairing broadcast mechanism of the NearLink protocol, the voice remote control can be quickly discovered by the adapter and an efficient connection can be established. This connection method supports high-speed transmission of voice data, ensuring the real-time and accuracy of voice control. Users can flexibly control the smart TV using NearLink technology, breaking through the limitation of the single transmission path of traditional remote controls, and improving the pairing efficiency and usage convenience between devices.

[0121] In another embodiment, the recording of voice data in step S3 includes:

[0122] S31: When the voice key is pressed, the voice remote control initializes the microphone driver and starts recording;

[0123] S32: Convert the recorded sound into digital audio data through digital-to-analog conversion;

[0124] S33: When the voice key is released, de-initialize the microphone driver and stop recording;

[0125] During the recording process, the audio data is continuously encoded and sent through the selected transmission channel.

[0126] The working principle of the above technical solution is as follows: When the user presses the voice key on the voice remote control, the voice remote control first performs microphone driver initialization operations. These initialization operations include: activating the microphone hardware circuit, setting the microphone sampling parameters (the sampling rate can be set to any value from 8 kHz to 48 kHz, and the typical value is 16 kHz; the bit depth can be set to any value from 8 bits to 24 bits, and the typical value is 16 bits), and allocating an audio data buffer (the buffer size is usually set to the amount of audio data from 10 ms to 200 ms). After the initialization is completed, the microphone immediately enters the working state and starts to collect the user's voice signal.

[0127] During the recording process, the analog voice signal collected by the microphone is converted into digital audio data through the built-in analog-to-digital converter (ADC). In this conversion process, the analog signal first undergoes gain adjustment through a preamplifier (the gain range is any value from 0 dB to 40 dB), then undergoes anti-aliasing processing through a low-pass filter (the cut-off frequency is usually half of the sampling rate), and finally is quantized by the ADC at the preset sampling rate and bit depth to generate a digital audio data stream in PCM (pulse code modulation) format.

[0128] To improve the transmission efficiency, the voice remote control performs real-time encoding and compression on the collected PCM data. Optional encoding algorithms include: ADPCM (adaptive differential pulse code modulation, the compression ratio is about 1 / 4), G.711 (the compression ratio is about 1 / 2), opus encoding (the compression ratio can be dynamically adjusted, usually from 1 / 6 to 1 / 10), etc. The encoded audio data is packaged into data packets (each data packet contains audio data from 10 ms to 60 ms), and timestamp and sequence number information are attached, and then sent to the receiving device through a pre-selected transmission channel (such as 2.4 GHz radio frequency, Bluetooth, WiFi, or infrared).

[0129] When the user releases the voice key, the voice remote control detects the key-up event and immediately performs microphone driver de-initialization operations. These operations include: sending an end-of-recording flag data packet, stopping microphone collection, turning off the ADC, releasing the audio data buffer, and turning off the microphone power. To ensure that all the collected audio data can be transmitted completely, the voice remote control will confirm that the last group of audio data has been encoded and sent before turning off the microphone.

[0130] In special cases, such as when no valid voice input is detected for 5 consecutive seconds (configurable to any value from 1 second to 10 seconds), the voice remote control can automatically enter the low-power standby mode to reduce battery consumption; when a voice signal is detected again or the user presses the voice key again, it immediately resumes the normal recording state. In addition, when the battery level of the voice remote control is lower than the preset threshold (usually 10% to 20%), the available time can be extended by reducing the sampling rate and encoding quality, and at the same time, the user is reminded to replace the battery through the LED indicator or by sending a specific status code.

[0131] The beneficial effects of the above technical solution are as follows: The voice remote control triggers the microphone to record by pressing a button and converts the voice into digital audio data in real time, achieving the rapid capture and processing of voice commands. This real-time recording and conversion mechanism ensures the timeliness and accuracy of voice data, providing a reliable basis for subsequent transmission to the smart set-top box or adapter via Bluetooth or XingFlash. As a result, users can complete voice control more naturally and efficiently, and the operation process is more convenient.

[0132] In another embodiment, the encoded voice data in step S3 includes:

[0133] S34: Receive the original audio data obtained after the voice remote control picks up sound;

[0134] S35: Compress the original audio data using the SBC encoding algorithm, with a sampling rate of 16 kHz, a block size of 16, mono, and the number of sub-bands of 8;

[0135] S36: Generate the encoded voice data.

[0136] The working principle of the above technical solution is as follows: The voice remote control captures the sound signal emitted by the user through the built-in microphone, converts the sound wave into an electrical signal, and then converts the analog electrical signal into digital audio data through an analog-to-digital converter. The original audio data obtained at this stage usually has a high data volume, and direct transmission may cause unstable transmission of the Bluetooth or XingFlash protocol. Therefore, it is necessary to compress and encode the original audio data to reduce the data volume while maintaining sufficient audio quality.

[0137] To ensure the stable transmission of voice data, the system uses the SBC (Sub-band Coding) algorithm to compress and encode the original audio data. The SBC encoding process specifically includes the following steps:

[0138] Sub-band division: The SBC algorithm first decomposes the spectrum of the original audio data into multiple sub-bands of different frequency bands. In this system, the number of sub-bands is set to 8, and the complete audio spectrum is divided into 8 different frequency ranges.

[0139] Frequency Shift: The data of each sub-band is subjected to frequency shift processing to convert the sub-band data of each frequency band into baseband data for subsequent processing.

[0140] Sampling Processing: The system samples the baseband data, and the sampling rate is set to 16 kHz, which can effectively capture the main frequency components of human speech while keeping the data volume within a reasonable range.

[0141] Quantization Coding: The sampled data is quantized, mapping the sampling values to a finite number of numerical levels and then encoding. The system sets the block size to 16, that is, 16 sample points are processed as one encoding unit each time.

[0142] Mono Processing: Considering the application scenario of voice transmission, the system processes audio data in mono mode, which can further reduce the data volume compared to stereo and is more suitable for the transmission of voice information.

[0143] By adjusting the above parameters (sampling rate, block size, number of channels, number of sub-bands, etc.) of the SBC algorithm, the system can achieve a good balance between audio quality and data volume and realize the effective compression of voice data.

[0144] After being processed by the SBC encoding algorithm, the volume of the original audio data is significantly reduced, while still retaining the key features of the voice information. The encoded voice data is generated in the form of a digital bit stream and can be stably transmitted to the receiving device through Bluetooth or the XingShan protocol. After receiving the encoded data, the receiving device can restore it to a playable audio signal through the corresponding decoding algorithm.

[0145] The beneficial effects of the above technical solution are as follows: Compressing voice data using the SBC encoding algorithm not only effectively reduces the bandwidth requirements for data transmission but also optimizes the transmission efficiency while ensuring voice clarity. This encoding mechanism enables the voice remote control to stably transmit high-quality voice data through Bluetooth or XingShan technology, solves the problem of data redundancy during transmission, and provides users with a smooth and efficient control experience.

[0146] In another embodiment, the transmission to the smart set-top box via Bluetooth in step S3 includes:

[0147] S37: Based on the Bluetooth connection status, the voice remote control creates and starts a GATT service as the Server side to generate a Bluetooth transmission channel;

[0148] S38: The smart set-top box, as the Client side, discovers the GATT service and characteristics and prepares to receive data;

[0149] S39: The voice remote control sends the encoded voice data packet to the smart set-top box through the GATT interface to complete the Bluetooth protocol transmission.

[0150] The working principle of the above technical solution is as follows: The voice remote control acts as the server of Bluetooth communication. After confirming the establishment of a Bluetooth connection with the smart set-top box, it needs to establish a service and start a transmission channel through a specific interface. When the voice remote control detects that the Bluetooth connection status is the connected state, the voice remote control completes the registration of the server by calling the gatts_register_server interface. After the registration is completed, the voice remote control calls the gatts_add_service interface to create a service according to the pre-agreed UUID value (c1764e61-a0bc-4e0c-0dcf-23b4338b7901). This service is specifically used for subsequent voice data transmission operations.

[0151] To ensure that the service can correctly transmit voice data, the voice remote control further calls the gatts_add_characteristic interface to add a characteristic value to the created service. This characteristic value is used to filter and identify the transmitted voice data in the future. At the same time, the voice remote control also needs to call the gatts_add_descriptor interface to add descriptor information to the characteristic value, including key information such as configuration parameters and data formats, to ensure that the smart set-top box can correctly parse the received data. When the service, characteristic value, and descriptor are all configured, the voice remote control calls the gatts_start_service interface to officially start the GATT service. At this time, the Bluetooth transmission channel is successfully established, and the voice remote control is ready to transmit voice data to the smart set-top box.

[0152] On the smart set-top box side, as the client of Bluetooth communication, it needs to discover and prepare to receive the data transmitted by the voice remote control through a series of operations. The smart set-top box first calls the gattc_register_client interface to register the client, and then actively discovers the service with the UUID of c1764e61-a0bc-4e0c-0dcf-23b4338b7901 created by the voice remote control through the gattc_discovery_service interface. After the service discovery is successful, the smart set-top box continues to call the gattc_discovery_character interface to discover the characteristics for voice data transmission in the service, and discovers the corresponding descriptor information through the gattc_discovery_descriptor interface. After the discovery is completed, the smart set-top box also needs to interact with the voice remote control to negotiate the MTU size to determine the maximum capacity of each transmitted data packet.

[0153] After the voice data transmission channel is established, the voice remote controller sends data according to the user's voice input operation. Specifically, when the user presses the voice button, the voice remote controller first sends a voice start packet through the gatts_notify_indicate interface; then, while the user continues to press the voice button, the voice remote controller continues to send voice data packets through the same interface; when the user releases the voice button, the voice remote controller sends a voice end packet, marking the end of the entire voice input process. After receiving these data packets, the smart set-top box correctly identifies the complete voice command based on the identifiers of the start packet and the end packet and performs subsequent processing.

[0154] The beneficial effect of the above technical solution is that through the Bluetooth GATT service, the voice remote control can stably transmit the encoded voice data packets to the smart set-top box. This transmission mechanism makes full use of the low power consumption characteristics of Bluetooth, which not only prolongs the battery life of the remote control, but also ensures the reliability of data transmission. Therefore, users can easily control the smart set-top box with a single remote control, which is more power-saving and convenient, and enhances the flexibility of use.

[0155] In another embodiment, the transmitting to the adapter by star flash in step S3 includes:

[0156] S3-1: Based on the Star Flash connection status, the voice remote control creates and starts the SSAP service as the server to establish the Star Flash transmission channel;

[0157] S3-2: The adapter, as the client, discovers the attribute structure of the SSAP service and initiates a read request, preparing to receive data;

[0158] S3-3: The voice remote control sends the encoded voice data packet to the adapter through the SSAP interface to complete the Star Flash protocol transmission.

[0159] The working principle of the above technical solution is as follows: In the Starlight transmission system, the voice remote control acts as the server, and the adapter on the smart TV acts as the client. The two establish a connection and transmit voice data through the Starlight SSAP protocol. Starlight SSAP provides a complete set of service creation, feature value definition and data transmission mechanisms to ensure that voice data can be efficiently and reliably transmitted from the remote control to the adapter.

[0160] When the voice remote control detects that the XingShan connection status is available, it first registers a server for transmitting voice data by calling the ssaps_register_server interface. The role of this interface is to create an SSAP server instance on the voice remote control, preparing for subsequent service addition and data transmission. After registering the server, the voice remote control calls the ssaps_add_service_sync interface according to the pre-agreed UUID to create a Service service. The role of this interface is to add a specific service to the server, which will be specifically used for voice data transmission and is uniquely identified by the UUID to ensure that the adapter can accurately identify this service. Then, the voice remote control calls the ssaps_add_property_sync interface to add characteristic values to the created service. The role of this interface is to add characteristic values carrying voice data to the service, which is equivalent to defining the channel properties of data transmission. To make the format of the transmitted voice data clear, the voice remote control further calls the ssaps_add_descriptor_syn interface to add descriptor information to the characteristics in the service. The role of this interface is to add detailed description information to the characteristics carrying voice data, including configuration information and format, etc., to ensure that the adapter can correctly parse the received voice data. After completing the above preparatory work, the voice remote control finally calls the ssaps_start_service interface to officially start the service. The role of this interface is to make the server for voice data transmission enter the active state, ready to receive connection requests from the adapter and respond to data transmission requirements.

[0161] When the adapter needs to receive voice data, it first calls the ssapc_register_client interface to register a client for receiving voice data. The role of this interface is to create an SSAP client instance on the adapter, preparing for subsequent service discovery and data reception. After registering the client, the adapter recursively calls the ssapc_find_structure interface to find the property data of the voice remote control. The role of this interface is to search for and identify the services, characteristics, and descriptor information corresponding to the characteristics provided on the voice remote control, and determine the specific services and characteristics for voice data transmission by matching the pre-agreed UUID. When the adapter successfully discovers the service structure of the voice remote control, it sends a ssapc_read_req request to the voice remote control. The role of this request is to indicate to the server that the client is ready to receive voice data, thus triggering the voice data transmission process.

[0162] After the voice remote control service successfully establishes a connection with the adapter client, the transmission of voice data follows a specific data packet sequence. When the user presses the voice key on the voice remote control, the voice remote control first sends a voice start packet, marking the start of voice data transmission. While the voice key is held down, the voice remote control continuously collects the user's voice, encodes the collected voice data, and then continuously sends voice data packets to the adapter through the ssaps_notify_indicate interface. The role of this interface is to enable the server to actively transmit voice data to the client without repeated requests from the client, thereby improving the transmission efficiency. When the user releases the voice key, the voice remote control sends a voice end packet, marking the end of this voice data transmission. After receiving the voice end packet, the adapter sends the complete voice data to the TV for processing through UAC.

[0163] The beneficial effects of the above technical solution are as follows: Based on the efficient transmission mechanism of the SparkLink SSAP service, the voice remote control can quickly transmit voice data to the adapter. This high-speed transmission characteristic is particularly suitable for voice control scenarios that require real-time response. Users can accurately control smart TVs through SparkLink technology, solving the problem of slow response of traditional transmission methods, thereby significantly improving the operation efficiency and user experience.

[0164] In another embodiment, step S4 includes:

[0165] S41: In the set-top box control mode, the smart set-top box decodes the voice data using the SBC decoding algorithm to generate PCM clean stream data;

[0166] S42: In the TV control mode, the adapter decodes the voice data using the SBC decoding algorithm to generate PCM clean stream data;

[0167] S43: In the TV control mode, the adapter transmits the PCM clean stream data to the smart TV through the UAC protocol.

[0168] The working principle of the above technical solution is as follows: In the set-top box control mode, after the smart set-top box receives the audio data, since the audio data is in a compressed state and cannot be directly used by the system, it needs to be decoded. At this time, the smart set-top box calls the built-in SBC decoding algorithm to decompress and decode the audio data. The specific implementation process is as follows: First, the smart set-top box sets the key parameters of the SBC algorithm, including the sampling rate (any value from 16 kHz to 48 kHz), bit depth (usually 16 bits), number of channels (mono or stereo), number of subbands (4 or 8 subbands), block length (4 to 16 blocks), allocation method (SNR or loudness), and minimum allocation unit; then, the smart set-top box calls the decoding interface of the SBC encoding algorithm to parse the received audio data frame by frame. First, it parses the audio frame structure, then decodes the frame header information, then decodes the subband signal, and finally reconstructs the time-domain signal to generate directly usable PCM clear stream data; finally, the smart set-top box transmits the decoded PCM clear stream data to the voice assistant application for voice recognition and instruction execution.

[0169] In the TV control mode, since the processing and decoding of voice data need to be completed at the adapter end, after the adapter receives the audio data, it also needs to decode it. At this time, the adapter calls the built-in SBC decoding algorithm to decompress and decode the audio data. The specific implementation process is as follows: First, the adapter sets the parameters of the SBC algorithm according to the preset configuration, including the sampling rate, bit depth, number of channels, number of subbands, block length, allocation method, and minimum allocation unit, etc.; then, the adapter calls the interface function of the SBC decoding algorithm to decode the received audio data. The decoding process includes four steps: parsing the audio frame, decoding the frame header information, decoding the subband signal, and reconstructing the time-domain signal; finally, the adapter successfully converts the compressed audio data into PCM clear stream data, preparing for subsequent transmission to the smart TV.

[0170] In the TV control mode, after the adapter decodes the audio data, it needs to transmit the PCM clean stream data to the smart TV for the voice assistant application to use. At this time, the adapter sends the PCM clean stream data to the smart TV through the USB Audio Class (UAC) protocol. The specific implementation process is as follows: First, the adapter packs the decoded PCM clean stream data according to the requirements of the UAC protocol, sets appropriate data headers, audio descriptors, and data transmission parameters; then, the adapter establishes a connection with the smart TV through the physical USB interface and sets the transmission rate, buffer size, and transmission mode (synchronous or asynchronous) according to the standard interface specifications of the UAC protocol; next, the adapter transmits the packed PCM clean stream data through the established USB connection channel to the smart TV; finally, after the smart TV system receives the PCM clean stream data, it parses and provides it for the voice assistant application to read and use through the system driver, completing the entire voice data transmission process.

[0171] The beneficial effects of the above technical solution are as follows: The smart set-top box and the adapter adopt the SBC decoding algorithm, which can accurately restore the voice data to PCM clean stream data and transmit it to the smart TV through the UAC protocol. This decoding and transmission mechanism ensures the integrity and high-quality output of the voice data, providing a reliable guarantee for subsequent voice processing. Therefore, users can enjoy a clear and accurate voice control experience, and the operation is smoother.

[0172] In another embodiment, the TV processes the voice data in step S4, including:

[0173] S44: The smart TV transmits the PCM clean stream data to the voice platform, and the voice platform converts the audio data into text, performs word segmentation processing, understands the intention, retrieves data, and generates operation instructions.

[0174] Among them, the smart TV collects the user's voice according to a pre-configured audio collection template, generates PCM clean stream data, and transmits the PCM clean stream data to the voice platform;

[0175] The voice platform converts the PCM clean stream data into corresponding text data according to a pre-configured audio-to-text model;

[0176] Perform word segmentation processing on the text data to form multi-component word segmentation data, where each component of the word segmentation data includes parameters representing keywords in the user's voice and context parameters representing the sentence structure;

[0177] According to the multi-component word segmentation data, use the multi-intention recognition algorithm to generate a set of user intentions, where the set of intentions includes multiple parallel user intention parameters;

[0178] According to the set of intentions, retrieve the corresponding operation data from a pre-configured instruction database to generate a preliminary set of operation instructions;

[0179] Optimize the preliminary operation instruction set according to the context parameters of the user's voice through dynamic adjustment logic to generate the final operation instruction, where the dynamic adjustment logic prioritizes the multi-intent recognition results according to the relevance of the context parameters and corrects the instruction generation rules.

[0180] The working principle of the above technical solution is as follows: The voice data processing process of the smart TV is based on the transmission and processing of PCM clean stream data, including:

[0181] When the user issues a voice command through the voice remote control, the audio data collected by the voice remote control is first converted into PCM clean stream data. This PCM clean stream data is an uncompressed raw audio data format that retains the complete information of the voice. After receiving the PCM clean stream data, the smart TV transmits it to the voice platform for processing through a network connection. After receiving the PCM clean stream data, the voice platform first performs natural speech translation processing, that is, converts the audio data into text form. The translation process uses deep learning algorithms. By extracting audio features and matching acoustic models and language models, continuous speech signals are accurately converted into text sequences. The translation accuracy is not less than 95% to ensure the accuracy of subsequent processing. After the text data is generated, the voice platform performs word segmentation processing. The word segmentation processing uses a lexical analysis algorithm to split the continuous text into the smallest semantic units with meaning. During this process, the system will identify the main components in the sentence, such as the subject, predicate, object, etc., and mark the part of speech and grammatical relationship of each word. The word segmentation algorithm uses the bidirectional maximum matching method, combined with a statistical language model, and the word segmentation accuracy is not less than 98%. After the word segmentation is completed, the system performs user intent understanding. Intent understanding analyzes the semantics of the text after word segmentation, extracts feature words, and identifies the actual needs of the user through a natural language processing model. Feature words include but are not limited to: channel name, program type, actor name, time information, etc. The system identifies whether the user wants to perform channel switching, content search, volume adjustment or other operations through the combination relationship between feature words. After intent recognition, the system performs data retrieval according to the extracted feature words. During the data retrieval process, the system compares the extracted intent features with the live channel and media asset corpus pre-stored in the voice server. The comparison uses a semantic similarity calculation method. When the similarity exceeds a preset threshold (usually 0.85), it is considered a successful match. The comparison range includes program names, channel names, actor names, and related media content description information, etc. Finally, the voice platform converts the retrieved data into operation instructions in a standard format and sends them back to the smart TV through a network connection, and the smart TV executes the corresponding operations, such as switching to a specified channel, playing specific content, adjusting the volume, etc. The execution time of the operation instruction does not exceed 500 milliseconds to ensure the smoothness of the user experience.

[0182] The voice remote control supports dual-mode transmission of voice data via Bluetooth and XingShan. The specific implementation is as follows: When the voice remote control is in the mode of controlling the set-top box, it establishes a connection with the smart set-top box through the built-in Bluetooth module. The connection uses the Bluetooth 4.2 or higher version protocol to ensure the stability of data transmission and low power consumption. After the user presses the voice button, the remote control starts to collect voice data and transmits the voice data to the smart set-top box in real time in the form of a PCM data stream with a sampling rate of not less than 16 kHz and a quantization accuracy of 16 bits through the Bluetooth channel. An encryption algorithm is used to ensure data security during the transmission process. When the voice remote control is in the mode of controlling the TV, the remote control transmits the voice data to the adapter through the XingShan channel. The XingShan transmission uses infrared carrier technology and transmits data at a carrier frequency of 38 kHz through modulation and demodulation. The voice data is first compressed to reduce the data volume and adapt to the transmission bandwidth limitation of the XingShan channel. After receiving the XingShan signal, the adapter demodulates it and restores it to the original voice data, and then transmits the data to the smart TV through the HDMI cable or network connection. The switching between these two modes of the voice remote control is achieved through a dedicated mode switching button. When it is detected that the user presses the mode switching button, the control unit inside the voice remote control switches the current working mode and displays the current working status through the LED indicator. In the Bluetooth mode, the indicator shows blue; in the XingShan mode, the indicator shows red. After the mode switching is completed, the remote control automatically sends a connection request to the corresponding receiving end (set-top box or adapter) to establish a communication link.

[0183] The beneficial effects of the above technical solution are as follows: The smart TV converts the PCM clear stream data into text and generates operation instructions through the voice platform, realizing the intelligence and naturalness of voice control. This processing mechanism enables users to interact with the smart TV in natural language through a single remote control, solves the problem of cumbersome operation of the traditional control method, and greatly improves the convenience and intelligence of use.

[0184] In another embodiment, as Figure 3 shown, a dual-mode voice transmission system based on XingShan and Bluetooth includes:

[0185] A Bluetooth connection module, which is used for the voice remote control to establish a connection with the smart set-top box through the Bluetooth protocol and generate a Bluetooth connection status;

[0186] A XingShan connection module, which is used for the voice remote control to establish a connection with the adapter through the XingShan protocol and generate a XingShan connection status;

[0187] An interaction control module, which is used to record and encode voice data by the voice remote control according to the selected control mode and transmit it to the smart set-top box through Bluetooth or to the adapter through XingShan;

[0188] A data processing module, which is used for:

[0189] If in the set-top box control mode, the smart set-top box decodes and processes the voice data and generates instructions to control the set-top box;

[0190] If in TV control mode, the adapter decodes and transmits the audio data to the smart TV, and the TV processes the voice data and performs corresponding operations.

[0191] The working principle of the above technical solution is: when the voice remote control is started, the Bluetooth connection module first calls the enable_ble interface to enable the Bluetooth protocol and activate the Bluetooth function; then, the Bluetooth connection module calls the gap_ble_set_local_addr interface to set the local Bluetooth MAC address, and sets the relevant parameters of the broadcast through the gap_ble_set_adv_data interface; after the smart set-top box is started, its onboard Bluetooth module enters the pairing state, sets the device scanning parameters and starts the device scan; when the smart set-top box scans the voice remote control, it calls the connection interface to initiate a connection request to the voice remote control, and the voice remote control responds after receiving the request; after the smart set-top box detects the connection response, it initiates a pairing request to the voice remote control through the gap_ble_pair_remote_device interface, and the voice remote control responds to the pairing and saves the pairing information such as the MAC address of the smart set-top box; through the above steps, the voice remote control and the smart set-top box complete the Bluetooth connection and pairing, and the Bluetooth connection module generates the Bluetooth connection state for system use.

[0192] During the startup process of the voice remote control and the adapter, the Star Flash connection module enables the Star Flash protocol; when the voice remote control enters the pairing state, it initiates a pairing broadcast and calls the public device interface to publicize the remote control device; after the adapter enters the pairing state, it calls the device discovery interface to search for the voice remote control device to be connected and paired; when the adapter finds the voice remote control device, it initiates a connection request through the connection request interface; after receiving the connection request, the voice remote control responds to the connection request of the adapter; after the adapter detects that the connection is successful, it calls the pairing interface to initiate a pairing request; the voice remote control processes the pairing request and saves the unique identification information such as the MAC address of the adapter; through the above steps, the voice remote control and the adapter complete the Star Flash connection and pairing, and the Star Flash connection module generates the Star Flash connection status for system use.

[0193] When the user presses the voice key on the remote control, the interaction control module initializes the relevant drivers of the microphone. After initialization, the microphone records the user's voice and converts the voice into audio data through the analog-to-digital conversion method. When the voice key bounces up, the interaction control module de-initializes the microphone and stops recording the user's voice. After the interaction control module obtains the audio data, it encodes and compresses the audio data through the SBC algorithm. The system sets the sampling rate of the SBC algorithm to 16 kHz, the block size to 16, mono, and the number of subbands to 8. It encodes and compresses the audio data by calling the encoding interface of the encoding algorithm to ensure the stable transmission of voice data.

[0194] When the user selects the set-top box control mode, the interaction control module transmits voice data through the Bluetooth GATT service. The voice remote control acts as the Server side, and the smart set-top box acts as the Client side. The voice remote control calls the gatts_register_server interface to create a Server, and creates a Service through the gatts_add_service interface according to the UUID (c1764e61-a0bc-4e0c-0dcf-23b4338b7901). Then it adds characteristic values through the gatts_add_characteristic interface, adds descriptor information through the gatts_add_descriptor interface, and finally calls the gatts_start_service interface to start the service. When the user selects the TV control mode, the interaction control module transmits data through the StarFlash SSAP specification. The voice remote control acts as the Server side, and the adapter connected to the smart TV acts as the Client side. The voice remote control calls the ssaps_register_server interface to create a Server, and creates a Service through the ssaps_add_service_sync interface according to the agreed UUID. It adds characteristic values through the ssaps_add_property_sync interface, adds descriptor information through the ssaps_add_descriptor_syn interface, and finally calls the ssaps_start_service interface to start the service.

[0195] In the set-top box control mode, the voice remote control sends voice data packets to the smart set-top box through the gatts_notify_indicate interface, including voice start packets, voice data packets, and voice end packets. Among them, the voice start packet is sent when the voice key is pressed, the voice end packet is sent when the voice key is released, and voice data packets are continuously sent between the voice start and end packets. In the TV control mode, the voice remote control sends voice data packets to the adapter through the ssaps_notify_indicate interface, also including voice start packets, voice data packets, and voice end packets. After receiving the voice data, the adapter transmits the audio data to the smart TV through the UAC protocol.

[0196] In the set-top box control mode, after the smart set-top box receives the audio data, the data processing module decompresses and decodes the audio data through the SBC decoding algorithm. By setting corresponding attributes such as sampling rate, bit depth, number of channels, number of subbands, block length, etc., the decoding interface is called to restore the encoded audio data to PCM clear stream data. Subsequently, the data processing module transmits the audio data to the voice platform. The voice platform performs natural speech translation on the audio data, understands the user's intention through word segmentation processing, retrieves data according to the user's intention, and finally converts the retrieval result into an operation instruction to control the smart set-top box to perform corresponding operations. In the TV control mode, after the adapter receives the voice data, the data processing module also decodes the audio data into PCM clear stream data through the SBC decoding algorithm. Subsequently, through the standard interface of the USB audio transmission protocol (UAC), the audio data is transmitted to the smart TV system. The voice assistant application of the smart TV reads the audio data and transmits it to the voice platform for processing, and finally generates an instruction to control the smart TV to perform corresponding operations.

[0197] The beneficial effects of the above technical solution are as follows: By integrating a Bluetooth connection module, a XingShan connection module, an interactive control module, and a data processing module, a complete dual-mode voice transmission system is constructed. This system not only realizes efficient voice control of smart set-top boxes and smart TVs, but also enhances the maintainability and scalability of the system through modular design. Users can flexibly switch the control object using a single remote control, simplifying device management and significantly improving the convenience of use and the adaptability of system functions.

[0198] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of equivalent technologies of the present invention, the present invention also intends to include these changes and modifications.

Claims

1. A dual-mode voice transmission method based on SparkLink and Bluetooth, characterized in that, include: S1: The voice remote control establishes a connection with the smart set-top box through the Bluetooth protocol and generates a Bluetooth connection state; S2: The voice remote control and the adapter establish a connection through the Star Flash protocol, generating a Star Flash connection state; S3: According to the control mode selected by the user, the voice remote controller records and encodes the voice data and transmits it to the smart set-top box via Bluetooth or to the adapter via Star Flash; S4: If in the set-top box control mode, the smart set-top box decodes and processes the voice data and generates instructions to control the set-top box; If in TV control mode, the adapter decodes and transmits the audio data to the smart TV, and the TV processes the voice data and performs corresponding operations.

2. The dual-mode voice transmission method based on SparkLink and Bluetooth according to claim 1, wherein, The S1 step includes: S11: The voice remote control enables the Bluetooth protocol, sets the local Bluetooth MAC address and broadcast format data, and starts Bluetooth broadcasting; S12: The smart set-top box starts the Bluetooth module, scans the voice remote control, and initiates a connection request to the voice remote control; S13: After the voice remote controller responds to the connection request, the smart set-top box initiates a pairing request to the voice remote controller, and the voice remote controller responds and saves the MAC address of the smart set-top box, completing the Bluetooth connection and pairing.

3. The dual-mode voice transmission method based on SparkLink and Bluetooth according to claim 1, wherein, The S2 step includes: S21: The voice remote control and the adapter enable the Star Flash protocol and complete the initialization of the Star Flash protocol; S22: Based on the initialization state of the Star Flash protocol, the voice remote controller initiates a pairing broadcast, and the adapter discovers the device and initiates a connection request; S23: After the voice remote controller responds to the connection request, the adapter initiates a pairing request, and the voice remote controller saves the pairing information of the adapter, completing the Star Flash connection and pairing.

4. The dual-mode voice transmission method based on SparkLink and Bluetooth according to claim 1, wherein The recorded voice data in step S3 includes: S31: When the voice button is pressed, the voice remote controller initializes the microphone driver and starts recording; S32: converting the recorded sound into digital audio data through digital-to-analog conversion; S33: When the voice button is released, the microphone driver is deinitialized and recording is stopped; During the recording process, audio data is continuously encoded and sent over the selected transmission channel.

5. The dual-mode voice transmission method based on SparkLink and Bluetooth according to claim 1, characterized in that The encoded speech data in step S3 includes: S34: receiving original audio data obtained after the voice remote controller picks up the sound; S35: uses the SBC encoding algorithm to compress the original audio data, with a sampling rate of 16kHz, a block size of 16, mono, and 8 sub-bands; S36: Generate encoded voice data.

6. The dual-mode voice transmission method based on SparkLink and Bluetooth according to claim 1, wherein The transmission to the smart set-top box via Bluetooth in step S3 includes: S37: Based on the Bluetooth connection status, the voice remote control creates and starts a GATT service as the server, generating a Bluetooth transmission channel; S38: The smart set-top box discovers GATT services and characteristics as a client and prepares to receive data; S39: The voice remote controller sends the encoded voice data packet to the smart set-top box through the GATT interface to complete the Bluetooth protocol transmission.

7. The dual-mode voice transmission method based on SparkLink and Bluetooth according to claim 1, wherein, The transmission to the adapter via Starflash in step S3 includes: S3-1: Based on the Star Flash connection status, the voice remote control creates and starts the SSAP service as the server to establish the Star Flash transmission channel; S3-2: The adapter, as the client, discovers the attribute structure of the SSAP service and initiates a read request, preparing to receive data; S3-3: The voice remote control sends the encoded voice data packet to the adapter through the SSAP interface to complete the StarFlash protocol transmission.

8. The dual-mode voice transmission method based on SparkLink and Bluetooth according to claim 1, characterized in that Step S4 includes: S41: In the set-top box control mode, the smart set-top box decodes the voice data using the SBC decoding algorithm to generate PCM clear stream data; S42: In the TV control mode, the adapter decodes the voice data using the SBC decoding algorithm to generate PCM clear stream data; S43: In the TV control mode, the adapter transmits the PCM clear stream data to the smart TV through the UAC protocol.

9. The dual-mode voice transmission method based on SparkLink and Bluetooth according to claim 1, wherein The TV processing voice data in Step S4 includes: S44: The smart TV transmits the PCM clear stream data to the voice platform. The voice platform converts the audio data into text, performs word segmentation processing, understands the intent, retrieves data, and generates operation instructions.

10. A dual-mode voice transmission system based on SparkLink and Bluetooth, characterized in that, Includes: A Bluetooth connection module for establishing a connection between the voice remote control and the smart set-top box through the Bluetooth protocol to generate a Bluetooth connection status; A StarFlash connection module for establishing a connection between the voice remote control and the adapter through the StarFlash protocol to generate a StarFlash connection status; An interaction control module for recording and encoding voice data by the voice remote control according to the selected control mode and transmitting it to the smart set-top box through Bluetooth or to the adapter through StarFlash; A data processing module for: If in the set-top box control mode, the smart set-top box decodes and processes the voice data to generate instructions to control the set-top box; If in the TV control mode, the adapter decodes and then transmits the audio data to the smart TV, and the TV processes the voice data and performs corresponding operations.

Images