Data transmission method, electronic device, communication system and readable storage medium
By receiving and processing sensor data in interval time slots of audio data transmission, generating and sending spatial audio data, the problem of sensor data transmission affecting audio data transmission is solved, and the reliability of sensor data transmission and the real-time response efficiency of spatial audio are improved.
Patent Information
- Application Number
- CN202111094683.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-17
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2041-09-17
AI Technical Summary
Without affecting the transmission of audio data, how to effectively transmit sensor data to achieve spatial audio effects is an urgent problem.
The sensor data sent by the wearable device is received at the interval time slots of the transmission of the audio data, and the audio data is processed by using the audio data processor of the terminal device to generate and transmit spatial audio data. The specific steps include receiving sensor data in the terminal device, performing audio processing, and sending the processed spatial audio data to the wearable device through the Bluetooth chip and the audio bus.
It realizes the reliability and real-time response efficiency of sensor data transmission while ensuring that audio data transmission is not affected, and improves the real-time response efficiency of spatial audio.
Smart Images

Figure CN115834757B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of wireless communication technology, and in particular to a data transmission method, electronic equipment, a communication system and a readable storage medium. Background Art
[0002] With the development of technology, Bluetooth headsets have introduced spatial audio functions, which use sensors such as gyroscopes on the headsets to track user movements, map the sensor data to audio data for processing, and allow users to have a spatial perception experience.
[0003] One way to implement the above function is to send sensor data to a smartphone, which uses the sensor data to process the audio data to obtain spatial audio data. However, how to transmit sensor data without affecting the transmission of audio data and achieve the effect of spatial audio is an urgent problem to be solved. Summary of the invention
[0004] The present application aims to solve one of the technical problems in the related art at least to some extent.
[0005] To this end, the following technical solutions are proposed:
[0006] The first aspect of the present application provides a data transmission method, which is applied to a terminal device and includes:
[0007] In the interval time slot of the last audio data transmission, the sensor data transmitted by the wearable device is received;
[0008] Performing audio processing on the audio data to be sent currently according to the sensor data to obtain spatial audio data;
[0009] The spatial audio data is sent to the wearable device.
[0010] Optionally, receiving the sensor data sent by the wearable device in the interval time slot of the last sending of the audio data includes:
[0011] In the interval time slot of the last sending of audio data, receiving the sensor data through the Bluetooth chip of the terminal device;
[0012] The performing audio processing on the audio data to be sent according to the sensor data to output the processed audio data includes:
[0013] Based on the sensor data, the audio data to be sent is processed by the audio data processor ADSP of the terminal device using a spatial audio algorithm to obtain spatial audio data;
[0014] The sending the spatial audio data to the wearable device includes:
[0015] The spatial audio data is sent to the wearable device through the audio bus and the Bluetooth chip of the terminal device.
[0016] Optionally, receiving the sensor data through a Bluetooth chip of the terminal device includes:
[0017] Using the radio frequency module in the Bluetooth chip to receive a sensor data packet, wherein the sensor data packet carries sensor data;
[0018] The sensor data packet is parsed by a controller in the Bluetooth chip to obtain sensor data.
[0019] Optionally, before parsing the sensor data packet by the controller in the Bluetooth chip to obtain the sensor data, the method further includes:
[0020] Configuration parameters are acquired, and the sensor data packet is determined from the received data packet according to the configuration parameters.
[0021] Optionally, the length of the interval time slot is determined according to a sending rate of the audio data configured by the terminal device.
[0022] Optionally, receiving the sensor data sent by the wearable device in the interval time slot of the last sending of the audio data includes:
[0023] In the interval time slot of the last audio data transmission, monitoring the sensor data transmitted by the wearable device;
[0024] In response to monitoring the sensor data, the sensor data is received.
[0025] A second aspect of the present application provides a data transmission method, which is applied to a wearable device and includes:
[0026] Collect sensor data;
[0027] Receive audio data sent by the terminal device;
[0028] The sensor data is sent to the terminal device at a set time slot after the audio data is received.
[0029] Optionally, after collecting sensor data, the method further includes:
[0030] storing the sensor data in a target buffer queue;
[0031] After receiving the audio data, the method further comprises:
[0032] According to the priorities of the data queues to be sent in the wearable device, the sensor data is read from the data queue to be sent with the highest priority; wherein the data queue to be sent with the highest priority is the target buffer queue.
[0033] Optionally, sending the sensor data to the terminal device at a set time slot after receiving the audio data includes:
[0034] A sensor data packet is sent to the terminal device in a next time slot after the audio data is received, wherein the sensor data packet carries the sensor data.
[0035] Optionally, the sensor data packet occupies 1 time slot.
[0036] The third aspect of the present application provides a terminal device, including:
[0037] A transceiver unit, configured to receive sensor data sent by the wearable device during an interval time slot of the last audio data transmission;
[0038] a processing unit, configured to perform audio processing on the audio data currently to be sent according to the sensor data, so as to output the processed audio data;
[0039] The transceiver unit is further used to send the spatial audio data to the wearable device.
[0040] Optionally, the transceiver unit is used for:
[0041] In the interval time slot of the last sending of audio data, receiving the sensor data through the Bluetooth chip of the terminal device;
[0042] The processing unit is used for:
[0043] Based on the sensor data, the audio data to be sent is processed by the audio data processor ADSP of the terminal device using a spatial audio algorithm to obtain spatial audio data;
[0044] The transceiver unit is also used for:
[0045] The spatial audio data is sent to the wearable device through the audio bus and the Bluetooth chip of the terminal device.
[0046] A fourth aspect of the present application provides a wearable device, including:
[0047] A sensor unit, for collecting sensor data;
[0048] A transceiver unit, used for receiving audio data sent by a terminal device;
[0049] The transceiver unit is further configured to send sensor data to the terminal device at a set time slot after receiving the audio data.
[0050] Optionally, the wearable device further includes:
[0051] a processing unit, configured to store the sensor data in a target buffer queue;
[0052] The processing unit is also used for:
[0053] According to the priorities of the data queues to be sent in the wearable device, the sensor data is read from the data queue to be sent with the highest priority; wherein the data queue to be sent with the highest priority is the target buffer queue.
[0054] Optionally, the transceiver unit is specifically used for:
[0055] A sensor data packet is sent to the terminal device in a next time slot after the audio data is received, wherein the sensor data packet carries the sensor data.
[0056] The fifth aspect embodiment of the present application proposes a communication system, including: the terminal device described in the third aspect embodiment of the present application and the wearable device described in the fourth aspect embodiment of the present application.
[0057] The sixth aspect embodiment of the present application proposes an electronic device, comprising: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to call and execute the executable instructions stored in the memory to implement the data transmission method proposed in the first aspect embodiment of the present application.
[0058] The seventh aspect embodiment of the present application proposes an electronic device, comprising: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to call and execute the executable instructions stored in the memory to implement the data transmission method proposed in the second aspect embodiment of the present application.
[0059] The eighth aspect embodiment of the present application proposes a non-temporary computer-readable storage medium. When the instructions in the storage medium are executed by the processor of an electronic device, the electronic device can execute the data transmission method proposed in the first aspect embodiment of the present application.
[0060] The ninth aspect embodiment of the present application proposes a non-temporary computer-readable storage medium. When the instructions in the storage medium are executed by the processor of an electronic device, the electronic device can execute the data transmission method proposed in the second aspect embodiment of the present application.
[0061] The tenth aspect embodiment of the present application proposes a computer program product. When the computer program is executed by a processor of an electronic device, the electronic device can execute the data transmission method proposed in the first aspect embodiment of the present application.
[0062] An eleventh embodiment of the present application proposes a computer program product. When the computer program is executed by a processor of an electronic device, the electronic device can execute the data transmission method proposed in the second embodiment of the present application.
[0063] The technical solution of the present application receives the sensor data sent by the wearable device in the interval time slot of the last sending of audio data, performs audio processing on the audio data to be sent currently according to the sensor data, and outputs the processed audio data. When realizing the spatial audio effect, it ensures that the transmission of the sensor data does not affect the transmission of the Bluetooth audio data, thereby improving the reliability of the sensor data transmission.
[0064] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0065] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0066] Figure 1 A schematic diagram of the architecture of a communication system provided in an embodiment of the present application;
[0067] Figure 2 A flowchart of a data transmission method provided in an embodiment of the present application;
[0068] Figure 3 A flowchart of another data transmission method provided in an embodiment of the present application;
[0069] Figure 4 A flowchart of a data transmission method provided in an embodiment of the present application;
[0070] Figure 5 A flowchart of another data transmission method provided in an embodiment of the present application;
[0071] Figure 6 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application;
[0072] Figure 7 A schematic diagram of the structure of a wearable device provided in an embodiment of the present application;
[0073] Figure 8A structural block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0074] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.
[0075] In order to better understand a data transmission method disclosed in an embodiment of the present application, the following digital display describes a communication system applicable to the embodiment of the present application.
[0076] See also Figure 1 , Figure 1 A schematic diagram of the architecture of a communication system provided in an embodiment of the present application. The communication system may include but is not limited to a wearable device and a terminal device. Figure 1 The number and form of the devices shown are for illustrative purposes only and do not constitute a limitation on the embodiments of the present application. In actual applications, two or more wearable devices and two or more terminal devices may be included. Figure 1 The communication system shown includes a wearable device 101 and a terminal device 102 as an example.
[0077] The wearable device 101 in the embodiment of the present application is a device that can be worn by the user, is separated from the terminal device 102 and can communicate, and can change its spatial position by following the user's spatial movements, such as a Bluetooth headset. The wearable device can also be a smart watch, a smart bracelet, a smart phone, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a Bluetooth speaker, etc. The embodiment of the present application does not limit the specific technology and specific device form used by the wearable device.
[0078] The terminal device 102 in the embodiment of the present application is an entity on the user side that can be used as a sound source end, for receiving or transmitting signals and processing signals, such as a mobile phone. The terminal device can also be referred to as a terminal device (terminal), a user equipment (UE), a mobile station (MS), a mobile terminal device (MT), etc. The terminal device can be a car with communication function, a smart car, a mobile phone (MobilePhone), a wearable device, a tablet computer (Pad), a computer with wireless transceiver function, a virtual reality (VirtualReality, VR) terminal device, an augmented reality (AugmentedReality, AR) terminal device, a wireless terminal device in industrial control (Industrial Control), a wireless terminal device in self-driving (Self-Driving), a wireless terminal device in remote surgery (Remote Medical Surgery), a wireless terminal device in smart grid (Smart Grid), a wireless terminal device in transportation safety (Transportation Safety), a wireless terminal device in smart city (Smart City), a wireless terminal device in smart home (Smart Home), etc. The embodiments of the present application do not limit the specific technology and specific device form adopted by the terminal device.
[0079] In an example application scenario, when a user listens to audio from a terminal device 102 through a wearable device 101, the terminal device 102, as the sound source, encodes and compresses the audio signal to obtain audio data and transmits it to the wearable device 101. In the spatial audio example, the wearable device 101 needs to transmit sensor data 103 collected by a gyroscope, an accelerometer, etc. back to the terminal device for processing. The terminal device 101 performs spatial audio calculations on the audio data based on the acquired sensor data, and sends the processed audio data 104 to the earphone. It can be understood that the processed audio data is spatial audio data.
[0080] In the related art, if data scheduling and air interface transmission are not considered, the sensor data transmitted back by the wearable device 101 will occupy or waste Bluetooth bandwidth and affect the normal transmission of audio data, and the transmitted sensor data cannot be guaranteed to be received by the terminal device 102 in the first time. Moreover, after receiving the sensor data, the Bluetooth chip of the terminal device 102 sends the sensor data to the Bluetooth host (usually in the application processor), and the Bluetooth host (the Bluetooth host is a module inside the terminal device) sends the data to the audio software module, which extracts the data through its own channel and performs spatial audio calculation and audio data processing to obtain the processed spatial audio data. The whole process has a high delay and a large overhead, which seriously affects the real-time response efficiency of spatial audio.
[0081] The data transmission method, electronic device, and computer-readable storage medium according to the embodiments of the present application are described in detail below with reference to the accompanying drawings.
[0082] Figure 2 The present invention provides a flow chart of a data transmission method according to an embodiment of the present invention. It should be noted that the method is applied to a terminal device.
[0083] like Figure 2 As shown, the data transmission method may include the following steps:
[0084] Step 201, receiving sensor data sent by the wearable device in the interval time slot of the last audio data transmission. There will be at least one interval time slot after the terminal device sends audio data last time, that is, the terminal device acts as the sound source and sends audio data to the wearable device at intervals, wherein the audio data is obtained after the terminal device compresses and encodes the audio signal. The last volume data sent by the terminal device is determined based on the audio data to be sent currently, that is, the last audio data transmission and the audio data to be sent currently are two adjacent transmission operations. For example, the audio data to be sent currently is the fifth audio data transmission operation, and the last audio data transmission operation is the fourth audio data transmission operation.
[0085] It should be noted that the interval transmission of audio data means that the transmission of audio data is discrete, and there will be an interval time slot between two transmitted audio data, that is, there is at least one time slot between the transmission of two audio data.
[0086] In some implementations, the interval time slot is determined according to a transmission rate of audio data configured by the terminal device.
[0087] The higher the transmission rate, the fewer the number of time slots between the time slots. Because the time slots occupied by the transmitted audio data are fixed, the higher the transmission rate, that is, the faster the terminal device transmits the audio data, the fewer the number of time slots between the audio data.
[0088] It can be understood that the interval time slot can be fixed or dynamically changed.
[0089] Optionally, when sending audio data of the same encoding format type, for example, when listening to music using an app, the sending rate of the audio data is constant, that is, the interval time slots of each audio data sent during this period are fixed.
[0090] Sensor data is acquired by the wearable device through the sensors installed on it and sent by the wearable device. The sensors installed on the wearable device can detect changes in the spatial position, posture information, etc. of the wearable device and output sensor data corresponding to the changes.
[0091] Optionally, the sensor may be at least one of a gyroscope, a three-dimensional airborne sensor, a position sensor, a displacement sensor, a velocity sensor, an acceleration sensor, and the like.
[0092] The end device receives the sensor data in the interval time slot when the audio data is sent.
[0093] Optionally, the sensor data is received via a Bluetooth chip of the terminal device.
[0094] In some embodiments, a radio frequency module in a Bluetooth chip is used to receive a sensor data packet, wherein the sensor data packet carries the sensor data;
[0095] The sensor data packet is parsed by the controller in the Bluetooth chip to obtain the sensor data.
[0096] It is understandable that the terminal device may or may not receive sensor data in each interval time slot. The transmission of sensor data is related to the acquisition of the wearable device. That is to say, the terminal device may receive the sensor data in the interval time slot only after the wearable device collects the sensor data.
[0097] In some implementations, the terminal device monitors the sensor data during the interval time slot of sending the audio data, and receives the sensor data in response to monitoring the sensor data.
[0098] That is, after sending the audio data, the terminal device starts to monitor the sensor data, and receives the sensor data when the sensor data is monitored.
[0099] Step 202: Perform audio processing on the audio data to be sent currently according to the sensor data to obtain spatial audio data.
[0100] Step 203: Send the spatial audio data to the wearable device.
[0101] After receiving the sensor data, the terminal device processes the audio data to be sent according to the sensor data to obtain spatial audio data.
[0102] That is, after processing the audio data to be sent according to the received sensor data, the terminal device sends the processed audio data to the wearable device, that is, sends the spatial audio data to the wearable device.
[0103] In some implementations, after receiving the sensor data, the terminal device uses a spatial audio algorithm to process the audio data to be sent according to the sensor data to obtain spatial audio data.
[0104] Among them, spatial audio data is processed audio data that allows users of wearable devices to have a spatial experience. The spatial audio algorithm performs corresponding calculations on the audio data based on the user's spatial position movement represented by the sensor data, such as compensating, tuning, and filtering the time difference and sound level difference to simulate the time difference, sound level difference and human body filtering effect between the left and right ears, and can provide real-time feedback on the user's movement. For people, the sound heard by the human ear will be different before and after an action is made. For example, if the user turns his head to the left, the sound heard will change accordingly. The spatial audio algorithm can be used to calculate the audio data accordingly, and the spatial audio data obtained after the calculation can show this change, that is, real-time feedback on the user's movement.
[0105] In some embodiments, the communication between the terminal device and the wearable device in the embodiments of the present application adopts a Bluetooth link based on BR / EDR (Basic Rate / Enhanced Data Rate) technology, such as a Bluetooth virtual serial port channel based on the Bluetooth serial port protocol SPP (Serial Port Profile), or a link based on the Bluetooth hands-free protocol HFP (Hands-Free Profile).
[0106] It is understandable that, in the embodiment of the present application, the audio data sent last time in step 201 may be the spatial audio data obtained after being processed in step 202, or may be the audio data not processed in step 202. This is because the audio data to be sent will be processed to obtain the spatial audio data only after the sensor data is received.
[0107] The embodiment of the present application receives sensor data sent by the wearable device in the interval time slot of the last sending of audio data, performs audio processing on the audio data to be sent currently according to the sensor data, and outputs the processed audio data. When realizing the spatial audio effect, it is ensured that the transmission of sensor data will not affect the transmission of audio data, will not affect the listening of normal audio, and improves the reliability of sensor data transmission.
[0108] Figure 3 A flowchart of another data transmission method provided in an embodiment of the present application is provided. It should be noted that the method is applied to a terminal device.
[0109] like Figure 3 As shown, the data transmission method may include the following steps:
[0110] Step 301: In the interval time slot of the last audio data transmission, the sensor data transmitted by the wearable device is received through the Bluetooth chip of the terminal device.
[0111] In some implementations, the terminal device receives a sensor data packet through a radio frequency module in a Bluetooth chip, wherein the sensor data packet carries sensor data, and parses the sensor data packet through a controller in the Bluetooth chip to obtain the sensor data.
[0112] The RF module in the Bluetooth chip is a module that sends and receives data in the 2.4 GHz ISM band according to the RF protocol.
[0113] In some implementations, before parsing the sensor data packet through a controller in a Bluetooth chip, the method further includes: acquiring configuration parameters, and determining the sensor data packet from the received data packet according to the configuration parameters.
[0114] It is understandable that the RF module of the Bluetooth chip can receive many data packets, such as sensor data packets, text data packets, etc. The controller can determine the sensor data packets from the received data packets based on the acquired configuration parameters and parse the sensor data packets.
[0115] Optionally, the controller obtains the configuration parameter through a command in an HCI (host controller interface, host control interface protocol).
[0116] As a possible implementation, the configuration parameter may be a data packet type. The controller may determine the sensor data packet from the received data packets according to the data packet type, and parse the sensor data packet.
[0117] Step 302: Based on the sensor data, the audio data processor ADSP of the terminal device uses a spatial audio algorithm to process the audio data to be sent to obtain spatial audio data.
[0118] Among them, the audio data processor ADSP (audio digital signal processor) is a processor that can process audio signals according to application requirements.
[0119] In the embodiment of the present application, the audio bus of the terminal device directly connects the Bluetooth chip and the audio data processor ADSP. After receiving the sensor data, the Bluetooth chip sends the sensor data to the ADSP through the audio bus. It can be understood that in the embodiment of the present disclosure, the Bluetooth chip directly sends the sensor data to the ADSP. Compared with the related art sensor data transmission between the Bluetooth chip and the ADSP, the transmission path of the sensor data in the embodiment of the present disclosure is the shortest, thereby improving the transmission efficiency of the sensor data, that is, improving the generation efficiency of the spatial audio data.
[0120] In the related technology, the transmission path of sensor data between the Bluetooth chip and ADSP is as follows: after receiving the sensor data, the Bluetooth chip needs to send it to the Bluetooth protocol stack, and then send it to the application framework layer of the terminal device through the Bluetooth protocol stack. The application framework layer sends the sensor data to the audio module of the terminal device to receive the relevant data, and finally the audio module sends it to ADSP.
[0121] Optionally, the audio bus may be a slimbus (serial low-power inter-chip media bus) audio bus.
[0122] After receiving the sensor data, the audio data processor ADSP processes the audio data to be sent using a spatial audio algorithm based on the sensor data to obtain spatial audio data, that is, processed audio data that allows users of wearable devices to have a spatial experience.
[0123] Among them, the spatial audio algorithm is to perform corresponding calculations on the audio data according to the spatial position movement of the user represented by the sensor data, such as compensating, tuning, and filtering the time difference and sound level difference to simulate the time difference, sound level difference and human body filtering effect between the left and right ears, and can provide real-time feedback on the user's movement. For humans, the sound heard by the human ear will be different before and after an action is made. For example, if the user turns his head to the left, the sound heard will change accordingly. The spatial audio algorithm can be used to perform corresponding calculations on the audio data, and the spatial audio data obtained after the calculation can show this change, that is, real-time feedback on the user's movement.
[0124] Step 303: Send spatial audio data to the wearable device through the audio bus and Bluetooth chip of the terminal device.
[0125] That is to say, after the audio data processor ADSP processes the audio signal to obtain spatial audio data, it sends the spatial audio data to the Bluetooth chip through the audio bus, and then sends the spatial audio data to the wearable device through the Bluetooth chip.
[0126] Optionally, the spatial audio data is sent to the wearable device via a radio frequency module of the Bluetooth chip.
[0127] In some implementations, before the spatial audio data is sent, the spatial audio data is encapsulated according to the type of codec with which the audio data is sent to obtain a spatial audio data packet.
[0128] The data transmission method of the embodiment of the present application receives the sensor data sent by the wearable device through the Bluetooth chip of the terminal device in the interval time slot of the last sending of audio data, and processes the audio data to be sent by the audio data processor ADSP using a spatial audio algorithm based on the sensor data to obtain spatial audio data, and sends the spatial audio data to the wearable device through the audio bus and the Bluetooth chip of the terminal device. When realizing the spatial audio effect, it is ensured that the transmission of sensor data will not affect the transmission of audio data and will not affect the listening of normal audio, thereby improving the reliability of sensor data transmission, and effectively reducing the calculation and processing delay of sensor data in the terminal device, thereby improving the real-time response efficiency of spatial audio.
[0129] Figure 4 A schematic diagram of a data transmission method provided in an embodiment of the present application is provided. It should be noted that the method is applied to a wearable device.
[0130] like Figure 4 As shown, the data transmission method may include the following steps:
[0131] Step 401, collecting sensor data.
[0132] The sensor data is obtained by sensors installed on the wearable device. The sensors installed on the wearable device can detect changes in the spatial position, posture information, etc. of the wearable device and output sensor data corresponding to the changes.
[0133] Optionally, the sensor may be at least one of a gyroscope, a three-dimensional airborne sensor, a position sensor, a displacement sensor, a velocity sensor, an acceleration sensor, and the like.
[0134] In an embodiment of the present application, a user wears a wearable device, and when the user moves or acts, the sensor on the wearable device can detect the change and collect sensor data. For example, the user wears headphones, and the sensor in the headphones can detect the user's head movements, such as turning the head, and the headphones will obtain and collect sensor data through the sensor.
[0135] Step 402: Receive audio data sent by the terminal device.
[0136] Among them, the audio data is sent by the terminal device, that is, the terminal device acts as the sound source, compresses and encodes the audio signal, and sends the audio data to the wearable device at intervals.
[0137] Optionally, the wearable device receives audio data via a Bluetooth chip, that is, data is transmitted between the wearable device and the terminal device via Bluetooth communication.
[0138] Step 403: Send sensor data to the terminal device at a set time slot after receiving the audio data.
[0139] It should be noted that the terminal device, as the sound source, will always send audio data to the wearable device, but the audio data it sends will not occupy all time slots. There will be an interval time slot between two audio data. Therefore, in order to ensure that the wearable device does not affect the audio data when sending back sensor data, the sensor data is sent to the terminal device at the set time slot after receiving the audio data.
[0140] The set time slot is a time slot between receiving two audio data. For example, in the first time slot, the wearable device receives audio data, and in the sixth time slot, the wearable device receives audio data again. Then, the set time slot for sending sensor data can be one of the second to fifth time slots.
[0141] In some implementations, the wearable device sends the sensor data to the terminal device in the next time slot after receiving the audio data sent by the terminal device.
[0142] In some implementations, a sensor data packet is sent to the terminal device in the next time slot after receiving the audio data sent by the terminal device, wherein the sensor data packet carries the sensor data, that is, the sensor data may be encapsulated in the sensor data packet and sent to the terminal device.
[0143] Optionally, the sensor data packet is a data packet occupying 1 time slot.
[0144] In some embodiments, the communication between the terminal device and the wearable device in the embodiments of the present application adopts a Bluetooth link based on BR / EDR (Basic Rate / Enhanced Data Rate) technology, such as a Bluetooth virtual serial port channel based on the Bluetooth serial port protocol SPP (Serial Port Profile), or a link based on the Bluetooth hands-free protocol HFP (Hands-Free Profile).
[0145] The data transmission method of the embodiment of the present application collects sensor data, receives audio data sent by a terminal device, and sends the sensor data to the terminal device at a set time slot after receiving the audio data. When achieving a spatial audio effect, it ensures that the transmission of the sensor data will not affect the transmission of the audio data, will not affect the listening of normal audio, and improves the reliability of sensor data transmission.
[0146] Figure 5 A flow chart of another data transmission method provided in an embodiment of the present application. It should be noted that the method is applied to a wearable device.
[0147] like Figure 5 As shown, the data transmission method may include the following steps:
[0148] Step 501, collecting sensor data.
[0149] Step 502: Store the sensor data in a target buffer queue.
[0150] The target buffer queue is defined by the controller in the Bluetooth chip of the wearable device.
[0151] It is understandable that after the wearable device collects the sensor data, it does not directly transmit the sensor data back to the terminal device, but stores the sensor data in the target buffer queue. Directly transmitting the sensor data back to the terminal device is irregular and may occupy the time slot for audio data transmission, resulting in the transmission of audio data being affected, or the sensor data cannot be transmitted to the terminal device in a timely and accurate manner, affecting the user's normal listening.
[0152] Step 503: Receive audio data sent by the terminal device.
[0153] Optionally, the wearable device receives audio data via a Bluetooth chip.
[0154] Specifically, the audio data may be received through a radio frequency module in the Bluetooth chip.
[0155] It should be noted that the above-mentioned method of receiving audio data is only exemplary, and the present application may, but is not limited to, select the above-mentioned method to receive audio data, and the present application may also receive audio data through other transceiver modules. The present application does not limit the method of receiving audio data.
[0156] Step 504, reading sensor data from the data queue to be sent with the highest priority according to the priorities of the data queues to be sent in the wearable device; wherein the data queue to be sent with the highest priority is the target buffer queue.
[0157] There can be multiple queues of data to be sent in a wearable device, with different priorities. The priority of the target buffer queue is the highest among all queues of data to be sent. That is, when the wearable device needs to read data from the queue of data to be sent and send it, it will read the sensor data from the target buffer queue and send it.
[0158] Step 505: Send a sensor data packet to the terminal device in the next time slot after receiving the audio data, wherein the sensor data packet carries the sensor data.
[0159] As a possible implementation, after receiving the audio data, the sensor data is immediately read from the target buffer queue, and the sensor data is encapsulated to obtain a sensor data packet, and the sensor data packet is sent to the terminal device in the next time slot.
[0160] As another possible implementation, after receiving the audio data, the sensor data is read from the target buffer queue in the next time slot, and the sensor data is encapsulated to obtain a sensor data packet, which is then sent to the terminal device.
[0161] It should be noted that the timing of reading the sensor data from the buffer queue and packaging it is not limited here.
[0162] Optionally, a sensor data packet occupies several time slots.
[0163] Among them, the number of time slots occupied by the sensor data packet is to improve the transmission efficiency of the sensor data while ensuring that the return of the sensor data does not occupy the transmission time slot of the audio data. Therefore, the time slot occupied by the sensor data packet can be determined according to the transmission interval of the audio data. In order to ensure the reliability of the transmission, generally 1-3 time slots can be selected. Typically, in order to effectively utilize the Bluetooth channel time slot, the sensor data packet occupies 1 time slot.
[0164] Optionally, the type of the sensor data packet includes at least one of DM1, DH1, 2-DH1 and 3-DH1. Wherein, D(M|H)(1|3|5), D represents data packet, M represents medium rate packet with 2 / 3 ratio FEC; H represents high rate packet without error correction code; 1, 3, 5 represent the number of time slots occupied by the packet respectively;
[0165] DM1, DM3, DM5, DH1, DH3, DH5
[0166] In Bluetooth communication transmission, common data packet types and their parameters are shown in the following table:
[0167] Table 1 Common data packet types and parameters for Bluetooth communication
[0168]
[0169] It should be noted that in the type, D(M|H)(1|3|5), D represents data packets, M represents medium-rate packets with 2 / 3 ratio FEC (Forward Error Correction); H represents high-rate packets without error correction codes; 1, 3, and 5 represent the number of time slots occupied by the packets: DM1, DM3, DM5, DH1, DH3, and DH5. In Table 1, for the first number in the type, such as "2" in 2-DH1, the first number represents different effective loads. If it is 1, it is not written by default, such as DH1, 2-DH1, and 3-DH1. The corresponding time slots are the same, but the effective loads are different.
[0170] As the audio source, the terminal device will always send audio data to the wearable device. The data packet type of the audio data may be 2-DH5 or 3-DH5 as described in the table above. The terminal device has different types of audio signal encoding and decoding, and the data packet type of the audio data sent is also different. Generally speaking, the interval between audio data is 10ms-20ms. The wearable device sends the sensor data packet to the terminal device in the next time slot after receiving the audio data.
[0171] Optionally, the wearable device can send a sensor data packet to the terminal device via a radio frequency module in the Bluetooth chip.
[0172] The data transmission method of the embodiment of the present application collects sensor data, stores the sensor data in a target buffer queue, receives audio data sent by a terminal device, and reads sensor data from a data queue with the highest priority to be sent according to the priorities of each data queue to be sent in the wearable device, wherein the data queue with the highest priority to be sent is the target buffer queue, and sends a sensor data packet to the terminal device in the next time slot after receiving the audio data, wherein the sensor data packet carries sensor data, so that the wearable device does not immediately return the sensor data to the terminal device after collecting the sensor data, but waits until the interval of audio data transmission before returning the sensor data to the terminal device, thereby achieving a spatial audio effect, ensuring that the transmission of the sensor data will not affect the transmission of the audio data, will not affect the listening of normal audio, and improves the reliability of sensor data transmission.
[0173] In order to implement the above embodiments, the present application also proposes a wearable device.
[0174] Figure 6 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application.
[0175] like Figure 6 As shown, the terminal device includes: a transceiver unit 610 and a processing unit 620.
[0176] The transceiver unit 610 is used to receive the sensor data sent by the wearable device in the interval time slot of the last audio data transmission;
[0177] A processing unit 620, configured to perform audio processing on the audio data to be sent currently according to the sensor data, so as to output the processed audio data;
[0178] The transceiver unit 610 is further configured to send the spatial audio data to the wearable device.
[0179] As a possible implementation manner, the transceiver unit 610 is specifically configured to:
[0180] Receiving the sensor data through the Bluetooth chip of the terminal device;
[0181] The processing unit 620 is specifically used for:
[0182] Based on the sensor data, the audio data processor ADSP uses a spatial audio algorithm to process the audio data to be sent to obtain spatial audio data;
[0183] The transceiver unit 610 is further specifically configured to:
[0184] The spatial audio data is sent to the wearable device through the audio bus and the Bluetooth chip of the terminal device.
[0185] As a possible implementation manner, the transceiver unit 610 is specifically configured to:
[0186] Using the radio frequency module in the Bluetooth chip to receive a sensor data packet, wherein the sensor data packet carries sensor data;
[0187] The sensor data packet is parsed by a controller in the Bluetooth chip to obtain sensor data.
[0188] As a possible implementation manner, the transceiver unit 610 is further configured to:
[0189] Configuration parameters are acquired, and the sensor data packet is determined from the received data packet according to the configuration parameters.
[0190] As a possible implementation manner, the length of the interval time slot is determined according to a sending rate of the audio data configured by the terminal device.
[0191] As a possible implementation manner, the transceiver unit 610 is further configured to:
[0192] In the interval time slot of the last audio data transmission, monitoring the sensor data transmitted by the wearable device;
[0193] In response to monitoring the sensor data, the sensor data is received.
[0194] The terminal device of the embodiment of the present application receives the sensor data sent by the wearable device in the interval time slot of the last sending of audio data, performs audio processing on the audio data to be sent according to the sensor data, and outputs the processed audio data. When realizing the spatial audio effect, it is ensured that the transmission of the sensor data will not affect the transmission of the audio data, will not affect the listening of normal audio, and improves the reliability of the sensor data transmission.
[0195] It should be noted that the aforementioned explanation of the data transmission method embodiment applied to the terminal device is also applicable to the terminal device of this embodiment and will not be repeated here.
[0196] In order to implement the above embodiments, the present application also proposes a wearable device.
[0197] Figure 7 A schematic diagram of the structure of a wearable device provided in an embodiment of the present application.
[0198] like Figure 7 As shown, the terminal device includes: a sensor unit 710 and a transceiver unit 720.
[0199] Wherein, the sensor unit 710 is used to collect sensor data;
[0200] The transceiver unit 720 is used to receive audio data sent by the terminal device;
[0201] The transceiver unit 720 is further configured to send the sensor data to the terminal device in a set time slot after receiving the audio data.
[0202] As a possible implementation, the wearable device further includes:
[0203] A processing unit 730, configured to store the sensor data in a target buffer queue;
[0204] The processing unit 730 is further configured to: read the sensor data from the data queue to be sent with the highest priority according to the priorities of the data queues to be sent in the wearable device; wherein the data queue to be sent with the highest priority is the target buffer queue.
[0205] As a possible implementation manner, the transceiver unit 720 is specifically configured to:
[0206] A sensor data packet is sent to the terminal device in a next time slot after the audio data is received, wherein the sensor data packet carries the sensor data.
[0207] The terminal device of the embodiment of the present application collects sensor data, receives audio data sent by the terminal device, and sends the sensor data to the terminal device at a set time slot after receiving the audio data. When realizing the spatial audio effect, it is ensured that the transmission of the sensor data will not affect the transmission of the audio data, will not affect the listening of normal audio, and improves the reliability of the sensor data transmission.
[0208] It should be noted that the aforementioned explanation of the embodiment of the data transmission method applied to the wearable device is also applicable to the wearable device of this embodiment, and will not be repeated here.
[0209] In order to implement the above embodiment, the present application also proposes a communication system, including the above Figure 6 The embodiment proposes a terminal device and the aforementioned Figure 7 A wearable device is provided in an embodiment.
[0210] In order to implement the above embodiment, the present application also proposes an electronic device, comprising: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to call and execute the executable instructions stored in the memory to implement the above Figure 2-Figure 3The data transmission method proposed in the embodiment.
[0211] In order to implement the above embodiment, the present application also proposes an electronic device, comprising: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to call and execute the executable instructions stored in the memory to implement the above Figure 4-Figure 5 The data transmission method proposed in the embodiment.
[0212] In order to implement the above embodiment, the present application also proposes a non-transitory computer-readable storage medium. When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can execute the above Figure 2-Figure 3 The data transmission method proposed in the embodiment.
[0213] In order to implement the above embodiment, the present application also proposes a non-transitory computer-readable storage medium. When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can execute the above Figure 4-Figure 5 The data transmission method proposed in the embodiment.
[0214] In order to implement the above-mentioned embodiment, the embodiment of the present application further provides a computer program product, which, when executed by a processor of an electronic device, enables the electronic device to perform the above-mentioned Figure 2-Figure 3 The data transmission method proposed in the embodiment.
[0215] In order to implement the above-mentioned embodiment, the embodiment of the present application further provides a computer program product, which, when executed by a processor of an electronic device, enables the electronic device to perform the above-mentioned Figure 4-Figure 5 The data transmission method proposed in the embodiment.
[0216] Figure 8 8 is a block diagram of an electronic device according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0217] Reference Figure 8 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .
[0218] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
[0219] The memory 804 is configured to store various types of data to support operations on the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0220] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.
[0221] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
[0222] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.
[0223] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.
[0224] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the electronic device 800, the relative positioning of the components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0225] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as WiFi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0226] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.
[0227] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by a processor 820 of an electronic device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0228] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.
[0229] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0230] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.
[0231] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.
[0232] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0233] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.
[0234] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
[0235] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.
Claims
1. A data transmission method, characterized in that: The method is applied to a terminal device and comprises the following steps: In the interval time slot of the last audio data transmission, the sensor data transmitted by the wearable device is received; Performing audio processing on the audio data to be sent currently according to the sensor data to obtain spatial audio data, wherein the spatial audio data is audio data that allows the user of the wearable device to have a spatial experience; sending the spatial audio data to the wearable device; The receiving of sensor data sent by the wearable device in the interval time slot of the last sending of audio data includes: In the interval time slot of the last sending of audio data, receiving the sensor data through the Bluetooth chip of the terminal device; The performing audio processing on the audio data to be sent currently according to the sensor data to obtain spatial audio data includes: Based on the sensor data, the audio data to be sent is processed by the audio data processor ADSP of the terminal device using a spatial audio algorithm to obtain spatial audio data, wherein the spatial audio algorithm performs corresponding calculations on the audio data according to the spatial position movement of the user represented by the sensor data; The sending the spatial audio data to the wearable device includes: Sending the spatial audio data to the wearable device through the audio bus and the Bluetooth chip of the terminal device; The receiving the sensor data through the Bluetooth chip of the terminal device includes: Using the radio frequency module in the Bluetooth chip to receive a sensor data packet, wherein the sensor data packet carries sensor data and is a data packet occupying one time slot; The sensor data packet is parsed by a controller in the Bluetooth chip to obtain sensor data.
2. The method according to claim 1, characterized in that: Before the controller in the Bluetooth chip parses the sensor data packet to obtain the sensor data, the method further includes: Configuration parameters are acquired, and the sensor data packet is determined from the received data packet according to the configuration parameters.
3. The method according to claim 1, characterized in that The length of the interval time slot is determined according to the sending rate of the audio data configured by the terminal device.
4. The method according to claim 1, characterized in that The receiving of sensor data sent by the wearable device in the interval time slot of the last sending of audio data includes: In the interval time slot of the last audio data transmission, monitoring the sensor data transmitted by the wearable device; In response to monitoring the sensor data, the sensor data is received.
5. A data transmission method, characterized in that: The method is applied to a wearable device and comprises the following steps: Collect sensor data; Receiving audio data sent by a terminal device according to the data transmission method according to any one of claims 1 to 4; sending sensor data to the terminal device at a set time slot after receiving the audio data; The sending the sensor data to the terminal device at a set time slot after receiving the audio data comprises: A sensor data packet is sent to the terminal device in a next time slot after the audio data is received, wherein the sensor data packet carries the sensor data.
6. The method according to claim 5, characterized in that After collecting the sensor data, the method further includes: storing the sensor data in a target buffer queue; After receiving the audio data, the method further comprises: According to the priorities of the data queues to be sent in the wearable device, the sensor data is read from the data queue to be sent with the highest priority; wherein the data queue to be sent with the highest priority is the target buffer queue.
7. The method according to claim 6, characterized in that The sensor data packet occupies 1 time slot.
8. A terminal device, characterized in that: include: The transceiver unit is used to receive the sensor data sent by the wearable device in the interval time slot of the last audio data transmission; a processing unit, configured to perform audio processing on the audio data to be sent currently according to the sensor data to obtain spatial audio data, wherein the spatial audio data is audio data that allows the user of the wearable device to have a spatial experience; The transceiver unit is further used to send the spatial audio data to the wearable device; The transceiver unit is used for: In the interval time slot of the last sending of audio data, receiving the sensor data through the Bluetooth chip of the terminal device; The processing unit is used for: Based on the sensor data, the audio data to be sent is processed by the audio data processor ADSP of the terminal device using a spatial audio algorithm to obtain spatial audio data, wherein the spatial audio algorithm performs corresponding calculations on the audio data according to the spatial position movement of the user represented by the sensor data; The transceiver unit is also used for: Sending the spatial audio data to the wearable device through the audio bus and the Bluetooth chip of the terminal device; The receiving the sensor data through the Bluetooth chip of the terminal device includes: Using the radio frequency module in the Bluetooth chip to receive a sensor data packet, wherein the sensor data packet carries sensor data and is a data packet occupying one time slot; The sensor data packet is parsed by a controller in the Bluetooth chip to obtain sensor data.
9. A wearable device comprising: A sensor unit, for collecting sensor data; A transceiver unit, configured to receive audio data sent by a terminal device according to the data transmission method according to any one of claims 1 to 4; The transceiver unit is further configured to send sensor data to the terminal device at a set time slot after receiving the audio data; The sending the sensor data to the terminal device at a set time slot after receiving the audio data comprises: A sensor data packet is sent to the terminal device in a next time slot after the audio data is received, wherein the sensor data packet carries the sensor data.
10. The wearable device according to claim 9, characterized in that: The wearable device further includes: a processing unit, configured to store the sensor data in a target buffer queue; The processing unit is also used for: According to the priorities of the data queues to be sent in the wearable device, the sensor data is read from the data queue to be sent with the highest priority; wherein the data queue to be sent with the highest priority is the target buffer queue.
11. A communication system, characterized in that: include: The terminal device as described in claim 8 and the wearable device as described in any one of claims 9-10.
12. An electronic device, characterized in that: include: processor; a memory for storing executable instructions for the processor; The processor is configured to call and execute executable instructions stored in the memory to implement the method as described in any one of claims 1-4 or 5-7.
13. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method as described in any one of claims 1-4 or 5-7.
Citation Information
Patent Citations
Speech quality improving method and system and mobile terminal
CN105469802A
Gesture interactive wearable spatial audio system
CN105874408A
Bluetooth audio transmission method and device and computer readable memory medium
CN108848410A
Mixed reality system with spatialized audio
CN109791441A
Method for generating customized spatial audio with head tracking
CN110021306A
