Audio synchronous transmission method and device, electronic equipment and storage medium

Abstract

The invention provides an audio synchronous transmission method and device, electronic equipment and a storage medium, and belongs to the technical field of audio synchronous transmission, the method comprises the following steps: obtaining complete channel monitoring data, the complete channel monitoring data comprising unilateral channel quality monitoring data and round-trip data monitoring data; taking at least one kind of quality monitoring data in the single-party channel quality monitoring data and / or round-trip data monitoring data as forward channel monitoring data, and sending the forward channel monitoring data to the second equipment in a target form; determining a target channel quality score based on the forward channel monitoring data and the backward channel monitoring data; determining an audio synchronous transmission strategy based on the target channel quality score; and performing audio synchronous transmission with the second equipment based on the audio synchronous transmission strategy. According to the invention, the timeliness of audio synchronous transmission can be improved.

Description

Technical Field

[0001] This application belongs to the field of audio synchronization transmission technology, and more specifically, relates to an audio synchronization transmission method and apparatus, electronic device, and storage medium. Background Technology

[0002] With the rapid popularization of devices such as smartwatches and smart glasses, the scenarios for synchronous audio transmission between them and devices like smartphones and tablets are becoming increasingly diverse, covering various applications such as call interaction, music playback, voice assistant command transmission, and voice feedback of health data. In these scenarios, the real-time performance and stability of synchronous audio transmission directly affect the user experience. For example, audio desynchronization during a call can lead to stuttering and echoes.

[0003] However, in existing technologies, when users make calls using wearable electronic devices such as smartwatches and smart glasses, the following situations often occur: after the user makes a sound, the other party in the call can only receive the user's sound after a relatively long time; conversely, after the other party makes a sound, the user can only receive the other party's sound after a relatively long time.

[0004] Therefore, an audio synchronization transmission method is needed to improve the timeliness of audio synchronization transmission. Summary of the Invention

[0005] The purpose of this application is to provide an audio synchronous transmission method, apparatus, electronic device, and storage medium to improve the timeliness of audio synchronous transmission.

[0006] A first aspect of this application provides an audio synchronization transmission method, comprising: Acquire complete channel monitoring data, which includes: one-way channel quality monitoring data and round-trip data monitoring data; the one-way channel quality monitoring data is obtained by the first device performing channel quality monitoring at a first frequency, and includes multiple quality monitoring data; the round-trip data monitoring data is obtained by sending a round-trip time measurement request to the second device at a second frequency; the first frequency is N times the second frequency, where N is a positive integer; the first device and the second device perform full-duplex data interaction; At least one quality monitoring data from the unidirectional channel quality monitoring data, and / or round-trip data monitoring data, are used as forward channel monitoring data, and the forward channel monitoring data is sent to the second device in a target format; the target format is either an independent data frame or an embedded data frame; the embedded data frame format is a data format in which the forward channel monitoring data is embedded into a data frame; the data frame is used for audio data transmission. The target channel quality score is determined based on forward channel monitoring data and reverse channel monitoring data. The reverse channel monitoring data is the monitoring data returned by the second device based on the forward channel monitoring data. Determine the audio synchronization transmission strategy based on the target channel quality score; Audio is transmitted synchronously with a second device based on an audio synchronization transmission strategy.

[0007] A second aspect of this application provides an audio synchronization transmission device, comprising: The monitoring data acquisition module is used to acquire complete channel monitoring data, which includes: one-way channel quality monitoring data and round-trip data monitoring data. The one-way channel quality monitoring data is obtained by the first device performing channel quality monitoring at a first frequency, and includes multiple quality monitoring data. The round-trip data monitoring data is obtained by sending a round-trip time measurement request to the second device at a second frequency. The first frequency is N times the second frequency, where N is a positive integer. Full-duplex data interaction is performed between the first device and the second device. The monitoring data transmission module is used to take at least one quality monitoring data from the unidirectional channel quality monitoring data, and / or, the round-trip data monitoring data, as the forward channel monitoring data, and send the forward channel monitoring data to the second device in a target form; the target form is either an independent data frame or an embedded data frame; the embedded data frame form is a data form in which the forward channel monitoring data is embedded in a data frame; the data frame is used for audio data transmission; The channel quality score determination module is used to determine the target channel quality score based on forward channel monitoring data and reverse channel monitoring data. The reverse channel monitoring data is the monitoring data returned by the second device based on the forward channel monitoring data. The transmission strategy determination module is used to determine the audio synchronization transmission strategy based on the target channel quality score; The synchronous transmission module is used to perform synchronous audio transmission with the second device based on the audio synchronous transmission strategy.

[0008] A third aspect of this application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program to implement the steps of the above-described audio synchronization transmission method.

[0009] A fourth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the above-described audio synchronization transmission method.

[0010] The beneficial effects of the audio synchronization transmission method, apparatus, electronic device, and storage medium provided in this application are as follows: This embodiment provides a flexible solution for different link load conditions by sending forward channel monitoring data to the second device in the form of independent data frames or embedded data frames. Independent data frames encapsulate the forward channel monitoring data into a separate data frame, offering flexible data format, carrying more monitoring indicators, and providing more detailed feedback on channel quality information. This results in a more accurate determination of the target channel quality score, making the audio synchronization transmission strategy more suitable for current audio transmission scenarios and improving the timeliness of audio transmission. Embedded data frames, on the other hand, embed the forward channel monitoring data into the audio data transmission frame, without occupying separate link resources, resulting in extremely low overhead. It reuses the idle space of existing data frames, adding almost no extra bandwidth, further improving the timeliness of audio synchronization transmission. This embodiment determines the target channel quality score based on the forward channel monitoring data and the reverse channel monitoring data returned by the second device. Reverse channel monitoring data reflects the link quality from the second device to the first device. Combined with forward channel monitoring data, it takes into account the channel quality in both directions. The resulting target channel quality score can more accurately reflect the actual condition of the entire communication link, so that the final audio synchronization transmission strategy can meet the timeliness requirements of audio synchronization transmission. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 A flowchart illustrating an audio synchronization transmission method provided in an embodiment of this application; Figure 2 A structural block diagram of an audio synchronization transmission device provided in an embodiment of this application; Figure 3 This is a schematic block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0013] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0014] Before going into details, let me clarify one possible application scenario for this application: This application is applied to a first device (e.g., smart glasses). Each component of the smart glasses contains a component that can interact with a second device via Bluetooth, Wi-Fi, or other wireless / wired connections. After the first device using the method of this application establishes a data connection with the second device, the playback and reception of voice are preferentially performed through the first device by default.

[0015] To make the objectives, technical solutions, and advantages of this application clearer, the following description will be provided in conjunction with the accompanying drawings and specific embodiments.

[0016] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating an audio synchronization transmission method provided in an embodiment of this application. The method is executed by a first device and includes: S101-S105.

[0017] S101: Obtain complete channel monitoring data, which includes: one-way channel quality monitoring data and round-trip data monitoring data; the one-way channel quality monitoring data is obtained by the first device performing channel quality monitoring at the first frequency, and includes multiple quality monitoring data; the round-trip data monitoring data is obtained by sending a round-trip time measurement request to the second device at the second frequency; the first frequency is N times the second frequency, where N is a positive integer; the first device and the second device perform full-duplex data interaction.

[0018] In this embodiment, complete channel monitoring data refers to the monitoring data of the first device itself. The first device can be a wearable storage medium, such as smart glasses, and the second device can be a mobile phone or tablet or other electronic device. The unilateral channel quality monitoring data in the complete channel monitoring data is channel quality data collected and calculated solely by the first device. The first frequency refers to the fixed time interval or execution cycle at which the first device performs channel quality monitoring, which can be 100ms / time. Signal quality monitoring refers to the performance evaluation of the communication link between the first device and the second device, the core of which is to determine whether the current link is stable and can meet the requirements of synchronous audio transmission. Various quality monitoring data can be, for example, Received Signal Strength Indicator (RSSI), Link Quality Indicator (LQI), or Bit Error Rate (BER). Full-duplex data interaction between the second device and the first device means that the second device and the first device can send and receive data simultaneously, with bidirectional communication without blocking each other.

[0019] In this embodiment, the second frequency refers to the fixed time interval or execution cycle at which the first device sends a round-trip time measurement request to the second device. The first frequency is N times the second frequency, where N is a positive integer, such as N=5. This means the period of the second frequency is longer; for example, if the first frequency is 100ms / time, the second frequency is 500ms / time. The first and second frequencies can also be other preset values.

[0020] In one embodiment of this application, since the first frequency and the second frequency are different, and the first frequency is N times the second frequency, the number of monitored data obtained when sending data to the second device is different. For example, if the first frequency is 100ms / time and the second frequency is 500ms / time, the first device may obtain 5 one-way channel quality monitoring data when obtaining one round-trip data monitoring data. Therefore, the one-way channel quality monitoring data can be determined by taking the average value.

[0021] In other words, the unilateral channel quality monitoring data is obtained by performing channel quality monitoring at the first frequency and through the following methods: Perform channel quality monitoring at the first frequency until N intervals of channel quality monitoring data are obtained. The average value of N interval channel quality monitoring data is taken to obtain the single-side channel quality monitoring data.

[0022] In this embodiment, since the first frequency is N times the second frequency, there are N sets of data monitored at the first frequency within the time interval of monitoring at the second frequency. The interval channel quality monitoring data is the monitoring data obtained each time channel quality monitoring is performed at the first frequency. Therefore, in this embodiment, the average value is taken as the final one-way channel quality monitoring data.

[0023] In this embodiment, a round-trip time (RTT) measurement request refers to a specific data packet actively sent by the first device to the second device to trigger RTT measurement. RTT reflects the total time it takes for data to travel from the first device to the second device and back, serving as an indicator of link transmission latency. Audio synchronization is extremely sensitive to latency; for example, a call delay exceeding 100ms will result in noticeable stuttering. RTT monitoring data refers to the specific time value calculated through the RTT measurement request, typically in milliseconds.

[0024] S102: Take at least one quality monitoring data from the unidirectional channel quality monitoring data, and / or, the round-trip data monitoring data, as the forward channel monitoring data, and send the forward channel monitoring data to the second device in a target form; the target form is an independent data frame or an embedded data frame; the embedded data frame is a data form in which the forward channel monitoring data is embedded in a data frame; the data frame is used for audio data transmission.

[0025] In this embodiment, at least one quality monitoring data from the unilateral channel quality monitoring data can be used as forward channel monitoring data, or round-trip data monitoring data can be used as forward channel monitoring data, or forward channel monitoring data and at least one quality monitoring data from the unilateral channel quality data can be used together as forward channel monitoring data.

[0026] In this embodiment, the independent data frame format refers to encapsulating the forward channel monitoring data into a separate data frame, such as a Service Data Unit (SDU) data packet at the Bluetooth L2CAP layer, which is then sent separately as service data. The embedded data frame format refers to embedding the forward channel monitoring data into a data frame. Since this data frame itself is the same data frame used for audio data transmission between the first and second devices, the monitoring data is sent via the transmission of this data frame without occupying link resources independently.

[0027] Independent data frames offer flexible data formats and can carry more monitoring metrics, but they have higher overhead, requiring dedicated link bandwidth and transmission time, which may increase audio frame latency. Embedded data frames have extremely low overhead, reusing the free space of existing data frames (such as reserved or extended fields) with almost no additional bandwidth usage; however, their capacity is limited by the data frame length, typically carrying only a small number of key metrics.

[0028] Therefore, in one embodiment of this application, the process of determining the target form includes: In response to the transmission traffic in the first link exceeding the preset traffic, the target format is determined to be an embedded data frame; the first link is a unidirectional communication link for transmitting audio data from the first device to the second device; the preset traffic is a fixed proportion of the maximum traffic capacity corresponding to the first link; If the transmission traffic in the first link is less than or equal to the preset traffic, the target format is determined to be an independent data frame.

[0029] In this embodiment, when the transmission traffic of the first link (i.e., the unidirectional communication link from the first device to the second device transmitting audio) exceeds the preset traffic, the link load is high. Priority should be given to ensuring audio data transmission to avoid independent data packets consuming resources and causing stuttering. Therefore, monitoring data can be sent in the form of embedded data frames. Conversely, when the transmission traffic in the first link is less than or equal to the preset traffic, the link load is low, and sending additional independent data packets will not affect audio synchronization. Therefore, independent data frames with larger data capacity and more flexible data format can be selected for transmission. The fixed ratio can be set based on experience.

[0030] S103: Determine the target channel quality score based on forward channel monitoring data and reverse channel monitoring data. The reverse channel monitoring data is the monitoring data returned by the second device based on the forward channel monitoring data.

[0031] In this embodiment, the reverse channel monitoring data refers to the data returned by the second device to the first device after receiving the forward channel monitoring data, reflecting the link quality from the second device to the first device. Its data processing process and transmission format are the same as those of the first device.

[0032] In this embodiment, forward channel monitoring data and reverse channel monitoring data can be combined. For example, the evaluation results can be quantified through weighted calculation, and the quantified evaluation results can be determined as the target channel quality score. The specific calculation method is not limited in this embodiment.

[0033] S104: Determine the audio synchronization transmission strategy based on the target channel quality score.

[0034] In this embodiment, an audio synchronization transmission strategy can be determined by a preset mapping table. The mapping table contains at least the mapping relationship between channel quality score and transmission strategy, as shown in Table 1. That is, after obtaining the target channel quality score, the quality score range in which the target channel quality score is located is determined based on Table 1, and the corresponding audio synchronization transmission strategy is determined based on the quality score range to which it belongs.

[0035]

[0036] S105: Perform audio synchronous transmission with the second device based on the audio synchronous transmission strategy.

[0037] In this embodiment, the corresponding components or data transmission methods can be controlled based on the audio synchronization transmission strategy determined above, so as to perform synchronous audio transmission with the second device.

[0038] As can be seen from the above, this embodiment provides a flexible solution for different link load conditions by sending forward channel monitoring data to the second device in the form of independent data frames or embedded data frames. The independent data frame format encapsulates the forward channel monitoring data into a separate data frame, offering flexible data format, carrying more monitoring indicators, and providing more detailed feedback on channel quality information. Based on this, the determination of the target channel quality score is more accurate, making the audio synchronization transmission strategy more suitable for the current audio transmission scenario and improving the timeliness of audio transmission. The embedded data frame format, on the other hand, embeds the forward channel monitoring data into the audio data transmission data frame, without occupying separate link resources, resulting in extremely low overhead. It reuses the idle space of existing data frames, adding almost no extra bandwidth, further improving the timeliness of audio synchronization transmission. This embodiment determines the target channel quality score based on the forward channel monitoring data and the reverse channel monitoring data returned by the second device. Reverse channel monitoring data reflects the link quality from the second device to the first device. Combined with forward channel monitoring data, it takes into account the channel quality in both directions. The resulting target channel quality score can more accurately reflect the actual condition of the entire communication link, so that the final audio synchronization transmission strategy can meet the timeliness requirements of audio synchronization transmission.

[0039] In one embodiment of this application, if the target format is an embedded data frame, the process of determining the forward channel monitoring data includes: Based on the number of bytes in the free field of the target data frame, at least one monitoring data is determined from multiple quality monitoring data and round-trip data monitoring data as the forward channel monitoring data; the at least one monitoring data includes: at least one quality monitoring data in the unidirectional channel quality monitoring data, and / or, round-trip data monitoring data, the target data frame is the data frame that the first device will send to the second device next; the target data frame is the data frame that the first device sends to the second device at a third frequency for audio data transmission. The forward channel monitoring data is sent to the second device in target form, including: Adjust the target data frame based on forward channel monitoring data; The forward channel monitoring data is sent to the second device via the adjusted target data frame.

[0040] In this embodiment, the data frame is a standardized frame used by the first and second devices to transmit audio data. Considering that multiplexing data frames can reduce additional bandwidth usage, its length is adjusted according to the link quality level (see Table 1). When the link quality level is good, the data packet capacity is larger to reduce the number of transmissions, resulting in a longer data frame length. Conversely, when the link quality level is poor, the data packet capacity is smaller to reduce the risk of single transmission failure, resulting in a shorter data frame length. Therefore, the data frame length will change due to changes in the previous audio synchronization transmission strategy.

[0041] In this embodiment, at least one monitoring data can be determined from various quality monitoring data and round-trip time monitoring data by the number of bytes in the idle field of the target data frame, and used as the forward channel monitoring data.

[0042] For example, if the idle field of the target data frame is only 3 bytes, then RSSI+RTT (3 bytes in total) is selected from RSSI (1 byte), LQI (1 byte), and RTT (2 bytes) as the forward channel monitoring data, discarding LQI. Alternatively, LQI+RTT (3 bytes in total) or RSSI+LQI (2 bytes in total) can be selected. In this embodiment, the priority of each monitoring data can be predetermined, and different priorities can be set in different scenarios. For example, in this embodiment, the application scenario is a two-way call scenario, where latency and jitter directly affect the call experience. Secondly, link quality needs to be monitored to avoid call interruption. Therefore, the priorities can be set in the following order: RTT first, then RSSI, and finally LQI. RTT can provide latency information that other indicators cannot provide.

[0043] In this embodiment, the target data frame refers to the data frame that the first device will send to the second device next. It is the current frame to be sent among many periodic data frames and serves as the carrier of the current monitoring data. The transmission frequency is the third frequency, which is a preset value and can be set based on experience or other protocols. Adjusting the target data frame refers to embedding encoded forward monitoring data into the target data frame, such as reusing the payload area or reserved fields of the target data frame, so that it can accommodate the selected forward channel monitoring data without destroying the core function of the target data frame. After the data embedding is completed, the selected forward channel monitoring data is written into the adjustment field of the target data frame according to the preset encoding rules (such as RSSI offset conversion or RTT little-endian storage), and then sent to the second device normally along with the target data frame at the third frequency.

[0044] As can be seen from the above, this embodiment of the application avoids creating additional independent data packets to transmit monitoring data by multiplexing forward channel monitoring data into the target data frame for transmission, thereby reducing the occupation of additional bandwidth. Without affecting the core function of the target data frame, it achieves effective transmission of monitoring data and improves the utilization efficiency of link resources. The length of the target data frame is dynamically adjusted according to changes in link quality. When the link quality is good, the target data frame is longer, accommodating more monitoring data; when the link quality is poor, the target data frame is shorter, allowing for the selection and transmission of key monitoring data. This method of dynamically adjusting the amount of monitoring data transmitted based on link quality further optimizes bandwidth usage, ensuring link stability while transmitting as much useful channel quality information as possible.

[0045] In one embodiment of this application, adjusting the target data frame based on forward channel monitoring data includes: Each monitoring data point contained in the forward channel monitoring data is encoded to obtain at least one encoded data point; Based on the number of bytes in each encoded data, the target control frame is adjusted using at least one of the following methods: Reuse the payload area of ​​the target data frame; Reuse the reserved fields of the target data frame.

[0046] In this embodiment, the original indicators in the forward channel monitoring data, such as RSSI=-65dBm, LQI=140 and RTT=25ms, are converted into a compact format encoding suitable for storage in the data frame. Essentially, this solves the problem of mismatch between the original data format and the data frame field requirements.

[0047] The purpose of encoding is to adapt to the unsigned field restrictions of data frames. Since most data frame fields are unsigned numbers, negative numbers need to be converted to positive numbers. For example, RSSI=-65dBm can be converted to 63, which can be achieved by using an offset of +128. At the same time, it can compress the data length. For example, RTT=25ms can be stored as a 2-byte unsigned number instead of text or floating-point format. It can also unify the data format so that different types of monitoring data can be parsed according to fixed rules.

[0048] For example, RSSI (-65dBm) is encoded as 0x3F; LQI (140) is directly encoded as 0x8C; RTT (25ms) is encoded as 0x1900 (2 bytes of little-endian storage).

[0049] In this embodiment, the target data frame is embedded based on the length of each encoding. The core logic of this embodiment is: the original structure of the data frame has a fixed length and field divisions, and the modification needs to be adjusted as needed to ensure that all encoded data can be accommodated without exceeding the maximum length limit of the Bluetooth protocol for this type of data frame.

[0050] The process of adjusting the structure of the target data frame includes at least one of the following: (1) Reuse the payload area of ​​the target data frame.

[0051] The idle space in the payload area is reused. The payload area carries service data. The encoded monitoring data can be embedded at the end of the service data. At the same time, the implicit value of the payload length is updated so that the receiver (second device) can distinguish between service data and forward channel monitoring data.

[0052] (2) Reuse the reserved fields of the target data frame.

[0053] In the data frame defined by the Bluetooth protocol, there are reserved fields whose functions have not yet been assigned. Reusing these idle fields to carry the encoded monitoring data does not require increasing the total length of the data frame. In this embodiment, it is preferable to reuse some of the bytes, that is, the remaining bytes still retain their original values.

[0054] For example, a 2-byte reserved field at the end of a data frame can be reused as a 1-byte storage space. Encoded data can be directly written into this field, keeping the total length unchanged. This does not increase the data frame length, and the additional bandwidth usage on the link is almost zero, resulting in the best compatibility.

[0055] In this embodiment, the adjustment of the data frame can be performed in the following order: first, reuse the standard reserved field of the target data frame, and then reuse the payload area of ​​the target data frame. The reason, as mentioned above, is that reusing the standard reserved field of the target data frame does not increase the data frame length, has almost zero additional bandwidth usage on the link, and offers the best compatibility; therefore, this adjustment method can be preferred.

[0056] As can be seen from the above, this embodiment adjusts the target data frame based on the length of each encoding, flexibly selecting the adjustment method according to the total length of the encoded data, thus ensuring the rationality and effectiveness of the data frame structure adjustment. Through optimization of the data frame structure and reasonable processing of the monitoring data, this embodiment enables the second device to receive accurate and comprehensive forward channel monitoring data, which can serve as an important basis for the second device to assess channel quality and formulate audio synchronization transmission strategies. Simultaneously, the data transmission and processing mechanism of this embodiment also helps improve the stability and reliability of the entire audio synchronization transmission system, reducing the occurrence of transmission interruptions or data errors caused by channel quality issues.

[0057] In one embodiment of this application, determining a target channel quality score based on forward channel monitoring data and reverse channel monitoring data includes: The first type of indicators are determined based on forward channel monitoring data, and each indicator in the first type of indicators is mapped to a standardized score; the first type of indicators are used to characterize the channel quality of the first link. The second type of indicators are determined based on the reverse channel monitoring data, and each indicator in the second type of indicators is mapped to a standardized score; the second type of indicators are used to characterize the channel quality of the second link; the second link is a one-way communication link for transmitting audio data from the second device to the first device; For each indicator dimension, the target score for that dimension is determined based on the standardized scores of the indicators in the first category of indicators and the standardized scores of the indicators in the second category of indicators. The target channel quality score is obtained by weighting the target scores of each indicator dimension.

[0058] In this embodiment, the first link refers to the unidirectional communication link from the first device to the second device, which is the main path for audio uplink transmission. The first type of index refers to specific parameters extracted from the forward channel monitoring data that characterize the quality of the first link, corresponding to the monitoring dimensions, such as effective RSSI, LQI, frame error rate, RTT, etc.

[0059] Standardized scores refer to converting the raw values ​​of Category I indicators, such as RSSI=-65dBm and LQI=140, into a uniform score of 0-100 to eliminate differences in units and ranges between different indicators. For example: RSSI = -65dBm, which is in the excellent range of -90 to -60dBm, corresponding to a standardized score of 80; An LQI of 140 is in the good range of 100-150, corresponding to a standardized score of 80.

[0060] In this embodiment, the standardized scores of each indicator can be determined by a preset mapping table, which will not be elaborated further in this embodiment.

[0061] In this embodiment, the second link refers to the unidirectional communication link from the second device to the first device, which is the main path for downlink audio transmission. The second type of metric refers to specific parameters extracted from reverse channel monitoring data that characterize the quality of the second link. The standardization scoring logic is exactly the same as the standardization rules for the first type of metric, avoiding deviations caused by different conversion rules.

[0062] In this embodiment, the indicator dimension refers to a specific monitoring indicator type, such as RSSI as one dimension and LQI as another. Each dimension corresponds to two standardized scores (positive score and negative score) for the bidirectional link. The target score is a single score obtained by fusing the positive and negative standardized scores of the same dimension, used to characterize the overall bidirectional quality of that dimension. The target score can be determined by using an arithmetic mean. For example, if the positive standardized score of the RSSI dimension is 80 and the negative standardized score is 60, then the target score is (80+60) / 2 = 70. In this embodiment, the target scores for each indicator dimension are weighted to obtain the channel quality score of the audio synchronization transmission system. This involves assigning different weights to different indicator dimensions based on their importance to audio synchronization transmission, and then summing the target scores for each dimension by their corresponding weights. The weights for the weighted summation can be set by the user.

[0063] In one embodiment of this application, determining the target score for a dimension based on the standardized scores of the indicators for that dimension in the first type of indicators and the standardized scores of the indicators for that dimension in the second type of indicators includes: In response to the lack of standardized scores for the indicators of this dimension in the first category of indicators and the lack of standardized scores for the indicators of this dimension in the second category of indicators, the target score for this dimension is set to a preset value. In response to the lack of standardized scores for the indicators in the first category of indicators, or the lack of standardized scores for the indicators in the second category of indicators, the standardized scores for the missing links in the same dimension are determined based on the standardized scores for the non-missing links in the same dimension; the target score for the dimension is determined based on the standardized scores for the non-missing links in the same dimension and the expanded standardized scores for the missing links in the same dimension. Since the standardized scores of the indicators in this dimension of the first category of indicators are not missing, and the standardized scores of the indicators in this dimension of the second category of indicators are not missing, the average of the standardized scores of the indicators in this dimension of the first category of indicators and the standardized scores of the indicators in this dimension of the second category of indicators is taken as the target score for this dimension.

[0064] In this embodiment, considering that the data processing and transmission process of the second device is consistent, if the data packet sent by the second device is in the form of an embedded data frame, and the number of bytes in the free field of the target data frame is small, it may not be able to carry all the monitoring data, which may lead to insufficient data and missing data. Therefore, in this embodiment, for each dimension of the indicator, if the standardized score of the indicator of that dimension in the first type of indicator and the standardized score of the indicator of that dimension in the second type of indicator are both missing, it can be set to the average of the historical target scores of that dimension or other preset values.

[0065] If only one standardized score is missing, the standardized score of the missing party can be determined based on the unmissing standardized scores. The principle is that two links are typically in the same physical environment, constrained by common link quality factors, and environmental factors do not change drastically due to changes in transmission direction. In this embodiment, it is also considered that the second device has a larger antenna and higher transmission power, while the first device, due to size limitations, has a smaller antenna and lower transmission power. Therefore, even in the same environment, the RSSI from the second device to the first device is usually higher than the RSSI from the first device to the second device. Therefore, in this embodiment, in response to the absence of a standardized score for that dimension of the first category of indicators and the absence of a standardized score for that dimension of the second category of indicators, the standardized score of that dimension of the first category of indicators is multiplied by a first coefficient to obtain the standardized score of that dimension of the second category of indicators; in response to the absence of a standardized score for that dimension of the first category of indicators and the absence of a standardized score for that dimension of the second category of indicators, the standardized score of that dimension of the second category of indicators is multiplied by a second coefficient to obtain the standardized score of that dimension of the first category of indicators. The first coefficient is greater than the second coefficient. The first coefficient can be 1.2, and the second coefficient can be 0.8. The average of the standardized scores (without missing data) and the determined standardized scores is then used to determine the target score for that dimension. Having a first coefficient greater than the second coefficient ensures that the final score better reflects hardware capabilities, matches the hardware differences between the terminal and the first device, and ensures that the estimated bidirectional link quality matches the actual situation.

[0066] If the standardized scores of the indicators for this dimension in the first category of indicators and the standardized scores of the indicators for this dimension in the second category of indicators are both available, then the average of the two can be taken as the target score for this dimension.

[0067] As can be seen from the above, this application comprehensively considers the channel quality of both the first-to-second and second-to-first unidirectional communication links by determining the first type of indicators based on forward channel monitoring data and the second type of indicators based on reverse channel monitoring data. This avoids the one-sidedness of evaluation caused by considering only a single link, and can more accurately reflect the actual channel conditions of the entire audio synchronous transmission system. This provides a reliable basis for subsequent audio transmission strategy adjustments and ensures the stability of audio synchronous transmission. This embodiment also considers that if the data packets sent by the second device are in the form of embedded data frames, and the number of bytes in the free field of the target data frame is small, it may not be able to carry all the monitoring data, leading to insufficient or missing data. This application provides detailed processing for different data loss situations for each dimension of the indicators and sets corresponding coping strategies, enabling the system to still perform channel quality evaluation when facing data loss. This enhances the robustness and reliability of the system, avoids evaluation interruptions or inaccurate results due to data loss, and ensures the normal operation of the audio synchronous transmission system under various conditions.

[0068] Corresponding to the audio synchronization transmission method in the above embodiments, Figure 2 This is a structural block diagram of an audio synchronization transmission device provided according to an embodiment of this application. For ease of explanation, only the parts relevant to the embodiment of this application are shown. References Figure 2 The audio synchronization transmission device 20 includes: a monitoring data acquisition module 21, a monitoring data transmission module 22, a channel quality score determination module 23, a transmission strategy determination module 24, and a synchronization transmission module 25.

[0069] The monitoring data acquisition module 21 is used to acquire complete channel monitoring data, which includes: one-way channel quality monitoring data and round-trip data monitoring data. The one-way channel quality monitoring data is obtained by the first device performing channel quality monitoring at a first frequency, and includes multiple quality monitoring data. The round-trip data monitoring data is obtained by sending a round-trip time measurement request to the second device at a second frequency. The first frequency is N times the second frequency, where N is a positive integer. Full-duplex data interaction is performed between the first device and the second device. The monitoring data transmission module 22 is used to take at least one quality monitoring data from the unidirectional channel quality monitoring data, and / or the round-trip data monitoring data as forward channel monitoring data, and send the forward channel monitoring data to the second device in a target form; the target form is an independent data frame or an embedded data frame; the embedded data frame is a data form in which the forward channel monitoring data is embedded in a data frame; the data frame is used for audio data transmission; The channel quality score determination module 23 is used to determine the target channel quality score based on forward channel monitoring data and reverse channel monitoring data. The reverse channel monitoring data is the monitoring data returned by the second device based on the forward channel monitoring data. Transmission strategy determination module 24 is used to determine the audio synchronization transmission strategy based on the target channel quality score; The synchronous transmission module 25 is used to perform synchronous audio transmission with the second device based on the audio synchronous transmission strategy.

[0070] In one embodiment of this application, the audio synchronization transmission device 20 further includes: a data frame adjustment module; If the target data is in the form of an embedded data frame, the monitoring data transmission module 22 is further configured to determine at least one monitoring data from multiple quality monitoring data and round-trip data monitoring data based on the number of bytes in the free field of the target data frame, as the forward channel monitoring data; the at least one monitoring data includes: at least one quality monitoring data in the unidirectional channel quality monitoring data, and / or, round-trip data monitoring data, the target data frame being the data frame that the first device will send to the second device next; the target data frame being the data frame that the first device sends to the second device at a third frequency for audio data transmission; The forward channel monitoring data is sent to the second device in target form, including: Adjust the target data frame based on forward channel monitoring data; The forward channel monitoring data is sent to the second device via the adjusted target data frame.

[0071] In one embodiment of this application, the monitoring data transmission module 22 is further configured to encode each monitoring data contained in the forward channel monitoring data to obtain at least one encoded data. Based on the number of bytes in each encoded data, the target control frame is adjusted using at least one of the following methods: Reuse the payload area of ​​the target data frame; Reuse the reserved fields of the target data frame.

[0072] In one embodiment of this application, the unilateral channel quality monitoring data is obtained by performing channel quality monitoring at a first frequency and obtaining N interval channel quality monitoring data by performing channel quality monitoring at the first frequency. The average value of N interval channel quality monitoring data is taken to obtain the single-side channel quality monitoring data.

[0073] In one embodiment of this application, the audio synchronization transmission device 20 further includes: a transmission format determination module, configured to determine the target format as an embedded data frame format in response to the transmission traffic in the first link being greater than a preset traffic; the first link is a unidirectional communication link for transmitting audio data from the first device to the second device; the preset traffic is a fixed proportion of the maximum traffic capacity corresponding to the first link; If the transmission traffic in the first link is less than or equal to the preset traffic, the target format is determined to be an independent data frame.

[0074] In one embodiment of this application, the channel quality score determination module 23 is specifically used to determine a first type of index based on forward channel monitoring data, and map each index in the first type of index to a standardized score; the first type of index is used to characterize the channel quality of the first link; The second type of indicators are determined based on the reverse channel monitoring data, and each indicator in the second type of indicators is mapped to a standardized score; the second type of indicators are used to characterize the channel quality of the second link; the second link is a one-way communication link for transmitting audio data from the second device to the first device; For each indicator dimension, the target score for that dimension is determined based on the standardized scores of the indicators in the first category of indicators and the standardized scores of the indicators in the second category of indicators. The target channel quality score is obtained by weighting the target scores of each indicator dimension.

[0075] In one embodiment of this application, the channel quality score determination module 23 is further configured to, in response to the lack of standardized scores for the indicators of that dimension in the first type of indicators and the lack of standardized scores for the indicators of that dimension in the second type of indicators, set the target score of that dimension to a preset value. In response to the lack of standardized scores for the indicators in the first category of indicators, or the lack of standardized scores for the indicators in the second category of indicators, the standardized scores for the missing links in the same dimension are determined based on the standardized scores for the non-missing links in the same dimension; the target score for the dimension is determined based on the standardized scores for the non-missing links in the same dimension and the expanded standardized scores for the missing links in the same dimension. Since the standardized scores of the indicators in this dimension of the first category of indicators are not missing, and the standardized scores of the indicators in this dimension of the second category of indicators are not missing, the average of the standardized scores of the indicators in this dimension of the first category of indicators and the standardized scores of the indicators in this dimension of the second category of indicators is taken as the target score for this dimension.

[0076] See Figure 3 , Figure 3 This is a schematic block diagram of an electronic device provided according to an embodiment of this application. Figure 3The electronic device 300 in this embodiment may include one or more processors 301, one or more input devices 302, one or more output devices 303, and one or more memories 304. The processors 301, input devices 302, output devices 303, and memories 304 communicate with each other via a communication bus 305. The memories 304 store computer programs, including program instructions. The processors 301 execute the program instructions stored in the memories 304. Specifically, the processors 301 are configured to invoke the program instructions to perform the functions of each module / unit in the above-described device embodiments, for example... Figure 2 The functions of the monitoring data acquisition module 21, monitoring data transmission module 22, channel quality score determination module 23, transmission strategy determination module 24, and synchronous transmission module 25 are shown.

[0077] It should be understood that, in the embodiments of this application, the processor 301 may be a central processing unit (CPU), but it may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0078] Input device 302 may include a touchpad, a fingerprint sensor (for collecting the user's fingerprint information and fingerprint orientation information), a microphone, etc., and output device 303 may include a display (LCD, etc.), a speaker, etc.

[0079] The memory 304 may include read-only memory and random access memory, and provides instructions and data to the processor 301. A portion of the memory 304 may also include non-volatile random access memory. For example, the memory 304 may also store a first frequency and a second frequency.

[0080] In specific implementations, the processor 301, input device 302, and output device 303 described in the embodiments of this application can execute the implementation methods described in the embodiments of the audio synchronization transmission method provided in this application, or they can execute the implementation methods of the electronic devices described in the embodiments of this application, which will not be repeated here.

[0081] In another embodiment of this application, a computer-readable storage medium is provided. This computer-readable storage medium stores a computer program, which includes program instructions. When executed by a processor, the program instructions implement all or part of the processes in the methods described above. Alternatively, the computer program can instruct related hardware to complete the process. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include any entity or device capable of carrying computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc.

[0082] The computer-readable storage medium can be an internal storage unit of the electronic device in any of the foregoing embodiments, such as a hard disk or memory of the electronic device. The computer-readable storage medium can also be an external storage device of the electronic device, such as a plug-in hard disk, smart media card (SMC), secure digital card (SD), flash card, etc., equipped on the electronic device. Furthermore, the computer-readable storage medium can include both internal and external storage units of the electronic device. The computer-readable storage medium is used to store computer programs and other programs and data required by the electronic device. The computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

[0083] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0084] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the electronic devices and units described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0085] In the several embodiments provided in this application, it should be understood that the disclosed electronic devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the couplings or direct couplings or communication connections shown or discussed may be indirect couplings or communication connections through some interfaces or units, or they may be electrical, mechanical, or other forms of connection.

[0086] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of this application, depending on actual needs.

[0087] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0088] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An audio synchronization transmission method, characterized in that, include: Complete channel monitoring data is acquired, including: one-way channel quality monitoring data and round-trip data monitoring data; the one-way channel quality monitoring data is obtained by the first device performing channel quality monitoring at a first frequency, and includes multiple quality monitoring data; the round-trip data monitoring data is obtained by sending a round-trip time measurement request to the second device at a second frequency; the first frequency is N times the second frequency, where N is a positive integer; full-duplex data interaction is performed between the first device and the second device; At least one of the quality monitoring data from the unidirectional channel quality monitoring data, and / or the round-trip data monitoring data, is used as forward channel monitoring data, and the forward channel monitoring data is sent to the second device in a target format; the target format is either an independent data frame format or an embedded data frame format; the embedded data frame format is a data format in which the forward channel monitoring data is embedded into a data frame; the data frame is used for audio data transmission; The target channel quality score is determined based on the forward channel monitoring data and the reverse channel monitoring data, wherein the reverse channel monitoring data is the monitoring data returned by the second device based on the forward channel monitoring data; Determine the audio synchronization transmission strategy based on the target channel quality score; Based on the aforementioned audio synchronization transmission strategy, audio is transmitted synchronously with the second device.

2. The audio synchronization transmission method as described in claim 1, characterized in that, If the target format is an embedded data frame, the process of determining the forward channel monitoring data includes: Based on the number of bytes in the free field of the target data frame, at least one monitoring data is determined from the various quality monitoring data and the round-trip data monitoring data as the forward channel monitoring data; the at least one monitoring data includes: at least one quality monitoring data in the unidirectional channel quality monitoring data, and / or, the round-trip data monitoring data; the target data frame is the data frame that the first device will send to the second device next; the target data frame is a data frame for audio data transmission sent by the first device to the second device at a third frequency; The step of sending forward channel monitoring data to the second device in target form includes: The target data frame is adjusted based on the aforementioned forward channel monitoring data; The forward channel monitoring data is sent to the second device via the adjusted target data frame.

3. The audio synchronization transmission method as described in claim 2, characterized in that, The adjustment of the target data frame based on the forward channel monitoring data includes: Each monitoring data contained in the forward channel monitoring data is encoded to obtain at least one encoded data; Based on the number of bytes in each encoded data, the target control frame is adjusted using at least one of the following methods: Reuse the payload area of ​​the target data frame; Reuse the reserved fields of the target data frame.

4. The audio synchronization transmission method as described in claim 1, characterized in that, The unilateral channel quality monitoring data is obtained by performing channel quality monitoring at a first frequency and through the following methods: Perform channel quality monitoring at the first frequency until N intervals of channel quality monitoring data are obtained. The average value of the N interval channel quality monitoring data is taken to obtain the unilateral channel quality monitoring data.

5. The audio synchronization transmission method as described in claim 1, characterized in that, The process of determining the target form includes: In response to the transmission traffic in the first link exceeding a preset traffic, the target format is determined to be an embedded data frame format; the first link is a unidirectional communication link for transmitting audio data from the first device to the second device; the preset traffic is a fixed proportion of the maximum traffic capacity corresponding to the first link; In response to the transmission traffic in the first link being less than or equal to the preset traffic, the target format is determined to be an independent data frame format.

6. The audio synchronization transmission method as described in claim 5, characterized in that, The determination of the target channel quality score based on the forward channel monitoring data and the reverse channel monitoring data includes: Based on the forward channel monitoring data, a first type of index is determined, and each index in the first type of index is mapped to a standardized score; the first type of index is used to characterize the channel quality of the first link. The second type of indicators are determined based on the reverse channel monitoring data, and each indicator in the second type of indicators is mapped to a standardized score; the second type of indicators are used to characterize the channel quality of the second link; the second link is a one-way communication link from the second device to the first device for transmitting audio data. For each indicator dimension, the target score for that dimension is determined based on the standardized scores of the indicators in the first category of indicators and the standardized scores of the indicators in the second category of indicators. The target channel quality score is obtained by weighting the target scores of each indicator dimension.

7. The audio synchronization transmission method as described in claim 6, characterized in that, The determination of the target score for this dimension based on the standardized scores of the indicators in the first category and the standardized scores of the indicators in the second category includes: In response to the lack of standardized scores for the indicators of this dimension in the first category of indicators and the lack of standardized scores for the indicators of this dimension in the second category of indicators, the target score for this dimension is set to a preset value. In response to the lack of standardized scores for the indicators in the first category of indicators, or the lack of standardized scores for the indicators in the second category of indicators, the standardized scores for the missing links in the same dimension are determined based on the standardized scores for the non-missing links in the same dimension; the target score for the dimension is determined based on the standardized scores for the non-missing links in the same dimension and the expanded standardized scores for the missing links in the same dimension. Since the standardized scores of the indicators in this dimension of the first category of indicators are not missing, and the standardized scores of the indicators in this dimension of the second category of indicators are not missing, the average of the standardized scores of the indicators in this dimension of the first category of indicators and the standardized scores of the indicators in this dimension of the second category of indicators is taken as the target score for this dimension.

8. An audio synchronization transmission device, characterized in that, include: The monitoring data acquisition module is used to acquire complete channel monitoring data, which includes: one-way channel quality monitoring data and round-trip data monitoring data. The one-way channel quality monitoring data is obtained by the first device performing channel quality monitoring at a first frequency, and includes multiple quality monitoring data. The round-trip data monitoring data is obtained by sending a round-trip time measurement request to the second device at a second frequency. The first frequency is N times the second frequency, where N is a positive integer. Full-duplex data interaction is performed between the first device and the second device. The monitoring data transmission module is used to transmit at least one quality monitoring data from the unidirectional channel quality monitoring data, and / or the round-trip data monitoring data as forward channel monitoring data, and to transmit the forward channel monitoring data to the second device in a target format; the target format is an independent data frame format or an embedded data frame format; the embedded data frame format is a data format in which the forward channel monitoring data is embedded in a data frame; the data frame is used for audio data transmission; The channel quality score determination module is used to determine the target channel quality score based on the forward channel monitoring data and the reverse channel monitoring data, wherein the reverse channel monitoring data is the monitoring data returned by the second device based on the forward channel monitoring data; The transmission strategy determination module is used to determine the audio synchronization transmission strategy based on the target channel quality score; The synchronous transmission module is used to perform synchronous audio transmission with the second device based on the audio synchronous transmission strategy.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 7.

Images