Audio data transmission method and apparatus

Abstract

The present application provides an audio data transmission method and an apparatus. The audio data transmission method of the present application comprises: when a first frame is retransmitted, sequentially transmitting audio data in corresponding groups of the first frame in descending order of M1 priorities, wherein the audio data in the corresponding groups belong to M1 groups of audio data of the first frame, the M1 groups of audio data correspond to the M1 priorities, and M1>1. The present application can improve the transmission success rate of high-priority audio data, thereby enhancing user experience.

Description

Audio data transmission method and apparatus Technical Field

[0001] This application relates to audio technology, and more particularly to an audio data transmission method and apparatus. Background Technology

[0002] With the development of wireless technology, the use of True Wireless Stereo (TWS) earphones is becoming increasingly widespread, and users' demands for high-definition audio data transmission are constantly increasing. Especially in crowded places such as airports and train stations, the wireless channel is subject to large changes in interference within a short period of time due to the surrounding environment, resulting in a sharp change in channel capacity. This requires audio data transmission to be able to quickly track and adapt to this change, so that the latency and sound quality at the receiving end remain at an acceptable level for the user.

[0003] Related technologies can adjust audio codec rates and wireless communication rates based on information such as packet error ratio (PER), retransmission rate, and interference detection. However, these technologies have long scheduling cycles and large delays, resulting in slow bit rate and rate adjustments, which are not conducive to rapid tracking of changes and have weak anti-interference capabilities. Summary of the Invention

[0004] This application provides an audio data transmission method and apparatus to improve the success rate of high-priority audio data transmission and enhance user experience.

[0005] In a first aspect, this application provides an audio data transmission method, comprising: when a first frame is retransmitted, sequentially transmitting audio data in a corresponding group of the first frame in descending order of M1 priorities, wherein the audio data in the corresponding group belongs to the M1 group of audio data of the first frame, and the M1 group of audio data corresponds to the M1 priorities, wherein M1 > 1.

[0006] When the channel is affected by strong interference, this application can quickly adjust the audio data encoding and decoding by sending a frame multiple times based on the priority of the audio data, thereby reducing the number of transmissions of high-priority audio data, improving the success rate of high-priority audio data transmission, and enhancing the user experience.

[0007] In audio encoding, an audio segment is divided into multiple audio frames, and the audio frames are encoded one by one in chronological order. In this application, the audio frame being processed by the transmitting end is called the first frame (or the current frame), and the audio frame processed by the transmitting end after the first frame is called the second frame (or the next frame or the frame after the current frame).

[0008] The retransmission of the first frame can be determined by the receiver's response. For example, after the sender transmits the first frame, if an ACK response is received from the receiver, the first frame is considered successfully transmitted; if a NACK response is received, the first frame is considered to have failed to transmit and is retransmitted. Alternatively, the retransmission of the first frame can be determined by a timer. For example, with a timer of 4ms, if no response is received from the receiver before the timer expires, the first frame is considered to have failed to transmit and is retransmitted. Other methods can also be used to determine if the first frame has been retransmitted, and this application does not specifically limit these methods.

[0009] Any audio frame can be segmented according to the priority of the audio data. Therefore, an audio frame with multiple priorities can contain multiple groups of audio data, each group corresponding to a priority. In this application, the first frame has M1 priorities, so all the audio data of the first frame is divided into M1 groups, each group corresponding to a priority, where M1 > 1. For example, if there are three priorities n1, n2, and n3, then the priorities of the first frame include n1, n2, and n3, and the priorities of the second frame also include n1, n2, and n3. Optionally, the priorities of each audio frame can be defined independently, and at the receiving end, the audio signal is ultimately played back as a complete sequence of multiple frames.

[0010] In audio data transmission, the primary goal is to ensure smooth and uninterrupted audio playback at the receiving end. Therefore, the bits supporting this requirement (also known as audio data, audio bits, bit data, etc., without specific limitations) are high-priority bits. It's crucial to ensure that the high-priority bits of each audio frame are received and merged by the receiving end. High-priority bits can support low bitrate encoding and decoding. Furthermore, to improve the audio quality to standard quality and enhance the user experience, the bits added to support this requirement are medium-priority bits, which can support medium bitrate encoding and decoding. Further, to improve the audio quality to high-definition quality and enhance the user experience, the bits added to support this requirement are low-priority bits, which can support high bitrate encoding and decoding. Finally, to improve the audio quality to lossless quality and enhance the user experience, the bits added to support this requirement are very low-priority bits, which can support full bitrate encoding and decoding. In other words, the priority of audio bits can be determined according to the listening effect at the receiving end. Lower priority audio bits can ensure smooth listening, while higher priority audio bits can provide high sound quality.

[0011] In wireless communication, an air interface time can be configured for the transmission of an audio data frame. For example, a timer can be set. If the timer has not yet expired or the remaining time is sufficient to send one audio data transmission, then the air interface time for that frame is considered sufficient. Conversely, if the timer expires or the remaining time is insufficient to send one audio data transmission, then the air interface time for that frame is considered insufficient. For example, the aforementioned timer can be set to 20ms.

[0012] In this application, the premise that the air interface time of the first frame is sufficient means that if the first frame fails to be transmitted within the air interface time of the first frame, the sending end can still retransmit the first frame. The sending end will only process the second frame and enter the air interface time of the second frame when the air interface time of the first frame is insufficient or the number of retransmissions of the first frame reaches the retransmission threshold (e.g., 3 retransmissions).

[0013] When sending the first frame, the sending end transmits the audio data within the corresponding group in multiple batches according to the M1 priorities of the first frame, from highest to lowest, as described above. For example, a frame has four priorities: high priority, medium priority, low priority, and very low priority, corresponding to four groups of audio bits. Provided there is sufficient air interface time, the high-priority bits are transmitted first, followed by the medium-priority bits, then the low-priority bits, and finally the very low-priority bits. If a priority bit fails to be transmitted during this process, it is retransmitted until successful. If the number of retransmissions for a priority bit reaches the retransmission threshold, the untransmitted audio data for that frame is discarded, and the next frame is sent. If there is insufficient air interface time, the untransmitted audio data for that frame is discarded, and the next frame is sent. In other words, an audio frame includes three priorities, n1, n2, and n3. Audio data of priority n1 is transmitted first. After the audio data of n1 is successfully transmitted and there is sufficient air interface time, audio data of n2 is transmitted, and so on. If there is no idle time, the audio data for frame n2 will not be transmitted, and the audio data for frame n3 will also not be transmitted. Then the audio data for the next frame n1 will be transmitted, and so on.

[0014] Optionally, the audio data transmitted by the transmitter in a single transmission can correspond to one priority level. For example, in the example above, one frame is transmitted in four parts, representing high-priority bits, medium-priority bits, low-priority bits, or very low-priority bits. Optionally, the audio data transmitted by the transmitter in a single transmission can correspond to multiple priorities. For example, in the example above, one frame is transmitted in two parts, representing high / medium-priority bits or low / very low-priority bits. The combination method of audio data can be determined based on channel quality, MCS scheme, etc., and this application does not impose specific limitations on it.

[0015] In one possible implementation, provided that the air interface time of the first frame is sufficient, the transmitting end sequentially transmits the audio data within the corresponding group in descending order of priority (M1 groups). This may include the following steps:

[0016] 1. Send the first audio signal

[0017] 1.1 Obtain the first data, which includes audio data in n1 priority groups. The n1 priorities are the first n1 priorities in M1 priorities sorted from high to low, where 0 < n1 < M1.

[0018] The first data is the high-priority audio data in the first frame, which may include a set of audio data corresponding to one priority (i.e., the highest priority, n1=1), or may include multiple sets of audio data corresponding to multiple priorities (i.e., the highest priority, the second highest priority, ..., the i-th priority, n1>1).

[0019] 1.2 The first audio signal is obtained by channel coding the first data according to the first MCS;

[0020] The first MCS can be the MCS used by the transmitter in the previous frame before sending the first frame, and the MCS scheme has not yet been switched. It is evident that the first audio signal carries the aforementioned first data, which corresponds to the first MCS.

[0021] 1.3 Send the first audio signal.

[0022] 2. Send the second audio signal

[0023] 2.1 After the first audio signal is successfully sent, if the air interface time of the first frame is sufficient, the second data is obtained. The second data includes audio data in the corresponding groups of n2 priorities. The n2 priorities are ranked after the n1 priorities in the order of M1 priorities from high to low, and 0 < n2 < M1.

[0024] The air interface time for the first frame is sufficient, indicating that the sending end still has time to process the first frame. Under the aforementioned premise, the sending end can continue to send the second data that has not yet been sent in the first frame.

[0025] The second data is the audio data with the second highest priority in the first frame. It can include a set of audio data corresponding to one priority (i.e., the second highest priority, n2=1), or it can include multiple sets of audio data corresponding to multiple priorities (i.e., the (i+1)th priority, the (i+2)th priority, ..., the (i+j)th priority, n2>1).

[0026] 2.2 The second audio signal is obtained by channel coding the second data according to the first MCS;

[0027] The first MCS can be the MCS used by the transmitter to send the first data, or it can be the MCS used by the transmitter to send the previous frame of the first frame. At this point, the MCS scheme has not yet been switched. It can be seen that the second audio signal carries the aforementioned second data, which corresponds to the first MCS.

[0028] 2.3 Send the second audio signal.

[0029] 3. Retransmit the second audio signal

[0030] 3.1 If the second audio signal fails to be transmitted, the second audio signal shall be transmitted again provided that the air interface time of the first frame is sufficient and the number of retransmissions of the second audio signal has not reached the retransmission threshold.

[0031] The air interface time for the first frame is sufficient, indicating that the transmitter still has time to process the first frame. The number of retransmissions of the second audio signal has not reached the retransmission threshold, meaning that the second audio signal still has a chance to be retransmitted. Under these two conditions, the transmitter can retransmit the second audio signal.

[0032] 4. Send a third audio signal based on the transmission of the second audio signal.

[0033] 4.1 After the second audio signal is successfully sent, or if the second audio signal fails to be sent, and the air interface time of the first frame is insufficient, the third data is obtained. The third data includes the audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, M2>1, 0<n3<M2;

[0034] Optionally, after the second data, the first frame has no audio data, that is, the first frame is sent in two parts: the first audio signal carrying the first data is sent in the first part, and the second audio signal carrying the second data is sent in the second part.

[0035] Optionally, after the second data, the first frame may also contain audio data, that is, the first frame may be sent in three or more parts: the first audio signal carrying the first data is sent in the first part, the second audio signal carrying the second data is sent in the second part, the third audio signal carrying the data that has not yet been sent is sent in the third part, and so on.

[0036] This embodiment uses the example of sending the first frame in two parts as an example, but it does not limit the transmission logic of the sending end. When sending the first frame, the sending end sends the audio data in the corresponding group multiple times according to the M1 priorities of the first frame in descending order. During this process, if the transmission of a certain priority bit fails, the priority bit is retransmitted until the transmission is successful; if the number of retransmissions of the priority bit reaches the retransmission threshold, the audio data of the first frame that has not yet been sent is discarded, and the second frame is sent instead; if the air interface time of the first frame is insufficient, the audio data of the first frame that has not yet been sent is discarded, and the second frame is sent instead.

[0037] Based on the above explanation, the successful transmission of the second audio signal indicates that the transmission of the first frame is complete. Under the aforementioned premise, the transmitting end can then proceed to transmit the third data in the second frame.

[0038] If the air interface time for the first frame is insufficient, it means the transmitter does not have enough time to process the first frame and needs to enter the air interface time for the second frame to begin processing it. Under the aforementioned conditions, the transmitter then sends the third data from the second frame.

[0039] The third data is the high-priority audio data in the second frame, which may include a set of audio data corresponding to one priority (i.e., the highest priority, n3=1), or may include multiple sets of audio data corresponding to multiple priorities (i.e., the highest priority, the second highest priority, ..., the i-th priority, n3>1).

[0040] 4.2 The third audio signal is obtained by channel coding the third data according to the first MCS;

[0041] As described above, the transmitting end does not switch to transmitting the third data in the second frame due to changes in channel quality; therefore, the first MCS can still be used to perform channel coding on the third data. It is evident that the third audio signal carries the aforementioned third data, which corresponds to the first MCS.

[0042] 4.3 Send the third audio signal.

[0043] 5. Send a fourth audio signal based on the transmission of the second audio signal.

[0044] 5.1 When the second audio signal fails to be transmitted, and the number of retransmissions of the second audio signal reaches the retransmission threshold, the third data is obtained. The third data includes the audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, M2>1, 0<n3<M2.

[0045] The second audio signal has reached the retransmission threshold, meaning that there is no longer a chance to retransmit it after multiple attempts, which also reflects a deterioration in channel quality. Under these circumstances, the transmitting end then sends the third data from the second frame.

[0046] 5.2 The fourth audio signal is obtained by channel coding the third data according to the second MCS, where the order of the second MCS is lower than that of the first MCS;

[0047] As mentioned above, the transmitting end switches to sending the third data in the second frame due to deteriorating channel quality. Therefore, it is necessary to switch the previously used MCS and lower its order. At this time, the transmitting end performs channel coding on the third data according to the second MCS with the lowered order. It can be seen that the fourth audio signal carries the aforementioned third data, which corresponds to the second MCS. This allows for rapid adjustment of the communication MCS, timely response to changes in channel quality, and improved anti-interference capability.

[0048] 5.3 Send the fourth audio signal.

[0049] 6. Retransmit the first audio signal

[0050] 6.1 If the first audio signal fails to be transmitted, the first audio signal shall be transmitted again provided that the air interface time of the first frame is sufficient and the number of retransmissions of the first audio signal has not reached the retransmission threshold.

[0051] The air interface time for the first frame is sufficient, indicating that the transmitter still has time to process the first frame. The number of retransmissions of the first audio signal has not reached the retransmission threshold, meaning the first audio signal still has a chance to be retransmitted. Under these two conditions, the transmitter can retransmit the first audio signal.

[0052] 7. Send a third audio signal based on the transmission of the first audio signal.

[0053] 7.1 After the first audio signal is successfully sent, if the air interface time of the first frame is insufficient, the third data is obtained. The third data includes the audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low. M2>1, 0<n3<M2.

[0054] If the air interface time for the first frame is insufficient, it means the transmitter does not have enough time to process the first frame and needs to enter the air interface time for the second frame to begin processing it. Under the aforementioned conditions, the transmitter then sends the third data from the second frame.

[0055] 7.2 The third audio signal is obtained by channel coding the third data according to the first MCS;

[0056] As described above, the transmitting end does not switch to transmitting the third data in the second frame due to changes in channel quality; therefore, the first MCS can still be used to perform channel coding on the third data. It is evident that the third audio signal carries the aforementioned third data, which corresponds to the first MCS.

[0057] 7.3 Send the third audio signal.

[0058] 8. Based on the transmission of the first audio signal, transmit the fourth audio signal.

[0059] 8.1 When the first audio signal fails to be transmitted, and the number of retransmissions of the first audio signal reaches the retransmission threshold, the third data is obtained. The third data includes the audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low. M2>1, 0<n3<M2.

[0060] The first audio signal has reached the retransmission threshold, meaning that there is no longer a chance to retransmit it after multiple attempts, which also reflects a deterioration in channel quality. Under these circumstances, the transmitting end then sends the third data from the second frame.

[0061] 8.2 The third data is channel-coded according to the second MCS to obtain the fourth audio signal. The order of the second MCS is lower than that of the first MCS.

[0062] As mentioned above, the transmitting end switches to sending the third data in the second frame due to deteriorating channel quality. Therefore, it is necessary to switch the previously used MCS and lower its order. At this time, the transmitting end performs channel coding on the third data according to the second MCS with the lowered order. It can be seen that the fourth audio signal carries the aforementioned third data, which corresponds to the second MCS. This allows for rapid adjustment of the communication MCS, timely response to changes in channel quality, and improved anti-interference capability.

[0063] 8.3 Send the fourth audio signal.

[0064] It should be noted that the above only mentions that the sending end sends the third data in the second frame, that is, the sending end sends the high-priority audio data in the second frame, but it does not mean that the sending end does not send the second-highest / medium / low-priority audio data in the second frame. The sending process of this type of data can refer to the steps for the second data above, and will not be repeated here.

[0065] When sending the current frame, the sending end transmits the audio data within the corresponding group in multiple transmissions according to the frame's multiple priorities from highest to lowest. During this process, if a priority bit fails to be transmitted, it is retransmitted until successful. If the number of retransmissions for a priority bit reaches the retransmission threshold, the audio data not yet transmitted in the current frame is discarded, and the next frame is sent. If the air interface time for the current frame is insufficient, the audio data not yet transmitted in the current frame is discarded, and the next frame is sent. This process quickly identifies which data needs to be retransmitted and which data needs to be saved or discarded, thereby reducing the number of transmissions of high-priority audio data, improving the success rate of high-priority audio data transmission, and enhancing the user experience.

[0066] Optionally, the first data mentioned above includes 1 / t audio data within n1 priority groups, where t≥1.

[0067] Optionally, the second data mentioned above includes 1 / t audio data within n2 priority groups, where t≥1.

[0068] Optionally, the aforementioned third data includes 1 / t audio data within n3 priority groups, where t≥1.

[0069] For example, t = 1, 2, 4, ... When the channel quality deteriorates as described above, to enhance anti-interference capability, the transmitter switches the previously used first MCS and lowers its order. That is, the audio data is channel-coded according to the second MCS with the lowered order. To adapt to the second MCS, the amount of data sent by the transmitter for the third data can retain the amount of data sent in the original transmission (corresponding to the first / second data). For example, all data in a certain priority group (t = 1), or half of the data in a certain priority group (t = 2), etc.; or the amount of data sent by the transmitter for the third data can be halved from the amount of data sent in the original transmission (corresponding to the first / second data). For example, half of the data in a certain priority group (t = 2), or a quarter of the data in a certain priority group (t = 4), etc.; or the amount of data sent by the transmitter for the third data can be a quarter of the amount of data sent in the original transmission (corresponding to the first / second data), and so on.

[0070] The above steps describe the process by which the transmitter, assuming sufficient air interface time for the first frame, sequentially transmits the audio data within the corresponding groups in descending order of priority (M1). This addresses the situation where strong interference (degraded channel quality) persists in the channel, severely impacting transmission performance. When the strong interference disappears, the transmitter can consider the reverse operation: increasing the order of the MCS (Multi-Channel System) and / or merging the audio data within the high- and low-priority groups in a single transmission.

[0071] In one possible implementation, when no retransmission occurs for m consecutive frames, the fourth data is acquired. The fourth data includes audio data within the n4 priority groups of the third frame. The third frame follows the m consecutive frames and contains M3 groups of audio data corresponding to M3 priorities. The n4 priorities are the first n4 priorities in descending order of the M3 priorities, where m > 1, M3 > 1, and n1 ≤ n4 ≤ M3. The fourth data is then channel-coded according to the third MCS to obtain the fifth audio signal. The order of the third MCS is higher than that of the second MCS. The fifth audio signal is then transmitted.

[0072] If m consecutive frames were transmitted without retransmission, it means that m frames were transmitted consecutively according to the steps above without any retransmission, and each audio signal was successfully transmitted on the first attempt. This reflects improved channel quality. Under the aforementioned premise, the transmitting end can then transmit the fourth data in the third frame, which is the audio frame following the aforementioned m frames.

[0073] The fourth data is high-priority audio data in the third frame. It may include multiple sets of audio data with the same priority as the first data (n4 = n1), or it may include multiple sets of audio data with a higher priority than the first data (n4 > n1), or it may include all the audio data of the third frame (n4 = M3).

[0074] It should be noted that the above only mentions the sending end transmitting the fourth data in the third frame, that is, the sending end transmitting the high-priority audio data in the third frame. This does not mean that the sending end does not transmit the second-highest / medium / lowest priority audio data in the third frame. The transmission process for this type of data can refer to the steps for the second data described above, and will not be repeated here. When the sending end can transmit all the audio data of the current frame at once, the scheme of transmitting the same frame in multiple parts can no longer be considered until a retransmission of a certain frame occurs.

[0075] Secondly, this application provides an audio data transmission device, including: a transmission module, configured to transmit audio data in a corresponding group of the first frame sequentially in descending order of M1 priorities when a retransmission of the first frame occurs, wherein the audio data in the corresponding group belongs to the M1 group of audio data of the first frame, and the M1 group of audio data corresponds to the M1 priorities, where M1 > 1.

[0076] In one possible implementation, the transmitting module is specifically used to transmit a first audio signal, which is obtained by channel coding of the first data according to the first modulation and coding strategy MCS. The first data includes audio data in n1 priority groups, where the n1 priorities are the first n1 priorities in the M1 priorities sorted from high to low, and 0 < n1 < M1.

[0077] In one possible implementation, the transmitting module is further configured to transmit a second audio signal after the first audio signal is successfully transmitted, provided that the air interface time of the first frame is sufficient. The second audio signal is obtained by channel coding of the second data according to the first MCS. The second data includes audio data in n2 priority groups, and the n2 priorities are arranged after the n1 priorities in the M1 priorities from high to low, where 0 < n2 < M1.

[0078] In one possible implementation, the sending module is further configured to, after the second audio signal fails to be sent, resend the second audio signal provided that the air interface time of the first frame is sufficient and the number of retransmissions of the second audio signal has not reached the retransmission threshold.

[0079] In one possible implementation, the transmitting module is further configured to transmit a third audio signal after the first audio signal is successfully transmitted, provided that the air interface time of the first frame is insufficient, or after the second audio signal is successfully transmitted, or after the second audio signal fails to be transmitted, provided that the air interface time of the first frame is insufficient. The third audio signal is obtained by channel coding of the third data according to the first MCS. The third data includes audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, where M2 > 1 and 0 < n3 < M2.

[0080] In one possible implementation, the transmitting module is further configured to transmit a fourth audio signal when the first audio signal fails to be transmitted, provided that the number of retransmissions of the first audio signal reaches a retransmission threshold, or when the second audio signal fails to be transmitted, provided that the number of retransmissions of the second audio signal reaches a retransmission threshold. The fourth audio signal is obtained by channel coding the third data according to the second MCS, wherein the order of the second MCS is lower than the order of the first MCS. The third data includes audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, where M2 > 1 and 0 < n3 < M2.

[0081] In one possible implementation, the sending module is further configured to, after the first audio signal fails to be sent, resend the first audio signal provided that the air interface time of the first frame is sufficient and the number of retransmissions of the first audio signal has not reached the retransmission threshold.

[0082] In one possible implementation, the transmitting module is further configured to transmit a fifth audio signal when no retransmission occurs in m consecutive frames. The fifth signal is obtained by channel coding of the fourth data according to the third MCS, wherein the order of the third MCS is higher than the order of the second MCS. The fourth data includes audio data within the n4 priority groups of the third frame. The third frame is after the m consecutive frames and contains M3 groups of audio data corresponding to M3 priorities. The n4 priorities are the first n4 priorities in the M3 priorities sorted from high to low, where m > 1, M3 > 1, and n1 ≤ n4 ≤ M3.

[0083] In one possible implementation, the first data includes 1 / t audio data within the n1 priority-corresponding groups, where t≥1.

[0084] In one possible implementation, the second data includes 1 / t audio data within the n2 priority corresponding groups, where t≥1.

[0085] In one possible implementation, the third data includes 1 / t audio data within the n3 priority groups, where t ≥ 1.

[0086] Thirdly, this application provides a terminal device, comprising: one or more processors; a memory for storing one or more programs; and when the one or more programs are executed by the one or more processors, causing the one or more processors to implement the method as described in any one of the first aspects above.

[0087] Fourthly, this application provides a computer-readable storage medium, characterized in that it includes a computer program, which, when executed on a computer, causes the computer to perform the method described in any one of the first aspects above.

[0088] Fifthly, this application provides a computer program product, characterized in that the computer program product includes computer program code, which, when run on a computer, causes the computer to perform the method described in any one of the first aspects above. Attached Figure Description

[0089] Figure 1 is a schematic diagram of L2CH audio data;

[0090] Figure 2 is a schematic diagram of an application scenario of this application;

[0091] Figure 3 is a schematic diagram of the structure of the terminal device 300 of this application;

[0092] Figure 4 is a software structure block diagram of the terminal device 300 of this application;

[0093] Figure 5 is a flowchart of the audio data transmission method 500 provided in this application;

[0094] Figure 6 is a flowchart of the audio data transmission method of this application;

[0095] Figures 7a and 7b are schematic diagrams of audio data transmission according to this application;

[0096] Figure 8 is a structural schematic diagram of the audio data transmission device 800 of this application. Detailed Implementation

[0097] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0098] The terms "first," "second," etc., used in the specification, embodiments, claims, and drawings of this application are for distinguishing purposes only and should not be construed as indicating or implying relative importance or order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, such as including a series of steps or units. A method, system, product, or apparatus is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products, or apparatuses.

[0099] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0100] In audio data transmission, the transmitting end acquires audio data, first performs audio encoding on the audio data to obtain a bitstream, then performs channel encoding on the bitstream to obtain a signal, which the transmitting end then transmits in the channel. The receiving end acquires the signal transmitted by the transmitting end through the channel, first performs channel decoding on the signal to obtain a bitstream, then performs audio decoding on the bitstream to obtain audio data, and finally plays the audio based on the audio data. Therefore, audio data transmission involves the following technologies:

[0101] I. Audio Encoding and Decoding Technology

[0102] Audio codecs are used to compress audio data and reduce redundancy in transmitted data. Currently, there are many audio codec technologies available. For example, LDAC, developed by Sony, supports Bluetooth transmission of 24-bit / 96kHz high-definition audio at a maximum rate of 990Kbps. aptX, developed by Qualcomm, supports aptX-HD transmission of 24-bit / 48kHz high-definition audio at a rate of 576Kbps. L2HC, developed by Huawei, is a codec solution from the StarFlash Alliance, supporting transmission of 32-bit / 96kHz high-definition audio at a maximum rate of 1920Kbps.

[0103] L2HC can implement audio bit-priority encoding and decoding technology. For example, as shown in Figure 1 (Figure 1 is a schematic diagram of L2HC audio data), in a frame of audio data transmitted using L2HC technology, the bit priorities are arranged from high to low from left to right. Based on priority sorting, the following applications can be achieved, ensuring seamless concatenation of data packets with different audio bitrates:

[0104] a) Once all bits have been received correctly, the receiver can use full-rate decoding and lossless audio playback.

[0105] b) If a very low priority bit at the tail is lost, the receiver can still use high bit rate decoding and high-definition audio quality playback.

[0106] c) If low-priority bits at the tail are lost, the receiver can still use medium-rate decoding and normal audio quality playback.

[0107] d) If the high-priority bits at the tail are lost, and only the high-priority bits at the head are received correctly, the receiver can still use low-bit-rate decoding and smooth audio playback.

[0108] II. Wireless Communication Technology

[0109] Earphones, typically acting as the receiver, are battery-powered devices and generally employ low-power wireless communication technologies. Bluetooth is the most common low-power wireless communication technology, currently supporting a maximum physical layer speed of 3 Mbps, with a future potential to support up to 8 Mbps. StarLight low-power communication, on the other hand, is a more recently established communication standard that currently supports speeds up to 16 Mbps. Therefore, Bluetooth communication is commonly used between terminal devices and earphones (e.g., True Wireless Stereo (TWS) earphones).

[0110] It should be noted that other wireless communication technologies can also be used between two devices transmitting audio data (e.g., a mobile phone and headphones, two walkie-talkies, a mobile phone and a speaker), and this application does not specifically limit them.

[0111] Modulation and Coding Scheme (MCS) is used in wireless communication technology to dynamically adjust signal transmission parameters. By combining modulation and forward error correction coding, a balance between transmission rate and reliability is achieved. The core metric of MCS is the number of effective bits per resource element (RE). This value changes dynamically with channel quality. That is, when the channel quality is high, using high-order modulation (e.g., 256QAM) and a high coding rate can increase the transmission rate; when the channel quality is poor, downgrading to low-order modulation (e.g., QPSK) and redundant coding can ensure transmission reliability.

[0112] Before describing the technical solution of this application, the application scenario of this application will first be described with reference to the accompanying drawings. For example, Figure 2 is a schematic diagram of an application scenario of this application. As shown in Figure 2, this scenario includes a transmitting end (also referred to as an audio data provider) and a receiving end (also referred to as an audio data playback end). The interconnection method between the transmitting end and the receiving end includes, but is not limited to, Bluetooth technology. The transmitting end may include, but is not limited to, mobile phones, walkie-talkies, tablets, laptops, desktop computers, etc., and can provide audio data compression capabilities. The receiving end may include, but is not limited to, true wireless stereo (TWS) headphones, wireless headphones, wireless neckband headphones, walkie-talkies, speakers, etc., and can provide audio data decompression and reconstruction capabilities, and even audio playback capabilities.

[0113] It should be noted that the application scenario shown in Figure 2 is an example, but it should not constitute any limitation on this application, and this application does not make any specific limitation on the application scenario.

[0114] Figure 3 is a schematic diagram of the terminal device 300 of this application. It should be understood that the terminal device 300 shown in Figure 3 is merely an example, and the terminal device 300 may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in Figure 3 can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits. In some possible application scenarios, the terminal device 300 can be applied to a transmitting end and / or a receiving end, and this application does not specifically limit this application.

[0115] Terminal device 300 may include: processor 310, external memory interface 320, internal memory 321, universal serial bus (USB) interface 330, charging management module 340, power management module 341, battery 342, antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, audio module 370, speaker 370A, receiver 370B, microphone 370C, headphone jack 370D, sensor module 380, button 390, motor 391, indicator 392, camera 393, display screen 394, and subscriber identification module (SIM) card interface 395, etc. The sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, a barometric pressure sensor 380C, a magnetic sensor 380D, an accelerometer sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, etc.

[0116] Processor 310 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. The different processing units may be independent devices or integrated into one or more processors.

[0117] The controller can serve as the central nervous system and command center of the terminal device 300. The controller can generate operation control signals based on the instruction opcode and timing signals to control the fetching and execution of instructions.

[0118] The processor 310 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. This memory can store instructions or data that the processor 310 has just used or that are used repeatedly. If the processor 310 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 310, and thus improves the efficiency of the system.

[0119] In some embodiments, the processor 310 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0120] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 310 may include multiple I2C buses. The processor 310 can couple to the touch sensor 380K, charger, flash, camera 393, etc., through different I2C bus interfaces. For example, the processor 310 can couple to the touch sensor 380K through the I2C interface, enabling the processor 310 and the touch sensor 380K to communicate through the I2C bus interface, thereby realizing the touch function of the terminal device 300.

[0121] The I2S interface can be used for audio communication. In some embodiments, the processor 310 may include multiple I2S buses. The processor 310 can be coupled to the audio module 370 via the I2S bus to enable communication between the processor 310 and the audio module 370. In some embodiments, the audio module 370 can transmit audio signals to the wireless communication module 360 ​​via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0122] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 370 and the wireless communication module 360 ​​can be coupled via the PCM bus interface. In some embodiments, the audio module 370 can also transmit audio signals to the wireless communication module 360 ​​via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0123] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 310 and the wireless communication module 360. For example, the processor 310 communicates with the Bluetooth module in the wireless communication module 360 ​​via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 370 can transmit audio signals to the wireless communication module 360 ​​via the UART interface to enable music playback through Bluetooth headphones.

[0124] The MIPI interface can be used to connect the processor 310 to peripheral devices such as the display screen 394 and the camera 393. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 310 and the camera 393 communicate via the CSI interface to enable the shooting function of the terminal device 300. The processor 310 and the display screen 394 communicate via the DSI interface to enable the display function of the terminal device 300.

[0125] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 310 to a camera 393, a display screen 394, a wireless communication module 360, an audio module 370, a sensor module 380, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0126] USB port 330 is a USB standard compliant interface, which can be a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 330 can be used to connect a charger to charge terminal device 300, and can also be used for data transfer between terminal device 300 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other user devices, such as AR devices.

[0127] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the terminal device 300. In other embodiments of this application, the terminal device 300 may also adopt different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.

[0128] The charging management module 340 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 340 receives charging input from the wired charger via a USB interface 330. In some wireless charging embodiments, the charging management module 340 receives wireless charging input via the wireless charging coil of the terminal device 300. While charging the battery 342, the charging management module 340 can also supply power to the user device via the power management module 341.

[0129] The power management module 341 connects the battery 342, the charging management module 340, and the processor 310. The power management module 341 receives input from the battery 342 and / or the charging management module 340, providing power to the processor 310, internal memory 321, external memory, display screen 394, camera 393, and wireless communication module 360. The power management module 341 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 341 may also be located within the processor 310. In other embodiments, the power management module 341 and the charging management module 340 may be housed in the same device.

[0130] The wireless communication function of the terminal device 300 can be implemented through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, modem processor and baseband processor, etc.

[0131] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 300 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0132] The mobile communication module 350 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the terminal device 300. The mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 350 may be housed in the processor 310. In some embodiments, at least some functional modules of the mobile communication module 350 and at least some modules of the processor 310 may be housed in the same device.

[0133] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 370A, receiver 370B, etc.) or displays images or videos through a display screen 394. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 310 and may be housed in the same device as the mobile communication module 350 or other functional modules.

[0134] The wireless communication module 360 ​​can provide solutions for wireless communication applications on the terminal device 300, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 360 ​​can be one or more devices integrating at least one communication processing module. The wireless communication module 360 ​​receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signal, and sends the processed signal to processor 310. The wireless communication module 360 ​​can also receive signals to be transmitted from processor 310, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0135] In some embodiments, antenna 1 of terminal device 300 is coupled to mobile communication module 350, and antenna 2 is coupled to wireless communication module 360, enabling terminal device 300 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0136] The terminal device 300 implements display functions through a GPU, a display screen 394, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 310 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0137] Display screen 394 is used to display images, videos, etc. Display screen 394 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 300 may include one or N displays 394, where N is a positive integer greater than 1.

[0138] The terminal device 300 can perform shooting functions through an ISP, camera 393, video codec, GPU, display 394, and application processor.

[0139] The ISP (Image Signal Processor) is used to process data fed back from the camera 393. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 393.

[0140] Camera 393 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the terminal device 300 may include one or N cameras 393, where N is a positive integer greater than 1.

[0141] A digital signal processor (DSP) is used to process digital signals. Besides digital image signals, it can also process other digital signals. For example, when the terminal device 300 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0142] Video codecs are used to compress or decompress digital video. Terminal device 300 may support one or more video codecs. Thus, terminal device 300 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0143] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs can enable intelligent cognitive applications in terminal devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0144] The external storage interface 320 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the terminal device 300. The external storage card communicates with the processor 310 through the external storage interface 320 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0145] Internal memory 321 can be used to store computer executable program code, which includes instructions. Processor 310 executes various functional applications and data processing of terminal device 300 by running the instructions stored in internal memory 321. Internal memory 321 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of terminal device 300 (such as audio data, phonebook, etc.). Furthermore, internal memory 321 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0146] Terminal device 300 can implement audio functions, such as music playback and recording, through audio module 370, speaker 370A, receiver 370B, microphone 370C, headphone jack 370D, and application processor.

[0147] The audio module 370 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. The audio module 370 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 370 may be located in the processor 310, or some functional modules of the audio module 370 may be located in the processor 310.

[0148] The speaker 370A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The terminal device 300 can listen to music or make hands-free calls through the speaker 370A.

[0149] The receiver 370B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the terminal device 300 answers a phone call or voice message, the receiver 370B can be brought close to the listener's ear to hear the voice.

[0150] Microphone 370C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 370C, inputting the sound signal into microphone 370C. Terminal device 300 may be equipped with at least one microphone 370C. In some embodiments, terminal device 300 may be equipped with two microphones 370C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, terminal device 300 may be equipped with three, four, or more microphones 370C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0151] The 370D headphone jack is used to connect wired headphones. The 370D headphone jack can be a USB 330 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0152] Pressure sensor 380A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 380A can be disposed on display screen 394. There are many types of pressure sensors 380A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 380A, the capacitance between the electrodes changes. Terminal device 300 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 394, terminal device 300 detects the intensity of the touch operation based on pressure sensor 380A. Terminal device 300 can also calculate the touch position based on the detection signal from pressure sensor 380A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example: when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0153] The gyroscope sensor 380B can be used to determine the motion attitude of the terminal device 300. In some embodiments, the gyroscope sensor 380B can determine the angular velocity of the terminal device 300 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 380B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 380B detects the angle of the terminal device 300's shake, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the terminal device 300 through reverse movement, thus achieving image stabilization. The gyroscope sensor 380B can also be used in navigation and motion-sensing game scenarios.

[0154] The barometric pressure sensor 380C is used to measure air pressure. In some embodiments, the terminal device 300 calculates altitude using the air pressure value measured by the barometric pressure sensor 380C to assist in positioning and navigation.

[0155] The magnetic sensor 380D includes a Hall sensor. The terminal device 300 can use the magnetic sensor 380D to detect the opening and closing of the flip cover. In some embodiments, when the terminal device 300 is a flip phone, the terminal device 300 can detect the opening and closing of the flip cover using the magnetic sensor 380D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0156] The 380E accelerometer sensor can detect the magnitude of acceleration in various directions (typically three axes) of the terminal device 300. When the terminal device 300 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the user device's posture and can be applied to screen orientation switching, pedometers, and other applications.

[0157] A distance sensor 380F is used to measure distance. The terminal device 300 can measure distance via infrared or laser. In some embodiments, during a shooting scene, the terminal device 300 can utilize the distance sensor 380F to measure distance for rapid focusing.

[0158] The proximity sensor 380G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The terminal device 300 emits infrared light outward through the LED. The terminal device 300 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near the terminal device 300. When insufficient reflected light is detected, the terminal device 300 can determine that no object is near the terminal device 300. The terminal device 300 can use the proximity sensor 380G to detect when a user holds the terminal device 300 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 380G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0159] The ambient light sensor 380L is used to sense ambient light intensity. The terminal device 300 can adaptively adjust the brightness of the display screen 394 based on the sensed ambient light intensity. The ambient light sensor 380L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 380L can also work with the proximity sensor 380G to detect whether the terminal device 300 is in a pocket to prevent accidental touches.

[0160] The fingerprint sensor 380H is used to collect fingerprints. The terminal device 300 can use the characteristics of the collected fingerprints to achieve fingerprint unlocking, access to application locks, fingerprint photography, fingerprint answering of incoming calls, etc.

[0161] Temperature sensor 380J is used to detect temperature. In some embodiments, terminal device 300 uses the temperature detected by temperature sensor 380J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 380J exceeds a threshold, terminal device 300 reduces the performance of the processor located near temperature sensor 380J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is below another threshold, terminal device 300 heats battery 342 to prevent abnormal shutdown of terminal device 300 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, terminal device 300 boosts the output voltage of battery 342 to prevent abnormal shutdown due to low temperature.

[0162] Touch sensor 380K, also known as a "touch panel," can be located on display screen 394. The touch sensor 380K and display screen 394 together form a touchscreen, also known as a "touch screen." Touch sensor 380K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 394. In other embodiments, touch sensor 380K may also be located on the surface of terminal device 300, in a different position than display screen 394.

[0163] The bone conduction sensor 380M can acquire vibration signals. In some embodiments, the bone conduction sensor 380M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 380M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 380M can also be incorporated into headphones to form bone conduction headphones. The audio module 370 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 380M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 380M to realize heart rate detection functionality.

[0164] Buttons 390 include a power button, volume buttons, etc. Buttons 390 can be mechanical buttons or touch-sensitive buttons. Terminal device 300 can receive button input and generate key signal inputs related to user settings and function control of terminal device 300.

[0165] Motor 391 can generate vibration alerts. Motor 391 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can be corresponding to touch operations applied to different applications (such as taking photos, playing audio, etc.). Motor 391 can also correspond to different vibration feedback effects for touch operations applied to different areas of the display screen 394. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0166] Indicator 392 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0167] The SIM card interface 395 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 395 to make contact with and separate from the terminal device 300. The terminal device 300 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 395 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 395 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 395 is also compatible with different types of SIM cards. The SIM card interface 395 is also compatible with external memory cards. The terminal device 300 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the terminal device 300 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal device 300 and cannot be separated from the terminal device 300.

[0168] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the terminal device. In other embodiments of this application, the terminal device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0169] The software system of terminal device 300 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of terminal device 300.

[0170] Figure 4 is a software structure block diagram of the terminal device 300 of this application.

[0171] The layered architecture of the terminal device 300 divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0172] The application layer can include a series of application packages.

[0173] As shown in Figure 4, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0174] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0175] As shown in Figure 4, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0176] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0177] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0178] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0179] The phone manager is used to provide communication functions for the terminal device 300. For example, it manages call status (including connection and disconnection).

[0180] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0181] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the system's top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sound alerts, vibrating the device 300Hz, and flashing indicator lights.

[0182] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0183] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0184] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0185] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0186] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0187] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0188] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0189] A 2D graphics engine is a graphics engine for 2D drawing.

[0190] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0191] It is understood that the components included in the system framework layer, system library, and runtime layer shown in Figure 4 do not constitute a specific limitation on the terminal device 300. In other embodiments of this application, the terminal device 300 may include more or fewer components than shown in the figure, or combine some components, or split some components, or have different component arrangements.

[0192] Based on the above, the audio data transmission method provided in this application will be described below.

[0193] Figure 5 is a flowchart of process 500 of the audio data transmission method provided in this application. Process 500 can be executed by the terminal device mentioned above. Process 500 is described as a series of steps or operations. It should be understood that process 500 can be executed in various orders and / or occur simultaneously, and is not limited to the execution order shown in Figure 5. Process 500 may include:

[0194] Step 501: When the first frame is retransmitted, the audio data in the corresponding group of the first frame is sent sequentially in descending order of priority according to M1 priority levels.

[0195] In audio encoding, an audio segment is divided into multiple audio frames, and the audio frames are encoded one by one in chronological order. In this application, the audio frame being processed by the transmitting end is called the first frame (or the current frame), and the audio frame processed by the transmitting end after the first frame is called the second frame (or the next frame or the frame after the current frame).

[0196] The retransmission of the first frame can be determined by the receiver's response. For example, after the sender transmits the first frame, if an ACK response is received from the receiver, the first frame is considered successfully transmitted; if a NACK response is received, the first frame is considered to have failed to transmit and is retransmitted. Alternatively, the retransmission of the first frame can be determined by a timer. For example, with a timer of 4ms, if no response is received from the receiver before the timer expires, the first frame is considered to have failed to transmit and is retransmitted. Other methods can also be used to determine if the first frame has been retransmitted, and this application does not specifically limit these methods.

[0197] Any audio frame can be segmented according to the priority of the audio data. Therefore, an audio frame with multiple priorities can contain multiple groups of audio data, each group corresponding to a priority. In this application, the first frame has M1 priorities, so all the audio data of the first frame is divided into M1 groups, each group corresponding to a priority, where M1 > 1. For example, if there are three priorities n1, n2, and n3, then the priorities of the first frame include n1, n2, and n3, and the priorities of the second frame also include n1, n2, and n3. Optionally, the priorities of each audio frame can be defined independently, and at the receiving end, the audio signal is ultimately played back as a complete sequence of multiple frames.

[0198] The method for determining the priority of audio frames can be referred to Figure 1. The primary goal in audio data transmission is to ensure smooth and uninterrupted audio playback at the receiving end. Therefore, the bits supporting this requirement (also referred to as audio data, audio bits, bit data, etc., without specific limitations) are high-priority bits. To ensure that the high-priority bits of each audio frame can be received and merged by the receiving end, high-priority bits can support low bitrate encoding and decoding. Furthermore, to improve the audio quality to normal quality and enhance the user experience, the bits added to support this requirement are medium-priority bits, which can support medium bitrate encoding and decoding. Further, to improve the audio quality to high-definition quality and enhance the user experience, the bits added to support this requirement are low-priority bits, which can support high bitrate encoding and decoding. Finally, to improve the audio quality to lossless quality and enhance the user experience, the bits added to support this requirement are very low-priority bits, which can support full bitrate encoding and decoding. In other words, the priority of audio bits can be determined according to the listening effect at the receiving end. Lower priority audio bits can ensure smooth listening, while higher priority audio bits can provide high sound quality.

[0199] In wireless communication, an air interface time can be configured for the transmission of an audio data frame. For example, a timer can be set. If the timer has not yet expired or the remaining time is sufficient to send one audio data transmission, then the air interface time for that frame is considered sufficient. Conversely, if the timer expires or the remaining time is insufficient to send one audio data transmission, then the air interface time for that frame is considered insufficient. For example, the aforementioned timer can be set to 20ms.

[0200] In this application, the premise that the air interface time of the first frame is sufficient means that if the first frame fails to be transmitted within the air interface time of the first frame, the sending end can still retransmit the first frame. The sending end will only process the second frame and enter the air interface time of the second frame when the air interface time of the first frame is insufficient or the number of retransmissions of the first frame reaches the retransmission threshold (e.g., 3 retransmissions).

[0201] When sending the first frame, the sending end transmits the audio data within the corresponding group in multiple batches according to the M1 priorities of the first frame, from highest to lowest, as described above. For example, a frame in Figure 1 has four priorities: high priority, medium priority, low priority, and very low priority, corresponding to four groups of audio bits. Provided there is sufficient air interface time, the high-priority bits are transmitted first, followed by the medium-priority bits, then the low-priority bits, and finally the very low-priority bits. During this process, if a priority bit fails to be transmitted, it is retransmitted until successful. If the number of retransmissions for a priority bit reaches the retransmission threshold, the untransmitted audio data for that frame is discarded, and the next frame is sent. If there is insufficient air interface time, the untransmitted audio data for that frame is discarded, and the next frame is sent. In other words, the audio frame has three priorities: n1, n2, and n3. Audio data of priority n1 is transmitted first. Once the audio data of n1 is successfully transmitted and there is sufficient time remaining, audio data of n2 is transmitted, and so on. If there is no time remaining, audio data of n2 is not transmitted, and neither is audio data of n3. Then, the audio data of the next frame (n1) is transmitted, and so on.

[0202] Optionally, the audio data transmitted by the transmitter in a single transmission can correspond to one priority level. For example, in the example above, one frame is transmitted in four parts, representing high-priority bits, medium-priority bits, low-priority bits, or very low-priority bits. Optionally, the audio data transmitted by the transmitter in a single transmission can correspond to multiple priorities. For example, in the example above, one frame is transmitted in two parts, representing high / medium-priority bits or low / very low-priority bits. The combination method of audio data can be determined based on channel quality, MCS scheme, etc., and this application does not impose specific limitations on it.

[0203] In one possible implementation, provided that the air interface time of the first frame is sufficient, the transmitting end sequentially transmits the audio data within the corresponding group in descending order of priority according to M1 priority levels, as shown in Figure 6 (Figure 6 is a flowchart of the audio data transmission method of this application). This may include the following steps:

[0204] 1. Send the first audio signal

[0205] 1.1 Obtain the first data, which includes audio data in n1 priority groups. The n1 priorities are the first n1 priorities in M1 priorities sorted from high to low, where 0 < n1 < M1.

[0206] The first data is the high-priority audio data in the first frame, which may include a set of audio data corresponding to one priority (i.e., the highest priority, n1=1), or may include multiple sets of audio data corresponding to multiple priorities (i.e., the highest priority, the second highest priority, ..., the i-th priority, n1>1).

[0207] 1.2 The first audio signal is obtained by channel coding the first data according to the first MCS;

[0208] The first MCS can be the MCS used by the transmitter in the previous frame before sending the first frame, and the MCS scheme has not yet been switched. It is evident that the first audio signal carries the aforementioned first data, which corresponds to the first MCS.

[0209] 1.3 Send the first audio signal.

[0210] 2. Send the second audio signal

[0211] 2.1 After the first audio signal is successfully sent, if the air interface time of the first frame is sufficient, the second data is obtained. The second data includes audio data in the corresponding groups of n2 priorities. The n2 priorities are ranked after the n1 priorities in the order of M1 priorities from high to low, and 0 < n2 < M1.

[0212] The air interface time for the first frame is sufficient, indicating that the sending end still has time to process the first frame. Under the aforementioned premise, the sending end can continue to send the second data that has not yet been sent in the first frame.

[0213] The second data is the audio data with the second highest priority in the first frame. It can include a set of audio data corresponding to one priority (i.e., the second highest priority, n2=1), or it can include multiple sets of audio data corresponding to multiple priorities (i.e., the (i+1)th priority, the (i+2)th priority, ..., the (i+j)th priority, n2>1).

[0214] 2.2 The second audio signal is obtained by channel coding the second data according to the first MCS;

[0215] The first MCS can be the MCS used by the transmitter to send the first data, or it can be the MCS used by the transmitter to send the previous frame of the first frame. At this point, the MCS scheme has not yet been switched. It can be seen that the second audio signal carries the aforementioned second data, which corresponds to the first MCS.

[0216] 2.3 Send the second audio signal.

[0217] 3. Retransmit the second audio signal

[0218] 3.1 If the second audio signal fails to be transmitted, the second audio signal shall be transmitted again provided that the air interface time of the first frame is sufficient and the number of retransmissions of the second audio signal has not reached the retransmission threshold.

[0219] The air interface time for the first frame is sufficient, indicating that the transmitter still has time to process the first frame. The number of retransmissions of the second audio signal has not reached the retransmission threshold, meaning that the second audio signal still has a chance to be retransmitted. Under these two conditions, the transmitter can retransmit the second audio signal.

[0220] 4. Send a third audio signal based on the transmission of the second audio signal.

[0221] 4.1 After the second audio signal is successfully sent, or if the second audio signal fails to be sent, and the air interface time of the first frame is insufficient, the third data is obtained. The third data includes the audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, M2>1, 0<n3<M2;

[0222] Optionally, after the second data, the first frame has no audio data, that is, the first frame is sent in two parts: the first audio signal carrying the first data is sent in the first part, and the second audio signal carrying the second data is sent in the second part.

[0223] Optionally, after the second data, the first frame may also contain audio data, that is, the first frame may be sent in three or more parts: the first audio signal carrying the first data is sent in the first part, the second audio signal carrying the second data is sent in the second part, the third audio signal carrying the data that has not yet been sent is sent in the third part, and so on.

[0224] This embodiment uses the example of sending the first frame in two parts as an example, but it does not limit the transmission logic of the sending end. When sending the first frame, the sending end sends the audio data in the corresponding group multiple times according to the M1 priorities of the first frame in descending order. During this process, if the transmission of a certain priority bit fails, the priority bit is retransmitted until the transmission is successful; if the number of retransmissions of the priority bit reaches the retransmission threshold, the audio data of the first frame that has not yet been sent is discarded, and the second frame is sent instead; if the air interface time of the first frame is insufficient, the audio data of the first frame that has not yet been sent is discarded, and the second frame is sent instead.

[0225] Based on the above explanation, the successful transmission of the second audio signal indicates that the transmission of the first frame is complete. Under the aforementioned premise, the transmitting end can then proceed to transmit the third data in the second frame.

[0226] If the air interface time for the first frame is insufficient, it means the transmitter does not have enough time to process the first frame and needs to enter the air interface time for the second frame to begin processing it. Under the aforementioned conditions, the transmitter then sends the third data from the second frame.

[0227] The third data is the high-priority audio data in the second frame, which may include a set of audio data corresponding to one priority (i.e., the highest priority, n3=1), or may include multiple sets of audio data corresponding to multiple priorities (i.e., the highest priority, the second highest priority, ..., the i-th priority, n3>1).

[0228] 4.2 The third audio signal is obtained by channel coding the third data according to the first MCS;

[0229] As described above, the transmitting end does not switch to transmitting the third data in the second frame due to changes in channel quality; therefore, the first MCS can still be used to perform channel coding on the third data. It is evident that the third audio signal carries the aforementioned third data, which corresponds to the first MCS.

[0230] 4.3 Send the third audio signal.

[0231] 5. Send a fourth audio signal based on the transmission of the second audio signal.

[0232] 5.1 When the second audio signal fails to be transmitted, and the number of retransmissions of the second audio signal reaches the retransmission threshold, the third data is obtained. The third data includes the audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, M2>1, 0<n3<M2.

[0233] The second audio signal has reached the retransmission threshold, meaning that there is no longer a chance to retransmit it after multiple attempts, which also reflects a deterioration in channel quality. Under these circumstances, the transmitting end then sends the third data from the second frame.

[0234] 5.2 The fourth audio signal is obtained by channel coding the third data according to the second MCS, where the order of the second MCS is lower than that of the first MCS;

[0235] As mentioned above, the transmitting end switches to sending the third data in the second frame due to deteriorating channel quality. Therefore, it is necessary to switch the previously used MCS and lower its order. At this time, the transmitting end performs channel coding on the third data according to the second MCS with the lowered order. It can be seen that the fourth audio signal carries the aforementioned third data, which corresponds to the second MCS. This allows for rapid adjustment of the communication MCS, timely response to changes in channel quality, and improved anti-interference capability.

[0236] 5.3 Send the fourth audio signal.

[0237] 6. Retransmit the first audio signal

[0238] 6.1 If the first audio signal fails to be transmitted, the first audio signal shall be transmitted again provided that the air interface time of the first frame is sufficient and the number of retransmissions of the first audio signal has not reached the retransmission threshold.

[0239] The air interface time for the first frame is sufficient, indicating that the transmitter still has time to process the first frame. The number of retransmissions of the first audio signal has not reached the retransmission threshold, meaning the first audio signal still has a chance to be retransmitted. Under these two conditions, the transmitter can retransmit the first audio signal.

[0240] 7. Send a third audio signal based on the transmission of the first audio signal.

[0241] 7.1 After the first audio signal is successfully sent, if the air interface time of the first frame is insufficient, the third data is obtained. The third data includes the audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low. M2>1, 0<n3<M2.

[0242] If the air interface time for the first frame is insufficient, it means the transmitter does not have enough time to process the first frame and needs to enter the air interface time for the second frame to begin processing it. Under the aforementioned conditions, the transmitter then sends the third data from the second frame.

[0243] 7.2 The third audio signal is obtained by channel coding the third data according to the first MCS;

[0244] As described above, the transmitting end does not switch to transmitting the third data in the second frame due to changes in channel quality; therefore, the first MCS can still be used to perform channel coding on the third data. It is evident that the third audio signal carries the aforementioned third data, which corresponds to the first MCS.

[0245] 7.3 Send the third audio signal.

[0246] 8. Based on the transmission of the first audio signal, transmit the fourth audio signal.

[0247] 8.1 When the first audio signal fails to be transmitted, and the number of retransmissions of the first audio signal reaches the retransmission threshold, the third data is obtained. The third data includes the audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low. M2>1, 0<n3<M2.

[0248] The first audio signal has reached the retransmission threshold, meaning that there is no longer a chance to retransmit it after multiple attempts, which also reflects a deterioration in channel quality. Under these circumstances, the transmitting end then sends the third data from the second frame.

[0249] 8.2 The third data is channel-coded according to the second MCS to obtain the fourth audio signal. The order of the second MCS is lower than that of the first MCS.

[0250] As mentioned above, the transmitting end switches to sending the third data in the second frame due to deteriorating channel quality. Therefore, it is necessary to switch the previously used MCS and lower its order. At this time, the transmitting end performs channel coding on the third data according to the second MCS with the lowered order. It can be seen that the fourth audio signal carries the aforementioned third data, which corresponds to the second MCS. This allows for rapid adjustment of the communication MCS, timely response to changes in channel quality, and improved anti-interference capability.

[0251] 8.3 Send the fourth audio signal.

[0252] It should be noted that the above only mentions that the sending end sends the third data in the second frame, that is, the sending end sends the high-priority audio data in the second frame, but it does not mean that the sending end does not send the second-highest / medium / low-priority audio data in the second frame. The sending process of this type of data can refer to the steps for the second data above, and will not be repeated here.

[0253] When sending the current frame, the sending end transmits the audio data within the corresponding group in multiple transmissions according to the frame's multiple priorities from highest to lowest. During this process, if a priority bit fails to be transmitted, it is retransmitted until successful. If the number of retransmissions for a priority bit reaches the retransmission threshold, the audio data not yet transmitted in the current frame is discarded, and the next frame is sent. If the air interface time for the current frame is insufficient, the audio data not yet transmitted in the current frame is discarded, and the next frame is sent. This process quickly identifies which data needs to be retransmitted and which data needs to be saved or discarded, thereby reducing the number of transmissions of high-priority audio data, improving the success rate of high-priority audio data transmission, and enhancing the user experience.

[0254] Optionally, the first data mentioned above includes 1 / t audio data within n1 priority groups, where t≥1.

[0255] Optionally, the second data mentioned above includes 1 / t audio data within n2 priority groups, where t≥1.

[0256] Optionally, the aforementioned third data includes 1 / t audio data within n3 priority groups, where t≥1.

[0257] For example, t = 1, 2, 4, ... When the channel quality deteriorates as described above, to enhance anti-interference capability, the transmitter switches the previously used first MCS and lowers its order. That is, the audio data is channel-coded according to the second MCS with the lowered order. To adapt to the second MCS, the amount of data sent by the transmitter for the third data can retain the amount of data sent in the original transmission (corresponding to the first / second data). For example, all data in a certain priority group (t = 1), or half of the data in a certain priority group (t = 2), etc.; or the amount of data sent by the transmitter for the third data can be halved from the amount of data sent in the original transmission (corresponding to the first / second data). For example, half of the data in a certain priority group (t = 2), or a quarter of the data in a certain priority group (t = 4), etc.; or the amount of data sent by the transmitter for the third data can be a quarter of the amount of data sent in the original transmission (corresponding to the first / second data), and so on.

[0258] The above steps describe the process by which the transmitter, assuming sufficient air interface time for the first frame, sequentially transmits the audio data within the corresponding groups in descending order of priority (M1). This addresses the situation where strong interference (degraded channel quality) persists in the channel, severely impacting transmission performance. When the strong interference disappears, the transmitter can consider the reverse operation: increasing the order of the MCS (Multi-Channel System) and / or merging the audio data within the high- and low-priority groups in a single transmission.

[0259] In one possible implementation, when no retransmission occurs for m consecutive frames, the fourth data is acquired. The fourth data includes audio data within the n4 priority groups of the third frame. The third frame follows the m consecutive frames and contains M3 groups of audio data corresponding to M3 priorities. The n4 priorities are the first n4 priorities in descending order of the M3 priorities, where m > 1, M3 > 1, and n1 ≤ n4 ≤ M3. The fourth data is then channel-coded according to the third MCS to obtain the fifth audio signal. The order of the third MCS is higher than that of the second MCS. The fifth audio signal is then transmitted.

[0260] If m consecutive frames were transmitted without retransmission, it means that m frames were transmitted consecutively according to the steps above without any retransmission, and each audio signal was successfully transmitted on the first attempt. This reflects improved channel quality. Under the aforementioned premise, the transmitting end can then transmit the fourth data in the third frame, which is the audio frame following the aforementioned m frames.

[0261] The fourth data is high-priority audio data in the third frame. It may include multiple sets of audio data with the same priority as the first data (n4 = n1), or it may include multiple sets of audio data with a higher priority than the first data (n4 > n1), or it may include all the audio data of the third frame (n4 = M3).

[0262] It should be noted that the above only mentions the sending end transmitting the fourth data in the third frame, that is, the sending end transmitting the high-priority audio data in the third frame. This does not mean that the sending end does not transmit the second-highest / medium / lowest priority audio data in the third frame. The transmission process for this type of data can refer to the steps for the second data described above, and will not be repeated here. When the sending end can transmit all the audio data of the current frame at once, the scheme of transmitting the same frame in multiple parts can no longer be considered until a retransmission of a certain frame occurs.

[0263] When the channel is affected by strong interference, this application can quickly adjust the audio data encoding and decoding by sending a frame multiple times based on the priority of the audio data, thereby reducing the number of transmissions of high-priority audio data, improving the success rate of high-priority audio data transmission, and enhancing the user experience.

[0264] The technical solution of the method embodiment shown in Figure 5 will be described in detail below using specific embodiments.

[0265] Figures 7a and 7b are schematic diagrams of audio data transmission according to this application. This embodiment includes the following steps:

[0266] 1. Obtain audio data for the corresponding group based on priority. For example, in L2HC encoding and decoding, audio data can be obtained in the order of their appearance. This is because in L2HC encoded data packets, the data at the beginning (left in the diagram) has a higher priority than the data at the end (right in the diagram). Typically, the amount of high-priority data and low-priority data is half the amount of audio data in that frame.

[0267] 2. As shown in Figure 7a, when strong interference causes the k-th frame to be retransmitted, the data packets of the k-th frame are adjusted during the retransmission of the k-th frame, and the high-priority data k_high is transmitted first.

[0268] 3. If the high-priority data k_high fails to be sent (not successfully received by the receiver), then the high-priority data k_high will be retransmitted.

[0269] 4. If the high-priority data k_high is successfully sent (successfully received by the receiving end) and there is sufficient air interface time, then the low-priority data k_low is sent.

[0270] 5. If the high-priority data k_high is successfully transmitted, but there is not enough air interface time, the low-priority data k_low is discarded, and the high-priority data k+1_high of the (k+1)th frame is transmitted instead.

[0271] 6. If the low-priority data k_low fails to be transmitted and there is not enough air interface time, the low-priority data k_low is discarded and the high-priority data k+1_high of the (k+1)th frame is transmitted instead.

[0272] 7. As shown in Figure 7b, if the high-priority data k_high fails to be transmitted after multiple retransmissions (e.g., 3 retransmissions), it indicates that strong interference in the channel is always present and seriously affects the transmission performance. In this case, the high-priority data k+1_high of the (k+1)th frame is transmitted instead, and the communication MCS for transmitting the high-priority data k+1_high is switched to a low-order MCS in the (k+1)th frame to enhance the anti-interference capability.

[0273] 8. If the high-priority data k+1_high still fails to be sent after switching to a low-priority MCS, the high-priority data k+1_high can be further subdivided into half of the high-priority data k+1_high1 / 2 and half of the low-priority data k+1_low1 / 2, and then steps 2 to 7 can be repeated.

[0274] Once the strong interference in the channel disappears, the success rate of high-priority data transmission will significantly improve. At this point, the transmitting end can reverse the above eight steps to increase the communication MCS and / or merge high-priority and low-priority data to improve audio quality.

[0275] Figure 8 is a structural schematic diagram of the audio data transmission device 800 of this application. As shown in Figure 8, the audio data transmission device 800 of this embodiment can be applied to the aforementioned terminal device. The audio data transmission device 800 may include: a transmitting module 801. Wherein,

[0276] The sending module 801 is used to send the audio data in the corresponding group of the first frame in descending order of M1 priorities when the first frame is retransmitted. The audio data in the corresponding group belongs to the M1 group of audio data in the first frame. The M1 group of audio data corresponds to the M1 priorities, where M1 > 1.

[0277] In one possible implementation, the transmitting module 801 is specifically used to transmit a first audio signal, which is obtained by channel coding of the first data according to the first modulation and coding strategy MCS. The first data includes audio data in n1 priority groups, where the n1 priorities are the first n1 priorities in the M1 priorities sorted from high to low, and 0 < n1 < M1.

[0278] In one possible implementation, the transmitting module 801 is further configured to transmit a second audio signal after the first audio signal is successfully transmitted, provided that the air interface time of the first frame is sufficient. The second audio signal is obtained by channel coding of the second data according to the first MCS. The second data includes audio data in n2 priority groups. The n2 priorities are arranged after the n1 priorities in the M1 priorities from high to low, and 0 < n2 < M1.

[0279] In one possible implementation, the sending module 801 is further configured to, after the second audio signal fails to be sent, resend the second audio signal provided that the air interface time of the first frame is sufficient and the number of retransmissions of the second audio signal has not reached the retransmission threshold.

[0280] In one possible implementation, the transmitting module 801 is further configured to transmit a third audio signal after the first audio signal is successfully transmitted, provided that the air interface time of the first frame is insufficient, or after the second audio signal is successfully transmitted, or after the second audio signal fails to be transmitted, provided that the air interface time of the first frame is insufficient. The third audio signal is obtained by channel coding the third data according to the first MCS. The third data includes audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, M2>1, 0<n3<M2.

[0281] In one possible implementation, the transmitting module 801 is further configured to transmit a fourth audio signal when the first audio signal fails to be transmitted, provided that the number of retransmissions of the first audio signal reaches a retransmission threshold, or when the second audio signal fails to be transmitted, provided that the number of retransmissions of the second audio signal reaches a retransmission threshold. The fourth audio signal is obtained by channel coding the third data according to the second MCS, wherein the order of the second MCS is lower than the order of the first MCS. The third data includes audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, where M2 > 1 and 0 < n3 < M2.

[0282] In one possible implementation, the sending module 801 is further configured to, after the first audio signal fails to be sent, resend the first audio signal provided that the air interface time of the first frame is sufficient and the number of retransmissions of the first audio signal has not reached the retransmission threshold.

[0283] In one possible implementation, the transmitting module 801 is further configured to transmit a fifth audio signal when no retransmission occurs in m consecutive frames. The fifth signal is obtained by channel coding of the fourth data according to the third MCS, wherein the order of the third MCS is higher than the order of the second MCS. The fourth data includes audio data within the n4 priority groups of the third frame. The third frame is after the m consecutive frames and contains M3 groups of audio data corresponding to M3 priorities. The n4 priorities are the first n4 priorities in the M3 priorities sorted from high to low, where m > 1, M3 > 1, and n1 ≤ n4 ≤ M3.

[0284] In one possible implementation, the first data includes 1 / t audio data within the n1 priority-corresponding groups, where t≥1.

[0285] In one possible implementation, the second data includes 1 / t audio data within the n2 priority corresponding groups, where t≥1.

[0286] In one possible implementation, the third data includes 1 / t audio data within the n3 priority groups, where t ≥ 1.

[0287] The apparatus in this embodiment can be used to execute the technical solution of the method embodiment shown in FIG5. Its implementation principle and technical effect are similar, and will not be described again here.

[0288] It is understood that, in order to achieve the above-mentioned functions, electronic devices include hardware and / or software modules that perform the respective functions. Based on the algorithmic steps of the examples described in the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.

[0289] In one example, FIG3 shows a schematic block diagram of an apparatus 300 according to an embodiment of the present application. The apparatus 300 may include a processor 301 and a transceiver / transceiver pin 302, and optionally, a memory 303.

[0290] The various components of device 300 are coupled together via bus 304, which includes a data bus, a power bus, a control bus, and a status signal bus. However, for clarity, all buses are referred to as bus 304 in the figure.

[0291] Optionally, the memory 303 can be used for the instructions in the foregoing method embodiments. The processor 301 can be used to execute the instructions in the memory 303, control the receive pin to receive signals, and control the transmit pin to transmit signals.

[0292] The device 300 may be an electronic device or a chip of an electronic device in the above method embodiments.

[0293] All relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0294] This embodiment also provides a computer storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the dual Wi-Fi connection method in the above embodiment.

[0295] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the dual Wi-Fi connection method in the above embodiment.

[0296] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the dual Wi-Fi connection method in the above method embodiments.

[0297] In this embodiment, the electronic device, computer storage medium, computer program product or chip are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding method provided above, and will not be repeated here.

[0298] In implementation, each step of the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this application can be directly implemented by a hardware encoding processor, or by a combination of hardware and software modules in the encoding processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.

[0299] The memory mentioned in the above embodiments can be volatile memory or non-volatile memory, or may include both. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM). It should be noted that the memory used in the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0300] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0301] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0302] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0303] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0304] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0305] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0306] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An audio data transmission method, characterized in that, include: When the first frame is retransmitted, the audio data in the corresponding group of the first frame is sent sequentially in descending order of M1 priorities. The audio data in the corresponding group belongs to the M1 group of audio data in the first frame. The M1 group of audio data corresponds to the M1 priorities, where M1 > 1.

2. The method according to claim 1, characterized in that, The step of sequentially sending the audio data within the corresponding group of the first frame in descending order of priority according to M1 priorities includes: A first audio signal is transmitted. The first audio signal is obtained by channel coding the first data according to the first modulation and coding strategy MCS. The first data includes audio data in n1 priority groups. The n1 priorities are the first n1 priorities in the M1 priorities sorted from high to low, where 0 < n1 < M1.

3. The method according to claim 2, characterized in that, The step of sequentially sending the audio data within the corresponding group of the first frame in descending order of priority according to M1 priorities further includes: After the first audio signal is successfully transmitted, provided that the air interface time of the first frame is sufficient, the second audio signal is transmitted. The second audio signal is obtained by channel coding the second data according to the first MCS. The second data includes audio data in n2 priority groups. The n2 priorities are arranged after the n1 priorities in the order of M1 priorities from high to low, and 0 < n2 < M1.

4. The method according to claim 3, characterized in that, The step of sequentially sending the audio data within the corresponding group of the first frame in descending order of priority according to M1 priorities further includes: If the second audio signal fails to be transmitted, the second audio signal will be transmitted again if the air interface time of the first frame is sufficient and the number of retransmissions of the second audio signal has not reached the retransmission threshold.

5. The method according to claim 3 or 4, characterized in that, After transmitting the audio data within the corresponding group of the first frame sequentially according to M1 priorities from high to low, the method further includes: After the first audio signal is successfully transmitted, a third audio signal is transmitted if the air interface time of the first frame is insufficient, or if the second audio signal is successfully transmitted, or if the second audio signal fails to be transmitted, if the air interface time of the first frame is insufficient. The third audio signal is obtained by channel coding the third data according to the first MCS. The third data includes audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, M2>1, 0<n3<M2.

6. The method according to any one of claims 3-5, characterized in that, After transmitting the audio data within the corresponding group of the first frame sequentially according to M1 priorities from high to low, the method further includes: When the first audio signal fails to be transmitted, a fourth audio signal is transmitted if the number of retransmissions of the first audio signal reaches the retransmission threshold, or if the second audio signal fails to be transmitted, a fourth audio signal is transmitted if the number of retransmissions of the second audio signal reaches the retransmission threshold. The fourth audio signal is obtained by channel coding the third data according to the second MCS. The order of the second MCS is lower than the order of the first MCS. The third data includes audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, where M2 > 1 and 0 < n3 < M2.

7. The method according to any one of claims 2-6, characterized in that, The step of sequentially sending the audio data within the corresponding group of the first frame in descending order of priority according to M1 priorities further includes: If the first audio signal fails to be transmitted, the first audio signal will be transmitted again if the air interface time of the first frame is sufficient and the number of retransmissions of the first audio signal has not reached the retransmission threshold.

8. The method according to claim 6, characterized in that, After sending the fourth audio signal, the process also includes: When no retransmission occurs for m consecutive frames, a fifth audio signal is sent. The fifth signal is obtained by channel coding the fourth data according to the third MCS. The order of the third MCS is higher than that of the second MCS. The fourth data includes audio data in the n4 priority groups of the third frame. The third frame is after the m consecutive frames. The third frame contains M3 groups of audio data corresponding to M3 priorities. The n4 priorities are the first n4 priorities in the M3 priorities sorted from high to low, where m>1, M3>1, and n1≤n4≤M3.

9. The method according to claim 2, characterized in that, The first data includes 1 / t audio data within the n1 priority groups, where t≥1.

10. The method according to claim 3, characterized in that, The second data includes 1 / t audio data within the n2 priority groups, where t≥1.

11. The method according to claim 5 or 6, characterized in that, The third data includes 1 / t audio data within the n3 priority groups, where t≥1.

12. An audio data transmission device, characterized in that, include: The sending module is used to send the audio data in the corresponding group of the first frame in descending order of M1 priorities when the first frame is retransmitted. The audio data in the corresponding group belongs to the M1 group of audio data in the first frame. The M1 group of audio data corresponds to the M1 priorities, where M1 > 1.

13. The apparatus according to claim 12, characterized in that, The transmitting module is specifically used to transmit a first audio signal. The first audio signal is obtained by channel coding the first data according to the first modulation and coding strategy MCS. The first data includes audio data in n1 priority groups. The n1 priorities are the first n1 priorities in the M1 priorities sorted from high to low, where 0 < n1 < M1.

14. The apparatus according to claim 13, characterized in that, The transmitting module is further configured to transmit a second audio signal after the first audio signal is successfully transmitted, provided that the air interface time of the first frame is sufficient. The second audio signal is obtained by channel coding of the second data according to the first MCS. The second data includes audio data in n2 priority groups. The n2 priorities are arranged after the n1 priorities in the M1 priorities from high to low, and 0 < n2 < M1.

15. The apparatus according to claim 14, characterized in that, The sending module is further configured to, when the second audio signal fails to be sent, resend the second audio signal provided that the air interface time of the first frame is sufficient and the number of retransmissions of the second audio signal has not reached the retransmission threshold.

16. The apparatus according to claim 14 or 15, characterized in that, The transmitting module is further configured to transmit a third audio signal when the first audio signal is successfully transmitted, provided that the air interface time of the first frame is insufficient, or when the second audio signal is successfully transmitted, or when the second audio signal fails to be transmitted, provided that the air interface time of the first frame is insufficient. The third audio signal is obtained by channel coding of the third data according to the first MCS. The third data includes audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, M2>1, 0<n3<M2.

17. The apparatus according to any one of claims 14-16, characterized in that, The transmitting module is further configured to transmit a fourth audio signal when the first audio signal fails to be transmitted, provided that the number of retransmissions of the first audio signal reaches a retransmission threshold, or when the second audio signal fails to be transmitted, provided that the number of retransmissions of the second audio signal reaches a retransmission threshold. The fourth audio signal is obtained by channel coding the third data according to the second MCS. The order of the second MCS is lower than the order of the first MCS. The third data includes audio data in the n3 priority groups of the second frame. The second frame is the next frame after the first frame. The second frame contains M2 groups of audio data corresponding to M2 priorities. The n3 priorities are the first n3 priorities in the M2 priorities sorted from high to low, where M2 > 1 and 0 < n3 < M2.

18. The apparatus according to any one of claims 13-17, characterized in that, The sending module is further configured to, when the first audio signal fails to be sent, resend the first audio signal provided that the air interface time of the first frame is sufficient and the number of retransmissions of the first audio signal has not reached the retransmission threshold.

19. The apparatus according to claim 17, characterized in that, The transmitting module is further configured to transmit a fifth audio signal when no retransmission occurs for m consecutive frames. The fifth signal is obtained by channel coding of the fourth data according to the third MCS. The order of the third MCS is higher than that of the second MCS. The fourth data includes audio data in the n4 priority groups of the third frame. The third frame is after the m consecutive frames. The third frame contains M3 groups of audio data corresponding to M3 priorities. The n4 priorities are the first n4 priorities in the M3 priorities sorted from high to low, where m > 1, M3 > 1, and n1 ≤ n4 ≤ M3.

20. The apparatus according to claim 13, characterized in that, The first data includes 1 / t audio data within the n1 priority groups, where t≥1.

21. The apparatus according to claim 14, characterized in that, The second data includes 1 / t audio data within the n2 priority groups, where t≥1.

22. The apparatus according to claim 16 or 17, characterized in that, The third data includes 1 / t audio data within the n3 priority groups, where t≥1.

23. A terminal device, characterized in that, include: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-11.

24. A computer-readable storage medium, characterized in that, Includes a computer program, which, when executed on a computer, causes the computer to perform the method of any one of claims 1-11.

25. A computer program product, characterized in that, The computer program product includes computer program code that, when run on a computer, causes the computer to perform the method according to any one of claims 1-11.

Images