Communication Method for Wireless Headphones and Wireless Headphones

Abstract

The present application relates to a communication method and wireless earphones for wireless earphones. The wireless earphones support the LE Audio mode and include a first earphone and a second earphone. The communication method includes: when both the first earphone and the second earphone play audio data in the LE Audio mode, setting, by the first earphone, an initial advance time for audio data playback, and the first earphone and the second earphone synchronously playing the received audio data packets at the audio data playback moment determined based on the FT value and the initial advance time for audio data playback; adjusting, by the first earphone, the advance time for audio data playback based on the reception status of the audio data packets, so that in the case where the reception status of the audio data packets is worse than a preset threshold, the advance time for audio data playback is decreased, and vice versa, the advance time for audio data playback. The communication method of the present application can improve the phenomenon of audio playback jamming and reduce the synchronous playback delay when there is no jamming, thereby improving the user experience.

Description

Technical Field

[0001] This application relates to the technical field of wireless earphones, and more specifically, to a communication method for wireless earphones and wireless earphones. Background Art

[0002] With the rapid development of the TWS earphone market, the Bluetooth Special Interest Group has launched the BLE Audio technology. In this technology, in order to achieve synchronous playback of multiple audio receiving devices such as true wireless stereo (TWS) earphones, the concept of FT (Flush Timeout Point) is introduced, that is: when an audio data packet reaches the last transmission time point (FTP, Flush Timeout Point)) and has not been successfully transmitted, the packet will be discarded. Compared with the more times of data packet retransmission in traditional Bluetooth (BT) communication, the FT mechanism may cause packet loss in BLE Audio. Especially in a poor surrounding environment, BLE Audio may keep losing packets. Therefore, usually, by setting a larger FT value, more retransmission times are allowed before the FTP arrives to alleviate the poor experience such as stuttering or popping caused by packet loss or algorithmic packet compensation. However, since the FT value cannot be dynamically adjusted once set, a larger FT value means a longer delay. Currently, no prior art has been found that can better balance the packet loss problem and the delay problem in BLE Audio. Summary of the Invention

[0003] This application is provided to solve the above-mentioned defects existing in the prior art. There is a need for a communication method for wireless earphones and wireless earphones, which can allow more retransmission times to improve stuttering when the audio data packet reception condition is poor, such as stuttering, in the Bluetooth LE Audio (Bluetooth Low Energy Audio) mode, and allow multiple earphones to synchronously play in advance when the audio data packet reception condition is good, so as to have a smaller playback delay and improve the user experience.

[0004] According to a first aspect of the present application, there is provided a communication method for wireless earphones. The wireless earphones support the LE Audio mode and include a first earphone and a second earphone. The communication method includes, when both the first earphone and the second earphone play audio data in the LE Audio mode: setting, by the first earphone, an initial advance time for audio data playback, and synchronously playing, by the first earphone and the second earphone, the respective received audio data packets at an audio data playback moment determined based on the FT value and the initial advance time for audio data playback, where the first earphone is any one of the two earphones, and the FT value is the survival time of an audio data packet set in the LE Audio mode and cannot be dynamically adjusted. Determining, by the first earphone, the reception status of audio data packets within a first time interval, and adjusting, based on the reception status of the audio data packets, the advance time for audio data playback, such that when the reception status of the audio data packets is worse than a preset threshold, the advance time for audio data playback is decreased, and when the reception status of the audio data packets is equal to or better than the preset threshold and remains for a second time interval, the advance time for audio data playback is increased, and such that the first earphone and the second earphone synchronously play the respective received audio data packets at an audio data playback moment determined based on the FT value and the adjusted advance time for audio data playback.

[0005] According to a second aspect of the present application, there is provided a pair of wireless earphones, which includes a first earphone and a second earphone. The first earphone includes a first system-on-chip, and the second earphone includes a second system-on-chip. When both the first earphone and the second earphone play audio data in the LE Audio mode, the first system-on-chip of the first earphone is configured to: set an initial advance time for audio data playback, such that the first earphone and the second earphone synchronously play the respective received audio data packets at an audio data playback moment determined based on the FT value and the initial advance time for audio data playback, where the FT value is the survival time of an audio data packet set in the LE Audio mode and cannot be dynamically adjusted. The first system-on-chip is further configured to: determine the reception status of audio data packets within a first time interval, and adjust, based on the reception status of the audio data packets, the advance time for audio data playback, such that when the reception status of the audio data packets is worse than a preset threshold, the advance time for audio data playback is decreased, and when the reception status of the audio data packets is equal to or better than the preset threshold and remains for a second time interval, the advance time for audio data playback is increased, and such that the first earphone and the second earphone synchronously play the respective received audio data packets at an audio data playback moment determined based on the FT value and the adjusted advance time for audio data playback.

[0006] The communication method and wireless earphones for wireless earphones provided in various embodiments of the present application can dynamically adjust the synchronous playback time of audio data according to the reception status of audio data packets when the FT value cannot be dynamically adjusted once set in the LE Audio mode: when the reception status of the audio data packet is worse than the preset threshold, the advance time of audio data playback can be reduced, that is, the playback time of the audio data packet is closer to the FT value set by the system, so that there are more retransmission opportunities before the synchronous playback time arrives, effectively improving the anti-interference ability of the external environment and improving the stuttering experience caused by packet loss; while when the reception status is equal to or better than the preset threshold and the second time interval is maintained, the advance amount of audio data playback can be increased, so that while reducing packet loss, the delay of synchronous audio playback of the earphones can also be reduced, further improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 FIG. shows a flowchart of a communication method for wireless earphones according to an embodiment of the present application;

[0008] Figure 2 FIG. shows an exemplary schematic diagram of a first synchronous broadcast stream according to an embodiment of the present application;

[0009] Figure 3 FIG. shows an exemplary schematic diagram of a second synchronous broadcast stream according to an embodiment of the present application;

[0010] Figure 4 FIG. shows an exemplary schematic diagram of a third synchronous broadcast stream according to an embodiment of the present application;

[0011] Figure 5 FIG. shows a flowchart of synchronous adjustment between two earphones according to an embodiment of the present application; and

[0012] Figure 6 FIG. shows a schematic structural diagram of wireless earphones according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0013] To enable those skilled in the art to better understand the technical solutions of the present application, the present application will be described in detail below with reference to the accompanying drawings and specific embodiments. The embodiments of the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments, but this is not a limitation of the present application.

[0014] The "first", "second" and similar terms used in the present application do not indicate any order, quantity or importance, but are only used for distinction. Words such as "including" or "comprising" mean that the elements before the word cover the elements listed after the word, and do not exclude the possibility of also covering other elements.

[0015] Figure 1 The flowchart shows a communication method for wireless earphones according to an embodiment of the present application. The wireless earphones support the LE Audio mode and include a first earphone and a second earphone. The first earphone and the second earphone respectively support the Bluetooth Low Energy Audio mode. In this mode, the packet sender sets the same FT value (audio packet survival time) for the first earphone and the second earphone respectively during the QOS configuration phase, and the FT value cannot be dynamically adjusted after being set. When both the first earphone and the second earphone play audio data in the LE Audio mode, as Figure 1 shown, first in step 101, the first earphone sets an initial advance time for audio data playback. After the FT value is set, the earphone plays audio data according to the delay time of the FT value. After the first earphone sets the initial advance time for audio data playback, it can play audio data in advance based on the FT value. The first earphone can be either of the two earphones.

[0016] In step 102, the first earphone and the second earphone synchronously play the respective received audio packets at the audio data playback moment determined based on the FT value and the initial advance time for audio data playback, where the first earphone can be either of the two earphones, and the FT value is the audio packet survival time set in the LE Audio mode and cannot be dynamically adjusted. The audio data playback moment can be calculated based on the FT value and the initial advance time for audio data playback. The two earphones respectively reach the purpose of synchronous playback according to the same audio data playback moment. In some embodiments, the audio data playback moment is the moment calculated by subtracting the advance time for audio data playback from the moment corresponding to the FT value after the audio data is received. Taking the synchronous broadcast stream as an example, for instance, if the FT value is 10, then if an audio packet is received in the corresponding ISO Interval (the first ISO Interval), it will wait until the tenth ISO Interval to play the audio packet. If the set initial advance time for audio data playback is 2 ISO Intervals, then the first earphone plays the audio data in the eighth ISO Interval.

[0017] In step 103, the first earphone determines whether the reception status of audio data packets within the first time interval is worse than a preset threshold. In some embodiments, taking the LC3 10-millisecond frame length as an example, the first time interval can be set to a value within the range of several tens of milliseconds to several tens of seconds. And whether the reception status of audio data packets is worse than the preset threshold can be assumed as the percentage of correctly received audio data packets in the case of continuous audio data playback. Therefore, when only 500 audio data packets are received out of 1000 audio data packets that should be received within 10 seconds (the other data packets are not received or received incorrectly), it can be considered that the percentage of correct reception is approximately 50%. Assuming that the preset threshold is set to 95%, then the determination result of step 103 is "yes". In other embodiments, in the case where the audio may not be continuously played, whether the reception status of audio data packets within the first time interval is worse than the preset threshold can also be determined based on whether no audio data packets are received within the first time interval. For example, if no audio data packets are received for 30 consecutive seconds, then the determination result of step 103 is "yes". The specific implementation manner, the setting of the first time interval, the specific meaning of the reception status of audio data packets, and the specific value of the preset threshold can be specifically set according to experience or experimental data, and the present application does not limit this.

[0018] If the judgment result in step 103 is "yes", then proceed to step 104. Based on the reception status of the audio data packet, adjust the advance time of the audio data playback to reduce the advance time of the audio data playback. If the reception status of the audio data packet is worse than the preset threshold, it indicates that at this time, for example, due to electromagnetic interference in the external environment, the reception status of the audio data packet is not good. Then, the advance time of the audio data playback can be reduced so that the synchronous playback time of the audio data is closer to the FT value. In some embodiments, in the initial state, the advance time of the audio data playback can be set to a relatively large value first, so that the audio playback has a relatively small time delay, and in the subsequent process, the advance time of the audio data playback is adjusted according to the reception status of the audio data packet. Still taking the example given in step 102, that is, the first time interval is 10 seconds and the preset threshold is 95%. Then, when 700 audio data packets are correctly received within 10 seconds and the correct reception rate is 70%, which is relatively close to 80%, the advance time of the audio data playback can be reduced by one ISO Interval; and when only 100 audio data packets are correctly received within 10 seconds and the correct reception rate is 10%, which is far from the preset threshold, the advance time of the audio data playback can be reduced by more than one ISO Interval. That is to say, the specific method for adjusting the advance time of the audio data playback can be determined according to the deviation between the actual reception status of the audio data packet and the preset threshold. For example, in the case of a large deviation, a larger adjustment step value can be adopted to shorten the adjustment time; while in the case of a small deviation, a smaller adjustment step value can be adopted. In this way, a more accurate adjustment result can be obtained and overshoot caused by too large a step size can be avoided.

[0019] Figure 2 Show a first synchronous broadcast stream schematic diagram according to an embodiment of the present application. In the case of being worse than the preset threshold, the advance time of the audio data playback can be reduced. For example, if the FT value is set to 4 and the initial advance time is 1 ISO Interval, then the initial playback time of the P0 data is FP0. After reducing the advance time by 1 ISO Interval, the playback time of the P0 data can be changed to FP1. By increasing the playback delay, the audio data packet can have more opportunities for retransmission to reduce packet loss and avoid the bad experience of stuttering caused thereby.

[0020] If the judgment result in step 103 is "No", then in step 103', it is further judged whether the reception status of the audio data packet is equal to or better than a preset threshold and maintains a second time interval. If so, step 105 is performed to adjust the advance time of the audio data playback based on the reception status of the audio data packet, so that the advance time of the audio data playback increases. If the reception status of the audio data packet is equal to or better than the preset threshold, it indicates that the reception status is good at this time. If such a good reception status has been maintained for a period of time, such as the second time interval, it can be considered that the current environmental conditions are good, the audio data packet reception is stable, so the advance time of the audio playback can be considered to be increased, so as to further shorten the delay of the audio playback on the premise of ensuring a good reception status. Among them, the second time interval can be a value in the range of dozens of milliseconds to dozens of seconds. In some other embodiments, it can also be set to 0, and the present application does not make specific restrictions on this. Similar to the example in step 104, when increasing the advance time of the audio data playback based on the reception status of the audio data packet, if the reception status of the audio data packet in the current first time interval is greatly improved compared to the preset threshold or compared to the reception status of the audio data packet in the previous first time interval, a larger adjustment step value can be used to shorten the adjustment time; on the contrary, when the improvement is small, a smaller adjustment step value can be used to obtain a more accurate adjustment result and avoid overshoot caused by too large a step size.

[0021] Figure 3 Show a second synchronous broadcast stream schematic diagram according to an embodiment of the present application. For example, if the FT value is set to 4 and the initial advance time is 1 ISO Interval, then the initial playback time of the P0 data is FP0. If the reception status of the audio data packet is equal to or better than the preset threshold and such a good reception status has been maintained for a period of time, the playback time of the P0 data can now be changed to FP2 to reduce the delay.

[0022] After step 104 or step 105, step 106 is performed. The first earphone and the second earphone synchronously play the audio data packets received by them at the audio data playback time determined based on the FT value and the adjusted advance time of the audio data playback.

[0023] According to the embodiment of the present application, under the condition that the FT value is set and cannot be dynamically adjusted, when the reception is not good, by reducing the advance time, allowing more retransmission times, the anti-interference ability to the surrounding environment can be improved, and the situation of audio playback jamming can be avoided, and compared with playing audio data corresponding to the FT value, there is no increase in playback delay; when the reception is better, by increasing the advance time, while ensuring the audio playback quality, the delay of the audio data playback can be further reduced.

[0024] In some embodiments, when the reception condition of the audio data packet is worse than a preset threshold and the advance time of the audio data playback is greater than 0, the advance time of the audio data playback is decreased by a first step value. The first time interval may be 10 seconds, and the preset threshold may be a correct reception rate of 90%. Then, when 700 audio data packets are correctly received within 10 seconds and the correct reception rate is 70%, and the advance time of the audio data playback is greater than 0, the first step value by which the playback advance time can be decreased can be 1 ISO Interval or 2 ISO Intervals. When the advance time of the audio data playback is equal to 0, the advance time of the audio data playback can no longer be adjusted.

[0025] In some embodiments, when the reception condition of the audio data packet is equal to or better than a preset threshold and a second time interval is maintained, and the advance time of the audio data playback is less than FT value - 1, the advance time of the audio data playback is increased by a second step value. When it is better than the preset threshold and the second time interval is maintained, and the advance time of the audio data playback is equal to FT value - 1, the first step value by which the playback advance time is increased can be 1 ISO Interval or 2 ISO Intervals. When the advance time of the audio data playback is equal to FT value - 1, the advance time of the audio data playback can no longer be adjusted.

[0026] The above first step value and second step value can be the same or different. By way of example only, the first step value and the second step value can be set according to the current reception condition of the audio data packet. For example, according to the percentage of the audio data packets correctly received within the first time interval, the advance time can be decreased by 1 ISO Interval or decreased by 2 ISO Intervals.

[0027] In some embodiments, the advance time of the audio data playback is greater than or equal to 0 and less than or equal to FT value - 1. After the QOS parameters of the earphone are set, the FT value cannot be dynamically modified. When the advance time of the audio data playback is the minimum value of 0, it means not to play in advance, and the audio data is played at a unified time point defined by the FT value. Figure 4 Fig. shows a schematic diagram of a third synchronous broadcast stream according to an embodiment of the present application. As Figure 4As shown, if the FT value = 4, then the playback time point of the P0 audio data is at FP0. When the advance time of the audio data playback is the maximum value of 3, then the playback time point of the P0 audio data is at FP1. This is equivalent to receiving and playing the audio data P0 within an ISO Interval without delay. If the advance time of the audio data is equal to 0, which is equivalent to no advance at this time, according to the FT value, the audio data P0 will still be played at the FP0 moment, and even if the audio data packet is received within the first ISO Interval in Figure 4 , it will also be played at the FP0 moment.

[0028] Therefore, within the value range of the advance time of the audio data playback, the playback time of the audio data can be dynamically adjusted. Without increasing the delay, the stuttering problem can be optimized, and when the reception is good, the audio playback delay can be further reduced by increasing the advance time. Therefore, in the communication method for wireless earphones according to the embodiments of the present application, the FT value can be set to a relatively large value. Since the advance time of the audio data playback can be adjusted when the reception condition is good, a relatively large FT value does not always mean a greater audio playback delay. In the case of a poor peripheral electromagnetic environment, the relatively large FT value can be fully utilized for more retransmissions, thereby greatly reducing the stuttering or popping sounds caused by packet loss or packet compensation and improving the overall audio playback effect.

[0029] In some embodiments, the communication method further includes: when adjusting and reducing the advance time of audio data playback, synchronously reducing the audio data playback speeds of the first earphone and the second earphone; after the buffer depths of the first earphone and the second earphone reach the buffer depths corresponding to the adjusted advance time of audio data playback, resuming the normal audio data playback speed. When affected by the surrounding environment interference, the reception condition deteriorates. Based on the FT value, the advance time of audio data playback decreases, so the playback moments of audio data are discontinuous. Therefore, during the process of adjusting the advance time of audio data playback, the audio data playback speed can be reduced to make the audio data play continuously without stuttering. And during the process of adjusting the advance time of audio data playback, the buffer depth is increased. Specifically, for example, the audio data playback speed can be adjusted by adjusting the sampling rate of audio decoding. During the process of finely adjusting the sampling rate of audio decoding (such as Codec Resample), the playback speed can be adjusted with little perception by the user, so that the buffer depth increases. For example, if the audio data is delayed by 2 ISO Intervals, then two audio data packets are cached correspondingly. If the FT value = 4 and the advance time of audio data playback is 2, and the existing buffer depth is 1 audio data packet, the buffer depth needs to be increased by 1 audio data packet, and the adjusted buffer depth is 2 audio data packets. When the buffer depth reaches the buffer depth corresponding to the adjusted advance time of audio data playback, the playback speed can be restored to normal.

[0030] Figure 5 The flowchart showing the synchronous adjustment between two earphones according to an embodiment of the present application is shown. In step 501, when the first earphone determines that the advance time of audio data playback needs to be adjusted, the first earphone sends a synchronous adjustment request to the second earphone, and the synchronous adjustment request includes at least the adjusted advance time of audio data playback. The first earphone can be any one of the two earphones, and the surrounding environment interference conditions of the two earphones may be different. If the first earphone determines that the advance time of audio data playback needs to be adjusted, whether the advance time decreases or increases, the first earphone can send a synchronous adjustment request to the second earphone, and the synchronous adjustment request includes the adjusted advance time of audio data playback of the first earphone to ensure the subsequent playback synchronization of the first earphone and the second earphone.

[0031] When the second earphone receives the synchronization adjustment request, it performs step 502 to determine whether the current buffer depth of the second earphone is less than the buffer depth corresponding to the adjusted early time of audio data playback. To ensure synchronous playback of audio data by the first and second earphones, the first earphone may reduce the early time to avoid stuttering. If the buffer depth of the second earphone is 5 and the buffer depth corresponding to the adjusted early time of the first earphone is 6, it indicates that the reception condition of the second earphone is better than that of the first earphone. To maintain consistency, the second earphone needs to adjust its actual buffer depth to synchronize with the first earphone.

[0032] If the result of step 502 is yes, step 503 is performed to calculate an adjustment coefficient for the audio data playback speed based on the current buffer depth and the adjusted early time of audio data playback, and adjust the audio data playback speed based on the adjustment coefficient. If the current buffer depth of the second earphone is 5 and the early time needs to be reduced by one ISO Interval, the adjustment coefficient can be the size of the decoded sampling rate. When the early time is reduced, the decoded sampling rate is reduced. If the reduction amplitude of the early time is large, the sampling rate is correspondingly smaller. If the result of step 502 is no, it may be that the buffer depth of the second earphone is the same as that of the first earphone, and the second earphone does not need to be adjusted. If the buffer depth of the second earphone is greater than that of the first earphone, the second earphone also does not need to be adjusted. In some embodiments, the second earphone and the first earphone can be adjusted and synchronized through periodic interaction.

[0033] After step 503, the result obtained is Figure 5 As shown in 504, the buffer depth of the second earphone is made to reach the buffer depth corresponding to the adjusted early time of audio data playback, and audio data is played at the same audio data playback moment as the first earphone. After adjustment, the second earphone plays audio data based on the newly adjusted early time. The buffer depths of the two earphones are the same, and they can play audio data at the same audio data playback moment as the first earphone. In this way, when the reception condition of any one earphone is poor, the other earphone can also maintain the same smaller early time as that earphone, so as to ensure synchronous playback of the two earphones with high playback quality and improve the user's listening experience. The cycle time for sending the synchronization adjustment request can be set according to the change of interference in the surrounding environment, or according to the packet reception time of a certain number of audio data packets.

[0034] In some embodiments, the first earphone and the second earphone periodically send second synchronization information to the other earphone, and the second synchronization information at least includes the most recent audio data playback time; when the first earphone or the second earphone receives the second synchronization information sent by the other earphone, it adjusts its own playback speed and the cache depth of the audio data according to the later audio data playback time. The first earphone and the second earphone can be synchronized every fixed time. The first earphone sends the second synchronization information to the second earphone, or the second earphone sends the second synchronization information to the first earphone, and the receiving party makes adjustments to ensure that the audio data is played at the later audio data playback time. So that the first earphone and the second earphone can better maintain consistency during the process of playing audio data.

[0035] In some embodiments, when the second earphone needs to join the audio playback during the audio playback of the first earphone, the first earphone sends a synchronization adjustment request to the second earphone, and the synchronization adjustment request at least includes the current advance time of the audio data playback; the second earphone adjusts its own audio data cache depth and synchronizes with the first earphone to play the audio data at the audio data playback time corresponding to the advance time of the audio data playback. In the case of playing with only one earphone, if another earphone needs to join the simultaneous playback, after receiving the synchronization adjustment request from the first earphone, the second earphone increases the cache depth until it reaches the same cache depth as the first earphone, and then synchronizes with the first earphone to play the audio data according to the advance time, ensuring the consistency of the audio data played by the first earphone and the second earphone and improving the user experience.

[0036] In some embodiments, during the first period of starting the audio data playback, the first earphone determines whether there is cached data in the buffer; if there is no cached data in the buffer, the first earphone reduces the advance amount and slows down the playback speed until the audio data playback time corresponding to the advance time of the audio data playback. During the first period of starting the audio data playback, check the cached data situation in the buffer. If there is no cached data, it may be that the audio reception condition is not good, so it is necessary to reduce the advance amount and slow down the playback speed until the audio data playback time corresponding to the advance time of the audio data playback is reached.

[0037] Figure 6A schematic structural diagram of a wireless earphone according to an embodiment of the present application is shown. The wireless earphone includes a first earphone 610 and a second earphone 620. It is characterized in that the first earphone 610 includes a first system-on-chip 611, and the second earphone 620 includes a second system-on-chip 621. When both the first earphone 610 and the second earphone 620 play audio data in the LE Audio mode, the first system-on-chip 611 of the first earphone 610 is configured to: set an initial advance time for audio data playback, so that the first earphone 610 and the second earphone 620 synchronously play the received audio data packets at the audio data playback moment determined based on the FT value and the initial advance time for audio data playback, where the FT value is the audio data packet survival time set in the LE Audio mode and cannot be dynamically adjusted; determine the reception status of the audio data packets within a first time interval, and based on the reception status of the audio data packets, adjust the advance time for audio data playback, so that when the reception status of the audio data packets is worse than a preset threshold, the advance time for audio data playback is reduced, and when the reception status of the audio data packets is equal to or better than the preset threshold and remains for a second time interval, the advance time for audio data playback is increased, and the first earphone 610 and the second earphone 620 synchronously play the received audio data packets at the audio data playback moment determined based on the FT value and the adjusted advance time for audio data playback.

[0038] According to an embodiment of the present application, under the condition that the FT value is set and cannot be dynamically adjusted, when the reception is not good, by reducing the advance time, more retransmission times are allowed, the anti-interference ability to the surrounding environment is improved, and the situation of audio playback stuttering is avoided. Moreover, compared with playing audio data corresponding to the FT value, there is no increase in playback delay; when the reception is better, by increasing the advance time, while ensuring the audio playback quality, the delay of audio data playback can be further reduced.

[0039] In some embodiments, the audio data playback moment is the moment corresponding to the difference between the moment corresponding to the FT value after the audio data is received and the advance time for audio data playback.

[0040] In some embodiments, the first system-on-chip 611 is further configured to: when the reception status of the audio data packet is worse than a preset threshold and the advance time of the audio data playback is greater than 0, reduce the advance time of the audio data playback by a first step value; when the reception status of the audio data packet is equal to or better than the preset threshold and a second time interval is maintained, and the advance time of the audio data playback is less than the FT value - 1, increase the advance time of the audio data playback by a first step value. The above first step value and second step value may be the same or different. By way of example only, the first step value and the second step value may be set according to the current reception status of the audio data packet.

[0041] In some embodiments, the advance time of the audio data playback is greater than or equal to 0 and less than or equal to FT value - 1. After the QOS parameters of the headset are set, the FT value cannot be changed anymore. The maximum value of the advance time of the audio data playback is FT value - 1, and the minimum value is 0. When the minimum value is 0, it means no advance playback, and the audio data is played according to the FT value. Therefore, within the value range of the advance time of the audio data playback, the playback time of the audio data can be dynamically adjusted, and the stuttering problem can be optimized without increasing the delay. When the advance time is increased, the delay can be further reduced. Therefore, within the value range of the advance time of the audio data playback, the playback time of the audio data can be dynamically adjusted, the stuttering problem can be optimized without increasing the delay, and when the reception condition is good, the audio playback delay can be further reduced by increasing the advance time. Therefore, in the communication method for wireless headsets according to the embodiments of the present application, the FT value can be set to a relatively large value. Since the advance time of the audio data playback can be adjusted when the reception condition is good, a relatively large FT value does not always mean a larger audio playback delay. In the case of a poor surrounding electromagnetic environment, the relatively large FT value can be fully utilized for more retransmissions, thereby greatly reducing the stuttering caused by packet loss or packet compensation. Or in some embodiments, when the advance time of the audio data playback is adjusted and decreased, the first system - on - chip 611 is further configured to: reduce the audio data playback speed of the first headset 610, and resume the normal audio data playback speed after the cache depth of the buffer of the first headset 610 reaches the cache depth corresponding to the adjusted advance time of the audio data playback; the second system - on - chip 621 is configured to: reduce the audio data playback speed of the second headset 620 synchronously with the first headset 610, and resume the normal audio data playback speed after the cache depth of the buffer of the second headset 620 reaches the cache depth corresponding to the adjusted advance time of the audio data playback. In the case of being interfered by the surrounding environment, the reception condition deteriorates. Based on the FT value, the advance time of the audio data playback decreases. During the process of adjusting the advance time of the audio data playback, the audio data playback speed can be reduced, so that the user can hear continuous music playback without stuttering, and at the same time, the cache depth becomes larger.

[0042] In some embodiments, the first system - on - chip 611 and the second system - on - chip 621 reduce the audio data playback speed by adjusting the sampling rate of their decoders. Through the fine - tuning process, the user can hardly perceive the change in sound. During the process of fine - tuning the sampling rate of the audio decoding (such as Codec Resample), the playback speed can be adjusted without the user's basic perception.

[0043] In some embodiments, the first system-on-chip 611 is further configured to: in the case of determining that the advance time of the audio data playback needs to be adjusted, send a synchronization adjustment request to the second earphone 620, where the synchronization adjustment request at least includes the adjusted advance time of the audio data playback; the second system-on-chip 621 is further configured to: in the case of receiving the synchronization adjustment request, determine whether the current buffer depth of the second earphone 620 is less than the buffer depth corresponding to the adjusted advance time of the audio data playback. If so, calculate an adjustment coefficient for the audio data playback speed based on the current buffer depth and the required adjusted advance time of the audio data playback, and adjust the audio data playback speed based on the adjustment coefficient, so that the buffer depth of the second earphone 620 reaches the buffer depth corresponding to the adjusted advance time of the audio data playback, and play the audio data at the same audio data playback moment as the first earphone 610. In this way, when the reception condition of any one earphone is poor, the other earphone can also maintain the same relatively small advance time as that earphone, so as to ensure that the two earphones play synchronously with a high playback quality and improve the user's listening experience. The cycle time for sending the synchronization adjustment request can be set according to the change of the interference in the surrounding environment, or can be set according to the packet reception time of a certain number of audio data packets.

[0044] In some embodiments, the first system-on-chip 611 and the second system-on-chip 621 periodically send second synchronization information to each other, where the second synchronization information at least includes the most recent audio data playback moment; when the first system-on-chip 611 or the second system-on-chip 621 receives the second synchronization information from the other party, adjust its own playback speed and the buffer depth of the audio data according to the later audio data playback moment. The first earphone and the second earphone can be synchronized every fixed time. The first earphone sends the second synchronization information to the second earphone, or the second earphone sends the second synchronization information to the first earphone, and the receiving party makes adjustments to ensure that the audio data is played at the later audio data playback moment. So that the first earphone and the second earphone can better maintain consistency during the process of playing the audio data.

[0045] In some embodiments, the first system-on-chip 611 is further configured to: when the second earphone 620 needs to join the audio playback during the audio playback of the first earphone 610, send a synchronization adjustment request to the second system-on-chip 621, where the synchronization adjustment request at least includes the advance time of the current audio data playback; the second system-on-chip 621 is further configured to: after receiving the synchronization adjustment request, adjust the depth of its own audio data buffer, and play the audio data synchronously with the first earphone 610 at the audio data playback moment corresponding to the advance time of the audio data playback. In the case of using only one earphone for playback, if another earphone needs to join for simultaneous playback, the second earphone increases the buffer depth after receiving the synchronization adjustment request from the first earphone, until it reaches the same buffer depth as the first earphone, and then plays the audio data synchronously with the first earphone according to the advance time, ensuring the consistency of the audio data playback between the first earphone and the second earphone and improving the user experience.

[0046] In some embodiments, the first system-on-chip 611 is further configured to: during a first period when starting to play audio data, determine whether there is buffered data in the buffer; if there is no buffered data in the buffer, reduce the advance amount, and play the audio data at the audio data playback moment corresponding to the advance time of the audio data playback. During the first period when starting to play audio data, check the buffered data situation in the buffer. If there is no buffered data, it may indicate that the audio reception condition is not good, and then the advance amount needs to be reduced and the playback speed needs to be slowed down until the audio data playback moment corresponding to the advance time of the audio data playback is reached.

[0047] Moreover, although exemplary embodiments have been described herein, the scope includes any and all embodiments based on the present application having equivalent elements, modifications, omissions, combinations (e.g., solutions that cross various embodiments), adaptations, or alterations. The elements in the claims will be broadly interpreted based on the language used in the claims and are not limited to the examples described in this specification or during the implementation of the present application, and the examples will be interpreted as non-exclusive. Therefore, this specification and the examples are intended to be considered only as examples, and the true scope and spirit are indicated by the following claims and the full scope of their equivalents.

[0048] The above description is intended to be illustrative and not restrictive. For example, the above examples (or one or more aspects thereof) may be used in combination with each other. For example, those of ordinary skill in the art may use other embodiments when reading the above description. Additionally, in the above detailed description, various features may be grouped together to simplify the present application. This should not be construed as an intention that a feature of the application not claimed is necessary for any claim. On the contrary, the subject matter of the present application may be less than all of the features of a particular embodiment of the application. Thus, the following claims are hereby incorporated into the detailed description as examples or embodiments, where each claim stands on its own as a separate embodiment, and it is contemplated that these embodiments may be combined with each other in various combinations or permutations. The scope of the present invention should be determined with reference to the appended claims and the full scope of equivalents to which those claims are entitled.

[0049] The above embodiments are only exemplary embodiments of the present application and are not used to limit the present invention. The protection scope of the present invention is defined by the claims. Those skilled in the art can make various modifications or equivalent replacements within the essence and protection scope of the present application, and such modifications or equivalent replacements should also be regarded as falling within the protection scope of the present invention.

Claims

1. A communication method for wireless earphones, the wireless earphones supporting the LE Audio mode and including a first earphone and a second earphone, characterized in that, The communication method includes that when both the first earphone and the second earphone play audio data in the LEAudio mode: The first earphone sets an initial advance time for audio data playback, and the first earphone and the second earphone synchronously play the respective received audio data packets at the audio data playback moment determined based on the FT value and the initial advance time for audio data playback, where the first earphone is any one of the two earphones, and the FT value is the audio data packet survival time set in the LEAudio mode and cannot be dynamically adjusted; wherein, the audio data playback moment is the moment corresponding to the difference between the moment corresponding to the FT value after the audio data is received and the advance time for audio data playback; The first earphone determines the reception status of audio data packets within a first time interval, and based on the reception status of the audio data packets, adjusts the advance time for audio data playback, so that when the reception status of the audio data packets is worse than a preset threshold, the advance time for audio data playback is reduced, and when the reception status of the audio data packets is equal to or better than the preset threshold and remains for a second time interval, the advance time for audio data playback is increased, and the first earphone and the second earphone synchronously play the respective received audio data packets at the audio data playback moment determined based on the FT value and the adjusted advance time for audio data playback.

2. The communication method according to claim 1, wherein Based on the reception status of the audio data packets, adjusting the advance time for audio data playback so that when the reception status of the audio data packets is worse than a preset threshold, the advance time for audio data playback is reduced, and when the reception status of the audio data packets is equal to or better than the preset threshold and remains for a second time interval, the advance time for audio data playback is increased further includes: When the reception status of the audio data packets is worse than the preset threshold and the advance time for audio data playback is greater than 0, reducing the advance time for audio data playback by a first step value; When the reception status of the audio data packets is equal to or better than the preset threshold and remains for a second time interval and the advance time for audio data playback is less than FT value - 1, increasing the advance time for audio data playback by a second step value.

3. The communication method according to claim 1, characterized in that The communication method further includes: the advance time for audio data playback is greater than or equal to 0 and less than or equal to FT value - 1.

4. The communication method according to claim 1, wherein The communication method further includes: When adjusting and reducing the advance time for audio data playback, synchronously reducing the audio data playback speed of the first earphone and the second earphone; After the buffer depths of the first earphone and the second earphone reach the buffer depths corresponding to the adjusted advance time for audio data playback, restoring the normal audio data playback speed.

5. The communication method according to claim 4, characterized in that, The communication method further includes: When the first earphone determines that the advance time for playing the audio data needs to be adjusted, the first earphone sends a synchronization adjustment request to the second earphone, and the synchronization adjustment request at least includes the adjusted advance time for playing the audio data; When the second earphone receives the synchronization adjustment request, it determines whether the current buffer depth of the second earphone is less than the buffer depth corresponding to the adjusted advance time for playing the audio data. If so, it calculates an adjustment coefficient for the audio data playback speed based on the current buffer depth and the required adjusted advance time for playing the audio data, and adjusts the audio data playback speed based on the adjustment coefficient so that the buffer depth of the second earphone reaches the buffer depth corresponding to the adjusted advance time for playing the audio data, and plays the audio data at the same audio data playback moment as the first earphone.

6. The communication method according to claim 4, wherein The communication method further includes: The first earphone and the second earphone periodically send second synchronization information to the other earphone, and the second synchronization information at least includes the most recent audio data playback moment; When the first earphone or the second earphone receives the second synchronization information sent by the other earphone, it adjusts its own playback speed and the buffer depth of the audio data according to the later audio data playback moment.

7. The communication method according to claim 1, wherein The communication method further includes: When the second earphone needs to join the audio playback during the audio playback of the first earphone, the first earphone sends a synchronization adjustment request to the second earphone, and the synchronization adjustment request at least includes the current advance time for playing the audio data; The second earphone adjusts its own audio data buffer depth and synchronizes with the first earphone to play the audio data at the audio data playback moment corresponding to the advance time for playing the audio data.

8. The communication method according to claim 1, characterized in that The communication method further includes: In the first period of starting to play the audio data, the first earphone determines whether there is buffered data in the buffer; If there is no buffered data in the buffer, the first earphone reduces the advance amount and slows down the playback speed until the audio data playback moment corresponding to the advance time for playing the audio data.

9. A wireless earphone, the wireless earphone comprising a first earphone and a second earphone, characterized in that, The first earphone includes a first system-on-chip, and the second earphone includes a second system-on-chip. When both the first earphone and the second earphone use the LE Audio mode to play the audio data, the first system-on-chip of the first earphone is configured to: Set an initial advance time for playing the audio data so that the first earphone and the second earphone synchronously play the respective received audio data packets at the audio data playback moment determined based on the FT value and the initial advance time for playing the audio data, where the FT value is the audio data packet survival time set in the LE Audio mode and cannot be dynamically adjusted; and the audio data playback moment is the moment corresponding to the difference between the moment corresponding to the FT value after the audio data is received and the advance time for playing the audio data; Determine the reception status of audio data packets within a first time interval, and based on the reception status of the audio data packets, adjust the advance time of the audio data playback, such that when the reception status of the audio data packets is worse than a preset threshold, the advance time of the audio data playback is decreased, and when the reception status of the audio data packets is equal to or better than the preset threshold and remains for a second time interval, the advance time of the audio data playback is increased, and such that the first earphone and the second earphone synchronously play the respective received audio data packets at the audio data playback moment determined based on the FT value and the adjusted advance time of the audio data playback.

10. The wireless earphone according to claim 9, wherein, The first system-on-chip is further configured to: When the reception status of the audio data packets is worse than the preset threshold and the advance time of the audio data playback is greater than 0, decrease the advance time of the audio data playback by a first step value; When the reception status of the audio data packets is equal to or better than the preset threshold and remains for the second time interval and the advance time of the audio data playback is less than FT value - 1, increase the advance time of the audio data playback by a first step value.

11. The wireless earphone according to claim 9, wherein, The advance time of the audio data playback is greater than or equal to 0 and less than or equal to FT value - 1.

12. The wireless earphone according to claim 9, characterized in that, When adjusting and causing the advance time of the audio data playback to decrease, The first system-on-chip is further configured to: reduce the audio data playback speed of the first earphone, and resume the normal audio data playback speed after the buffer depth of the first earphone reaches the buffer depth corresponding to the adjusted advance time of the audio data playback; The second system-on-chip is configured to: synchronously with the first earphone, reduce the audio data playback speed of the second earphone, and resume the normal audio data playback speed after the buffer depth of the second earphone reaches the buffer depth corresponding to the adjusted advance time of the audio data playback.

13. The wireless earphone according to claim 12, wherein The first system-on-chip and the second system-on-chip reduce the audio data playback speed by adjusting the sampling rate of their decoders.

14. The wireless earphone according to claim 12, characterized in that, The first system-on-chip is further configured to: when it is determined that the advance time of the audio data playback needs to be adjusted, send a synchronous adjustment request to the second earphone, and the synchronous adjustment request at least includes the adjusted advance time of the audio data playback; The second system-on-chip is further configured to: when receiving the synchronous adjustment request, determine whether the current buffer depth of the second earphone is less than the buffer depth corresponding to the adjusted advance time of the audio data playback, and if so, calculate an adjustment coefficient for the audio data playback speed based on the current buffer depth and the required adjustment of the advance time of the audio data playback, and adjust the audio data playback speed based on the adjustment coefficient, such that the buffer depth of the second earphone reaches the buffer depth corresponding to the adjusted advance time of the audio data playback, and play the audio data at the same audio data playback moment as the first earphone.

15. The wireless earphone according to claim 12, wherein, The first system-on-chip and the second system-on-chip periodically send second synchronization information to each other, and the second synchronization information at least includes the most recent audio data playback time; When the first system-on-chip or the second system-on-chip receives the second synchronization information from the other party, it adjusts its own playback speed and the cache depth of the audio data according to the later audio data playback time.

16. The wireless earphone according to claim 9, wherein The first system-on-chip is further configured to: when the second earphone needs to join the audio playback during the audio playback of the first earphone, send a synchronization adjustment request to the second system-on-chip, and the synchronization adjustment request at least includes the current advance time of the audio data playback; The second system-on-chip is further configured to: after receiving the synchronization adjustment request, adjust its own audio data cache depth, and synchronously play the audio data with the first earphone at the audio data playback time corresponding to the advance time of the audio data playback.

17. The wireless earphone according to claim 9, characterized in that, The first system-on-chip is further configured to: In the first period of starting the audio data playback, determine whether there is cached data in the buffer; If there is no cached data in the buffer, reduce the advance amount, and play the audio data at the audio data playback time corresponding to the advance time of the audio data playback.

Images