Audio data processing system, method, device, electronic device and storage medium

By determining the target time and time offset between multiple Bluetooth devices, the problem of audio data being out of sync when recording with Bluetooth headsets is solved, and more three-dimensional audio data recording is achieved.

CN114826474BActive Publication Date: 2025-02-18GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210470816.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-28
Publication Date
2025-02-18
Estimated Expiration
2042-04-28

AI Technical Summary

Technical Problem

In the prior art, when recording through multiple Bluetooth headphones, the recorded audio data is easily out of sync, resulting in the recorded audio data being not three-dimensional enough.

Method used

The first Bluetooth device performs a protocol with the plurality of second Bluetooth devices, determines a target time, and determines a time offset based on the target time, so as to achieve alignment of the audio data collected by the plurality of second Bluetooth devices.

Benefits of technology

The synchronization of the audio data collected by multiple second Bluetooth devices during mixing is realized, and the stereoscopicity of the recorded audio data is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114826474B_ABST
    Figure CN114826474B_ABST
Patent Text Reader

Abstract

The present application relates to an audio data processing system, method, device, electronic device and storage medium, and belongs to the field of terminal technology. The method includes: negotiating a target time with a first Bluetooth device; determining a time offset of the acquisition time of the acquired audio data relative to the target time; sending the audio data and the time offset to the first Bluetooth device, and the first Bluetooth device is connected to the second Bluetooth device via a Bluetooth communication link. Through this solution, the acquisition of audio data by multiple second Bluetooth devices is achieved, making the acquired audio data more three-dimensional.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to an audio data system, method, device, electronic device and storage medium. Background Art

[0002] With the development of terminal technology, the functions that terminals need to implement are increasing. Among them, many functions require the terminal to process audio data, for example, recording through the terminal. With the development of terminal technology, the research and development of terminal accessories is also constantly improving. For example, Bluetooth headsets have been widely used. Therefore, recording through Bluetooth headsets has become a common way to process audio data.

[0003] In the related art, in order to prevent the recorded audio data from being out of sync due to recording with multiple Bluetooth headsets, the terminal only interacts with one of the Bluetooth headsets when recording through the Bluetooth headset, resulting in the recorded audio data not being three-dimensional enough. Therefore, there is an urgent need for a method that can process audio data through multiple Bluetooth headsets to achieve recording. Summary of the invention

[0004] The embodiments of the present application provide an audio data processing system, method, device, electronic device and storage medium, which can realize the collection of audio data through multiple electronic devices. The technical solution is as follows:

[0005] In one aspect, an audio data processing system is provided, the audio data processing system comprising a first Bluetooth device and a plurality of second Bluetooth devices;

[0006] The first Bluetooth device is configured to:

[0007] In a case where the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, respectively negotiate with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of the plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices different from the first audio device;

[0008] The first audio device and the second audio device are respectively configured as:

[0009] A time offset between a current time and the target time is determined, and audio data is collected based on the time offset and the target time.

[0010] On the other hand, an audio data processing method is provided, which is applied to a second Bluetooth device, and the method includes:

[0011] Negotiate a target time with the first Bluetooth device;

[0012] Determine a time offset of a collection time of collected audio data relative to the target time;

[0013] The audio data and the time offset are sent to the first Bluetooth device, the first Bluetooth device being connected to the second Bluetooth device via a Bluetooth communication link.

[0014] On the other hand, an audio data processing method is provided, which is applied to a first Bluetooth device, and the method includes:

[0015] When the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, protocols are respectively negotiated with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of a plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices different from the first audio device.

[0016] In another aspect, a second Bluetooth device is provided, the second Bluetooth device comprising:

[0017] A first protocol module, used to negotiate a target time with a first Bluetooth device;

[0018] A determination module, used to determine a time offset of a collection time of collected audio data relative to the target time;

[0019] The sending module is used to send the audio data and the time offset to the first Bluetooth device, and the first Bluetooth device is connected to the second Bluetooth device via a Bluetooth communication link.

[0020] In another aspect, a first Bluetooth device is provided, the first Bluetooth device comprising:

[0021] A second protocol module is used to respectively negotiate with the first audio device and the second audio device to determine a target time when the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other; wherein the first audio device is any one of a plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices that is different from the first audio device.

[0022] On the other hand, an electronic device is provided, comprising a processor and a memory; the memory stores at least one program code, and the at least one program code is used to be executed by the processor to implement the audio data processing method as described in the above aspect.

[0023] On the other hand, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores at least one program code, and the at least one program code is used to be executed by a processor to implement the audio data processing method as described in the above aspects.

[0024] On the other hand, a computer program product is provided, wherein the computer program product stores at least one program code, and the at least one program code is used to be executed by a processor to implement the audio data processing method as described in the above aspect.

[0025] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 An audio data processing system according to an exemplary embodiment of the present application is shown;

[0027] Figure 2 A schematic diagram of determining a target time according to an exemplary embodiment of the present application is shown;

[0028] Figure 3 A schematic diagram showing a data packet of audio data shown in an exemplary embodiment of the present application;

[0029] Figure 4 A schematic diagram of the structure of a second Bluetooth device shown in an exemplary embodiment of the present application is shown;

[0030] Figure 5 A schematic diagram of the structure of a first Bluetooth device shown in an exemplary embodiment of the present application is shown;

[0031] Figure 6 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0032] Figure 7 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0033] Figure 8 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0034] Fig. 9 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0035] Fig.10 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0036] Fig.11 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0037] Fig.12 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0038] Fig.13 A structural block diagram of a second Bluetooth device shown in an exemplary embodiment of the present application is shown;

[0039] Fig.14 A structural block diagram of a first Bluetooth device shown in an exemplary embodiment of the present application is shown;

[0040] Fig.15 A structural block diagram of an electronic device shown in an exemplary embodiment of the present application is shown. DETAILED DESCRIPTION

[0041] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0042] The "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. The relevant data involved in the embodiments of the present application may be data authorized by the user or fully authorized by all parties.

[0043] Please refer to Figure 1, which shows an audio data processing system shown in an exemplary embodiment of the present application, the audio data processing system includes a first Bluetooth device 100 and multiple second Bluetooth devices 200; the first Bluetooth device 100 is configured to: when the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, respectively negotiate with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of the multiple second Bluetooth devices 200, and the second audio device is another one of the multiple second Bluetooth devices 200 that is different from the first audio device; the first audio device and the second audio device are respectively configured to: determine a time offset between a current time and the target time, and collect audio data based on the time offset and the target time.

[0044] The first Bluetooth device 100 is connected to each of the second Bluetooth devices 200 through a corresponding Bluetooth communication link. In some embodiments, each of the second Bluetooth devices 200 is configured to: collect audio data in response to an audio collection instruction; determine a time offset corresponding to the audio data, and send the audio data and the time offset to the first Bluetooth device 100; wherein the time offset corresponding to the audio data is a time offset of the collection time of the audio data relative to a target time, and the target time is a time agreed upon between the first Bluetooth device 100 and each of the second Bluetooth devices 200. In some embodiments, the first Bluetooth device 100 is configured to: synthesize audio data based on the audio data and the corresponding time offset respectively sent by each of the second Bluetooth devices 200.

[0045] In some embodiments, the above "protocol" process is performed according to the standard Low Energy Audio (LE Audio) protocol. During the protocol, the start time of the audio data collected by the first Bluetooth device and the second Bluetooth device can be set at the start position of the anchor point in the data frame, thereby aligning the time when the first Bluetooth device and the second Bluetooth device process the audio data, thereby simplifying the processing of the audio data.

[0046] Among them, the first Bluetooth device 100 and each second Bluetooth device 200 can be connected through a Bluetooth communication link. Accordingly, the first Bluetooth device 100 and the plurality of second Bluetooth devices 200 are respectively provided with Bluetooth chips. In some embodiments, the first Bluetooth device 100 is provided with a first Bluetooth chip, and the second Bluetooth device 200 is provided with a second Bluetooth chip. The first Bluetooth chip and the second Bluetooth chip are chips that support the Low Energy Audio (LE Audio) protocol. Accordingly, data is transmitted between the first Bluetooth device 100 and the second Bluetooth device 200 via a link of the LE Audio protocol.

[0047] The first Bluetooth device 100 may be a terminal device, for example, the first Bluetooth device may be at least one of a mobile phone, a tablet computer, a personal computer (PC), and the like. The second Bluetooth device 200 may be a wearable electronic device, for example, at least one of a headset, a watch, glasses, and the like. In some embodiments of the present application, the first audio device and the second audio device may be different audio source devices / units from the same electronic device, for example, the first audio device is a first microphone on a smart terminal, and the second audio device is a second microphone on the smart terminal. In other embodiments, the second audio device is another electronic device independent of the first audio device.

[0048] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device 100 respectively performs protocols with the first audio device and the second audio device to determine a target time, so that the first audio device and the second audio device can both determine a time offset with reference to the target time. In this way, the target time is used as a unified standard to align the audio data collected by the multiple second Bluetooth devices 200, so that the audio data collected by the multiple second Bluetooth devices 200 can be synchronized during mixing, thereby realizing the collection of audio data by the multiple second Bluetooth devices 200, making the collected audio data more three-dimensional.

[0049] In some embodiments, the first Bluetooth device 100 is configured to: determine a data transceiving cycle for data transceiving, and determine the target time based on the data transceiving cycle.

[0050] The second Bluetooth device 200 determines the target time based on the LE Audio ISO protocol. The LE Audio ISO protocol requires the first Bluetooth device 100 and the second Bluetooth device 200 to perform data transmission and reception at the beginning of a data transmission and reception cycle. After a data transmission and reception cycle ends, it is necessary to wait until the next data transmission and reception cycle to continue data transmission and reception. In some embodiments, see Figure 2 , the second Bluetooth device 200 determines the data transceiving cycle corresponding to the current time, and determines the start time of the data transceiving cycle as the target time. In some embodiments, the first Bluetooth device 100 determines the next data transceiving cycle corresponding to the current time, and determines the start time of the data transceiving cycle as the target time.

[0051] In some embodiments, the data transceiving cycle of the first Bluetooth device 100 and the first audio device and the second audio device in the plurality of second Bluetooth devices 200 is the same, then the first Bluetooth device determines the target time based on the same data transceiving cycle, and performs a protocol with the first audio device and the second audio device based on the target time. Accordingly, the data transceiving cycle is the data transceiving cycle of the first Bluetooth device 100, and the first Bluetooth device 100 is configured to: send a first protocol request to the first audio device and the second audio device, and the first protocol request is used to perform a protocol with the first audio device and the second audio device to notify the target time and the data transceiving cycle of the first Bluetooth device 100.

[0052] In some embodiments, the data transceiving cycles of the first Bluetooth device 100 and the first audio device and the second audio device in the plurality of second Bluetooth devices 200 are different, and the first Bluetooth device 100 can determine the target time according to its own data transceiving cycle, and then negotiate with the first audio device and the second audio device. This process is the same as the process principle of the first Bluetooth device 100 negotiating the target time with the first audio device and the second audio device based on the data transceiving cycle of the first Bluetooth device 100 when the data transceiving cycle of the first Bluetooth device 100 and the plurality of second Bluetooth devices 200 are the same, and will not be repeated here.

[0053] In some embodiments, the first Bluetooth device 100 further determines the target time according to the data transceiving cycle of the first audio device or the second audio device. Accordingly, the data transceiving cycle is the data transceiving cycle of the first audio device; the first audio device is configured to: send the data transceiving cycle of the first audio device to the first Bluetooth device 100; the first Bluetooth device 100 is configured to: receive the data transceiving cycle sent by the first audio device; determine the target time based on the data transceiving cycle; send a second protocol request to the first audio device and the second audio device, the second protocol request is used to negotiate with the first audio device and the second audio device to notify the target time.

[0054] It should be noted that the process of the first Bluetooth device 100 determining the target time based on the data transceiving cycle of the second audio device is the same as the process of the first Bluetooth device determining the target time for the data transceiving cycle based on the first audio device in principle, and will not be repeated here. In the case where the data transceiving cycles of the first Bluetooth device 100 and the plurality of second Bluetooth devices 200 are different, the first Bluetooth device 100 also respectively negotiates a common target data transceiving cycle with the plurality of second Bluetooth devices 200. Accordingly, the first Bluetooth device 100 is also configured to: determine the common target data transceiving cycle in the case where the data transceiving cycles of the first audio device and the second audio device are different; based on the second protocol request, the data transceiving cycles of the first audio device and the second audio device are respectively set to the common target data transceiving cycle. Accordingly, in some embodiments, the first Bluetooth device 100 uses the larger data transceiving cycle in different data transceiving cycles as the common target data transceiving cycle. In some embodiments, the first Bluetooth device 100 uses the smaller data transceiving cycle in different data transceiving cycles as the common target data transceiving cycle. In some embodiments, the first Bluetooth device 100 performs data transmission in a fixed data transceiving cycle, and accordingly, the fixed data transceiving cycle is used as the public target data transceiving cycle. In the embodiment of the present application, the manner in which the first Bluetooth device 100 determines the public target data transceiving cycle is not specifically limited.

[0055] In some embodiments, the target time can also be determined by the first audio device or the second audio device in the second Bluetooth device 200. Accordingly, the first audio device is configured to: determine the target time based on the data transceiver cycle of the first audio device; send a third protocol request to the first Bluetooth device and the second audio device based on the target time, and the third protocol request is used to negotiate with the first Bluetooth device and the second audio device to notify the target time. The process of determining the target time by other audio devices in the multiple second Bluetooth devices 200 is the same as the process of determining the target time by the first audio device, and will not be repeated here.

[0056] In some embodiments, the second Bluetooth device 200 is configured to determine the interruption time of the data transmission bus when collecting the audio data, and determine the interruption time as the collection time of the audio data; determine the difference between the collection time and the target time as the time offset.

[0057] In some embodiments, in response to the audio collection instruction, the second Bluetooth device 200 collects audio data in the current environment, encodes the collected audio data, and obtains the encoded audio data. Among them, the encoding method can be Low-Complexity Communication Codecs (LC3) encoding, etc. The second Bluetooth device 200 (the first audio device and the second audio device) sends the collected audio data to the first Bluetooth device 100 according to the LE synchronous channel (Isochronous Channels, ISO) protocol corresponding to LE Audio.

[0058] In some embodiments, the first Bluetooth device 100 is configured to receive audio data and time offset sent by the second Bluetooth device 200; decode the audio data; align the decoded audio data based on the time offset corresponding to each audio data; and synthesize multiple aligned audio data.

[0059] The first Bluetooth device 100 and the second Bluetooth device 200 can perform data transmission via a connection-oriented synchronous data stream (CIS), and the second Bluetooth device 200 sends the audio data to the first Bluetooth device 100 in the form of a CIS data packet. Correspondingly, the first Bluetooth device 100 receives the CIS data packet. Figure 3 , each CIS data packet includes at least one audio data frame.

[0060] The first Bluetooth device 100 decodes the audio data sent by multiple second Bluetooth devices 200, caches the decoded audio data locally, determines the actual playback time of each audio data based on the time offset and target time corresponding to each audio data, thereby aligning the multiple audio data, and then mixes the multiple decoded audio data to obtain synthesized audio data.

[0061] In the embodiment of the present application, the first Bluetooth device 100 aligns multiple audio data with the target time as a reference based on the time offset through the second audio processing module 101, so that the multiple audio data can be synchronized, ensuring the sound quality of the audio data mixed by the first Bluetooth device 100.

[0062] In some embodiments, the first Bluetooth device 100 collects audio through multiple second Bluetooth devices 200 to obtain different recordings, and when it is necessary to synchronize the audio data collected by the multiple second Bluetooth devices 200, the audio data collected by the multiple second Bluetooth devices 200 are synchronized. For example, the first Bluetooth device 100 receives an audio synchronization instruction, and synchronizes the audio data collected by the multiple second Bluetooth devices 200 based on the audio synchronization instruction.

[0063] Accordingly, in some embodiments, the first Bluetooth device 100 synchronizes multiple audio data based on the target time and time offset corresponding to the audio data sent by the multiple second Bluetooth devices 200. In some embodiments, after receiving the audio synchronization instruction, the first Bluetooth device 100 respectively negotiates a new target time with the multiple second Bluetooth devices 200, determines the time offset based on the new target time, and synchronizes. Accordingly, the multiple second Bluetooth devices 200 include a first audio device and a second audio device; the first audio device is configured to: determine the time offset of the collection time of the audio data relative to the target time based on the audio collection instruction from the first Bluetooth device 100; the second audio device is configured to: determine the time offset of the collection time of the audio data relative to the target time based on the audio collection instruction from the first Bluetooth device 100; the first Bluetooth device 100 is also configured to: in response to the audio synchronization instruction, negotiate a new target time with the first audio device and the second audio device; determine the time offset of the audio synchronization instruction relative to the new target time; synchronize multiple audio data based on the time offset of the audio data collected by the first audio device and the second audio device and the time offset determined based on the new target time.

[0064] In an embodiment of the present application, multiple second Bluetooth devices 200 can collect audio data separately. When the first Bluetooth device 100 needs to synchronize the audio data collected by the multiple second Bluetooth devices 200, it determines the time offset of the audio synchronization instruction based on the new target time corresponding to the audio synchronization instruction. Therefore, when merging the audio data, the audio data collected by different audio devices can be synchronized based on multiple time offsets. In this way, when the audio synchronization instruction is received, the multiple audio data are synchronized, so that the first Bluetooth device 100 can collect different audio data separately through the multiple second Bluetooth devices 200, enriching the scenarios for collecting audio data.

[0065] In some embodiments, the collection instructions of multiple second Bluetooth devices 200 are sent simultaneously by the first Bluetooth device 100. Accordingly, when the multiple second Bluetooth devices 200 determine the time offset, the time offset is determined based on the same target time. In this way, the first Bluetooth device 100 compares the time offset of the audio data sent by the multiple second Bluetooth devices 200 with the same target time, so as to align the multiple audio data. In some embodiments, the first Bluetooth device 100 sends audio collection instructions to the multiple second Bluetooth devices 200 one after another. In this case, the target time determined by the multiple second Bluetooth devices 200 is the start time corresponding to different data transceiver cycles. In this way, the first Bluetooth device 100 determines the alignment time points of the multiple audio data based on the corresponding data transceiver cycle and the corresponding offset of each second Bluetooth device 200, thereby aligning the multiple audio data.

[0066] When the second Bluetooth device 200 sends the audio data and the corresponding target time and the time offset relative to the target time to the first Bluetooth device 100, the target time is marked based on the corresponding data transceiving cycle, for example, a field corresponding to the data transceiving cycle is added to the target time. Accordingly, the first Bluetooth device 100 aligns the multiple audio data based on the data transceiving cycle and the time offset corresponding to the target time.

[0067] For example, the third audio device starts collecting audio data 1 in the Nth data transceiving cycle, and the collection time is t1, which is the time offset between the Nth data transceiving cycle and the fourth audio device starts collecting audio data 2 in the N+Mth data transceiving cycle, and the collection time is t2, which is the time offset between the N+Mth data transceiving cycle and the N+Mth data transceiving cycle. If the data collection cycle is T, the first Bluetooth device 100 aligns the start time of audio data 2 to the moment corresponding to M*T-t1+t2 after the start time of audio data 1, thereby aligning audio data 1 and audio data 2.

[0068] In an embodiment of the present application, by determining the data transceiver cycle corresponding to the collection time of audio collection by different second Bluetooth devices 200, the audio data sent by different second Bluetooth devices 200 are aligned based on the data transceiver cycle, so that multiple audio data can be measured with a unified time standard, so that the audio data collected by multiple second Bluetooth devices can be synchronized with the unified time standard during mixing. This prevents the audio data obtained by mixing from being out of sync due to different system times of different electronic devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizes the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0069] In some embodiments, if the data transceiving period of the protocol of the multiple second Bluetooth devices 200 is the same as that of the first Bluetooth device 100, the first Bluetooth device 100 can align the audio data sent by the multiple second Bluetooth devices 200 through the above process. In some embodiments, if the data transceiving period of the protocol of the multiple second Bluetooth devices 200 is different from that of the first Bluetooth device 100, the first Bluetooth device 100 respectively performs protocols with the multiple second Bluetooth devices 200 to obtain a common target data transceiving period, and synchronizes the audio data sent by different second Bluetooth devices 200 based on the common target data transceiving period.

[0070] Correspondingly, after establishing a Bluetooth communication connection with the first Bluetooth device 100, the first audio device and the second audio device first send the corresponding data transceiving cycle to the first Bluetooth device 100. When the first Bluetooth device 100 detects that the data transceiving cycle of the first audio device and the second audio device are different, the first Bluetooth device 100 determines a common target data transceiving cycle, and sends the common target data transceiving cycle to the first audio device and the second audio device, thereby unifying the data transceiving cycle of the first audio device and the second audio device, so as to measure the corresponding target times of the first audio device and the second audio device with a unified time standard, so as to ensure that the audio data collected by the first audio device and the second audio device can be synchronized.

[0071] In some embodiments, the first audio device and the second audio device establish corresponding Bluetooth communication links with the first Bluetooth device 100 at different times. In some embodiments, the first audio device and the second audio device establish corresponding Bluetooth communication links with the first Bluetooth device 100 at the same time. In the embodiments of the present application, this is not specifically limited.

[0072] In some embodiments, the first Bluetooth device 100 is further configured to receive audio data from the first audio device and the second audio device; determine a link delay for data transmission between the first Bluetooth device 100 and the first audio device and a link delay for data transmission between the first Bluetooth device 100 and the second audio device; align the audio data collected by the first audio device and the audio data collected by the second audio device based on the link delay and the time offset; and synthesize the aligned audio data.

[0073] The link delay is the time required for the audio data to be transmitted between the first Bluetooth device 100 and the second Bluetooth device 200. Accordingly, the first Bluetooth device 100 determines the delay of the audio data in the second Bluetooth device 200 based on the time offset, and calculates the delay of the second Bluetooth device 200 processing the audio data through the air interface receiving time point and the data transmission bus interruption time in the second Bluetooth device 200, and determines the sum of the delay of the audio data in the second Bluetooth device 200 and the delay of transmitting the audio data through the air interface as the link delay.

[0074] Since the audio data collected by the first Bluetooth device 100 does not generate the link delay, the first Bluetooth device 100 mixes the audio data collected by the first Bluetooth device 100 with the audio data collected by the second Bluetooth device 200 based on the link delay. The process of the first Bluetooth device 100 mixing the audio data collected by the first Bluetooth device 100 with the audio data collected by the second Bluetooth device 200 is the same as the principle of the process of the first Bluetooth device 100 mixing the audio data collected by the first audio device and the second audio device, which will not be repeated here.

[0075] In the embodiment of the present application, when the first Bluetooth device 100 mixes the audio data collected by the first Bluetooth device 100 and the audio data collected by the second Bluetooth device 200, the link delay caused by the transmission of the audio data between the first Bluetooth device 100 and the second Bluetooth device 200 is taken into account. This ensures that the audio data collected by the first Bluetooth device 100 and the second Bluetooth device 200 can be synchronized, thereby ensuring the quality of the audio data.

[0076] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0077] See also Figure 4 , which shows a structural block diagram of the second Bluetooth device 200 provided in an embodiment of the present application, see Figure 4, the second Bluetooth device 200 includes: a first audio acquisition module 201, a first audio processing module 202 and a first processing module 203. The first audio acquisition module 201 and the first audio processing module 202 perform data transmission via a data transmission bus, and the first audio processing module 202 and the first processing module 203 perform data transmission via inter-core communication. The first audio acquisition module 201, the first audio processing module 202 and the first processing module 203 can be integrated in the Bluetooth module of the second Bluetooth device 200.

[0078] The first audio acquisition module 201 is configured to collect audio data in response to an audio acquisition instruction, and send the audio data to the first audio processing module 202; the first audio processing module 202 is configured to receive the audio data, encode the audio data, and obtain the encoded audio data; send the encoded audio data to the first processing module 203; the first processing module 203 is configured to receive the encoded audio data, and send the encoded audio data to the second Bluetooth device 200.

[0079] When the audio collection instruction is received, the first audio collection module 201 is started. The first audio collection module 201 may be a CODEC encoder.

[0080] The first audio processing module 202 is configured to encode the audio data. The encoding method may be Low-Complexity Communication Codecs (LC3) encoding, etc. The first audio processing module 202 may be any type of audio processor, for example, the first audio processing module 202 may be an AudioDSP.

[0081] The first processing module 203 receives the encoded audio data, and sends the data to the first Bluetooth device 100 according to the LE Isochronous Channels (ISO) protocol corresponding to LE Audio. The first processing module 203 may be a BT controller.

[0082] The data transmission bus may be an integrated circuit built-in audio bus (Inter-IC Sound, I2S) bus, and the inter-core communication may be an inter-process communication (Inter-Process Communication, IPC) communication, etc.

[0083] In some embodiments, the first audio processing module 202 is configured to determine the interruption time of the data transmission bus when collecting the audio data, and determine the collection time of the audio data based on the interruption time; send the collection time to the first processing module 203; the first processing module 203 is configured to receive the collection time and determine the target time; determine the difference between the collection time and the target time as the time offset; and send the time offset to the first Bluetooth device 100.

[0084] It should be noted that the system time read from the interruption can be used as the collection time of the audio data in the data transmission cycle before the interruption occurs, or as the collection time of the audio data in the data transmission cycle after the interruption occurs. In the embodiment of the present application, this is not specifically limited.

[0085] Another point that needs to be explained is that, for the second Bluetooth device 200 that supports direct memory access (DMA), the first audio processing module 202 can also read the system time through DMA interruption. In the embodiment of the present application, the method for reading the system time is not specifically limited.

[0086] It should be noted that different processing systems correspond to different readable time information, therefore, the first processor is further configured to convert the time offset into a data format readable by the second Bluetooth device 200 .

[0087] Another point to be explained is that in different processing systems, the data transmission process between the processing modules may be different. For example, for the first Bluetooth device 100 provided with a host module (HOST), the first audio processing module 202 sends the audio data and the acquisition time to the HOST, and the HOST sends the audio data and the acquisition time to the first processing module 203.

[0088] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0089] See also Figure 5 , which shows a structural block diagram of the first Bluetooth device 100 provided in an embodiment of the present application, see Figure 5The first Bluetooth device 100 includes: a second audio processing module 101 and a second control module 102. The second audio processing module 101 and the second control module 102 perform data transmission via a data transmission bus. The second audio processing module 101 and the second control module 102 can be integrated in the Bluetooth module of the first Bluetooth device 100.

[0090] The second control module 102 is configured to receive the audio data and time offset sent by the second Bluetooth device 200; send the audio data and the time offset to the second audio processing module 101; the second audio processing module 101 is configured to receive the audio data and time offset sent by the second control module 102, and decode the audio data; align the decoded audio data based on the time offset corresponding to each decoded audio data; and synthesize multiple aligned audio data.

[0091] The second control module 102 and the first processing module 203 can be modules of the same type, which is not specifically limited in the embodiment of the present application.

[0092] The first processing module 203 and the second control module 102 can perform data transmission via a connection-oriented synchronous data stream (CIS), and the second Bluetooth device 200 sends the audio data and the time offset to the first Bluetooth device 100 in the form of a CIS data packet. Correspondingly, the first Bluetooth device 100 receives the CIS data packet via the second control module 102; the second control module 102 sends the audio data and the time offset in the CIS data packet to the second audio processing module 101 via the data transmission bus.

[0093] The second audio processing module 101 and the first audio processing module 202 can be modules of the same type, and this is not specifically limited in the embodiment of the present application. The second audio processing module 101 decodes the audio data sent by the plurality of second Bluetooth devices 200, caches the decoded audio data locally, determines the actual playback time of each audio data based on the time offset and target time corresponding to each audio data, thereby aligning the plurality of audio data, and then synthesizing the plurality of decoded audio data.

[0094] In the embodiment of the present application, the first Bluetooth device 100 aligns multiple audio data with the target time as a reference based on the time offset through the second audio processing module 101, so that the multiple audio data can be synchronized, ensuring the sound quality of the audio data mixed by the first Bluetooth device 100.

[0095] In some embodiments, the first Bluetooth device 100 further includes a second acquisition module 103. The second acquisition module 103 and the second audio processing module 101 perform data transmission via a data transmission bus.

[0096] The second acquisition module 103 is configured to perform signal conversion on the collected audio data to obtain audio data recognizable by the Bluetooth device, and send the audio data to the second audio processing module 101; the second control module 102 is configured to determine the link delay for data transmission between the first Bluetooth device 100 and the second Bluetooth device 200; send the link delay to the second audio processing module 101; the second audio processing module 101 is configured to align the audio data collected by the first Bluetooth device 100 and the audio data collected by the second Bluetooth device 200 based on the link delay, and synthesize the aligned audio data.

[0097] The second audio acquisition module 103 and the first audio acquisition module 201 may be modules of the same type, which is not specifically limited in the embodiment of the present application.

[0098] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0099] The audio data processing method involved in the embodiment of the present application can be applied in an independent audio data processing scenario; or, the audio data processing method involved in the present application can be applied in a video shooting scenario. In the embodiment of the present application, the audio data processing method can be applied in any scenario requiring audio data processing.

[0100] In the embodiment of the present application, the first Bluetooth device and the plurality of second Bluetooth devices are connected via a Bluetooth communication link, so that when collecting audio data, the first Bluetooth device can collect audio data through the plurality of second Bluetooth devices, so that the final audio data is more three-dimensional. Figure 6 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0101] Step S601: The second Bluetooth device negotiates a target time with the first Bluetooth device.

[0102] In some embodiments, the target time is the start time of the next data transceiving cycle adjacent to the data transceiving cycle where the current time is located. Alternatively, the target time is the time of the data transceiving cycle where the current time is located. The start time of the data transceiving cycle corresponds to the start position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data.

[0103] Prior to this step, the second Bluetooth device determines the target time for collecting audio data based on the audio collection instruction, and the target time is the start time of the data transceiver cycle of the protocol between the first Bluetooth device and each second Bluetooth device. The target time of the protocol between the second Bluetooth device and the first Bluetooth device can be triggered by the second Bluetooth device or by the first Bluetooth device, and is not specifically limited in the embodiment of the present application.

[0104] Among them, the audio acquisition instruction can be triggered by the first Bluetooth device, can be triggered by the second Bluetooth device itself, or can be triggered by other electronic devices. In the embodiments of the present application, this is not specifically limited. Accordingly, in some embodiments, the second Bluetooth device receives the audio acquisition instruction sent by the first Bluetooth device. The first Bluetooth device displays an audio acquisition interface through the audio acquisition interface. The audio acquisition option can be displayed in the audio acquisition interface. In response to the triggering operation of the audio acquisition option, the first Bluetooth device generates an audio acquisition instruction and sends the audio acquisition instruction to the second Bluetooth device connected to the currently established Bluetooth communication link. Alternatively, the audio acquisition interface can also display multiple second Bluetooth devices connected to the currently established Bluetooth communication link, and in response to a click operation on any second Bluetooth device, an audio acquisition instruction is sent to the second Bluetooth device.

[0105] In some embodiments, the second Bluetooth device receives an audio acquisition trigger operation, and generates an audio acquisition instruction based on the audio acquisition trigger operation. The second Bluetooth device can display an audio acquisition interface, and the user triggers the second Bluetooth device to perform audio acquisition through the audio acquisition interface displayed by the second Bluetooth device. For example, the second Bluetooth device is a watch, and the audio acquisition interface is displayed in the second Bluetooth device, and the user triggers the second Bluetooth device to perform audio acquisition through the audio acquisition interface. Alternatively, the second Bluetooth device is provided with a sensor, and the user triggers the second Bluetooth device to perform audio acquisition through the sensor. For example, the second Bluetooth device is a headset, and the headset is provided with a sensor. In response to the sensor sensing the user's continuous tapping action, the second Bluetooth device performs audio acquisition.

[0106] It should be noted that the first Bluetooth device may also initiate audio synchronization to the first audio device and the second audio device when receiving the audio synchronization instruction. Accordingly, in response to the audio synchronization instruction, the first Bluetooth device negotiates with the first audio device and the second audio device to determine the target time, and the target time is used by the first Bluetooth device to synchronize the audio data sent by the second audio device and the first audio device respectively.

[0107] In an embodiment of the present application, multiple second Bluetooth devices can collect audio data separately. The first Bluetooth device synchronizes the multiple audio data based on the target time only when it is necessary to synchronize the audio data collected by the multiple second Bluetooth devices. This allows the first Bluetooth device to collect different audio data separately through multiple second Bluetooth devices, enriching the scenarios for collecting audio data.

[0108] Another point to be explained is that, in the embodiment of the present application, the first Bluetooth device can negotiate the target time with at least one second Bluetooth device among the plurality of second Bluetooth devices. In the embodiment of the present application, this is not specifically limited.

[0109] Step S602: the second Bluetooth device determines a time offset of a collection time of collected audio data relative to the target time.

[0110] In this step, the second Bluetooth device determines the interruption time of the data transmission bus when collecting the audio data, and determines the collection time of the audio data based on the interruption time; determines the target time of the protocol; and determines the difference between the collection time and the target time as the time offset.

[0111] The data transmission bus transmits data periodically, and an interrupt occurs at the end of each data transmission cycle. Therefore, the second Bluetooth device can read the system time based on the interrupt of the data transmission bus, and the time is the collection time of the audio data. The second Bluetooth device adds time information before the data packet corresponding to the audio data, and the data packet includes at least one frame of audio data, and the time information includes the collection time.

[0112] It should be noted that the time read from the interruption can be used as the collection time of audio data in a data transmission cycle before the interruption occurs, or can be used as the collection time of audio data in a data transmission cycle after the interruption occurs. In the embodiment of the present application, this is not specifically limited.

[0113] Another point that needs to be explained is that for a second Bluetooth device that supports direct memory access (DMA), the system time can also be read through DMA interruption. In the embodiment of the present application, the method for reading the system time is not specifically limited.

[0114] Step S603: the second Bluetooth device sends the audio data and the time offset to the first Bluetooth device, and the first Bluetooth device is connected to the second Bluetooth device via a Bluetooth communication link.

[0115] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0116] Please refer to Figure 7 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0117] Step S701: a first Bluetooth device receives audio data and time offsets respectively sent by each second Bluetooth device, the second Bluetooth device being connected to the first Bluetooth device via a Bluetooth communication link.

[0118] In this step, the first Bluetooth device receives SCI data packets sent by multiple second Bluetooth devices, and reads audio data and time offset from the SCI data packets.

[0119] Step S702: the first Bluetooth device synthesizes audio data based on the audio data respectively sent by the second Bluetooth devices and the time offset corresponding to each audio data.

[0120] In this step, the first Bluetooth device decodes the received audio data; aligns the decoded audio data based on the time offset corresponding to each audio data; and synthesizes the aligned multiple audio data.

[0121] The first Bluetooth device decodes the audio data sent by multiple second Bluetooth devices, caches the decoded audio data locally, determines the actual playback time of each audio data based on the time offset and target time corresponding to each audio data, thereby aligning the multiple audio data, and then mixes the multiple decoded audio data.

[0122] In the embodiment of the present application, the first Bluetooth device aligns multiple audio data based on the target time based on the time offset, so that the multiple audio data can be synchronized, ensuring the sound quality of the audio data mixed by the first Bluetooth device.

[0123] In some embodiments, in response to an audio synchronization instruction, a first Bluetooth device negotiates with multiple second Bluetooth devices respectively to determine a target time; determines a time offset of the audio synchronization instruction relative to the target time; and synchronizes the audio data collected by the multiple second Bluetooth devices based on the time offset.

[0124] In an embodiment of the present application, multiple second Bluetooth devices can collect audio data separately. When the first Bluetooth device needs to synchronize the audio data collected by the multiple second Bluetooth devices, the first Bluetooth device determines the time offset of the audio synchronization instruction based on the target time corresponding to the audio synchronization instruction. Therefore, when merging the audio data, the audio data collected by the first audio device and the second audio device can be synchronized based on the time offsets corresponding to the first audio device and the second audio device in the second Bluetooth device respectively. In this way, when the audio synchronization instruction is received, the multiple audio data are synchronized, so that the first Bluetooth device can collect different audio data respectively through the multiple second Bluetooth devices, enriching the scenarios for collecting audio data.

[0125] In some embodiments, a first Bluetooth device receives target times of multiple second Bluetooth devices. If the target times of the multiple second Bluetooth devices do not match, the first Bluetooth device synthesizes the audio data respectively sent by the multiple second Bluetooth devices based on the data transmission and reception cycles and the corresponding time offsets corresponding to the target times of the multiple second Bluetooth devices.

[0126] In an embodiment of the present application, by determining the data transceiver cycle corresponding to the collection time of audio collection by different second Bluetooth devices, the audio data sent by different second Bluetooth devices are aligned based on the data transceiver cycle, so that multiple audio data can be measured with a unified time standard, so that the audio data collected by multiple second Bluetooth devices can be synchronized with the unified time standard during mixing. This prevents the audio data obtained by mixing from being out of sync due to different system times of different electronic devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizes the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0127] In some embodiments, a first Bluetooth device receives data transceiving cycles sent by multiple second Bluetooth devices. When the data transceiving cycles of the multiple second Bluetooth devices are different, the first Bluetooth device respectively negotiates with the multiple second Bluetooth devices to determine a common target data transceiving cycle. The common target data transceiving cycle is used to respectively determine the target time of the multiple second Bluetooth devices, thereby determining the time offset for the multiple second Bluetooth devices to collect audio data.

[0128] In an embodiment of the present application, the first Bluetooth device determines a common target data transceiving cycle, thereby unifying the data transceiving cycles of multiple second Bluetooth devices, so that the target times corresponding to the multiple second Bluetooth devices are measured with a unified time standard to ensure that the audio data collected by the multiple second Bluetooth devices can be synchronized.

[0129] In some embodiments, the first Bluetooth device itself can also collect audio data. Accordingly, the first Bluetooth device collects audio data, determines the link delay for data transmission between the first Bluetooth device and the first audio device and the link delay for data transmission between the first Bluetooth device and the second audio device; based on the link delay and the time offset sent by the first audio device and the second audio device, aligns the audio data collected by the first Bluetooth device, the first audio device and the second audio device; and synthesizes the aligned audio data.

[0130] The link delay is the time required for data to be transmitted between the first Bluetooth device and the second Bluetooth device. Accordingly, the first Bluetooth device determines the delay of the audio data in the second Bluetooth device based on the time offset, and calculates the delay of the second Bluetooth device processing the audio data through the air interface receiving time point and the data transmission bus interruption time in the second Bluetooth device, and determines the sum of the delay of the audio data in the second Bluetooth device and the delay of transmitting the audio data through the air interface as the link delay.

[0131] Since the audio data collected by the first Bluetooth device will not generate the link delay, the first Bluetooth device can align the audio data collected by the first Bluetooth device and the second Bluetooth device based on the link delay, thereby mixing the audio data collected by the first Bluetooth device and the second Bluetooth device. The process of the first Bluetooth device mixing the audio data collected by the first Bluetooth device and the second Bluetooth device is the same as the process of the first Bluetooth device mixing the audio data collected by multiple second Bluetooth devices, which will not be repeated here.

[0132] One point that needs to be explained is that the first Bluetooth device can also mix the audio data collected by the first Bluetooth device and the audio data collected by multiple second Bluetooth devices based on the target time, time offset and link delay. The mixing process is the same as the principle of the process of the first Bluetooth device mixing the audio data collected by multiple second Bluetooth devices, which will not be repeated here.

[0133] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0134] The following describes the process of the first audio device protocol target time in the first Bluetooth device and the second Bluetooth device as an example.

[0135] Please refer to Figure 8 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0136] Step S801: When the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, the first Bluetooth device negotiates with the first audio device and the second audio device respectively to determine a target time.

[0137] Wherein, the first audio device is any one of a plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices that is different from the first audio device. The second Bluetooth device is a device that establishes a Bluetooth connection with the first Bluetooth device. In some embodiments, the first Bluetooth device is a terminal device, and the first audio device and the second audio device are wearable devices. In some embodiments, the first audio device and the second audio device establish corresponding Bluetooth communication links with the first Bluetooth device at different times. In some embodiments, the first audio device and the second audio device simultaneously establish corresponding Bluetooth communication links with the first Bluetooth device. In the embodiments of the present application, this is not specifically limited.

[0138] In some embodiments, the first audio device and the second audio device collect audio data based on the audio collection instruction. When the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device sends a synchronization instruction to the first audio device and the second audio device, and determines the target time based on the synchronization instruction and the agreement with the first audio device and the second audio device. In some embodiments, when collecting audio data, the first audio device and the second audio device send the collected audio data to the first Bluetooth device. The first Bluetooth device determines whether the audio data collected by the first audio device and the second audio device are synchronized based on the audio data sent by the first audio device and the second audio device. If they are not synchronized, the target time is agreed with the first audio device and the second audio device.

[0139] In some embodiments, the target time is the start time of the next data transceiving cycle adjacent to the data transceiving cycle where the current time is located, wherein the start time of the data transceiving cycle corresponds to the start position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data.

[0140] Prior to this step, the second Bluetooth device determines the target time for collecting audio data based on the audio collection instruction, and the target time is the start time of the data transmission and reception cycle of the protocol between the first Bluetooth device and each second Bluetooth device. The audio collection instruction can be triggered by the first Bluetooth device, the second Bluetooth device itself, or other electronic devices. In the embodiment of the present application, this is not specifically limited.

[0141] Accordingly, in some embodiments, the second Bluetooth device receives the audio acquisition instruction sent by the first Bluetooth device. The first Bluetooth device displays an audio acquisition interface through the audio acquisition interface. The audio acquisition option can be displayed in the audio acquisition interface. In response to the triggering operation of the audio acquisition option, the first Bluetooth device generates an audio acquisition instruction and sends the audio acquisition instruction to the second Bluetooth device connected to the current established Bluetooth communication link. Alternatively, the audio acquisition interface can also display multiple second Bluetooth devices connected to the current established Bluetooth communication link, and in response to a click operation on any second Bluetooth device, an audio acquisition instruction is sent to the second Bluetooth device.

[0142] In some embodiments, the second Bluetooth device receives an audio acquisition trigger operation, and generates an audio acquisition instruction based on the audio acquisition trigger operation. The second Bluetooth device can display an audio acquisition interface, and the user triggers the second Bluetooth device to perform audio acquisition through the audio acquisition interface displayed by the second Bluetooth device. For example, the second Bluetooth device is a watch, and the audio acquisition interface is displayed in the second Bluetooth device, and the user triggers the second Bluetooth device to perform audio acquisition through the audio acquisition interface. Alternatively, the second Bluetooth device is provided with a sensor, and the user triggers the second Bluetooth device to perform audio acquisition through the sensor. For example, the second Bluetooth device is a headset, and the headset is provided with a sensor. In response to the sensor sensing the user's continuous tapping action, the second Bluetooth device performs audio acquisition.

[0143] In some embodiments, the first Bluetooth device also collects audio data, and when synthesizing audio data, the audio data collected by the first Bluetooth device, the first audio device, and the second audio device are synthesized. Accordingly, the first Bluetooth device receives audio data from the first audio device and the second audio device; determines the link delay for data transmission between the first Bluetooth device and the first audio device and the link delay for data transmission between the first Bluetooth device and the second audio device; aligns the audio data collected by the first audio device and the audio data collected by the second audio device based on the link delay; and synthesizes the aligned audio data.

[0144] It should be noted that the first Bluetooth device may also initiate audio synchronization to the first audio device and the second audio device when receiving the audio synchronization instruction. Accordingly, in response to the audio synchronization instruction, the first Bluetooth device negotiates with the first audio device and the second audio device to determine the target time, and the target time is used by the first Bluetooth device to synchronize the audio data sent by the second audio device and the first audio device respectively.

[0145] In an embodiment of the present application, multiple second Bluetooth devices can collect audio data separately. The first Bluetooth device synchronizes the multiple audio data based on the target time only when it is necessary to synchronize the audio data collected by the multiple second Bluetooth devices. This allows the first Bluetooth device to collect different audio data separately through multiple second Bluetooth devices, enriching the scenarios for collecting audio data.

[0146] Another point to be explained is that, in the embodiment of the present application, the first Bluetooth device can negotiate the target time with more Bluetooth devices than the first audio device and the second audio device, or, when the first Bluetooth device also collects audio data, the first Bluetooth device can negotiate the target time with any second Bluetooth device among multiple second Bluetooth devices. In the embodiment of the present application, this is not specifically limited.

[0147] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0148] Please refer to Fig. 9 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0149] Step S901: the first Bluetooth device determines a data transmission / reception cycle for data transmission / reception, and determines the target time based on the data transmission / reception cycle.

[0150] In some embodiments, the data transceiving cycle is the data transceiving cycle of the first Bluetooth device, and the first Bluetooth device determines the target time based on the data transceiving cycle of the first Bluetooth device. In some embodiments, the data transceiving cycle is the data transceiving cycle of the first audio device or the second audio device. The first electronic device obtains the data transceiving cycle of the first audio device or the second audio device, and the first electronic device determines the target time based on the data transceiving cycle of the first audio device or the second audio device.

[0151] In some embodiments, the first Bluetooth device determines the target time based on the LE Audio ISO protocol. The LE Audio ISO protocol requires the first Bluetooth device and the second Bluetooth device to perform data transmission and reception at the beginning of a data transmission and reception cycle, and after a data transmission and reception cycle ends, it is necessary to wait until the next data transmission and reception cycle to continue data transmission and reception.

[0152] Step S902: When the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, the first Bluetooth device negotiates with the first audio device and the second audio device respectively to determine the target time.

[0153] The principle of this step is the same as that of step S801 and will not be repeated here.

[0154] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0155] In some embodiments, the data transceiving cycle is the data transceiving cycle of the first Bluetooth device, and the first Bluetooth device determines the target time based on the data transceiving cycle of the first Bluetooth device and the protocols with the first audio device and the second audio device. Fig.10 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0156] Step S1001: The first Bluetooth device determines the target time based on the data transceiving cycle of the first Bluetooth device.

[0157] In some embodiments, the target time is the start time of the next data transceiving cycle adjacent to the data transceiving cycle where the current time is located. Accordingly, the first Bluetooth device determines the data transceiving cycle where the current time is located, and determines the start time of the next data transceiving cycle adjacent to the data transceiving cycle as the target time. The start time of the data transceiving cycle corresponds to the starting position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data. Therefore, when the first audio device and the second audio device send audio data, the same time is used as the starting position of the anchor point in the audio data frame, which ensures the consistency of the start time of the sent audio data, thereby ensuring that the audio data can be synchronized.

[0158] Step S1002: the first Bluetooth device sends a first protocol request to the first audio device and the second audio device, where the first protocol request is used to negotiate with the first audio device and the second audio device to notify the target time and the data transceiving cycle of the first Bluetooth device.

[0159] The first Bluetooth device generates a first protocol request based on the target time, and sends the first protocol request to the first audio device and the second audio device respectively. After receiving the first protocol request, the first audio device and the second audio device respectively determine the target time based on the first protocol request, and collect audio data based on the target time.

[0160] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0161] In some embodiments, the data transceiving cycle is the data transceiving cycle of the first audio device, and the first Bluetooth device determines the target time based on the data transceiving cycle of the first audio device and the protocols with the first audio device and the second audio device. Fig.11 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0162] Step S1101: the first Bluetooth device receives the data transceiving cycle of the first audio device sent by the first audio device.

[0163] The first audio device may send the data transceiving cycle of the first audio device to the first Bluetooth device when establishing a connection with the first Bluetooth device. After receiving the data transceiving cycle sent by the first audio device, the first Bluetooth device stores the data transceiving cycle locally, and calls the data transceiving cycle of the first audio device when determining the target time. In some embodiments, the first Bluetooth device sends a synchronization instruction to the first audio device, and the first audio device sends the data transceiving cycle of the first audio device to the first Bluetooth device based on the synchronization instruction.

[0164] In some embodiments, the first Bluetooth device receives the data transceiving cycle sent by the first audio device and the second audio device, and the first Bluetooth device is based on the common target data transceiving cycle of the first audio device and the second audio device. When the data cycles of the first audio device and the second audio device are the same, the first Bluetooth device determines the same data transceiving cycle as the common target data transceiving cycle. When the data transceiving cycles of the first audio device and the second audio device are different, in some embodiments, the first Bluetooth device uses the larger data transceiving cycle in the different data transceiving cycles as the common target data transceiving cycle. In some embodiments, the first Bluetooth device uses the smaller data transceiving cycle in the different data transceiving cycles as the common target data transceiving cycle. In some embodiments, the first Bluetooth device transmits data with a fixed data transceiving cycle, and accordingly, the fixed data transceiving cycle is used as the common target data transceiving cycle. In the embodiment of the present application, the manner in which the first Bluetooth device determines the common target data transceiving cycle is not specifically limited.

[0165] Step S1102: the first Bluetooth device determines the target time based on the data transceiving cycle of the first audio device.

[0166] The principle of this step is the same as that of step S1001 and will not be repeated here.

[0167] Step S1103: the first Bluetooth device sends a second protocol request to the first audio device and the second audio device, where the second protocol request is used to negotiate with the first audio device and the second audio device to notify the target time.

[0168] The principle of this step is the same as that of step S1002 and will not be repeated here.

[0169] It should be noted that the first Bluetooth device can also determine the target time based on the data transceiving cycle of any audio device among the multiple second Bluetooth devices. This process is the same as the principle of the first Bluetooth device determining the target time based on the data transceiving cycle of the first audio device, and will not be repeated here.

[0170] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0171] In some embodiments, the first Bluetooth device may also receive a protocol request from the first audio device to negotiate the target time with the first audio device and the second audio device. Fig.12 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0172] Step S1201: the first Bluetooth device receives a third protocol request sent by the first audio device, where the third protocol request is used to negotiate with the first Bluetooth device and the second audio device to notify the target time.

[0173] The principle of this step is the same as that of step S1002 and will not be repeated here.

[0174] The principle of determining the target time by audio data is the same as the principle of determining the target time by the first Bluetooth device, which will not be repeated here.

[0175] It should be noted that the first audio device also sends a third protocol request to the second audio device, thereby negotiating the target time with the second audio device. This process is the same as the principle of step S1002 and will not be repeated here.

[0176] It should be noted that any audio device among the plurality of second Bluetooth devices can negotiate the target time with the first Bluetooth device. In some embodiments, before this step, the first Bluetooth device negotiates with the plurality of second Bluetooth devices to determine the audio device of the target time. In some embodiments, the first Bluetooth device displays a Bluetooth connection interface, in which a plurality of second Bluetooth devices are displayed, and the first Bluetooth device determines the audio device used to determine the target time from the plurality of second Bluetooth devices based on the user's selection operation.

[0177] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0178] Please refer to Fig.13 , which shows a structural block diagram of a second Bluetooth device provided by an embodiment of the present application. The second Bluetooth device can be implemented as all or part of the processor through software, hardware, or a combination of both. The device includes:

[0179] The first protocol module 1301 is used to negotiate a target time with a first Bluetooth device;

[0180] A first determining module 1302 is used to determine a time offset of a collection time of collected audio data relative to the target time;

[0181] The sending module 1303 is used to send the audio data and the time offset to the first Bluetooth device, and the first Bluetooth device is connected to the second Bluetooth device through a Bluetooth communication link.

[0182] In some embodiments, the first determining module 1302 includes:

[0183] A first determining unit, used to determine an interruption time of a data transmission bus when collecting the audio data, and determine a collection time of the audio data based on the interruption time;

[0184] The second determining unit is configured to determine a difference between the acquisition time and the target time as the time offset.

[0185] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0186] Please refer to Fig.14 , which shows a structural block diagram of a first Bluetooth device provided by an embodiment of the present application. The first Bluetooth device can be implemented as all or part of a processor through software, hardware, or a combination of both. The device includes:

[0187] The second protocol module 1401 is used to respectively negotiate with the first audio device and the second audio device to determine a target time when the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other; wherein the first audio device is any one of a plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices different from the first audio device.

[0188] In some embodiments, the apparatus further comprises:

[0189] The second determination module is used to determine a data transmission and reception cycle for data transmission and reception, and determine the target time based on the data transmission and reception cycle.

[0190] In some embodiments, the second determination module includes:

[0191] The third determining unit is used to determine the start time of the next data transceiving cycle adjacent to the data transceiving cycle where the current time is located as the target time; or determine the start time of the data transceiving cycle where the current time is located as the target time.

[0192] In some embodiments, the start time of the data transceiving cycle corresponds to the start position of an anchor point in an audio data frame, and the audio data frame is any data frame that transmits the audio data.

[0193] In some embodiments, the apparatus further comprises:

[0194] A decoding module, used for decoding the audio data sent by the first audio device and the second audio device;

[0195] An alignment module, used for aligning the decoded audio data based on the time offset corresponding to each audio data;

[0196] The synthesis module is used to synthesize the aligned multiple audio data.

[0197] In some embodiments, the apparatus further comprises:

[0198] A third determination module, used to determine a link delay for data transmission between the first Bluetooth device and the first audio device and a link delay for data transmission between the first Bluetooth device and the second audio device;

[0199] The alignment module is used to align the audio data collected by the first Bluetooth device, the first audio device and the second audio device based on the link delay and the time offset sent by the first audio device and the second audio device;

[0200] The synthesis module is used to synthesize the aligned audio data.

[0201] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device can both determine the time offset with reference to the target time, thereby using the target time as a unified standard to align the audio data collected by multiple second Bluetooth devices, so that the audio data collected by the multiple second Bluetooth devices can be synchronized during mixing, thereby realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0202] In the embodiment of the present application, the first Bluetooth device and the second Bluetooth device may include other components in addition to the modules involved in the above embodiments. Fig.15 , which shows a structural block diagram of an electronic device provided by an exemplary embodiment of the present application. The structural block diagram can be a structural block diagram of a first Bluetooth device, or a structural block diagram of a second Bluetooth device. The electronic device 1500 includes one or more of the following components: a processor 1510, a memory 1520, and a Bluetooth module 1530.

[0203] In some embodiments, the processor 1510 may include one or more processing cores. The processor 1510 uses various interfaces and lines to connect various parts within the entire electronic device 1500, and executes various functions and processes data of the electronic device 1500 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1520, and calling data stored in the memory 1520. Optionally, the processor 1510 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1510 can integrate one or more combinations of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a neural network processor (Neural-network Processing Unit, NPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the NPU is used to implement artificial intelligence (Artificial Intelligence, AI) functions; and the modem is used to process wireless communications. It is understandable that the above-mentioned modem may not be integrated into the processor 1510, but may be implemented by a separate chip.

[0204] In some embodiments, the memory 1520 includes a random access memory (RAM) and may also include a read-only memory (ROM). Optionally, the memory 1520 includes a non-transitory computer-readable storage medium. The memory 1520 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 1520 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc.; the data storage area may store data (such as audio data, a phone book), etc., created according to the use of the electronic device 1500.

[0205] In some embodiments, the Bluetooth module 1530 includes the above-mentioned first audio acquisition module 201, the first audio processing module 202 and the first processing module 203, so that the second Bluetooth device performs the function of audio acquisition; or, the Bluetooth module 1530 includes the above-mentioned second audio processing module 101 and the second control module 102, so as to achieve mixing of multiple audio data.

[0206] In some embodiments, the electronic device 1500 further includes a display screen. The display screen is a display component for displaying a user interface. Optionally, the display screen is a display screen with a touch function, through which the user can use any suitable object such as a finger or a stylus to perform touch operations on the display screen. The display screen is usually arranged on the front panel of the electronic device 1500. The display screen can be designed as a full screen, a curved screen, a special-shaped screen, a double-sided screen or a folding screen. The display screen can also be designed as a combination of a full screen and a curved screen, a combination of a special-shaped screen and a curved screen, etc., which is not limited in this embodiment.

[0207] In addition, those skilled in the art can understand that the structure of the electronic device 1500 shown in the above drawings does not constitute a limitation on the electronic device 1500, and the electronic device 1500 may include more or fewer components than shown, or combine certain components, or arrange the components differently. For example, the electronic device 1500 also includes a microphone, a speaker, a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (Wireless Fidelity, Wi-Fi) module, a power supply and other components, which will not be described in detail here.

[0208] An embodiment of the present application also provides a computer-readable medium, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the audio data processing method shown in the above embodiments.

[0209] An embodiment of the present application also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the audio data processing method shown in the above embodiments.

[0210] Those skilled in the art should be aware that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented with hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein the communication media include any media that facilitates the transmission of a computer program from one place to another. The storage medium can be any available medium that a general or special-purpose computer can access.

[0211] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. An audio data processing method, characterized in that: Applied to a second Bluetooth device, the method comprises: Negotiate a target time with the first Bluetooth device; Determine a time offset of a collection time of collected audio data relative to the target time, wherein the time offset is a difference between the collection time and the target time; The audio data and the time offset are sent to the first Bluetooth device, the first Bluetooth device being connected to the second Bluetooth device via a Bluetooth communication link.

2. The method according to claim 1, characterized in that The determining of the time offset of the acquisition time of the acquired audio data relative to the target time includes: Determine the interruption time of the data transmission bus when collecting the audio data, determine the interruption time as the collection time of the audio data, the interruption time is the system time read when the data transmission bus is interrupted at the end of the data transmission cycle, and the data transmission cycle is the period of data transmission by the data transmission bus; The difference between the acquisition time and the target time is determined as the time offset.

3. An audio data processing method, characterized in that: Applied to a first Bluetooth device, the method includes: In the case where the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, determining a data transceiving cycle for data transceiving, and determining the start time of the next data transceiving cycle adjacent to the data transceiving cycle where the current time is located as the target time; or determining the start time of the data transceiving cycle where the current time is located as the target time; Respectively negotiate with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of a plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices different from the first audio device.

4. The method according to claim 3, characterized in that The start time of the data transceiving cycle corresponds to the start position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data.

5. The method according to claim 3, characterized in that: The method further comprises: Decoding the audio data sent by the first audio device and the second audio device; Aligning the decoded audio data based on the time offset corresponding to each audio data; Synthesize multiple aligned audio data.

6. The method according to claim 3, characterized in that The method further comprises: Determine a link delay for data transmission between the first Bluetooth device and the first audio device and a link delay for data transmission between the first Bluetooth device and the second audio device; Aligning the audio data collected by the first Bluetooth device, the first audio device, and the second audio device based on the link delay and the time offset sent by the first audio device and the second audio device; Synthesize the aligned audio data.

7. An audio data processing system, characterized in that: The audio data processing system includes a first Bluetooth device and a plurality of second Bluetooth devices; The first Bluetooth device is configured to: In a case where the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, respectively negotiate with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of the plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices different from the first audio device; The first audio device and the second audio device are respectively configured as: A time offset between the current time and the target time is determined, and audio data is collected based on the time offset and the target time, wherein the time offset is a difference between the current time and the target time.

8. The audio data processing system according to claim 7, characterized in that: The first Bluetooth device is configured as: A data transmission and reception cycle for data transmission and reception is determined, and a start time of a next data transmission and reception cycle adjacent to the data transmission and reception cycle where the current time is located is determined as a target time.

9. The audio data processing system according to claim 8, characterized in that: The data transceiving cycle is the data transceiving cycle of the first Bluetooth device, and the first Bluetooth device is configured as follows: A first protocol request is sent to the first audio device and the second audio device, where the first protocol request is used to negotiate with the first audio device and the second audio device to notify the target time and the data transceiving cycle of the first Bluetooth device.

10. The audio data processing system according to claim 8, characterized in that: The data transceiving cycle is the data transceiving cycle of the first audio device; The first audio device is configured as: Sending a data transceiver cycle of the first audio device to the first Bluetooth device; The first Bluetooth device is configured to: receiving a data transceiver cycle sent by the first audio device; Determining the target time based on the data transceiving cycle; A second protocol request is sent to the first audio device and the second audio device, where the second protocol request is used to negotiate with the first audio device and the second audio device to notify the target time.

11. The audio data processing system according to claim 10, characterized in that: The first Bluetooth device is further configured to: In a case where the data transceiving cycles of the first audio device and the second audio device are different, determining a common target data transceiving cycle; Based on the second protocol request, the data transceiving periods of the first audio device and the second audio device are respectively set as the common target data transceiving period.

12. The data processing system according to claim 7, characterized in that: The first audio device is configured to: Determining the target time based on a data transceiving cycle of the first audio device; A third protocol request is sent to the first Bluetooth device and the second audio device based on the target time, where the third protocol request is used to negotiate with the first Bluetooth device and the second audio device to notify the target time.

13. The audio data processing system according to claim 7, characterized in that: Each of the second Bluetooth devices is respectively configured as: Determine the interruption time of the data transmission bus when collecting the audio data, determine the interruption time as the collection time of the audio data, the interruption time is the system time read when the data transmission bus is interrupted at the end of a data transmission cycle, and the data transmission cycle is the cycle of the data transmission bus transmitting data; determine the difference between the collection time and the target time as the time offset.

14. The audio data processing system according to claim 7, characterized in that: The first Bluetooth device is configured as: Based on the time offset corresponding to the audio data sent by each second Bluetooth device, the decoded audio data are aligned; and the aligned audio data are synthesized.

15. The audio data processing system according to claim 7, characterized in that: The first Bluetooth device is also configured to: receiving audio data from the first audio device and the second audio device; Determine a link delay for data transmission between the first Bluetooth device and the first audio device and a link delay for data transmission between the first Bluetooth device and the second audio device; Based on the link delay and the time offset, aligning the audio data collected by the first audio device with the audio data collected by the second audio device; Synthesize the aligned audio data.

16. The audio data processing system according to claim 7, characterized in that: The start time of the data transceiving cycle corresponds to the start position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data.

17. The audio data processing system according to claim 7, characterized in that: The first audio device and the second audio device establish corresponding Bluetooth communication links with the first Bluetooth device at different times respectively.

18. The audio data processing system according to any one of claims 7 to 17, characterized in that: The first Bluetooth device is a terminal device, and the second Bluetooth device is a wearable device.

19. A second Bluetooth device, characterized in that: The second Bluetooth device comprises: A first protocol module, used to negotiate a target time with a first Bluetooth device; A determination module, used to determine a time offset of a collection time of collected audio data relative to the target time, wherein the time offset is a difference between the collection time and the target time; The sending module is used to send the audio data and the time offset to the first Bluetooth device, and the first Bluetooth device is connected to the second Bluetooth device via a Bluetooth communication link.

20. A first Bluetooth device, characterized in that: The first Bluetooth device comprises: The second protocol module is used to determine the data transmission and reception cycle for data transmission and reception when the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, and determine the start time of the next data transmission and reception cycle adjacent to the data transmission and reception cycle where the current time is located as the target time; or determine the start time of the data transmission and reception cycle where the current time is located as the target time; and respectively negotiate with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of a plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices that is different from the first audio device.

21. An electronic device, characterized in that: The electronic device includes a processor and a memory; the memory stores at least one program code, and the at least one program code is used to be executed by the processor to implement the audio data processing method as described in any one of claims 1 to 2; or, the at least one program code is used to be executed by the processor to implement the audio data processing method as described in any one of claims 3 to 6.

22. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one program code, and the at least one program code is used to be executed by the processor to implement the audio data processing method as described in any one of claims 1 to 2; or, the at least one program code is used to be executed by the processor to implement the audio data processing method as described in any one of claims 3 to 6.

Citation Information

Patent Citations

  • Recording method and device, wireless earphone and storage medium

    CN113542479A