Audio data processing system, method, device, electronic device and storage medium

Abstract

The present application relates to an audio data processing system, method, device, electronic device and storage medium, and belongs to the field of terminal technology. The system includes: a first Bluetooth device and multiple second Bluetooth devices; the first Bluetooth device is configured to: when the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, respectively negotiate with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of the multiple second Bluetooth devices, and the second audio device is another one of the multiple second Bluetooth devices that is different from the first audio device; the first audio device and the second audio device are respectively configured to: start collecting audio data at the target time. Through this solution, the collection of audio data by multiple second Bluetooth devices is realized, making the collected audio data more three-dimensional.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to an audio data processing system, method, device, electronic device and storage medium. Background Art

[0002] With the development of terminal technology, the functions that terminals need to implement are increasing. Among them, many functions require the terminal to process audio data, for example, recording through the terminal. With the development of terminal technology, the research and development of terminal accessories is also constantly improving. For example, Bluetooth headsets have been widely used. Therefore, recording through Bluetooth headsets has become a common way to process audio data.

[0003] In the related art, in order to prevent the recorded audio data from being out of sync due to recording with multiple Bluetooth headsets, the terminal only interacts with one of the Bluetooth headsets when recording through the Bluetooth headset, resulting in the recorded audio data not being three-dimensional enough. Therefore, there is an urgent need for a method that can process audio data through multiple Bluetooth headsets to achieve recording. Summary of the invention

[0004] The embodiments of the present application provide an audio data processing system, method, device, electronic device and storage medium, which can realize the collection of audio data through multiple electronic devices. The technical solution is as follows:

[0005] In one aspect, an audio data processing system is provided, the audio data processing system comprising a first Bluetooth device and a plurality of second Bluetooth devices;

[0006] The first Bluetooth device is configured to:

[0007] In a case where the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, respectively negotiate with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of the plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices different from the first audio device;

[0008] The first audio device and the second audio device are respectively configured as:

[0009] The audio data collection starts at the target time.

[0010] On the other hand, an audio data processing method is provided, which is applied to a first Bluetooth device, and the method includes:

[0011] In the case that the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, protocols are respectively performed with the first audio device and the second audio device to determine the target time.

[0012] In another aspect, a first Bluetooth device is provided, the first Bluetooth device comprising:

[0013] The protocol module is used to respectively negotiate with the first audio device and the second audio device to determine the target time when the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other.

[0014] On the other hand, a Bluetooth device is provided, comprising a processor and a memory; the memory stores at least one program code, and the at least one program code is used to be executed by the processor to implement the audio data processing method as described in the above aspects.

[0015] On the other hand, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores at least one program code, and the at least one program code is used to be executed by a processor to implement the audio data processing method as described in the above aspects.

[0016] On the other hand, a computer program product is provided, wherein the computer program product stores at least one program code, and the at least one program code is used to be executed by a processor to implement the audio data processing method as described in the above aspect.

[0017] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device respectively performs protocols with the first audio device and the second audio device to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the system time of different Bluetooth devices from being different, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 An audio data processing system according to an exemplary embodiment of the present application is shown;

[0019] Figure 2 A schematic diagram of determining a target time according to an exemplary embodiment of the present application is shown;

[0020] Figure 3A schematic diagram of a data packet of audio data shown in an exemplary embodiment of the present application is shown;

[0021] Figure 4 A schematic diagram of the structure of a second Bluetooth device shown in an exemplary embodiment of the present application is shown;

[0022] Figure 5 A schematic diagram of the structure of a first Bluetooth device shown in an exemplary embodiment of the present application is shown;

[0023] Figure 6 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0024] Figure 7 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0025] Figure 8 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0026] Fig. 9 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0027] Fig.10 A flowchart of an audio data processing method according to an exemplary embodiment of the present application is shown;

[0028] Fig.11 A structural block diagram of a first Bluetooth device shown in an exemplary embodiment of the present application is shown;

[0029] Fig.12 A structural block diagram of an electronic device shown in an exemplary embodiment of the present application is shown. DETAILED DESCRIPTION

[0030] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0031] The "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. The relevant data involved in the embodiments of the present application may be data authorized by the user or fully authorized by all parties.

[0032] Please refer to Figure 1, which shows an audio data processing system shown in an exemplary embodiment of the present application, the audio data processing system includes a first Bluetooth device 100 and multiple second Bluetooth devices 200; the first Bluetooth device 100 is configured to: when the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, respectively negotiate with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of the multiple second Bluetooth devices 200, and the second audio device is another one of the multiple second Bluetooth devices 200 different from the first audio device; the first audio device and the second audio device are respectively configured to: start collecting audio data at the target time.

[0033] In some embodiments, the above "protocol" process is performed according to the standard Low Energy Audio (LE Audio) protocol. During the protocol, the start time of the audio data collected by the first Bluetooth device and the second Bluetooth device can be set at the start position of the anchor point in the data frame, thereby aligning the time when the first Bluetooth device and the second Bluetooth device process the audio data, thereby simplifying the processing of the audio data.

[0034] Among them, the first Bluetooth device 100 and each second Bluetooth device 200 can be connected through a Bluetooth communication link. Accordingly, the first Bluetooth device 100 and the plurality of second Bluetooth devices 200 are respectively provided with a Bluetooth chip. In some embodiments, the first Bluetooth device 100 is provided with a first Bluetooth chip, and the second Bluetooth device 200 is provided with a second Bluetooth chip. The first Bluetooth chip and the second Bluetooth chip are chips that support the LE Audio protocol. Accordingly, data is transmitted between the first Bluetooth device 100 and the second Bluetooth device 200 via a link of the LE Audio protocol.

[0035] The first Bluetooth device 100 may be a terminal device, for example, the first Bluetooth device may be at least one of a mobile phone, a tablet computer, a personal computer (PC), and the like. The second Bluetooth device 200 may be a wearable electronic device, for example, at least one of a headset, a watch, glasses, and the like. In some embodiments of the present application, the first audio device and the second audio device may be different audio source devices / units from the same electronic device, for example, the first audio device is a first microphone on a smart terminal, and the second audio device is a second microphone on the smart terminal. In other embodiments, the second audio device is another electronic device independent of the first audio device.

[0036] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device 100 respectively performs protocols with the first audio device and the second audio device to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the time asynchrony of the audio data caused by the different system times of different Bluetooth devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices 200, making the collected audio data more three-dimensional.

[0037] In some embodiments, the first Bluetooth device 100 is configured to: determine a data transceiving cycle for data transceiving, and determine the target time based on the data transceiving cycle.

[0038] The first Bluetooth device 100 is configured to determine a data transceiving cycle in which data is currently being transceived, and determine a start time of a next data transceiving cycle adjacent to the data transceiving cycle as the target time.

[0039] The first Bluetooth device 100 determines the target time based on the LE Audio ISO protocol. The LE Audio ISO protocol requires the first Bluetooth device 100 and the second Bluetooth device 200 to perform data transmission and reception at the beginning of a data transmission and reception cycle. After a data transmission and reception cycle ends, it is necessary to wait until the next data transmission and reception cycle to continue data transmission and reception. Figure 2 , the first Bluetooth device 100 determines the next data transceiving cycle corresponding to the current time, and determines the start time of the data transceiving cycle as the target time.

[0040] In some embodiments, the data transceiving cycle of the first Bluetooth device 100 and the first audio device and the second audio device in the plurality of second Bluetooth devices 200 is the same, then the first Bluetooth device determines the target time based on the same data transceiving cycle, and performs a protocol with the first audio device and the second audio device based on the target time. Accordingly, the data transceiving cycle is the data transceiving cycle of the first Bluetooth device 100, and the first Bluetooth device 100 is configured to: send a first protocol request to the first audio device and the second audio device, and the first protocol request is used to perform a protocol with the first audio device and the second audio device to notify the target time and the data transceiving cycle of the first Bluetooth device 100.

[0041] In some embodiments, the data transceiving cycles of the first Bluetooth device 100 and the first audio device and the second audio device in the plurality of second Bluetooth devices 200 are different, and the first Bluetooth device 100 can determine the target time according to its own data transceiving cycle, and then negotiate with the first audio device and the second audio device. This process is the same as the process principle of the first Bluetooth device 100 negotiating the target time with the first audio device and the second audio device based on the data transceiving cycle of the first Bluetooth device 100 when the data transceiving cycle of the first Bluetooth device 100 and the plurality of second Bluetooth devices 200 are the same, and will not be repeated here.

[0042] In some embodiments, the first Bluetooth device 100 further determines the target time according to the data transceiving cycle of the first audio device or the second audio device. Accordingly, the data transceiving cycle is the data transceiving cycle of the first audio device; the first audio device is configured to: send the data transceiving cycle of the first audio device to the first Bluetooth device 100; the first Bluetooth device 100 is configured to: receive the data transceiving cycle sent by the first audio device; determine the target time based on the data transceiving cycle; send a second protocol request to the first audio device and the second audio device, the second protocol request is used to negotiate with the first audio device and the second audio device to notify the target time.

[0043] It should be noted that the process of the first Bluetooth device 100 determining the target time based on the data transceiving cycle of the second audio device is the same as the process of the first Bluetooth device determining the target time for the data transceiving cycle based on the first audio device in principle, and will not be repeated here. In the case where the data transceiving cycles of the first Bluetooth device 100 and the plurality of second Bluetooth devices 200 are different, the first Bluetooth device 100 also respectively negotiates a common target data transceiving cycle with the plurality of second Bluetooth devices 200. Accordingly, the first Bluetooth device 100 is also configured to: determine the common target data transceiving cycle in the case where the data transceiving cycles of the first audio device and the second audio device are different; based on the second protocol request, the data transceiving cycles of the first audio device and the second audio device are respectively set to the common target data transceiving cycle. Accordingly, in some embodiments, the first Bluetooth device 100 uses the larger data transceiving cycle in different data transceiving cycles as the common target data transceiving cycle. In some embodiments, the first Bluetooth device 100 uses the smaller data transceiving cycle in different data transceiving cycles as the common target data transceiving cycle. In some embodiments, the first Bluetooth device 100 performs data transmission in a fixed data transceiving cycle, and accordingly, the fixed data transceiving cycle is used as the public target data transceiving cycle. In the embodiment of the present application, the manner in which the first Bluetooth device 100 determines the public target data transceiving cycle is not specifically limited.

[0044] In some embodiments, the target time can also be determined by the first audio device or the second audio device in the second Bluetooth device 200. Accordingly, the first audio device is configured to: determine the target time based on the data transceiver cycle of the first audio device; send a third protocol request to the first Bluetooth device and the second audio device based on the target time, and the third protocol request is used to negotiate with the first Bluetooth device and the second audio device to notify the target time. The process of determining the target time by other audio devices in the multiple second Bluetooth devices 200 is the same as the process of determining the target time by the first audio device, and will not be repeated here.

[0045] In some embodiments, the first Bluetooth device 100 collects audio through multiple second Bluetooth devices 200 respectively to obtain different audio data, and packages the audio data collected by different second Bluetooth devices 200 into data corresponding to the second Bluetooth device. In some embodiments, when it is necessary to synchronize the audio data collected by multiple second Bluetooth devices 200, the first Bluetooth device 100 synchronizes the audio data collected by the multiple second Bluetooth devices 200. For example, the first Bluetooth device 100 receives an audio synchronization instruction, and synchronizes the audio data collected by the multiple second Bluetooth devices 200 based on the audio synchronization instruction.

[0046] Accordingly, in some embodiments, the first Bluetooth device 100 synchronizes the multiple audio data based on the target time corresponding to the audio data sent by the multiple second Bluetooth devices 200. In some embodiments, after receiving the audio synchronization instruction, the first Bluetooth device 100 respectively negotiates the target time with the multiple second Bluetooth devices 200 and synchronizes based on the target time.

[0047] In an embodiment of the present application, multiple second Bluetooth devices 200 can collect audio data separately. The first Bluetooth device 100 negotiates the target time with the multiple second Bluetooth devices 200 only when it is necessary to synchronize the audio data collected by the multiple second Bluetooth devices 200, and synchronizes the multiple audio data based on the target time, so that the first Bluetooth device can collect different audio data separately through the multiple second Bluetooth devices 200, enriching the scenarios for collecting audio data.

[0048] In some embodiments, the target time determined by the multiple second Bluetooth devices 200 is the start time corresponding to the same data transceiver cycle. In this way, the first Bluetooth device 100 aligns the starting ends of the first audio data sent by the multiple second Bluetooth devices 200, thereby realizing the alignment of the audio data sent by the multiple second Bluetooth devices. In some embodiments, the multiple second Bluetooth devices 200 establish Bluetooth link connections with the first Bluetooth device 100 at different times, so that the first Bluetooth device 100 successively sends audio collection instructions to the multiple second Bluetooth devices 200. In this case, the target time for the multiple second Bluetooth devices 200 to perform audio collection is the start time corresponding to different data transceiver cycles. In this way, the first Bluetooth device 100 determines the alignment time points of multiple audio data based on the data transceiver cycle corresponding to each second Bluetooth device 200, thereby aligning the multiple audio data.

[0049] When the second Bluetooth device 200 sends audio data and the corresponding target time to the first Bluetooth device 100, the target time is marked based on the corresponding data transceiving cycle, for example, a field corresponding to the data transceiving cycle is added to the target time. Accordingly, the first Bluetooth device 100 aligns multiple audio data based on the data transceiving cycle corresponding to the target time.

[0050] For example, the first audio device starts collecting audio data 1 at the start time of the Nth data transmission and reception cycle, and the second audio device starts collecting audio data 2 at the start time of the N+Mth data transmission and reception cycle. If the data collection cycle is T, the first Bluetooth device 100 aligns the start time of audio data 2 to the moment corresponding to M*T after the start time of audio data 1, thereby aligning audio data 1 and audio data 2.

[0051] In an embodiment of the present application, by determining the data transceiver cycle corresponding to the target time for audio collection by different second Bluetooth devices 200, the audio data sent by different second Bluetooth devices 200 are aligned based on the data transceiver cycle, so that multiple audio data can be measured with a unified time standard, so that the audio data collected by multiple second Bluetooth devices 200 can be synchronized with the unified time standard during mixing. This prevents the audio data obtained by mixing from being out of sync due to different system times of different electronic devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices 200, making the collected audio data more three-dimensional.

[0052] Correspondingly, the first audio device transmits data with the first Bluetooth device 100 based on the first data transceiving cycle; the second audio device transmits data with the first Bluetooth device 100 based on the second data transceiving cycle; the first Bluetooth device 100 is also configured to: when the first data transceiving cycle and the second data transceiving cycle are different, respectively negotiate with the first audio device and the second audio device to determine a common target data transceiving cycle, and the common target data transceiving cycle is used to synchronize the audio data sent by the first audio device and the second audio device.

[0053] Correspondingly, after establishing a Bluetooth communication connection with the first Bluetooth device 100, the first audio device and the second audio device first send the corresponding data transceiving cycle to the first Bluetooth device 100. When the first Bluetooth device 100 detects that the data transceiving cycle of the first audio device and the second audio device are different, the first Bluetooth device 100 determines a common target data transceiving cycle, and sends the common target data transceiving cycle to the first audio device and the second audio device, thereby unifying the data transceiving cycle of the first audio device and the second audio device, so as to measure the corresponding target times of the first audio device and the second audio device with a unified time standard, so as to ensure that the audio data collected by the first audio device and the second audio device can be synchronized.

[0054] In some embodiments, the first audio device and the second audio device establish corresponding Bluetooth communication links with the first Bluetooth device 100 at different times. In some embodiments, the first audio device and the second audio device establish corresponding Bluetooth communication links with the first Bluetooth device 100 at the same time. In the embodiments of the present application, this is not specifically limited.

[0055] In response to the current time reaching the target time, the second Bluetooth device 200 collects audio data in the current environment, encodes the audio data, and obtains the encoded audio data. The encoding method can be Low-Complexity Communication Codecs (LC3) encoding, etc. The second Bluetooth device 200 sends the encoded audio data to the first Bluetooth device 100 according to the LE Isochronous Channels (ISO) protocol corresponding to LEAudio. In some embodiments, the first Bluetooth device 100 is configured to receive the audio data sent by the second Bluetooth device 200; decode the audio data; align the decoded audio data based on the target time corresponding to each audio data; and generate the second audio data based on the aligned multiple audio data.

[0056] The first Bluetooth device 100 and the second Bluetooth device 200 can perform data transmission via a connection-oriented synchronous data stream (CIS), and the second Bluetooth device 200 sends the audio data to the first Bluetooth device 100 in the form of a CIS data packet. Correspondingly, the first Bluetooth device 100 receives the CIS data packet. Figure 3 , each CIS data packet includes at least one audio data frame. In some embodiments, the start time of the data transceiver cycle corresponds to the start position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data.

[0057] The first Bluetooth device 100 decodes the audio data sent by the plurality of second Bluetooth devices 200, caches the decoded audio data locally, determines the actual playback time of each audio data based on the target time corresponding to each audio data, thereby aligning the plurality of audio data, and then mixes the plurality of decoded audio data to obtain mixed audio data. The mixing method may be any mixing method, and the mixing method is not specifically limited in the embodiment of the present application.

[0058] In the embodiment of the present application, the first Bluetooth device 100 aligns the audio data sent by multiple second Bluetooth devices 200 based on the target time, so that the multiple audio data can be synchronized, ensuring the sound quality of the audio data mixed by the first Bluetooth device 100.

[0059] In some embodiments, the first Bluetooth device 100 is also configured to determine the target time in response to the audio collection instruction; collect audio data in response to the system time of the first Bluetooth device 100 reaching the target time; determine the link delay for data transmission between the first Bluetooth device 100 and the second Bluetooth device 200; align the audio data with the mixed audio data based on the link delay; and generate audio data based on the aligned audio data and the mixed audio data.

[0060] In some embodiments, the first Bluetooth device 100 further synthesizes the audio data collected by the first audio device, the second audio device, and the first Bluetooth device 100. Accordingly, the first Bluetooth device 100 is further configured to: receive audio data from the first audio device and the second audio device; determine the link delay for data transmission between the first Bluetooth device 100 and the first audio device and the link delay for data transmission between the first Bluetooth device 100 and the second audio device; align the audio data collected by the first audio device and the audio data collected by the second audio device based on the link delay; and synthesize the aligned audio data.

[0061] The link delay is the time required for the audio data to be transmitted between the first Bluetooth device 100 and the second Bluetooth device 200. Accordingly, the first Bluetooth device 100 determines the delay of the audio data in the second Bluetooth device 200 based on the target time, determines the delay of the second Bluetooth device 200 processing the audio data through the air interface receiving time point and the data transmission bus interruption time in the second Bluetooth device 200, and determines the sum of the delay of the audio data in the second Bluetooth device 200 and the delay of transmitting the audio data through the air interface as the link delay.

[0062] Since the link delay will not be generated when collecting audio data through the first Bluetooth device 100, the first Bluetooth device 100 mixes the audio data collected by the first Bluetooth device 100 with the audio data collected by the second Bluetooth device 200 based on the link delay. The process of the first Bluetooth device 100 mixing the audio data collected by the first audio data with the audio data collected by the second Bluetooth device 200 is the same as the principle of the first Bluetooth device 100 mixing the audio data collected by the first audio device and the second audio device, which will not be repeated here.

[0063] In the embodiment of the present application, when the first Bluetooth device 100 mixes the audio data collected by the first Bluetooth device 100 and the audio data collected by the second Bluetooth device 200, the link delay caused by the transmission of the audio data between the first Bluetooth device 100 and the second Bluetooth device 200 is taken into account. This ensures that the audio data collected by the first Bluetooth device 100 and the second Bluetooth device 200 can be synchronized, thereby ensuring the quality of the audio data.

[0064] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device respectively performs protocols with the first audio device and the second audio device to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the system time of different Bluetooth devices from being different, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0065] See also Figure 4 , which shows a structural block diagram of the second Bluetooth device 200 provided in an embodiment of the present application, see Figure 4The second Bluetooth device 200 includes: a first audio acquisition module 201, a first audio processing module 202 and a first control module 203. The first audio acquisition module 201 and the first audio processing module 202 perform data transmission via a data transmission bus, and the first audio acquisition module 201 and the first control module 203 perform data transmission via inter-core communication. The first audio acquisition module 201, the first audio processing module 202 and the first control module 203 can be integrated in the Bluetooth module of the second Bluetooth device 200.

[0066] Among them, the first audio acquisition module 201 is configured to determine the target time in response to the audio acquisition instruction; in response to the system time of the second Bluetooth device 200 reaching the target time, collect audio data and send the audio data to the first audio processing module 202; the first audio processing module 202 is configured to receive the audio data, encode the audio data, and obtain the first audio data.

[0067] The first audio acquisition module 201 may be a CODEC encoder, which is used to perform signal conversion on the collected audio data. The first audio acquisition module 201 determines the target time based on the LE Audio ISO protocol.

[0068] The first audio processing module 202 is configured to encode the audio data. The encoding method may be Low-Complexity Communication Codecs (LC3) encoding, etc. The first audio processing module 202 may be any type of audio processor, for example, the first audio processing module 202 may be an AudioDSP.

[0069] The first audio processing module 202 sends the audio data and the target time to the first control module 203. The first control module 203 receives the first audio data and sends the data to the first Bluetooth device 100 according to the LE Isochronous Channels (ISO) protocol corresponding to LE Audio. The first control module 203 may be a BT controller.

[0070] The data transmission bus may be an integrated circuit built-in audio bus (Inter-IC Sound, I2S) bus, and the inter-core communication may be an inter-process communication (Inter-Process Communication, IPC) communication, etc.

[0071] It should be noted that the process of determining the target time can also be implemented by the first control module 203. Accordingly, the first control module 203 detects the current system time, and in response to the system time reaching the target time, sends a collection instruction to the first audio collection module 201. The first audio collection module 201 collects audio data based on the collection instruction. Among them, the principle of determining the target time by the first control module 203 is the same as the principle of determining the target time by the first audio collection module 201, which will not be repeated here.

[0072] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device respectively performs protocols with the first audio device and the second audio device to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the system time of different Bluetooth devices from being different, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0073] See also Figure 5 , which shows a structural block diagram of the first Bluetooth device 100 provided in an embodiment of the present application, see Figure 5 The first Bluetooth device 100 includes: a second audio processing module 101 and a second control module 102. The second audio processing module 101 and the second control module 102 perform data transmission via a data transmission bus. The second audio processing module 101 and the second control module 102 can be integrated in the Bluetooth module of the first Bluetooth device 100.

[0074] The second control module 102 is configured to receive the audio data sent by the second Bluetooth device 200; send the audio data to the second audio processing module 101; the second audio processing module 101 is configured to receive the audio data sent by the second control module 102 and decode the audio data; align the decoded audio data based on the target time corresponding to each audio data of the protocol; and synthesize multiple aligned audio data.

[0075] The second control module 102 and the first control module 203 can be modules of the same type, which is not specifically limited in the embodiment of the present application.

[0076] Among them, the first control module 203 and the second control module 102 can perform data transmission through a connection-oriented synchronous data stream (Connected Isochronous Stream, CIS), and the second Bluetooth device 200 sends the audio data to the first Bluetooth device 100 in the form of a CIS data packet. Correspondingly, the first Bluetooth device 100 receives the CIS data packet through the second control module 102; the second control module 102 sends the audio data in the CIS data packet to the second audio processing module 101 through the data transmission bus. The second audio processing module 101 and the first audio processing module 202 can be modules of the same type, and this is not specifically limited in the embodiment of the present application.

[0077] In the embodiment of the present application, the first Bluetooth device 100 aligns multiple audio data based on the target time through the second audio processing module 101, so that the multiple audio data can be synchronized, ensuring the sound quality of the audio data mixed by the first Bluetooth device 100.

[0078] In some embodiments, the first Bluetooth device 100 also includes a second audio acquisition module 103; the second audio acquisition module 103 and the second audio processing module 101 perform data transmission through a data transmission bus; the second audio acquisition module 103 is configured to collect audio data in response to the system time of the first Bluetooth device 100 reaching the target time, and send the audio data to the second audio processing module 101; the second control module 102 is configured to determine the link delay for data transmission between the first Bluetooth device 100 and the second Bluetooth device 200; send the link delay to the second audio processing module 101; the second audio processing module 101 is configured to align the audio data collected by the first Bluetooth device 100 and the second audio data collected by the second Bluetooth device 200 based on the link delay, and synthesize the aligned audio data.

[0079] The second audio acquisition module 103 and the first audio acquisition module 201 can be the same type of module, which is not specifically limited in the embodiment of the present application. The second audio acquisition module 103 performs audio acquisition upon receiving an audio acquisition instruction and caches the acquired audio data locally.

[0080] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device respectively performs protocols with the first audio device and the second audio device to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the system time of different Bluetooth devices from being different, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0081] The audio data processing method involved in the embodiment of the present application can be applied in an independent audio data processing scenario; or, the audio data processing method involved in the present application can be applied in a video shooting scenario. In the embodiment of the present application, the audio data processing method can be applied in any scenario requiring audio data processing.

[0082] In the embodiment of the present application, the first Bluetooth device and the plurality of second Bluetooth devices are connected via a Bluetooth communication link, so that when collecting audio data, the first Bluetooth device can collect audio data through the plurality of second Bluetooth devices, so that the final audio data is more three-dimensional. Figure 6 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0083] Step S601: When the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, the first Bluetooth device negotiates with the first audio device and the second audio device respectively to determine a target time.

[0084] Wherein, the first audio device is any one of a plurality of second Bluetooth devices, and the second audio device is another one of the plurality of second Bluetooth devices that is different from the first audio device. The second Bluetooth device is a device that establishes a Bluetooth connection with the first Bluetooth device. In some embodiments, the first Bluetooth device is a terminal device, and the first audio device and the second audio device are wearable devices. In some embodiments, the first audio device and the second audio device establish corresponding Bluetooth communication links with the first Bluetooth device at different times. In some embodiments, the first audio device and the second audio device simultaneously establish corresponding Bluetooth communication links with the first Bluetooth device. In the embodiments of the present application, this is not specifically limited.

[0085] In some embodiments, the first audio device and the second audio device collect audio data based on the audio collection instruction. When the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device sends a synchronization instruction to the first audio device and the second audio device, and determines the target time based on the synchronization instruction and the agreement with the first audio device and the second audio device. In some embodiments, when collecting audio data, the first audio device and the second audio device send the collected audio data to the first Bluetooth device. The first Bluetooth device determines whether the audio data collected by the first audio device and the second audio device are synchronized based on the audio data sent by the first audio device and the second audio device. If they are not synchronized, the target time is agreed with the first audio device and the second audio device.

[0086] In some embodiments, the target time is the start time of the next data transceiving cycle adjacent to the data transceiving cycle where the current time is located, wherein the start time of the data transceiving cycle corresponds to the start position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data.

[0087] Prior to this step, the second Bluetooth device determines the target time for collecting audio data based on the audio collection instruction, and the target time is the start time of the data transmission and reception cycle of the protocol between the first Bluetooth device and each second Bluetooth device. The audio collection instruction can be triggered by the first Bluetooth device, the second Bluetooth device itself, or other electronic devices. In the embodiment of the present application, this is not specifically limited.

[0088] Accordingly, in some embodiments, the second Bluetooth device receives the audio acquisition instruction sent by the first Bluetooth device. The first Bluetooth device displays an audio acquisition interface through the audio acquisition interface. The audio acquisition option can be displayed in the audio acquisition interface. In response to the triggering operation of the audio acquisition option, the first Bluetooth device generates an audio acquisition instruction and sends the audio acquisition instruction to the second Bluetooth device connected to the current established Bluetooth communication link. Alternatively, the audio acquisition interface can also display multiple second Bluetooth devices connected to the current established Bluetooth communication link, and in response to a click operation on any second Bluetooth device, an audio acquisition instruction is sent to the second Bluetooth device.

[0089] In some embodiments, the second Bluetooth device receives an audio acquisition trigger operation, and generates an audio acquisition instruction based on the audio acquisition trigger operation. The second Bluetooth device can display an audio acquisition interface, and the user triggers the second Bluetooth device to perform audio acquisition through the audio acquisition interface displayed by the second Bluetooth device. For example, the second Bluetooth device is a watch, and the audio acquisition interface is displayed in the second Bluetooth device, and the user triggers the second Bluetooth device to perform audio acquisition through the audio acquisition interface. Alternatively, the second Bluetooth device is provided with a sensor, and the user triggers the second Bluetooth device to perform audio acquisition through the sensor. For example, the second Bluetooth device is a headset, and the headset is provided with a sensor. In response to the sensor sensing the user's continuous tapping action, the second Bluetooth device performs audio acquisition.

[0090] In some embodiments, the first Bluetooth device also collects audio data, and when synthesizing audio data, the audio data collected by the first Bluetooth device, the first audio device, and the second audio device are synthesized. Accordingly, the first Bluetooth device receives audio data from the first audio device and the second audio device; determines the link delay for data transmission between the first Bluetooth device and the first audio device and the link delay for data transmission between the first Bluetooth device and the second audio device; aligns the audio data collected by the first audio device and the audio data collected by the second audio device based on the link delay; and synthesizes the aligned audio data.

[0091] It should be noted that the first Bluetooth device may also initiate audio synchronization to the first audio device and the second audio device when receiving the audio synchronization instruction. Accordingly, in response to the audio synchronization instruction, the first Bluetooth device negotiates with the first audio device and the second audio device to determine the target time, and the target time is used by the first Bluetooth device to synchronize the first audio data sent by the second audio device and the first audio device respectively.

[0092] In an embodiment of the present application, multiple second Bluetooth devices can collect audio data separately. The first Bluetooth device synchronizes the multiple first audio data based on the target time only when it is necessary to synchronize the first audio data collected by the multiple second Bluetooth devices. This allows the first Bluetooth device to collect different audio data separately through multiple second Bluetooth devices, enriching the scenarios for collecting audio data.

[0093] Another point to be explained is that, in the embodiment of the present application, the first Bluetooth device can negotiate the target time with more Bluetooth devices than the first audio device and the second audio device, or, when the first Bluetooth device also collects audio data, the first Bluetooth device can negotiate the target time with any second Bluetooth device among multiple second Bluetooth devices. In the embodiment of the present application, this is not specifically limited.

[0094] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the collected audio data from being out of sync due to the different system times of different Bluetooth devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0095] Please refer to Figure 7 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0096] Step S701: the first Bluetooth device determines a data transmission / reception cycle for data transmission / reception, and determines the target time based on the data transmission / reception cycle.

[0097] In some embodiments, the data transceiving cycle is the data transceiving cycle of the first Bluetooth device, and the first Bluetooth device determines the target time based on the data transceiving cycle of the first Bluetooth device. In some embodiments, the data transceiving cycle is the data transceiving cycle of the first audio device or the second audio device. The first electronic device obtains the data transceiving cycle of the first audio device or the second audio device, and the first electronic device determines the target time based on the data transceiving cycle of the first audio device or the second audio device.

[0098] In some embodiments, the first Bluetooth device determines the target time based on the LE Audio ISO protocol. The LE Audio ISO protocol requires the first Bluetooth device and the second Bluetooth device to perform data transmission and reception at the beginning of a data transmission and reception cycle, and after a data transmission and reception cycle ends, it is necessary to wait until the next data transmission and reception cycle to continue data transmission and reception.

[0099] Step S702: When the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, the first Bluetooth device negotiates with the first audio device and the second audio device respectively to determine the target time.

[0100] The principle of this step is the same as that of step S601 and will not be repeated here.

[0101] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the collected audio data from being out of sync due to the different system times of different Bluetooth devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0102] In some embodiments, the data transceiving cycle is the data transceiving cycle of the first Bluetooth device, and the first Bluetooth device determines the target time based on the data transceiving cycle of the first Bluetooth device and the protocols with the first audio device and the second audio device. Figure 8 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0103] Step S801: The first Bluetooth device determines the target time based on the data transceiving cycle of the first Bluetooth device.

[0104] In some embodiments, the target time is the start time of the next data transceiving cycle adjacent to the data transceiving cycle where the current time is located. Accordingly, the first Bluetooth device determines the data transceiving cycle where the current time is located, and determines the start time of the next data transceiving cycle adjacent to the data transceiving cycle as the target time. The start time of the data transceiving cycle corresponds to the starting position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data. Therefore, when the first audio device and the second audio device send audio data, the same time is used as the starting position of the anchor point in the audio data frame, which ensures the consistency of the start time of the sent audio data, thereby ensuring that the audio data can be synchronized.

[0105] Step S802: the first Bluetooth device sends a first protocol request to the first audio device and the second audio device, where the first protocol request is used to negotiate with the first audio device and the second audio device to notify the target time and the data transceiving cycle of the first Bluetooth device.

[0106] The first Bluetooth device generates a first protocol request based on the target time, and sends the first protocol request to the first audio device and the second audio device respectively. After receiving the first protocol request, the first audio device and the second audio device respectively determine the target time based on the first protocol request, and collect audio data based on the target time.

[0107] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the collected audio data from being out of sync due to the different system times of different Bluetooth devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0108] In some embodiments, the data transceiving cycle is the data transceiving cycle of the first audio device, and the first Bluetooth device determines the target time based on the data transceiving cycle of the first audio device and the protocols with the first audio device and the second audio device. Fig. 9 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0109] Step S901: the first Bluetooth device receives the data transceiving cycle of the first audio device sent by the first audio device.

[0110] The first audio device may send the data transceiving cycle of the first audio device to the first Bluetooth device when establishing a connection with the first Bluetooth device. After receiving the data transceiving cycle sent by the first audio device, the first Bluetooth device stores the data transceiving cycle locally, and calls the data transceiving cycle of the first audio device when determining the target time. In some embodiments, the first Bluetooth device sends a synchronization instruction to the first audio device, and the first audio device sends the data transceiving cycle of the first audio device to the first Bluetooth device based on the synchronization instruction.

[0111] In some embodiments, the first Bluetooth device receives the data transceiving cycle sent by the first audio device and the second audio device, and the first Bluetooth device is based on the common target data transceiving cycle of the first audio device and the second audio device. When the data cycles of the first audio device and the second audio device are the same, the first Bluetooth device determines the same data transceiving cycle as the common target data transceiving cycle. When the data transceiving cycles of the first audio device and the second audio device are different, in some embodiments, the first Bluetooth device uses the larger data transceiving cycle in the different data transceiving cycles as the common target data transceiving cycle. In some embodiments, the first Bluetooth device uses the smaller data transceiving cycle in the different data transceiving cycles as the common target data transceiving cycle. In some embodiments, the first Bluetooth device 100 transmits data with a fixed data transceiving cycle, and accordingly, the fixed data transceiving cycle is used as the common target data transceiving cycle. In the embodiment of the present application, the manner in which the first Bluetooth device 100 determines the common target data transceiving cycle is not specifically limited.

[0112] Step S902: the first Bluetooth device determines the target time based on the data transceiving cycle of the first audio device.

[0113] The principle of this step is the same as that of step S801 and will not be repeated here.

[0114] Step S903: the first Bluetooth device sends a second protocol request to the first audio device and the second audio device, where the second protocol request is used to negotiate with the first audio device and the second audio device to notify the target time.

[0115] The principle of this step is the same as that of step S802 and will not be repeated here.

[0116] It should be noted that the first Bluetooth device can also determine the target time based on the data transceiving cycle of any audio device among the multiple second Bluetooth devices. This process is the same as the principle of the first Bluetooth device determining the target time based on the data transceiving cycle of the first audio device, and will not be repeated here.

[0117] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the collected audio data from being out of sync due to the different system times of different Bluetooth devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0118] In some embodiments, the first Bluetooth device may also receive a protocol request from the first audio device to negotiate the target time with the first audio device and the second audio device. Fig.10 , which shows a flowchart of an audio data processing method shown in an exemplary embodiment of the present application. The method includes:

[0119] Step S1001: the first Bluetooth device receives a third protocol request sent by the first audio device, where the third protocol request is used to negotiate with the first Bluetooth device and the second audio device to notify the target time.

[0120] The principle of this step is the same as that of step S802 and will not be repeated here.

[0121] The principle of determining the target time by the first audio data is the same as the principle of determining the target time by the first Bluetooth device, which will not be repeated here.

[0122] It should be noted that the first audio device also sends a third protocol request to the second audio device, thereby negotiating the target time with the second audio device. This process is the same as the principle of step S802 and will not be repeated here.

[0123] It should be noted that any audio device among the plurality of second Bluetooth devices can negotiate the target time with the first Bluetooth device. In some embodiments, before this step, the first Bluetooth device negotiates with the plurality of second Bluetooth devices to determine the audio device of the target time. In some embodiments, the first Bluetooth device displays a Bluetooth connection interface, in which a plurality of second Bluetooth devices are displayed, and the first Bluetooth device determines the audio device used to determine the target time from the plurality of second Bluetooth devices based on the user's selection operation.

[0124] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the collected audio data from being out of sync due to the different system times of different Bluetooth devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0125] Please refer to Fig.11 , which shows a structural block diagram of a first Bluetooth device provided by an embodiment of the present application. The first audio device can be implemented as all or part of a processor through software, hardware, or a combination of both. The first audio device includes:

[0126] The protocol module 1101 is used to respectively negotiate with the first audio device and the second audio device to determine a target time when the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other.

[0127] In some embodiments, the apparatus further comprises:

[0128] The first determining module is used to determine a data transmission and reception cycle for data transmission and reception, and determine the target time based on the data transmission and reception cycle.

[0129] In some embodiments, the data transceiving cycle is the data transceiving cycle of the first Bluetooth device, and the first determining module includes:

[0130] The first determining unit is configured to determine the target time based on a data transceiving cycle of the first Bluetooth device.

[0131] In some embodiments, the protocol module 1101 includes:

[0132] The first sending unit is used to send a first protocol request to the first audio device and the second audio device, where the first protocol request is used to negotiate with the first audio device and the second audio device to notify the target time and the data receiving and transmitting cycle of the first Bluetooth device.

[0133] In some embodiments, the data transceiving cycle is a data transceiving cycle of a first audio device; and the first determining module includes:

[0134] A first receiving unit, configured to receive a data transceiving cycle of the first audio device sent by the first audio device;

[0135] The second determining unit is configured to determine the target time based on a data transceiving cycle of the first audio device.

[0136] In some embodiments, the protocol module 1101 includes:

[0137] The second sending unit is used to send a second protocol request to the first audio device and the second audio device, where the second protocol request is used to negotiate with the first audio device and the second audio device to notify the target time.

[0138] In some embodiments, the apparatus further comprises:

[0139] The second determining module is used to determine a common target data receiving and sending cycle when the data receiving and sending cycles of the first audio device and the second audio device are different.

[0140] In some embodiments, the protocol module 1101 includes:

[0141] The second receiving unit is used to receive a third protocol request sent by the first audio device, where the third protocol request is used to negotiate with the first Bluetooth device and the second audio device to notify the target time.

[0142] In some embodiments, the target time is the start time of the next data transceiving cycle adjacent to the data transceiving cycle where the current time is located.

[0143] In some embodiments, the start time of the data transceiving cycle corresponds to the start position of an anchor point in an audio data frame, and the audio data frame is any data frame that transmits the audio data.

[0144] In some embodiments, the first audio device and the second audio device establish corresponding Bluetooth communication links with the first Bluetooth device at different times.

[0145] In some embodiments, the apparatus comprises:

[0146] A receiving module, configured to receive audio data from the first audio device and the second audio device;

[0147] A second determining module, used to determine a link delay for data transmission between the first Bluetooth device and the first audio device and a link delay for data transmission between the first Bluetooth device and the second audio device;

[0148] an alignment module, configured to align the audio data collected by the first audio device with the audio data collected by the second audio device based on the link delay;

[0149] The synthesis module is used to synthesize the aligned audio data.

[0150] In some embodiments, the first Bluetooth device is a terminal device, and the first audio device and the second audio device are wearable devices.

[0151] In an embodiment of the present application, when the audio data collected by the first audio device and the second audio device are not synchronized, the first Bluetooth device performs protocols with the first audio device and the second audio device respectively to determine the target time, so that the first audio device and the second audio device both collect audio at the target time, thereby ensuring that the first audio device and the second audio device can be synchronized with the same time standard, thus preventing the collected audio data from being out of sync due to the different system times of different Bluetooth devices, thereby ensuring that the audio data obtained by mixing can be synchronized, and realizing the collection of audio data by multiple second Bluetooth devices, making the collected audio data more three-dimensional.

[0152] In the embodiment of the present application, the first Bluetooth device and the second Bluetooth device may include other components in addition to the modules involved in the above embodiments. Fig.12 , which shows a structural block diagram of an electronic device provided by an exemplary embodiment of the present application. The structural block diagram can be a structural block diagram of a first Bluetooth device, or a structural block diagram of a second Bluetooth device. The electronic device 1200 includes one or more of the following components: a processor 1210, a memory 1220, and a Bluetooth module 1230.

[0153] In some embodiments, the processor 1210 may include one or more processing cores. The processor 1210 uses various interfaces and lines to connect various parts within the entire electronic device 1200, and executes various functions and processes data of the electronic device 1200 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1220, and calling data stored in the memory 1220. Optionally, the processor 1210 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1210 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a neural network processor (Neural-network Processing Unit, NPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the NPU is used to implement artificial intelligence (Artificial Intelligence, AI) functions; and the modem is used to process wireless communications. It is understandable that the above-mentioned modem may not be integrated into the processor 1110, but may be implemented by a separate chip.

[0154] In some embodiments, the memory 1220 includes a random access memory (RAM) and may also include a read-only memory (ROM). Optionally, the memory 1220 includes a non-transitory computer-readable storage medium. The memory 1220 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 1220 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc.; the data storage area may store data (such as audio data, a phone book), etc., created according to the use of the electronic device 1200.

[0155] In some embodiments, the Bluetooth module 1230 includes the above-mentioned first audio acquisition module 201, the first audio processing module 202 and the first control module 203, so that the second Bluetooth device performs the function of audio acquisition; or, the Bluetooth module 1230 includes the above-mentioned second audio processing module 101 and the second control module 102, so as to achieve mixing of multiple first audio data into second audio data.

[0156] In some embodiments, the electronic device 1200 further includes a display screen. The display screen is a display component for displaying a user interface. Optionally, the display screen is a display screen with a touch function, through which the user can use any object such as a finger or a stylus to perform touch operations on the display screen. The display screen is usually arranged on the front panel of the electronic device 1200. The display screen can be designed as a full screen, a curved screen, a special-shaped screen, a double-sided screen or a folding screen. The display screen can also be designed as a combination of a full screen and a curved screen, a combination of a special-shaped screen and a curved screen, etc., which is not limited in this embodiment.

[0157] In addition, those skilled in the art can understand that the structure of the electronic device 1200 shown in the above drawings does not constitute a limitation on the electronic device 1200, and the electronic device 1200 may include more or fewer components than shown, or combine certain components, or arrange the components differently. For example, the electronic device 1200 also includes a microphone, a speaker, a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (Wireless Fidelity, Wi-Fi) module, a power supply and other components, which will not be described in detail here.

[0158] An embodiment of the present application also provides a computer-readable medium, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the audio data processing method shown in the above embodiments.

[0159] An embodiment of the present application also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the audio data processing method shown in the above embodiments.

[0160] Those skilled in the art should be aware that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented with hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein the communication media include any media that facilitates the transmission of a computer program from one place to another. The storage medium can be any available medium that a general or special-purpose computer can access.

[0161] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. An audio data processing system, characterized in that: The audio data processing system includes a first Bluetooth device and a plurality of second Bluetooth devices; The first Bluetooth device is configured to: In the case where the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, respectively negotiate with the first audio device and the second audio device to determine the target time; wherein the first audio device is any one of the plurality of second Bluetooth devices, the second audio device is another one of the plurality of second Bluetooth devices different from the first audio device, and the first audio device and the second audio device respectively establish corresponding Bluetooth communication links with the first Bluetooth device at different times; the target time is the start time of the next data transceiver cycle adjacent to the data transceiver cycle where the current time is located, the start time of the data transceiver cycle corresponds to the start position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data; The first audio device and the second audio device are respectively configured as: Start collecting audio data at the target time; The first Bluetooth device is configured to: The audio data sent by the multiple second Bluetooth devices are aligned based on the data receiving and sending cycle corresponding to the target time.

2. The audio data processing system according to claim 1, characterized in that: The first Bluetooth device is configured as: A data transmission and reception cycle for transmitting and receiving data is determined, and the target time is determined based on the data transmission and reception cycle.

3. The audio data processing system according to claim 2, characterized in that: The data transceiving cycle is the data transceiving cycle of the first Bluetooth device, and the first Bluetooth device is configured as follows: A first protocol request is sent to the first audio device and the second audio device, where the first protocol request is used to negotiate with the first audio device and the second audio device to notify the target time and the data transceiving cycle of the first Bluetooth device.

4. The audio data processing system according to claim 2, characterized in that: The data transceiving cycle is the data transceiving cycle of the first audio device; The first audio device is configured as: Sending a data transceiver cycle of the first audio device to the first Bluetooth device; The first Bluetooth device is configured to: receiving a data transceiver cycle sent by the first audio device; Determining the target time based on the data transceiving cycle; A second protocol request is sent to the first audio device and the second audio device, where the second protocol request is used to negotiate with the first audio device and the second audio device to notify the target time.

5. The audio data processing system according to claim 4, characterized in that: The first Bluetooth device is further configured to: In a case where the data transceiving cycles of the first audio device and the second audio device are different, determining a common target data transceiving cycle; Based on the second protocol request, the data transceiving periods of the first audio device and the second audio device are respectively set as the common target data transceiving period.

6. The audio data processing system according to claim 1, characterized in that: The first audio device is configured to: Determining the target time based on a data transceiver cycle of the first audio device; A third protocol request is sent to the first Bluetooth device and the second audio device based on the target time, where the third protocol request is used to negotiate with the first Bluetooth device and the second audio device to notify the target time.

7. The audio data processing system according to claim 1, characterized in that: The first Bluetooth device is also configured to: receiving audio data from the first audio device and the second audio device; Determine a link delay for data transmission between the first Bluetooth device and the first audio device and a link delay for data transmission between the first Bluetooth device and the second audio device; Based on the link delay, aligning the audio data collected by the first audio device with the audio data collected by the second audio device; Synthesize the aligned audio data.

8. The audio data processing system according to any one of claims 1 to 7, characterized in that: The first Bluetooth device is a terminal device, and the second Bluetooth device is a wearable device.

9. An audio data processing method, characterized in that: Applied to a first Bluetooth device, the method includes: In a case where the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, respectively negotiate with the first audio device and the second audio device to determine a target time, so that the first audio device and the second audio device start collecting audio data at the target time; wherein the first audio device is any one of a plurality of second Bluetooth devices, the second audio device is another one of the plurality of second Bluetooth devices different from the first audio device, and the first audio device and the second audio device respectively establish corresponding Bluetooth communication links with the first Bluetooth device at different times; the target time is the start time of the next data transceiver cycle adjacent to the data transceiver cycle where the current time is located, the start time of the data transceiver cycle corresponds to the start position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data; The audio data sent by the multiple second Bluetooth devices are aligned based on the data receiving and sending cycle corresponding to the target time.

10. The method according to claim 9, characterized in that Before respectively negotiating with the first audio device and the second audio device to determine the target time, the method further includes: A data transmission and reception cycle for transmitting and receiving data is determined, and the target time is determined based on the data transmission and reception cycle.

11. The method according to claim 10, characterized in that The data transceiving cycle is the data transceiving cycle of the first Bluetooth device, and the step of determining the data transceiving cycle for data transceiving and determining the target time based on the data transceiving cycle includes: The target time is determined based on a data transceiving cycle of the first Bluetooth device.

12. The method according to claim 11, characterized in that The respectively negotiating with the first audio device and the second audio device to determine the target time comprises: A first protocol request is sent to the first audio device and the second audio device, where the first protocol request is used to negotiate with the first audio device and the second audio device to notify the target time and the data transceiving cycle of the first Bluetooth device.

13. The method according to claim 10, characterized in that The data transceiving cycle is the data transceiving cycle of the first audio device; and the step of determining the data transceiving cycle for data transceiving, and determining the target time based on the data transceiving cycle, includes: receiving a data transceiving cycle of the first audio device sent by the first audio device; The target time is determined based on a data transceiving cycle of the first audio device.

14. The method according to claim 13, characterized in that The respectively negotiating with the first audio device and the second audio device to determine the target time comprises: A second protocol request is sent to the first audio device and the second audio device, where the second protocol request is used to negotiate with the first audio device and the second audio device to notify the target time.

15. The method according to claim 13, characterized in that The method further comprises: In a case where the data transceiving cycles of the first audio device and the second audio device are different, a common target data transceiving cycle is determined.

16. The method according to claim 9, characterized in that The respectively negotiating with the first audio device and the second audio device to determine the target time comprises: A third protocol request sent by the first audio device is received, where the third protocol request is used to negotiate with the first Bluetooth device and the second audio device to notify the target time.

17. The method according to claim 9, characterized in that The method further comprises: receiving audio data from the first audio device and the second audio device; Determine a link delay for data transmission between the first Bluetooth device and the first audio device and a link delay for data transmission between the first Bluetooth device and the second audio device; Based on the link delay, aligning the audio data collected by the first audio device with the audio data collected by the second audio device; Synthesize the aligned audio data.

18. The method according to any one of claims 9 to 17, characterized in that: The first Bluetooth device is a terminal device, and the first audio device and the second audio device are wearable devices.

19. A first Bluetooth device, characterized in that: The first Bluetooth device comprises: A protocol module, used for, when the audio data collected by the first audio device and the audio data collected by the second audio device are not synchronized with each other, respectively negotiating with the first audio device and the second audio device to determine a target time, so that the first audio device and the second audio device start collecting audio data at the target time; wherein the first audio device is any one of a plurality of second Bluetooth devices, the second audio device is another one of the plurality of second Bluetooth devices different from the first audio device, and the first audio device and the second audio device respectively establish corresponding Bluetooth communication links with the first Bluetooth device at different times; the target time is the start time of the next data transceiver cycle adjacent to the data transceiver cycle where the current time is located, the start time of the data transceiver cycle corresponds to the start position of the anchor point in the audio data frame, and the audio data frame is any data frame that transmits the audio data; A module for executing the following steps: aligning the audio data sent by the plurality of second Bluetooth devices based on a data transceiver cycle corresponding to the target time.

20. A Bluetooth device, characterized in that: The Bluetooth device includes a processor and a memory; the memory stores at least one program code, and the at least one program code is used to be executed by the processor to implement the audio data processing method according to any one of claims 9 to 18.

21. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one program code, and the at least one program code is used to be executed by a processor to implement the audio data processing method according to any one of claims 9 to 18.

Images