Audio data processing method, device, audio communication system and storage medium

Abstract

The present disclosure relates to the field of data communication technology, and specifically provides an audio data processing method, device, audio communication system, and storage medium. An audio data processing method is applied to an audio receiving device, and the method includes: receiving at least two audio stream data sent by an audio sending device via a wireless short-range communication method; based on a preset control instruction, processing at least one of the at least two audio stream data to obtain a target audio stream. In an embodiment of the present disclosure, the parallel transmission and reception of multiple audio stream data is realized in wireless short-range communication, and each audio stream data can be independently processed and controlled to achieve more audio playback effects and enrich audio functions.

Description

Technical Field

[0001] The present disclosure relates to the field of data communication technology, and in particular to an audio data processing method, device, audio communication system, and storage medium. Background Art

[0002] At present, the application scenarios covered by wireless short-range communication technology are becoming more and more extensive. However, in related technologies, wireless short-range communication technology is limited by factors such as bandwidth when transmitting audio streams, and cannot achieve independent control or processing of multiple audio stream data, resulting in limited audio playback functions. Summary of the Invention

[0003] To achieve independent control and processing of multiple audio streams in wireless short-range audio transmission scenarios, the present disclosure provides an audio data processing method, device, audio communication system, and storage medium.

[0004] In a first aspect, an embodiment of the present disclosure provides an audio data processing method, applied to an audio receiving device, the method comprising:

[0005] receiving at least two audio stream data sent by an audio sending device via a wireless short-range communication method;

[0006] Based on a preset control instruction, at least one of the at least two audio stream data is processed to obtain a target audio stream.

[0007] In some implementations, processing at least one of the at least two audio stream data based on a preset control instruction to obtain a target audio stream includes:

[0008] Determining the timing information and time ratio of each of the audio stream data based on the preset control instruction;

[0009] Compress each audio stream data according to the time ratio to obtain audio playback data corresponding to each audio stream data;

[0010] The audio playback data are spliced ​​in time sequence according to the time sequence information to obtain the target audio stream.

[0011] In some implementations, compressing each audio stream data according to the time ratio to obtain audio playback data corresponding to each audio stream data includes:

[0012] Determine the duration of each audio stream data according to the total duration of the target audio stream and the time ratio of each audio stream data;

[0013] According to the duration of each audio stream data, the playback speed of the audio stream data is adjusted to obtain the audio playback data corresponding to the audio stream data.

[0014] In some embodiments, the method further comprises:

[0015] According to the data identifier included in the preset control instruction, target audio stream data corresponding to the data identifier is determined from the at least two audio stream data.

[0016] In some embodiments, the method further comprises:

[0017] Parsing each audio stream data to obtain identification information carried by the audio stream data;

[0018] A data identifier corresponding to the audio stream data is generated according to the identification information, and the data identifier is assigned to the audio stream data.

[0019] In some implementations, the identification information of the audio stream data includes a first identification of the audio sending device, a second identification of an audio source corresponding to the audio stream data, and a third identification corresponding to the audio stream data.

[0020] In some embodiments, the method further comprises:

[0021] According to the playback control instruction included in the preset control instruction, the audio playback parameters of the target audio stream data are adjusted to obtain the target audio stream.

[0022] In some embodiments, the wireless short-range communication method includes star flash communication and / or wireless local area network communication.

[0023] In a second aspect, the present disclosure provides an audio data processing method, which is applied to an audio sending device. The method includes:

[0024] Acquire at least two audio stream data generated by respective audio sources of the audio sending device;

[0025] The audio stream data is sent to an audio receiving device via wireless short-range communication.

[0026] In some embodiments, the wireless short-range communication method includes star flash communication and / or wireless local area network communication.

[0027] In a third aspect, the present disclosure provides an audio communication system, including:

[0028] An audio sending device, comprising at least one audio source, each of the audio sources being configured to generate at least one audio stream data;

[0029] an audio receiving device connected to the audio sending device via a wireless short-range communication method, the audio receiving device comprising at least one audio sink configured to receive the at least one audio stream data;

[0030] The audio receiving device further includes a processor and a memory, wherein the processor is communicatively connected to the memory, and the memory stores computer instructions, and the computer instructions are used to enable the processor to execute the method according to any embodiment of the first aspect.

[0031] In a fourth aspect, the present disclosure provides an audio data processing apparatus, applied to an audio receiving device, the apparatus comprising:

[0032] A data receiving module is configured to receive at least two audio stream data sent by an audio sending device via a wireless short-range communication method;

[0033] The data processing module is configured to process at least one of the at least two audio stream data based on a preset control instruction to obtain a target audio stream.

[0034] In some embodiments, the data processing module is configured to:

[0035] Determining the timing information and time ratio of each of the audio stream data based on the preset control instruction;

[0036] Compress each audio stream data according to the time ratio to obtain audio playback data corresponding to each audio stream data;

[0037] The audio playback data are spliced ​​in time sequence according to the time sequence information to obtain the target audio stream.

[0038] In some embodiments, the data processing module is configured to:

[0039] Determine the duration of each audio stream data according to the total duration of the target audio stream and the time ratio of each audio stream data;

[0040] According to the duration of each audio stream data, the playback speed of the audio stream data is adjusted to obtain the audio playback data corresponding to the audio stream data.

[0041] In some embodiments, the data processing module is configured to:

[0042] According to the data identifier included in the preset control instruction, target audio stream data corresponding to the data identifier is determined from the at least two audio stream data.

[0043] In some embodiments, the data processing module is configured to:

[0044] Parsing each audio stream data to obtain identification information carried by the audio stream data;

[0045] A data identifier corresponding to the audio stream data is generated according to the identification information, and the data identifier is assigned to the audio stream data.

[0046] In some implementations, the identification information of the audio stream data includes a first identification of the audio sending device, a second identification of an audio source corresponding to the audio stream data, and a third identification corresponding to the audio stream data.

[0047] In some embodiments, the data processing module is configured to:

[0048] According to the playback control instruction included in the preset control instruction, the audio playback parameters of the target audio stream data are adjusted to obtain the target audio stream.

[0049] In some embodiments, the wireless short-range communication method includes star flash communication and / or wireless local area network communication.

[0050] In a fifth aspect, an embodiment of the present disclosure provides an audio data processing apparatus, applied to an audio sending device, the apparatus comprising:

[0051] a data acquisition module, configured to acquire at least two audio stream data generated by respective audio sources of the audio sending device;

[0052] The data sending module is configured to send the audio stream data to the audio receiving device via wireless short-range communication.

[0053] In a sixth aspect, an embodiment of the present disclosure provides a storage medium storing computer instructions, wherein the computer instructions are used to enable a computer to execute the method according to any embodiment of the first aspect or the second aspect.

[0054] The audio data processing method disclosed in this embodiment is applied to an audio receiving device and includes receiving at least two audio streams transmitted by an audio transmitting device via wireless short-range communication, and processing at least one of the at least two audio streams based on preset control instructions to obtain a target audio stream. This disclosed embodiment enables the parallel transmission and reception of multiple audio streams via wireless short-range communication, and allows for independent processing and control of each audio stream, resulting in a wider range of audio playback effects and enriched audio functionality. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the specific embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0056] Figure 1 It is a structural diagram of an audio communication system according to some embodiments of the present disclosure.

[0057] Figure 2 is a flowchart of an audio data processing method according to some embodiments of the present disclosure.

[0058] Figure 3 is a flowchart of an audio data processing method according to some embodiments of the present disclosure.

[0059] Figure 4 is a flowchart of an audio data processing method according to some embodiments of the present disclosure.

[0060] Figure 5 is a flowchart of an audio data processing method according to some embodiments of the present disclosure.

[0061] Figure 6 It is a schematic diagram of the principles of the audio data processing method in some embodiments of the present disclosure.

[0062] Figure 7 is a flowchart of an audio data processing method according to some embodiments of the present disclosure.

[0063] Figure 8 is a flowchart of an audio data processing method according to some embodiments of the present disclosure.

[0064] Figure 9 It is a schematic diagram of the principles of the audio data processing method in some embodiments of the present disclosure.

[0065] Figure 10 is a flowchart of an audio data processing method according to some embodiments of the present disclosure.

[0066] Figure 11 It is a structural block diagram of an audio data processing device according to some embodiments of the present disclosure.

[0067] Figure 12 It is a structural block diagram of an audio data processing device according to some embodiments of the present disclosure.

[0068] Figure 13 It is a structural block diagram of a mobile terminal according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0069] The technical solutions of the present disclosure will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present disclosure. In addition, the technical features involved in the different embodiments of the present disclosure described below can be combined with each other as long as they do not conflict with each other.

[0070] An audio stream refers to digitally encoded audio data generated by an audio application. An audio application can generate one or more audio streams simultaneously. Common short-range wireless transmission protocols for user audio stream data include Bluetooth (BT). However, Bluetooth communication can only transmit a single audio stream, not multiple independent audio streams. This makes it impossible for the receiving device to independently control or process multiple audio signals, limiting its audio functionality.

[0071] For example, in an example scenario, a multilingual news broadcast application on the sending device can simultaneously generate multiple audio streams in different languages, such as Chinese and English. In related technologies, when using Bluetooth transmission, the sending device can only send a single audio stream in one language, or superimpose multiple audio streams into a multilingual audio stream. On the receiving device side, it can only receive a single audio stream data. For a single audio stream data superimposed in multiple languages, the receiving device side cannot separate the audio streams in different languages, and thus cannot control and process each audio stream separately.

[0072] For example, in another example scenario, a short-distance multi-person conference application, when using wireless short-distance audio transmission, because the receiving device can only receive a single audio stream data, it is impossible to achieve independent control and processing of multiple audio streams. Therefore, during the meeting, only one person can speak online at the same time, and multiple people cannot speak at the same time, resulting in a poor conference experience.

[0073] The Star Flash Alliance is an industry alliance formed by domestic mobile phone, automobile and chip manufacturers for the next generation of wireless short-range communications. The Star Flash short-range communication standard it has formulated (hereinafter referred to as "Star Flash Communication") carries applications in scenarios such as smart cars, smart homes, smart terminals and smart manufacturing.

[0074] The Star Flash communication standard is divided into the access layer, basic service layer, and basic application layer from the bottom layer to the top layer. The access layer includes the physical layer and the link layer. The basic service layer mainly provides basic services such as device discovery and service management, connection management, data transmission and adaptation. The basic application layer mainly provides audio and video applications, human-machine interfaces, and other vertical industry applications.

[0075] In the audio streaming data transmission of the Xingshan Communication standard, the outgoing device of the audio stream is the audio sending device, which can include one or more audio sources (Source), each of which can generate one or more audio streams. The incoming device of the audio stream is the audio receiving device, which can include one or more audio sinks (Sink), each of which can receive one or more audio streams.

[0076] Based on this, the embodiments of the present disclosure provide an audio data processing method, device, audio communication system and storage medium, which aim to achieve simultaneous transmission and reception of multiple audio stream data and independent control and processing of single audio stream data in wireless short-range communication.

[0077] Figure 1 The audio communication system in some embodiments of the present disclosure is shown below. Figure 1 The application scenarios of the embodiments of the present disclosure are described.

[0078] like Figure 1 As shown, in some embodiments, the audio communication system of the present disclosure includes an audio sending device 100 and an audio receiving device 200, and the audio sending device 100 and the audio receiving device 200 establish a communication connection through wireless communication.

[0079] It is worth noting that the wireless communication method described in the embodiments of the present disclosure refers to short-range wireless communication, such as the aforementioned Star Flash communication standard. However, it is understood that the methods of the embodiments of the present disclosure are not limited to Star Flash communication. Under the condition that the communication bandwidth is sufficient, any other wireless communication method suitable for realizing the parallel transmission and reception of multiple audio stream data can be applied to the methods of the present disclosure, such as the wireless local area network (WiFi) communication protocol, etc., and the present disclosure does not limit this.

[0080] The audio transmitting device 100 may include one or more audio sources 110. An audio source 110 can be understood as an audio application that generates audio stream data. An audio application may generate only one audio stream, such as a music application that generates a single audio stream of music. An audio application may also generate multiple audio streams, such as a multilingual news broadcast application that simultaneously generates multiple audio streams in different languages. Therefore, it can be seen that an audio source 110 can generate one or more audio streams simultaneously.

[0081] Similarly, the audio receiving device 200 may include one or more audio sinks 210. The audio sink 210 may be understood as a receiving end to which the audio stream data is to be transmitted. In the embodiment of the present disclosure, one audio sink 210 may simultaneously receive one or more audio stream data, for example Figure 1 In the example, each arrow represents a piece of audio stream data.

[0082] exist Figure 1 Based on the example audio communication system, the present disclosure provides an audio data processing method, which can be applied to the audio receiving device 200 in the above example. Figure 2 Provide explanation.

[0083] like Figure 2 As shown, in some embodiments, the audio data processing method of the present disclosure example is performed by the audio receiving device 200, and the method includes:

[0084] S210: Receive at least two audio stream data sent by an audio sending device via a wireless short-range communication method; or, receive audio stream data sent by an audio sending device via a wireless short-range communication method, wherein the audio stream data includes at least two audio stream data.

[0085] S220: Based on a preset control instruction, process at least one audio stream data among the at least two audio stream data to obtain a target audio stream.

[0086] Combine Figure 1 As shown, the audio receiving device 200 can receive one or more audio stream data wirelessly transmitted by the audio sending device 100. The embodiment of the present disclosure is mainly aimed at the scenario of simultaneously transmitting multiple audio stream data, and the communication scenario of a single audio stream data is not repeated.

[0087] In the embodiments of the present disclosure, the wireless short-range communication method between the audio transmitting device and the audio receiving device can be any method with sufficient bandwidth that can achieve simultaneous wireless short-range transmission of multiple audio stream data, such as SparkLink communication, wireless local area network (WiFi) communication, etc., and the present disclosure does not impose any restrictions on this. Among them, SparkLink communication refers to wireless short-range communication technology, and in particular refers to wireless short-range communication technology that complies with the SparkLink Alliance (SparkLink) technical specifications.

[0088] On the audio sending device side, multiple audio stream data may be generated by one audio source, such as a multilingual news playback application, which generates audio stream data in multiple languages ​​at the same time, and each language corresponds to one audio stream data. It may also be multiple audio stream data generated by multiple audio sources, such as a music playback application as one audio source, which generates an audio stream data for music playback, and at the same time, a navigation application as another audio stream, which generates an audio stream data for navigation voice broadcast while playing music. Audio stream data may also be sent by two or more audio sending device ends as multiple audio sources; for example, in an online meeting, the audio receiving end may receive audio stream data sent by two or more audio sending devices together. Those skilled in the art can understand this, and this disclosure will not elaborate on it.

[0089] After receiving the multiple audio stream data, the audio receiving device may perform predetermined processing on any one or multiple audio stream data among the multiple audio stream data according to a preset control instruction, thereby obtaining a target audio stream.

[0090] In the disclosed embodiments, a preset control instruction refers to an instruction for controlling multiple received audio streams. The preset control instruction may include a data identifier and corresponding control parameters. Based on the data identifier, one or more audio streams to be processed can be determined from the multiple received audio data. Based on the control parameters, the determined audio streams can be processed accordingly to obtain the target audio stream.

[0091] In the embodiments of the present disclosure, the methods for processing audio stream data include but are not limited to any one or more of the following: play, stop, double-speed play, volume control, sound effects, audio compression and splicing, etc.; the present disclosure does not impose any restrictions on this.

[0092] For example, in one example scenario, an audio receiving device simultaneously receives two audio streams, one of which is music playback and the other is voice announcement. A preset control instruction indicates, "During the voice announcement period, reduce the volume of the music playback." Based on this preset control instruction, the audio stream corresponding to the music playback is determined to be the audio stream data to be processed, and the audio stream data is processed by reducing the volume to obtain the target audio stream.

[0093] For example, in another example scenario, the audio receiving device receives three audio stream data simultaneously, one of which is an English news broadcast, the second is a French news broadcast, and the third is a Chinese news broadcast. The preset control instruction indicates "compress the duration of each news broadcast and play each audio segment in the order of English, French, and Chinese." Therefore, according to the preset control instruction, the three audio stream data are compressed separately and spliced ​​in the order of English, French, and Chinese in time sequence to obtain the target audio stream. That is, the three audio streams that originally overlapped in the time domain are processed into three voice segments that are played sequentially in the time domain.

[0094] In the following embodiments of the present disclosure, the audio stream data processing process of the above examples will be described separately, which will not be described in detail here.

[0095] From the above, it can be seen that in the embodiments of the present disclosure, parallel transmission and reception of multiple audio stream data are achieved in wireless short-range communication, and each audio stream data can be independently processed and controlled to achieve more audio playback effects and enrich audio functions.

[0096] In the embodiment of the present disclosure, after receiving multiple audio stream data, the audio receiving device can first assign a unique data identifier to each audio stream data in order to realize independent processing and control of each audio stream data. Figure 3 The implementation method is described.

[0097] like Figure 3 As shown, in some embodiments, the audio data processing method of the present disclosure example is performed by the audio receiving device 200, and the method includes:

[0098] S310: Parse each audio stream data to obtain identification information carried by the audio stream data.

[0099] S320: Generate a data identifier corresponding to the audio stream data according to the identifier information, and assign the data identifier to the audio stream data.

[0100] It can be understood that on the audio sending device side, each audio source can be understood as an audio application. When the system starts the audio application, it will create a corresponding process. Each audio stream data generated in the audio application corresponds to a sub-thread in the process.

[0101] Therefore, each audio stream data generated by the audio source carries identification information that uniquely identifies the audio stream data. The identification information may include, for example, the MAC address of the audio sending device, the PID (Process Identification) of the audio application process to which the audio stream data belongs, and the ID number of the sub-thread to which the audio stream data belongs.

[0102] At the audio receiving device end, after receiving multiple audio stream data, the identification information carried in the audio stream data can be read, and a corresponding data identifier is generated according to the identification information, thereby allocating a new address to each audio stream data at the audio receiving device end.

[0103] In the embodiments of the present disclosure, the manner in which the audio receiving device assigns a data representation to each received audio stream data may be any manner suitable for uniquely identifying the audio stream data. That is, the form of the data identifier assigned to the audio stream data may be of any type, and the present disclosure does not impose any specific restrictions on this.

[0104] For example, in some implementations, the identification information of the audio stream data may include the following three parts:

[0105] 1) A first identifier of the audio sending device of the audio stream data.

[0106] The first identifier is unique identification information of the audio sending device. Multiple audio streams sent by the same audio sending device have the same first identifier, while audio streams sent by different audio sending devices have different first identifiers. For example, in one example, the first identifier can be the 32-bit MAC address of the audio sending device, represented as B8-9A-2A-9E-BE-48.

[0107] 2) A second identifier of the audio source of the audio stream data.

[0108] The second identifier refers to the process PID of the audio source application that generates the audio stream data. Multiple audio stream data generated by the same audio source have the same second identifier, while audio stream data generated by different audio sources have different second identifiers. For example, in one example, the second identifier of the audio stream data is the 16-bit application process ID, represented by 00-FF.

[0109] 3) A third identifier corresponding to the audio stream data.

[0110] The third identifier refers to the thread ID of the sub-thread corresponding to the audio stream data itself. The third identifiers of multiple different audio stream data generated by the same audio source are different. For example, in one example, the third identifier of the audio stream data is an 8-bit thread ID, which is 01.

[0111] Based on the above, it can be seen that using the first identifier, the second identifier, and the third identifier to hierarchically assign addresses to each audio stream data can efficiently manage each audio stream data. By analyzing the data identifier of the audio data, the audio stream data can be accurately traced to its source. Therefore, in the embodiments of the present disclosure, the method by which the audio receiving device assigns data identifiers to audio stream data is highly efficient and has standardized significance.

[0112] For example, in the example above, the data identifier generated for a particular audio stream is: B8-9A-2A-9E-BE-48-00-FF-01. The B8-9A-2A-9E-BE-48 portion uniquely identifies the audio sending device for that audio stream, the 00-FF portion uniquely identifies an audio source within that audio sending device, and the 01 portion uniquely identifies a particular audio stream within that audio source. As can be seen, hierarchical address allocation enables accurate traceability analysis of each audio stream.

[0113] At the audio receiving device end, after obtaining the data identifier of each audio stream data, the data identifier can be allocated to the corresponding audio stream data, and the data identifier of the audio stream data can be cached.

[0114] From the above, it can be seen that in the embodiments of the present disclosure, the audio receiving device can assign addresses to each audio stream data according to identification information at different levels, thereby achieving data identification standardization of audio stream data and improving the traceability analysis capability of audio stream data.

[0115] It should be noted that if Figure 3 The method corresponding to the illustrated embodiment may be implemented alone or in combination with any other embodiment of the present disclosure, and the embodiments of the present disclosure are not limited thereto.

[0116] After assigning a data identifier to each audio stream data, the audio stream data can be processed according to the preset control instruction. Figure 4 The implementation method is described.

[0117] like Figure 4 As shown, in some embodiments, the audio data processing method of the present disclosure example, the process of processing audio stream data based on preset control instructions, includes:

[0118] S410: Determine, according to a data identifier included in a preset control instruction, a target audio stream data corresponding to the data identifier from at least two audio stream data.

[0119] S420: Process the target audio stream data based on a preset control instruction.

[0120] In the embodiment of the present disclosure, at the audio receiving device end, after allocating data identifiers to each received audio stream data, data processing can be performed on the audio stream data based on preset control instructions.

[0121] It is understood that in some embodiments, it is not necessary to process all audio stream data, but rather only one or part of the audio stream data is processed, while the other audio stream data is not processed. For example, in one example, the audio receiving device receives two audio stream data, namely music playback and voice broadcast. In this scenario, only the audio stream data of the music playback needs to be volume-reduced, and the audio stream data of the voice broadcast does not need to be processed.

[0122] Therefore, in some embodiments, the preset control instruction includes a data identifier of the audio stream data that needs to be processed, so that the audio stream data that needs to be processed can be determined based on the data identifier carried by the preset control instruction, that is, the target audio stream data described in the present disclosure.

[0123] Furthermore, in some implementations, when multiple audio streams need to be processed, different audio streams may be processed differently. For example, in one example, an audio receiving device receives three audio streams: music playback, voice announcement, and system prompts. In this scenario, the music playback audio stream needs to be muted, the voice announcement audio stream needs to be lowered, and no processing is required for the system prompt audio stream.

[0124] Therefore, in some embodiments, the preset control instructions also include control instructions for processing each target audio stream data, so that each target audio stream data can be processed accordingly based on the data identifier and control instructions carried by the preset control instructions to obtain the final target audio stream.

[0125] Figure 5 The process of processing audio stream data in some embodiments of the present disclosure is shown below. Figure 5 Provide explanation.

[0126] like Figure 5 As shown, in some embodiments, the audio stream data processing method of the present disclosure example, the process of processing the target audio stream data includes:

[0127] S510: Determine target audio stream data corresponding to the data identifier from at least two audio stream data according to the data identifier included in the preset control instruction.

[0128] S520: Adjust audio playback parameters of the target audio stream data according to the playback control instruction included in the preset control instruction to obtain the target audio stream.

[0129] Based on the foregoing, it can be seen that the preset control instruction includes the data identifier of the audio stream data to be processed and the playback control instruction for processing the audio stream data. Therefore, in the embodiments of the present disclosure, the preset control instruction can be parsed to obtain the data identifier included in the preset control instruction, and then the corresponding audio stream data, i.e., the target audio stream data, can be determined from the multiple received audio stream data based on the data identifier.

[0130] After obtaining each target audio stream data, the preset control instruction is parsed to obtain a playback control instruction for processing each target audio stream data, and the target audio stream data is processed accordingly based on the playback control instruction to obtain the final target audio stream.

[0131] For example, in an example, Figure 6 As shown in the figure, the audio receiving device receives a total of 2 audio streams, of which audio stream 1 is the audio stream data corresponding to the voice broadcast, and audio stream 2 is the audio stream data corresponding to the music playback. The waveforms corresponding to audio stream 1 and audio stream 2 are as follows: Figure 6 As shown in (a).

[0132] In this example, the data identifier included in the preset control instruction is the data identifier of the audio stream 2, and the play control instruction indicates "reduce the volume to 10%."

[0133] Therefore, in the embodiment of the present disclosure, the audio receiving device parses the preset control instruction, determines that the audio stream data corresponding to audio stream 2 is the target audio stream data according to the data identifier, and then adjusts the volume parameter in the audio stream data of audio stream 2 to 10% based on the playback control instruction. The waveform of the target audio stream is as follows: Figure 6 As shown in (b), the audio heard by the user is Figure 6 The effect of the superposition of the two audio streams shown in (b) is that the volume of the music playback corresponding to audio stream 2 becomes smaller, while the voice broadcast corresponding to audio stream 1 is played normally.

[0134] Of course, those skilled in the art will understand that the audio playback parameters for adjusting the target audio stream data are not limited to the volume parameters in the above example, but also include any other playback parameters suitable for control, such as pause, mute, sound effects, etc., which will not be elaborated in this disclosure. In addition, the number of audio stream data is not limited to Figure 6 For example, there may be a larger amount of audio stream data, and the control principle is the same as above, which will not be described in detail.

[0135] From the above, it can be seen that in the embodiments of the present disclosure, parallel transmission and reception of multiple audio stream data are achieved in wireless short-range communication, and each audio stream data can be independently processed and controlled to achieve more audio playback effects and enrich audio functions.

[0136] In the above Figure 6 In the exemplary implementation, no matter how each target audio stream data is adjusted, the target audio stream data ultimately obtained is always a plurality of audio stream data superimposed and played in the time domain. In other implementations of the present disclosure, the audio receiving device can process a plurality of audio stream data superimposed in the time domain into a target audio stream that is continuous in the time domain.

[0137] For example, in a multi-person conference scenario, the audio receiving device on user A receives multiple audio stream data simultaneously, each of which represents the speech audio of a participant. In other words, user A's audio receiving device receives multiple audio stream data of multiple participants speaking simultaneously.

[0138] In this scenario, no matter which audio stream is processed, the resulting target audio stream will never capture all the audio information. For example, if all audio streams are played together, user A will have difficulty focusing on multiple voice messages. Alternatively, if the volume of some audio streams is lowered or muted, user A will lose that portion of the audio information, resulting in missing meeting information.

[0139] It can be seen that in some real-world scenarios, it is difficult to take into account the information integrity of the audio stream data that is superimposed in the time domain when processing multiple audio stream data. Therefore, in some embodiments of the present disclosure, the integrity of the audio information received by the user is guaranteed by processing multiple audio stream data that are superimposed in the time domain into a single audio stream that is continuous in the time domain. Figure 7 The implementation method is described.

[0140] like Figure 7 As shown, in some embodiments, the audio data processing method of the present disclosure examples processes audio stream data to obtain a target audio stream, including:

[0141] S710: Determine the timing information and time ratio of each audio stream data based on a preset control instruction.

[0142] S720: compress each audio stream data according to the time ratio to obtain audio playback data corresponding to each audio stream data.

[0143] S730: Perform time sequence splicing on each audio playback data according to the time sequence information to obtain a target audio stream.

[0144] It can be understood that in the implementation mode of the present disclosure, multiple audio stream data overlapping in the time domain need to be processed into a single audio stream that is continuous in the time domain, so that each audio stream data must have a certain sequence in time sequence. The timing information described in the present disclosure is used to represent the sequence of the corresponding audio stream data.

[0145] For example, in a multi-person conference scenario, including two audio sources, a main speaker and an auxiliary speaker, when both speak simultaneously, User A's audio receiving device can simultaneously receive both audio streams. In this scenario, the main speaker's voice takes precedence over the auxiliary speaker's. Therefore, User A can pre-set the timing information of the audio stream generated by the main speaker's speech to have a higher priority, while the timing information of the audio stream generated by the auxiliary speaker's speech has a lower priority in the preset control instructions. This results in the target audio stream being played first, followed by the audio stream of the auxiliary speaker's speech.

[0146] The time percentage can be understood as the duration of each audio stream data in the final target audio stream. It is understandable that, because the disclosed embodiments require processing multiple audio stream data with overlapping time domains into a single, continuous audio stream in the time domain, if the audio stream data is directly spliced ​​without compression, this will lead to time desynchronization issues in the target audio stream.

[0147] Taking the above-mentioned multi-person conference scenario as an example, assuming that the audio stream data of the main speaker and the audio stream data of the assistant speaker overlap for 12 seconds in a certain time period, if the audio stream data of the assistant speaker is directly spliced ​​after the audio stream data of the main speaker, the target audio stream obtained by splicing the two overlapping audio stream data will become 12s*2=24 seconds in timing. This will cause the audio stream received by user A to be out of sync with the actual meeting time in timing.

[0148] Therefore, in the embodiments of the present disclosure, before splicing multiple audio stream data, each audio stream data needs to be compressed in terms of time sequence to ensure that the total duration of the target audio stream is consistent with the actual duration. Thus, in the resulting target audio stream, the ratio of each audio stream data segment to the entire target audio stream duration is referred to as the time fraction in the present disclosure.

[0149] After obtaining the time proportion of each audio stream data, each audio stream data can be processed according to the time proportion of each audio stream data to obtain the corresponding audio playback data. Figure 8 The implementation method is described.

[0150] like Figure 8 As shown, in some embodiments, the audio data processing method of the present disclosure example processes the audio stream data according to the time ratio of each audio stream data, including:

[0151] S721: Determine the duration of each audio stream data according to the total duration of the target audio stream and the time ratio of each audio stream data.

[0152] S722: Adjust the playback speed of the audio stream data according to the duration of each audio stream data to obtain audio playback data corresponding to the audio stream data.

[0153] In the disclosed embodiment, the total duration of the target audio stream can be understood as the duration of the overlapping portion of multiple audio stream data in the time domain. In other words, the total duration of the target audio stream is the same as the overlapping duration of the multiple audio stream data. In this way, the target audio stream obtained can include the complete voice information of each audio stream data without causing the problem of audio signal timing asynchrony.

[0154] For each audio stream data, after obtaining the total duration of the target audio stream data, the duration of the audio stream data in the target audio stream can be determined according to the corresponding time ratio, and then the playback speed of the audio stream data can be adjusted accordingly based on the duration to obtain the corresponding audio playback data.

[0155] For example, in the above-mentioned conference scenario, in one example, considering that the speaker's voice priority is higher than that of the assistant speaker, user A can pre-set the time proportion of the audio stream data generated by the speaker's speech to 2 / 3, and the time proportion of the audio stream data generated by the assistant speaker's speech to 1 / 3 in the preset control instructions.

[0156] like Figure 9 As shown in (a), the audio stream data generated by the speaker's speech is audio stream 3, and the audio stream data generated by the assistant speaker's speech is audio stream 4. In a certain time period, audio stream 3 and audio stream 4 overlap for 12 seconds.

[0157] In this example scenario, the preset control instructions indicate that audio stream 3 accounts for 2 / 3 of the time, audio stream 4 accounts for 1 / 3 of the time, and the total duration of the target audio stream is 12 seconds. Therefore, the duration of audio stream 3 in the target audio stream is 12*2 / 3 = 8 seconds, and the duration of audio stream 4 in the target audio stream is 12*1 / 3 = 4 seconds.

[0158] In other words, in the method of the present disclosure, the duration of audio stream 3 needs to be compressed to 8 seconds, and the duration of audio stream 4 needs to be compressed to 4 seconds. On this basis, the playback speed of audio stream 3 and audio stream 4 can be adjusted. For example, the playback speed of audio stream 3 is adjusted to 1.5 times the speed, and the waveform of the audio playback data obtained is as follows: Figure 9 As shown in (b); the playback speed of audio stream 4 is adjusted to 3 times the speed, and the waveform of the audio playback data is as follows Figure 9 As shown in (b).

[0159] In the disclosed embodiment, after obtaining the audio playback data corresponding to each audio stream data, the multiple audio playback data can be spliced ​​and processed in a preset order according to the timing information in the preset control instruction to obtain a final single target audio stream.

[0160] Still Figure 9 For example, the waveform of the audio playback data corresponding to the speaker's audio stream 3 is as follows: Figure 9 As shown in (b), the waveform of the audio playback data corresponding to the audio stream 4 of the assistant speaker is as follows Figure 9 At the same time, in the preset control instructions, the timing information of the main speaker has a higher priority than the timing information of the auxiliary speaker.

[0161] In this example scenario, the audio playback data corresponding to the auxiliary speaker's audio stream 4 can be spliced ​​after the audio playback data corresponding to the main speaker's audio stream 3 in time sequence, and the waveform of the target audio stream obtained is as follows: Figure 9 As shown in (c), it can be seen that in the embodiment of the present disclosure, the total duration of the target audio stream is still 12 seconds, and the user can still synchronize with the actual audio timing after listening to the two audio streams in sequence.

[0162] Of course, those skilled in the art will understand that the above description only takes two audio stream data as an example. In fact, the embodiment of the present disclosure does not limit the number of audio stream data, and the principle of data processing is the same as above, which will not be further enumerated in this disclosure.

[0163] From the above, it can be seen that in the embodiment of the present disclosure, multiple audio stream data overlapping in the time domain can be processed into a single audio stream continuous in the time domain, while ensuring the timing synchronization of the audio information, the integrity of the audio information is improved, so that the user can obtain complete information of multiple audio stream data.

[0164] In addition, it is worth noting that in the above-mentioned example implementation of the present disclosure, the audio stream data processing process in some scenarios is described, but it can be understood that the method of the present disclosure is not limited to the above-mentioned examples, and any other processing method suitable for implementation can also be implemented.

[0165] For example, in some embodiments, when the audio receiving device includes multiple speakers (for example, TWS headphones include two speakers for the left and right ears, and wireless speakers include multiple independent speakers, etc.), each audio stream data can be processed and then the individual audio stream data can be separated and played to multiple speakers. In addition, when the audio stream data has spatial attributes, the spatial attributes of the audio stream can be further combined to achieve independent control of the spatial audio of multiple audio stream data. Those skilled in the art can understand and fully implement it based on the above disclosure, and this disclosure will not go into details.

[0166] As can be seen from the foregoing, the disclosed embodiments enable the parallel transmission and reception of multiple audio streams in wireless short-range communication, and each audio stream can be independently processed and controlled, achieving a wider range of audio playback effects and enriching audio functionality. Furthermore, multiple audio streams that overlap in the temporal domain can be processed into a single, continuous audio stream. This ensures the timing synchronization of the audio information while improving the integrity of the audio information, allowing users to obtain complete information from multiple audio streams.

[0167] exist Figure 1 Based on the example audio communication system, the embodiment of the present disclosure provides an audio data processing method, which can be applied to the audio sending device 100 in the above example. Figure 10 Provide explanation.

[0168] like Figure 10 As shown, in some embodiments, the audio data processing method of the present disclosure is performed by the audio sending device 100, and the method includes:

[0169] S1010: Obtain at least two audio stream data generated by each audio source of an audio sending device.

[0170] S1020: Send at least two audio stream data to an audio receiving device via wireless short-range communication.

[0171] Combine Figure 1 As shown, the audio sending device 100 includes one or more audio sources 110, each of which can generate one or more audio stream data. The embodiment of the present disclosure is mainly aimed at the scenario of simultaneously transmitting multiple audio stream data, and the communication scenario of a single audio stream data is not repeated.

[0172] At the audio transmitting device 100, multiple audio stream data generated by one or more audio sources can be transmitted to the aforementioned audio receiving device 200 via wireless communication. In the embodiments of the present disclosure, the wireless short-range communication method between the audio transmitting device and the audio receiving device can be any method with sufficient bandwidth that can achieve simultaneous transmission of multiple audio stream data, such as star flash communication, wireless local area network (WiFi) communication, etc., and the present disclosure does not limit this.

[0173] At the audio receiving device 200, after receiving multiple audio stream data, each audio stream data can be independently controlled and processed according to the aforementioned audio data processing method. Those skilled in the art can understand and fully implement the above with reference to the above, and this disclosure will not elaborate on this.

[0174] As can be seen from the foregoing, the disclosed embodiments enable the parallel transmission and reception of multiple audio streams in wireless short-range communication, and each audio stream can be independently processed and controlled, achieving a wider range of audio playback effects and enriching audio functionality. Furthermore, multiple audio streams that overlap in the temporal domain can be processed into a single, continuous audio stream. This ensures the timing synchronization of the audio information while improving the integrity of the audio information, allowing users to obtain complete information from multiple audio streams.

[0175] An embodiment of the present disclosure provides an audio communication system, which may be a communication system based on the Star Flash communication protocol standard.

[0176] See also Figure 1 As shown, in some embodiments, the audio communication system includes an audio transmitting device 100 and an audio receiving device 200. The audio transmitting device 100 may include one or more audio sources 110, and the audio receiving device 200 may include one or more audio sinks 210. One or more audio stream data may be transmitted in parallel between an audio source 110 and an audio sink 210.

[0177] The audio transmitting device 100 and the audio receiving device 200 further include a processor and a memory. The memory is used as a data storage device to store computer instructions of any of the above-mentioned embodiments, so that the processor can execute the audio data processing method of the above-mentioned embodiment according to the computer instructions. Those skilled in the art can understand and fully implement it with reference to the above, and this disclosure will not elaborate on this.

[0178] In some embodiments, the present disclosure provides an audio data processing device, which can be applied to the audio receiving device 200 in the above example. Figure 11 Provide explanation.

[0179] like Figure 11 As shown, in some embodiments, the audio data processing device of the present disclosure example includes:

[0180] The data receiving module 10 is configured to receive at least two audio stream data sent by the audio sending device via wireless short-range communication;

[0181] The data processing module 20 is configured to process at least one of the at least two audio stream data based on a preset control instruction to obtain a target audio stream.

[0182] From the above, it can be seen that in the embodiments of the present disclosure, parallel transmission and reception of multiple audio stream data are achieved in wireless short-range communication, and each audio stream data can be independently processed and controlled to achieve more audio playback effects and enrich audio functions.

[0183] In some embodiments, the data processing module 20 is configured to:

[0184] Based on the preset control instructions, determine the timing information and time ratio of each audio stream data;

[0185] Compress each audio stream data according to the time ratio to obtain the audio playback data corresponding to each audio stream data;

[0186] The audio playback data are spliced ​​in time sequence according to the timing information to obtain the target audio stream.

[0187] In some embodiments, the data processing module 20 is configured to:

[0188] Determine the duration of each audio stream data based on the total duration of the target audio stream and the time ratio of each audio stream data;

[0189] According to the duration of each audio stream data, the playback speed of the audio stream data is adjusted to obtain audio playback data corresponding to the audio stream data.

[0190] In some embodiments, the wireless communication method includes star flash communication.

[0191] From the above, it can be seen that in the embodiment of the present disclosure, multiple audio stream data overlapping in the time domain can be processed into a single audio stream continuous in the time domain, while ensuring the timing synchronization of the audio information, the integrity of the audio information is improved, so that the user can obtain complete information of multiple audio stream data.

[0192] In some embodiments, the data processing module 20 is configured to:

[0193] According to the data identifier included in the preset control instruction, target audio stream data corresponding to the data identifier is determined from at least two audio stream data.

[0194] In some embodiments, the data processing module 20 is configured to:

[0195] Parse each audio stream data to obtain identification information carried by the audio stream data;

[0196] A data identifier corresponding to the audio stream data is generated according to the identification information, and the data identifier is assigned to the audio stream data.

[0197] In some implementations, the identification information of the audio stream data includes a first identification of an audio sending device, a second identification of an audio source corresponding to the audio stream data, and a third identification corresponding to the audio stream data.

[0198] From the above, it can be seen that in the embodiments of the present disclosure, the audio receiving device can assign addresses to each audio stream data according to identification information at different levels, thereby achieving data identification standardization of audio stream data and improving the traceability analysis capability of audio stream data.

[0199] In some embodiments, the data processing module 20 is configured to:

[0200] According to the playback control instructions included in the preset control instructions, the audio playback parameters of the target audio stream data are adjusted to obtain the target audio stream.

[0201] From the above, it can be seen that in the embodiments of the present disclosure, parallel transmission and reception of multiple audio stream data are achieved in wireless short-range communication, and each audio stream data can be independently processed and controlled to achieve more audio playback effects and enrich audio functions.

[0202] In some embodiments, the present disclosure provides an audio data processing device, which can be applied to the audio sending device 100 in the above example. Figure 12 Provide explanation.

[0203] like Figure 12 As shown, in some embodiments, the audio data processing device of the present disclosure example includes:

[0204] The data acquisition module 30 is configured to acquire at least two audio stream data generated by each audio source of the audio sending device;

[0205] The data sending module 40 is configured to send the audio stream data to the audio receiving device via wireless communication.

[0206] In some embodiments, the wireless short-range communication method includes star flash communication.

[0207] As can be seen from the foregoing, the disclosed embodiments enable the parallel transmission and reception of multiple audio streams in wireless short-range communication, and each audio stream can be independently processed and controlled, achieving a wider range of audio playback effects and enriching audio functionality. Furthermore, multiple audio streams that overlap in the temporal domain can be processed into a single, continuous audio stream. This ensures the timing synchronization of the audio information while improving the integrity of the audio information, allowing users to obtain complete information from multiple audio streams.

[0208] In some embodiments, the present disclosure provides a storage medium storing computer instructions, where the computer instructions are used to cause a computer to execute the method in any of the above embodiments.

[0209] Figure 13The mobile terminal structure in some embodiments of the present disclosure is shown in FIG. The mobile terminal can be used as the aforementioned audio sending device 100 or as an audio receiving device 200. Figure 13 The mobile terminals according to some embodiments of the present disclosure are described.

[0210] Reference Figure 13 , the mobile terminal 1800 may include one or more of the following components: a processing component 1802 , a memory 1804 , a power component 1806 , a multimedia component 1808 , an audio component 1810 , an input / output (I / O) interface 1812 , a sensor component 1816 , and a communication component 1818 .

[0211] The processing component 1802 generally controls the overall operation of the mobile terminal 1800, such as operations associated with the display, phone calls, data communications, camera operation, and recording operations. The processing component 1802 may include one or more processors 1820 to execute instructions. In addition, the processing component 1802 may include one or more modules to facilitate interaction between the processing component 1802 and other components. For example, the processing component 1802 may include a multimedia module to facilitate interaction between the multimedia component 1808 and the processing component 1802. As another example, the processing component 1802 may read executable instructions from memory to implement mobile terminal-related functions.

[0212] The memory 1804 is configured to store various types of data to support the operations of the mobile terminal 1800. Examples of such data include instructions for any application or method operating on the mobile terminal 1800, contact data, phone book data, messages, pictures, videos, etc. The memory 1804 can be implemented by any type of volatile or non-volatile memory device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0213] The power component 1806 provides power to various components of the mobile terminal 1800. The power component 1806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the mobile terminal 1800.

[0214] The multimedia component 1808 includes a display screen that provides an output interface between the mobile terminal 1800 and the user. In some embodiments, the multimedia component 1808 includes a front-facing camera and / or a rear-facing camera. When the mobile terminal 1800 is in an operating mode, such as a capture mode or a video mode, the front-facing camera and / or the rear-facing camera can receive external multimedia data. Each of the front-facing camera and the rear-facing camera can have a fixed optical lens system or have a variable focal length and optical zoom capability.

[0215] The audio component 1810 is configured to output and / or input audio signals. For example, the audio component 1810 includes a microphone (MIC), which is configured to receive external audio signals when the mobile terminal 1800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 1804 or transmitted via the communication component 1818. In some embodiments, the audio component 1810 also includes a speaker for outputting audio signals.

[0216] I / O interface 1812 provides an interface between processing component 1802 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0217] Sensor assembly 1816 includes one or more sensors for providing various aspects of the status assessment of mobile terminal 1800. For example, sensor assembly 1816 can detect the open / closed state of mobile terminal 1800, the relative positioning of components, such as the display and keypad of mobile terminal 1800. Sensor assembly 1816 can also detect changes in the position of mobile terminal 1800 or a component of mobile terminal 1800, the presence or absence of user contact with mobile terminal 1800, the orientation or acceleration / deceleration of mobile terminal 1800, and changes in the temperature of mobile terminal 1800. Sensor assembly 1816 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1816 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 1816 can also include an accelerometer, a gyroscope, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0218] The communication component 1818 is configured to facilitate wired or wireless communication between the mobile terminal 1800 and other devices. The mobile terminal 1800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G, 3G, 4G, 5G or 6G, or a combination thereof. In an exemplary embodiment, the communication component 1818 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1818 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, Star Flash communication technology and other technologies.

[0219] In an exemplary embodiment, the mobile terminal 1800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components.

[0220] Obviously, the above embodiments are merely examples for clarity of explanation and are not intended to limit the embodiments. Those skilled in the art will appreciate that other variations or modifications can be made based on the above description. It is not necessary and impossible to enumerate all embodiments here. Obvious variations or modifications arising therefrom remain within the scope of protection of the present disclosure.

Claims

1. A method for processing audio data, characterized in that: Applied to an audio receiving device, the method includes: receiving at least two audio stream data sent by an audio sending device via a wireless short-range communication method; Based on a preset control instruction, processing at least one audio stream data of the at least two audio stream data to obtain a target audio stream; The step of processing at least one of the at least two audio stream data based on a preset control instruction to obtain a target audio stream includes: Determining the timing information and time ratio of each of the audio stream data based on the preset control instruction; Determine the duration of each audio stream data according to the total duration of the target audio stream and the time ratio of each audio stream data; Adjusting the playback speed of the audio stream data according to the duration of each audio stream data to obtain audio playback data corresponding to the audio stream data; The audio playback data are spliced ​​in time sequence according to the time sequence information to obtain the target audio stream.

2. The method according to claim 1, characterized in that The method further comprises: According to the data identifier included in the preset control instruction, target audio stream data corresponding to the data identifier is determined from the at least two audio stream data.

3. The method according to claim 2, characterized in that The method further comprises: Parsing each of the audio stream data to obtain identification information carried by the audio stream data; A data identifier corresponding to the audio stream data is generated according to the identification information, and the data identifier is assigned to the audio stream data.

4. The method according to claim 3, characterized in that The identification information of the audio stream data includes a first identification of the audio sending device, a second identification of an audio source corresponding to the audio stream data, and a third identification corresponding to the audio stream data.

5. The method according to claim 2, characterized in that The method further comprises: According to the playback control instruction included in the preset control instruction, the audio playback parameters of the target audio stream data are adjusted to obtain the target audio stream.

6. The method according to claim 1, characterized in that The wireless short-range communication method includes star flash communication and / or wireless local area network communication.

7. A method for processing audio data, characterized in that: Applied to an audio sending device, the method includes: Acquire at least two audio stream data generated by respective audio sources of the audio sending device; The at least two audio stream data are sent to an audio receiving device via wireless short-range communication, so that the audio receiving device executes the method according to any one of claims 1 to 6.

8. The method according to claim 7, characterized in that The wireless short-range communication method includes star flash communication.

9. An audio communication system, characterized in that: include: An audio sending device, comprising at least one audio source, each of the audio sources being configured to generate at least one audio stream data; an audio receiving device connected to the audio sending device via a wireless short-range communication method, the audio receiving device comprising at least one audio sink configured to receive the at least one audio stream data; The audio receiving device further includes a processor and a memory, wherein the processor is communicatively connected to the memory, and the memory stores computer instructions, and the computer instructions are used to enable the processor to execute the method according to any one of claims 1 to 6.

10. An audio data processing device, characterized in that: Applied to an audio receiving device, the device comprises: A data receiving module is configured to receive at least two audio stream data sent by an audio sending device via a wireless short-range communication method; a data processing module configured to process at least one of the at least two audio stream data based on a preset control instruction to obtain a target audio stream; The data processing module is configured to: Determining the timing information and time ratio of each of the audio stream data based on the preset control instruction; Determine the duration of each audio stream data according to the total duration of the target audio stream and the time ratio of each audio stream data; Adjusting the playback speed of the audio stream data according to the duration of each audio stream data to obtain audio playback data corresponding to the audio stream data; The audio playback data are spliced ​​in time sequence according to the time sequence information to obtain the target audio stream.

11. An audio data processing device, characterized in that: Applied to an audio transmitting device, the device comprises: a data acquisition module, configured to acquire at least two audio stream data generated by respective audio sources of the audio sending device; The data sending module is configured to send the audio stream data to an audio receiving device through a wireless short-range communication method, so that the audio receiving device executes the method according to any one of claims 1 to 6.

12. A storage medium, characterized in that: Computer instructions are stored, and the computer instructions are used to make a computer execute the method according to any one of claims 1 to 8.

Images