Bluetooth audio dynamic sound mixing processing method, device and system

Abstract

The embodiment of the invention provides a Bluetooth audio dynamic sound mixing processing method, device and system. The method comprises the following steps: acquiring external audio data; performing sound mixing processing on the external audio data and internal prompt audio data to obtain audio data to be transmitted; and determining the corresponding to-be-transmitted audio data based on a preset operation requirement and outputting the to-be-transmitted audio data to target equipment. According to the method, the external audio data and the internal prompt audio data are subjected to audio mixing processing, and proper audio data are output in real time according to different operation requirements, so that the flexibility and adaptability of audio output are improved, the processing flow is simplified, the requirement for hardware resources is reduced, and the response speed and efficiency of the system are improved.

Description

Technical Field

[0001] The present invention relates to the field of audio processing, and in particular to a Bluetooth audio dynamic mixing processing method, device, system, electronic equipment and storage medium thereof. Background Art

[0002] In the prior art, the processing and transmission of audio data often involves a combination of external audio input and internal audio prompts.

[0003] The existing Bluetooth audio dynamic mixing processing methods often have limitations in dealing with complex and changeable application scenarios and personalized needs, especially in terms of how to effectively mix and process these audio data and output appropriate audio data in real time according to different operation requirements. Therefore, the existing Bluetooth audio dynamic mixing processing methods have insufficient flexibility and precision and cannot well meet the problems of diverse application scenarios and personalized needs. Summary of the invention

[0004] The embodiment of the present invention provides a Bluetooth audio dynamic mixing processing method to solve the problem that the existing Bluetooth audio dynamic mixing processing method has insufficient flexibility and precision and cannot well meet the diverse application scenarios and personalized needs.

[0005] In a first aspect, an embodiment of the present invention provides a Bluetooth audio dynamic mixing processing method, the method comprising the following steps: Get external audio data; Mixing the external audio data with the internal prompt audio data to obtain audio data to be transmitted; Based on the preset operation requirements, the corresponding audio data to be transmitted is determined and output to the target device.

[0006] Optionally, the acquiring of external audio data includes: The external audio is collected by a sound receiving device to obtain corresponding external audio data to be decoded; After preprocessing and decoding the external audio data to be decoded, the external audio data is obtained.

[0007] Optionally, before mixing the external audio data with the internal prompt audio data to obtain the audio data to be transmitted, the method further includes: Identify the current internal audio database and determine the corresponding audio domain data, wherein the audio domain data includes the tone, pitch, and audio category corresponding to the internal audio data; Based on the tone, pitch and audio category, the internal prompt audio data in the current internal audio database is decoded and identified to obtain the internal prompt audio in a corresponding format.

[0008] Optionally, mixing the external audio data with the internal prompt audio data to obtain the audio data to be transmitted includes: Extracting the audio streams of the external audio data and the internal prompt audio data respectively to obtain a first audio stream corresponding to the external audio data and a second audio stream corresponding to the internal prompt audio data; Resampling the first audio stream and the second audio stream to determine matching data of the first audio stream and the second audio stream, wherein the matching data includes a format, a volume, and a number of channels of the audio stream; The first audio stream and the second audio stream are combined and processed according to the format, volume, and number of channels of the audio stream to obtain audio data to be transmitted.

[0009] Optionally, the merging the first audio stream and the second audio stream according to the format, volume, and number of channels of the audio stream to obtain audio data to be transmitted includes: Determine corresponding weighted mixing parameters based on the volume and the number of channels of the first audio stream and the second audio stream; Based on the weighted mixing parameters, the volume and the number of channels of the merged first audio stream and the second audio stream are adjusted, and after the adjustment, the first audio stream and the second audio stream are merged to obtain audio data to be transmitted.

[0010] Optionally, the determining, based on a preset operation requirement, the corresponding audio data to be transmitted and outputting it to a target device includes: The preset operation requirement is detected in real time, and when the preset operation requirement is detected to be triggered, audio data to be transmitted corresponding to the preset operation requirement is generated, and the audio data to be transmitted is output to the target device.

[0011] In a second aspect, an embodiment of the present invention further provides a Bluetooth audio dynamic mixing processing device, the Bluetooth audio dynamic mixing processing device comprising: A first acquisition module, used to acquire external audio data; A second acquisition module is used to mix the external audio data with the internal prompt audio data to obtain the audio data to be transmitted; The first determination module is used to determine the corresponding audio data to be transmitted based on a preset operation requirement and output it to a target device.

[0012] In a third aspect, an embodiment of the present invention further provides a Bluetooth audio dynamic mixing processing system, which includes: a Bluetooth audio dynamic mixing processing device, a server, and a smart terminal.

[0013] In a fourth aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the Bluetooth audio dynamic mixing processing method provided in the embodiment of the present invention when executing the computer program.

[0014] In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps in the Bluetooth audio dynamic mixing processing method provided in the embodiment of the invention are implemented.

[0015] In an embodiment of the present invention, external audio data is obtained; the external audio data is mixed with the internal prompt audio data to obtain the audio data to be transmitted; based on the preset operation requirements, the corresponding audio data to be transmitted is determined and output to the target device. By the above method, the external audio data and the internal prompt audio data are mixed, and the appropriate audio data is output in real time according to different operation requirements, which improves the flexibility and adaptability of the audio output, simplifies the processing flow, reduces the demand for hardware resources, and thus improves the response speed and efficiency of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 It is an architecture diagram of a Bluetooth audio dynamic mixing processing system provided by an embodiment of the present invention; Figure 2 It is a flowchart of a method for processing dynamic mixing of Bluetooth audio in a scene mode provided by an embodiment of the present invention; Figure 3 It is a flowchart of another method for processing dynamic mixing of Bluetooth audio in a scene mode improved by an embodiment of the present invention; Figure 4 It is a flowchart of a Bluetooth audio dynamic mixing processing method improved by an embodiment of the present invention; Figure 5 It is a structural schematic diagram of a Bluetooth audio dynamic mixing processing device provided in an embodiment of the present invention; Figure 6 It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0018] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0019] like Figure 1 As shown, Figure 1 It is an architecture diagram of a Bluetooth audio dynamic mixing processing system 100 provided by an embodiment of the present invention, and the Bluetooth audio dynamic mixing processing system includes: a Bluetooth audio dynamic mixing processing device 400, a server 101, and a target device 102. Among them, the above-mentioned Bluetooth audio dynamic mixing processing device 400 also includes a first acquisition module, which can be used to acquire external audio data; a second acquisition module, which can be used to mix the external audio data with the internal prompt audio data to obtain the audio data to be transmitted; a first determination module, which can be used to determine the corresponding audio data to be transmitted based on the preset operation requirements and output it to the target device.

[0020] Specifically, the above-mentioned target device may include but is not limited to a transmitter and a receiver and any smart device that can acquire external audio and mix and output it with internal prompt audio data, and the smart device's audio data reception and transmission method may include but is not limited to wireless modes such as Bluetooth and WiFi, such as Bluetooth transmitters, Bluetooth receivers, Bluetooth headsets, Bluetooth speakers, etc.

[0021] The above-mentioned external audio data can be the audio data collected by the above-mentioned target device through the sound receiving device, or the audio data that needs to be processed according to the above-mentioned Bluetooth audio dynamic mixing processing system. Specifically, it can be a custom voice and text content designed according to specific demand actions, or it can be the audio data prepared for the content of a certain instruction after the receiving device in the above-mentioned target device specifically receives the instruction. For example, when the receiving device receives an instruction to increase the volume, the corresponding audio data of "volume increase" is prepared, or when the receiving device receives an instruction to increase the voice call volume, the corresponding audio data of "lowering the current music volume" is prepared.

[0022] The internal prompt audio data can be determined according to the target device selected above. Generally speaking, the internal prompt audio data is the built-in audio data of the target device when it leaves the factory. It should be noted that the internal prompt audio data is usually automatically generated according to the preset rules or operation status of the target device, and does not depend on external input and modification. For example, it can be the notification sound inside the Bluetooth transmitter, the battery alarm sound, etc.

[0023] The above mixing process can be explained by the following two scenarios. The first scenario is to add a speaker or other sound device to the transmitting device in the above target device. When voice prompts are required, the audio data inside the target device is decoded and output to the speaker or other sound device, thereby achieving the purpose of outputting audio on the transmitting device that cannot make sound. Specifically, this scenario can be explained by Figure 2 It is understood that the decoding and output of audio data and the audio output of the transmitting device are two independent threads, that is, the voice prompt is an independent thread operation, and the transmitting device sending audio data to the receiving device is another independent thread operation; The second scenario is when the transmitting device transmits audio to the receiving device and needs to produce physical sound, you can use the following method to Figure 3 As shown, at this time, the built-in audio data is decoded by the above-mentioned Bluetooth audio dynamic mixing processing system, and then the decoded built-in prompt audio data is mixed with the external audio data to be transmitted, and the mixed audio data is output. Specifically, in this scenario, the extraction and mixing of voice prompts is not an independent thread operation, but a parallel operation with the transmitting device sending the audio data to the receiving device, and the internal prompt audio data is mixed after decoding.

[0024] More specifically, the above Figure 3 The steps are detailed, including: S1. The Bluetooth audio dynamic mixing processing system is initialized and detects the memory matching status. If there is no pairing record, it automatically enters the pairing state and waits for the target receiving device to connect. If it has not been connected, the system will automatically count whether it needs to shut down automatically.

[0025] S2, after the target transmitting device is connected to the target receiving device, the currently used audio input method is detected, for example, the audio is transmitted to the target receiving device via wireless transmission; S3, after receiving the transmission signal, create and modify the Bluetooth audio DSP link, add a mixing module, and dynamically detect whether the audio stream needs to be merged through the mixing module; S4. When the user operates the target transmitting device, such as adjusting the volume, switching the sound effects, low-power reminder, switching other modes, etc., the target transmitting device triggers audio decoding and decodes the local built-in prompt audio data or Tone sound; S5. At the beginning of decoding, first create a DSP link for the built-in prompt audio data. Then, because the decoded voice sampling rate is the sampling rate of the built-in compressed file, it may be 8K, 16K, 48K, etc., and the sampling rate of the sound source input may be 44.1K, 48K, 88.2K, 96K, 176.2K, 196K, etc., it is necessary to resample the decoded built-in prompt audio data and the external audio data to ensure that the sampling rates of the two can match. Therefore, it is necessary to create an audio decoding module and an audio resampling module. Then, the audio is mixed to obtain an audio with a fixed sampling rate. At this time, it is necessary to use the sampling rate after interacting with the connected Bluetooth receiving device, and it is necessary to resample again. S6. When the decoding prompt sound is finished, the prompt sound DSP link is to be destroyed. It should be noted that when creating and destroying the prompt sound DSP link, since the DSP link is an independent link, it will not affect the DSP link of the audio transmission; S7, encode, the encoding format is the encoding format after the interaction with the connected target receiving device, common formats are Sbc, aptX, aptX -HD, aptX -LowLatency, aptX-Adaptive, aptX-Lossless, Ldac, Lhdc, etc., after encoding, it is sent through wireless means such as Bluetooth and wifi; It should be noted that when there is a decoding prompt sound, the target receiving device can not only receive the prompt sound other than the sound source input (AUX / USB / I2S / SPIDF), but also receive the audio data output by merging the prompt sound with the sound source, and can also adjust the size of a certain channel by merging in the above-mentioned MIX module. It can also mute the sound of the sound source when the prompt sound is issued to ensure the clarity of the prompt sound. Because the prompt sound DSP link needs to be transmitted wirelessly, when the infinite audio is disconnected, in addition to destroying the wireless audio DSP link, it is also necessary to pay attention to whether the prompt sound DSP link exists. If it exists, it can be destroyed together.

[0026] The above-mentioned audio data to be transmitted may refer to audio data after mixing processing, and generally speaking, may be synthesized by adjusting the corresponding volume of external audio data and internal prompt audio data. At this time, the audio data to be transmitted is prepared to match the transmitting device in the target device through operations such as resampling, and is in a state of not being played or transmitted.

[0027] The above-mentioned preset operation requirements can be a series of rules and requirements that can be automatically triggered or customized according to different scenarios, user operation actions, device status and other events. The preset operation requirements automatically select suitable audio data and transmit it to the target device for playback or output.

[0028] In a possible embodiment, the Bluetooth audio dynamic mixing processing system obtains external audio data; mixes the external audio data with the internal prompt audio data to obtain the audio data to be transmitted; based on the preset operation requirements, the corresponding audio data to be transmitted is determined and output to the target device. The above method mixes the external audio data and the internal prompt audio data, and outputs the appropriate audio data in real time according to different operation requirements, which improves the flexibility and adaptability of the audio output, simplifies the processing flow, reduces the demand for hardware resources, and thus improves the response speed and efficiency of the system.

[0029] like Figure 4 As shown, Figure 4 1 is a flowchart of a Bluetooth audio dynamic mixing processing method provided by an embodiment of the present invention, and the Bluetooth audio dynamic mixing processing method comprises the steps of: 401. Obtain external audio data.

[0030] In an embodiment of the present invention, the above-mentioned Bluetooth audio dynamic mixing processing method can be applied to the above-mentioned Bluetooth audio dynamic mixing processing system. The above-mentioned Bluetooth audio dynamic mixing processing system has functions such as audio data processing, audio data transmission and reception, and audio data memory storage, and can be constructed based on a server or a server cluster. The above-mentioned server or server cluster can be an electronic device with audio data processing capabilities.

[0031] The above-mentioned external audio data can be the audio data collected by the above-mentioned target device through the sound receiving device, or the audio data that needs to be processed according to the above-mentioned Bluetooth audio dynamic mixing processing system. Specifically, it can be a custom voice and text content designed according to specific demand actions, or it can be the audio data prepared for the content of a certain instruction after the receiving device in the above-mentioned target device specifically receives the instruction. For example, when the receiving device receives an instruction to increase the volume, the corresponding audio data of "volume increase" is prepared, or when the receiving device receives an instruction to increase the voice call volume, the corresponding audio data of "lowering the current music volume" is prepared.

[0032] 402. Mix the external audio data with the internal prompt audio data to obtain audio data to be transmitted.

[0033] In the embodiment of the present invention, the internal prompt audio data can be determined according to the target device selected above. Generally speaking, the internal prompt audio data is the built-in audio data of the target device when it leaves the factory. It should be noted that the internal prompt audio data is usually automatically generated according to the preset rules or operation status of the target device, and does not depend on external input and modification. For example, it can be the notification sound inside the Bluetooth transmitter, the alarm sound of the battery level, etc.

[0034] The above-mentioned audio data to be transmitted may refer to audio data after mixing processing, and generally speaking, may be synthesized by adjusting the corresponding volume of external audio data and internal prompt audio data. At this time, the audio data to be transmitted is prepared to match the transmitting device in the target device through operations such as resampling, and is in a state of not being played or transmitted.

[0035] The above-mentioned mixing processing process can be illustrated by the following two scenarios. The first scenario is to add a speaker or other sound-emitting device to the transmitting device in the above-mentioned target device. When voice prompts are required, the audio data inside the target device is decoded and output to the speaker or other sound-emitting devices, thereby achieving the purpose of outputting audio on the transmitting device that cannot produce sound.

[0036] Through the above mixing processing, the flexibility and adaptability of audio output are improved, ensuring high-quality audio feedback in different operating environments.

[0037] 403. Based on the preset operation requirement, determine the corresponding audio data to be transmitted and output it to the target device.

[0038] The above-mentioned preset operation requirements can be a series of rules and requirements that can be automatically triggered or customized according to different scenarios, user operation actions, device status and other events. The preset operation requirements automatically select suitable audio data and transmit it to the target device for playback or output.

[0039] In a possible embodiment, the Bluetooth audio dynamic mixing processing system obtains external audio data; mixes the external audio data with the internal prompt audio data to obtain the audio data to be transmitted; based on the preset operation requirements, the corresponding audio data to be transmitted is determined and output to the target device. The above method mixes the external audio data and the internal prompt audio data, and outputs the appropriate audio data in real time according to different operation requirements, which improves the flexibility and adaptability of the audio output, simplifies the processing flow, reduces the demand for hardware resources, and thus improves the response speed and efficiency of the system.

[0040] In the embodiment of the present invention, external audio data is obtained; the external audio data is mixed with the internal prompt audio data to obtain the audio data to be transmitted; based on the preset operation requirements, the corresponding audio data to be transmitted is determined and output to the target device. Through the above method, the external audio data and the internal prompt audio data are mixed, and the appropriate audio data is output in real time according to different operation requirements, which improves the flexibility and adaptability of the audio output, simplifies the processing flow, reduces the demand for hardware resources, and thus improves the response speed and efficiency of the system.

[0041] Optionally, in the step of obtaining external audio data, it also includes collecting external audio through a sound receiving device to obtain corresponding external audio data to be decoded; and preprocessing and decoding the external audio data to be decoded to obtain external audio data.

[0042] In an embodiment of the present invention, the above-mentioned preprocessing may refer to an audio quality improvement operation before decoding the above-mentioned external audio data to be decoded. Specifically, it may be performed through operations such as noise removal, gain adjustment and time alignment, thereby improving the audio quality of the above-mentioned external audio data to be decoded.

[0043] The above-mentioned noise removal can remove the background noise and interference signals of the above-mentioned external audio data to be decoded by filtering, algorithmic noise reduction, etc.; the above-mentioned gain adjustment can adjust the signal strength of the above-mentioned external audio data to be decoded, so as to obtain the above-mentioned external audio data to be decoded with a larger volume or signal; the above-mentioned time alignment can be based on the current scene of the above-mentioned external audio data to be decoded, for example, when processing multi-channel or multi-channel audio data, by aligning the signals of the audio data of each channel to ensure that the audio data received by each channel is not delayed or advanced, thereby reducing the possibility of errors in subsequent audio data during the mixing process.

[0044] In a possible embodiment, the Bluetooth audio dynamic mixing processing system collects external audio through a sound receiving device (such as a microphone, an audio interface, etc.) to obtain external audio data to be decoded, and pre-processes the external audio data to be decoded before decoding it to generate corresponding external audio data.

[0045] Optionally, the step before mixing the external audio data with the internal prompt audio data to obtain the audio data to be transmitted also includes identifying the current internal audio database to determine the corresponding audio domain data; based on the tone, pitch, and audio category, decoding and identifying the internal prompt audio data in the current internal audio database to obtain the internal prompt audio in the corresponding format.

[0046] In an embodiment of the present invention, the above-mentioned internal audio database can be a collection of audio data for storing and managing, such as a collection of audio data such as the above-mentioned internal prompt audio data, collected external audio data, etc. Specifically, it can cover multiple categories of audio data such as prompt sounds, warning sounds, notification sounds, background sound effects, etc. These audio data are stored in a highly structured manner to facilitate the system to quickly identify, retrieve and process them.

[0047] The above-mentioned internal audio database can also analyze the user's historical operations and the corresponding audio data according to the above-mentioned Bluetooth audio dynamic mixing processing system, determine which audio data is more appropriate in the corresponding scenario, and dynamically modify the weighted mixing parameters of the audio data in real time according to the analysis results. According to the weighted mixing parameters, the proportion of audio data during mixing can be adjusted in the corresponding scenario. For example, during a voice call, the weight of the call voice and the music sound can be increased during the mixing process, and the weight of the music sound can be reduced.

[0048] The above-mentioned audio domain data may include but is not limited to the tone, pitch, and audio category corresponding to the internal audio data. It is understandable that the above-mentioned audio domain data is not limited to the waveform or spectrum information of the audio signal itself, but includes various high-level features and contextual information of the audio, so that the above-mentioned Bluetooth audio dynamic mixing processing system can make intelligent audio selection and processing decisions in different application scenarios. Specifically, the above-mentioned Bluetooth audio dynamic mixing processing system identifies multi-dimensional audio features in the audio domain data, such as the tone, pitch, audio category, and usage scenario of the audio data, and determines the corresponding internal prompt audio. For example, since the current internal prompt audio has the direction of AI development and has more voice content that tends to be supported by human emotions, the above-mentioned method can be used to identify and confirm the audio data in multiple dimensions to obtain the corresponding internal prompt audio data.

[0049] Optionally, in the step of mixing the external audio data with the internal prompt audio data to obtain the audio data to be transmitted, the step also includes respectively extracting the audio streams of the external audio data and the internal prompt audio data to obtain a first audio stream corresponding to the external audio data and a second audio stream corresponding to the internal prompt audio data; resampling the first audio stream and the second audio stream to determine matching data of the first audio stream and the second audio stream, the matching data including the format, volume and number of channels of the audio stream; and merging the first audio stream and the second audio stream according to the format, volume and number of channels of the audio stream to obtain the audio data to be transmitted.

[0050] In an embodiment of the present invention, the above-mentioned audio stream may refer to an audio data stream that is continuous in time series, which is a basic unit of an audio signal that exists in a digital or analog form during transmission or processing. Specifically, in the mixing process, since the above-mentioned first audio stream and the second audio stream are audio streams from different sound sources, when mixing the two, it is necessary to consider the time alignment of the two, that is, the process of the above-mentioned time alignment operation.

[0051] The first audio stream may be an original audio signal collected by a sound collecting device, and the second audio stream may be prompt audio data pre-generated or stored by the target device.

[0052] In order to ensure that the above-mentioned audio streams can be effectively combined during the mixing process, the above-mentioned first audio stream and the second audio stream can be processed through the above-mentioned resampling process, so that the two can match in data format, audio quality and playback effect, and match the corresponding receiving device, thereby completing the audio data output process.

[0053] In a possible embodiment, the above-mentioned Bluetooth audio dynamic mixing processing system generates the above-mentioned audio data to be transmitted by merging the first audio stream and the second audio stream according to a preset algorithm or rule for mixing processing. It can be understood that during the merging process, the above-mentioned Bluetooth audio dynamic mixing processing system can combine the above-mentioned first audio stream and the second audio stream in a certain proportion according to the above-mentioned preset algorithm or rule, and adjust the output volume and other data of the corresponding audio stream according to the proportion to ensure the clarity of the output audio data and meet the user's needs for the target audio in the current scene. The target audio can be determined according to the current scene. For example, during a voice call, when mixing the call voice and music sound, the volume of the call voice can be increased and the volume of the music sound can be reduced according to demand.

[0054] Optionally, in the step of merging the first audio stream and the second audio stream according to the format, volume and number of channels of the audio stream to obtain the audio data to be transmitted, the step also includes determining corresponding weighted mixing parameters based on the volume and number of channels of the first audio stream and the second audio stream; adjusting the volume and number of channels of the merged first audio stream and the second audio stream based on the weighted mixing parameters, and merging the first audio stream and the second audio stream after the adjustment to obtain the audio data to be transmitted.

[0055] In an embodiment of the present invention, the above-mentioned weighted mixing parameters can be used by the above-mentioned Bluetooth audio dynamic mixing processing system to analyze the user's historical operations and the corresponding audio data, and determine which audio data is more appropriate in the corresponding scenario. Specifically, it can be used to adjust and optimize the parameters of attributes such as volume and number of channels between multiple audio streams (or multiple audio sources).

[0056] In a possible embodiment, the above-mentioned Bluetooth audio dynamic mixing processing system can determine the weighted mixing parameters of the corresponding audio streams according to the characteristics of different audio streams, so as to balance the output effects of the audio streams and make the final mixing results meet the user's requirements for sound quality and effects in the current scenario. It can be understood that the above-mentioned weighted mixing parameters are usually dynamically adjusted based on the relative volume, channel configuration, format and other characteristics of the audio streams.

[0057] More specifically, the above-mentioned weighted mixing parameters can be determined according to the volume, number of channels, frequency, dynamic range and other characteristics of the audio stream. Generally speaking, the weighted mixing parameters are determined mainly based on the characteristics of the volume. For example, according to the user's current application scenario (during a call), when the call voice volume at the output of the Bluetooth headset is adjusted, when the user operates the volume amplification button, the weighted mixing parameters of the prompt sound output in the headset are set to a smaller value, and the weighted mixing parameters of the call voice are set to a larger value, so that the user can know that he is performing an operation to amplify the voice during the call, and the user's voice call will not be covered up.

[0058] Optionally, in the step of determining the corresponding audio data to be transmitted and outputting it to the target device based on the preset operation requirements, it includes real-time detection of the preset operation requirements. When the preset operation requirements are detected to be triggered, the audio data to be transmitted under the corresponding preset operation requirements are generated, and the audio data to be transmitted is output to the target device.

[0059] In an embodiment of the present invention, the above-mentioned preset operation requirements can be a series of rules and requirements that can be automatically triggered or custom-triggered according to different scenarios, user operation actions, device status and other events. The preset operation requirements automatically select suitable audio data and transmit it to the target device for playback or output.

[0060] In a possible embodiment, the Bluetooth audio dynamic mixing processing system detects the preset operation requirements in real time. It can be understood that during the real-time detection process, the Bluetooth audio dynamic mixing processing system continuously monitors the user's input, for example, by detecting the user's buttons, voice commands or action controls, etc. to obtain the corresponding operation requirements. When a certain operation requirement is detected, the preset operation requirement corresponding to the operation is determined according to the preset rules or algorithms, and the corresponding audio data is generated based on the requirement. For example, the Bluetooth audio dynamic mixing processing system will output the corresponding audio data to be sent according to different operation requirements, such as when the user issues a voice command, a voice feedback audio is generated; when the user touches the volume up button, a button pressing sound effect audio is generated. The generated audio data to be transmitted will be adjusted according to the preset format, volume and channel configuration requirements to ensure the quality of the audio output. Finally, the audio data to be transmitted will be output to the target device (such as a speaker, headphones, etc.), responding to user operations in real time to enhance the interactive experience.

[0061] like Figure 5 As shown, the embodiment of the present invention further provides a Bluetooth audio dynamic mixing processing device 500, and the Bluetooth audio dynamic mixing processing device includes: A first acquisition module 501 is used to acquire external audio data; The second acquisition module 502 is used to mix the external audio data with the internal prompt audio data to obtain the audio data to be transmitted; The first determination module 503 is used to determine the corresponding audio data to be transmitted based on a preset operation requirement and output it to a target device.

[0062] Optionally, the first acquisition module 501 includes: A first acquisition submodule is used to collect the external audio through a sound receiving device to obtain corresponding external audio data to be decoded; The second acquisition submodule is used to preprocess and decode the external audio data to be decoded to obtain the external audio data.

[0063] Optionally, the above device further comprises: A second determination module is used to identify the current internal audio database and determine the corresponding audio domain data, wherein the audio domain data includes the tone, pitch, and audio category corresponding to the internal audio data; The third acquisition module is used to decode and identify the internal prompt audio data in the current internal audio database based on the tone, pitch, and audio category to obtain the internal prompt audio in a corresponding format.

[0064] Optionally, the second acquisition module 502 includes: A third acquisition submodule is used to extract the audio streams of the external audio data and the internal prompt audio data respectively to obtain a first audio stream corresponding to the external audio data and a second audio stream corresponding to the internal prompt audio data; A first determination submodule, configured to perform resampling processing on the first audio stream and the second audio stream, and determine matching data of the first audio stream and the second audio stream, wherein the matching data includes a format, a volume, and a number of channels of the audio stream; The merging submodule is used to merge the first audio stream and the second audio stream according to the format, volume and number of channels of the audio stream to obtain audio data to be transmitted.

[0065] Optionally, the above merging submodules include: A determining unit, configured to determine corresponding weighted mixing parameters based on the volume and the number of channels of the first audio stream and the second audio stream; A merging unit is used to adjust the volume and the number of channels of the merged first audio stream and the second audio stream based on the weighted mixing parameter, and merge the first audio stream and the second audio stream after the adjustment to obtain audio data to be transmitted.

[0066] Optionally, the first determining module 503 includes: The detection submodule is used to perform real-time detection on the preset operation requirement, and when the preset operation requirement is detected to be triggered, generate the audio data to be transmitted corresponding to the preset operation requirement, and output the audio data to be transmitted to the target device.

[0067] like Figure 6 As shown, an embodiment of the present invention further provides an electronic device 600, including a processor, and the processor can execute any one of the above-mentioned Bluetooth audio dynamic mixing processing methods.

[0068] Specifically, it includes a processor 601 and a memory 602, and a computer program for executing the Bluetooth audio dynamic mixing processing method stored in the memory 602 and capable of running on the processor 601, wherein: The processor 601 runs the computer program of the Bluetooth audio dynamic mixing processing method stored in the memory 602, and performs the following steps: Get external audio data; Mixing the external audio data with the internal prompt audio data to obtain audio data to be transmitted; Based on the preset operation requirements, the corresponding audio data to be transmitted is determined and output to the target device.

[0069] Optionally, the processor 601 executes the acquiring of external audio data, including: The external audio is collected by a sound receiving device to obtain corresponding external audio data to be decoded; After preprocessing and decoding the external audio data to be decoded, the external audio data is obtained.

[0070] Optionally, before the processor 601 performs the mixing process of the external audio data and the internal prompt audio data to obtain the audio data to be transmitted, the method further includes: Identify the current internal audio database and determine the corresponding audio domain data, wherein the audio domain data includes the tone, pitch, and audio category corresponding to the internal audio data; Based on the tone, pitch and audio category, the internal prompt audio data in the current internal audio database is decoded and identified to obtain the internal prompt audio in a corresponding format.

[0071] Optionally, the processor 601 performs mixing processing on the external audio data and the internal prompt audio data to obtain the audio data to be transmitted, including: Extracting the audio streams of the external audio data and the internal prompt audio data respectively to obtain a first audio stream corresponding to the external audio data and a second audio stream corresponding to the internal prompt audio data; Resampling the first audio stream and the second audio stream to determine matching data of the first audio stream and the second audio stream, wherein the matching data includes a format, a volume, and a number of channels of the audio stream; The first audio stream and the second audio stream are combined and processed according to the format, volume, and number of channels of the audio stream to obtain audio data to be transmitted.

[0072] Optionally, the processor 601 performs the merging of the first audio stream and the second audio stream according to the format, volume, and number of channels of the audio stream to obtain audio data to be transmitted, including: Determine corresponding weighted mixing parameters based on the volume and the number of channels of the first audio stream and the second audio stream; Based on the weighted mixing parameters, the volume and the number of channels of the merged first audio stream and the second audio stream are adjusted, and after the adjustment, the first audio stream and the second audio stream are merged to obtain audio data to be transmitted.

[0073] Optionally, the processor 601 executes the step of determining the corresponding audio data to be transmitted and outputting the audio data to the target device based on the preset operation requirement, including: The preset operation requirement is detected in real time, and when the preset operation requirement is detected to be triggered, audio data to be transmitted corresponding to the preset operation requirement is generated, and the audio data to be transmitted is output to the target device.

[0074] An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the Bluetooth audio dynamic mixing processing method or the application-side Bluetooth audio dynamic mixing processing method provided in the embodiment of the present invention are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0075] Those skilled in the art can understand that the implementation of all or part of the processes in the above-mentioned embodiments can be completed by instructing the relevant hardware through a computer program, and can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).

[0076] The above disclosure is only the preferred embodiment of the present invention, which certainly cannot be used to limit the scope of the present invention. Therefore, equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

Claims

1. A Bluetooth audio dynamic mixing processing method, characterized in that: include: Get external audio data; Mixing the external audio data with the internal prompt audio data to obtain audio data to be transmitted; Based on the preset operation requirements, the corresponding audio data to be transmitted is determined and output to the target device.

2. The Bluetooth audio dynamic mixing processing method according to claim 1, characterized in that: The obtaining of external audio data comprises: The external audio is collected by a sound receiving device to obtain corresponding external audio data to be decoded; After preprocessing and decoding the external audio data to be decoded, the external audio data is obtained.

3. The Bluetooth audio dynamic mixing processing method according to claim 1, characterized in that: Before mixing the external audio data with the internal prompt audio data to obtain the audio data to be transmitted, the method further includes: Identify the current internal audio database and determine the corresponding audio domain data, wherein the audio domain data includes the tone, pitch, and audio category corresponding to the internal audio data; Based on the tone, pitch and audio category, the internal prompt audio data in the current internal audio database is decoded and identified to obtain the internal prompt audio in a corresponding format.

4. The Bluetooth audio dynamic mixing processing method according to claim 1, characterized in that: The mixing of the external audio data and the internal prompt audio data to obtain the audio data to be transmitted includes: Extracting the audio streams of the external audio data and the internal prompt audio data respectively to obtain a first audio stream corresponding to the external audio data and a second audio stream corresponding to the internal prompt audio data; Resampling the first audio stream and the second audio stream to determine matching data of the first audio stream and the second audio stream, wherein the matching data includes a format, a volume, and a number of channels of the audio stream; The first audio stream and the second audio stream are combined and processed according to the format, volume, and number of channels of the audio stream to obtain audio data to be transmitted.

5. The Bluetooth audio dynamic mixing processing method as claimed in claim 4, characterized in that: The merging the first audio stream and the second audio stream according to the format, volume, and number of channels of the audio stream to obtain audio data to be transmitted includes: Determine corresponding weighted mixing parameters based on the volume and the number of channels of the first audio stream and the second audio stream; Based on the weighted mixing parameters, the volume and the number of channels of the merged first audio stream and the second audio stream are adjusted, and after the adjustment, the first audio stream and the second audio stream are merged to obtain audio data to be transmitted.

6. The Bluetooth audio dynamic mixing processing method as described in claim 1, characterized in that: The step of determining the corresponding audio data to be transmitted and outputting the audio data to the target device based on the preset operation requirement includes: The preset operation requirement is detected in real time, and when the preset operation requirement is detected to be triggered, audio data to be transmitted corresponding to the preset operation requirement is generated, and the audio data to be transmitted is output to the target device.

7. A Bluetooth audio dynamic mixing processing device, characterized in that: include: A first acquisition module, used to acquire external audio data; A second acquisition module is used to mix the external audio data with the internal prompt audio data to obtain the audio data to be transmitted; The first determination module is used to determine the corresponding audio data to be transmitted based on a preset operation requirement and output it to a target device.

8. A Bluetooth audio dynamic mixing processing system, characterized in that: The Bluetooth audio dynamic mixing processing system comprises: a Bluetooth audio dynamic mixing processing device; The Bluetooth audio dynamic mixing processing device is determined by a Bluetooth audio dynamic mixing processing method shown in claims 1-6.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps in the Bluetooth audio dynamic mixing processing method as described in any one of claims 1 to 6 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the steps in the Bluetooth audio dynamic mixing processing method as described in any one of claims 1 to 6 are implemented.

Images