An audio signal transmission method and related device

Abstract

The application belongs to the field of communication and relates to an audio signal transmission method and related equipment, which comprises the following steps: collecting an audio signal, wherein the audio signal comprises a public network audio signal and a private network audio signal; preprocessing the public network audio signal and the private network audio signal; mixing the preprocessed public network audio signal and the preprocessed private network audio signal to obtain a mixed audio signal; encoding the mixed audio signal into a Bluetooth protocol format through an application program to generate a Bluetooth audio signal; and transmitting the Bluetooth audio signal to a Bluetooth device. The application performs protocol analysis and mixing processing on a private network data packet at a software level, realizes seamless fusion of public network and private network audio and Bluetooth collaborative output, solves the problem of the need for additional hardware modules for public and private network audio fusion and interworking between private networks, realizes low-delay and high-compatibility transmission, and improves user experience and operation efficiency in a complex communication scenario.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to an audio signal transmission method and related equipment. Background Technology

[0002] Existing multi-mode communication terminals handle public and private network audio and Bluetooth interactions in several ways. For audio processing, public and private network signals are received and decoded by their respective hardware modules, and then output via a single speaker using a switch. If simultaneous playback is required, additional independent hardware such as dual speakers is needed, relying on physical integration to achieve parallel playback. Regarding Bluetooth interaction, the terminal's Bluetooth module is typically bound to the public network module, supporting only wireless audio transmission over the public network. Since the private network module cannot directly connect to the Bluetooth signal path, an additional Bluetooth receiver module is required, transmitting audio directionally via hardware lines to connect with Bluetooth headsets.

[0003] This results in limited audio output across multiple networks, obstacles to Bluetooth interaction with private networks, reliance on additional hardware leading to low integration and high power consumption, inability to share Bluetooth resources between public and private networks, and cumbersome switching operations with high latency.

[0004] In view of the above, this application is hereby submitted. Summary of the Invention

[0005] The purpose of this application is to provide an audio signal transmission method, apparatus, computer device, and storage medium to solve the problem that additional hardware modules are needed for audio fusion between public and private networks and for interoperability between Bluetooth and private networks.

[0006] To address the aforementioned technical problems, this application provides an audio signal transmission method, employing the following technical solution:

[0007] An audio signal transmission method includes the following steps:

[0008] Acquire audio signals, including public network audio signals and private network audio signals;

[0009] The public network audio signal and the private network audio signal are preprocessed to obtain preprocessed public network audio signal and preprocessed private network audio signal;

[0010] The preprocessed public network audio signal and the preprocessed private network audio signal are mixed to obtain a mixed audio signal;

[0011] The mixed audio signal is encoded to generate a Bluetooth audio signal in Bluetooth protocol format;

[0012] The Bluetooth audio signal is transmitted to the Bluetooth device.

[0013] Furthermore, the above-mentioned preprocessing of the public network audio signal and the private network audio signal to obtain preprocessed public network audio signal and preprocessed private network audio signal includes:

[0014] Add timestamps to the public network audio signal and the private network audio signal to obtain the preprocessed public network audio signal and the preprocessed private network audio signal.

[0015] Furthermore, the preprocessed public network audio signal and the preprocessed private network audio signal are mixed to obtain a mixed audio signal, including:

[0016] Extract the speech activity and signal strength of the preprocessed public network audio signal, and use the speech activity and signal strength of the preprocessed public network audio signal as the first feature group;

[0017] Extract the speech activity and signal strength of the preprocessed private network audio signal, and use the speech activity and signal strength of the preprocessed private network audio signal as the second feature group;

[0018] Based on the first feature group and the second feature group, the preprocessed public network audio signal and the preprocessed private network audio signal are mixed to obtain a mixed audio signal.

[0019] Furthermore, based on the first feature group and the second feature group, the preprocessed public network audio signal and the preprocessed private network audio signal are mixed to obtain a mixed audio signal, including:

[0020] Obtain the total weight of the first feature group and the second feature group;

[0021] The public network allocation weight is obtained based on the first feature group and the total weight value;

[0022] The private network allocation weights are obtained based on the second feature group and the total weight value.

[0023] Based on the public network allocation weight and the private network allocation weight, the preprocessed public network audio signal and the preprocessed private network audio signal are mixed using a preset mixing model to obtain the mixed audio signal.

[0024] Furthermore, the above-mentioned method of obtaining the public network allocation weight based on the first feature group and the total weight value includes:

[0025] Priority for acquiring public network audio signals;

[0026] The public network allocation weight is obtained based on the priority, the first feature group, and the total weight value.

[0027] Furthermore, the above-mentioned encoding of the mixed audio signal to generate a Bluetooth audio signal in Bluetooth protocol format includes:

[0028] The mixed audio signal is compressed to obtain compressed coded data;

[0029] The compressed and encoded data is encapsulated into a data packet conforming to the Bluetooth protocol format to generate the Bluetooth audio signal.

[0030] Furthermore, after transmitting the Bluetooth audio signal to the Bluetooth device, the process includes:

[0031] Obtain the transmission quality of the Bluetooth audio signal;

[0032] The parameters of the Bluetooth device are adjusted based on the transmission quality and the preset threshold.

[0033] To address the aforementioned technical problems, this application also provides an audio signal transmission method apparatus, which employs the following technical solution:

[0034] An audio signal transmission device, comprising:

[0035] The acquisition module is used to acquire audio signals, including public network audio signals and private network audio signals;

[0036] The preprocessing module is used to preprocess the public network audio signal and the private network audio signal to obtain the preprocessed public network audio signal and the preprocessed private network audio signal.

[0037] The mixing module is used to mix the preprocessed public network audio signal and the preprocessed private network audio signal to obtain a mixed audio signal;

[0038] The conversion module is used to encode the mixed audio signal to generate a Bluetooth audio signal in Bluetooth protocol format;

[0039] A Bluetooth output module is used to transmit the Bluetooth audio signal to a Bluetooth device.

[0040] To address the aforementioned technical problems, this application also provides a computer device that employs the following technical solution:

[0041] A computer device includes a memory and a processor, the memory storing computer-readable instructions, the processor executing the computer-readable instructions to implement the steps of an audio signal transmission method as described above.

[0042] To address the aforementioned technical problems, this application also provides a computer-readable storage medium, employing the technical solution described below:

[0043] A computer-readable storage medium storing computer-readable instructions, which, when executed by a processor, implement the steps of an audio signal transmission method as described above.

[0044] Compared with the prior art, the embodiments of this application have the following main advantages:

[0045] This application discloses an audio signal transmission method, which involves acquiring audio signals, including public network audio signals and private network audio signals; preprocessing the public network audio signals and the private network audio signals; mixing the preprocessed public network audio signals and the preprocessed private network audio signals to obtain a mixed audio signal; encoding the mixed audio signal into Bluetooth protocol format through an application to generate a Bluetooth audio signal; and transmitting the Bluetooth audio signal to a Bluetooth device. This application achieves seamless integration of public and private network audio and Bluetooth collaborative output by performing protocol parsing and mixing of private network data packets at the software level. It solves the problem of requiring additional hardware modules for public-private network audio fusion and Bluetooth-to-private network interoperability, achieving low-latency, high-compatibility transmission and improving user experience and operational efficiency in complex communication scenarios. Attached Figure Description

[0046] To more clearly illustrate the solutions in this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0047] Figure 1 This is an exemplary system architecture diagram to which this application can be applied;

[0048] Figure 2 This is a flowchart of an audio signal transmission method provided in this application;

[0049] Figure 3 This is a schematic diagram of the structure of an audio signal transmission method device provided in this application;

[0050] Figure 4 This is a schematic diagram of the structure of a computer device provided in this application. Detailed Implementation

[0051] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains; the terminology used herein in the specification of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "comprising" and "having," and any variations thereof, in the specification, claims, and foregoing drawings of this application are intended to cover non-exclusive inclusion. The terms "first," "second," etc., in the specification, claims, or foregoing drawings of this application are used to distinguish different objects, not to describe a particular order.

[0052] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a mutually exclusive, independent, or alternative embodiment. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0053] In traditional technologies, multimode communication terminals heavily rely on additional hardware to achieve basic functions when handling public and private network audio. Public and private network audio outputs typically require physical switches or simple overlaying of audio circuits and speakers, making true software-level integration impossible. Furthermore, Bluetooth modules can only serve public network audio transmission; to collaborate with private networks, dedicated Bluetooth hardware and wiring must be provided for the private network module, significantly increasing device complexity and manufacturing costs.

[0054] Furthermore, traditional technologies lack the ability to intelligently identify audio content and dynamically adapt to the transmission environment. Audio signals from different sources can only be mechanically mixed, unable to dynamically adjust the output strategy based on the importance of the voice or signal quality, making critical communications susceptible to interference or masking. Bluetooth transmission also suffers from insufficient stability, making it difficult to guarantee the real-time performance and reliability required for private network communications in complex electromagnetic environments.

[0055] In this application, the public network refers to a large-scale network infrastructure that is open to the general public and built and operated by telecommunications operators. The core characteristics of the public network include openness, sharing, massive scale, convenient access (usually charged based on traffic or bandwidth), and its reliance on standard protocols (TCP / IP).

[0056] Private network communication standards are communication technology standards specifically designed for particular industries or scenarios. Their main characteristics are high reliability, low latency, and strong security. These include DMR (Digital Mobile Radio), PDT (Professional Digital Trunking), and TETRA (Terrestrial Trunked Radio), among others.

[0057] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

[0058] like Figure 1 As shown, system architecture 100 may include terminal devices (e.g., first terminal device 101, second terminal device 102, and third terminal device 103), network 104, and server 105. Network 104 serves as a medium for providing communication links between the first terminal device 101, second terminal device 102, third terminal device 103, and server 105. Network 104 may include various connection types, such as wired or wireless communication links or fiber optic cables, etc.

[0059] Users can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 via the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as web browser applications, shopping applications, search applications, instant messaging tools, email clients, social media platform software, etc.

[0060] The first terminal device 101, the second terminal device 102, and the third terminal device 103 can be various electronic devices with displays and support web browsing, including but not limited to smartphones, tablets, e-book readers, MP3 (Moving Picture Experts Group Audio Layer III) players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptops, and desktop computers, etc.

[0061] Server 105 can be a server that provides various services, such as a backend server that supports the pages displayed on the first terminal device 101, the second terminal device 102, and the third terminal device 103.

[0062] It should be noted that the audio signal transmission method provided in this application embodiment is generally executed by a terminal device, and correspondingly, a public network and private network audio fusion and Bluetooth collaborative transmission device is generally installed in the terminal device.

[0063] It should be understood that Figure 1 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of terminal devices, networks, and servers can be included.

[0064] In this embodiment, an audio signal transmission method operates on an electronic device (e.g., Figure 1 The terminal device shown can send or receive data via wired or wireless connection. It should be noted that the aforementioned wireless connection methods may include, but are not limited to, 3G / 4G / 5G connections, Wi-Fi connections, Bluetooth connections, WiMAX connections, Zigbee connections, UWB (ultrawideband) connections, and other currently known or future wireless connection methods.

[0065] Continue to refer to Figure 2 The diagram illustrates a flowchart of an embodiment of an audio signal transmission method according to this application. The audio signal transmission method includes the following steps:

[0066] Step S01: Acquire audio signals, including public network audio signals and private network audio signals.

[0067] Audio signals from at least two types of networks are acquired. Public network audio signals refer to voice or audio data transmitted over public communication networks (such as 4G / 5G, broadband internet, etc.), while private network audio signals refer to voice or audio data transmitted over dedicated communication networks (such as PDT / DMR / TETRA trunking networks, industrial private networks, etc.). These signals can be received through a serial communication interface. The serial communication interface can be UART (Universal Asynchronous Receiver / Transmitter), SPI (Serial Peripheral Interface), or any interface with serial data transmission capabilities, including RS485 (which uses the RS485 electrical standard to transmit UART format data), CAN (Controller Area Network), USB (pseudo-serial mode), etc., as long as it can receive private network data packets.

[0068] In this embodiment, a data acquisition device with multi-network access capability (such as a terminal device integrating a public network module and a private network module, or an external data acquisition device connected via wired / wireless means) can be used to acquire two types of audio signals in real time or near real time by adapting to public network protocols and private network protocols (such as PDT signaling protocol).

[0069] The acquired audio signals include audio input signals and audio output signals. Audio input signals refer to audio signals received from other devices or apparatuses, while audio output signals refer to audio signals to be emitted from this device or apparatus. The type of acquisition device is not limited to specific hardware and may include, but is not limited to, microphone modules, network audio receiving modules, external audio interfaces, etc., to achieve the acquisition of audio signals from public and private networks.

[0070] Step S02: Preprocess the public network audio signal and the private network audio signal to obtain the preprocessed public network audio signal and the preprocessed private network audio signal.

[0071] Due to differences in communication protocols and transmission paths, public and private networks may exhibit audio signal issues such as timing misalignment (e.g., transmission delay differences), format incompatibility (e.g., different sampling rates and encoding methods), and parameter inconsistencies (e.g., volume and gain differences). Direct fusion of these signals can lead to distortion, stuttering, or information loss. Preprocessing is a prerequisite for ensuring effective fusion. The acquired public and private network audio signals undergo pre-processing standardization to eliminate differences in timing, format, and parameters, ensuring they meet the basic requirements for subsequent fusion processing.

[0072] In this embodiment, an audio preprocessing mechanism is employed, including but not limited to timing calibration (such as aligning signals using a unified clock reference), format standardization (such as converting to a unified sampling rate and encoding format), and parameter normalization (such as adjusting the volume to a preset range). The specific preprocessing method is not limited to a particular algorithm, but aims to achieve signal fusion and optimization, for example, through a software-level signal conversion module or a hardware-level adaptation circuit.

[0073] Step S03: Mix the preprocessed public network audio signal and the preprocessed private network audio signal to obtain a mixed audio signal.

[0074] The pre-processed public network and private network audio signals are integrated into a single-channel hybrid audio signal. This signal must simultaneously carry the core information of both types of signals (such as public network dispatch instructions + private network alarm voice) without losing the key content of either signal.

[0075] In this embodiment, the preset mixing model can dynamically adjust the processing strategy. When only one valid signal exists (either the public network or the private network), that signal is directly output to avoid ineffective mixing. When both signals exist simultaneously, the public network audio signal and the private network audio signal are weighted and fused (e.g., higher priority signals have a higher proportion), time-domain multiplexed (e.g., time-slot-based transmission), or frequency-domain separated (e.g., different frequency bands carry different signals) based on the characteristic data of the audio signals (e.g., priority and intensity). The specific mixing algorithm is not limited to a particular type, as long as it can effectively integrate multiple signals.

[0076] Step S04: Encode the mixed audio signal to generate a Bluetooth audio signal in Bluetooth protocol format.

[0077] In existing technologies, terminal Bluetooth modules are typically bound to public network modules, and private network audio cannot be transmitted via Bluetooth (requiring additional hardware support). This prevents users from receiving private network signals when using devices such as Bluetooth headsets, limiting the flexibility of wireless interaction. Therefore, without adding additional hardware modules or devices, it is necessary to process the mixed audio signal obtained in step S03 according to the Bluetooth transmission protocol specifications and then send it via a Bluetooth link to a device with Bluetooth receiving capabilities (such as Bluetooth headsets, Bluetooth speakers, etc.).

[0078] In this embodiment, lossless encoding, such as PCM (Pulse Code Modulation) and A2DP (Advanced Audio Distribution Profile), can be used, or low-latency lossy encoding, such as LC3 (Low Complexity Communication Codec), SBC (Subband Codec), and AAC (Advanced Audio Coding), can be used, selected according to bandwidth requirements. After encoding, the encoded audio data is encapsulated into Bluetooth data packets according to the specifications of Bluetooth audio transmission protocols (including but not limited to A2DP and LEAudio (Low Energy Audio)). The data packets must include a Bluetooth protocol header (containing the target device address, source device address, channel identifier, and data type), audio metadata (such as sampling rate, encoding format, and bitrate), and the audio data body to ensure that Bluetooth devices can parse and decode them.

[0079] Step S05: Transmit the Bluetooth audio signal to the Bluetooth device.

[0080] Existing terminals typically have Bluetooth modules bound to public network modules, capable of transmitting only public network audio. Additional hardware modules are needed to transmit audio signals from private networks, requiring users to use both wired headphones (for private network audio) and Bluetooth headphones (for public network audio), resulting in cumbersome equipment and a poor user experience. If multiple users need to receive mixed audio (e.g., in an emergency response team), wired output requires multiple wired interfaces, leading to high hardware costs and complex wiring. Wireless output solves the problem of parallel reception by multiple devices. The encoded Bluetooth audio signal is sent from the multi-mode communication terminal to the target Bluetooth device (a device with Bluetooth audio receiving capabilities), achieving wireless output of mixed audio.

[0081] In this embodiment, the terminal and Bluetooth device establish a stable Bluetooth connection through a "Bluetooth pairing process" (such as PIN code pairing, NFC quick pairing, BLE broadcast pairing). This can be a one-to-one connection (such as the terminal to a single Bluetooth headset) or a one-to-many connection (such as the terminal to multiple Bluetooth speakers). During connection, transmission parameters (such as Bluetooth version, encoding format, and channel bandwidth) are selected to ensure compatibility with the Bluetooth device's capabilities (e.g., older devices negotiate Bluetooth 4.2+SBC, and newer devices negotiate Bluetooth 5.3+LC3).

[0082] Bluetooth audio data packets are sent via the audio channel of the Bluetooth link, such as the isochronous channel (ISO) of the synchronous-to-connection link LEAudio using the A2DP protocol. Specifically, a combination of continuous and batch transmission methods can be used. For example, continuous transmission (sending one data packet every 20ms) is used in real-time voice scenarios to ensure low latency, while batch transmission is used in non-real-time scenarios (such as audio playback) to improve transmission efficiency.

[0083] This application achieves seamless integration of public and private network audio and Bluetooth collaborative output by performing protocol parsing and mixing of private network data packets at the software level. It solves the problem of needing to add additional hardware modules for public and private network audio integration and Bluetooth-to-private network interoperability, and realizes low-latency, high-compatibility transmission, improving user experience and operational efficiency in complex communication scenarios.

[0084] In some optional implementations of this embodiment, the preprocessing of the public network audio signal and the private network audio signal to obtain preprocessed public network audio signal and preprocessed private network audio signal includes:

[0085] Add timestamps to the public network audio signal and the private network audio signal to obtain the preprocessed public network audio signal and the preprocessed private network audio signal.

[0086] There is a transmission delay difference between the public network and the private network due to differences in transmission paths, protocol stacks, and network loads. The transmission delay of the public network is usually 20ms to 50ms (affected by base station load and wireless environment), and the transmission delay of the private network is usually 10ms to 30ms (the cluster network optimizes real-time performance). If directly mixed, the time difference between the two signals may exceed 10ms, resulting in the inability to distinguish the overlapping parts of the public network voice and the private network voice, seriously affecting the accuracy of information transmission. For example, the public network command "Execute immediately" and the private network alarm "Equipment failure" become "Execute immediately equipment failure" due to timing misalignment.

[0087] Add timestamps with a unified time reference to the collected public network audio signal and private network audio signal respectively, calculate the time difference between the public network audio signal and the private network audio signal, align the two signals on the time axis, and ensure that there is no timing misalignment (such as echo, front and back delay) during mixing. The timestamp accuracy is not less than 1ms, and the time difference between the two signals after synchronization ≤ 5ms.

[0088] Exemplarily, based on the clock source built into the terminal device, which can be a real-time clock RTC, a network time synchronization clock NTP, a GNSS synchronization clock, etc., a globally unified time reference (such as Unix timestamp, etc.) is generated. At the moment when the public network audio signal is output from the public network module, record the current time reference value as its timestamp (denoted as T1), and at the moment when the audio playback is parsed from the serial communication interface, record the current time reference value as its timestamp (denoted as T2).

[0089] Calculate the time difference between the two signals ΔT = |T1 - T2|, add delay compensation to the signal with an earlier timestamp (such as when T1 < T2, add a delay of ΔT to the public network signal), or perform early playback on the signal with a later timestamp (implemented through cache preloading). Finally, make the time difference between the two signals ≤ 5ms. Recalculate ΔT every 100ms and adjust the compensation amount in real time to avoid long-term synchronization deviation. For example, when the public network load suddenly increases and the delay rises from 20ms to 50ms, the synchronization system can complete the compensation adjustment within 200ms.

[0090] This application reduces the chaos of the mixed audio through synchronizing the time difference between the two signals and a dynamic calibration mechanism, improves the user experience, and reduces the interference of sudden changes.

[0091] In some optional implementation manners of this embodiment, mixing the preprocessed public network audio signal and the preprocessed private network audio signal to obtain a mixed audio signal includes:

[0092] The voice activity and signal strength of the preprocessed public network audio signal are extracted and used as a first feature group; the voice activity and signal strength of the preprocessed private network audio signal are extracted and used as a second feature group; the preprocessed public network audio signal and the preprocessed private network audio signal are mixed according to the first feature group and the second feature group to obtain a mixed audio signal.

[0093] A fixed mixing ratio may fail to adapt to dynamic signal changes. For example, if the public network changes from "active voice" to "mute," mixing at a 50% ratio will result in a 50% reduction in the mixed audio volume. It may also fail to reflect differences in signal priority. For instance, if emergency alarms on a private network are mixed with ordinary voice messages on the public network at the same ratio, the emergency information will be diluted.

[0094] Quantitative features reflecting signal attributes, including signal strength and speech activity, are extracted from the preprocessed public and private network audio signals respectively, forming a first feature group and a second feature group. These features can be in numerical or labeled form. The first feature group includes the quantized features of the public network audio signal, and the second feature group includes the quantized features of the private network audio signal. Finally, the public and private network audio signals are mixed based on the first and second feature groups to obtain a mixed audio signal.

[0095] For example, speech activity can be obtained using short-time energy analysis (a commonly used speech signal processing method for extracting energy features from speech signals) to determine whether the signal is valid speech (neither silence nor noise). After initial screening using short-time energy analysis, if the signal is determined to be valid speech (excluding obvious silence or strong noise), the audio signal is divided into continuous short segments (i.e., "audio frames") with a length of 20ms / frame. The purpose of frame segmentation is to transform long-time-varying audio signals into short-time approximately stationary segments, facilitating accurate feature calculation.

[0096] For each 20ms audio frame, calculate the "sum of squares in the time domain" (i.e., the sum of the squares of the signal amplitudes) of all audio signal sampling points within the frame to obtain the short-time energy. Count the number of time-domain sign changes of the audio signal within the frame (i.e., the number of times the signal crosses from a positive amplitude to a negative amplitude, or vice versa) to obtain the zero-crossing rate. Compare the short-time energy and zero-crossing rate of the audio frame with a preset threshold. If the energy > -40dBFS and the zero-crossing rate < 50 times / frame, the frame is determined to be active (1); otherwise, it is inactive (0). The active status of N consecutive frames (usually 3 to 5 frames) can be statistically analyzed, either by percentage calculation or weighted summation. For example, the weighted percentage formula can be used to obtain:

[0097]

[0098] in, It represents the first frame (earliest frame) in a consecutive N frames. This represents the Nth frame (the latest frame) in a consecutive N frames. The active state for each frame, The weights for each frame are determined. N is 3 frames. Let the weights of 3 consecutive frames be 0.5 (latest frame), 0.3 (middle frame), and 0.2 (oldest frame). If all 3 frames are active, the activity value is (1×0.5+1×0.3+1×0.2) / 1=1.0; if only the latest frame is active, the activity value is 0.5 / 1=0.5.

[0099] Signal strength can be obtained by calculating the signal-to-noise ratio. Specifically, the noise power in the signal is estimated using spectral subtraction, and then the ratio of signal power to noise power is calculated: , the ratio Mapped to intensity values ​​(e.g., if SNR=30dB, the intensity value is 90; if SNR=20dB, the intensity value is 60).

[0100] Based on the public and private network priorities, signal strength, and voice activity obtained above, a first feature group and a second feature group are constructed, respectively. Feature analysis and weight allocation are then performed on the first and second feature groups. Following this weighted process, the preprocessed public and private network audio is superimposed and noise-reduced to synthesize the two audio streams into a single hybrid audio stream. This process preserves the effective information from both signals while highlighting the core voice according to priority.

[0101] Therefore, by extracting and analyzing features, information density is increased, ensuring that users can prioritize the identification of urgent information and improving the consistency of user experience.

[0102] In some optional implementations of this embodiment, the above-mentioned mixing of the preprocessed public network audio signal and the preprocessed private network audio signal according to the first feature group and the second feature group to obtain a mixed audio signal includes:

[0103] Obtain the total weight of the first feature group and the second feature group; obtain the public network allocation weight based on the first feature group and the total weight; obtain the private network allocation weight based on the second feature group and the total weight; and mix the preprocessed public network audio signal and the preprocessed private network audio signal using a preset mixing model based on the public network allocation weight and the private network allocation weight to obtain the mixed audio signal.

[0104] In this embodiment, the total value of the signal strength and voice activity of the first and second feature groups can be calculated first to obtain the total weight value. For example, the total weight value = (private network strength value × private network activity) + (public network strength value × public network activity).

[0105] Then, the allocation weight for the public network audio signal is calculated using the signal strength and voice activity from the first feature group, and the allocation weight for the private network audio signal is calculated using the signal strength and voice activity from the second feature group. For example, the calculation formulas for the public network allocation weight and the private network allocation weight are as follows:

[0106] Public network weight allocation = (Public network strength value × Public network activity) / Total weight value

[0107] Private network weight allocation = (Private network strength value × Private network activity) / Total weight value

[0108] Finally, by using a hybrid model, assigning weights to both the public and private networks, the preprocessed public and private network audio signals are superimposed to form a hybrid audio signal. This signal superposition can employ algorithms such as linear or non-linear superposition. For example, using linear superposition, the hybrid audio signal can be determined as: Hybrid Audio Signal = Public Network Signal × Public Network Weight + Private Network Signal × Private Network Weight.

[0109] This application uses feature extraction and feature analysis to mix audio, which can avoid invalid mixed audio and prevent mixed audio from being masked by low-priority signals, thereby improving the effectiveness of information.

[0110] In some optional implementations of this embodiment, obtaining the public network allocation weight based on the first feature group and the total weight value includes:

[0111] Priority for acquiring public network audio signals;

[0112] The public network allocation weight is obtained based on the priority, the first feature group, and the total weight value.

[0113] If signal strength is used as the sole criterion for allocation, a low-priority signal might mask a high-priority signal with slightly lower strength. Conversely, if priority is used as the sole criterion, an extremely low-priority signal might remain unrecognized after mixing. Therefore, a combination of both approaches is necessary to ensure that high-priority signals are prioritized while preventing signals with excessively low strength from being blindly given higher weights.

[0114] Priority can be obtained through signaling identifiers or preset tags. Signaling identifiers (such as the priority of scheduling resources in the 5G public network and the emergency call flag in the DMR private network) are extracted from the data of the public network and private network modules, and the priority is determined based on the signaling identifiers. If there are no signaling identifiers, user-preset tags are used (e.g., 4 for public network normal voice and 10 for private network emergency voice). The priority value range can be from 1 to 10 (10 being the highest).

[0115] For example, priority (P) can take values ​​from 1 to 10, which can be preset by the user, such as emergency for private networks = 10, and normal for public networks = 6. Signal strength (S) can take values ​​from 0 to 100 (mapped from SNR, such as SNR = 30dB → S = 90). <30, then limited ≤0.3, to avoid excessive weighting of low-resolution signals. Voice activity (V) can be set from 0.8 to 1.0, where all audio signals are valid voice. The total weight is adjusted according to the priority of public network audio signals and private network audio signals to obtain the adjusted total weight. For example, the adjusted total weight =

[0116] Public network weight allocation The calculation formula can be:

[0117] Total weight

[0118] in, For public network priority and For public network signal strength, For private network priority and This refers to the signal strength of the private network. For example, in scenario 1: the private network ( =10, =90, V=0.82), public network ( =6, =80, V=0.83), then the public network allocation weight =(6×80×0.8) / [(10×90×0.83)+(6×80×0.8)]≈0.34. Scenario 2 Public network ( =10, =20), private network ( =6, S=90), due to public network strength value =20 < 30, forced public network ≤0.3, therefore public network weight =0.3.

[0119] When calculating the allocation weight for a private network, the priority of the private network audio signal can also be obtained. Based on the priority, the second feature group, and the total weight value, the allocation weight for the private network can be derived. The specific implementation method is consistent with the public network allocation weight method described above. For example, in scenario 1: private network ( =10, =90, V=0.82), then the private network is assigned a weight. =(10×90×0.83) / [(10×90×0.83)+(6×80×0.8)]≈0.66.

[0120] The weights allocated to the public network and private network are recalculated every 200ms (dynamically changing with signal strength). When the priority difference is ≥5, for example, P private network = 10, P public network = 4, even if the private network S is slightly lower (e.g., S private network = 70, S public network = 90), W private network is still guaranteed to be ≥0.55 (prioritizing higher priority).

[0121] This application determines weights based on priority and audio signal intensity, avoiding the limitations of a single factor. It prioritizes importance and clarity, thereby increasing the confidence level of the audio signal. Even when high-priority signals have slightly lower intensity, they still receive reasonable weights, preventing them from being completely masked by strong low-priority signals. Signals with excessively low intensity values ​​also receive low weights, preventing noise or blurred signals from diluting effective information.

[0122] In some optional implementations of this embodiment, the above-described encoding of the mixed audio signal to generate a Bluetooth audio signal in Bluetooth protocol format includes:

[0123] The mixed audio signal is compressed to obtain compressed encoded data; the compressed encoded data is then encapsulated into a data packet conforming to the Bluetooth protocol format to generate the Bluetooth audio signal.

[0124] If the original mixed signal is in uncompressed PCM format (16kHz sampling rate, 16-bit depth), the bit rate is 256kbps. However, the available bandwidth of Bluetooth (such as A2DP) is typically 300 to 500kbps. If multiple signals or other data are transmitted or superimposed, packet loss is likely due to insufficient bandwidth. Therefore, the mixed audio signal needs to be compressed and encoded, and then a protocol header, metadata, and checksum information are added to the compressed and encoded data to generate standardized Bluetooth data packets.

[0125] For example, a built-in compression algorithm library (which may include LC3, SBC, AAC, etc.) can be used to automatically select a feasible compression algorithm based on the terminal hardware performance (such as CPU computing power and memory) and the Bluetooth device's algorithm selection (the encoding format supported by the Bluetooth device). If the Bluetooth device supports a low-latency algorithm (such as LC3, with a latency of ≤10ms), it will be selected first; if it does not support it, it will be downgraded to a general algorithm (such as SBC, which has compatibility with 99% of Bluetooth devices).

[0126] Dynamically adapt based on Bluetooth link quality (judged by RSSI signal strength). For example, a high bit rate (e.g., 256kbps) is used for a superior link (RSSI≥-70dBm) to ensure sound quality, while a low bit rate (e.g., 128kbps) is used for a poor link (RSSI≤-85dBm) to reduce packet loss.

[0127] Finally, it is encapsulated into a data packet format conforming to the Bluetooth protocol. The protocol header (8-16 bytes) contains the source MAC address, destination MAC address, protocol type, and data packet sequence number. The metadata (4-8 bytes) contains the compression algorithm identifier, sampling rate, frame length, and bitrate. The data body (100-255 bytes) contains the compressed and encoded audio data. The checksum (2-4 bytes) uses CRC16 / CRC32 to check data integrity.

[0128] This application enables audio to be recognized by most Bluetooth devices (mobile phones, headphones, car stereos, speakers, etc.) through standardized encapsulation. The protocol header sequence number and checksum enable packet loss detection and error packet discarding, improving data accuracy.

[0129] In some optional implementations of this embodiment, after transmitting the Bluetooth audio signal to the Bluetooth device, the following steps are included:

[0130] Obtain the transmission quality of the Bluetooth audio signal from the Bluetooth device;

[0131] Based on the transmission quality and preset threshold, adjust the parameters for the next Bluetooth audio signal transmission to the Bluetooth device.

[0132] Key quality indicators of Bluetooth audio signals, such as transmission latency, packet loss rate, and interference intensity, are periodically collected from Bluetooth devices to form quantitative transmission quality data, providing a basis for subsequent strategy adjustments.

[0133] For example, transmission delay can be calculated using the timestamp difference method. When the terminal sends a data packet, it records the sending timestamp (T_send). After receiving the packet, the Bluetooth device returns an acknowledgment frame containing the receiving timestamp (T_recv). Transmission delay ΔT = T_recv - T_send (excluding Bluetooth device processing time, only counting over-the-air transmission time). The average transmission delay is calculated every 100ms (the average of 5 measurements).

[0134] Packet loss rate can be calculated using continuous frame sequence number verification. The terminal assigns a continuous frame sequence number (0~65535) to each data packet. The total number of frames sent in 1 second (N_total) is counted and compared with the number of frames acknowledged by the Bluetooth device (N_recv). Packet loss rate = (N_total - N_recv) / N_total × 100%.

[0135] Interference intensity can be monitored using the channel RSSI (Received Signal Strength Index). The Bluetooth module scans the current channel's RSSI value (in dBm) in real time. RSSI > -80dBm (small absolute value) indicates strong interference, while RSSI < -90dBm indicates weak interference. The RSSI value is recorded every 50ms, and the average interference intensity over 1 second is calculated. Quality data (latency, packet loss rate, interference intensity) is recorded in real time.

[0136] This refers to dynamically adjusting the transmission parameters (such as channel, bit rate, and power) of Bluetooth audio signals based on monitored transmission quality data (latency, packet loss rate, and interference intensity) to maintain transmission quality within preset thresholds (latency ≤ 30ms, packet loss rate ≤ 5%). For example, when latency > 30ms or packet loss rate > 5%, the compression coding bit rate is reduced (e.g., from 256kbps to 192kbps, then to 128kbps). Each reduction in bit rate is expected to reduce latency by 5 to 10ms and packet loss rate by 3% to 5%. When quality recovers, such as latency ≤ 25ms and packet loss rate ≤ 3%, the bit rate is gradually increased to avoid frequent fluctuations.

[0137] This application detects signal quality and dynamic strategy changes during transmission in real time, preventing problems from escalating when they are detected. Quantified quality data provides a clear basis for adjustments, improving data effectiveness.

[0138] Further reference Figure 3 As a response to the above Figure 2 The implementation of the method shown in this application provides an embodiment of an audio signal transmission device, which is similar to... Figure 2 Corresponding to the method embodiments shown, this device can be specifically applied to various electronic devices.

[0139] like Figure 3 As shown, the audio signal transmission device 300 described in this embodiment includes: a data acquisition module 301, a preprocessing module 302, a mixing module 303, a conversion module 304, and a Bluetooth output module 305. Wherein:

[0140] The acquisition module 301 is used to acquire audio signals, including public network audio signals and private network audio signals, wherein the private network audio signals are obtained by receiving and parsing data packets from the private network module through a serial communication interface.

[0141] Preprocessing module 302 is used to preprocess the public network audio signal and the private network audio signal to obtain preprocessed public network audio signal and preprocessed private network audio signal;

[0142] The mixing module 303 is used to mix the preprocessed public network audio signal and the preprocessed private network audio signal to obtain a mixed audio signal;

[0143] Conversion module 304 is used to encode the mixed audio signal into Bluetooth protocol format through an application to generate a Bluetooth audio signal;

[0144] Bluetooth output module 305 is used to transmit the Bluetooth audio signal to a Bluetooth device.

[0145] This application provides a public network and private network audio fusion and Bluetooth collaborative transmission device. By performing protocol parsing and mixing processing on private network data packets at the software level, it achieves seamless fusion of public network and private network audio and Bluetooth collaborative output. It solves the problem that additional hardware modules are needed for public network and private network audio fusion and Bluetooth-to-private network interoperability. It achieves low latency and high compatibility transmission, and improves user experience and operational efficiency in complex communication scenarios.

[0146] In some embodiments, the public network and private network audio fusion and Bluetooth cooperative transmission device provided in this application can also be applied to related hardware circuits and architectures.

[0147] Specifically, the acquisition module 301 is used to acquire public network audio signals and private network audio signals, and may include digital audio interface circuits, analog audio acquisition circuits, universal serial interface circuits, etc. The preprocessing module 302 is responsible for timing calibration and format conversion of the audio signals, and its hardware may include a DSP (Digital Signal Processor) core, a dedicated hardware accelerator, an FPGA (Field-Programmable Gate Array), CPLD (Complex Programmable Logic Device) logic units, and a main processor (CPU / AP). The mixing module 303 intelligently mixes the two audio streams based on feature analysis, and its hardware may include a GPU (Graphics Processing Unit) parallel computing unit, an AI accelerator (NPU), a DSP, and a high-performance CPU. The conversion module 304 is responsible for encoding the mixed audio into Bluetooth format, and its hardware may include a hardware audio encoder, encoding logic within the Bluetooth chip, and a main processor. The Bluetooth output module 305 is responsible for transmitting Bluetooth signals, and its hardware may include a Bluetooth baseband processor and radio frequency (RF) front-end circuits (such as power amplifiers, low-noise amplifiers, and antenna switches). It modulates the digital baseband signal generated by the conversion module 304 to the 2.4GHz frequency band and radiates it out through the antenna.

[0148] The methods and apparatus described in this application are not limited to pure software implementation. They can intelligently preprocess, feature-aware mixing, and unified Bluetooth encapsulation of multi-source audio, and can be effectively mapped to various hardware circuit architectures, including but not limited to highly integrated SoCs, embedded systems composed of discrete components, and minor hardware modifications to existing devices.

[0149] To address the aforementioned technical problems, embodiments of this application also provide a computer device. Please refer to [link / reference needed]. Figure 4 , Figure 4 This is a basic structural block diagram of the computer device in this embodiment.

[0150] The computer device 4 includes a memory 41, a processor 42, and a network interface 43 that are interconnected via a system bus. It should be noted that only the computer device 4 with components 41-43 is shown in the figure; however, it should be understood that it is not required to implement all the shown components, and more or fewer components can be implemented alternatively. Those skilled in the art will understand that the computer device described here is a device capable of automatically performing numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes, but is not limited to, microprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), embedded devices, etc.

[0151] The computer device can be a desktop computer, laptop, handheld computer, or cloud server, etc. The computer device can interact with the user via a keyboard, mouse, remote control, touchpad, or voice control.

[0152] The memory 41 includes at least one type of readable storage medium, including flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 41 may be an internal storage unit of the computer device 4, such as the hard disk or memory of the computer device 4. In other embodiments, the memory 41 may also be an external storage device of the computer device 4, such as a plug-in hard disk, smart media card (SMC), secure digital card (SD), flash card, etc., equipped on the computer device 4. Of course, the memory 41 may also include both the internal storage unit and its external storage device of the computer device 4. In this embodiment, the memory 41 is typically used to store the operating system and various application software installed on the computer device 4, such as computer-readable instructions for audio signal transmission methods. In addition, the memory 41 can also be used to temporarily store various types of data that have been output or will be output.

[0153] In some embodiments, the processor 42 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip. The processor 42 is typically used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is used to execute computer-readable instructions stored in the memory 41 or to process data, for example, to execute computer-readable instructions for the audio signal transmission method.

[0154] The network interface 43 may include a wireless network interface or a wired network interface, which is typically used to establish communication connections between the computer device 4 and other electronic devices.

[0155] The computer device provided in this application performs protocol parsing and mixing of private network data packets at the software level, realizing seamless integration of public network and private network audio and Bluetooth collaborative output. It solves the problem that additional hardware modules are needed for public and private network audio integration and Bluetooth and private network interoperability, achieving low latency and high compatibility transmission, and improving user experience and operational efficiency in complex communication scenarios.

[0156] This application also provides another embodiment, namely, providing a computer-readable storage medium storing computer-readable instructions that can be executed by at least one processor to cause the at least one processor to perform the steps of the audio signal transmission method described above.

[0157] The computer-readable storage medium provided in this application performs protocol parsing and mixing of private network data packets at the software level, realizing seamless integration of public network and private network audio and Bluetooth collaborative output. It solves the problem that additional hardware modules are needed for public and private network audio integration and Bluetooth-to-private network interoperability, achieving low-latency and high-compatibility transmission, and improving user experience and operational efficiency in complex communication scenarios.

[0158] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0159] Obviously, the embodiments described above are only some embodiments of this application, not all embodiments. The accompanying drawings show preferred embodiments of this application, but do not limit the patent scope of this application. This application can be implemented in many different forms; rather, these embodiments are provided to provide a more thorough and comprehensive understanding of the disclosure of this application. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing specific embodiments, or make equivalent substitutions for some of the technical features. Any equivalent structures made using the content of this application's specification and drawings, directly or indirectly applied to other related technical fields, are similarly within the scope of patent protection of this application.

Claims

1. An audio signal transmission method, characterized by, The method comprises the following steps: collecting an audio signal, wherein the audio signal comprises a public network audio signal and a private network audio signal; preprocessing the public network audio signal and the private network audio signal to obtain a preprocessed public network audio signal and a preprocessed private network audio signal; mixing the preprocessed public network audio signal and the preprocessed private network audio signal to obtain a mixed audio signal; encoding the mixed audio signal to generate a Bluetooth audio signal in a Bluetooth protocol format; transmitting the Bluetooth audio signal to a Bluetooth device; wherein the mixing of the preprocessed public network audio signal and the preprocessed private network audio signal to obtain the mixed audio signal comprises: extracting the voice activity and signal strength of the preprocessed public network audio signal, and taking the voice activity and signal strength of the preprocessed public network audio signal as a first feature group; extracting the voice activity and signal strength of the preprocessed private network audio signal, and taking the voice activity and signal strength of the preprocessed private network audio signal as a second feature group; mixing the preprocessed public network audio signal and the preprocessed private network audio signal according to the first feature group and the second feature group to obtain the mixed audio signal.

2. The audio signal transmission method of claim 1, wherein, The preprocessing of the public network audio signal and the private network audio signal to obtain the preprocessed public network audio signal and the preprocessed private network audio signal comprises: adding a timestamp to the public network audio signal and the private network audio signal to obtain the preprocessed public network audio signal and the preprocessed private network audio signal.

3. The audio signal transmission method of claim 1, wherein, The mixing of the preprocessed public network audio signal and the preprocessed private network audio signal according to the first feature group and the second feature group to obtain the mixed audio signal comprises: obtaining a total weight value of the first feature group and the second feature group; obtaining a public network allocation weight according to the first feature group and the total weight value; obtaining a private network allocation weight according to the second feature group and the total weight value; mixing the preprocessed public network audio signal and the preprocessed private network audio signal according to the public network allocation weight and the private network allocation weight through a preset mixing model to obtain the mixed audio signal.

4. The audio signal transmission method according to claim 3, characterized in that, The obtaining of the public network allocation weight according to the first feature group and the total weight value comprises: obtaining a priority of the public network audio signal; obtaining the public network allocation weight according to the priority, the first feature group and the total weight value.

5. The audio signal transmission method of claim 1, wherein, The encoding of the mixed audio signal to generate the Bluetooth audio signal in the Bluetooth protocol format comprises: performing compression processing on the mixed audio signal to obtain compressed encoding data; packaging the compressed encoding data into a data packet conforming to the Bluetooth protocol format to obtain the Bluetooth audio signal.

6. The audio signal transmission method of claim 1, wherein, After the transmission of the Bluetooth audio signal to the Bluetooth device, the method comprises: obtaining a transmission quality of the Bluetooth audio signal; adjusting parameters of the Bluetooth device according to the transmission quality and a preset threshold.

7. An audio signal transmission apparatus characterized by comprising: The method comprises: The collection module is used for collecting an audio signal, wherein the audio signal comprises a public network audio signal and a private network audio signal. The preprocessing module is used for preprocessing the public network audio signal and the private network audio signal to obtain a preprocessed public network audio signal and a preprocessed private network audio signal. The mixing module is used for mixing the preprocessed public network audio signal and the preprocessed private network audio signal to obtain a mixed audio signal. The conversion module is used for encoding the mixed audio signal to generate a Bluetooth audio signal in a Bluetooth protocol format. The Bluetooth output module is used for transmitting the Bluetooth audio signal to a Bluetooth device. The mixing of the preprocessed public network audio signal and the preprocessed private network audio signal to obtain the mixed audio signal comprises the following steps: extracting a speech activity and a signal strength of the preprocessed public network audio signal as a first feature group; extracting a speech activity and a signal strength of the preprocessed private network audio signal as a second feature group; mixing the preprocessed public network audio signal and the preprocessed private network audio signal according to the first feature group and the second feature group to obtain the mixed audio signal.

8. A computer device, comprising: The computer readable storage medium stores computer readable instructions, and the computer readable instructions are executed by the processor to realize the steps of the audio signal transmission method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer readable instructions, and the computer readable instructions are executed by the processor to realize the steps of the audio signal transmission method according to any one of claims 1 to 6.

Images