UWB-based audio transmission method and device, terminal, and storage medium
Through UWB technology and linear predictive coding, lossless compression, and packet loss compensation methods, the bandwidth, stability and delay problems of traditional audio transmission technology are solved, efficient and low-latency audio data transmission is achieved, and user experience is improved.
Patent Information
- Application Number
- PCT/CN2024/070094
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-02
- Publication Date
- 2025-07-10
AI Technical Summary
Traditional wireless audio transmission technology has limitations in bandwidth, stability, delay and ability to penetrate obstacles, affecting the consistency of sound quality and user experience.
UWB technology is used to transmit audio signals, combining linear predictive coding, lossless compression, decompression and packet loss compensation methods to transmit audio signals through the UWB channel to reduce delay and ensure data integrity.
It realizes low latency, high efficiency and data integrity audio transmission, improving the stability and user experience of audio transmission.
Smart Images

Figure CN2024070094_10072025_PF_FP_ABST
Abstract
Description
UWB-based audio transmission method, device, terminal and storage medium Technical Field
[0001] The present invention relates to the field of information technology, and in particular to a UWB-based audio transmission method, device, terminal and storage medium. Background Art
[0002] With the advancement of wireless technology, traditional technologies like Wi-Fi, BT, and LE-audio are becoming increasingly mature as wireless transmission methods for multi-channel audio. Freed from the constraints of wired connections, people can now enjoy 5.1 / 7.1 multi-channel music at any time, providing greater flexibility and convenience for daily life and a superior entertainment experience. Bluetooth TWS earphones, Bluetooth speakers, Wi-Fi speakers, and other products adapted to multi-channel applications have emerged, and corresponding audio transmission technologies and processing algorithms have also evolved. Combined with superior audio decoding technology, these technologies create a concert-like experience.
[0003] However, current technologies like Wi-Fi and BT have limitations in terms of transmission stability, latency, and the ability to penetrate obstacles due to bandwidth constraints. Stable audio transmission is crucial to ensuring consistent sound quality, while traditional communication technologies can be subject to interference or latency in certain situations, impacting the user experience.
[0004] Summary of the Invention
[0005] Embodiments of the present invention provide a UWB-based audio transmission method, device, terminal, and storage medium, which transmit audio signals through a UWB channel, minimize the delay caused by transmission and processing, and achieve audio transmission with higher data integrity and efficiency through lossless compression, decompression, and packet loss compensation.
[0006] An embodiment of the present invention provides a UWB-based audio transmission method, which is applied to an audio transmission system. The audio transmission system includes a transmitting end and a receiving end, including:
[0007] Acquire a digital audio signal, and compress the digital signal based on linear predictive coding;
[0008] Converting the compressed digital signal into a pulse signal, and controlling the transmitting end to transmit the pulse signal in a UWB channel;
[0009] Controlling the receiving end to demodulate the pulse signal into a digital signal and decompress it after receiving the pulse signal;
[0010] The decompressed digital signal is subjected to packet loss detection processing, and the detected packet loss data is compensated to obtain a complete audio digital signal.
[0011] Optionally, the step of obtaining a digital audio signal includes at least one of the following:
[0012] Converting the received analog signal into the digital signal by analog-to-digital conversion; and / or
[0013] The digital signal is extracted from a high-definition audio file.
[0014] Optionally, compressing the digital signal based on linear predictive coding includes:
[0015] Performing linear predictive coding on the digital signal to obtain a prediction residual;
[0016] The pre-acquired linear prediction coefficient and the prediction residual are entropy coded to obtain a coded bit stream to complete the compression of the digital signal.
[0017] Optionally, converting the compressed digital signal into a pulse signal includes:
[0018] determining pulse shape, amplitude, and frequency parameters based on the compressed digital signal;
[0019] The digital signal is mapped into a pulse sequence suitable for UWB transmission based on the pulse shape, amplitude and frequency parameters to obtain the pulse signal.
[0020] Optionally, performing packet loss detection processing on the decompressed digital signal and compensating the detected packet loss data includes:
[0021] detecting a data packet according to a forward error correction code in the decompressed digital signal;
[0022] If data packet loss is detected, a message is sent to the sending end according to the forward error correction code, and the sending end is controlled to search for corresponding packet loss data in a sending buffer according to the message for retransmission.
[0023] Optionally, performing packet loss detection on the decompressed digital signal and compensating for the detected packet loss data includes:
[0024] performing packet loss detection processing on the decompressed digital signal;
[0025] If data packet loss is detected, the lost data is reconstructed from other associated data packets according to the check code to compensate for it.
[0026] Optionally, before sending the pulse signal, the method further includes:
[0027] Obtain the device chip ID of the sending end;
[0028] The device chip ID is combined with a random number to obtain a key, and the key is sent to the receiving end so that the receiving end decompresses the key.
[0029] An embodiment of the present invention further provides a UWB-based audio transmission device, which is applied to an audio transmission system. The audio transmission system includes a transmitting end and a receiving end, including:
[0030] a compression unit, configured to obtain a digital audio signal and compress the digital signal based on linear predictive coding;
[0031] a transmitting unit, configured to convert the compressed digital signal into a pulse signal, and control the transmitting end to transmit the pulse signal in a UWB channel;
[0032] A receiving unit, configured to control the receiving end to demodulate the pulse signal into a digital signal and decompress it after receiving the pulse signal;
[0033] The compensation unit is used to perform packet loss detection processing on the decompressed digital signal and compensate the detected packet loss data to obtain a complete audio digital signal.
[0034] An embodiment of the present invention further provides a terminal, comprising: a memory and a processor, wherein the memory stores an application processing program, and when the application processing program is executed by the processor, the steps of any one of the UWB-based audio transmission methods provided in the embodiments of the present invention are implemented.
[0035] An embodiment of the present invention further provides a storage medium storing a plurality of instructions suitable for loading by a processor to execute any UWB-based audio transmission method provided by an embodiment of the present invention.
[0036] The UWB-based audio transmission method provided in an embodiment of the present invention can obtain an audio digital signal, compress the digital signal based on linear predictive coding, convert the compressed digital signal into a pulse signal, and control the transmitter to send the pulse signal in the UWB channel. After receiving the pulse signal, the receiver demodulates it into a digital signal and decompresses it, performs packet loss detection on the decompressed digital signal, and compensates for the detected packet loss data to obtain a complete audio digital signal. The solution provided in the embodiment of the present application transmits audio signals through a UWB channel, reduces the delay caused by transmission and processing to a minimum, and achieves audio transmission with higher data integrity and efficiency through lossless compression, decompression, and packet loss compensation. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0038] FIG1 is a schematic diagram of a first flow chart of a UWB-based audio transmission method according to an embodiment of the present invention;
[0039] FIG2 is a schematic diagram of a second flow chart of a UWB-based audio transmission method according to an embodiment of the present invention;
[0040] 3 is a schematic structural diagram of an audio transmission system provided in an embodiment of the present invention;
[0041] 4 is a schematic structural diagram of a UWB-based audio transmission device according to an embodiment of the present invention;
[0042] FIG5 is a schematic structural diagram of a terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0043] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
[0044] It should be noted that, in this document, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.
[0045] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are shown in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless clearly stated herein, the execution of these steps is not strictly limited in order, and they can be performed in other orders. Moreover, at least a portion of the steps in the figure may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.
[0046] It should be noted that in this article, step codes such as 101 and 102 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the order. Those skilled in the art may execute 102 first and then 101, etc. during specific implementation, but these should all be within the scope of protection of this application.
[0047] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present invention. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute a separate or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0048] An embodiment of the present invention provides a UWB-based audio transmission method. The execution subject of the UWB-based audio transmission method may be the audio sending device provided in the embodiment of the present invention.
[0049] As shown in FIG1 , FIG1 is a schematic diagram of a first flow chart of a UWB-based audio transmission method provided in an embodiment of the present invention. The specific flow of the UWB-based audio transmission method may be as follows:
[0050] 101. Obtain an audio digital signal, and compress the digital signal based on linear predictive coding.
[0051] In one embodiment, the audio transmission system used in this method includes an audio transmitter and an audio receiver. At the transmitter, the audio signal must first be digitized and losslessly compressed to ensure data integrity and sound quality. Specifically, this embodiment can convert the analog signal into a digital signal using analog-to-digital conversion (ADC) technology, or directly obtain the digital audio signal from a high-definition audio file. That is, the step of obtaining the digital audio signal includes at least one of the following: converting the received analog signal into the digital signal through analog-to-digital conversion; and / or extracting the digital signal from a high-definition audio file.
[0052] In one embodiment, when using the principle of prediction and coding, a linear prediction relationship between audio samples can be analyzed to generate a difference signal (residual signal). These residual signals are then encoded using an effective coding scheme, thereby achieving efficient data compression while maintaining sound quality.
[0053] 102. Convert the compressed digital signal into a pulse signal, and control the transmitter to send the pulse signal in the UWB channel.
[0054] Among them, the UWB-based audio transmission method provided in the embodiment of the present application is based on UWB (Ultra Wide Band) technology. UWB technology is a wireless communication technology that uses ultra-short pulses or extremely wide bandwidth continuous waves for data transmission. It has the advantages of low system complexity, low power spectrum density of transmitted signals, insensitivity to channel fading, low interception capability, and high positioning accuracy. It is particularly suitable for high-speed wireless access in dense multipath places such as indoors. Therefore, the devices connected by the method provided by the present application can achieve more efficient, high-quality and low-latency audio transmission between different devices due to the use of UWB ultra-wideband technology, thereby providing users with an excellent auditory experience.
[0055] In one embodiment, compressed audio data is intelligently modulated and converted into a pulse signal suitable for UWB transmission. This compression method not only ensures audio quality, but also effectively reduces the bandwidth and time required for transmission, and also reduces the risk of packet loss during transmission. The compressed and modulated pulse signal can then be transmitted to the receiver via the UWB channel.
[0056] 103. After receiving the pulse signal, the control receiving end demodulates the pulse signal into a digital signal and decompresses the signal.
[0057] Furthermore, at the receiving end, the pulse signal is demodulated and decompressed, restoring the compressed audio data to the original lossless audio signal. Specifically, the modulated UWB signal is transmitted via the transmitting UWB antenna to the receiving device. UWB technology allows signals to be transmitted with extremely short pulse durations, enabling high-precision time positioning and multipath interference mitigation. The UWB receiver at the receiving end receives the transmitted UWB signal and demodulates the received pulse sequence into a digital signal.
[0058] In one embodiment, the received UWB pulse signal is demodulated and converted back into a digital signal by using a previously implemented lossless compression algorithm, thereby restoring the demodulated data to the original lossless audio data.
[0059] 104. Perform packet loss detection on the decompressed digital signal and compensate for the detected packet loss data to obtain a complete audio digital signal.
[0060] At this stage, the application focuses on resolving potential packet loss issues to ensure transmission stability and audio reliability. By introducing a packet loss detection mechanism, the system can accurately determine whether packet loss has occurred during transmission. The packet loss detection step may include: verifying the decompressed digital signal to determine whether a packet is lost. If so, sending a packet loss notification to the sender and controlling the sender to retransmit the lost packet based on the packet loss notification.
[0061] In one embodiment, to address packet loss, the system can further utilize a packet loss compensation mechanism to compensate for detected packet loss, thereby obtaining a complete audio digital signal. Specifically, lost data packets can be recovered at the receiving end by introducing redundant data and forward error correction (FEC). Forward Error Correction (FEC) is a technology used to control transmission errors in one-way communication systems. It performs error recovery by sending additional information along with the data to reduce the bit error rate. Forward error correction codes can, to a certain extent, recover lost data.
[0062] Redundant data refers to the transmission of not only the original data but also some redundant data based on correlations, allowing the decoder to reconstruct lost packets based on the correlations between the data. The introduction of redundant data further enhances data integrity and stability. The application of these technologies ensures that audio data consistency is maintained even under adverse transmission conditions.
[0063] In addition to the two packet loss compensation methods mentioned above, in another embodiment, interleaving technology can also be used. Interleaving technology is not a true packet loss recovery technology because it cannot recover data packets that have been lost, but this technology can reduce the losses caused by packet loss. Interleaving technology is to divide the original data into several units smaller than IP packets, and reorder the order of these units before sending, so that the data in each IP packet comes from different voice frames. When frame loss occurs, only part of the data of each frame is lost, and the entire frame of data will not be lost. These units are reordered at the receiving end. Interleaving technology takes advantage of the human brain's ability to automatically recover part of the lost data through auditory perception. When only a small amount of data is lost in each frame, the impact on the human ear's hearing is small, thereby improving the sound quality. Since no additional information is output, the bandwidth will not be increased.
[0064] This embodiment ensures the integrity of the audio data by compensating for packet loss through the above steps. At the same time, the system is also optimized for the low-latency requirements of real-time audio transmission, leveraging the low-latency characteristics of UWB technology and optimized signal processing to minimize the delay caused by transmission and processing. In summary, the embodiment of this application successfully achieves low latency, data integrity, and high-efficiency high-quality audio transmission for smart devices while achieving high-quality audio transmission through lossless compression, decompression, and packet loss compensation.
[0065] It should be noted that the above-mentioned electronic device can be any device capable of LTE communication, such as: a mobile phone, a tablet personal computer, a laptop computer, a personal digital assistant (PDA), a mobile internet device (MID) or a wearable device.
[0066] As described above, the UWB-based audio transmission method proposed in the embodiment of the present invention can obtain the digital signal of the audio, compress the digital signal based on linear predictive coding, convert the compressed digital signal into a pulse signal, and control the transmitting end to send the pulse signal in the UWB channel. After receiving the pulse signal, the receiving end demodulates it into a digital signal and decompresses it, performs packet loss detection processing on the decompressed digital signal, and compensates for the detected packet loss data to obtain a complete audio digital signal. The solution provided in the embodiment of the present application transmits audio signals through the UWB channel, reduces the delay caused by transmission and processing to the lowest level, and achieves audio transmission with higher data integrity and efficiency through means such as lossless compression, decompression and packet loss compensation.
[0067] The method described in the above embodiment will be further described below.
[0068] Please refer to FIG2 , which is a schematic diagram of a second flow chart of a UWB-based audio transmission method provided by an embodiment of the present invention. The method includes:
[0069] 201. Obtain an audio digital signal, perform linear predictive coding on the digital signal, and obtain a prediction residual.
[0070] 202. Perform entropy coding on the pre-acquired linear prediction coefficients and prediction residuals to obtain a coded bit stream to complete the compression of the digital signal.
[0071] During linear predictive coding, the digital signal corresponding to the audio sample can be used as a reference signal to analyze the linear prediction relationship between the audio samples. Specifically, linear predictive coding can be performed on the digital signal based on the audio sample to obtain a prediction residual. The pre-acquired linear prediction coefficients and prediction residual are then entropy-coded to produce a coded bitstream. This method achieves efficient data compression while maintaining sound quality.
[0072] 203. Determine pulse shape, amplitude, and frequency parameters based on the compressed digital signal.
[0073] 204. Map the digital signal to a pulse sequence suitable for UWB transmission based on the pulse shape, amplitude, and frequency parameters to obtain a pulse signal, and control the transmitter to transmit the pulse signal in the UWB channel.
[0074] In one embodiment, intelligent modulation techniques are used to map compressed audio data into pulse sequences suitable for UWB transmission. This step converts digital audio data into pulse signals suitable for transmission over UWB channels. Intelligent modulation involves selecting an appropriate modulation scheme to ensure data reliability over the UWB channel.
[0075] Specifically, this embodiment utilizes a selected modulation scheme to convert a pulse sequence into a pulse signal suitable for transmission over a UWB channel. This process involves mapping digital information onto parameters such as pulse shape, amplitude, and frequency to create a signal that meets UWB technical requirements. This step ensures that the generated UWB signal can be stably transmitted over the channel and accurately interpreted at the receiving end.
[0076] 205. After receiving the pulse signal, the control receiving end demodulates the signal into a digital signal and decompresses the signal.
[0077] At the receiving end, the pulse signal is demodulated and decompressed, thereby restoring the compressed audio data to the original lossless audio signal. To further enhance the security of audio data transmission, decompression can also be performed using a key sent by the sending end. This key can be generated and sent by the sending end. In one embodiment, before sending the pulse signal, the method may further include obtaining the device chip ID of the sending end, combining the device chip ID with a random number to obtain a key, and sending the key to the receiving end, so that the receiving end can perform decompression based on the key.
[0078] 206. Perform packet loss detection on the decompressed digital signal and compensate for the detected packet loss data to obtain a complete audio digital signal.
[0079] In one embodiment, the steps of performing packet loss detection on a decompressed digital signal and compensating for the detected lost data may include: detecting the data packet based on a forward error correction code in the decompressed digital signal; if data loss is detected, sending a message to the transmitter based on the forward error correction code; and controlling the transmitter to search for the corresponding lost data in a send buffer based on the message for retransmission. Specifically, the transmitter may add a forward error correction code to the data packet, which is then sent along with the data packet to the receiver; the receiver checks and corrects the data based on the error correction code. Upon detecting data loss, the receiver may send a negative acknowledgement (NACK) message to the transmitter; the transmitter, based on the sequence number in the NACK message, locates the corresponding data packet in the send buffer and retransmits it to the receiver.
[0080] In another embodiment, the steps of performing packet loss detection on the decompressed digital signal and compensating for the detected lost data may include: performing packet loss detection on the decompressed digital signal, and if data loss is detected, reconstructing the lost data from other associated data packets based on a check code to compensate for the lost data. Specifically, in this embodiment, the transmitting end not only transmits the original data but also transmits some redundant data based on correlation, so that the receiving end can reconstruct the lost data packets based on the correlation between the data. For example, a parity check code may be used. This method transmits a check code containing the exclusive-or operation of the previous n data packets for every n-1 data packets. If the network loses only one packet out of every n data packets, the lost data packet can be reconstructed from the other n-1 data packets.
[0081] In other embodiments, packet loss compensation can be achieved using low-rate redundant coding (LRC). LRCC is a redundancy technique where each data packet contains not only its own data but also a compressed copy of the previous frame's data. This copy is low-quality and occupies fewer bits. When a packet is lost at the receiving end, this copy can be used to quickly reconstruct the lost packet from subsequent packets.
[0082] Through this step, it is ensured that the audio data can withstand various challenges during the transmission process, thereby providing users with a stable and reliable audio experience. By compensating for and recovering lost data packets, it is possible to effectively deal with uncertainties in transmission, thereby ensuring that users obtain high-quality audio transmission services. The UWB-based audio transmission method provided in the embodiment of the present application has outstanding improvements over traditional WiFi and Bluetooth technologies, including high-quality broadband transmission, high data transmission rate, low interference and stability, low-latency transmission, and support for lossless compression transmission of up to 192k audio files. These improvements together ensure that users can enjoy a higher quality and more realistic audio experience.
[0083] The UWB-based audio transmission method provided in the embodiment of the present application can be applied to many scenarios that require high sound quality and low latency, such as conference systems, conference treasures, telephone systems, gaming headsets, AR / VR / XR devices, etc. Take the conference scenario as an example, please refer to Figure 3, which is a structural diagram of the audio transmission system provided by the embodiment of the present invention. Among them, UWB device A is connected to the computer through the network, and communicates with multiple UWB devices B at the remote end (such as a meeting), UWB device A and UWB devices B1, B2, B3...Bn can realize wireless voice transmission through UWB, UWB devices A, B1, B2, B3...Bn are all equipped with microphones and speakers, the microphone is used to collect voice information at different locations, etc., and the speaker can return the voice information collected by other endpoints to realize long-distance multi-point two-way audio transmission.
[0084] Furthermore, in the above scenario, the bidirectional voice transmission process can include: UWB device A synthesizes the real-time voice / audio information collected by UWB devices B2, B3, ..., Bn and transmits it to B1. That is, the voice heard by A = B1 + B2 + B3 + B4 ... + Bn, the voice heard by B1 = A + B2 + B3 + B4 ... + Bn, the voice heard by B2 = A + B1 + B3 + B4 ... + Bn, the voice heard by B3 = A + B1 + B2 + B4 ... + Bn, the voice heard by B4 = A + B1 + B2 + B3 ... + Bn, and the voice heard by Bn = A + B1 + B2 + B3 + B4 ... + Bn-1. In addition, the above multiple UWB devices B can also be grouped and managed. For example, UWB device A can group and manage UWB devices B1, B2, B3, B4, ..., Bn. For example, assign B1, B2, and B3 into one group, and assign B4...Bn into one group.
[0085] As described above, the UWB-based audio transmission method proposed in the embodiment of the present invention can obtain an audio digital signal, perform linear prediction coding on the digital signal to obtain a prediction residual, perform entropy coding on the pre-acquired linear prediction coefficient and prediction residual to obtain a coded code stream to complete the compression of the digital signal, determine the pulse shape, amplitude and frequency parameters according to the compressed digital signal, map the digital signal to a pulse sequence suitable for UWB transmission based on the pulse shape, amplitude and frequency parameters to obtain a pulse signal, and control the transmitter to send the pulse signal in the UWB channel, control the receiver to demodulate it into a digital signal and decompress it after receiving the pulse signal, perform packet loss detection processing on the decompressed digital signal, and compensate for the detected packet loss data to obtain a complete audio digital signal. The solution provided in the embodiment of the present application transmits audio signals through the UWB channel, reduces the delay caused by transmission and processing to a minimum level, and achieves audio transmission with higher data integrity and efficiency through lossless compression, decompression and packet loss compensation.
[0086] In order to implement the above method, an embodiment of the present invention further provides a UWB-based audio transmission device, which is applied to an audio transmission system. The audio transmission system includes a transmitting end and a receiving end, and terminal devices such as mobile phones, tablet computers, etc.
[0087] For example, as shown in FIG4 , which is a schematic diagram of a first structure of a UWB-based audio transmission device provided by an embodiment of the present invention, the UWB-based audio transmission device may include:
[0088] A compression unit 301 is configured to obtain a digital audio signal and compress the digital signal based on linear predictive coding;
[0089] The transmitting unit 302 is configured to convert the compressed digital signal into a pulse signal and control the transmitting end to transmit the pulse signal in the UWB channel;
[0090] The receiving unit 303 is configured to control the receiving end to demodulate the pulse signal into a digital signal and perform decompression after receiving the pulse signal;
[0091] The compensation unit 304 is configured to perform packet loss detection on the decompressed digital signal and compensate for the detected packet loss data to obtain a complete audio digital signal.
[0092] The UWB-based audio transmission device proposed in the embodiment of the present invention can obtain the digital signal of the audio, compress the digital signal based on linear predictive coding, convert the compressed digital signal into a pulse signal, and control the transmitting end to send the pulse signal in the UWB channel. After receiving the pulse signal, the receiving end demodulates it into a digital signal and decompresses it, performs packet loss detection processing on the decompressed digital signal, and compensates for the detected packet loss data to obtain a complete audio digital signal. The solution provided in the embodiment of the present application transmits audio signals through the UWB channel, reduces the delay caused by transmission and processing to the lowest level, and achieves audio transmission with higher data integrity and efficiency through means such as lossless compression, decompression and packet loss compensation.
[0093] An embodiment of the present invention further provides a terminal, as shown in FIG5 , which may include a radio frequency (RF) circuit 601, a memory 602 including one or more computer-readable storage media, an input unit 603, a display unit 604, a sensor 605, an audio circuit 606, a wireless fidelity (WiFi) module 607, a processor 608 including one or more processing cores, and a power supply 609. It will be understood by those skilled in the art that the terminal structure shown in FIG5 does not constitute a limitation on the terminal, and may include more or fewer components than shown, or combine certain components, or arrange the components differently. Among them:
[0094] The RF circuit 601 can be used to receive and send signals during information transmission or calls. In particular, after receiving downlink information from the base station, it is handed over to one or more processors 608 for processing; in addition, uplink data is sent to the base station. Generally, the RF circuit 601 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM) card, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc. In addition, the RF circuit 601 can also communicate with the network and other devices via wireless communication. Wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.
[0095] The memory 602 can be used to store software programs and modules. The processor 608 executes various functional applications and information processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.); the data storage area may store data created according to the use of the terminal (such as audio data, a phone book, etc.). In addition, the memory 602 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 608 and the input unit 603 with access to the memory 602.
[0096] The input unit 603 can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical, or trackball signal input related to user settings and function control. Specifically, in one embodiment, the input unit 603 may include a touch-sensitive surface and other input devices. A touch-sensitive surface, also known as a touch display or touchpad, can detect user touch operations on or near it (for example, operations performed by a user using a finger, stylus, or any other suitable object or accessory on or near the touch-sensitive surface) and drive corresponding connected devices according to a pre-set program. Optionally, the touch-sensitive surface may include a touch detection device and a touch controller. The touch detection device detects the user's touch direction and detects signals generated by the touch operation, transmitting the signals to the touch controller. The touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 608. It can also receive and execute commands from the processor 608. In addition, touch-sensitive surfaces can be implemented using various types, such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface, the input unit 603 may also include other input devices. Specifically, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.
[0097] The display unit 604 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the terminal, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 604 may include a display panel. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch-sensitive surface can cover the display panel. When the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor 608 to determine the type of touch event. The processor 608 then provides a corresponding visual output on the display panel based on the type of touch event. Although in Figure 5, the touch-sensitive surface and the display panel are implemented as two independent components to implement input and output functions, in some embodiments, the touch-sensitive surface and the display panel can be integrated to implement input and output functions.
[0098] The terminal may also include at least one sensor 605, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel according to the brightness of the ambient light, and the proximity sensor may turn off the display panel and / or backlight when the terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the terminal, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be described here.
[0099] Audio circuit 606, a speaker, and a microphone provide an audio interface between the user and the terminal. Audio circuit 606 converts received audio data into electrical signals and transmits them to the speaker, which then converts them into sound signals for output. Conversely, the microphone converts collected sound signals into electrical signals, which are then received by audio circuit 606 and converted into audio data. The audio data is then processed by output processor 608 and transmitted via RF circuit 601 to, for example, another terminal. Alternatively, the audio data is output to memory 602 for further processing. Audio circuit 606 may also include an earphone jack to allow communication between an external headset and the terminal.
[0100] WiFi is a short-range wireless transmission technology. The terminal uses WiFi module 607 to help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband Internet access. Although FIG5 shows WiFi module 607, it is understood that it is not a required component of the terminal and can be omitted as needed without changing the essence of the invention.
[0101] Processor 608 is the terminal's control center, connecting all components of the phone using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 602 and accessing data stored in memory 602, it executes various terminal functions and processes data, thereby providing overall monitoring of the phone. Optionally, processor 608 may include one or more processing cores; preferably, processor 608 may integrate an application processor and a modem processor, with the application processor primarily handling the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 608.
[0102] The terminal also includes a power supply 609 (e.g., a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 608 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 609 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.
[0103] Although not shown, the terminal may also include a camera, a Bluetooth module, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 608 in the terminal will load the executable files corresponding to the processes of one or more applications into the memory 602 according to the following instructions, and the processor 608 will run the applications stored in the memory 602 to implement various functions:
[0104] Acquire a digital audio signal, and compress the digital signal based on linear predictive coding;
[0105] Converting the compressed digital signal into a pulse signal, and controlling the transmitting end to transmit the pulse signal in a UWB channel;
[0106] Controlling the receiving end to demodulate the pulse signal into a digital signal and decompress it after receiving the pulse signal;
[0107] The decompressed digital signal is subjected to packet loss detection processing, and the detected packet loss data is compensated to obtain a complete audio digital signal.
[0108] In the above embodiments, the description of each embodiment has its own focus. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the UWB-based audio transmission method above, which will not be repeated here.
[0109] As can be seen from the above, the terminal of the embodiment of the present invention can obtain the digital signal of the audio, compress the digital signal based on linear predictive coding, convert the compressed digital signal into a pulse signal, and control the transmitting end to send the pulse signal in the UWB channel. After receiving the pulse signal, the receiving end demodulates it into a digital signal and decompresses it, performs packet loss detection processing on the decompressed digital signal, and compensates for the detected packet loss data to obtain a complete audio digital signal. The solution provided by the embodiment of the present application transmits audio signals through the UWB channel, reduces the delay caused by transmission and processing to the lowest level, and achieves audio transmission with higher data integrity and efficiency through means such as lossless compression, decompression and packet loss compensation.
[0110] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0111] To this end, an embodiment of the present invention provides a storage medium storing a plurality of instructions that can be loaded by a processor to execute the steps of any of the UWB-based audio transmission methods provided in the embodiments of the present invention. For example, the instructions can execute the following steps:
[0112] Acquire a digital audio signal, and compress the digital signal based on linear predictive coding;
[0113] Converting the compressed digital signal into a pulse signal, and controlling the transmitting end to transmit the pulse signal in a UWB channel;
[0114] Controlling the receiving end to demodulate the pulse signal into a digital signal and decompress it after receiving the pulse signal;
[0115] The decompressed digital signal is subjected to packet loss detection processing, and the detected packet loss data is compensated to obtain a complete audio digital signal.
[0116] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.
[0117] The storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0118] Since the instructions stored in the storage medium can execute the steps of any UWB-based audio transmission method provided in the embodiments of the present invention, the beneficial effects that can be achieved by any UWB-based audio transmission method provided in the embodiments of the present invention can be achieved. Please refer to the previous embodiments for details and will not be repeated here.
[0119] The above is a detailed introduction to the UWB-based audio transmission method, device, terminal and storage medium provided in the embodiments of the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core ideas. At the same time, for those skilled in the art, according to the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.
Claims
1. An audio transmission method based on UWB, which is applied to an audio transmission system. The audio transmission system includes a sending end and a receiving end, and is characterized in that, Including: Obtain the digital signal of the audio, and compress the digital signal based on linear prediction coding; Convert the compressed digital signal into a pulse signal, and control the sending end to send the pulse signal in the UWB channel; Control the receiving end to demodulate the received pulse signal into a digital signal and perform decompression; Perform packet loss detection processing on the decompressed digital signal, and compensate the detected packet loss data to obtain a complete audio digital signal.
2. The UWB-based audio transmission method according to claim 1, wherein The step of obtaining the digital signal of the audio includes at least one of the following: Convert the received analog signal into the digital signal through analog-to-digital conversion; and / or Extract the digital signal from a high-definition audio file.
3. The UWB-based audio transmission method according to claim 1, wherein The compression of the digital signal based on linear prediction coding includes: Perform linear prediction coding on the digital signal to obtain a prediction residual; Perform entropy coding on the pre-obtained linear prediction coefficients and the prediction residual to obtain an encoded bitstream, so as to complete the compression of the digital signal.
4. The UWB-based audio transmission method according to claim 1, wherein The conversion of the compressed digital signal into a pulse signal includes: Determine the pulse shape, amplitude, and frequency parameters according to the compressed digital signal; Map the digital signal into a pulse sequence suitable for UWB transmission based on the pulse shape, amplitude, and frequency parameters to obtain the pulse signal.
5. The UWB-based audio transmission method according to claim 1, characterized in that, The packet loss detection processing of the decompressed digital signal and the compensation of the detected packet loss data include: Detect the data packet according to the forward error correction code in the decompressed digital signal; If data packet loss is detected, send a message to the sending end according to the forward error correction code, and control the sending end to find the corresponding packet loss data in the sending buffer according to the message and retransmit it.
6. The UWB-based audio transmission method according to claim 1, wherein The packet loss detection processing of the decompressed digital signal and the compensation of the detected packet loss data include: Perform packet loss detection processing on the decompressed digital signal; If data packet loss is detected, reconstruct the packet loss data from other associated data packets according to the check code for compensation.
7. The UWB-based audio transmission method according to any one of claims 1-6, characterized in that Before sending the pulse signal, the method further includes: Obtain the device chip ID of the sending end; Perform a combined operation on the device chip ID and a random number to obtain a key, and send the key to the receiving end so that the receiving end performs decompression according to the key.
8. An audio transmission device based on UWB, which is applied to an audio transmission system. The audio transmission system includes a sending end and a receiving end, and is characterized in that Including: A compression unit for obtaining the digital signal of the audio and compressing the digital signal based on linear prediction coding; A sending unit for converting the compressed digital signal into a pulse signal and controlling the sending end to send the pulse signal in the UWB channel; A receiving unit for controlling the receiving end to demodulate the received pulse signal into a digital signal and perform decompression; A compensation unit for performing packet loss detection processing on the decompressed digital signal and compensating the detected packet loss data to obtain a complete audio digital signal.
9. A terminal, characterized in that, The terminal includes: a memory and a processor. Among them, an application program is stored on the memory, and when the application program is executed by the processor, the steps of the UWB-based audio transmission method described in any one of claims 1 to 7 are implemented.
10. A storage medium, characterized in that, The storage medium stores multiple instructions, and the instructions are suitable for being loaded by the processor to execute the UWB-based audio transmission method described in any one of claims 1 to 7.
Citation Information
Patent Citations
Audio data sending processing method and device as well as audio data receiving processing method and the device
CN108696491A
Audio sharing method and device, terminal, audio equipment and storage medium
CN115412835A
Apparatus and method for voice reproducing
JP2006279809A
Wireless audio transmission system using ultra wideband communication and the method thereof
KR1020090013900A
Audio system sound tuning using ultrawideband radio sensing
US20230292047A1