A wireless low-latency audio transmission method based on an embedded system

Abstract

The present application relates to the technical field of audio transmission, and particularly relates to a wireless low-delay audio transmission method based on an embedded system. Step S1, frame-by-frame acquisition; step S2, difference frame filling processing; step S3, data is converted into a data packet, indirectly misaligned storage is carried out, and is sent to a processing unit for decoding and playing; step S4, whether the audio transmission meets a preset standard is judged, if the preset standard is not met, corresponding parameters in a subsequent data wireless transmission process are adjusted to corresponding values, or secondary judgment is carried out. Compared with the prior art, the beneficial effects of the present application are that the present application can fill frames in time when frames are lost by setting a timer, so that the integrity of the audio data is ensured; at the same time, after the audio data is increased by N times of the misalignment rate, the rate in the transmission to the processing unit is also increased to N times, so that the audio transmission can be sent with high flow and low delay, thereby improving the transmission efficiency.

Description

Technical Field

[0001] This invention relates to the field of audio transmission technology, and in particular to a low-latency wireless audio transmission method based on an embedded system. Background Technology

[0002] For acoustic transmission, television viewers need lip-sync, thus requiring a short delay time to transmit the acoustic signal. Once the time misalignment exceeds a certain threshold, television viewers will perceive the time-displaced audio signal transmission as significant interference.

[0003] Chinese Patent Publication No. CN201880003244.1 discloses a method and system for low-latency audio transmission in a mobile radio network, comprising: a terminal, a base station, and an audio receiver. The terminal transmits audio data encoded according to a second format and other data encoded according to a first format via an uplink. The audio receiver according to the invention directly receives the audio data transmitted via the uplink. Here, one of the encoding / decoding second data frames is affected by other audio data of the same second data frame, but not by the audio data of other second data frames. Therefore, the method and system for low-latency audio transmission in a mobile radio network have the following problem: the audio transmission rate and information integrity cannot be guaranteed in the presence of interference. Summary of the Invention

[0004] To address this issue, the present invention provides a low-latency wireless audio transmission method based on an embedded system, overcoming the problem in existing technologies that cannot guarantee audio transmission rate and information integrity when interference occurs.

[0005] To achieve the above objectives, this invention provides a low-latency wireless audio transmission method based on an embedded system. It includes:

[0006] Step S1: The central control unit controls the acquisition unit to acquire audio information frame by frame using the ALSA method with a preset sampling rate and to mark the corresponding timestamp on each data frame in sequence.

[0007] Step S2: The central control unit controls the acquisition unit to determine whether there are any missing frames in the acquired audio information. If there are missing frames, the audio information is processed by frame interpolation, and a missing frame flag is marked on the supplemented data frame. The central control unit then sequentially sends each marked data frame to the storage unit.

[0008] Step S3: The central control unit controls the storage unit to store the received data frames in the first and second storage spaces set in the storage unit in a staggered manner according to the preset alternating storage duration set in the central control unit, so as to form data packets in each storage space and send each data packet to the processing unit in a wireless transmission manner. When the processing unit receives the data packet, it plays the corresponding audio information according to the data frame in the data packet.

[0009] Step S4: The central control unit determines whether the audio transmission of the storage unit meets the preset standard based on the transmission delay during the wireless transmission between the storage unit and the processing unit. If the audio transmission of the storage unit does not meet the preset standard, the corresponding operating parameters of the subsequent data wireless transmission between the storage unit and the processing unit are adjusted to the corresponding values. Alternatively, if the audio transmission of the storage unit does not initially meet the preset standard, the central control unit performs a secondary determination on whether the transmission during the wireless transmission between the storage unit and the processing unit meets the preset standard based on the data transmission rate during the wireless transmission between the storage unit and the processing unit.

[0010] In step S5, if the central control unit determines that the audio transmission during the wireless transmission between the storage unit and the processing unit meets the standard, it keeps the relevant parameters unchanged and continues the audio transmission.

[0011] Further, in step S4, the central control unit detects the transmission delay during the audio transmission process of the storage unit and determines, based on the transmission delay, whether the audio transmission of the storage unit meets the preset standard, wherein:

[0012] The first determination method is that the central control unit determines that the audio transmission of the storage unit meets a preset standard; the first determination method satisfies that the transmission delay is less than the preset first-level transmission delay in the central control unit;

[0013] The second determination method is that the central control unit initially determines that the audio transmission of the storage unit does not meet the preset standard, and the central control unit performs a second determination on whether the audio transmission of the storage unit meets the standard based on the transmission rate during the audio transmission process of the storage unit; the second determination method satisfies that the transmission delay is greater than or equal to the first-level preset transmission delay and less than or equal to the second-level preset transmission delay preset in the central control unit, and the second-level preset transmission delay is greater than the first-level preset transmission delay.

[0014] The third determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard, and the central control unit adjusts the bandwidth of the link between the storage unit and the processing unit to the corresponding value according to the difference between the secondary preset transmission delay and the transmission delay; the third determination method satisfies that the transmission delay is greater than the secondary preset transmission delay.

[0015] Furthermore, under the second determination method, the central control unit detects the transmission rate during the wireless transmission between the storage unit and the processing unit, and determines a secondary determination method based on the transmission rate to determine whether the audio transmission to the storage unit meets a preset standard, wherein:

[0016] The first and second determination methods are as follows: the central control unit determines that the audio transmission of the storage unit meets a preset standard; the first and second determination methods satisfy that the transmission rate is greater than the preset first-level transmission rate in the central control unit;

[0017] The second determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard. The central control unit determines the specific reason why the audio transmission of the storage unit does not meet the preset standard based on the similarity between the received audio information and the audio curve of the original audio information. The second determination method satisfies that the transmission rate is less than or equal to the first-level preset transmission rate and greater than or equal to the second-level preset transmission rate preset in the central control unit, and the first-level preset transmission rate is greater than the second-level preset transmission rate.

[0018] The third secondary determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard, and the central control unit adjusts the bandwidth of the link between the storage unit and the processing unit to the corresponding value according to the difference between the secondary preset transmission delay and the transmission delay; the third secondary determination method satisfies that the transmission rate is less than the secondary preset transmission rate.

[0019] Furthermore, under the second secondary determination method, the central control unit determines the specific reason why the audio transmission to the storage unit does not meet the preset standard based on the audio similarity between the received audio information and the original audio information, wherein:

[0020] The first cause determination method is that the central control unit determines that the reason why the audio transmission of the storage unit does not meet the preset standard is a network signal problem. The central control unit adjusts the misalignment ratio of the acquisition unit in the audio acquisition process to the corresponding value according to the audio similarity. The first cause determination method satisfies that the similarity is greater than the preset audio similarity in the central control unit.

[0021] The second cause determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard because the corresponding operating parameters in the storage unit do not meet the preset standard. The central control unit adjusts the corresponding operating parameters in the storage unit to the corresponding value according to the difference between the preset audio similarity and the similarity. The second cause determination method satisfies that the audio similarity is less than or equal to the preset audio similarity.

[0022] Furthermore, under the first cause determination method, the central control unit records the difference between the similarity and the preset audio similarity as a first-level similarity difference, and determines the multiplier adjustment method for the misalignment multiplier based on the first-level similarity difference, wherein:

[0023] The first magnification adjustment method is that the central control unit uses a first magnification adjustment coefficient to adjust the misalignment magnification to the corresponding value; the first magnification adjustment method satisfies that the first-level similarity difference is greater than the first preset first-level similarity difference preset in the central control unit;

[0024] The second multiplier adjustment method is that the central control unit uses a second multiplier adjustment coefficient to adjust the misalignment multiplier to the corresponding value; the second multiplier adjustment method satisfies that the first-level similarity difference is less than or equal to the first preset first-level similarity difference and greater than or equal to the second preset first-level similarity difference preset in the central control unit, and the first preset first-level similarity difference is greater than the second preset first-level similarity difference;

[0025] The third magnification adjustment method is that the central control unit uses a third magnification adjustment coefficient to adjust the misalignment magnification to the corresponding value; the third magnification adjustment method satisfies that the first-level similarity difference is less than the second preset first-level similarity difference.

[0026] Furthermore, under the second cause determination method, the central control unit records the difference between the preset audio similarity and the similarity as a secondary similarity difference, and determines the adjustment method for the preset alternating storage duration based on the secondary similarity difference, wherein:

[0027] The first adjustment method is that the central control unit uses a first adjustment coefficient to adjust the preset alternating storage duration to a corresponding value; the first adjustment method satisfies that the second-level similarity difference is greater than the first preset second-level similarity difference preset in the central control unit;

[0028] The second adjustment method is that the central control unit uses a second adjustment coefficient to adjust the preset alternating storage duration to the corresponding value; the second adjustment method satisfies that the second-level similarity difference is less than or equal to the first preset second-level similarity difference and greater than or equal to the second preset second-level similarity difference preset in the central control unit, and the first preset second-level similarity difference is greater than the second preset second-level similarity difference;

[0029] The third adjustment method is that the central control unit uses a third adjustment coefficient to adjust the preset alternating storage duration to the corresponding value; the third adjustment method satisfies that the second-level similarity difference is less than the second preset second-level similarity difference.

[0030] Furthermore, under the third determination method, the central control unit records the difference between the transmission delay and the secondary preset transmission delay as a delay difference, and determines the bandwidth adjustment method of the link between the storage unit and the processing unit based on the delay difference, wherein:

[0031] The first adjustment method is that the central control unit uses a first adjustment coefficient to adjust the bandwidth of the link between the storage unit and the processing unit to a corresponding value; the first adjustment method satisfies that the delay difference is greater than a preset first-level delay difference value in the central control unit;

[0032] The second adjustment method uses a second adjustment coefficient to adjust the bandwidth of the link between the storage unit and the processing unit to a corresponding value; the second adjustment method satisfies that the delay difference is less than or equal to the first-level preset delay difference and greater than or equal to the second-level preset delay difference preset in the central control unit, and the first-level preset delay difference is greater than the second-level preset delay difference;

[0033] The third adjustment method is that the central control unit uses a third adjustment coefficient to adjust the bandwidth of the link between the storage unit and the processing unit to a corresponding value; the third adjustment method satisfies that the delay difference is less than the secondary preset delay difference.

[0034] Furthermore, in step S2, the central control unit sets the duration of its internally set first timer to the difference between two adjacent timestamps of the audio information acquired by the acquisition unit at a preset sampling rate. When the timer issues a reminder, the central control unit determines whether the data frame at that time node has been successfully stored based on whether there is a corresponding data frame in the storage unit for the audio. When the central control unit determines that the data frame at a single time node has failed to be stored, it determines that the audio has a frame difference, controls the storage unit to use the previous frame at the frame difference position to fill in the frame at the frame difference position, and marks the frame difference.

[0035] Further, in step S3, the central control unit sets the timing duration of its internally set second timer to a corresponding value to divide the storage process of the storage unit into several storage cycles. In a single storage cycle, the data frames collected by the acquisition unit within that cycle, along with the difference frame markers and timestamps of each data frame, are sequentially stored in the corresponding storage space to form a data packet. The storage unit stores the data in two adjacent storage cycles into different storage spaces.

[0036] Furthermore, the central control unit controls the storage unit to reduce the number of frames of the audio information according to a preset misalignment ratio in the central control unit to generate audio information with reduced frame count. The central control unit collects the audio information with reduced frame count frame by frame and sequentially sends each data frame collected in each storage cycle, as well as the difference frame mark and timestamp of each data frame, to the corresponding storage space to form a data packet.

[0037] Furthermore, this invention can quickly determine whether the audio transmission meets the preset standard by calculating the transmission delay and comparing it with the preset standard. In case the preset standard is not met, the corresponding parameters can be adjusted in a timely manner or a second judgment can be made quickly to complete the adjustment of the corresponding parameters, thereby ensuring that the audio transmission can be sent with high throughput and low latency, thus improving the transmission efficiency.

[0038] Furthermore, by monitoring the transmission rate, this invention can quickly determine whether the audio transmission meets the preset standard through a secondary judgment method, thereby further determining the reasons for not meeting the preset standard, thus ensuring that the audio transmission can be sent with high throughput and low latency, thereby improving transmission efficiency.

[0039] Furthermore, by comparing audio similarity with a preset standard, the present invention can quickly determine the specific reasons why audio transmission does not meet the preset standard, and determine the corresponding parameters that need to be adjusted according to the specific reasons, thereby quickly finding and solving the problem, thus ensuring that audio transmission can be sent with high throughput and low latency, thereby improving transmission efficiency.

[0040] Furthermore, when the present invention determines that the reason why the audio transmission does not meet the preset standard is a network signal problem, the central control unit calculates the first-level similarity difference and determines the corresponding adjustment coefficient based on the first similarity, thereby adjusting the misalignment ratio to the corresponding value. This quickly completes the adjustment of the misalignment ratio to avoid the influence of signal problems, thereby ensuring that the audio transmission can be sent with high throughput and low latency, thus improving transmission efficiency.

[0041] Furthermore, the present invention calculates the similarity difference and determines the adjustment method for the preset alternating storage duration based on the similarity difference, thereby quickly completing the adjustment of the preset alternating storage duration, thus ensuring that audio transmission can be sent with high throughput and low latency, thereby improving transmission efficiency.

[0042] Furthermore, this invention calculates the delay difference and determines the adjustment method for the broadband based on the delay difference, thereby reducing the impact of system interference by adjusting the broadband, thus ensuring high-flow, low-latency audio transmission and improving transmission efficiency.

[0043] Furthermore, this invention performs frame interpolation on the audio data. If a frame is lost, the audio from the previous frame will be used to interpolate the data at the position where it should be stored, thereby ensuring a high probability of maintaining the integrity of the audio data.

[0044] Furthermore, this invention avoids data from being overwritten by data from the previous second by storing data in a staggered manner, thereby ensuring a high probability of audio data integrity. Attached Figure Description

[0045] Figure 1 This is a schematic diagram of the wireless low-latency audio transmission method based on an embedded system according to the present invention.

[0046] Figure 2 This is a block diagram of the wireless low-latency audio transmission method based on an embedded system according to the present invention.

[0047] Figure 3 This is a flowchart illustrating the determination method described in this invention.

[0048] Figure 4 This is a flowchart of the secondary determination method described in this invention. Detailed Implementation

[0049] To make the objectives and advantages of the present invention clearer, the present invention will be further described below with reference to embodiments; it should be understood that the specific embodiments described herein are merely for explaining the present invention and are not intended to limit the present invention.

[0050] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are merely illustrative of the technical principles of the present invention and are not intended to limit the scope of protection of the present invention.

[0051] It should be noted that in the description of this invention, the terms "upper", "lower", "left", "right", "inner", "outer", etc., which indicate directions or positional relationships, are based on the directions or positional relationships shown in the accompanying drawings. This is only for the convenience of description and is not intended to indicate or imply that the device or element must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation of this invention.

[0052] Furthermore, it should be noted that, in the description of this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0053] Please see Figure 1 and Figure 2 As shown, it is a flowchart illustrating the wireless low-latency audio transmission method based on an embedded system according to the present invention, and a structural block diagram illustrating the wireless low-latency audio transmission method based on an embedded system according to the present invention, including:

[0054] Step S1: The central control unit controls the acquisition unit to acquire audio information frame by frame using the ALSA method with a preset sampling rate and to mark the corresponding timestamp on each data frame in sequence.

[0055] Step S2: The central control unit controls the acquisition unit to determine whether there are any missing frames in the acquired audio information. If there are missing frames, the audio information is processed by frame interpolation, and a missing frame flag is marked on the supplemented data frame. The central control unit then sequentially sends each marked data frame to the storage unit.

[0056] Step S3: The central control unit controls the storage unit to store the received data frames in the first and second storage spaces set in the storage unit in a staggered manner according to the preset alternating storage duration set in the central control unit, so as to form data packets in each storage space and send each data packet to the processing unit in a wireless transmission manner. When the processing unit receives the data packet, it plays the corresponding audio information according to the data frame in the data packet.

[0057] Step S4: The central control unit determines whether the audio transmission of the storage unit meets the preset standard based on the transmission delay during the wireless transmission between the storage unit and the processing unit. If the audio transmission of the storage unit does not meet the preset standard, the corresponding operating parameters of the subsequent data wireless transmission between the storage unit and the processing unit are adjusted to the corresponding values. Alternatively, if the audio transmission of the storage unit does not initially meet the preset standard, the central control unit performs a secondary determination on whether the transmission during the wireless transmission between the storage unit and the processing unit meets the preset standard based on the data transmission rate during the wireless transmission between the storage unit and the processing unit.

[0058] In step S5, if the central control unit determines that the audio transmission during the wireless transmission between the storage unit and the processing unit meets the standard, it keeps the relevant parameters unchanged and continues the audio transmission.

[0059] Please see Figure 3 As shown, this is a flowchart of the determination method of the present invention. In step S4, the central control unit detects the transmission delay in the audio transmission process of the storage unit and determines whether the audio transmission of the storage unit meets the preset standard based on the transmission delay in the audio transmission process of the storage unit.

[0060] The first determination method is that the central control unit determines that the audio transmission of the storage unit meets a preset standard; the first determination method satisfies that the transmission delay is less than the preset first-level transmission delay of 10μs in the central control unit;

[0061] The second determination method is that the central control unit initially determines that the audio transmission of the storage unit does not meet the preset standard, and the central control unit performs a second determination on whether the audio transmission of the storage unit meets the standard based on the transmission rate during the audio transmission process of the storage unit; the second determination method satisfies that the transmission delay is greater than or equal to the first-level preset transmission delay and less than or equal to the second-level preset transmission delay of 18μs preset in the central control unit;

[0062] The third determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard, and the central control unit adjusts the bandwidth of the link between the storage unit and the processing unit to the corresponding value according to the difference between the secondary preset transmission delay and the transmission delay; the third determination method satisfies that the transmission delay is greater than the secondary preset transmission delay.

[0063] Please see Figure 4 As shown, this is a flowchart of the secondary determination method of the present invention. Under the second determination method, the central control unit detects the transmission rate during the wireless transmission between the storage unit and the processing unit, and determines whether the audio transmission to the storage unit meets the preset standard based on the transmission rate, wherein:

[0064] The first and second determination methods are as follows: the central control unit determines that the audio transmission of the storage unit meets the preset standard; the first and second determination methods satisfy that the transmission rate is greater than the preset first-level transmission rate of 200M / s in the central control unit;

[0065] The second secondary determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard. The central control unit determines the specific reason why the audio transmission of the storage unit does not meet the preset standard based on the similarity between the received audio information and the audio curve of the original audio information. The second secondary determination method satisfies that the transmission rate is less than or equal to the first-level preset transmission rate and greater than or equal to the second-level preset transmission rate of 100M / s preset in the central control unit.

[0066] The third secondary determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard, and the central control unit adjusts the bandwidth of the link between the storage unit and the processing unit to the corresponding value according to the difference between the secondary preset transmission delay and the transmission delay; the third secondary determination method satisfies that the transmission rate is less than the secondary preset transmission rate.

[0067] Specifically, under the second and second determination method, the central control unit determines the reason why the audio transmission to the storage unit does not meet the preset standard based on the audio similarity between the received audio information and the original audio information, wherein:

[0068] The first cause determination method is that the central control unit determines that the reason why the audio transmission of the storage unit does not meet the preset standard is a network signal problem. The central control unit adjusts the misalignment ratio of the acquisition unit during the audio acquisition process to the corresponding value according to the audio similarity. The first cause determination method satisfies that the similarity is greater than the preset audio similarity of 85% in the central control unit.

[0069] The second cause determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard because the corresponding operating parameters in the storage unit do not meet the preset standard. The central control unit adjusts the corresponding operating parameters in the storage unit to the corresponding value according to the difference between the preset audio similarity and the similarity. The second cause determination method satisfies that the audio similarity is less than or equal to the preset audio similarity.

[0070] Specifically, under the first cause determination method, the central control unit records the difference between the similarity and the preset audio similarity as a first-level similarity difference, and determines the multiplier adjustment method for the misalignment multiplier based on the first-level similarity difference, wherein:

[0071] The first magnification adjustment method is that the central control unit uses a first magnification adjustment coefficient of 0.75 to adjust the misalignment magnification to the corresponding value; the first magnification adjustment method satisfies that the first-level similarity difference is greater than 10% of the first preset first-level similarity difference preset in the central control unit;

[0072] The second magnification adjustment method is that the central control unit uses a second magnification adjustment coefficient of 0.85 to adjust the misalignment magnification to the corresponding value; the second magnification adjustment method satisfies that the first-level similarity difference is less than or equal to the first preset first-level similarity difference and greater than or equal to 5% of the second preset first-level similarity difference preset in the central control unit;

[0073] The third magnification adjustment method is that the central control unit uses a third magnification adjustment coefficient of 0.95 to adjust the misalignment magnification to the corresponding value; the third magnification adjustment method satisfies that the first-level similarity difference is less than the second preset first-level similarity difference.

[0074] Specifically, under the second cause determination method, the central control unit records the difference between the preset audio similarity and the similarity as a secondary similarity difference, and determines the adjustment method for the preset alternating storage duration based on the secondary similarity difference, wherein:

[0075] The first adjustment method is that the central control unit uses a first adjustment coefficient of 1.3 to adjust the preset alternating storage duration to the corresponding value; the first adjustment method satisfies that the second-level similarity difference is greater than 20% of the first preset second-level similarity difference preset in the central control unit;

[0076] The second adjustment method is that the central control unit uses a second adjustment coefficient of 1.2 to adjust the preset alternating storage duration to the corresponding value; the second adjustment method satisfies that the second-level similarity difference is less than or equal to the first preset second-level similarity difference and greater than or equal to 10% of the second preset second-level similarity difference preset in the central control unit;

[0077] The third adjustment method is that the central control unit uses a third adjustment coefficient of 1.1 to adjust the preset alternating storage duration to the corresponding value; the third adjustment method satisfies that the second-level similarity difference is less than the second preset second-level similarity difference.

[0078] Specifically, under the third determination method, the central control unit records the difference between the transmission delay and the secondary preset transmission delay as a delay difference, and determines the bandwidth adjustment method of the link between the storage unit and the processing unit based on the delay difference, wherein:

[0079] The first adjustment method is that the central control unit uses a first adjustment coefficient of 1.3 to adjust the bandwidth of the link between the storage unit and the processing unit to a corresponding value; the first adjustment method satisfies that the delay difference is greater than the preset first-level delay difference value of 15μs in the central control unit;

[0080] The second adjustment method uses a second adjustment coefficient of 1.2 to adjust the bandwidth of the link between the storage unit and the processing unit to the corresponding value; the second adjustment method satisfies that the delay difference is less than or equal to the first-level preset delay difference and greater than or equal to the second-level preset delay difference of 8μs preset in the central control unit;

[0081] The third adjustment method is that the central control unit uses a third adjustment coefficient of 1.1 to adjust the bandwidth of the link between the storage unit and the processing unit to the corresponding value; the third adjustment method satisfies that the delay difference is less than the second-level preset delay difference.

[0082] Specifically, in step S2, the central control unit sets the duration of its internally set first timer to the difference between two adjacent timestamps of the audio information acquired by the acquisition unit at a preset sampling rate. When the timer issues a reminder, the central control unit determines whether the data frame at that time node has been successfully stored based on whether there is a corresponding data frame in the storage unit for the audio. When the central control unit determines that the data frame at a single time node has failed to be stored, it determines that the audio has a frame difference, controls the storage unit to use the frame before the frame difference position to fill in the frame at the frame difference position, and marks the frame difference.

[0083] Specifically, in step S3, the central control unit sets the timing duration of its internal second timer to a corresponding value to divide the storage process of the storage unit into several storage cycles. In a single storage cycle, the data frames collected by the acquisition unit within that cycle, along with the difference frame markers and timestamps of each data frame, are sequentially stored in the corresponding storage space to form a data packet. The storage unit stores the data in two adjacent storage cycles into different storage spaces.

[0084] Specifically, the central control unit controls the storage unit to reduce the number of frames of the audio information according to a preset misalignment ratio in the central control unit to generate audio information with reduced frame count. The central control unit collects the audio information with reduced frame count frame by frame and sequentially sends each data frame collected in each storage cycle, as well as the difference frame mark and timestamp of each data frame, to the corresponding storage space to form a data packet.

[0085] The technical solution of the present invention has been described above with reference to the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will all fall within the scope of protection of the present invention.

[0086] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for low-latency wireless audio transmission based on an embedded system, characterized in that, include: Step S1: The central control unit controls the acquisition unit to acquire audio information frame by frame using the ALSA method with a preset sampling rate and to mark the corresponding timestamp on each data frame in sequence. Step S2: The central control unit controls the acquisition unit to determine whether there are any missing frames in the acquired audio information. If there are missing frames, the audio information is processed by frame interpolation, and a missing frame flag is marked on the supplemented data frame. The central control unit then sequentially sends each marked data frame to the storage unit. Step S3: The central control unit controls the storage unit to store the received data frames in the first and second storage spaces set in the storage unit in a staggered manner according to the preset alternating storage duration set in the central control unit, so as to form data packets in each storage space and send each data packet to the processing unit in a wireless transmission manner. When the processing unit receives the data packet, it plays the corresponding audio information according to the data frame in the data packet. Step S4: The central control unit determines whether the audio transmission of the storage unit meets the preset standard based on the transmission delay during the wireless transmission between the storage unit and the processing unit. If the audio transmission of the storage unit does not meet the preset standard, the central control unit adjusts the corresponding operating parameters during the wireless transmission between the storage unit and the processing unit to the corresponding values. Alternatively, if the central control unit initially determines that the audio transmission of the storage unit does not meet the preset standard, it performs a secondary determination on whether the transmission during the wireless transmission between the storage unit and the processing unit meets the preset standard based on the data transmission rate during the wireless transmission between the storage unit and the processing unit. Step S5: If the central control unit determines that the audio transmission during the wireless transmission between the storage unit and the processing unit meets the standard, it keeps the relevant parameters unchanged and continues the audio transmission. In step S4, the central control unit detects the transmission delay during the audio transmission process of the storage unit and determines a judgment method for whether the audio transmission of the storage unit meets the preset standard based on the transmission delay during the audio transmission process of the storage unit, wherein: The first determination method is that the central control unit determines that the audio transmission of the storage unit meets a preset standard; the first determination method satisfies that the transmission delay is less than the preset first-level transmission delay in the central control unit; The second determination method is that the central control unit initially determines that the audio transmission of the storage unit does not meet the preset standard, and the central control unit performs a second determination on whether the audio transmission of the storage unit meets the standard based on the transmission rate during the audio transmission process of the storage unit; the second determination method satisfies that the transmission delay is greater than or equal to the first-level preset transmission delay and less than or equal to the second-level preset transmission delay preset in the central control unit, and the second-level preset transmission delay is greater than the first-level preset transmission delay. The third determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard, and the central control unit adjusts the bandwidth of the link between the storage unit and the processing unit to the corresponding value according to the difference between the secondary preset transmission delay and the transmission delay; the third determination method satisfies that the transmission delay is greater than the secondary preset transmission delay; Under the second determination method, the central control unit detects the transmission rate during the wireless transmission between the storage unit and the processing unit, and determines, based on the transmission rate, whether the audio transmission to the storage unit meets the preset standard in a secondary determination method, wherein: The first and second determination methods are as follows: the central control unit determines that the audio transmission of the storage unit meets a preset standard; the first and second determination methods satisfy that the transmission rate is greater than the preset first-level transmission rate in the central control unit; The second determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard. The central control unit determines the specific reason why the audio transmission of the storage unit does not meet the preset standard based on the similarity between the received audio information and the audio curve of the original audio information. The second determination method satisfies that the transmission rate is less than or equal to the first-level preset transmission rate and greater than or equal to the second-level preset transmission rate preset in the central control unit, and the first-level preset transmission rate is greater than the second-level preset transmission rate. The third secondary determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard, and the central control unit adjusts the bandwidth of the link between the storage unit and the processing unit to the corresponding value according to the difference between the secondary preset transmission delay and the transmission delay; the third secondary determination method satisfies that the transmission rate is less than the secondary preset transmission rate.

2. The low-latency wireless audio transmission method based on an embedded system according to claim 1, characterized in that, Under the second and second determination methods, the central control unit determines the specific reason why the audio transmission to the storage unit does not meet the preset standard based on the audio similarity between the received audio information and the original audio information, wherein: The first cause determination method is that the central control unit determines that the reason why the audio transmission of the storage unit does not meet the preset standard is a network signal problem. The central control unit adjusts the misalignment ratio of the acquisition unit during the audio acquisition process to the corresponding value according to the audio similarity. The first cause determination method satisfies that the similarity is greater than the preset audio similarity in the central control unit. Wherein, the misalignment ratio is the reduction ratio of the number of audio information frames reduced by the storage unit according to the audio similarity difference. The second cause determination method is that the central control unit determines that the audio transmission of the storage unit does not meet the preset standard because the corresponding operating parameters in the storage unit do not meet the preset standard. The central control unit adjusts the corresponding operating parameters in the storage unit to the corresponding value according to the difference between the preset audio similarity and the similarity. The second cause determination method satisfies that the audio similarity is less than or equal to the preset audio similarity.

3. The low-latency wireless audio transmission method based on an embedded system according to claim 2, characterized in that, Under the first cause determination method, the central control unit records the difference between the similarity and the preset audio similarity as the first-level similarity difference, and determines the multiplier adjustment method for the misalignment multiplier based on the first-level similarity difference, wherein: The first magnification adjustment method is that the central control unit uses a first magnification adjustment coefficient to adjust the misalignment magnification to the corresponding value; the first magnification adjustment method satisfies that the first-level similarity difference is greater than the first preset first-level similarity difference preset in the central control unit; The second multiplier adjustment method is that the central control unit uses a second multiplier adjustment coefficient to adjust the misalignment multiplier to the corresponding value; the second multiplier adjustment method satisfies that the first-level similarity difference is less than or equal to the first preset first-level similarity difference and greater than or equal to the second preset first-level similarity difference preset in the central control unit, and the first preset first-level similarity difference is greater than the second preset first-level similarity difference; The third magnification adjustment method is that the central control unit uses a third magnification adjustment coefficient to adjust the misalignment magnification to the corresponding value; the third magnification adjustment method satisfies that the first-level similarity difference is less than the second preset first-level similarity difference.

4. The low-latency wireless audio transmission method based on an embedded system according to claim 3, characterized in that, Under the second cause determination method, the central control unit records the difference between the preset audio similarity and the similarity as a secondary similarity difference, and determines the adjustment method for the preset alternating storage duration based on the secondary similarity difference, wherein: The first adjustment method is that the central control unit uses a first adjustment coefficient to adjust the preset alternating storage duration to a corresponding value; the first adjustment method satisfies that the second-level similarity difference is greater than the first preset second-level similarity difference preset in the central control unit; The second adjustment method is that the central control unit uses a second adjustment coefficient to adjust the preset alternating storage duration to the corresponding value; the second adjustment method satisfies that the second-level similarity difference is less than or equal to the first preset second-level similarity difference and greater than or equal to the second preset second-level similarity difference preset in the central control unit, and the first preset second-level similarity difference is greater than the second preset second-level similarity difference; The third adjustment method is that the central control unit uses a third adjustment coefficient to adjust the preset alternating storage duration to the corresponding value; the third adjustment method satisfies that the second-level similarity difference is less than the second preset second-level similarity difference.

5. The low-latency wireless audio transmission method based on an embedded system according to claim 4, characterized in that, Under the third determination method, the central control unit records the difference between the transmission delay and the secondary preset transmission delay as a delay difference, and determines the bandwidth adjustment method of the link between the storage unit and the processing unit based on the delay difference, wherein: The first adjustment method is that the central control unit uses a first adjustment coefficient to adjust the bandwidth of the link between the storage unit and the processing unit to a corresponding value; the first adjustment method satisfies that the delay difference is greater than a preset first-level delay difference value in the central control unit; The second adjustment method uses a second adjustment coefficient to adjust the bandwidth of the link between the storage unit and the processing unit to a corresponding value; the second adjustment method satisfies that the delay difference is less than or equal to the first-level preset delay difference and greater than or equal to the second-level preset delay difference preset in the central control unit, and the first-level preset delay difference is greater than the second-level preset delay difference; The third adjustment method is that the central control unit uses a third adjustment coefficient to adjust the bandwidth of the link between the storage unit and the processing unit to a corresponding value; the third adjustment method satisfies that the delay difference is less than the secondary preset delay difference.

6. The low-latency wireless audio transmission method based on an embedded system according to claim 1, characterized in that, In step S2, the central control unit sets the duration of its internally set first timer to the difference between two adjacent timestamps of the audio information acquired by the acquisition unit at a preset sampling rate. When the timer issues a reminder, the central control unit determines whether the data frame at the corresponding time node is successfully stored based on whether there is a corresponding data frame in the storage unit for the audio. If the central control unit determines that the data frame at a single time node has failed to be stored, it determines that the audio has a frame difference, controls the storage unit to use the previous frame at the frame difference position to fill in the frame at the frame difference position, and marks the frame difference.

7. The low-latency wireless audio transmission method based on an embedded system according to claim 1, characterized in that, In step S3, the central control unit sets the timing duration of its internal second timer to a corresponding value to divide the storage process of the storage unit into several storage cycles. In a single storage cycle, the data frames collected by the acquisition unit within that cycle, along with the difference frame markers and timestamps of each data frame, are sequentially stored in the corresponding storage space to form a data packet. The storage unit stores the data in two adjacent storage cycles into different storage spaces.

8. The low-latency wireless audio transmission method based on an embedded system according to claim 7, characterized in that, The central control unit controls the storage unit to reduce the number of frames of the audio information according to the preset misalignment ratio in the central control unit to generate audio information with reduced frame number. The central control unit collects the audio information with reduced frame number frame frame by frame and sequentially sends each data frame collected in each storage cycle, as well as the difference frame mark and timestamp of each data frame, to the corresponding storage space to form a data packet.

Images