Audio transmission method for networked broadcast system and networked broadcast system

Abstract

The application discloses an audio transmission method of a networked broadcast system and the networked broadcast system. A networked host receives audio messages to be sent, determines the serial numbers corresponding to each audio message, sequentially puts the audio messages into a sending buffer according to the serial numbers, establishes a sliding window in the sending buffer, and sends the audio messages in the sliding window to a networked decoding terminal. After receiving the audio messages, the networked decoding terminal feeds back acknowledgement packets corresponding to the audio messages. If the networked host determines that the acknowledgement packets corresponding to all the audio messages in the sliding window have been received, the networked host deletes the audio messages in the sliding window in the current sending buffer. The method can feed back the receiving conditions of the audio messages through the networked decoding terminal, facilitates the realization of packet loss recovery, is beneficial to reducing the phenomenon of audio playing lag, meets the normal business operation requirements of customers, and improves user experience. The application can be widely applied in the field of broadcast technology.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of broadcast technology, in particular to an audio transmission method of a networked broadcast system and the networked broadcast system. BACKGROUND

[0002] The networked broadcast system generally includes a networked host and a plurality of networked decoding terminals. The networked host and the networked decoding terminals are connected through a plurality of switches or routers to form a network broadcast system. The networked host has a paging function, that is, real-time audio collected through a microphone on the front panel of the host can be encoded and then transmitted to each networked decoding terminal through the network. The networked decoding terminal decodes and plays the received network audio data. This technology is widely used and can be applied to schools, governments, various large-scale events and other scenarios.

[0003] In actual application, it is found that network transmission has a particularly important impact on the experience of real-time audio application. In a local area network environment, the network audio transmission environment is stable and reliable, and the networked broadcast system can realize high-quality real-time audio transmission and playback. However, in an Internet environment, some shortcomings of the networked broadcast system are exposed. For example, in the Internet environment, network transmission is complex and changeable (such as network congestion and network jitter), which can cause unreliable audio transmission, packet loss, voice loss or lag, and seriously affect the normal business operation of customers.

[0004] Therefore, the existing problems need to be solved and optimized. SUMMARY

[0005] The present application aims to at least partly solve one of the technical problems in the related art.

[0006] To this end, an object of the embodiments of the present application is to provide an audio transmission method of a networked broadcast system and the networked broadcast system.

[0007] In order to achieve the above technical purpose, the technical solutions adopted by the embodiments of the present application include:

[0008] In one aspect, the embodiments of the present application provide an audio transmission method of a networked broadcast system, the networked broadcast system including a networked host and at least one networked decoding terminal; the method including:

[0009] The networked host receives an audio message to be sent, sorts the audio message, and determines the serial number corresponding to each audio message;

[0010] The networked host sequentially puts the audio packets into a sending buffer according to the sequence numbers, establishes a sliding window in the sending buffer, and sends the audio packets in the sliding window to the networked decoding terminal;

[0011] The networked decoding terminal feeds back an acknowledgement packet corresponding to the audio packet to the networked host after receiving the audio packet;

[0012] The networked host determines whether all the acknowledgement packets corresponding to the audio packets in the sliding window have been received;

[0013] If the networked host determines that all the acknowledgement packets corresponding to the audio packets in the sliding window have been received, the networked host deletes the audio packets in the sliding window in the sending buffer, so that new audio packets fall into the sliding window, and the networked host returns to the step of sending the audio packets in the sliding window to the networked decoding terminal.

[0014] In addition, the audio transmission method of the networked broadcasting system according to the above-mentioned embodiment of the present application can further have the following additional technical features:

[0015] Further, in an embodiment of the present application, the method further comprises:

[0016] If the networked host determines that all the acknowledgement packets corresponding to the audio packets in the sliding window have not been received, the networked host re-sends the audio packets in the sliding window to the networked decoding terminal.

[0017] Further, in an embodiment of the present application, the networked host receives the audio packets to be sent, comprising:

[0018] The networked host receives audio data input by a user through a microphone;

[0019] The networked host encodes the audio data to obtain the audio packets to be sent.

[0020] Further, in an embodiment of the present application, the networked decoding terminal feeds back an acknowledgement packet corresponding to the audio packet to the networked host after receiving the audio packet, comprising:

[0021] The networked decoding terminal receives the audio packet into a receiving buffer after receiving the audio packet;

[0022] The networked decoding terminal detects new audio packets in the receiving buffer according to a pre-set time stamp interval, and feeds back an acknowledgement packet corresponding to the new audio packets to the networked host.

[0023] Further, in one embodiment of the present application, after the step of receiving the audio packet to be sent by the networked host, the method further comprises:

[0024] The networked host detects the audio packet to determine the expiration time node corresponding to the audio packet;

[0025] The networked host discards the audio packet according to the expiration time node.

[0026] Further, in one embodiment of the present application, the networked host discards the audio packet according to the expiration time node, comprising:

[0027] The networked host queries the current time node and the link round-trip time estimate;

[0028] The networked host determines the completion time node of sending the audio packet to the networked decoding terminal according to the current time node and the link round-trip time estimate;

[0029] If the networked host determines that the completion time node exceeds the expiration time node, the audio packet is discarded.

[0030] Further, in one embodiment of the present application, the link round-trip time estimate is obtained by the following way:

[0031] The networked host queries the control packet information transmitted between the networked host and the networked decoding terminal;

[0032] The networked host determines the link round-trip time estimate according to the control packet information.

[0033] On the other hand, an embodiment of the present application provides a networked broadcast system, comprising a networked host and at least one networked decoding terminal;

[0034] The networked host is configured to receive an audio packet to be sent, sort the audio packet, determine a serial number corresponding to each audio packet, put the audio packet into a sending buffer according to the serial number, establish a sliding window in the sending buffer, and send the audio packet in the sliding window to the networked decoding terminal;

[0035] The networked decoding terminal is configured to feed back an acknowledgement packet corresponding to the audio packet to the networked host after receiving the audio packet;

[0036] The networked host is further configured to determine whether all the acknowledgement packets corresponding to the audio packets in the sliding window have been received; if it is determined that all the acknowledgement packets corresponding to the audio packets in the sliding window have been received, the audio packets in the sliding window in the current sending buffer are deleted, so that new audio packets fall into the sliding window, and the task of sending the audio packets in the sliding window to the networked decoding terminal is continued.

[0037] Further, in an embodiment of the present application, the networked host is further configured to: determine that all the acknowledgement packets corresponding to the audio packets in the sliding window have not been received, and resend the audio packets in the sliding window to the networked decoding terminal.

[0038] Further, in an embodiment of the present application, the networked host is specifically configured to: receive audio data input by a user through a microphone, and encode the audio data to obtain audio packets to be sent.

[0039] The advantages and beneficial effects of the present application will be partially given in the following description, partially will become obvious from the following description, or will be learned by the practice of the present application:

[0040] An audio transmission method of a networked broadcast system disclosed by the embodiments of the present application is provided, a networked host receives audio packets to be sent, sorts the audio packets, and determines a serial number corresponding to each of the audio packets; the networked host sequentially puts the audio packets into a sending buffer according to the serial numbers, establishes a sliding window in the sending buffer, and sends the audio packets in the sliding window to a networked decoding terminal; after the networked decoding terminal receives the audio packets, the networked decoding terminal feeds back acknowledgement packets corresponding to the audio packets to the networked host; the networked host determines whether all the acknowledgement packets corresponding to the audio packets in the sliding window have been received; if the networked host determines that all the acknowledgement packets corresponding to the audio packets in the sliding window have been received, the audio packets in the sliding window in the current sending buffer are deleted, so that new audio packets fall into the sliding window, and the step of sending the audio packets in the sliding window to the networked decoding terminal is returned to be executed. The method can feed back the receiving condition of the audio packets by the networked decoding terminal, facilitate the realization of packet loss recovery, be beneficial to reducing the phenomenon of audio playing lag, meet the normal business operation demand of customers, and improve the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following introduces the drawings of the related technical solutions in the embodiments of the present application or the prior art. It should be understood that the drawings in the following introduction are only for the convenience of clearly describing some of the embodiments of the technical solutions in the present application, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0042] Figure 1 A flowchart of an audio transmission method of a networked broadcast system provided in an embodiment of the present application;

[0043] Figure 2 A schematic diagram of an application scenario of a networked broadcast system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the purposes, technical solutions and advantages of the present application clearer, the following further describes the present application in combination with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. When the following description relates to the drawings, the same numerals in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all the implementations consistent with the embodiments of the present application, but are only examples of devices and methods consistent with some aspects of the embodiments of the present application as detailed in the appended claims.

[0045] It can be understood that the terms "first", "second", and the like used in the present application can be used herein to describe various concepts, but unless specifically stated, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, without departing from the scope of the embodiments of the present application, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "when" or "when" or "in response to determining".

[0046] The terms "at least one", "multiple", "each", "any" and the like used in the present application include one, two or more than two, multiple includes two or more than two, each refers to each of the corresponding multiple, and any refers to any one of the multiple.

[0047] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as understood by those skilled in the art to which the present application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.

[0048] The networked broadcast system generally includes a networked host and a plurality of networked decoding terminals. The networked host and the networked decoding terminals are connected through a plurality of switches or routers to form a network broadcast system. The networked host has a paging function, that is, real-time audio collected through a microphone on a front panel of the host can be encoded and then transmitted to each networked decoding terminal through the network. The networked decoding terminal decodes and plays the received network audio data. This technology has a wide range of applications and can be widely used in schools, governments, and various large-scale events.

[0049] In practical applications, it is found that network transmission has a particularly important impact on the experience of real-time audio applications. In a local area network environment, the network audio transmission environment is stable and reliable, and the networked broadcast system can achieve high-quality real-time audio transmission and playback. However, in an Internet environment, some shortcomings of the networked broadcast system are exposed.

[0050] For example, in an Internet environment, network transmission is complex and variable (such as network congestion and network jitter), which can cause unreliable audio transmission. In an unreliable Internet environment, real-time audio transmission can result in a small probability of real-time audio packet loss. Since the networked broadcast system does not have an exception handling mechanism for the Internet environment, the networked decoding terminal can receive disconnected network audio packets for playback, resulting in silence or stuttering, which seriously affects the normal business operation of customers.

[0051] In a stable and reliable local area network environment, the networked broadcast system can control the real-time audio delay from microphone audio collection of the networked host to audio playback of the networked decoding terminal within 500 ms, which is acceptable for user experience. However, in an unreliable Internet environment, when the data traffic in the network exceeds the processing capacity of the devices in the link, the network can become congested. Congestion can cause audio data delay. Since the networked broadcast system does not have an exception handling mechanism for the network congestion environment, the entire real-time audio transmission time can be uncontrollable, and even several seconds of playback delay can occur, which is unacceptable for user experience.

[0052] In view of this, the embodiment of the present application provides an audio transmission method of a networked broadcast system. In the method, a networked host receives audio messages to be sent, sorts the audio messages, and determines the serial numbers corresponding to each of the audio messages. The networked host sequentially puts the audio messages into a sending buffer according to the serial numbers, establishes a sliding window in the sending buffer, and sends the audio messages in the sliding window to a networked decoding terminal. After receiving the audio messages, the networked decoding terminal feeds back acknowledgement packets corresponding to the audio messages to the networked host. The networked host determines whether all the acknowledgement packets corresponding to the audio messages in the sliding window have been received. If the networked host determines that all the acknowledgement packets corresponding to the audio messages in the sliding window have been received, the networked host deletes the audio messages in the sliding window in the sending buffer, so that new audio messages fall into the sliding window, and the networked host returns to the step of sending the audio messages in the sliding window to the networked decoding terminal. The method can confirm the reception of the audio messages through the feedback of the networked decoding terminal, facilitate the recovery of lost packets, reduce the phenomenon of audio playback lag, meet the normal business operation needs of customers, and improve the user experience.

[0053] Please refer to Figure 1 , Figure 1 is a flowchart of an audio transmission method of a networked broadcast system provided by the embodiment of the present application. The networked broadcast system in the embodiment of the present application includes a networked host and at least one networked decoding terminal. Referring to Figure 1 , the audio transmission method of the networked broadcast system provided by the present application includes but is not limited to the following steps.

[0054] In step 110, the networked host receives audio messages to be sent, sorts the audio messages, and determines the serial numbers corresponding to each of the audio messages.

[0055] In step 120, the networked host sequentially puts the audio messages into a sending buffer according to the serial numbers, establishes a sliding window in the sending buffer, and sends the audio messages in the sliding window to the networked decoding terminal.

[0056] In step 130, after receiving the audio messages, the networked decoding terminal feeds back acknowledgement packets corresponding to the audio messages to the networked host.

[0057] In step 140, the networked host determines whether all the acknowledgement packets corresponding to the audio messages in the sliding window have been received.

[0058] Step 150, if the networked host determines that all audio packets corresponding to the sliding window have been received, delete the audio packets in the current sending buffer that are in the sliding window, so that new audio packets fall into the sliding window, and return to perform the step of sending the audio packets in the sliding window to the networked decoding terminal.

[0059] In the embodiments of the present application, an audio transmission method of a networked broadcast system is provided. The method can feed back the receiving status of the audio packets by the networked decoding terminal, facilitate the realization of packet loss recovery, reduce the phenomenon of audio playback lag, meet the normal business operation needs of customers, and improve the user experience.

[0060] The audio transmission method of the networked broadcast system provided in the embodiments of the present application is suitable for a networked broadcast system comprising a networked host and at least one networked decoding terminal. Specifically, please refer to Figure 2 In the embodiments of the present application, an application scenario of a networked broadcast system is shown. In the embodiments of the present application, the networked broadcast system can comprise one networked host 210 and a plurality of networked decoding terminals 240. The specific number of the networked decoding terminals 240 is not limited in the present application. The networked broadcast system can realize the application of broadcast based on a gateway 220 and the Internet 230.

[0061] The gateway 220 is also called an inter-network connector or a protocol converter. The gateway realizes network interconnection at the transport layer and is a computer system or device acting as a conversion function. The gateway is a translator between two systems using different communication protocols, data formats or languages, or even completely different architectures. At the same time, the gateway can also provide filtering and security functions. In the embodiments of the present application, the networked host 210 can send audio packets to the networked decoding terminal 240 through the gateway 220 and the Internet 230. The networked decoding terminal 240 can receive and decode the audio packets for playing, thereby realizing the application of networked broadcast.

[0062] Of course, it can be understood that Figure 2 The application scenario shown is only used for illustrative purposes and does not mean to limit the actual application of the present application.

[0063] Specifically, in the embodiments of the present application, for the networked host, it can receive audio packets to be sent, sort the audio packets, and assign a unique sequence number to each audio packet. The sequence number here can use Arabic numerals, for example, if there are currently 7 packets, the numbers 1-7 can be used as the sequence number corresponding to each audio packet. Then, the networked host puts the audio packets into the sending buffer in sequence according to the sequence number, and establishes a sliding window in the sending buffer. The length of the sliding window can be flexibly determined according to actual needs, for example, in some embodiments, the sliding window can cover 3 audio packets. The audio packets in the sliding window will be sent by the networked host to the networked decoding terminal. After receiving the audio packets, the networked decoding terminal can feed back an acknowledgement packet corresponding to the audio packet to the networked host. Specifically, in the embodiments of the present application, the networked decoding terminal can feed back the acknowledgement packet corresponding to the audio packet to the networked host after receiving each audio packet, or can detect all received audio packets every predetermined time period and feed back the acknowledgement packets corresponding to multiple audio packets, which is not limited in the present application.

[0064] In the embodiments of the present application, after the networked host sends the audio packets in the sliding window, it can determine whether it has received the acknowledgement packets corresponding to all the audio packets in the sliding window. If yes, it means that the batch of audio packets is successfully received, in which case, the audio packets in the current sending buffer that are in the sliding window can be deleted, so as to update the position of the sliding window and make new audio packets enter the sliding window. Then, the step of sending the audio packets in the sliding window to the networked decoding terminal can be continued to be executed. This cycle continues until all the audio packets are transmitted. Of course, in some embodiments, there can be a case where the networked host determines that it has not received the acknowledgement packets corresponding to all the audio packets in the sliding window, in which case, it can be due to network fluctuations or other reasons, resulting in the phenomenon of packet loss. In this case, the networked host can resend the audio packets in the sliding window to the networked decoding terminal, so as to reduce the probability of the networked decoding terminal appearing silent or lagging, and improve the stability and reliability of audio playing.

[0065] The application in the present application is described below in combination with specific examples. It is assumed that the number of audio packets is 7 and the numbers 1-7 are assigned as the serial numbers by way of example. The size of the sliding window is set to 3. The initial sliding window covers the audio packets corresponding to the serial numbers 1-3. The networked host sends the audio packets corresponding to the serial numbers 1-3 to the networked decoding terminal. If the networked decoding terminal normally receives these audio packets, it will feed back the acknowledgement packets corresponding to the audio packets with the serial numbers 1-3. If it does not normally receive all the audio packets, it can not feed back or only feed back the acknowledgement packets corresponding to part of the audio packets. When the networked host confirms that it receives the acknowledgement packets corresponding to the audio packets with the serial numbers 1-3, it can delete the audio packets with the serial numbers 1-3 in the sending buffer. At this time, the audio packets with the serial numbers 4-6 will fall into the sliding window and can be continuously sent. Conversely, when the networked host confirms that it does not receive all the acknowledgement packets corresponding to the audio packets with the serial numbers 1-3, it can resend the audio packets with the serial numbers 1-3. Of course, in some embodiments, the networked host can also send the audio packets for which no acknowledgement packet is received, which is not limited in the present application.

[0066] In some embodiments, the networked host receives the audio packets to be sent, comprising:

[0067] The networked host receives the audio data input by the user through the microphone.

[0068] The networked host encodes the audio data to obtain the audio packets to be sent.

[0069] In the embodiments of the present application, a microphone can be configured on the networked host side. When the networked host receives the audio packets to be sent, the audio data input by the user through the microphone can be converted into the audio packets to be sent. Specifically, the audio data input by the user can be collected through the microphone, that is, an analog audio signal is first collected and converted into a digital signal through an analog-to-digital converter (ADC). Then, the audio data can be preprocessed, such as noise reduction and gain control. Then, the audio data is frame-processed, the continuous audio data is divided into multiple small segments (frames), and an appropriate encoding algorithm is selected to encode the audio data of each frame. The header information is added before the encoded audio data, and the complete audio packet can be packaged.

[0070] In some embodiments, after the networked decoding terminal receives the audio packet, it feeds back the acknowledgement packet corresponding to the audio packet to the networked host, comprising:

[0071] After the networked decoding terminal receives the audio packet, it puts the audio packet into the receiving buffer.

[0072] The networked decoding terminal detects the added audio packet in the receiving buffer according to the preset timestamp interval, and feeds back the acknowledgement packet corresponding to the added audio packet to the networked host.

[0073] In the embodiment, the audio packet in the sending buffer can be sent according to the set timestamp interval. In the networked decoding terminal, after receiving the audio packet, the audio packet is put into the receiving buffer. Then, a delay window can be created in the receiving buffer, which functions to send the audio packet according to the timestamp little by little, and strictly detects according to the timestamp, so as to determine the added audio packet in the receiving buffer, and feed back the acknowledgement packet corresponding to the added audio packet to the networked host. Here, the size of the timestamp interval can be flexibly set according to the requirement, for example, it can be 11 milliseconds, and the application does not limit this.

[0074] In some embodiments, after the networked host receives the audio packet to be sent, the method further comprises:

[0075] The networked host detects the audio packet to determine the expiration time node corresponding to the audio packet;

[0076] The networked host discards the audio packet according to the expiration time node.

[0077] In the embodiment, a timeout discarding mechanism can also be added. Each audio packet generally corresponds to an expiration time node, and the audio packet is invalid after the expiration time node. In order to improve the efficiency of audio data transmission, in the embodiment, the expiration time node corresponding to the audio packet can be determined on the networked host side, and then the audio packet is discarded according to the expiration time node. In this way, sub-second low-delay transmission can be realized, thereby improving the user's audio playback experience.

[0078] Specifically, in the embodiment, the networked host can obtain the current time node and the link round-trip time estimate, and according to the current time node and the link round-trip time estimate, the completion time node corresponding to sending the audio packet to the networked decoding terminal can be determined. If the completion time node does not exceed the expiration time node, the audio packet can be normally sent. If the completion time node exceeds the expiration time node, it means that even if the data packet is sent, it is already expired. At this time, in order to reduce the waste of transmission resources, the audio packet can be discarded directly. Here, the link round-trip time estimate can be obtained according to the control packet information transmitted between the networked host and the networked decoding terminal, for example, the timestamp information in the reply control packet and the reply reply control packet can be used to calculate the link round-trip time estimate.

[0079] It should be noted that, in the embodiment of the present application, there is a default real-time playing delay amount (which can be set through a configuration file) between the networked host and the receiving end of the networked decoding terminal. This delay amount is actually generated in the receiving buffer, and all audio data is put into the receiving buffer and must wait for a delay amount before being sent to the decoder. Therefore, in the embodiment of the present application, the size of the receiving buffer can be determined according to the link round-trip time estimation, so as to realize low delay of audio playing.

[0080] In the embodiment of the present application, a networked broadcast system is also provided, which comprises a networked host and at least one networked decoding terminal.

[0081] The networked host is configured to receive audio messages to be sent, sort the audio messages, determine the serial numbers corresponding to each of the audio messages, put the audio messages into a sending buffer in sequence according to the serial numbers, establish a sliding window in the sending buffer, and send the audio messages in the sliding window to the networked decoding terminal.

[0082] The networked decoding terminal is configured to feed back an acknowledgement packet corresponding to the audio message to the networked host after receiving the audio message.

[0083] The networked host is further configured to determine whether the acknowledgement packets corresponding to all the audio messages in the sliding window have been received; if it is determined that the acknowledgement packets corresponding to all the audio messages in the sliding window have been received, the audio messages in the sliding window in the current sending buffer are deleted, so that new audio messages fall into the sliding window, and the task of sending the audio messages in the sliding window to the networked decoding terminal is continued to be performed.

[0084] It can be understood that the contents in the method embodiments described above are applicable to the system embodiment, the system embodiment specifically realizes the same functions as the method embodiments described above, and achieves the same beneficial effects as the method embodiments described above.

[0085] The embodiment of the present application further discloses a computer readable storage medium, which stores a program executable by a processor, and the program executable by the processor is used to realize an audio transmission method of a networked broadcast system as shown in Figure 1 The embodiment of the present application further discloses a computer readable storage medium, which stores a program executable by a processor, and the program executable by the processor is used to realize an audio transmission method of a networked broadcast system as shown in

[0086] It can be understood that the contents in the method embodiments of the audio transmission method of the networked broadcast system as shown in Figure 1 The embodiment of the present application further discloses a computer readable storage medium, which stores a program executable by a processor, and the program executable by the processor is used to realize an audio transmission method of a networked broadcast system as shown in Figure 1The audio transmission method embodiments of the networked broadcast system shown are the same, and the beneficial effects achieved are the same as Figure 1 The beneficial effects achieved by the audio transmission method embodiments of the networked broadcast system shown are also the same.

[0087] In some alternative embodiments, the functions / operations mentioned in the block diagrams can not occur in the order mentioned in the operation diagrams. For example, depending on the functions / operations involved, two blocks shown in succession can actually be executed substantially concurrently or the blocks can sometimes be executed in reverse order. Furthermore, the embodiments presented and described in the flow diagrams are only examples. The steps presented and described in the flow diagrams are provided by way of example in order to provide a more thorough understanding of the technology. The disclosed methods are not limited to the operations and logical flows presented in the specification. Alternative embodiments are contemplated in which the order of various steps is changed and in which sub-steps of a larger step are performed in parallel rather than sequentially. Variations of these methods can be implemented where parts of one method are implemented as a different method. Such modifications to the methods are meant to be within the scope of the technology.

[0088] Furthermore, although the present application is described in the context of functional modules, it is understood that one or more of the functions and / or features can be integrated in a single physical system and / or software module, or one or more functions and / or features can be implemented in separate physical systems or software modules. It is also understood that detailed discussion of the actual implementation of each module is unnecessary to an understanding of the present application. Rather, the actual implementation is within the skills of those in the art, given the attributes of the various functional modules, their relationships, and the internal relationships of the modules, as disclosed in the context of the various embodiments of the system. Therefore, the present application is not limited to the specific embodiments described herein, but only by the claims, which are to be given their full scope including all legal equivalents. It is understood that the specific examples presented herein are meant to be illustrative only and are not meant to limit the scope of the present application, which is defined by the appended claims and their equivalents.

[0089] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the parts that make contributions to the prior art or the parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the embodiments of the method of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0090] The logic and / or steps represented in the flow diagrams or otherwise described herein, for example, can be embodied in non-transitory computer- readable media, executed by an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions, or in conjunction with which the instructions can be executed. In the context of this specification, a "computer-readable medium" can be any system, apparatus, or device that can include, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The program can be implemented in any of the programming languages, scripting languages, assembly languages, higher-level procedural or object-oriented programming languages, or lower-level (e.g., machine code) languages, and combinations thereof.

[0091] More specific examples (a non-exhaustive list) of the computer-readable medium include the following: an electrical connection (electronic) having one or more wires, a portable computer diskette (magnetic), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber (optical), and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can also be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, for example, via optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and stored in a computer memory.

[0092] It should be understood that aspects of the present application can be implemented in hardware, software, firmware, or combinations thereof. In the above embodiments, various steps or methods can be implemented in software or firmware that is stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any of the following technologies, or combinations thereof, can be used with the necessary modifications: a discrete logic circuit(s) having logic gates for implementing logic functions upon an application of data signals, an application specific integrated circuit having appropriate combinational logic gates, a programmable gate array(s) (PGA), a field programmable gate array (FPGA), and / or the like.

[0093] In the above description of the present specification, reference has been made to descriptive terms such as "one embodiment / expression", "another embodiment / expression", or "some embodiments / expressions" or the like, which can mean that a particular feature, structure, material or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. Descriptive terms such as the above do not necessarily refer to the same embodiment or example throughout the present specification. Also, the described particular features, structures, materials or characteristics can be combined in any one or more embodiments or examples in an appropriate manner.

[0094] While the embodiments of the present application have been shown and described, it is to be understood that the embodiments can be changed, modified, substituted, and varied, in many ways without departing from the principles and spirit of the present application, the scope of which is defined by the claims and their equivalents.

[0095] The above is a specific description of the preferred embodiments of the present application, but the present application is not limited to the embodiments, and those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of the present application, and these equivalent modifications or substitutions are included in the scope defined by the claims of the present application

[0096] In the description of the present specification, the description of the terms "one embodiment", "another embodiment", or "certain embodiments" or the like means that the specific features, structures, materials or characteristics described in connection with the embodiments or examples are included in at least one embodiment or example of the present application. The illustrative expressions of the above terms in the present specification do not necessarily refer to the same embodiment or example. Also, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0097] While the embodiments of the present application have been shown and described, it is to be understood that the embodiments can be changed, modified, substituted, and varied, in many ways without departing from the principles and spirit of the present application, the scope of which is defined by the claims and their equivalents.

Claims

1. An audio transmission method for a networked broadcasting system, characterized in that, The networked broadcasting system includes a networked host and multiple networked decoding terminals; the method includes: The networked host receives audio messages to be sent, sorts the audio messages, and determines the sequence number corresponding to each audio message; The networked host places the audio packets into the sending buffer in sequence according to the sequence number, establishes a sliding window in the sending buffer, and sends the audio packets in the sliding window to each of the networked decoding terminals. After receiving the audio message, each of the networked decoding terminals sends an acknowledgment packet corresponding to the audio message back to the networked host; The networked host determines whether it has received acknowledgment packets corresponding to all audio messages within the sliding window; If the networked host determines that it has received acknowledgment packets corresponding to all audio packets in the sliding window, it deletes the audio packets in the current sending buffer that are in the sliding window so that new audio packets fall into the sliding window, and returns to the step of sending the audio packets in the sliding window to the networked decoding terminal. After the step of the networked host receiving the audio message to be sent, the method further includes: The networked host detects the audio message and determines the expiration time node corresponding to the audio message; The networked host queries the current time node and the estimated link round-trip time; The networked host determines the completion time node for sending the audio message to the networked decoding terminal based on the current time node and the estimated link round-trip time. If the networked host determines that the completion time node exceeds the expiration time node, it will discard the audio message.

2. The audio transmission method for a networked broadcasting system according to claim 1, characterized in that, The method further includes: If the networked host determines that it has not received acknowledgment packets corresponding to all audio packets within the sliding window, the networked host will resend the audio packets within the sliding window to the networked decoding terminal.

3. The audio transmission method for a networked broadcasting system according to claim 1, characterized in that, The networked host receives the audio message to be sent, including: The networked host receives audio data input by the user through a microphone; The networked host encodes the audio data to obtain an audio message to be sent.

4. The audio transmission method of a networked broadcasting system according to claim 1, characterized in that, After receiving the audio message, the networked decoding terminal sends an acknowledgment packet corresponding to the audio message back to the networked host, including: After receiving the audio message, the networked decoding terminal puts the audio message into the receiving buffer; The networked decoding terminal detects newly added audio packets in the receiving buffer according to a pre-set timestamp interval, and sends an acknowledgment packet corresponding to the newly added audio packet back to the networked host.

5. The audio transmission method for a networked broadcasting system according to claim 1, characterized in that, The estimated link round-trip time is obtained in the following way: The networked host queries the control packet information transmitted between itself and the networked decoding terminal; The networked host determines the estimated link round-trip time based on the control packet information.

6. A networked broadcasting system, characterized in that, Includes a networked host and multiple networked decoding terminals; The networked host is used to receive audio messages to be sent, sort the audio messages, determine the sequence number of each audio message, put the audio messages into the sending buffer in sequence according to the sequence number, establish a sliding window in the sending buffer, and send the audio messages in the sliding window to each of the networked decoding terminals. Each of the networked decoding terminals is used to send an acknowledgment packet corresponding to the audio message back to the networked host after receiving the audio message; The networked host is also used to determine whether it has received acknowledgment packets corresponding to all audio packets in the sliding window; if it is determined that it has received acknowledgment packets corresponding to all audio packets in the sliding window, the audio packets in the current sending buffer that are in the sliding window are deleted so that new audio packets fall into the sliding window, and the task of sending audio packets in the sliding window to the networked decoding terminal is continued. The networked host is also used to: detect the audio message and determine the expiration time node corresponding to the audio message; query the current time node and the estimated link round-trip time; and determine the completion time node corresponding to sending the audio message to the networked decoding terminal based on the current time node and the estimated link round-trip time. If the completion time node is determined to exceed the expiration time node, the audio message is discarded.

7. A networked broadcasting system according to claim 6, characterized in that, The networked host is also configured to: determine if an acknowledgment packet corresponding to all audio packets within the sliding window has not been received, and resend the audio packets within the sliding window to the networked decoding terminal.

8. A networked broadcasting system according to claim 6, characterized in that, The networked host is specifically used to: receive audio data input by the user through a microphone, encode the audio data, and obtain an audio message to be sent.

Images