Method and apparatus for processing audio encoded data packets

The method and apparatus for processing audio-encoded data packets address the limitations of existing audio jitter buffers by caching multiple audio-encoded data packets with different description index values for the same timestamp, thereby preventing data loss and improving audio quality for MDC code streams.

JP2025519427AActive Publication Date: 2025-06-26DOUYIN VISION CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024571834
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-10-31
Filing Date
2023-08-31
Publication Date
2025-06-26
Estimated Expiration
2043-08-31

AI Technical Summary

Technical Problem

Existing audio jitter buffers in real-time communication architectures are limited to processing single description coding (SDC) code streams, leading to data loss and degraded audio quality for multiple description coding (MDC) code streams.

Method used

A method and apparatus for processing audio-encoded data packets that analyze data packet information including timestamps and description index values, allowing for caching of multiple audio-encoded data packets with different description index values for the same timestamp, thereby avoiding data loss for MDC code streams.

Benefits of technology

The solution effectively caches all audio-encoded data packets with different description index values for the same timestamp, preventing data loss and enhancing the quality of decoded audio for MDC code streams.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025519427000001_ABST
    Figure 2025519427000001_ABST
Patent Text Reader

Abstract

A method and apparatus for processing an audio-encoded data packet, the method comprising: obtaining data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet, wherein the data packet information includes a timestamp and a description index value of the audio-encoded data packet, and wherein the audio-encoded data packet includes at least one description of the audio data, and the description index value is the index of the description; determining whether a data packet having the same data packet information as the data packet information of the audio-encoded data packet is cached in a data packet cache; and if not, writing the audio-encoded data packet into the data packet cache based on the data packet information of the audio-encoded data packet.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application claims the priority of Chinese Patent Application No. 202211345610.6 filed on October 31, 2022, and hereby incorporates by reference in its entirety the content disclosed in the above-mentioned Chinese patent application as part of this application.

[0002] Embodiments of the present disclosure relate to a method and apparatus for processing audio-encoded data packets.

Background Art

[0003] The audio Jitter buffer in a real-time communication architecture is an important part of real-time audio and video calls. Its main function is to cache the received audio media data packets and smoothly output the data to the decoding part, and it can also handle situations such as jitter, loss, and delay that occur when receiving audio data packets.

[0004] However, since the audio jitter buffer caches only one audio-encoded data packet for the same timestamp, the audio jitter buffer only supports the processing of a single description coding (SDC) code stream. Multiple description coding (MDC) code streams may contain multiple audio-encoded data packets within the same timestamp, but only one of the audio-encoded data packets is cached in the audio jitter buffer. Furthermore, due to the problem of audio data loss during audio processing, the quality of the decoded audio may be degraded, affecting the user experience.

Summary of the Invention

[0005] In view of this, embodiments of the present disclosure provide a method and an apparatus for processing audio-encoded data packets to avoid MDC code stream data loss.

[0006] Embodiments of the present disclosure provide a method for processing audio-encoded data packets, by analyzing the audio-encoded data packets to obtain data packet information of the audio-encoded data packets, where the data packet information includes a timestamp and a description index value of the audio-encoded data packets. Here, the audio-encoded data packets are obtained by encoding audio data, and the audio-encoded data packets include at least one description of the audio data, and the description index value is the index of the description. determining whether there is a data packet in the data packet cache whose data packet information is the same as that of the audio-encoded data packet, otherwise, writing the audio-encoded data packet into the data packet cache based on the data packet information of the audio-encoded data packet.

[0007] As an optional embodiment of the embodiments of the present disclosure, the method further includes determining a target timestamp, where the target timestamp is the timestamp of the audio-encoded data packet that needs to be decoded currently, reading each audio-encoded data packet with a timestamp being the target timestamp from the data packet cache, and obtaining the audio data of the target timestamp by decoding each audio-encoded data packet with a timestamp being the target timestamp.

[0008] As an optional embodiment of the embodiments of the present disclosure, when each description is transmitted in one audio-encoded data packet, writing the audio-encoded data packet into the data packet cache based on the data packet information of the audio-encoded data packet includes: determining a cache space corresponding to the timestamp of the audio-encoded data packet in the data packet cache; determining a cache order of the audio-encoded data packet in the cache space based on the description index value of the audio-encoded data packet; writing the audio-encoded data packet into the cache space according to the cache order of the audio-encoded data packet in the cache space.

[0009] As an optional embodiment of the embodiments of the present disclosure, the data packet information of the audio-encoded data packet further includes a sequence number of the audio-encoded data packet and the number of descriptions of the audio data corresponding to the audio-encoded data packet, and the method further includes: obtaining a first sequence number based on the sequence number of the audio-encoded data packet and the description index value of the audio-encoded data packet, where the first sequence number is the sequence number of the audio-encoded data packet in which the first description with a timestamp being a first timestamp is transmitted, and the first timestamp is the timestamp of the audio-encoded data packet; Obtaining the delay of the audio-encoded data packet based on the first sequence number, the second sequence number, and the number of the descriptions, where the second sequence number is the sequence number of the audio-encoded data packet in which the first description with the time stamp being the second time stamp is transmitted, and the second time stamp is the time stamp of the previously received audio-encoded data packet.

[0010] As an optional embodiment of the embodiments of the present disclosure, the method further Obtaining the packaging period of the audio-encoded data packet based on the first sequence number, the second sequence number, the first time stamp, the second time stamp, the number of the descriptions, and the sampling rate of the audio data, Obtaining the delay of the audio-encoded data packet based on the first sequence number, the second sequence number, and the number of the descriptions, And adjusting the audio playback parameters corresponding to the audio-encoded data packet according to the packaging period and the delay.

[0011] As an optional embodiment of the embodiments of the present disclosure, when the descriptions of the audio data with the same time stamp are transmitted in the same audio-encoded data packet, writing the audio-encoded data packet into the data packet cache based on the data packet information of the audio-encoded data packet means Determining whether the audio-encoded data packet carries descriptions of audio data with a plurality of time stamps, If not, determining a cache space corresponding to the time stamp of the audio-encoded data packet in the data packet cache, and writing the audio-encoded data packet into the cache space. If so, in the data packet cache, cache spaces corresponding to the plurality of timestamps are respectively determined, the audio encoded data packets are respectively written into the cache spaces corresponding to the plurality of timestamps, and the timestamp of the audio encoded data packet written into the cache space corresponding to any one of the timestamps is corrected to the timestamp.

[0012] As an optional embodiment of the embodiments of the present disclosure, reading each audio encoded data packet whose timestamp is the target timestamp from the data packet cache includes reading all audio encoded data packets in the cache space corresponding to the target timestamp.

[0013] As an optional embodiment of the embodiments of the present disclosure, the method further includes discarding, after determining the target timestamp, audio encoded data packets in the data packet cache whose timestamps are smaller than the target timestamp.

[0014] As an optional embodiment of the embodiments of the present disclosure, the method further includes, when a data packet whose data packet information is the same as the data packet information of the audio encoded data packet is cached in the data packet cache, comparing the priorities of the audio encoded data packet and the data packet, replacing the data packet with the audio encoded data packet if the priority of the audio encoded data packet is higher than the priority of the data packet, and discarding the audio encoded data packet if the priority of the audio encoded data packet is lower than the priority of the data packet.

[0015] Other embodiments of the present disclosure provide an apparatus for processing audio-encoded data packets, a processing unit that obtains data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet, where the data packet information includes a timestamp and a description index value of the audio-encoded data packet. Here, the audio-encoded data packet is obtained by encoding audio data, and the audio-encoded data packet includes at least one description of the audio data, and the description index value is an index of the description, and a determination unit for determining whether a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is cached in the data packet cache, and a writing unit for writing the audio-encoded data packet into the data packet cache based on the data packet information of the audio-encoded data packet when a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is not cached in the data packet cache.

[0016] As an optional embodiment of the embodiments of the present disclosure, the apparatus for processing audio-encoded data packets further includes a determination unit for determining a target timestamp, where the target timestamp is a timestamp of an audio-encoded data packet that needs to be decoded currently, and a reading unit for reading each audio-encoded data packet whose timestamp is the target timestamp from the data packet cache, and a decoding unit for obtaining audio data of the target timestamp by decoding each audio-encoded data packet whose timestamp is the target timestamp.

[0017] As an optional embodiment of an example of the present disclosure, specifically when each description is transmitted in one audio-encoded data packet, in the data packet cache, a cache space corresponding to the time stamp of the audio-encoded data packet is determined, and based on the description index value of the audio-encoded data packet, a cache order in the cache space of the audio-encoded data packet is determined, and the audio-encoded data packet is used to write the audio-encoded data packet into the cache space according to the cache order in the cache space of the audio-encoded data packet.

[0018] As an optional embodiment of an example of the present disclosure, the processing unit further obtains a first sequence number based on the sequence number of the audio-encoded data packet and the description index value of the audio-encoded data packet, where the first sequence number is the sequence number of the audio-encoded data packet in which the first description with a time stamp being the first time stamp is transmitted, the first time stamp is the time stamp of the audio-encoded data packet, obtains a second sequence number, where the second sequence number is the sequence number of the audio-encoded data packet in which the first description with a time stamp being the second time stamp is transmitted, the second time stamp is the time stamp of the audio-encoded data packet received one before, and is used to obtain the delay of the audio-encoded data packet based on the first sequence number, the second sequence number, and the number of the descriptions, and the second sequence number is the sequence number of the audio-encoded data packet in which the first description with a time stamp being the second time stamp is transmitted, and the second time stamp is the time stamp of the audio-encoded data packet received one before.

[0019] As an optional embodiment of the embodiments of the present disclosure, the processing unit is further configured to obtain a packaging period of the audio encoded data packet based on the first sequence number, the second sequence number, the first timestamp, the second timestamp, the number of the descriptions, and a sampling rate of the audio data, obtain a delay of the audio encoded data packet based on the first sequence number, the second sequence number, and the number of the descriptions, and use the obtained packaging period and the delay to adjust audio playback parameters corresponding to the audio encoded data packet.

[0020] As an optional embodiment of the embodiments of the present disclosure, specifically, when descriptions of audio data with the same timestamp are transmitted in the same audio encoded data packet, the writing unit determines whether the audio encoded data packet carries descriptions of audio data with a plurality of timestamps. If not, in the data packet cache, it determines a cache space corresponding to the timestamp of the audio encoded data packet, writes the audio encoded data packet into the cache space. If so, in the data packet cache, it determines cache spaces corresponding to the plurality of timestamps respectively, writes the audio encoded data packet into the cache spaces corresponding to the plurality of timestamps respectively, and is used to correct the timestamp of the audio encoded data packet written into the cache space corresponding to any one of the timestamps to the timestamp.

[0021] As an optional embodiment of the embodiments of the present disclosure, specifically, the reading unit is used to read all audio encoded data packets in the cache space corresponding to the target timestamp.

[0022] As an optional embodiment of the embodiments of the present disclosure, after determining the target timestamp, the processing unit is further used to discard audio encoded data packets in the data packet cache whose timestamps are smaller than the target timestamp.

[0023] As an optional embodiment of the embodiments of the present disclosure, when the write unit further caches a data packet in the data packet cache whose data packet information is the same as that of the audio encoded data packet, the write unit compares the priorities of the audio encoded data packet and the data packet. If the priority of the audio encoded data packet is higher than that of the data packet, the write unit replaces the data packet with the audio encoded data packet; if the priority of the audio encoded data packet is lower than that of the data packet, the write unit is used to discard the audio encoded data packet.

[0024] Another embodiment of the present disclosure provides an electronic device, including a memory and a processor. The memory is used to store a computer program. When the computer program is executed by the processor, the processor is used to cause the electronic device to execute the method for processing an audio encoded data packet described in any one of the above embodiments.

[0025] Still another embodiment of the present disclosure provides a computer-readable storage medium. When the computer program is executed by a computing device, the computing device is caused to execute the method for processing an audio encoded data packet described in any one of the above embodiments.

[0026] Still another embodiment of the present disclosure provides a computer program product which, when executed by a computer, causes the computer to implement the method for processing an audio encoded data packet described in any one of the above embodiments.

[0027] The method for processing an audio-encoded data packet according to an embodiment of the present disclosure first analyzes the audio-encoded data packet to obtain the data packet information of the audio-encoded data packet. Next, it determines whether a data packet whose data packet information is the same as that of the audio-encoded data packet is cached in the data packet cache. If the data packet cache does not contain a data packet whose data packet information is the same as that of the audio-encoded data packet, the audio-encoded data packet is written into the data packet cache based on the data packet information of the audio-encoded data packet. In the known art, compared with caching only one audio-encoded data packet with the same timestamp in the audio jitter buffer, the data packet information in the embodiment of the present disclosure includes the timestamp and the description index value of the audio-encoded data packet. Therefore, as long as the timestamp or the description index value in the audio-encoded data packet is different from that of the cached data packet, the audio-encoded data packet is written into the data packet cache. Therefore, in the embodiment of the present disclosure, all audio-encoded data packets with different description index values for the same timestamp can be cached to avoid loss of MDC code stream data.

Brief Description of the Drawings

[0028] The drawings herein are incorporated into the specification and form a part of the specification, showing embodiments suitable for the present disclosure and used together with the specification to interpret the principles of the present disclosure.

[0029] For a clearer description of the embodiments of the present disclosure, the drawings that need to be referred to in the embodiments are briefly described below. Obviously, those skilled in the art can obtain other drawings based on these drawings without creative labor.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Embodiments for Carrying Out the Invention

[0030] To better understand the above objects, features, and advantages of the present disclosure, the technical solutions of the present disclosure will be further described below. Unless there is a contradiction, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0031] In the following description, many specific details are set forth to facilitate a thorough understanding of the present disclosure. However, the present disclosure may be practiced in other forms different from those described herein. Obviously, the embodiments in the specification are only a part of the embodiments of the present disclosure, not all of them.

[0032] In the embodiments of the present disclosure, the terms "exemplary" or "for example" are used as examples, illustrations, or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present disclosure should not be construed as being more preferable or advantageous than other embodiments or designs. Specifically, the invocation of terms such as "exemplary" or "for example" is intended to present related concepts in a specific manner. Also, in the description of the embodiments of the present disclosure, unless otherwise specified, "a plurality" means two or more.

[0033] The embodiments of the present disclosure provide a method for processing audio-encoded data packets. Referring to FIG. 1, the method for processing audio-encoded data packets includes the following steps S101 to S103.

[0034] S101: Obtain the data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet.

[0035] Here, the data packet information includes the time stamp and the description index value of the audio-encoded data packet. Here, the audio-encoded data packet is obtained by encoding audio data, and the audio-encoded data packet includes at least one description of the audio data, and the description index value is the index of the description.

[0036] In an embodiment of the present disclosure, the audio data may be encoded into at least one code stream. For example, audio data in a single description coding method can be encoded into one code stream, and this one code stream is called one description. Audio data in a multiple description coding method can be encoded into multiple code streams, and each code stream is called one description.

[0037] In an embodiment of the present disclosure, the coding methods of audio data are single description coding (SDC) and multiple description coding (MDC). Referring to FIG. 2, when the coding method of audio data is SDC, the SDC code stream of audio data with the same timestamp contains only one description (the description with the index value Md_0). However, when the coding method of audio data is MDC, the MDC code stream of audio data with the same timestamp contains only multiple descriptions (the descriptions with the index value from Md_0 to the index value Md_m-1).

[0038] In an embodiment of the present disclosure, the physical meaning of the timestamp of the audio encoded data packet is the sequence number of the first sample point in the audio encoded data packet. For example, when a certain audio encoded data packet carries sample points with sequence numbers 0 to 959, the timestamp of the audio encoded data packet is the sequence number 0 of the first sample point among them. Further, for example, when a certain audio encoded data packet carries sample points with sequence numbers x to x + y, the timestamp of the audio encoded data packet is the sequence number x of the first sample point among them.

[0039] In an embodiment of the present disclosure, the description index value is used to distinguish different description code streams in a plurality of description code streams. In this embodiment, the description index value can be represented as md_i, such as md_0, md_1, md_2, etc.

[0040] S102: Determine whether a data packet with data packet information the same as that of the audio encoded data packet is cached in the data packet cache.

[0041] In step S102 above, if no data packet with data packet information the same as that of the audio encoded data packet is cached in the data packet cache, execute the following step S103.

[0042] Since the data packet information includes the time stamp and the description index value of the audio encoded data packet, for the data packets information to be the same, both the time stamp and the description index value need to be the same. Therefore, if no data packet with both the time stamp and the description index value the same as those of the audio encoded data packet is cached in the data packet cache, it is determined that no data packet with data packet information the same as that of the audio encoded data packet is cached in the data packet cache.

[0043] S103: Write the audio encoded data packet into the data packet cache based on the data packet information of the audio encoded data packet.

[0044] The method for processing an audio-encoded data packet according to an embodiment of the present disclosure first obtains the data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet. Next, it is determined whether a data packet having the same data packet information as the data packet information of the audio-encoded data packet is cached in the data packet cache. When the data packet cache does not contain a data packet having the same data packet information as the data packet information of the audio-encoded data packet, the audio-encoded data packet is written into the data packet cache based on the data packet information of the audio-encoded data packet. In the prior art, compared with only one audio-encoded data packet being cached for audio data with the same timestamp in the audio jitter buffer, the data packet information in the embodiment of the present disclosure includes the timestamp and the description index value of the audio-encoded data packet. Therefore, as long as the timestamp or the description index value in the audio-encoded data packet is different from that of the cached data packet, the audio-encoded data packet is written into the data packet cache. Therefore, in the embodiment of the present disclosure, all audio-encoded data packets with different description index values for the same timestamp are cached, and furthermore, the loss of the MDC code stream data can be avoided.

[0045] As a refinement and extension of the above embodiment, the embodiment of the present disclosure provides a method for processing an audio-encoded data packet. Referring to FIG. 3, the method for processing the audio-encoded data packet includes the following steps.

[0046] S301: Obtain the data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet.

[0047] Here, the data packet information includes the time stamp and the description index value of the audio-encoded data packet. Here, the audio-encoded data packet is obtained by encoding audio data, and the audio-encoded data packet includes at least one description of the audio data, and the description index value is the index of the description.

[0048] S302: Determine whether a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is cached in the data packet cache.

[0049] In step S302 above, in the data packet cache, whether a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is cached not present If so, execute the following step S303.

[0050] S303: Based on the data packet information of the audio-encoded data packet, write the audio-encoded data packet into the data packet cache.

[0051] S304: Determine the target time stamp.

[0052] Here, the target time stamp is the time stamp of the audio-encoded data packet that needs to be decoded currently.

[0053] S305: Read from the data packet cache each audio-encoded data packet whose time stamp is the target time stamp.

[0054] S306: By decoding each audio-encoded data packet whose time stamp is the target time stamp, obtain the audio data of the target time stamp.

[0055] Steps S301 to S303 in the above embodiment are used to implement a process of analyzing audio-encoded data packets and writing them into the data packet cache. Steps S304 to S30 6 are used to implement a process of reading audio-encoded data packets from the data packet cache and decoding the audio encoding data packets to obtain audio data. Since the above two processes are performed simultaneously, steps S301 to S303 and S304 to S306 are performed synchronously in this embodiment.

[0056] According to an embodiment of the present disclosure, a method for processing an audio-encoded data packet first obtains data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet. Next, it is determined whether a data packet whose data packet information is the same as that of the audio-encoded data packet is cached in the data packet cache. If the data packet cache does not contain a data packet whose data packet information is the same as that of the audio-encoded data packet, the audio-encoded data packet is written into the data packet cache based on the data packet information of the audio-encoded data packet. In the known art, compared with caching only one audio-encoded data packet for audio data with the same timestamp in the audio jitter buffer, the data packet information in the embodiment of the present disclosure includes the timestamp and the description index value of the audio-encoded data packet. Therefore, as long as the timestamp or the description index value in the audio-encoded data packet is different from that of the cached data packet, the audio-encoded data packet is written into the data packet cache. Therefore, in the embodiment of the present disclosure, all audio-encoded data packets with different description index values for the same timestamp are cached, and furthermore, the loss of the MDC code stream data can be avoided.

[0057] As a refinement and extension of the above embodiment, when each description code stream is transmitted in one audio-encoded data packet, referring to FIG. 4, the method for processing an audio-encoded data packet according to an embodiment of the present disclosure includes the following steps S401 to S412.

[0058] S401: Obtain data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet.

[0059] Here, the data packet information includes the time stamp and the description index value of the audio encoded data packet. Here, the audio encoded data packet is obtained by encoding audio data, and the audio encoded data packet includes at least one description of the audio data, and the description index value is the index of the description.

[0060] According to the example shown in FIG. 2 above, when the encoding method of the audio data is SDC, the SDC code stream of the audio data with the same time stamp includes only one description. When the encoding method of the audio data is MDC, the MDC code stream of the audio data with the same time stamp includes a plurality of descriptions. Therefore, when the encoding method of the audio data is SDC, the description of the audio data with the same time stamp can be transmitted by only one audio encoded data packet. When the encoding method of the audio data is MDC, the description of the audio data with the same time stamp needs to be transmitted by a plurality of audio encoded data packets.

[0061] S402: Determine whether a data packet whose data packet information is the same as the data packet information of the audio encoded data packet is cached in the data packet cache.

[0062] In step S402 above, if a data packet whose data packet information is the same as the data packet information of the audio encoded data packet is cached in the data packet cache, the following steps S403 to S405 are executed.

[0063] S403: Compare the priorities of the audio encoded data packet and the data packet.

[0064] In some embodiments, the priority of the data packet is such that the priority of the original media packet is higher than that of the retransmission recovery packet, the priority of the retransmission recovery packet is higher than that of the forward error correction (FEC) packet, and the forward error correction packet is higher than the in-band FEC packet. That is, original media packet > retransmission recovery packet > forward error correction packet > in-band FEC packet.

[0065] Here, the original media packet refers to the data packet of the original audio-encoded data.

[0066] The packet recovered by retransmission refers to the data packet obtained by retransmitting the audio-encoded data packet based on the retransmission mechanism after the original data packet is lost.

[0067] The forward error correction (FEC) packet refers to the data packet obtained after performing forward error correction on the audio-encoded data packet.

[0068] The in-band FEC packet refers to the data packet obtained after performing in-band FEC on the audio-encoded data packet.

[0069] In S403 above, if the priority of the audio-encoded data packet is higher than that of the data packet, the following S404 is executed; if the priority of the audio-encoded data packet is lower than that of the data packet, the following S405 is executed.

[0070] S404: Replace the data packet with the audio-encoded data packet.

[0071] In some embodiments, the audio-encoded data packet is an original data packet, and the data packet is a packet recovered by retransmission. According to the priorities provided in this embodiment, since it is easy to obtain that the priority of the original data packet is higher than the priority of the packet recovered by retransmission, the data packet is replaced with the audio-encoded data packet.

[0072] S405. Discard the audio-encoded data packet.

[0073] In some embodiments, the audio-encoded data packet is an in-band FEC packet. If the data packet is an original data packet, according to the priorities provided in this embodiment, since it is easy to obtain that the priority of the in-band FEC packet is lower than the priority of the original data packet, the audio-encoded data packet is discarded.

[0074] In step S402 above, when there is no data packet cached in the data packet cache whose data packet information is the same as the data packet information of the audio-encoded data packet, the following steps S406 to S408 are executed.

[0075] S406. In the data packet cache, determine a cache space corresponding to the timestamp of the audio-encoded data packet.

[0076] Referring to FIG. 5, the data packet cache includes a cache space 501 corresponding to a timestamp t-1, a cache space 502 corresponding to a timestamp t, and a cache space 503 corresponding to a timestamp t+1. When the timestamp of the audio-encoded data packet is t-1, based on the fact that the timestamp is t-1, timestampThe cache space 501 corresponding to t-1 can be determined. When the time stamp of the audio encoded data packet is t, based on the fact that the time stamp is t, the cache space 502 corresponding to the time stamp t can be determined. When the time stamp of the audio encoded data packet is t+1, based on the fact that the time stamp is t+1, timestamp the cache space 503 corresponding to t+1 can be determined.

[0077] S407. Based on the description index value of the audio encoded data packet, determine the cache order of the audio encoded data packet in the cache space.

[0078] S408. Write the audio encoded data packet into the cache space according to the cache order of the audio encoded data packet in the cache space.

[0079] Referring to FIG. 6, the data packet cache includes a cache space 501 corresponding to the time stamp t-1, a cache space 502 corresponding to the time stamp t, and a cache space 503 corresponding to the time stamp t+1. In the cache space 502 corresponding to the time stamp t, audio encoded data packets with description index values md_0, md_2, and md_5 are cached. When an audio encoded data packet with a time stamp of t and a description index value of md_3 is received, first, based on the fact that the time stamp is t, the cache space 502 corresponding to the time stamp t is determined. Then, based on the fact that the description index value is md_3, the cache order of the audio encoded data packet in the cache space is to be located between the audio encoded data packet with a description index value of md_2 and the audio encoded data packet with a description index value of md_5. Therefore, the audio encoded data packet with a time stamp of t and a description index value of md_3 is written between the audio encoded data packet with a description index value of md_2 and the audio encoded data packet with a description index value of md_5 in the cache space 502.

[0080] S409: Determine the target time stamp.

[0081] Here, the target time stamp is the time stamp of the audio encoded data packet that needs to be decoded currently.

[0082] S410: Discard the audio encoded data packets in the data packet cache whose time stamps are smaller than the target time stamp.

[0083] Exemplarily, when the target timestamp is t, discard the audio-encoded data packets with timestamps t-1, t-2, t-3, and so on. When the target timestamp is t+1, discard the audio-encoded data packets with timestamps t, t-1, t-2, and so on.

[0084] S411. Read all the audio-encoded data packets in the cache space corresponding to the target timestamp.

[0085] S412. Obtain the audio data of the target timestamp by decoding each audio-encoded data packet whose timestamp is the target timestamp.

[0086] In some embodiments, the data packet information further includes the sequence number of the audio-encoded data packet and the number of descriptions of the audio data corresponding to the audio-encoded data packet. The method for processing the audio-encoded data packet according to the embodiments of the present disclosure further includes calculating the packaging period and delay of the audio-encoded data packet, and adjusting the audio playback parameters corresponding to the audio-encoded data packet according to the packaging period and the delay. In some embodiments, the implementation manner of calculating the packaging period and delay of the audio-encoded data packet and adjusting the audio playback parameters corresponding to the audio-encoded data packet according to the packaging period and the delay can include the following steps a to e.

[0087] Step a. Obtain a first sequence number based on the sequence number of the audio-encoded data packet and the description index value of the audio-encoded data packet.

[0088] Here, the first sequence number is the sequence number of the audio-encoded data packet in which the first description with a time stamp being the first time stamp is transmitted, and the first time stamp is the time stamp of the audio-encoded data packet.

[0089] When the encoding method of the audio data corresponding to the audio-encoded data packet is SDC, the number of descriptions of the audio data corresponding to the audio-encoded data packet is 1. However, when the encoding method of the audio data corresponding to the audio-encoded data packet is MDC, the number of descriptions of the audio data corresponding to the audio-encoded data packet is 2 or more.

[0090] Exemplarily, referring to FIG. 7, in FIG. 7, the time stamp of the audio-encoded data packet is t, the description index value of the audio-encoded data packet is a, the sequence number of the audio-encoded data packet is n + a, the encoding method of the audio data corresponding to the audio-encoded data packet is MDC, and the number of descriptions of the audio data corresponding to the audio-encoded data packet is x are shown as an example. Since the descriptions of the audio data with a time stamp of t are each transmitted in one audio-encoded data packet, when receiving the audio-encoded data packet for transmitting the description with a description index value of a, it can be determined that the sequence number of the first description (the description with a description index value of md_0) of the audio data with a time stamp of t is n, and further n is determined as the first sequence number.

[0091] Since both the sequence number of the audio-encoded data packet and the description index value of the description of the audio data are consecutive, the implementation method of obtaining the first sequence number based on the sequence number of the audio-encoded data packet and the description index value of the audio-encoded data packet includes the following steps. The first sequence number is obtained by the following formula. s1 = s0 - M(i) Here, S0 is the sequence number of the audio-encoded data packet, s1 is the first sequence number (the sequence number of the audio-encoded data packet in which the first description with the time stamp being the first time stamp is transmitted), and M(i) is the description index value of the audio-encoded data packet.

[0092] Step b: Obtain the second sequence number.

[0093] Here, the second sequence number is the sequence number of the audio-encoded data packet in which the first description with the time stamp being the second time stamp is transmitted, and the second time stamp is the time stamp of the previously received audio-encoded data packet.

[0094] Note that when the time stamp of the previously received audio-encoded data packet is the same as the time stamp of the current audio-encoded data packet, the first sequence number and the second sequence number are the sequence numbers of the same audio-encoded data packet, and the first sequence number is the same as the second sequence number. However, when the time stamp of the previously received audio-encoded data packet is different from the time stamp of the current audio-encoded data packet, the first sequence number and the second sequence number are the sequence numbers of different audio-encoded data packets, and the first sequence number is different from the second sequence number.

[0095] Step c, based on the first sequence number, the second sequence number, the first timestamp, the second timestamp, the number of descriptions, and the sampling rate of the audio data, obtain the packaging period of the audio encoded data packet.

[0096] In some embodiments, the implementation manner of the above step c (obtaining the packaging period of the audio encoded data packet based on the first sequence number, the second sequence number, the first timestamp, the second timestamp, the number of descriptions, and the sampling rate of the audio data) includes obtaining the packaging period of the audio encoded data packet by the following formula: n1=(ts - ts’) / (s1 - s2) n2=m * n1 T = 1000.0f * n2 / fs Here, n1 is the number of sample points in a single audio encoded data packet, ts is the first timestamp, ts’ is the second timestamp, s1 is the first sequence number, s2 is the second sequence number, n2 is the total number of sample points in all audio encoded data packets whose timestamp is the first timestamp, m is the number of descriptions of the audio data corresponding to the audio encoded data packet, fs is the sampling rate of the audio data, and T is the packaging period of the audio encoded data packet.

[0097] The calculation principle of the above formula is explained as follows.

[0098] Since the time stamp in the audio-encoded data packet represents the physical meaning of the sequence number of the first sample point in the audio-encoded data packet, in the above formula n1 = (ts - ts') / (s1 - s2), subtracting the second time stamp ts' from the first time stamp ts can obtain the total number of sample points of the audio data of the first time stamp. Then, subtracting the second sequence number from the first sequence number can obtain the number of audio-encoded data packets whose time stamp is the first time stamp. Finally, dividing the total number of sample points of the first time stamp by the number of audio-encoded data packets whose time stamp is the first time stamp can obtain the number of sample points n1 in a single audio-encoded data packet whose time stamp is the first time stamp. of audio data By dividing the total number, the number of sample points n1 in a single audio-encoded data packet whose time stamp is the first time stamp can be obtained.

[0099] In the formula n2 = m * n1, multiplying the number m of descriptions of the audio data corresponding to the audio-encoded data packet by the number of sample points n1 in a single audio-encoded data packet can obtain the total number of sample points n2 in all audio-encoded data packets whose time stamp is the first time stamp.

[0100] In the formula T = 1000.0f * n2 / fs, dividing the total number of sample points n2 in all audio-encoded data packets whose time stamp is the first time stamp by the sampling rate fs of the audio data can obtain the sampling time of all sample points, and further obtain the packaging period T of the audio-encoded data packet.

[0101] Step d, obtaining the delay of the audio-encoded data packet based on the first sequence number, the second sequence number, and the number of descriptions.

[0102] In some embodiments, the implementation method of step d (obtaining the delay of the audio encoded data packet based on the first sequence number, the second sequence number, and the number of the descriptions) includes obtaining the delay of the audio encoded data packet by the following formula: DE = ((s1 - s2) / m) - 1 Here, DE is the delay of the audio encoded data packet, s1 is the first sequence number, s2 is the second sequence number, and m is the number of descriptions of the audio data corresponding to the audio encoded data packet.

[0103] Step e, adjust the audio playback parameters corresponding to the audio encoded data packet according to the packaging period and the delay.

[0104] As an extension and refinement of the above embodiments, when the descriptions of the audio data with the same timestamp are transmitted in the same audio encoded data packet, referring to FIG. 8, the method for processing the audio encoded data packet according to the embodiments of the present disclosure includes the following steps S801 to S812.

[0105] S801: Obtain the data packet information of the audio encoded data packet by analyzing the audio encoded data packet.

[0106] Here, the data packet information includes the timestamp and the description index value of the audio encoded data packet. Here, the audio encoded data packet is obtained by encoding audio data, and the audio encoded data packet includes at least one description of the audio data, and the description index value is the index of the description.

[0107] Note that since the descriptions of audio data with the same timestamp are transmitted in the same audio-encoded data packet, when the encoding mode of the audio data is MDC, the audio-encoded data packet contains multiple description index values.

[0108] In some embodiments, referring to FIG. 9, when the descriptions of audio data with the same timestamp are transmitted in the same audio-encoded data packet, since the audio data with the same timestamp contains only one description, the audio data of If the encoding method is SDC, the SDC code stream with the same timestamp contains only one audio-encoded data packet and the audio-encoded data packet contains only one description (the description with index value 0) of the audio data of that timestamp, but the audio data of If the encoding method is MDC and the number of descriptions of the audio data is m, the audio-encoded data packet of the MDC code stream with the same timestamp contains m descriptions (descriptions with index values from 0 to m - 1) of the audio data of that timestamp, and may also contain at least one description (descriptions with index values m, m - 1) of the audio data of at least one other timestamp.

[0109] S802: Determine whether a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is cached in the data packet cache.

[0110] In S802 above, if a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is cached in the data packet cache, perform the following steps S803 to S805: S803: Compare the priorities of the audio-encoded data packet and the data packet.

[0111] In S803 above, if the priority of the audio-encoded data packet is higher than the priority of the data packet, execute the following S804; if the priority of the audio-encoded data packet is lower than the priority of the data packet, execute the following S805.

[0112] S804: Replace the data packet with the audio-encoded data packet.

[0113] S805: Discard the audio-encoded data packet.

[0114] In S802 above, if no data packet with the same data packet information as the audio-encoded data packet is cached in the data packet cache, execute the following steps S806 to S808: S806: Determine whether the audio-encoded data packet carries descriptions of audio data with multiple timestamps.

[0115] In S806 above, if the audio-encoded data packet carries only one description of audio data with a timestamp, execute the following S807; if the audio-encoded data packet carries descriptions of audio data with multiple timestamps, execute the following S808.

[0116] S807: In the data packet cache, determine the cache space corresponding to the timestamp of the audio-encoded data packet and write the audio-encoded data packet into the cache space.

[0117] S808. In the data packet cache, cache spaces corresponding to the plurality of timestamps are respectively determined, the audio encoded data packets are respectively written into the cache spaces corresponding to the plurality of timestamps, and the timestamp of the audio encoded data packet written into the cache space corresponding to any one of the timestamps is corrected to the timestamp.

[0118] Exemplarily, referring to FIG. 10, in FIG. 10, taking as an example the audio encoded data packet with the timestamp t, it is shown that the description of the audio data with the timestamp t and the description of the audio data with the timestamp t-1 are included. Since the description of the audio data with the timestamp t-1 is included in the audio encoded data packet with the timestamp t, when receiving the audio encoded data packet Dt, the audio encoded data packet Dt is written into the cache space 101 corresponding to the timestamp t and the cache space 102 corresponding to the timestamp t-1, and the timestamp of the audio encoded data packet Dt written into the cache space 102 corresponding to the timestamp t-1 is corrected to t-1.

[0119] Exemplarily, according to the example shown in FIG. 10 above, when the description of the audio data with the timestamp t and the description of the audio data with the timestamp t-1 are included in the audio encoded data packet with the timestamp t, the realization method of writing the audio encoded data packets into the cache spaces corresponding to the timestamp t and the timestamp t-1 respectively, and correcting the timestamp of the audio encoded data packet written into the cache space corresponding to the timestamp t-1 to t-1 can include the following steps 1 to 4: Step 1. Copy the audio encoded data packet to obtain the copied data packet.

[0120] Step 2, modify the timestamp of the copied data packet from t to t-1.

[0121] Step 3, write the modified, copied data packet to the cache space corresponding to timestamp t-1.

[0122] Step 4, write the original audio-encoded data packet to the cache space corresponding to timestamp t.

[0123] S809: Determine the target timestamp.

[0124] Here, the target timestamp is the timestamp of the audio-encoded data packet that needs to be decoded currently.

[0125] S810: Discard the audio-encoded data packets in the data packet cache whose timestamps are smaller than the target timestamp.

[0126] S811, read all the audio-encoded data packets in the cache space corresponding to the target timestamp.

[0127] S812, obtain the audio data of the target timestamp by decoding each audio-encoded data packet whose timestamp is the target timestamp.

[0128] In an embodiment of the present disclosure, when a description of audio data with a plurality of timestamps is carried in the audio-encoded data packet, the audio-encoded data packet is written into a cache space corresponding to each timestamp, and the timestamp of the audio-encoded data packet written into the cache space corresponding to any one of the timestamps is corrected to the target timestamp. Therefore, in the cache space corresponding to the target timestamp, all audio-encoded data packets carrying the description of the audio data of the target timestamp are included, and the timestamps of the audio-encoded data packets are all the target timestamp. Thus, in the above embodiment, more information of the audio data of the target timestamp can be decoded, thereby improving the quality of the obtained audio data of the timestamp.

[0129] Based on the same inventive concept, as an implementation of the above method, an embodiment of the present disclosure further provides a processing device for an audio-encoded data packet, and this embodiment corresponds to the embodiment of the above method. For the sake of readability, in this embodiment, the details in the embodiment of the above method will not be described in detail one by one. Obviously, the processing device for the audio-encoded data packet in this embodiment can correspondingly implement all the contents in the embodiment of the above method.

[0130] An embodiment of the present disclosure provides audio-encoded data packet a processing device. FIG. 11 is a schematic configuration diagram of the processing device for the audio-encoded data packet. Referring to FIG. 11, the processing device 1100 for the audio-encoded data packet includes It is for obtaining data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet. The data packet information includes a timestamp and a description index value of the audio-encoded data packet. Here, the audio-encoded data packet is obtained by encoding audio data, and the audio-encoded data packet includes at least one description of the audio data. The description index value is an index of the description, and processing unit 111, The data packet cache includes a determination unit 112 for determining whether a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is cached, The data packet cache includes a writing unit 113 for writing the audio-encoded data packet to the data packet cache based on the data packet information of the audio-encoded data packet when a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is not cached.

[0131] As an optional embodiment of the embodiments of the present disclosure, referring to FIG. 12, the processing device 1100 of the audio-encoded data packet further includes a determination unit 114 for determining a target timestamp, where the target timestamp is the timestamp of the audio-encoded data packet that needs to be decoded currently, a reading unit 115 for reading each audio-encoded data packet whose timestamp is the target timestamp from the data packet cache, and a decoding unit 116 for obtaining the audio data of the target timestamp by decoding each audio-encoded data packet whose timestamp is the target timestamp.

[0132] As an optional embodiment of an example of the present disclosure, specifically, when each description is transmitted in one audio-encoded data packet, in the data packet cache, a cache space corresponding to the time stamp of the audio-encoded data packet is determined, and based on the description index value of the audio-encoded data packet, the cache order in the cache space of the audio-encoded data packet is determined, and according to the cache order in the cache space of the audio-encoded data packet, it is used to write the audio-encoded data packet into the cache space.

[0133] As an optional embodiment of an example of the present disclosure, the processing unit 111 further obtains a first sequence number based on the sequence number of the audio-encoded data packet and the description index value of the audio-encoded data packet, where the first sequence number is the sequence number of the audio-encoded data packet in which the first description with a time stamp being the first time stamp is transmitted, the first time stamp is the time stamp of the audio-encoded data packet, and it is used to obtain the delay of the audio-encoded data packet based on the first sequence number, the second sequence number, and the number of the descriptions, where the second sequence number is the sequence number of the audio-encoded data packet in which the first description with a time stamp being the second time stamp is transmitted, and the second time stamp is the time stamp of the audio-encoded data packet received one before.

[0134] As an optional embodiment of the embodiments of the present disclosure, the processing unit 111 is further configured to obtain a packaging period of the audio encoded data packet based on the first sequence number, the second sequence number, the first timestamp, the second timestamp, the number of the descriptions, and a sampling rate of the audio data, obtain a delay of the audio encoded data packet based on the first sequence number, the second sequence number, and the number of the descriptions, and is used to adjust audio playback parameters corresponding to the audio encoded data packet according to the packaging period and the delay.

[0135] As an optional embodiment of the embodiments of the present disclosure, specifically, when descriptions of audio data with the same timestamp are transmitted in the same audio encoded data packet, the writing unit 112 determines whether the audio encoded data packet carries descriptions of audio data with a plurality of timestamps. Otherwise, in the data packet cache, it determines a cache space corresponding to the timestamp of the audio encoded data packet, writes the audio encoded data packet into the cache space. If so, in the data packet cache, it determines cache spaces corresponding to the plurality of timestamps respectively, writes the audio encoded data packet into the cache spaces corresponding to the plurality of timestamps respectively, and is used to modify the timestamp of the audio encoded data packet written into the cache space corresponding to any one of the timestamps to the timestamp.

[0136] As an optional embodiment of the embodiments of the present disclosure, specifically, the reading unit 114 is used to read all audio encoded data packets in the cache space corresponding to the target timestamp.

[0137] As an optional embodiment of an example of the present disclosure, after determining the target timestamp, the processing unit 111 is further used to discard audio encoded data packets in the data packet cache whose timestamps are smaller than the target timestamp.

[0138] As an optional embodiment of an example of the present disclosure, when the data packet cache caches a data packet whose data packet information is the same as that of the audio encoded data packet, the writing unit 113 further compares the priorities of the audio encoded data packet and the data packet. If the priority of the audio encoded data packet is higher than that of the data packet, the data packet is replaced with the audio encoded data packet. If the priority of the audio encoded data packet is lower than that of the data packet, it is used to discard the audio encoded data packet.

[0139] The processing apparatus for audio encoded data packets provided in this example can execute the processing method for audio encoded data packets provided by the embodiments of the above method. Its implementation principle and technical effects are similar and will not be described in detail here.

[0140] Based on the same inventive concept, the embodiments of the present disclosure further provide an electronic device. FIG. 13 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in FIG. 13, the electronic device according to this embodiment includes a memory 131 and a processor 132. The memory 131 is used to store a computer program. When the computer program is executed by the processor 132, it is used to execute the processing method for audio encoded data packets according to the above embodiments.

[0141] Based on the same inventive concept, the embodiments of the present disclosure further provide a computer-readable storage medium storing a computer program, and the computer program is computing deviceWhen executed by, it causes the computing device to execute the method for processing audio encoded data packets provided by the above embodiments.

[0142] Based on the same inventive concept, embodiments of the present disclosure, when executed by a computer, cause the computer to further provide a computer program product that realizes the method for processing audio encoded data packets provided by the above embodiments.

[0143] Those skilled in the art will understand that the embodiments of the present disclosure can be provided as a method, a system, or a computer program product. Therefore, this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Further, the present disclosure can adopt the form of a computer program product implemented on one or more computer-usable storage media including computer-usable program code.

[0144] The processor may be a central processing unit 103 (Central Processing Unit, CPU), or other common processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Aplication Secific Itegrated Crcuit, ASIC), field-programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware assemblies, etc. The general-purpose processor may be a microprocessor, or the processor may be any ordinary processor, etc.

[0145] The memory may include forms such as non-persistent memory in a computer-readable medium, random access memory (RAM), and / or non-volatile memory such as read-only memory (ROM) or flash random access memory (flash RAM). The memory is an example of a computer-readable medium.

[0146] Computer-readable media include persistent and non-persistent, removable and non-removable storage media. The storage media can implement the storage of information by any method or technology, and the information may be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical memory, magnetic cassette tape, magnetic disk storage device or other magnetic storage device, or any other non-transmission medium, but are not limited thereto, and can store information accessible by a computing device. As defined herein, computer-readable media do not include transitory media such as modulated data signals or carrier waves.

[0147] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure and are not intended to limit them. Although the present disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art can understand that it is still possible to modify the technical solutions described in the foregoing embodiments, or perform substitutions with equivalents for some or all of the technical features therein. However, these modifications or substitutions do not deviate from the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present disclosure.

Claims

1. A method for processing an audio-encoded data packet, comprising: obtaining data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet, wherein the data packet information includes a timestamp and a description index value of the audio-encoded data packet, where the audio-encoded data packet is obtained by encoding audio data, the audio-encoded data packet includes at least one description of the audio data, and the description index value is an index of the description; determining whether a data packet having the same data packet information as the audio-encoded data packet is cached in a data packet cache; otherwise, writing the audio-encoded data packet to the data packet cache based on the data packet information of the audio-encoded data packet.

2. determining a target timestamp, where the target timestamp is a timestamp of an audio-encoded data packet that needs to be decoded currently; reading, from the data packet cache, each audio-encoded data packet having a timestamp that is the target timestamp; and obtaining audio data of the target timestamp by decoding each audio-encoded data packet having a timestamp that is the target timestamp. The method according to claim 1, further comprising:

3. When each description is transmitted in one audio-encoded data packet, writing the audio-encoded data packet to the data packet cache based on the data packet information of the audio-encoded data packet includes: determining a cache space corresponding to the timestamp of the audio-encoded data packet in the data packet cache; and determining a cache order of the audio-encoded data packet in the cache space based on the description index value of the audio-encoded data packet. The method according to claim 2, comprising writing the audio-encoded data packet into the cache space according to the cache order in the cache space of the audio-encoded data packet.

4. The data packet information of the audio-encoded data packet further includes the sequence number of the audio-encoded data packet and the number of descriptions of the audio data corresponding to the audio-encoded data packet, and the method includes: obtaining a first sequence number based on the sequence number of the audio-encoded data packet and the description index value of the audio-encoded data packet, where the first sequence number is the sequence number of the audio-encoded data packet in which the first description with a time stamp being the first time stamp is transmitted, and the first time stamp is the time stamp of the audio-encoded data packet; The method according to claim 3, further comprising obtaining a delay of the audio-encoded data packet based on the first sequence number, the second sequence number, and the number of descriptions, where the second sequence number is the sequence number of the audio-encoded data packet in which the first description with a time stamp being the second time stamp is transmitted, and the second time stamp is the time stamp of the previously received audio-encoded data packet.

5. obtaining a packaging period of the audio-encoded data packet based on the first sequence number, the second sequence number, the first time stamp, the second time stamp, the number of descriptions, and the sampling rate of the audio data; The method according to claim 4, further comprising adjusting audio playback parameters corresponding to the audio-encoded data packet according to the packaging period and the delay.

6. When descriptions of audio data with the same time stamp are transmitted in the same audio-encoded data packet, writing the audio-encoded data packet into the data packet cache based on the data packet information of the audio-encoded data packet is: Determine whether the audio encoded data packet carries a description of audio data with a plurality of timestamps, If not, in the data packet cache, determine a cache space corresponding to the timestamp of the audio encoded data packet, and write the audio encoded data packet into the cache space, If so, in the data packet cache, determine cache spaces corresponding to the plurality of timestamps respectively, write the audio encoded data packet into the cache spaces corresponding to the plurality of timestamps respectively, and correct the timestamp of the audio encoded data packet written into the cache space corresponding to any one of the timestamps to the timestamp, including the method according to claim 2.

7. Reading each audio encoded data packet from the data packet cache whose timestamp is the target timestamp Includes reading all audio encoded data packets in the cache space corresponding to the target timestamp, the method according to claim 3 or 6.

8. The method further includes After determining the target timestamp, discarding audio encoded data packets in the data packet cache whose timestamps are smaller than the target timestamp, the method according to any one of claims 2 to 7.

9. The method further includes When the data packet cache caches a data packet whose data packet information is the same as the data packet information of the audio encoded data packet, compare the priorities of the audio encoded data packet and the data packet, If the priority of the audio encoded data packet is higher than the priority of the data packet, replace the data packet with the audio encoded data packet, If the priority of the audio encoded data packet is lower than the priority of the data packet, discard the audio encoded data packet, including the method according to any one of claims 1 to 8.

10. A processing device for audio encoded data packets, A processing unit for obtaining data packet information of the audio-encoded data packet by analyzing the audio-encoded data packet, wherein the data packet information includes a time stamp and a description index value of the audio-encoded data packet. Here, the audio-encoded data packet is obtained by encoding audio data, and the audio-encoded data packet includes at least one description of the audio data, and the description index value is the index of the description, and a determination unit in the data packet cache for determining whether a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is cached, and a processing apparatus for an audio-encoded data packet, including a reading unit in the data packet cache for writing the audio-encoded data packet into the data packet cache based on the data packet information of the audio-encoded data packet when a data packet whose data packet information is the same as the data packet information of the audio-encoded data packet is not cached.

11. An electronic device including a memory and a processor, wherein the memory is used to store a computer program, and when the computer program is executed, the processor is used to cause the electronic device to execute the method for processing an audio-encoded data packet according to any one of claims 1 to 9.

12. A computer-readable storage medium storing a computer program, wherein when the computer program is executed by a computing device, the computing device is caused to execute the method for processing an audio-encoded data packet according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Data processing method and device, electronic equipment and readable storage medium

    CN111787420A

  • Audio data processing method and device suitable for stage, equipment and medium

    CN115065860A

  • Distributed media transmission system

    JP1999239134A

  • A method for managing a jitter buffer and a jitter buffer that utilizes it.

    JP2014531055A

  • Method of managing a jitter buffer, and jitter buffer using same

    US20140310008A1