An audio data transmission lost frame processing method, device, system and medium

By determining the frame drop zone in USB audio data transmission and calculating supplementary sampling points and values, the sound explosion problem caused by audio data loss is solved, and the user experience is improved.

CN114141257BActive Publication Date: 2025-08-05GEER TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111678569.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-31
Publication Date
2025-08-05
Estimated Expiration
2041-12-31

AI Technical Summary

Technical Problem

In USB audio data transmission, audio data loss frames lead to bursts, poor user experience, and the existing technology cannot effectively solve it.

Method used

By determining the frame drop area of the audio signal, the left and right end points of the frame drop area and the surrounding sampling points are used to calculate the sample points to be supplemented and the sampling values are performed, and the supplementary process is performed to generate the complete audio signal.

Benefits of technology

Reduces the generation of pop sound, improves the audio playback effect and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114141257B_ABST
    Figure CN114141257B_ABST
Patent Text Reader

Abstract

The present invention discloses a method, device, system, and computer-readable storage medium for processing lost frames in audio data transmission. The method comprises: determining a lost frame region of an audio signal; calculating, based on left and right endpoints of the lost frame region and a first preset number of sampling points located before the lost frame region and a second preset number of sampling points located after the lost frame region, each sampling point to be supplemented in the lost frame region and a sampling value corresponding to each sampling point to be supplemented; supplementing the lost frame region based on each sampling point to be supplemented and the corresponding sampling value to obtain a supplemented audio signal. The present invention can reduce the generation of popping sounds during use, thereby improving audio playback quality and enhancing user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of audio decoding, and in particular to a method, device, system and computer-readable storage medium for processing lost frames in audio data transmission. Background Art

[0002] After any USB device is connected to the USB interface, the host detects the access of a new device and uses different request commands (Request) to query the device's properties. The device reports its own status to the host through different descriptors, which may include the type of device, the function of the device, the number of endpoints the device has, and other working properties. UAC (USB Audio Class, abbreviated as UAC) Audio is a way to transmit audio data through USB. The USB Audio driver generates an analog sound card (CARD), and the audio data is transmitted and processed through the USB interface, such as recording (RECORD) and playback (PLAYBACK). During the audio recording process of the USB CARD, the audio data is sent from the HOST (host device) to the SLAVE (USB CARD, slave device) end, and then the SLAVE USB Controller sends the audio data to the DMA for the Audio module to obtain and process.

[0003] USB has four transmission channel types (Endpoint): Control, Interrupt, Bulk, and Isochronous. Control is used for USB bus control, etc. (all devices have it), Interrupt is mostly used for data transmission between mice and keyboards, and Bulk is mostly used for data transmission between USB flash drives. The first three types all have retransmission, but UAC Audio uses the fourth port, Isochronous, for audio data transmission. It has an error detection mechanism but no retransmission function. This often results in the inability to re-collect the original data when audio data packets are lost during transmission. The lost audio segment will produce popping sounds, which makes the user experience poor.

[0004] In view of this, how to provide a method, device, system and computer-readable storage medium for processing lost frames in audio data transmission that solve the above technical problems has become a problem that needs to be solved by those skilled in the art. Summary of the Invention

[0005] The purpose of the embodiments of the present invention is to provide a method, device, system, and computer-readable storage medium for processing lost frames in audio data transmission, which can reduce the generation of popping sounds during use, thereby improving audio playback quality and enhancing user experience.

[0006] To solve the above technical problems, an embodiment of the present invention provides a method for processing lost frames in audio data transmission, comprising:

[0007] Determine the frame loss area of the audio signal;

[0008] Calculating, based on the left and right endpoints of the frame drop region, a first preset number of sampling points located before the frame drop region, and a second preset number of sampling points located after the frame drop region, respective sampling points to be supplemented in the frame drop region and sampling values corresponding to respective sampling points to be supplemented;

[0009] The frame-lost area is supplemented according to each of the sampling points to be supplemented and the corresponding sampling values to obtain a supplemented audio signal.

[0010] Optionally, the process of calculating each to-be-supplemented sampling point in the frame dropped area and a sampling value corresponding to each to-be-supplemented sampling point based on the left and right endpoints of the frame dropped area, a first preset number of sampling points located before the frame dropped area, and a second preset number of sampling points located after the frame dropped area is as follows:

[0011] Determine the number and type of extreme value points to be supplemented by comparing the left endpoint of the frame loss region, the first sampling point located to the left of the left endpoint, the right endpoint of the frame loss region, and the first sampling point located to the right of the right endpoint;

[0012] Determine the sampling value of the extreme point to be supplemented based on the sampling values of the left endpoint of the frame loss region, the nth sampling point located to the left of the left endpoint, the n-1th sampling point located to the left of the left endpoint, the right endpoint of the frame loss region, the mth sampling point located to the right of the right endpoint, and the m-1th sampling point located to the right of the right endpoint;

[0013] The number of sampling points to be supplemented in the lost frame area and the sampling value of each sampling point to be supplemented are determined based on the magnitudes of the sampling values of the extreme point to be supplemented, the left endpoint of the lost frame area, the first sampling point to the left of the left endpoint, the right endpoint of the lost frame area, and the first sampling point to the right of the right endpoint.

[0014] Optionally, the process of determining the number and type of extreme value points to be supplemented by comparing the sampling values of the left endpoint of the frame loss region and the first sampling point located to the left of the left endpoint, and the right endpoint of the frame loss region and the first sampling point located to the right of the right endpoint is:

[0015] When L A -L A1 <0,L B -L B1When <0, there is one extreme point to be supplemented, and the type is a minimum point;

[0016] When L A -L A1 <0,L B -L B1 >0, there are two extreme value points to be supplemented, of which the types are minimum point and maximum point respectively;

[0017] When L A -L A1 >0,L B -L B1 >0, there is one extreme point to be supplemented, and the type is a maximum point;

[0018] When L A -L A1 >0,L B -L B1 When <0, there are two extreme value points to be supplemented, which are of the maximum value point and the minimum value point respectively;

[0019] Among them, L A Indicates the sampling value of the left endpoint of the frame loss area, L A1 Represents the sampling value of the first sampling point to the left of the left endpoint, L B represents the sampling value of the right endpoint of the frame loss area, L B1 Indicates the sample value of the first sampling point to the right of the right endpoint.

[0020] Optionally, the process of determining the sampling value of the to-be-supplemented extreme point based on the sampling values of the left endpoint of the frame-dropping region, the nth sampling point to the left of the left endpoint, the n-1th sampling point to the left of the left endpoint, the right endpoint of the frame-dropping region, the mth sampling point to the right of the right endpoint, and the m-1th sampling point to the right of the right endpoint is:

[0021] When there is only one extreme point to be supplemented and it is a minimum point:

[0022] If L A(n-1) -L An >0, then Lmin=L A +(L A -L A(n-1) );

[0023] If L A(n-1) -L An <0, then Lmin=L A +(L A -L An ); where Lmin is the sampling value of the minimum point;

[0024] When there are two extreme points to be supplemented, and from L A To L B When they are minimum and maximum points respectively:

[0025] If L A(n-1) -L An >0, then Lmin=L A +(L A -L A(n-1) );

[0026] If L A(n-1) -L An <0, then Lmin=L A +(L A -L An );

[0027] If L B(m-1) -L Bm <0, then Lmax=L B +(LB-L B(m-1) );

[0028] If L B(m-1) -L Bm >0, then Lmax=L B +(LB-L Bm ); where Lmax is the sampling value of the maximum point;

[0029] When there is only one extreme point to be supplemented and it is a maximum point:

[0030] If L A(n-1) -L An <0, then Lmax=L A +(L A -L A(n-1) );

[0031] If L A(n-1) -L An >0, then Lmax=L A +(L A -L An );

[0032] When there are two extreme points to be supplemented, and they are the maximum point and the minimum point from LA to LB:

[0033] If L A(n-1) -L An <0, then Lmax=L A +(L A -L A(n-1) );

[0034] If L A(n-1) -LAn >0, then Lmax=L A +(L A -L An );

[0035] If L B(m-1) -L Bm >0, then Lmin=L B +(L B -L B(m-1) );

[0036] If L B(m-1) -L Bm <0, then Lmin=L B +(L B -L Bm );

[0037] Where n is the first preset number, m is the second preset number, L An represents the sampling value of the nth sampling point to the left of the left endpoint, L A(n-1) represents the sampling value of the n-1th sampling point to the left of the left endpoint, L Bm represents the sampling value of the mth sampling point to the right of the right endpoint, L Bm-1 Represents the sampling value of the m-1th sampling point to the right of the right endpoint.

[0038] Optionally, the process of determining the number of sampling points to be supplemented in the lost frame region and the sampling value of each sampling point to be supplemented based on the magnitudes of the sampling values of the extreme point to be supplemented, the left endpoint of the lost frame region, the first sampling point to the left of the left endpoint, the right endpoint of the lost frame region, and the first sampling point to the right of the right endpoint is:

[0039] When there is one extreme point to be supplemented and it is a minimum point:

[0040] From L A The number of sampling points to be supplemented to Lmin is L P =(Lmin-L A ) / (L A -L A1 ), and the sampling value of the pth sampling point to be supplemented is L A +p*L Astep , where L Astep =L A -L A1 ;

[0041] From L B The number of sampling points to be supplemented to Lmin is L Q =(Lmin-L B ) / (LB -L B1 ), and the sampling value of the qth sampling point to be supplemented is L B +p*L Bstep , where L Bstep =L B -L B1 ;

[0042] When there are two extreme value points to be supplemented, and from L A To L B When they are minimum and maximum points respectively:

[0043] From L A The number of sampling points to be supplemented to Lmin is L X =(L A -Lmin) / (L A -L A1 ), and the sampling value of the xth sampling point to be supplemented is L A +x*L Astep Among them, L Astep =L A -L A1 ;

[0044] The number of sampling points to be supplemented from Lmin to Lmax Y =(Lmax-Lmin) / ((|L A -L A1 |+|L B -L B1 |) / 2), and the sampling value of the yth sampling point to be supplemented is Lmin+y*L Astep Among them, L Bstep =(|L A -L A1 |+|L B -L B1 |) / 2;

[0045] From Lmax to L B The number of sampling points to be supplemented L Z =(Lmax-L B ) / (L B -L B1 ), and the sampling value of the zth sampling point to be supplemented is Lmax+z*L Bstep , where L Bstep =L B1 -L B ;

[0046] When there is only one extreme point to be supplemented and it is a maximum point:

[0047] From L AThe number of sampling points to be supplemented to Lmax is L P =(Lmax-L A ) / (L A -L A1 ), and the sampling value of the pth sampling point to be supplemented is L A +p*L Astep , where L Astep =L A -L A1 ;

[0048] From Lmax to L B The number of sampling points to be supplemented L Q =(Lmax-L B ) / (L B -L B1 ), and the sampling value of the qth sampling point to be supplemented is Lmax-p*L Bstep , where L Bstep =L B -L B1 ;

[0049] When there are two extreme points to be supplemented, and from L A To L B When they are maximum and minimum points respectively:

[0050] From L A The number of sampling points to be supplemented to Lmax is L X =(L A -Lmax) / (L A -L A1 ), and the sampling value of the xth sampling point to be supplemented is L A +x*L Astep Among them, L Astep =L A -L A1 ;

[0051] The number of sampling points to be supplemented from Lmax to Lmin is L Y =(Lmax-Lmin) / ((|L A -L A1 |+|L B -L B1 |) / 2), and the sampling value of the yth sampling point to be supplemented is Lmax-y*L Astep Among them, L Bstep =(|L A -L A1 |+|L B -L B1 |) / 2;

[0052] From Lmin to LB The number of sampling points to be supplemented L Z =(Lmin-L B ) / (L B -L B1 ), and the sampling value of the zth sampling point to be supplemented is Lmin+z*L Bstep , where L Bstep =L B1 -L B .

[0053] Optionally, the first preset number is determined by:

[0054] The comparison starts from the first sampling point before the left endpoint of the frame loss area. A(n-1) -L An >0, determine the value of n and use the value as the first preset number; when L does not exist within the preset threshold number A(n-1) -L An >0, the preset threshold value is used as the first preset number;

[0055] The comparison starts from the first sampling point after the right endpoint of the frame loss area. B(m-1) -L Bm >0, determine the value of m and use the value as the second preset number; when L does not exist within the preset threshold number B(m-1) -L Bm >0, the preset threshold quantity is used as the second preset quantity.

[0056] An embodiment of the present invention further provides a device for processing lost frames in audio data transmission, comprising:

[0057] A determination module, configured to determine a frame loss area of the audio signal;

[0058] a calculation module, configured to calculate, based on the left and right endpoints of the frame-dropped region, a first preset number of sampling points located before the frame-dropped region, and a second preset number of sampling points located after the frame-dropped region, respective sampling points to be supplemented in the frame-dropped region and a sampling value corresponding to each sampling point to be supplemented;

[0059] The supplementing module is used to supplement the frame-lost area according to each of the sampling points to be supplemented and their corresponding sampling values to obtain a supplemented audio signal.

[0060] Optionally, the calculation module includes:

[0061] a first determining unit, configured to determine the number and type of extreme value points to be supplemented by comparing the sampling values of the left endpoint of the frame loss region and the first sampling point located to the left of the left endpoint, the right endpoint of the frame loss region and the first sampling point located to the right of the right endpoint;

[0062] a second determining unit, configured to determine the sampling value of the to-be-supplemented extreme value point based on the left endpoint of the frame-dropping region, the nth sampling point to the left of the left endpoint, the n-1th sampling point to the left of the left endpoint, the right endpoint of the frame-dropping region, the mth sampling point to the right of the right endpoint, and the m-1th sampling point to the right of the right endpoint;

[0063] A third determining unit is configured to determine the number of sampling points to be supplemented in the lost frame area and the sampling value of each sampling point to be supplemented based on the magnitudes of the sampling values of the extreme point to be supplemented, the left endpoint of the lost frame area, the first sampling point to the left of the left endpoint, the right endpoint of the lost frame area, and the first sampling point to the right of the right endpoint.

[0064] An embodiment of the present invention further provides a system for processing lost frames in audio data transmission, comprising:

[0065] Memory for storing computer programs;

[0066] A processor is configured to implement the steps of the above-mentioned method for processing lost frames in audio data transmission when executing the computer program.

[0067] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the method for processing lost frames in audio data transmission as described above are implemented.

[0068] Embodiments of the present invention provide a method, apparatus, system, and computer-readable storage medium for processing lost frames in audio data transmission. The method includes: determining a lost frame region of an audio signal; calculating, based on left and right endpoints of the lost frame region and a first preset number of sampling points located before the lost frame region and a second preset number of sampling points located after the lost frame region, each sampling point to be supplemented in the lost frame region and a sampling value corresponding to each sampling point to be supplemented; and supplementing the lost frame region based on each sampling point to be supplemented and the corresponding sampling value to obtain a supplemented audio signal.

[0069] It can be seen that in the embodiment of the present invention, a frame-dropping region of an audio signal is first determined. Then, based on the left and right endpoints of the frame-dropping region, a first preset number of sampling points located before the frame-dropping region, and a second preset number of sampling points located after the frame-dropping region, each sampling point to be supplemented within the frame-dropping region and a sampling value corresponding to each sampling point to be supplemented are further calculated. The frame-dropping region is supplemented based on each sampling point to be supplemented and the corresponding sampling value, thereby obtaining a supplemented audio signal. During use, the present invention can reduce the occurrence of popping sounds, thereby improving audio playback quality and enhancing user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the prior art and the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0071] Figure 1 A flowchart of a method for processing lost frames in audio data transmission provided by an embodiment of the present invention;

[0072] Figure 2 A flowchart of a method for calculating sampling points to be supplemented and corresponding sampling values provided by an embodiment of the present invention;

[0073] Figure 3 An embodiment of the present invention provides an audio signal with lost frames;

[0074] Figure 4 A schematic diagram of a trend of frame loss areas of an audio signal provided by an embodiment of the present invention;

[0075] Figure 5 A schematic diagram of another trend of audio signal frame loss areas provided by an embodiment of the present invention;

[0076] Figure 6 A schematic diagram of another trend of audio signal frame loss areas provided by an embodiment of the present invention;

[0077] Figure 7 A schematic diagram of another trend of audio signal frame loss areas provided by an embodiment of the present invention;

[0078] Figure 8 A schematic structural diagram of a device for processing lost frames in audio data transmission provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0079] Embodiments of the present invention provide a method, device, system, and computer-readable storage medium for processing lost frames in audio data transmission, which can reduce the generation of popping sounds during use, thereby improving audio playback quality and enhancing user experience.

[0080] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0081] Please refer to Figure 1 , Figure 1 A flowchart of a method for processing lost frames in audio data transmission provided by an embodiment of the present invention is provided. The method includes:

[0082] S110: Determine a frame loss area of the audio signal;

[0083] It should be noted that in actual applications, the PCM audio data sent by the USB host device can be obtained through the USB module and the audio data can be stored in the HW cache module. The HW cache module triggers an interrupt to notify the USB controller to transfer the PCM audio data to DMA (direct memory access). The audio module obtains the DMA data to process the audio data, such as playback, converting it into a wav audio file and saving it to Flash. Among them, after the HW cache module triggers an interrupt, the audio module will receive the status identifier of obtaining the HW cache returned by the USB controller. Specifically, the status identifier can be used to further determine whether there are lost data frames in the audio signal. At this time, the audio signal can be further obtained, and the corresponding frame loss area can be determined through the obtained audio signal.

[0084] S120: Calculating each to-be-supplemented sampling point in the frame dropped region and a sampling value corresponding to each to-be-supplemented sampling point based on the left and right endpoints of the frame dropped region, a first preset number of sampling points located before the frame dropped region, and a second preset number of sampling points located after the frame dropped region;

[0085] Specifically, in an embodiment of the present invention, after determining a frame loss region in an audio signal, a first preset number of sampling points (including a sampling value corresponding to each sampling point) located before the frame loss region and a second preset number of sampling points (including the sampling values of the sampling points) located after the frame loss region in the audio signal can be obtained. Then, based on the first preset number of sampling points located before the frame loss region and the second preset number of sampling points located after the frame loss region, each sampling point to be supplemented in the frame loss region and the sampling value corresponding to each sampling point to be supplemented are calculated.

[0086] For example, see Figure 2 The audio signal shown is a two-channel stereo signal with a sampling frequency of 48k. LA is the left endpoint of the left channel frame loss area, LB is the right endpoint of the left channel frame loss area, RA is the left endpoint of the right channel frame loss area, and RB is the right endpoint of the left channel frame loss area. In actual applications, the method provided in the embodiment of the present invention is used to compensate for the signal in the frame loss area for each channel.

[0087] S130: Supplement the lost frame area according to the sampling points to be supplemented and their corresponding sampling values to obtain a supplemented audio signal.

[0088] Specifically, after determining the sampling points to be supplemented in the lost frame area and the sampling values corresponding to each sampling point to be supplemented, the positions of the sampling points to be supplemented and the sampling values corresponding to each sampling point can be supplemented from the lost frame area, so that the data in the lost frame area is complete to obtain a supplemented audio signal, and the frame lost area portion of the supplemented audio signal has been supplemented with the sampling points and the corresponding sampling values.

[0089] For further information, please refer to Figure 3 The process of calculating the sampling points to be supplemented in the frame dropped area and the sampling values corresponding to each sampling point to be supplemented in S120 based on the left and right endpoints of the frame dropped area, a first preset number of sampling points located before the frame dropped area, and a second preset number of sampling points located after the frame dropped area may specifically be:

[0090] S210: Determine the number and type of extreme value points to be supplemented by comparing the left endpoint of the frame loss region, the first sampling point to the left of the left endpoint, the right endpoint of the frame loss region, and the first sampling point to the right of the right endpoint;

[0091] It should be noted that, in the embodiment of the present invention, one of the channels in the embodiment of the present invention can be used as an example for detailed description, wherein, in the embodiment of the present invention, after determining the frame loss area of the audio signal, the left endpoint and the right endpoint of the frame loss area can be determined according to the position of the frame loss area, and then a first preset number of sampling points and corresponding sampling values located before the frame loss area (that is, the sampling points are earlier than the position of the frame loss area) are further determined from the audio signal, and a second preset number of sampling points and corresponding sampling values located after the frame loss area (that is, the sampling points are later than the position of the frame loss area) are determined, wherein the first preset number and the second preset number can be the same or different, and can be determined specifically according to actual conditions, and the embodiment of the present invention does not make any special limitations.

[0092] Specifically, the number and type of extreme value points to be supplemented in the frame loss area can be determined by the following method:

[0093] When L A -L A1 <0,L B -L B1 <0, there is one extreme point to be supplemented, and the type is a minimum point; specifically, when L A -L A1 <0,L B -L B1 When <0, the audio trend diagrams at both ends of the audio signal frame loss area are as follows Figure 4 As shown, according to the Fourier transform, the trend of the sampling points to be supplemented in the frame loss area is from L A To L B First it goes down and then it goes up, so L A and L B The supplementary extreme points between are the minimum points.

[0094] When L A -L A1 <0,L B -L B1 > 0, there are two extreme points to be supplemented, of which the types are minimum point and maximum point respectively. Specifically, when L A -L A1 <0,L B -L B1 When >0, the audio trend diagrams at both ends of the audio signal frame loss area are as follows Figure 5 As shown, according to the Fourier transform, the trend of the sampling points to be supplemented in the frame loss area is from L A To L B First it goes down, then it goes up, then it goes down again, so L A and L B The supplementary extreme points are the minimum point and the maximum point respectively.

[0095] When L A-L A1 >0,L B -L B1 > 0, there is one extreme point to be supplemented, and the type is a maximum point; specifically, when L A -L A1 >0,L B -L B1 When >0, the audio trend diagrams at both ends of the audio signal frame loss area are as follows Figure 6 As shown, according to the Fourier transform, the trend of the sampling points to be supplemented in the frame loss area is from L A To L B First rise and then fall, so L A and L B The extreme points supplemented between are the maximum points.

[0096] When L A -L A1 >0,L B -L B1 <0, there are two extreme points to be supplemented, of which the types are maximum point and minimum point respectively. Specifically, when L A -L A1 >0,L B -L B1 When <0, the audio trend diagrams at both ends of the audio signal frame loss area are as follows Figure 7 As shown, according to the Fourier transform, the trend of the sampling points to be supplemented in the frame loss area is from L A To L B First it rises, then falls, and then rises again, so L A and L B The supplementary extreme points are the maximum point and the minimum point respectively.

[0097] Among them, L A Indicates the sampling value of the left endpoint of the frame loss area, L A1 Indicates the sampling value of the first sampling point to the left of the left endpoint, L B Indicates the sampling value of the right endpoint of the frame loss area, L B1 Indicates the sample value of the first sampling point to the right of the right endpoint.

[0098] S220: Determine the sampling value of the extreme point to be supplemented based on the sampling values of the left endpoint of the frame loss region, the nth sampling point to the left of the left endpoint, the n-1th sampling point to the left of the left endpoint, the right endpoint of the frame loss region, the mth sampling point to the right of the right endpoint, and the m-1th sampling point to the right of the right endpoint;

[0099] Specifically, in the embodiment of the present invention, after determining the number and type of extreme value points to be supplemented, the sampling values of the extreme value points to be supplemented can be determined by the following method:

[0100] When there is only one extreme point to be supplemented and it is a minimum point:

[0101] If L A(n-1) -L An >0, indicating L A(n-1) is the maximum value, then Lmin=L A +(L A -L A(n-1) );

[0102] If L A(n-1) -L An <0, indicating that L An is both a maximum and a maximum value, then Lmin=L A +(L A -L An ); where Lmin is the sampling value of the minimum point;

[0103] When there are two extreme points to be supplemented, and from L A To L B When they are minimum and maximum points respectively:

[0104] If L A(n-1) -L An >0, indicating L A(n-1) is the maximum value, then Lmin=L A +(L A -L A(n-1) );

[0105] If L A(n-1) -L An <0, indicating that L An is both a maximum and a maximum value, then Lmin=L A +(L A -L An );

[0106] If L B(m-1) -L Bm <0, indicating L B(n-1) is the minimum value, then Lmax=L B +(LB-L B(m-1) );

[0107] If L B(m-1) -L Bm >0, indicating that L is in the area between n sampling points after the frame loss area Bn is both a minimum and a minimum value, then Lmax=L B +(LB-L Bm ); where Lmax is the sampling value of the maximum point;

[0108] When there is only one extreme point to be supplemented and it is a maximum point:

[0109] If L A(n-1) -L An <0, indicating L A(n-1) is the minimum value, then Lmax=L A +(L A -L A(n-1) );

[0110] If L A(n-1) -L An > 0, indicating that L is in the area between n sampling points before the frame loss area An is both a minimum and a minimum value, then Lmax=L A +(L A -L An );

[0111] When there are two extreme points to be supplemented, and the maximum point and the minimum point are from LA to LB:

[0112] If L A(n-1) -L An <0, indicating L A(n-1) is the minimum value, then Lmax=L A +(L A -L A(n-1) );

[0113] If L A(n-1) -L An >0, indicating L An is the minimum value, then Lmax=L A +(L A -L An );

[0114] If L B(m-1) -L Bm >0, indicating L B(n-1) is the maximum value, then Lmin=L B +(L B -L B(m-1) );

[0115] If L B(m-1) -L Bm <0, indicating L Bn is the minimum value, then Lmin=L B +(L B -L Bm );

[0116] Where n is the first preset number, m is the second preset number, L An Indicates the sampling value of the nth sampling point to the left of the left endpoint, LA(n-1) Indicates the sampling value of the n-1th sampling point to the left of the left endpoint, L Bm Indicates the sampling value of the mth sampling point to the right of the right endpoint, L Bm-1 Represents the sample value of the m-1th sampling point to the right of the right endpoint.

[0117] S230: Determine the number of sampling points to be supplemented in the lost frame area and the sampling value of each sampling point to be supplemented based on the extreme point to be supplemented, the left endpoint of the lost frame area, the first sampling point to the left of the left endpoint, the right endpoint of the lost frame area, and the first sampling point to the right of the right endpoint.

[0118] Specifically, in the embodiment of the present invention, after determining the sampling value of the extreme point to be supplemented, each sampling point to be supplemented in the frame loss area and the sampling value corresponding to each sampling point to be supplemented can be determined by the following method, as follows:

[0119] When there is only one extreme point to be supplemented and it is a minimum point:

[0120] From L A The number of sampling points to be supplemented to Lmin is L P =(Lmin-L A ) / (L A -L A1 ), and the sampling value of the pth sampling point to be supplemented is L A +p*L Astep , where L Astep =L A -L A1 ;

[0121] That is, L Astep =L A -L A1 As from L A The fixed difference between the sampling values of the sampling points to be supplemented to Lmin, then L A The sampling value of the first sampling point to be supplemented to the right is L A +1*L Astep , L A The sampling value of the second sampling point to be supplemented to the right is L A +2*L Astep , ... the sampling value of the pth sampling point to be supplemented is L A +p*L Astep The position of each sampling point to be supplemented on the horizontal axis is determined by the system audio sampling rate, and the present invention does not impose any special limitation thereto.

[0122] From L B The number of sampling points to be supplemented to Lmin is LQ =(Lmin-L B ) / (L B -L B1 ), and the sampling value of the qth sampling point to be supplemented is L B +p*L Bstep , where L Bstep =L B -L B1 ;

[0123] That is, L Bstep =L B -L B1 As the distance from Lmin to L B The fixed difference between the sampling values of the sampling points to be supplemented, then L B The sampling value of the first sampling point to be supplemented to the left is L B +1*L Bstep , L B The sampling value of the second sampling point to be supplemented to the left is L B +2*L Bstep , ... the sampling value of the qth sampling point to be supplemented is L B +p*L Bstep .

[0124] When there are two extreme points to be supplemented, and from L A To L B When they are minimum and maximum points respectively:

[0125] From L A The number of sampling points to be supplemented to Lmin is L X =(L A -Lmin) / (L A -L A1 ), and the sampling value of the xth sampling point to be supplemented is L A +x*L Astep Among them, L Astep =L A -L A1 ;

[0126] That is, L Astep =L A -L A1 As from L A The fixed difference between the sampling values of the sampling points to be supplemented to Lmin, then L A The sampling value of the first sampling point to be supplemented to the right is L A +1*L Astep , L A The sampling value of the second sampling point to be supplemented to the right is L A +2*LAstep , ... the sampling value of the xth sampling point to be supplemented is L A +x*L Astep .

[0127] The number of sampling points to be supplemented from Lmin to Lmax Y =(Lmax-Lmin) / ((|L A -L A1 |+|L B -L B1 |) / 2), and the sampling value of the yth sampling point to be supplemented is Lmin+y*L Astep Among them, L Bstep =(|L A -L A1 |+|L B -L B1 |) / 2;

[0128] That is, L Bstep =(|L A -L A1 |+|L B -L B1 |) / 2 is the fixed difference between the sampling values of the sampling points to be supplemented from Lmin to Lmax, then the sampling value of the first sampling point to be supplemented to the right of Lmin is Lmin+1*L Astep , the sampling value of the second sampling point to be supplemented to the right of Lmin is Lmin+2*L Astep , ... the sampling value of the yth sampling point to be supplemented is Lmin+y*L Astep .

[0129] From Lmax to L B The number of sampling points to be supplemented L Z =(Lmax-L B ) / (L B -L B1 ), and the sampling value of the zth sampling point to be supplemented is Lmax+z*L Bstep , where L Bstep =L B1 -L B ;

[0130] That is, L Bstep =L B1 -L B As the distance from Lmax to L B The fixed difference between the sampling values of the sampling points to be supplemented, then the sampling value of the first sampling point to be supplemented to the right of Lmax is Lmax+1*L Astep, the sampling value of the second sampling point to be supplemented to the right of Lmax is Lmax+2*L Astep , ... the sampling value of the zth sampling point to be supplemented is Lmax+z*L Astep .

[0131] When there is only one extreme point to be supplemented and it is a maximum point:

[0132] From L A The number of sampling points to be supplemented to Lmax is L P =(Lmax-L A ) / (L A -L A1 ), and the sampling value of the pth sampling point to be supplemented is L A +p*L Astep , where L Astep =L A -L A1 ;

[0133] That is, L Astep =L A -L A1 As from L A The fixed difference between the sampling values of the sampling points to be supplemented between Lmax and L A The sampling value of the first sampling point to be supplemented to the right is L A +1*L Astep , L A The sampling value of the second sampling point to be supplemented to the right is L A +2*L Astep , ... the sampling value of the pth sampling point to be supplemented is L A +p*L Astep .

[0134] From Lmax to L B The number of sampling points to be supplemented L Q =(Lmax-L B ) / (L B -L B1 ), and the sampling value of the qth sampling point to be supplemented is Lmax-p*L Bstep , where L Bstep =L B -L B1 ;

[0135] That is, L Bstep =L B -L B1 As the distance from Lmax to L BThe fixed difference between the sampling values of the sampling points to be supplemented, then the sampling value of the first sampling point to be supplemented to the right of Lmax is Lmax-1*L Bstep , L B The sampling value of the second sampling point to be supplemented to the left is Lmax-2*L Bstep , ... the sampling value of the qth sampling point to be supplemented is Lmax-p*L Bstep .

[0136] When there are two extreme points to be supplemented, and from L A To L B When they are maximum and minimum points respectively:

[0137] From L A The number of sampling points to be supplemented to Lmax is L X =(L A -Lmax) / (L A -L A1 ), and the sampling value of the xth sampling point to be supplemented is L A +x*L Astep Among them, L Astep =L A -L A1 ;

[0138] That is, L Astep =L A -L A1 As from L A The fixed difference between the sampling values of the sampling points to be supplemented to Lmax, then L A The sampling value of the first sampling point to be supplemented to the right is L A +1*L Astep , L A The sampling value of the second sampling point to be supplemented to the right is L A +2*L Astep , ... the sampling value of the xth sampling point to be supplemented is L A +x*L Astep .

[0139] The number of sampling points to be supplemented from Lmax to Lmin is L Y =(Lmax-Lmin) / ((|L A -L A1 |+|L B -L B1 |) / 2), and the sampling value of the yth sampling point to be supplemented is Lmax-y*L Astep Among them, L Bstep =(|L A -L A1 |+|L B-L B1 |) / 2;

[0140] That is, L Bstep =(|L A -L A1 |+|L B -L B1 |) / 2 is the fixed difference between the sampling values of the sampling points to be supplemented from Lmax to Lmin, then the sampling value of the first sampling point to be supplemented to the right of Lmax is Lmax-1*L Astep , the sampling value of the second sampling point to be supplemented to the right of Lmin is Lmax-2*L Astep , ... the sampling value of the yth sampling point to be supplemented is Lmax-y*L Astep .

[0141] From Lmin to L B The number of sampling points to be supplemented L Z =(Lmin-L B ) / (L B -L B1 ), and the sampling value of the zth sampling point to be supplemented is Lmin+z*L Bstep , where L Bstep =L B1 -L B .

[0142] That is, L Bstep =L B1 -L B As the distance from Lmin to L B The fixed difference between the sampling values of the sampling points to be supplemented, then the sampling value of the first sampling point to be supplemented to the right of Lmin is Lmin+1*L Astep , the sampling value of the second sampling point to be supplemented to the right of Lmin is Lmin+2*L Astep , ... the sampling value of the zth sampling point to be supplemented is Lmin+z*L Astep .

[0143] It should also be noted that, in actual applications, the first preset number and the second preset number can be determined by the following method:

[0144] Specifically, the method for determining the first preset number may be:

[0145] Start the comparison from the first sampling point before the left endpoint of the frame loss area. A(n-1) -L An >0, determine the value of n and use it as the first preset number; when L does not exist within the preset threshold number A(n-1)-L An >0, the preset threshold value is used as the first preset value;

[0146] The method for determining the second preset number may specifically be:

[0147] Start the comparison from the first sampling point after the right endpoint of the frame loss area. B(m-1) -L Bm >0, determine the value of m and use it as the second preset number; when L does not exist within the preset threshold number B(m-1) -L Bm >0, the preset threshold quantity is used as the second preset quantity.

[0148] It can be seen that in the embodiment of the present invention, a frame-dropping region of an audio signal is first determined. Then, based on a first preset number of sampling points located before the frame-dropping region and a second preset number of sampling points located after the frame-dropping region, each sampling point to be supplemented within the frame-dropping region and a sampling value corresponding to each sampling point to be supplemented are further calculated. The frame-dropping region is supplemented based on each sampling point to be supplemented and the corresponding sampling value, thereby obtaining a supplemented audio signal. During use, the present invention can reduce the occurrence of popping sounds, thereby improving audio playback quality and enhancing user experience.

[0149] Based on the above embodiment, the present invention also provides an apparatus for processing lost frames in audio data transmission. Figure 8 The device comprises:

[0150] A determination module 21 is used to determine a frame loss area of the audio signal;

[0151] a calculation module 22 configured to calculate each sampling point to be supplemented in the frame dropped region and a sampling value corresponding to each sampling point to be supplemented based on the left and right endpoints of the frame dropped region, a first preset number of sampling points located before the frame dropped region, and a second preset number of sampling points located after the frame dropped region;

[0152] The supplementation module 23 is configured to supplement the lost frame region according to the sampling points to be supplemented and their corresponding sampling values to obtain a supplemented audio signal.

[0153] Optionally, the calculation module includes:

[0154] The first determining unit is configured to determine the number and type of extreme value points to be supplemented by comparing the sampling values of the left endpoint of the frame loss region and the first sampling point to the left of the left endpoint, the right endpoint of the frame loss region and the first sampling point to the right of the right endpoint;

[0155] a second determining unit, configured to determine a sampling value of the extreme point to be supplemented based on the left endpoint of the frame loss region, the nth sampling point to the left of the left endpoint, the n-1th sampling point to the left of the left endpoint, the right endpoint of the frame loss region, the mth sampling point to the right of the right endpoint, and the m-1th sampling point to the right of the right endpoint;

[0156] The third determining unit is configured to determine the number of sampling points to be supplemented in the lost frame area and the sampling value of each sampling point to be supplemented based on the magnitudes of the sampling values of the extreme point to be supplemented, the left endpoint of the lost frame area, the first sampling point to the left of the left endpoint, the right endpoint of the lost frame area, and the first sampling point to the right of the right endpoint.

[0157] It should be noted that the audio data transmission lost frame processing device in the embodiment of the present invention has the same beneficial effects as the audio data transmission lost frame processing method provided in the above embodiment, and for the specific introduction of the audio data transmission lost frame processing method involved in the embodiment of the present invention, please refer to the above embodiment. The present invention will not be repeated here.

[0158] Based on the above embodiment, the present invention further provides a system for processing lost frames in audio data transmission, the system comprising:

[0159] Memory for storing computer programs;

[0160] The processor is configured to implement the steps of the above-mentioned method for processing lost frames in audio data transmission when executing a computer program.

[0161] For example, the processor in an embodiment of the present invention is configured to determine a frame-dropped region of an audio signal; calculate, based on a first preset number of sampling points before the frame-dropped region and a second preset number of sampling points after the frame-dropped region, each sampling point to be supplemented in the frame-dropped region and a sampling value corresponding to each sampling point to be supplemented; and supplement the frame-dropped region based on each sampling point to be supplemented and each corresponding sampling value to obtain a supplemented audio signal.

[0162] Based on the above embodiment, an embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of the above-mentioned method for processing lost frames in audio data transmission are implemented.

[0163] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc., which can store program codes.

[0164] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Reference can be made to the common and similar parts between the various embodiments. For the devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the method description.

[0165] It should also be noted that, in this specification, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

[0166] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention is not limited to the embodiments shown herein but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for processing lost frames in audio data transmission, characterized in that: include: Determine the frame loss area of the audio signal; Calculating, based on the left and right endpoints of the frame drop region, a first preset number of sampling points located before the frame drop region, and a second preset number of sampling points located after the frame drop region, respective sampling points to be supplemented in the frame drop region and sampling values corresponding to respective sampling points to be supplemented; The frame loss area is supplemented according to each of the sampling points to be supplemented and their corresponding sampling values to obtain a supplemented audio signal; wherein: The process of calculating the sampling points to be supplemented in the frame dropped area and the sampling values corresponding to each sampling point to be supplemented based on the left and right endpoints of the frame dropped area, a first preset number of sampling points located before the frame dropped area, and a second preset number of sampling points located after the frame dropped area is as follows: Determine the number and type of extreme value points to be supplemented by comparing the left endpoint of the frame loss region, the first sampling point located to the left of the left endpoint, the right endpoint of the frame loss region, and the first sampling point located to the right of the right endpoint; Determine the sampling value of the extreme point to be supplemented based on the sampling values of the left endpoint of the frame loss region, the nth sampling point located to the left of the left endpoint, the n-1th sampling point located to the left of the left endpoint, the right endpoint of the frame loss region, the mth sampling point located to the right of the right endpoint, and the m-1th sampling point located to the right of the right endpoint; The number of sampling points to be supplemented in the lost frame area and the sampling value of each sampling point to be supplemented are determined based on the magnitudes of the sampling values of the extreme point to be supplemented, the left endpoint of the lost frame area, the first sampling point to the left of the left endpoint, the right endpoint of the lost frame area, and the first sampling point to the right of the right endpoint.

2. The method for processing lost frames in audio data transmission according to claim 1, wherein: The process of determining the number and type of extreme value points to be supplemented by comparing the left endpoint of the frame loss region, the first sampling point located to the left of the left endpoint, the right endpoint of the frame loss region, and the first sampling point located to the right of the right endpoint is as follows: When L A -L A1 <0,L B -L B1 When <0, there is one extreme point to be supplemented, and the type is a minimum point; When L A -L A1 <0, L B -L B1 >0, there are two extreme value points to be supplemented, of which the types are minimum point and maximum point respectively; When L A -L A1 >0,L B -L B1 >0, there is one extreme point to be supplemented, and the type is a maximum point; When L A -L A1 >0,L B -L B1 When <0, there are two extreme value points to be supplemented, which are of the maximum value point and the minimum value point respectively; Among them, L A represents the sampling value of the left endpoint of the frame loss area, L A1 Represents the sampling value of the first sampling point to the left of the left endpoint, L B represents the sampling value of the right endpoint of the frame loss area, L B1 Indicates the sample value of the first sampling point to the right of the right endpoint.

3. The method for processing lost frames in audio data transmission according to claim 2, wherein: The process of determining the sampling value of the to-be-supplemented extreme point based on the sampling values of the left endpoint of the frame-dropping region, the nth sampling point to the left of the left endpoint, the n-1th sampling point to the left of the left endpoint, the right endpoint of the frame-dropping region, the mth sampling point to the right of the right endpoint, and the m-1th sampling point to the right of the right endpoint is as follows: When there is only one extreme point to be supplemented and it is a minimum point: If L A(n-1) -L An >0, then Lmin=L A + (L A -L A(n-1) ); If L A(n-1) -L An <0, then Lmin=L A + (L A -L An ); where Lmin is the sampling value of the minimum point; When there are two extreme points to be supplemented, and from L A To L B When they are minimum and maximum points respectively: If L A(n-1) -L An >0, then Lmin=L A + (L A -L A(n-1) ); If L A(n-1) -L An <0, then Lmin=L A + (L A -L An ); If L B(m-1) -L Bm <0, then Lmax=L B + (L B -L B(m-1) ); If L B(m-1) -L Bm >0, then Lmax=L B + (L B -L Bm ); where Lmax is the sampling value of the maximum point; When there is only one extreme point to be supplemented and it is a maximum point: If L A(n-1) -L An <0, then Lmax=L A + (L A -L A(n-1) ); If L A(n-1) -L An >0, then Lmax=L A + (L A -L An ); When there are two extreme points to be supplemented, and from L A To L B When they are maximum and minimum points respectively: If L A(n-1) -L An <0, then Lmax= L A + (L A -L A(n-1) ); If L A(n-1) -L An >0, then Lmax= L A + (L A -L An ); If L B(m-1) -L Bm >0, then Lmin=L B + (L B -L B(m-1) ); If L B(m-1) -L Bm <0, then Lmin=L B + (L B -L Bm ); Where n is the first preset number, m is the second preset number, L An represents the sampling value of the nth sampling point to the left of the left endpoint, L A(n-1) represents the sampling value of the n-1th sampling point to the left of the left endpoint, L Bm represents the sampling value of the mth sampling point to the right of the right endpoint, L B(m-1) Represents the sampling value of the m-1th sampling point to the right of the right endpoint.

4. The method for processing lost frames in audio data transmission according to claim 3, wherein: The process of determining the number of sampling points to be supplemented in the frame-dropped area and the sampling value of each sampling point to be supplemented based on the extreme point to be supplemented, the left endpoint of the frame-dropped area, the first sampling point to the left of the left endpoint, the right endpoint of the frame-dropped area, and the first sampling point to the right of the right endpoint is as follows: When there is one extreme point to be supplemented and it is a minimum point: From L A The number of sampling points to be supplemented to Lmin is L P =(Lmin-L A ) / ( L A -L A1 ), and the sampling value of the pth sampling point to be supplemented is L A +p*L Astep , where L Astep = L A -L A1 ; From L B The number of sampling points to be supplemented to Lmin is L Q =(Lmin-L B ) / ( L B -L B1 ), and the sampling value of the qth sampling point to be supplemented is L B +q*L Bstep , where L Bstep = L B -L B1 ; When there are two extreme value points to be supplemented, and from L A To L B When they are minimum and maximum points respectively: From L A The number of sampling points to be supplemented to Lmin is L X =( L A -Lmin) / ( L A -L A1 ), and the sampling value of the xth sampling point to be supplemented is L A +x*L Astep Among them, L Astep = L A -L A1 ; The number of sampling points to be supplemented from Lmin to Lmax Y =(Lmax-Lmin) / ((|L A -L A1 |+|L B -L B1 |) / 2), and the sampling value of the yth sampling point to be supplemented is Lmin+y*L Ystep Among them, L Ystep =(|L A -L A1 |+|L B -L B1 |) / 2; From Lmax to L B The number of sampling points to be supplemented L Z =(Lmax-L B ) / ( L B -L B1 ), and the sampling value of the zth sampling point to be supplemented is Lmax+z*L Zstep , where L Zstep = L B1 -L B ; When there is only one extreme point to be supplemented and it is a maximum point: From L A The number of sampling points to be supplemented to Lmax P =(Lmax-L A ) / ( L A -L A1 ), and the sampling value of the pth sampling point to be supplemented is L A +p*L Astep , where L Astep = L A -L A1 ; From Lmax to L B The number of sampling points to be supplemented L Q =(Lmax-L B ) / ( L B -L B1 ), and the sampling value of the qth sampling point to be supplemented is Lmax-q*L Bstep , where L Bstep = L B -L B1 ; When there are two extreme points to be supplemented, and from L A To L B When they are maximum and minimum points respectively: From L A The number of sampling points to be supplemented to Lmax is L X =(Lmax - L A ) / ( L A -L A1 ), and the sampling value of the xth sampling point to be supplemented is L A +x*L Astep Among them, L Astep =L A -L A1 ; The number of sampling points to be supplemented from Lmax to Lmin is L Y =(Lmax-Lmin) / ((|L A -L A1 |+|L B -L B1 |) / 2), and the sampling value of the yth sampling point to be supplemented is Lmax-y*L Ystep Among them, L Ystep =(|L A -L A1 |+|L B -L B1 |) / 2; From Lmin to L B The number of sampling points to be supplemented L Z =(Lmin-L B ) / ( L B -L B1 ), and the sampling value of the zth sampling point to be supplemented is Lmin+z*L Zstep , where L Zstep = L B1 -L B .

5. The method for processing lost frames in audio data transmission according to any one of claims 3 to 4, characterized in that: The method for determining the first preset number is: The comparison starts from the first sampling point before the left endpoint of the frame loss area. A(n-1) -L An >0, determine the value of n and use the value as the first preset number; When there is no L within the preset threshold number A(n-1) -L An >0, the preset threshold value is used as the first preset number; The comparison starts from the first sampling point after the right endpoint of the frame loss area. B(m-1) -L Bm >0, determine the value of m and use the value as the second preset number; when L does not exist within the preset threshold number B(m-1) -L Bm >0, the preset threshold quantity is used as the second preset quantity.

6. A device for processing lost frames in audio data transmission, characterized in that: include: A determination module, configured to determine a frame loss area of the audio signal; a calculation module, configured to calculate, based on the left and right endpoints of the frame-dropped region, a first preset number of sampling points located before the frame-dropped region, and a second preset number of sampling points located after the frame-dropped region, respective sampling points to be supplemented in the frame-dropped region and a sampling value corresponding to each sampling point to be supplemented; A supplementing module is used to supplement the lost frame area according to each of the sampling points to be supplemented and their corresponding sampling values to obtain a supplemented audio signal; wherein: The calculation module includes: a first determining unit, configured to determine the number and type of extreme value points to be supplemented by comparing the sampling values of the left endpoint of the frame loss region and the first sampling point located to the left of the left endpoint, the right endpoint of the frame loss region and the first sampling point located to the right of the right endpoint; a second determining unit, configured to determine the sampling value of the to-be-supplemented extreme value point based on the left endpoint of the frame-dropping region, the nth sampling point to the left of the left endpoint, the n-1th sampling point to the left of the left endpoint, the right endpoint of the frame-dropping region, the mth sampling point to the right of the right endpoint, and the m-1th sampling point to the right of the right endpoint; A third determining unit is configured to determine the number of sampling points to be supplemented in the lost frame area and the sampling value of each sampling point to be supplemented based on the extreme point to be supplemented, the left endpoint of the lost frame area, the first sampling point to the left of the left endpoint, the right endpoint of the lost frame area, and the first sampling point to the right of the right endpoint.

7. A system for processing lost frames in audio data transmission, characterized in that: include: memory for storing computer programs; A processor, configured to implement the steps of the method for processing lost frames in audio data transmission as claimed in any one of claims 1 to 5 when executing the computer program.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the method for processing lost frames in audio data transmission according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Packet loss recovery method and device of audio data packet, electronic equipment and storage medium

    CN113838477A

  • Non-linear fitting method of restoring the envelope of vibrating pulse wave

    CN1608584A