Satellite channel high fault tolerance audio and video joint coding and decoding method

Abstract

The invention discloses a satellite channel high fault-tolerant audio and video joint coding and decoding method, which relates to the technical field of satellite audio and video coding and decoding, and comprises the following steps of: separating audio and video into audio data and video data, and then separating the audio data and the video data into audio frame data and video frame data; performing data extraction on the video frame data to obtain color value tables of the video frame data in different RGB channels; performing compression coding on the video frame data based on the color value table, and converting the video frame data into video codes; encoding the audio frame data, and converting the audio frame data into audio codes; combining the video code and the audio code into a code group based on the frame data, and transmitting and decoding the code group; the method is used for solving the problem that the existing satellite audio and video coding and decoding technology is difficult to carry out lossless compression on the video by using a high compression rate, so that sound and picture desynchrony is easily generated.

Description

Technical Field

[0001] This invention relates to the field of satellite audio and video encoding and decoding technology, specifically to a high-fault-tolerant joint audio and video encoding and decoding method for satellite channels. Background Technology

[0002] Satellite audio and video encoding and decoding technology refers to a complete set of algorithms and technical solutions used for compressing, encoding, decompressing, and decoding audio and video data in satellite communication channels.

[0003] Existing satellite audio and video encoding / decoding technologies typically employ independent encoding and transmission of audio and video. This often results in audio-visual asynchrony after decoding. Furthermore, while both audio and video need compression during encoding, current satellite audio and video encoding / decoding technologies still retain significant redundant data during video compression. The larger the data volume, the higher the probability of transmission errors. Achieving even less data inevitably leads to video distortion, i.e., lossy compression. Existing satellite audio and video encoding / decoding technologies typically employ lossy compression... Compression involves encoding and decoding audio and video. For example, patent application CN116419009A discloses an "audio and video encoding and decoding method, apparatus, device and storage medium". However, this solution does not mention the specific encoding technology or process for audio and video. If lossy compression technology is used, it will lead to video distortion. If lossless compression technology is used, it will lead to an excessively low compression ratio, and the probability of bit errors during transmission will be greater. Existing satellite audio and video encoding and decoding technologies also have the problem of difficulty in using high compression ratios for lossless compression of video, which easily leads to audio and video desynchronization. Summary of the Invention

[0004] This invention aims to at least partially solve one of the technical problems in the prior art. It separates audio and video data into audio data and video data, and then further separates the audio and video data into frame data, which includes audio frame data and video frame data. The video frame data is then extracted to obtain color value tables in different RGB channels. These color value tables are then compressed and encoded to obtain single-frame encoding. Based on this single-frame encoding, the color value tables in adjacent video frame data are compressed and encoded to obtain video encoding. The audio frame data is then encoded to convert it into audio encoding. Finally, the video encoding and audio encoding are combined into a coding group based on the frame data and transmitted. After transmission, the coding group is decoded. This addresses the problem that existing satellite audio and video encoding and decoding technologies struggle to achieve lossless compression of video at high compression rates, leading to audio-visual asynchrony.

[0005] To achieve the above objectives, this application provides a satellite channel high-fault-tolerant audio and video joint encoding and decoding method, comprising the following steps: The audio and video data are separated into audio data and video data, and then the audio data and video data are separated into frame data, wherein the frame data includes audio frame data and video frame data. Extract data from video frame data to obtain color value tables for different RGB channels of the video frame data; The video frame data is compressed and encoded based on the color value table, converting the video frame data into video encoding. Encode the audio frame data, converting the audio frame data into audio encoding; Based on frame data, video and audio encodings are combined into a single encoding group for transmission and decoding.

[0006] Further, separating audio and video into audio data and video data, and then separating the audio data and video data into frame data, includes the following sub-steps: Audio extraction technology is used to extract audio from audio and video to obtain audio data, and then the video in the audio and video is saved as video data; Extract the image of each frame from the video data to obtain video frame data; Based on the frame rate of the audio and video, the audio data is divided into several frames to obtain audio frame data; Video and audio frames are numbered sequentially according to their order, and are identified by the symbol VFD. h and AFD h Where h is a non-zero natural number and h is the index of VFD and AFD, the VFD h With the AFD h Correspondingly.

[0007] Further, data extraction of the video frame data to obtain the color value table of the video frame data in different RGB channels includes the following sub-steps: The RGB channels include the R channel, G channel, and B channel; Obtain the color value tables of the video frame data in the R, G, and B channels, and name them R color value table, G color value table, and B color value table, respectively.

[0008] Furthermore, compressing and encoding the video frame data based on the color value table, and converting the video frame data into video encoding, includes the following sub-steps: The color value table in the same video frame data is compressed and encoded to obtain a single frame code; The video code is obtained by compressing and encoding the color value tables in adjacent video frame data based on single-frame encoding.

[0009] Furthermore, compressing and encoding the color value table in the same video frame data includes the following sub-steps: When compressing and encoding the same video frame data, it is named the processing frame data. The color value table records the color value of each pixel. When analyzing any color value table of the processing frame data, it is named the processing table. The color values ​​from each row of the processing table are used to form a string of numbers from left to right. The string of numbers in the i-th row is then labeled as NU from top to bottom. i , will NU i The j-th digit in the array is labeled C(i,j), where i and j are both positive integers and i is the index of NU, and (i,j) is the index of C. For any odd value of i, label C(i,j) as CP(i,n) and C(i+1,j) as CP(i+1,m), where n and m both belong to j; Set a displacement coefficient, labeled E, which is initially 0. Starting with m = i + E, place CP(i,n) on top of CP(i+1,m). At this time, CP(i,n) and CP(i+1,m) are considered to have the same number of digits. If CP(i,n) and CP(i+1,m) are equal, output a signal indicating equality at the same position; otherwise, output a signal indicating inequality at the same position. Label the signals at CP(i+1,m) as T. m and F m ; For T m Perform statistics and select the adjacent T values ​​of m. m Divide into a colophon group and count the T values ​​in the colophon group. m The number of CP(i+1,m) corresponding to the equivalence is named as the equivalence of the same position. The number string formed by CP(i+1,m) corresponding to the equivalence of the same position in ascending order of m is named as the equivalence of the same position number string. Add one to E and reanalyze the same-position equal quantities and the same-position equal number strings until max(j)-1 is reached. max() is the maximum value operator. Find the maximum value among the equal numbers in the same position and mark it as the maximum equal number. Mark the equal number string in the same position corresponding to the maximum equal number as the best equal number string. Construct a reference encoding table, which is used to store single-unit codes and best equal number strings. The single-unit code is an arbitrary code that occupies only one byte. Check if the best equal number string has a single-unit code in the reference encoding table. If it does, replace the best equal number string in CP(i,n) and CP(i+1,m) with the single-unit code. If not, create a new single-unit code and associate it with the best equal number string. Enter the single-unit code and the best equal number string into the reference encoding table. The single-frame encoding is obtained by analyzing all C(i,j).

[0010] Furthermore, the compression encoding of the color value table in adjacent video frame data based on single-frame encoding includes the following sub-steps: VFD h C(i,j) is labeled as CV h (i,j), Analyze CV h (i,j) and CV h+1 All identical number strings in (i,j) are composed of a group C(i,j) consisting of consecutive adjacent j. If two identical number strings do not have the same j, they are combined into a continuation group. Set continuous encoding, CV h+1 In (i,j), all identical number strings belonging to the continuation group are replaced with continuation codes; VFD h After the continuation encoding replacement is completed, VFD will be analyzed. h The single-frame encoding ultimately yields the VFD. h In video encoding, the continuous encoding of each frame of video data is the same, but the reference encoding table for each frame of video encoding is independent.

[0011] Furthermore, the encoding of the audio frame data specifically involves encoding the audio frame data using audio encoding technology to obtain audio encoding.

[0012] Furthermore, combining video and audio encoding into a single encoding group based on frame data and then transmitting and decoding it includes the following sub-steps: Based on frame data, video and audio codes are combined into a single code group and transmitted. The encoded group is decoded after transmission.

[0013] Furthermore, combining video and audio encodings into a single encoding group based on frame data and transmitting it includes the following sub-steps: VFD h With AFD h Video and audio encodings are integrated into a single encoding group, denoted as F. h ; The encoded groups are transmitted in ascending order of h.

[0014] Furthermore, decoding the encoded group after transmission includes the following sub-steps: The audio code is decoded by a decoding program, and the video code is decoded by referring to the encoding table of the video code, so as to obtain audio frame data and video frame data. According to F h The video frame data and audio frame data are combined in ascending order of h to obtain lossless audio and video data.

[0015] The beneficial effects of this invention are as follows: This invention separates audio and video into audio data and video data, and then further separates the audio data and video data into frame data, wherein the frame data includes audio frame data and video frame data. Then, data extraction is performed on the video frame data to obtain the color value tables of the video frame data in different RGB channels. The color value tables in the same video frame data are compressed and encoded to obtain single-frame encoding. Based on the single-frame encoding, the color value tables in adjacent video frame data are then compressed and encoded to obtain video encoding. The advantage is that the compression encoding method used in this invention can convert multi-byte data in video frame data into single-byte data to the maximum extent. Furthermore, the compression also considers the color change relationship between adjacent frame images. If the color does not change, the video frame data can be further compressed. The compression is lossless and has a higher compression ratio than existing lossless compression technologies, thus improving the effectiveness of satellite audio and video encoding and decoding. This invention encodes audio frame data, converts the audio frame data into audio code, and then combines the video code and audio code into a code group based on the frame data for transmission. Finally, the code group is decoded after transmission. The advantage is that by combining the audio code and video code according to the frame number, it ensures that the video frame data and audio frame data of each frame can be accurately matched, further improving the effectiveness of satellite audio and video encoding and decoding. Attached Figure Description

[0016] Figure 1 This is a flowchart illustrating the steps of the method of the present invention; Figure 2 This is a schematic diagram of the isodigitation of the displacement coefficient E=0 of the present invention; Figure 3 This is a schematic diagram of the same number of displacement coefficients when E=1 according to the present invention; Figure 4 This is a schematic diagram of the electronic device of the present invention. Detailed Implementation

[0017] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] Example 1, please refer to Figure 1 As shown, this application provides a satellite channel high-fault-tolerant audio and video joint encoding and decoding method, including the following steps: Step S1 involves separating the audio and video data into audio data and video data, and then further separating the audio data and video data into frame data, which includes audio frame data and video frame data. Step S1 includes the following sub-steps: Step S101: Extract audio from audio and video using audio extraction technology to obtain audio data, and then save the video from audio and video as video data; Step S102: Extract the image of each frame from the video data to obtain video frame data; Step S103: Divide the audio data into several frames based on the number of audio and video frames to obtain audio frame data; Step S104: Number the video frame data and audio frame data according to the order of the frames, and use the symbol VFD respectively. h and AFD h Where h is a non-zero natural number and h is the index of VFD and AFD, VFD h With AFD h Correspondingly; In practice, existing audio extraction techniques are used to separate the audio and video data, resulting in audio and video data. Since the extracted video data consists of 60 frames per second (60 images played per second), each image represents a video frame, meaning there are 60 video frame data per second. Simultaneously, the audio data within one second is divided into 60 audio frame data, corresponding one-to-one with the video frame data according to the frame order. That is, when h is equal, AFD... h and VFD h This refers to audio and video frame data that need to be played simultaneously.

[0019] Step S2 involves extracting data from the video frame data to obtain the color value table of the video frame data in different RGB channels; Step S2 includes the following sub-steps: Step S201, the RGB channel includes the R channel, G channel and B channel; Step S202: Obtain the color value tables of the video frame data in the R channel, G channel and B channel, and name them R color value table, G color value table and B color value table respectively; In specific implementation, color images are transmitted in three RGB channels. RGB channels are existing technical terms and will not be explained in detail in this embodiment. The color value table records the color value of each pixel in the corresponding RGB channel. The row and column of the pixel in the video frame data is the row and column of its color value in the color value table.

[0020] Step S3 involves compressing and encoding the video frame data based on the color value table, converting the video frame data into video encoding. Step S3 includes the following sub-steps: Step S301: Compress and encode the color value table in the same video frame data to obtain single-frame encoding; Step S301 includes the following sub-steps: Step S301.1: When compressing and encoding the same video frame data, name it as processing frame data. The color value table records the color value of each pixel. When analyzing any color value table of the processing frame data, name it as processing table. Step S301.2: Assemble a string of numbers from the color values ​​of each row in the processing table, from left to right; and mark the string of numbers in the i-th row as NU, from top to bottom. i , will NU i The j-th digit is labeled C(i,j), where i and j are both positive integers and i is the index of NU, and (i,j) is the index of C; In practice, due to the excessive amount of data in the complete processing table, it cannot be fully demonstrated in this embodiment. Therefore, this embodiment only uses a portion of the data as an example to illustrate the processing of video frame data; for example, the processing table is shown in Table 1 below: Table 1 Processing Table ; Then NU1 is 156142133130128, NU2 is 159150144130129, and NU3 is 14314113913599. The range of j in each row is not the same. For example, NU1 has 15 digits, so in the corresponding C(i,j) of NU1, 1≤j≤15. NU3 has 14 digits, so in the corresponding C(i,j) of NU3, 1≤j≤14. The numbers are C(1,1) to C(1,15), C(2,1) to C(2,15), and C(3,1) to C(3,14).

[0021] Step S301.3: For any odd value of i, mark C(i,j) as CP(i,n) and C(i+1,j) as CP(i+1,m), where n and m both belong to j; Step S301.4: Set the displacement coefficient, marked as E, with E initially set to 0. Starting with m = i + E, place CP(i,n) on top of CP(i+1,m). At this point, CP(i,n) and CP(i+1,m) are considered to have the same number of digits. In practice, the analysis is performed for any odd value of i. For example, when i=1, CP(i,n) and CP(i+1,m) are C(1,j) and C(2,j). When i=2, since C(2,j) has already been analyzed with C(1,j), it is skipped. The analysis is performed for i=3, that is, only odd values ​​are analyzed. Taking i=1 as an example, there are CP(1,n) and CP(2,m). The number of identical digits when the displacement coefficient E=0 is as follows: Figure 2 As shown, the number of isodigits when the displacement coefficient E=1 is as follows Figure 3 As shown, this essentially means shifting CP(i+1,m) forward by one position, and treating CP(i,n) and CP(i+1,m) in the same column as having the same number of positions.

[0022] Step S301.5: If CP(i,n) and CP(i+1,m) are equal, output a signal indicating equal positions; otherwise, output a signal indicating unequal positions. Label the signals at CP(i+1,m) as T. m and F m ; Step S301.6, for T m Perform statistics and select the adjacent T values ​​of m. m Divide into a colophon group and count the T values ​​in the colophon group. m The number of CP(i+1,m) corresponding to the equivalence is named as the equivalence of the same position. The number string formed by CP(i+1,m) corresponding to the equivalence of the same position in ascending order of m is named as the equivalence of the same position number string. Step S301.7: Add one to E and reanalyze the same digit equal quantity and the same digit equal number string until max(j)-1 is reached. max() is the maximum value operator. In specific implementation, Figure 2 For example, Figure 2 In this case, CP(1,1) and CP(2,1) are both 1, meaning CP(1,1) and CP(2,1) are equal, and the output signal is equal at the same position. At this point, CP(2,1) is T1. Analyzing CP(1,2) and CP(2,2) further yields T2. Then, analyzing CP(1,3) and CP(2,3), we find that CP(1,3) and CP(2,3) are not equal, and the output signal is unequal at the same position, thus yielding F3. T3 does not exist. Analyzing each group of equal positions, we finally obtain T1, T2, T4, T7, and T... 10 T 11 T 12 T 13 And T 14 Among them, T1 and T2 are adjacent, T4 is independent, T7 is independent, and T... 10 T 11 T 12 T 13 And T14 Adjacent pairs yield four pairs of identical numbers, with identical numbers being 2, 1, 1, and 5, and corresponding identical number strings being 15, 1, 1, and 13012. E is incremented by one and the analysis is repeated until max(j)-1 is reached, ultimately yielding different identical numbers and identical number strings. In max(j)-1, j usually refers to m.

[0023] Step S301.8: Obtain the maximum value among the equal values ​​in the same position, mark it as the maximum equal value, and mark the equal number string in the same position corresponding to the maximum equal value as the best equal number string; Step S301.9: Construct a reference code table. The reference code table is used to store single-unit codes and the best equal number string. The single-unit code is an arbitrary code that occupies only one byte. Check if the best equal number string has a single-unit code in the reference code table. If it does, replace the best equal number string in CP(i,n) and CP(i+1,m) with the single-unit code. If not, create a new single-unit code and associate it with the best equal number string. Enter the single-unit code and the best equal number string into the reference code table. Step S301.10: After analyzing all C(i,j), a single frame code is obtained; In practice, the maximum number of equalities obtained is 5, so the optimal equality string is 13012. A reference encoding table is constructed, as shown in Table 2 below: Table 2. Coding Table ; The single-character encoding is actually any single character in the single-byte character set. Since there is no single-character encoding in the target lookup encoding table, a character is randomly selected from the byte character set as the single-character encoding of the optimal equal-number string, and the lookup encoding table is updated. The lookup encoding table is shown in Table 3 below: Table 3. Coding Table ; In Tables 2 and 3, empty cells represent cells where no single-unit code or best equality string was entered; these are empty values. Replacing the best equality strings in CP(i,n) and CP(i+1,m) with single-unit codes essentially means replacing all NU values ​​with single-unit codes. i Replace 13012 with A, and finally compress NU1 and NU2 into 156142133A8 and 159150144A9. If 13012 also exists in NU3, it can also be replaced. After the replacement, add i+2 and analyze the next group CP(i,n) and CP(i+1,m). For example, when analyzing CP(3,n) and CP(4,m), it is found that the best equal number string is 14 and the single-character encoding is B. Then all NUs are replaced. iReplacing 14 with B, we get NU1 as 156B2133A8, NU2 as 159150B4A9, NU3 as B3B113913599, and so on. If we apply this to all NUs... i If there are still remaining characters in the single-byte character set after the analysis is completed, it can be analyzed again until only one character remains in the single-byte character set. The remaining one character is used to construct the continuation code. The continuation code of each video frame data is the same, that is, the video frame data uses the same continuation code.

[0024] Step S302: Based on single-frame encoding, the color value tables in adjacent video frame data are compressed and encoded to obtain the video code; Step S302 includes the following sub-steps: Step S302.1, VFD h C(i,j) is labeled as CV h (i,j), Analyze CV h (i,j) and CV h+1 All identical number strings in (i,j) are composed of a group C(i,j) consisting of consecutive adjacent j. If two identical number strings do not have the same j, they are combined into a continuation group. Step S302.2, set the continuation encoding, and set the CV. h+1 In (i,j), all identical number strings belonging to the continuation group are replaced with continuation codes; Step S302.3, VFD h After the continuation encoding replacement is completed, VFD will be analyzed. h The single-frame encoding ultimately yields the VFD. h In video encoding, the continuous encoding of each frame of video data is the same, but the reference encoding table for each frame of video encoding is independent. In practice, if the color value of the same pixel remains unchanged in the video frame data of two consecutive frames, this data can be omitted. For example, in this embodiment, the NU1 in the video frame data of the first frame is 156142133130128, and the NU1 in the video frame data of the second frame is also 156142133130128, which means that the pixel in the first row has not changed. Assuming the continuation encoding is X, the NU1 in the video frame data of the second frame can be directly changed to X. If X is found during decoding, the pixel corresponding to the video frame data of the previous frame is used. The continuation encoding of each row is replaced, and then the individual encoding of the video frame data itself is analyzed to finally obtain the video encoding. In this way, a large number of bytes can be saved. Moreover, since the video encoding does not discard any information in the data, lossless compression can also be achieved.

[0025] Step S4: Encode the audio frame data, converting the audio frame data into audio encoding; encode the audio frame data using audio encoding technology to obtain the audio encoding; In practice, existing audio encoding techniques can be used to encode the audio frame data, and this embodiment will not provide further details.

[0026] Step S5 involves combining the video and audio codes into a single encoding group based on the frame data, and then transmitting and decoding it. Step S5 includes the following sub-steps: Step S501: Based on the frame data, combine the video encoding and audio encoding into a set of encoding groups and transmit them; Step S501 includes the following sub-steps: Step S501.1, VFD h With AFD h Video and audio encodings are integrated into a single encoding group, denoted as F. h ; Step S501.2: Transmit the code groups in ascending order of h; In practice, video and audio encoding are combined and transmitted frame by frame, which ensures that each frame of the video corresponds to the audio. Even if some audio is missing, the rest of the audio will not be affected, and audio and video will always be synchronized.

[0027] Step S502: Decode the encoding group after transmission; Step S502 includes the following sub-steps: Step S502.1: Decode the audio code using a decoding program, and simultaneously decode the video code using a lookup table of the video code, to obtain audio frame data and video frame data. Step S502.2, according to F h The video frame data and audio frame data are combined in ascending order of h to obtain lossless audio and video data. In practice, the decoding program is the reverse of the encoding process, so this embodiment will not be described in detail.

[0028] Example 2, please refer to Figure 4 As shown, Figure 4A schematic diagram of an electronic device is provided, which may include a processor, a communication interface, a memory, and a communication bus. The processor, communication interface, and memory communicate with each other via the communication bus. The memory stores computer-readable instructions, which the processor can call. When the processor executes a computer-readable instruction, it performs steps similar to those in a satellite channel high-fault-tolerant audio-video joint encoding and decoding method to achieve the following functions: separating audio and video into audio data and video data, and further separating the audio and video data into audio frame data and video frame data; extracting data from the video frame data to obtain color value tables for different RGB channels; compressing and encoding the video frame data based on the color value tables to convert the video frame data into video encoding; encoding the audio frame data to convert the audio frame data into audio encoding; and combining the video encoding and audio encoding into a set of encodings based on the frame data for transmission and decoding.

[0029] Furthermore, the logical instructions in the aforementioned memory can be implemented as software functional units and sold or used as independent products, and can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0030] Example 3: This application also provides a computer program product, which includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute a satellite channel high-fault-tolerant audio and video joint encoding and decoding method provided by the above methods. The method includes: separating audio and video into audio data and video data, and then separating the audio data and video data into audio frame data and video frame data; extracting data from the video frame data to obtain color value tables of the video frame data in different RGB channels; compressing and encoding the video frame data based on the color value tables to convert the video frame data into video encoding; encoding the audio frame data to convert the audio frame data into audio encoding; and combining the video encoding and audio encoding into a set of encoding groups based on the frame data for transmission and decoding.

[0031] Example 4: This application also provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program performs the steps of the above-described satellite channel high-fault-tolerant audio-video joint encoding and decoding method to achieve the following functions: separating audio and video into audio data and video data, and then separating the audio data and video data into audio frame data and video frame data; extracting data from the video frame data to obtain color value tables for the video frame data in different RGB channels; compressing and encoding the video frame data based on the color value tables to convert the video frame data into video encoding; encoding the audio frame data to convert the audio frame data into audio encoding; and combining the video encoding and audio encoding into a set of encoding groups based on the frame data for transmission and decoding.

[0032] Based on the above description of the embodiments, the embodiments of the present invention can be provided as methods, systems, or computer program products. Based on this understanding, the above technical solutions, in essence or in terms of their contribution to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or certain parts of the embodiments.

[0033] In the embodiments provided in this application, it should be understood that the disclosed system or method can be implemented in other ways. The embodiments described above are merely illustrative. For example, the division of modules or units is only a logical functional division, and there may be other division methods in actual implementation. Furthermore, multiple modules or units may be combined or integrated into another system, or some features may be ignored or not executed. Additionally, the coupling or direct coupling or communication connection shown or discussed may be through some communication interfaces. The indirect coupling or communication connection between systems, modules, and units may be electrical, mechanical, or other forms.

[0034] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A high-fault-tolerant audio and video joint encoding and decoding method for satellite channels, characterized in that, Includes the following steps: The audio and video data are separated into audio data and video data, and then the audio data and video data are separated into frame data, wherein the frame data includes audio frame data and video frame data. Extract data from video frame data to obtain color value tables for different RGB channels of the video frame data; The video frame data is compressed and encoded based on the color value table, converting the video frame data into video encoding. Encode the audio frame data, converting the audio frame data into audio encoding; Based on frame data, video and audio encodings are combined into a single encoding group for transmission and decoding.

2. The satellite channel high-fault-tolerant audio and video joint encoding and decoding method according to claim 1, characterized in that, Separating audio and video into audio data and video data, and then separating the audio data and video data into frame data, includes the following sub-steps: Audio extraction technology is used to extract audio from audio and video to obtain audio data, and then the video in the audio and video is saved as video data; Extract the image of each frame from the video data to obtain video frame data; Based on the frame rate of the audio and video, the audio data is divided into several frames to obtain audio frame data; Video and audio frames are numbered sequentially according to their order, and are identified by the symbol VFD. h and AFD h Where h is a non-zero natural number and h is the index of VFD and AFD, the VFD h With the AFD h Correspondingly.

3. The satellite channel high-fault-tolerant audio and video joint encoding and decoding method according to claim 2, characterized in that, Extracting video frame data and obtaining color value tables for different RGB channels involves the following sub-steps: The RGB channels include the R channel, G channel, and B channel; Obtain the color value tables of the video frame data in the R, G, and B channels, and name them R color value table, G color value table, and B color value table, respectively.

4. The satellite channel high-fault-tolerant audio and video joint encoding and decoding method according to claim 3, characterized in that, Compression encoding of video frame data based on a color value table, converting video frame data into video encoding includes the following sub-steps: The color value table in the same video frame data is compressed and encoded to obtain a single frame code; The video code is obtained by compressing and encoding the color value tables in adjacent video frame data based on single-frame encoding.

5. A satellite channel high-fault-tolerant audio and video joint encoding and decoding method according to claim 4, characterized in that, Compressing and encoding the color value table in the same video frame data includes the following sub-steps: When compressing and encoding the same video frame data, it is named the processing frame data. The color value table records the color value of each pixel. When analyzing any color value table of the processing frame data, it is named the processing table. The color values ​​from each row of the processing table are used to form a string of numbers from left to right. The string of numbers in the i-th row is then labeled as NU from top to bottom. i , will NU i The j-th digit is labeled C(i,j), where i and j are both positive integers and i is the index of NU, and (i,j) is the index of C; For any odd value of i, label C(i,j) as CP(i,n) and C(i+1,j) as CP(i+1,m), where n and m both belong to j; Set a displacement coefficient, labeled E, which is initially 0. Starting with m = i + E, place CP(i,n) on top of CP(i+1,m). At this time, CP(i,n) and CP(i+1,m) are considered to have the same number of digits. If CP(i,n) and CP(i+1,m) are equal, output a signal indicating equality at the same position; otherwise, output a signal indicating inequality at the same position. Label the signals at CP(i+1,m) as T. m and F m ; For T m Perform statistics and select the adjacent T values ​​of m. m Divide into a colophon group and count the T values ​​in the colophon group. m The number of CP(i+1,m) corresponding to the equivalence is named as the equivalence of the same position. The number string formed by CP(i+1,m) corresponding to the equivalence of the same position in ascending order of m is named as the equivalence of the same position number string. Add one to E and reanalyze the same-position equal quantities and the same-position equal number strings until max(j)-1 is reached. max() is the maximum value operator. Find the maximum value among the equal numbers in the same position and mark it as the maximum equal number. Mark the equal number string in the same position corresponding to the maximum equal number as the best equal number string. Construct a reference encoding table, which is used to store single-unit codes and best equal number strings. The single-unit code is an arbitrary code that occupies only one byte. Check if the best equal number string has a single-unit code in the reference encoding table. If it does, replace the best equal number string in CP(i,n) and CP(i+1,m) with the single-unit code. If not, create a new single-unit code and associate it with the best equal number string. Enter the single-unit code and the best equal number string into the reference encoding table. The single-frame encoding is obtained by analyzing all C(i,j).

6. A satellite channel high-fault-tolerant audio and video joint encoding and decoding method according to claim 5, characterized in that, Compression encoding of color value tables in adjacent video frame data based on single-frame coding includes the following sub-steps: VFD h C(i,j) is labeled as CV h (i,j), Analyze CV h (i,j) and CV h+1 All identical number strings in (i,j) are composed of a group C(i,j) consisting of consecutive adjacent j. If two identical number strings do not have the same j, they are combined into a continuation group. Set continuous encoding, CV h+1 In (i,j), all identical number strings belonging to the continuation group are replaced with continuation codes; VFD h After the continuation encoding replacement is completed, VFD will be analyzed. h The single-frame encoding ultimately yields the VFD. h In video encoding, the continuous encoding of each frame of video data is the same, but the reference encoding table for each frame of video encoding is independent.

7. A satellite channel high-fault-tolerant audio and video joint encoding and decoding method according to claim 6, characterized in that, The encoding of audio frame data specifically involves encoding the audio frame data using audio encoding technology to obtain audio encoding.

8. A satellite channel high-fault-tolerant audio and video joint encoding and decoding method according to claim 7, characterized in that, Combining video and audio encodings into a single encoding group based on frame data for transmission and decoding includes the following sub-steps: Based on frame data, video and audio codes are combined into a single code group and transmitted. The encoded group is decoded after transmission.

9. A satellite channel high-fault-tolerant audio and video joint encoding and decoding method according to claim 8, characterized in that, Combining video and audio encodings into a single encoded block for transmission based on frame data includes the following sub-steps: VFD h With AFD h Video and audio encodings are integrated into a single encoding group, denoted as F. h ; The encoded groups are transmitted in ascending order of h.

10. A satellite channel high-fault-tolerant audio and video joint encoding and decoding method according to claim 9, characterized in that, Decoding the encoded group after transmission includes the following sub-steps: The audio code is decoded by a decoding program, and the video code is decoded by referring to the encoding table of the video code, so as to obtain audio frame data and video frame data. According to F h The video frame data and audio frame data are combined in ascending order of h to obtain lossless audio and video data.

Images