Satellite channel high fault-tolerant audio and video joint coding method

Abstract

The application discloses a kind of satellite channel high fault-tolerant audio and video joint coding and decoding method, it is related to satellite audio and video coding and decoding technical field, including the following steps: separating audio and video into audio data and video data, then audio data and video data are separated into audio frame data and video frame data;Video frame data is extracted, and the color value table of video frame data in different RGB channels is obtained;Video frame data is compressed and encoded based on the color value table, and video frame data is converted into video encoding;Audio frame data is encoded, and audio frame data is converted into audio encoding;Video encoding and audio encoding are combined into a group of encoding groups based on frame data and transmitted and decoded;The application is used to solve the problem that the existing satellite audio and video coding and decoding technology still exists difficult to use high compression ratio to lossless compression of video, leading to easy to produce audio and picture out of sync.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of satellite audio and video coding, in particular to a satellite channel high fault-tolerant audio and video joint coding method. BACKGROUND

[0002] Satellite audio and video coding technology refers to a complete set of algorithms and technical solutions for compressing and encoding audio and video data and decompressing and decoding.

[0003] The existing satellite audio and video coding technology usually adopts the mode of independent encoding and independent transmission of audio and video, and the phenomenon of audio and video out of sync is easy to occur after decoding. At the same time, in the encoding process, the audio and video need to be compressed, and the existing satellite audio and video coding technology still has a lot of redundant data when compressing the video. The larger the data volume, the higher the probability of error code in the transmission process. If you want to achieve less data volume, it will inevitably cause distortion of the video, i.e. lossy compression. The existing satellite audio and video coding technology usually adopts lossy compression to encode and decode audio and video. For example, in the patent application with the publication number CN116419009A, an "audio and video coding method, device, equipment and storage medium" is disclosed. The scheme does not mention the specific coding technology or the coding process of audio and video. If lossy compression technology is used, it will cause video distortion. If lossless compression technology is used, it will result in too low compression rate, and the probability of error code in the encoding transmission process will be higher. The existing satellite audio and video coding technology also has the problem of being difficult to use high compression rate for lossless compression of video, which leads to easy audio and video out of sync. SUMMARY

[0004] The present application aims to at least solve one of the technical problems in the prior art. By separating audio and video into audio data and video data, and then separating the audio data and video data into frame data, the frame data includes audio frame data and video frame data, then performing data extraction on the video frame data to obtain the color value table of the video frame data in different RGB channels, compressing and encoding the color value table in the same video frame data to obtain single frame encoding, then based on the single frame encoding, compressing and encoding the color value table in the adjacent video frame data to obtain video encoding, then encoding the audio frame data to convert the audio frame data into audio encoding, then based on the frame data, combining the video encoding and the audio encoding into a group of encoding groups and transmitting, and finally decoding the encoding groups after transmission, the problem of being difficult to use high compression rate for lossless compression of video in the existing satellite audio and video coding technology, which leads to easy audio and video out of sync, is solved.

[0005] To achieve the above object, the application provides a satellite channel high fault-tolerant audio and video joint coding method, comprising the following steps:

[0006] Separating the audio and video into audio data and video data, and then separating the audio data and video data into frame data, wherein the frame data comprises audio frame data and video frame data;

[0007] Extracting data from the video frame data to obtain a color value table of the video frame data in different RGB channels;

[0008] Compressing and encoding the video frame data based on the color value table to convert the video frame data into video encoding;

[0009] Encoding the audio frame data to convert the audio frame data into audio encoding;

[0010] Combining the video encoding and the audio encoding into a group of encoding groups based on the frame data and transmitting and decoding the group of encoding groups.

[0011] Further, separating the audio and video into audio data and video data, and then separating the audio data and video data into frame data comprises the following sub-steps:

[0012] Extracting the audio in the audio and video through an audio extraction technology to obtain audio data, and saving the video in the audio and video as video data;

[0013] Extracting the image of each frame in the video data to obtain video frame data;

[0014] Dividing the audio data into frame data based on the number of frames of the audio and video to obtain audio frame data;

[0015] Numbering the video frame data and the audio frame data in the order of frames, and respectively using symbols VFD h and AFD h , wherein h is a non-zero natural number and h is the serial number of VFD and AFD, the VFD h corresponds to the AFD h .

[0016] Further, extracting data from the video frame data to obtain a color value table of the video frame data in different RGB channels comprises the following sub-steps:

[0017] The RGB channel comprises an R channel, a G channel and a B channel;

[0018] Obtaining the color value table of the video frame data on the R channel, the G channel and the B channel, respectively named as R color value table, G color value table and B color value table.

[0019] Further, the color value table is compressed and encoded based on a color value table, and the video frame data is converted into a video code, which comprises the following sub-steps:

[0020] The color value table in the same video frame data is compressed and encoded to obtain a single frame code.

[0021] The color value table in adjacent video frame data is compressed and encoded based on the single frame code to obtain a video code.

[0022] Further, the color value table in the same video frame data is compressed and encoded, which comprises the following sub-steps:

[0023] When the same video frame data is compressed and encoded, it is named as processing frame data, and the color value table records the color value of each pixel point. When any color value table of the processing frame data is analyzed, it is named as processing table.

[0024] A string of digital strings is composed of the color values of each row in the processing table in the order from left to right, and the digital string of the i-th row is marked as NU i , wherein i and j are positive integers, i is the serial number of NU, and (i, j) is the serial number of C. i

[0025] For any odd value of i, C(i, j) is marked as CP(i, n), and C(i+1, j) is marked as CP(i+1, m), wherein n and m belong to j.

[0026] A displacement coefficient is set, which is marked as E, and E is initially 0. Starting from m=i+E, CP(i, n) is placed above CP(i+1, m), and at this time CP(i, n) and CP(i+1, m) are considered as the same digit.

[0027] If CP(i, n) and CP(i+1, m) are equal, output the same digit equal signal, otherwise output the same digit unequal signal. The same digit equal signal and the same digit unequal signal output at CP(i+1, m) are marked as T m and F m , respectively.

[0028] T m is counted, and m adjacent T m is divided into a group of same digit groups. The number of T m in the same digit group is named as same digit amount, and the digital string composed of CP(i+1, m) in the order from small to large according to m is named as same digit number string.

[0029] ​E is added one by one and the same parity and parity string is reanalyzed until max(j)-1 is reached, max() is the maximum operator;

[0030] The maximum value in the same parity is obtained, marked as the maximum parity, and the same parity string corresponding to the maximum parity is marked as the best parity string;

[0031] A control code table is constructed for storing monomer codes and the best parity string, the monomer code is any code occupying only one byte, and it is found whether the best parity string has a monomer code in the control code table, if yes, the best parity string in CP(i,n) and CP(i+1,m) is replaced by the monomer code, if not, a monomer code is newly created and associated with the best parity string, and the monomer code and the best parity string are entered into the control code table;

[0032] After analyzing all C(i,j), a single frame code is obtained.

[0033] Further, the color value table in the adjacent video frame data is compressed and encoded based on the single frame code, including the following sub-steps:

[0034] The C(i,j) in VFD h is marked as CV h (i,j), and all parity strings of CV h (i,j) and CV h+1 (i,j) are analyzed, each parity string is composed of a group of j consecutive adjacent C(i,j), if two parity strings do not have the same j, they are integrated into a group of continuation groups;

[0035] The continuation code is set, and all parity strings in CV h+1 (i,j) belonging to the continuation group are replaced by the continuation code;

[0036] After the replacement of the continuation code in VFD h is completed, the single frame code of VFD h is analyzed again, and finally the video code of VFD h is obtained, the continuation code of each frame of video frame data is the same, but the control code table of each frame of video code is independent.

[0037] Further, the audio frame data is encoded by an audio encoding technology to obtain an audio code.

[0038] Further, based on the frame data, the video code and the audio code are combined into a group of encoding groups and transmitted and decoded, including the following sub-steps:

[0039] Based on the frame data, the video code and the audio code are combined into a group of encoding groups and transmitted;

[0040] transmitting the encoding groups.

[0041] Further, combining the video encoding and the audio encoding into an encoding group based on the frame data and transmitting the encoding group comprises the following sub-steps:

[0042] transmitting the VFD h and the AFD h to the video encoding and the audio encoding into an encoding group, marked as F h .

[0043] transmitting the encoding groups in the order of h from small to large.

[0044] Further, decoding the encoding groups after transmission comprises the following sub-steps:

[0045] decoding the audio encoding through a decoding program, and decoding the video encoding by combining the video encoding with the reference encoding table, to obtain audio frame data and video frame data;

[0046] combining the video frame data and the audio frame data in the order of h from small to large in F h , to finally obtain lossless audio and video data.

[0047] Advantages of the present application: the present application separates the audio and video into audio data and video data, separates the audio data and the video data into frame data, the frame data comprising audio frame data and video frame data, then extracts data from the video frame data, obtains the color value table of the video frame data in different RGB channels, compresses and encodes the color value table in the same video frame data to obtain single-frame encoding, and further compresses and encodes the color value table in adjacent video frame data based on the single-frame encoding to obtain video encoding, the advantage being that the compression and encoding method used by the present application can maximize the conversion of multi-byte data in the video frame data into single-byte data, and also considers the color change relationship between adjacent frame images during compression, and if the color does not change, the video frame data can be further compressed, the compression being lossless, and the compression rate being higher than that of existing lossless compression technology, improving the effectiveness of satellite audio and video encoding and decoding.

[0048] The present application encodes the audio frame data, converts the audio frame data into audio encoding, combines the video encoding and the audio encoding into an encoding group based on the frame data and transmits the encoding group, and finally decodes the encoding group after transmission, the advantage being that the audio encoding and the video encoding are combined according to the frame number, ensuring that each frame of video frame data and audio frame data can be accurately corresponded, further improving the effectiveness of satellite audio and video encoding and decoding. BRIEF DESCRIPTION OF DRAWINGS

[0049] Figure 1 Flow chart of steps for the method of the present application;

[0050] Figure 2 Schematic diagram of the same parity when displacement coefficient E=0 of the present application;

[0051] Figure 3 Schematic diagram of the same parity when displacement coefficient E=1 of the present application;

[0052] Figure 4 Structural schematic diagram of the electronic device of the present application. DETAILED DESCRIPTION

[0053] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0054] Embodiment 1, please refer to Figure 1 As shown in the figure, the present application provides a satellite channel high fault-tolerant audio and video joint coding and decoding method, comprising the following steps:

[0055] Step S1, separating the audio and video into audio data and video data, and then separating the audio data and video data into frame data, the frame data comprising audio frame data and video frame data; step S1 comprises the following sub-steps:

[0056] Step S101, extracting the audio in the audio and video by audio extraction technology to obtain audio data, and saving the video in the audio and video as video data;

[0057] Step S102, extracting the image of each frame in the video data to obtain video frame data;

[0058] Step S103, dividing the audio data into frame number parts based on the frame number of the audio and video to obtain audio frame data;

[0059] Step S104, numbering the video frame data and the audio frame data according to the order of the frames, and respectively marking the video frame data as VFD h and the audio frame data as AFD h , wherein h is a non-zero natural number and h is the serial number of VFD and AFD, VFD h corresponds to AFD h ;

[0060] In the embodiment, the existing audio extraction technology is used to separate the audio and video in the audio and video to obtain the audio data and the video data. Since the extracted video data is 60 frames of video, i.e., 60 images are played per second, each image is a video frame data, i.e., there are 60 video frame data per second. Meanwhile, the audio data in one second is divided into 60 audio frame data. According to the order of the frames, the audio frame data and the video frame data are one-to-one corresponding when h is equal, i.e., AFD h and VFD h are the audio frame data and the video frame data that need to be played at the same time.

[0061] In step S2, the color value table of the video frame data in different RGB channels is obtained by data extraction. Step S2 includes the following sub-steps:

[0062] In step S201, the RGB channel includes the R channel, the G channel and the B channel.

[0063] In step S202, the color value table of the video frame data on the R channel, the G channel and the B channel is obtained, which are respectively named as the R color value table, the G color value table and the B color value table.

[0064] In the embodiment, the color image is divided into three RGB channels for transmission. The RGB channel is a professional term, and will not be described in detail in the embodiment. The color value table records the color value of each pixel point in the corresponding RGB channel. The row and column of the pixel point in the video frame data are the row and column of the color value in the color value table.

[0065] In step S3, the video frame data is converted into video coding by compression coding based on the color value table. Step S3 includes the following sub-steps:

[0066] In step S301, the color value table in the same video frame data is compression coded to obtain single frame coding.

[0067] Step S301 includes the following sub-steps:

[0068] In step S301.1, when the same video frame data is compression coded, it is named as processing frame data. The color value of each pixel point is recorded in the color value table. When any color value table of the processing frame data is analyzed, it is named as processing table.

[0069] In step S301.2, a string of digital string is composed of the color value of each row in the processing table in the order from left to right. The digital string of the i-th row is marked as NU i NU iThe jth digit of the middle is marked as C(i, j), wherein i and j are positive integers, i is the serial number of NU, and (i, j) is the serial number of C;

[0070] In the implementation, since the complete processing table data is too large to be specifically shown in the embodiment, the processing procedure of the video frame data is described only by taking part of the data as an example. For example, the processing table is shown in Table 1.

[0071] Table 1 Processing table

[0072] ;

[0073] NU1 is 156142133130128, NU2 is 159150144130129, and NU3 is 14314113913599. The value range of j in each row is not the same. For example, there are 15 digits in NU1, and in C(i, j) corresponding to NU1, 1≤j≤15. There are 14 digits in NU3, and in C(i, j) corresponding to NU3, 1≤j≤14. The serial numbers are C(1, 1) to C(1, 15), C(2, 1) to C(2, 15), and C(3, 1) to C(3, 14).

[0074] In step S301.3, for any odd value of i, C(i, j) is marked as CP(i, n), and C(i+1, j) is marked as CP(i+1, m), wherein n and m belong to j.

[0075] In step S301.4, a displacement coefficient E is set, E is initially 0, and CP(i, n) is placed above CP(i+1, m) starting from m=i+E. At this time, CP(i, n) and CP(i+1, m) are considered as the same digit.

[0076] In the implementation, for any odd value of i, analysis is performed. For example, when i=1, CP(i, n) and CP(i+1, m) are C(1, j) and C(2, j). When i=2, since C(2, j) has been analyzed with C(1, j), it is skipped, and i=3 is analyzed, that is, only odd values are analyzed. Taking i=1 as an example, there are CP(1, n) and CP(2, m). When the displacement coefficient E=0, the same digit is as shown in Figure 2 When the displacement coefficient E=1, the same digit is as shown in Figure 3 In fact, CP(i+1, m) is moved one position forward, and CP(i, n) and CP(i+1, m) in the same column are considered as the same digit.

[0077] Step S301.5, if CP(i, n) is equal to CP(i+1, m), output a same phase signal, otherwise output a different phase signal, mark the same phase signal and the different phase signal output at CP(i+1, m) as T m and F m ;

[0078] Step S301.6, count T m , divide m adjacent T m into a same phase group, count the number of T m in the same phase group, name it as same phase amount, and name the digital string composed of CP(i+1, m) corresponding to the same phase amount in the order of m from small to large as same phase number string;

[0079] Step S301.7, add 1 to E and re-analyze the same phase amount and the same phase number string until max(j)-1 is reached, max() is the maximum value operator;

[0080] In the specific implementation, for example, Figure 2 , CP(1, 1) and CP(2, 1) in Figure 2 are both 1, that is, CP(1, 1) and CP(2, 1) are equal, output a same phase signal, at this time CP(2, 1) is T1, then analyze CP(1, 2) and CP(2, 2) to get T2, then analyze CP(1, 3) and CP(2, 3) to find that CP(1, 3) and CP(2, 3) are not equal, output a different phase signal, thus get F3, and there is no T3, analyze each same phase group to finally get T1, T2, T4, T7, T 10 , T 11 , T 12 , T 13 and T 14 , wherein T1 and T2 are adjacent, T4 is independent, T7 is independent, T 10 , T 11 , T 12 , T 13 and T 14 are adjacent, get four same phase groups, the same phase amounts are 2, 1, 1 and 5 respectively, the corresponding same phase number strings are 15, 1, 1 and 13012 respectively, add 1 to E and repeat the analysis until max(j)-1 is reached, j in max(j)-1 usually refers to m.

[0081] Step S301.8, get the maximum value in the same phase amount, mark it as the maximum amount, and mark the same phase number string corresponding to the maximum amount as the best number string;

[0082] Step S301.9, a control encoding table is constructed, the control encoding table is used to store monomer encoding and the best equal number string, the monomer encoding is any encoding occupying only one byte, it is looked up whether the monomer encoding of the best equal number string exists in the control encoding table, if yes, the best equal number string in CP (i, n) and CP (i+1, m) is replaced by the monomer encoding, if not, a monomer encoding is newly built and is associated with the best equal number string, the monomer encoding and the best equal number string are entered into the control encoding table;

[0083] Step S301.10, after analyzing all C (i, j), a single frame encoding is obtained;

[0084] In the specific implementation, the maximum equal number is 5, so the best equal number string is 13012, the control encoding table is constructed, and the control encoding table is shown in Table 2 as follows:

[0085] Table 2 Control encoding table

[0086] ;

[0087] The monomer encoding is actually any character in the single-byte character set, since the monomer encoding does not exist in the target control encoding table, a character is randomly extracted from the single-byte character set as the monomer encoding of the best equal number string, and the control encoding table is updated, and the control encoding table is shown in Table 3 as follows:

[0088] Table 3 Control encoding table

[0089] ;

[0090] The empty cells in Table 2 and Table 3 represent that no monomer encoding or best equal number string is entered here, and are empty values; the best equal number string in CP (i, n) and CP (i+1, m) is replaced by the monomer encoding, which is actually replacing all 13012 in NU i to A, finally, NU1 and NU2 are compressed to 156142133A8 and 159150144A9, if 13012 also exists in NU3, the replacement can also be performed, after the replacement is completed, i+2 is combined, and the next group of CP (i, n) and CP (i+1, m) is analyzed, for example, when CP (3, n) and CP (4, m) are analyzed, it is found that the best equal number string is 14, and the monomer encoding is B, then all 14 in NU i is replaced by B, finally, NU1 is 156B2133A8, NU2 is 159150B4A9, and NU3 is B3B113913599, and so on, if all NU iAfter the analysis is completed, if there are still remaining characters in the single-byte character set, the analysis can be performed again until only one character remains in the single-byte character set, and the remaining one character is used to construct the continuation code, and the continuation code is the same for each frame of video data, i.e., the same continuation code is used for all frames of video data.

[0091] At step S302, the color value table in the adjacent video frame data is compressed and encoded based on the single-frame encoding to obtain video encoding.

[0092] Step S302 includes the following sub-steps:

[0093] At step S302.1, the VFD h is marked as CV h (i,j), and all homologous equal number strings of CV h (i,j) and CV h+1 (i,j) are analyzed, each homologous equal number string is composed of a group of j consecutive adjacent C(i,j), and if two homologous equal number strings do not have the same j, they are integrated into a continuation group.

[0094] At step S302.2, the continuation code is set, and the homologous equal number strings belonging to the continuation group in CV h+1 (i,j) are replaced with the continuation code.

[0095] At step S302.3, after the replacement of the continuation code in VFD h is completed, the single-frame encoding of VFD h is analyzed again to finally obtain the video encoding of VFD h , and the continuation code of each frame of video frame data is the same, but the reference encoding table of each frame of video encoding is independent.

[0096] In a specific implementation, if the color values of the same pixel point in the video frame data of the previous and next frames are not changed, this data can be omitted, for example, in the first frame of video frame data, NU1 is 156142133130128, and in the second frame of video frame data, NU1 is also 156142133130128, which means that the pixel point of the first row has not changed. Assuming that the continuation code is X, then NU1 in the second frame of video frame data is directly changed to X, and if X is found in the decoding, the pixel point corresponding to the previous frame of video frame data is continued to be used, and after the continuation code of each row is replaced, the single-body encoding of the video frame data itself is analyzed to finally obtain the video encoding. In this way, the number of bytes can be greatly saved, and since the video encoding does not discard any information in the data, it can also achieve lossless compression.

[0097] Step S4, encoding the audio frame data to convert the audio frame data into an audio code; the audio frame data is encoded by using an audio coding technology to obtain an audio code;

[0098] In a specific implementation, the encoding of the audio frame data can be performed by using an existing audio coding technology, which will not be described in the present embodiment.

[0099] Step S5, combining the video code and the audio code into a group of codes based on the frame data and transmitting and decoding the group of codes; Step S5 includes the following sub-steps:

[0100] Step S501, combining the video code and the audio code into a group of codes based on the frame data and transmitting the group of codes;

[0101] Step S501 includes the following sub-steps:

[0102] Step S501.1, integrating the video code and the audio code of VFD h and AFD h into a group of codes, which is marked as F h ;

[0103] Step S501.2, transmitting the group of codes in the order of h from small to large;

[0104] In a specific implementation, the video code and the audio code are combined and transmitted in units of frames, which can ensure that each frame of the video can correspond to the audio, even if part of the audio is missing, the remaining audio can still be protected from being affected, and the audio-visual synchronization can be maintained at all times.

[0105] Step S502, decoding the group of codes after transmission;

[0106] Step S502 includes the following sub-steps:

[0107] Step S502.1, decoding the audio code by using a decoding program, and decoding the video code by using the contrast code table of the video code, to obtain the audio frame data and the video frame data;

[0108] Step S502.2, combining the video frame data and the audio frame data in the order of h from small to large in F h , to finally obtain lossless audio-video data;

[0109] In a specific implementation, the decoding program is the inverse program of the encoding process, which will not be described in the present embodiment.

[0110] Embodiment 2, please refer to Figure 4 as shown, Figure 4An example is shown in a structural diagram of an electronic device, which can include a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete the communication among each other through the communication bus. The memory stores computer readable instructions, and the processor can call the instructions in the memory. When the computer readable instructions are executed by the processor, the steps in a satellite channel high fault tolerance audio and video joint coding method are executed to realize the following functions: separating audio and video into audio data and video data, and then separating the audio data and the video data into audio frame data and video frame data; performing data extraction on the video frame data to obtain a color value table of the video frame data in different RGB channels; compressing and encoding the video frame data based on the color value table to convert the video frame data into video encoding; encoding the audio frame data to convert the audio frame data into audio encoding; and combining the video encoding and the audio encoding into a group of encoding groups based on the frame data and transmitting and decoding.

[0111] In addition, the logical instructions in the memory described above can be implemented in the form of a software functional unit and sold or used as an independent product, which can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or part of the technical solutions can be embodied in the form of a software product, which is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0112] Embodiment 3, the present application also provides a computer program product, which includes a computer program stored on a computer readable storage medium, and the computer program includes program instructions, when the program instructions are executed by a computer, the computer can execute a satellite channel high fault tolerance audio and video joint coding method provided by the above-mentioned method, which includes: separating audio and video into audio data and video data, and then separating the audio data and the video data into audio frame data and video frame data; performing data extraction on the video frame data to obtain a color value table of the video frame data in different RGB channels; compressing and encoding the video frame data based on the color value table to convert the video frame data into video encoding; encoding the audio frame data to convert the audio frame data into audio encoding; and combining the video encoding and the audio encoding into a group of encoding groups based on the frame data and transmitting and decoding.

[0113] Embodiment 4, the application also provides a computer readable storage medium, and the application provides a storage medium, which stores a computer program, and the computer program is executed by a processor to run the steps in the above satellite channel high fault tolerance audio and video joint coding method to realize the following functions: separating audio and video into audio data and video data, and then separating the audio data and the video data into audio frame data and video frame data; performing data extraction on the video frame data to obtain a color value table of the video frame data in different RGB channels; performing compression encoding on the video frame data based on the color value table to convert the video frame data into video encoding; performing encoding on the audio frame data to convert the audio frame data into audio encoding; and combining the video encoding and the audio encoding into a group of encoding groups based on the frame data and performing transmission and decoding.

[0114] Through the description of the above embodiments, the embodiments of the present application can be provided as a method, a system or a computer program product. Based on such understanding, the above technical solutions can be embodied in the form of a software product, which can be stored in a computer readable storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the method described in each embodiment or some parts of the embodiment.

[0115] In the embodiments provided by the present application, it should be understood that the disclosed system or method can be implemented in other ways. The above described embodiments are merely illustrative. For example, the division of the modules or units is merely a logical function division, and there can be another division manner in actual implementation. For example, a plurality of modules or units can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed modules can be indirect coupling or communication connection through some communication interfaces. The coupling or communication connection can be electrical, mechanical or in other forms.

[0116] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for some technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A satellite channel high fault-tolerant audio-video joint coding method, characterized in that, The method comprises the following steps: Separating the audio and video into audio data and video data, and separating the audio data and video data into frame data, wherein the frame data comprises audio frame data and video frame data; Extracting data from the video frame data to obtain a color value table of the video frame data in different RGB channels; Encoding the video frame data based on the color value table to convert the video frame data into video encoding; Encoding the audio frame data to convert the audio frame data into audio encoding; Combining the video encoding and the audio encoding into a group of encoding groups based on the frame data, and transmitting and decoding the group of encoding groups; The step of separating the audio and video into audio data and video data, and separating the audio data and video data into frame data comprises the following sub-steps: Extracting the audio in the audio and video through an audio extraction technology to obtain audio data, and saving the video in the audio and video as video data; Extracting an image of each frame in the video data to obtain video frame data; Dividing the audio data into frame data based on the number of frames of the audio and video to obtain audio frame data; The video frame data and the audio frame data are numbered in the order of the frames, respectively by the symbols VFD h and AFD h , wherein h is a non-zero natural number and h is the sequence number of the VFD h and the AFD h ; The step of encoding the video frame data based on the color value table to convert the video frame data into video encoding comprises the following sub-steps: Encoding the color value table in the same video frame data to obtain single-frame encoding; Encoding the color value table in adjacent video frame data based on the single-frame encoding to obtain video encoding; The step of encoding the color value table in the same video frame data comprises the following sub-steps: When encoding the same video frame data, the video frame data is named as processing frame data, and the color value table records the color value of each pixel point; when analyzing any color value table of the processing frame data, the color value table is named as processing table; A string of numbers is formed by the color values of each row of the processing table in the order from left to right, and the string of numbers of the ith row is marked as NU i The jth digit in NU i is marked as C(i,j), where i and j are positive integers, i is the serial number of NU, and (i,j) is the serial number of C. For any odd value of i, mark C(i,j) as CP(i,n) and C(i+1,j) as CP(i+1,m), wherein n and m belong to j; Setting a displacement coefficient E, wherein E is initially 0, and placing CP(i,n) above CP(i+1,m) starting from m=i+E, wherein CP(i,n) and CP(i+1,m) are considered as same parity at this time; If CP(i, n) is equal to CP(i+1, m), an in-phase equal signal is output, otherwise an in-phase unequal signal is output, and the in-phase equal signal and the in-phase unequal signal output at CP(i+1, m) are marked as T m and F m ; For T m Perform statistics and select the adjacent T values ​​of m. m Divide into a colophon group and count the T values ​​in the colophon group. m The number of CP(i+1,m) corresponding to the equivalence is named as the equivalence of the same position. The number string formed by CP(i+1,m) corresponding to the equivalence of the same position in ascending order of m is named as the equivalence of the same position number string. Increasing E by one and reanalyzing the same parity and same parity string until max(j)-1 is reached, wherein max() is the maximum value operator; Obtaining the maximum value in the same parity, which is marked as the maximum quantity, and marking the same parity string corresponding to the maximum quantity as the best quantity string; Constructing a comparison encoding table, wherein the comparison encoding table is used to store single encoding and the best quantity string, the single encoding is any encoding occupying only one byte, and the comparison encoding table is used to check whether the best quantity string has a single encoding; if yes, the best quantity string in CP(i,n) and CP(i+1,m) is replaced with the single encoding; if no, a single encoding is newly created and associated with the best quantity string, and the single encoding and the best quantity string are recorded in the comparison encoding table; Obtaining single-frame encoding by analyzing all C(i,j); The step of encoding the color value table in adjacent video frame data based on the single-frame encoding comprises the following sub-steps: The VFD h is marked as CV h (i,j), and all homologous strings of CV h (i,j) and CV h+1 (i,j) are analyzed, each homologous string being composed of a group of j consecutive adjacent C(i,j), and if two homologous strings do not have the same j, they are integrated into a group of continued groups; Set continuation code, and replace the same parity string belonging to the continuation group in (i,j) with the continuation code. h+1 (i,j) with the continuation code. VFD h After the continuation coding replacement in the VFD is completed, analyze the VFD h The single frame coding of the VFD is finally obtained h The video coding of each frame is the same, but the comparison coding table of each frame is independent.

2. The method of claim 1, wherein, The video frame data is subjected to data extraction to obtain a color value table of the video frame data in different RGB channels, including the following sub-steps: The RGB channels include an R channel, a G channel and a B channel. The color value table of the video frame data in the R channel, the G channel and the B channel is obtained, and is respectively named as an R color value table, a G color value table and a B color value table.

3. The method of claim 2, wherein, The encoding of the audio frame data is specifically encoding of the audio frame data by using an audio encoding technology to obtain an audio encoding.

4. The method of claim 3, wherein, The video encoding and the audio encoding are combined into a group of encoding groups based on the frame data, and are transmitted and decoded, including the following sub-steps: The video encoding and the audio encoding are combined into a group of encoding groups based on the frame data, and are transmitted. The encoding groups are decoded after the transmission.

5. The method of claim 4, wherein, The video encoding and the audio encoding are combined into a group of encoding groups based on the frame data, and are transmitted, including the following sub-steps: VFD h is integrated with the video encoding and audio encoding of AFD h into a set of encoding groups, labeled F h ; The encoding groups are transmitted in the order of h from small to large.

6. A satellite channel high fault-tolerant audio-video joint coding method according to claim 5, characterized in that, The encoding groups are decoded after the transmission, including the following sub-steps: The audio encoding is decoded by using a decoding program, and the video encoding is decoded by using the contrast encoding table of the video encoding, to obtain the audio frame data and the video frame data. According to F h The video frame data and the audio frame data are combined in order of small to large h, and finally lossless audio and video data is obtained.

Images