Multi-pixel parallel ultra-low delay encoding and decoding method and transmitting and receiving equipment

Abstract

The invention relates to a multi-pixel parallel ultra-low delay coding method and transmitting and receiving equipment. The method comprises the following steps: acquiring high-definition video data; obtaining component data of the high-definition video data according to the pixel data of the high-definition video data, classifying and coding the component data of the high-definition video data, and performing digital wavelet transform on the component data of the high-definition video data of the same kind to obtain converted component data; the conversion component data comprises high-frequency sub-band data and low-frequency sub-band data, and performing cyclic compression on the conversion component data or quantizing the high-frequency sub-band data of the conversion component data; the component data of the high-definition video data is synchronously converted through digital wavelet transform to obtain the converted component data, the conversion efficiency is improved, and the converted component data is cyclically compressed or high-frequency sub-band data of the converted component data is quantized to reduce the video data loss.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a multi-pixel parallel ultra-low delay encoding and decoding method and a sending and receiving device. Background Art

[0002] In the prior art, there are two types of high-definition video transmission: uncompressed transmission and compressed transmission. When transmitting high-definition video without compression, the bandwidth required is very large, the requirements and cost of transmission equipment are high, and the scope of application is small. Compressed transmission is divided into deep compression and shallow compression. The deep compression algorithm of high-definition video is cumbersome, and the loss of high-definition video is large. The output video is difficult to meet the requirements of the professional audio and video field. Shallow compression of high-definition video can meet the requirements of the professional audio and video field and has been used more and more, but the light compression codec transmission efficiency is poor and the video data loss is large. Summary of the invention

[0003] The multi-pixel parallel ultra-low delay encoding and decoding method and the sending and receiving devices provided by the present invention solve the problem in the prior art of improving the transmission efficiency by performing multi-pixel parallel encoding and decoding through digital wavelet transform ultra-low delay encoding and decoding during shallow compression transmission of high-definition video.

[0004] To solve the above problems, the present invention is achieved through the following technical solutions:

[0005] A first aspect: a multi-pixel parallel ultra-low latency encoding method, the method comprising:

[0006] Get high-definition video data;

[0007] Obtaining component data of the high-definition video data according to the pixel data of the high-definition video data;

[0008] Classifying and encoding the component data of the high-definition video data, and performing digital wavelet transformation on the component data of the high-definition video data of the same type to obtain conversion component data;

[0009] The conversion component data includes high frequency sub-band data and low frequency sub-band data, and the conversion component data is cyclically compressed or quantized to obtain the high frequency sub-band data of the conversion component data.

[0010] A preferred solution of the present invention: obtaining the component data of the high-definition video data according to the pixel data of the high-definition video data comprises:

[0011] Convert the pixel data of the high-definition video data into pixel data in a YUV pixel format;

[0012] The component data is obtained by splitting each row of pixel data into Y component data, U component data, and V component data.

[0013] A preferred solution of the present invention: the component data of the same type of high-definition video data are respectively transformed by digital wavelet transform, including:

[0014] Set the Y component data, U component data, and V component data to X i The Y conversion component data, the U conversion component data, and the V conversion component data are respectively composed of the high frequency sub-band data P i and low-frequency subband data to form Q i ,in,

[0015] X i ={X0,X1,X2,...X 2n-1} (1)

[0016]

[0017] A preferred solution of the present invention: compressing the conversion component data includes:

[0018] According to the current LAN bandwidth and the preset compression budget value D of high-definition video data, and the number of pixel data rows N that make up the data packet, when the sum of the number of bytes of Y conversion component data, U conversion component data, and V conversion component data of N rows of YUV format pixel data is greater than the conversion component data compression budget value D; the Y conversion component data, U conversion component data, and V conversion component data are further subjected to cyclic digital wavelet transform.

[0019] A preferred solution of the present invention: the high frequency sub-band data of the quantized conversion component data comprises:

[0020] According to the current LAN bandwidth and the preset compression budget value D of the high-definition video data, and the number of pixel data rows N constituting the data packet, when the sum of the number of bytes of the Y conversion component data, the U conversion component data, and the V conversion component data of the N rows of YUV format pixel data is greater than the compression budget value D of the conversion component data; i Quantify.

[0021] A preferred solution of the present invention: the high-definition video data includes frame rate and resolution;

[0022] The compression budget

[0023] A second aspect: A multi-pixel parallel digital wavelet transform ultra-low delay decoding method, the method comprising:

[0024] Obtaining a target bitstream, wherein the target bitstream is obtained by encoding a high-definition video using the multi-pixel parallel ultra-low latency encoding method described above;

[0025] Determine whether to compress the conversion component data or quantize the high-frequency sub-band data of the conversion component data. When the conversion component data is compressed, obtain Y component data, U component data, and V component data through digital wavelet inverse transform; when the high-frequency sub-band data of the conversion component data is quantized, perform data compensation on part of the quantized data of the high-frequency sub-band data, and then obtain Y component data, U component data, and V component data through digital wavelet inverse transform.

[0026] A preferred solution of the present invention: the data compensation for part of the quantized high-frequency sub-band data comprises:

[0027] The high frequency sub-band data is partially quantized in its own format, and the data compensation is to perform data format compensation on the quantized high frequency sub-band data.

[0028] A third aspect: A high-definition video sending device, comprising: a memory and a processor coupled to the memory, the memory being used to store application instructions, and the processor being configured to call the application instructions to execute the above encoding method.

[0029] A fourth aspect: A high-definition video receiving device, comprising: a memory and a processor coupled to the memory, the memory being used to store application instructions, and the processor being configured to call the application instructions to execute the above-mentioned decoding method.

[0030] Beneficial effects:

[0031] The multi-pixel parallel ultra-low delay encoding method of the present invention obtains component data of high-definition video data based on pixel data of high-definition video data, synchronously converts the component data of high-definition video data through digital wavelet transform and obtains converted component data, thereby improving conversion efficiency; the converted component data includes high-frequency sub-band data and low-frequency sub-band data, and the high-frequency sub-band data of the converted component data is cyclically compressed or quantized to reduce video data loss. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solution of the embodiment of the present invention, the following will describe the required

[0033] The accompanying drawings are briefly introduced. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.

[0034] Figure 1 It is a flow chart of the multi-pixel parallel ultra-low delay encoding method of the present invention;

[0035] Figure 2 It is a schematic diagram of digital wavelet change of the present invention;

[0036] Figure 3 It is a schematic diagram of the structure of the high-definition video sending device of the present invention;

[0037] Figure 4 It is a structural schematic diagram of a high-definition video receiving device of the present invention. DETAILED DESCRIPTION

[0038] The following will be combined with the accompanying drawings in the present invention to clearly and completely describe the technical solutions in the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0039] like Figure 1-4 As shown:

[0040] A first aspect: a multi-pixel parallel ultra-low latency encoding method, the method comprising:

[0041] Obtain high-definition video data, the target high-definition video includes: ultra-high-definition video in YUV format, or ultra-high-definition video in RGB format;

[0042] According to the pixel data of the high-definition video data, all pixel data in YUV format or pixel data in RGB format are converted into YUV422 pixel format;

[0043] Splitting each row of pixel data of a frame to obtain component data of the high-definition video data, classifying and sequentially encoding the component data of the high-definition video data, and simultaneously performing digital wavelet transformation on component data of the high-definition video data of the same type to improve conversion efficiency and obtain conversion component data;

[0044] The conversion component data includes high frequency sub-band data and low frequency sub-band data, and the conversion component data is cyclically compressed or quantized to obtain the high frequency sub-band data of the conversion component data.

[0045] A preferred solution of the present invention: obtaining the component data of the high-definition video data according to the pixel data of the high-definition video data comprises:

[0046] The component data is obtained by splitting each row of pixel data into Y component data, U component data, and V component data. A preferred solution of the present invention: the component data of the same type of high-definition video data are respectively transformed by digital wavelet transform, including:

[0047] Set the Y component data, U component data, and V component data to Xi The Y conversion component data, the U conversion component data, and the V conversion component data are respectively composed of the high frequency sub-band data P i and low-frequency subband data to form Q i ,in,

[0048] X i ={X0,X1,X2,...X 2n-1} (1)

[0049]

[0050] For example, the Y component data is transformed into the Y conversion component data by digital wavelet transform, and the Y component data is combined with the X i Corresponding to each other, the high-frequency sub-band data P is obtained through the digital wavelet transform formula i The collection and low frequency subband data Q i Set; similarly, the U component data and the V component data are transformed as above.

[0051] A preferred solution of the present invention: compressing the conversion component data includes:

[0052] According to the current LAN bandwidth and the preset compression budget value D of high-definition video data, and the number of pixel data rows N that make up the data packet, when the sum of the number of bytes of Y conversion component data, U conversion component data, and V conversion component data of N rows of YUV format pixel data is greater than the compression budget value D of the conversion component data; the Y conversion component data, U conversion component data, and V conversion component data are further subjected to digital wavelet transform, and the transformed component data are compared with the compression budget value D until they are less than the compression budget value D.

[0053] A preferred solution of the present invention: the high frequency sub-band data of the quantized conversion component data comprises:

[0054] According to the current LAN bandwidth and the preset compression budget value D of the high-definition video data, and the number of pixel data rows N constituting the data packet, when the sum of the number of bytes of the Y conversion component data, the U conversion component data, and the V conversion component data of the N rows of YUV format pixel data is greater than the compression budget value D of the conversion component data; i Quantify.

[0055] The number N of pixel data rows constituting the data packet is 2 or 4. If the number N is determined, the total amount of data packets per frame is also determined.

[0056] A preferred solution of the present invention: the high-definition video data includes frame rate and resolution;

[0057] The compression budget

[0058] The high frequency subband P i For a specific format, for each high frequency subband P i Quantify.

[0059] After cyclically compressing the conversion component data or quantizing the high-frequency sub-band data of the conversion component data, the data packets are packaged and sent through a custom protocol. The custom protocol packages the Y conversion component data, the U conversion component data, and the V conversion component data respectively, and adds header information at the end of the data packet. The header information includes the packet sequence number, splitting information, compression or quantization information of the data packet.

[0060] The packet numbers of the data packets formed by each frame are arranged in order, the splitting information is the information that N rows of pixel data are split into Y component data, U component data, and V component data, and the quantization information is the high frequency sub-band P i Information on quantifying data.

[0061] A second aspect: A multi-pixel parallel digital wavelet transform ultra-low delay decoding method, the method comprising:

[0062] Obtaining a target bitstream, wherein the target bitstream is obtained by encoding a high-definition video using the multi-pixel parallel ultra-low latency encoding method described above;

[0063] Determine whether to compress the conversion component data or quantize the high-frequency sub-band data of the conversion component data. When compressing the conversion component data, determine the number of transformations and obtain Y component data, U component data, and V component data through inverse digital wavelet transform. When quantizing the high-frequency sub-band data of the conversion component data, perform data compensation on part of the quantized data of the high-frequency sub-band data and then obtain Y component data, U component data, and V component data through inverse digital wavelet transform.

[0064] A preferred solution of the present invention: the data compensation for part of the quantized high-frequency sub-band data comprises:

[0065] The high frequency sub-band data is partially quantized in its own format, and the data compensation is to perform data format compensation on the quantized high frequency sub-band data.

[0066] Specifically, receiving a data packet of a target high-definition video and obtaining header information of the data packet;

[0067] When the packet header information includes a packet sequence number and splitting information, when the packet header information includes a packet sequence number, splitting information, and compression information, the data packet is decapsulated to obtain Y conversion component data, U conversion component data, and V conversion component data, corresponding Y component data, U component data, and V component data are obtained by digital wavelet inverse transformation, the Y component data, U component data, and V component data are integrated by the splitting information to obtain pixel data, and the target high-definition video is output;

[0068] When the packet header information includes a packet sequence number, splitting information, and quantization information, the data packet is decapsulated to obtain Y conversion component data, U conversion component data, and V conversion component data; data compensation is performed on the Y conversion component data, U conversion component data, and V conversion component data through the quantization information; then, corresponding Y component data, U component data, and V component data are obtained through digital wavelet inverse transform; finally, the Y component data, U component data, and V component data are integrated according to the splitting information to obtain pixel data, and the target high-definition video is output.

[0069] A third aspect: A high-definition video sending device, comprising: a memory and a processor coupled to the memory, the memory being used to store application instructions, and the processor being configured to call the application instructions to execute the above encoding method.

[0070] like Figure 3 As shown, the sending device 30 may include but is not limited to: a memory 301 , a processor 302 and a WI FI communication module 303 .

[0071] Memory 301, can be used to: store application instructions and target high-definition video

[0072] The processor 302 may be used to: call the application program instructions stored in the memory 301 to implement Figure 1 The multi-pixel parallel ultra-low delay encoding method.

[0073] The processor 302 can be used to: convert the acquired pixel data of the target high-definition video to obtain pixel data in YUV pixel format; classify and sequentially encode the component data of the high-definition video data, and simultaneously perform digital wavelet transformation on the component data of the same type of high-definition video data to improve conversion efficiency and obtain conversion component data; the conversion component data includes high-frequency sub-band data and low-frequency sub-band data, and the high-frequency sub-band data of the conversion component data is cyclically compressed or quantized.

[0074] The processor 302 can be used to obtain target high-definition video information, for example, resolutions of 1920*1200, 1920*1080, 1280*720, 1680*1050, 1600*1200; the target high-definition video includes ultra-high-definition video in YUV format or ultra-high-definition video in RGB format.

[0075] More specifically, the processor 302 may be configured to:

[0076] The target high-definition video obtained through the HDMI to BT1120 interface chip input is analyzed to obtain the resolution, pixel format, etc. of the target video.

[0077] The processor 302 may also be used to: compress or quantize the Y conversion component data, the U conversion component data, and the V conversion component data respectively by using a multi-pixel parallel ultra-low delay encoding method:

[0078] It should be understood that the sending device 30 is only an example provided by an embodiment of the present invention, and the sending device 30 may have more or fewer components than those shown, may combine two or more components, or may have different configurations of components.

[0079] Understandable, about Figure 3 For specific implementations of the functional components included in the sending device 30, please refer to Figure 1-2 The embodiments are not described in detail here.

[0080] A fourth aspect: A high-definition video receiving device, comprising: a memory and a processor coupled to the memory, the memory being used to store application instructions, and the processor being configured to call the application instructions to execute the above-mentioned decoding method.

[0081] The present invention provides a high-definition video receiving device, which can be used to implement a multi-pixel parallel digital wavelet transform ultra-low delay decoding method. Figure 4 The receiving device shown can be used to execute the description content in the embodiments.

[0082] like Figure 4 As shown, the receiving device 40 may include but is not limited to: a memory 401 , a processor 402 and a communication module 403 .

[0083] Memory 401, can be used for: application program instructions

[0084] Processor 402 can be used to: call the application program instructions stored in memory 401 to implement Figure 2 The multi-pixel parallel digital wavelet transform ultra-low delay decoding method.

[0085] WI FI communication module 403 can be a wired network communication module, such as twisted pair CAT5 CAT6, and optical fiber transmission, etc., which can be used to: receive data packets sent by the sending device

[0086] The processor 402 may be used to: decapsulate the data packet received by the WIFI communication module 403 into the custom protocol parameters and the video data;

[0087] The processor 402 may be specifically configured to: determine whether the target high-definition video needs digital wavelet inverse transformation or data compensation according to the custom protocol parameters;

[0088] When the target high-definition video requires digital wavelet inverse transformation, the corresponding Y component data, U component data, and V component data are obtained by digital wavelet inverse transformation, the Y component data, U component data, and V component data are integrated by splitting information to obtain pixel data, and the target high-definition video is output;

[0089] When the target high-definition video requires data compensation, the Y conversion component data, U conversion component data, and V conversion component data are compensated by quantization information, and then the corresponding Y component data, U component data, and V component data are obtained by digital wavelet inverse transform. Finally, the Y component data, U component data, and V component data are integrated according to the splitting information to obtain pixel data, and the target high-definition video is output.

[0090] It should be understood that the receiving device 40 is only an example provided in the embodiment of the present invention, and the receiving device 40 may have more or fewer components than those shown, may combine two or more components, or may have different configurations of components. Figure 4 For specific implementations of the functional components included in the receiving device 40, please refer to Figure 4 The method embodiments are not described in detail here.

[0091] Schematically, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, devices, devices or modules, or may be an electrical, mechanical or other form of connection.

[0092] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, and may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiments of the present invention.

[0093] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above integrated modules may be implemented in the form of hardware or in the form of software functional modules.

[0094] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program codes.

[0095] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A multi-pixel parallel ultra-low delay encoding method, characterized in that: The method comprises: Get high-definition video data; Obtaining component data of the high-definition video data according to the pixel data of the high-definition video data; Classifying and encoding the component data of the high-definition video data, and performing digital wavelet transformation on the component data of the high-definition video data of the same type to obtain conversion component data; The conversion component data includes high frequency sub-band data and low frequency sub-band data, and the conversion component data is cyclically compressed or quantized to obtain the high frequency sub-band data of the conversion component data.

2. The multi-pixel parallel ultra-low delay encoding method according to claim 1, characterized in that: The obtaining the component data of the high-definition video data according to the pixel data of the high-definition video data comprises: Convert the pixel data of the high-definition video data into pixel data in a YUV pixel format; The component data is obtained by splitting each row of pixel data into Y component data, U component data, and V component data.

3. The multi-pixel parallel ultra-low delay encoding method according to claim 2, characterized in that: The component data of the high-definition video data of the same type are respectively transformed by digital wavelet transform, including: Set the Y component data, U component data, and V component data to X i , the Y conversion component data, the U conversion component data, and the V conversion component data are respectively composed of the high frequency sub-band data P i and low-frequency subband data to form Q i ,in, X i {X0,X1,X2,...X 2n-1 } (1) 4. The multi-pixel parallel ultra-low delay encoding method according to any one of claims 1 to 3, characterized in that: The compressing the conversion component data comprises: According to the current LAN bandwidth and the preset compression budget value D of high-definition video data, and the number of pixel data rows N that make up the data packet, when the sum of the number of bytes of Y conversion component data, U conversion component data, and V conversion component data of N rows of YUV format pixel data is greater than the conversion component data compression budget value D; the Y conversion component data, U conversion component data, and V conversion component data are further subjected to cyclic digital wavelet transform.

5. The multi-pixel parallel ultra-low delay encoding method according to any one of claims 1 to 3, characterized in that: The high frequency subband data of the quantized converted component data comprises: According to the current LAN bandwidth and the preset compression budget value D of the high-definition video data, and the number of pixel data rows N constituting the data packet, when the sum of the number of bytes of the Y conversion component data, the U conversion component data, and the V conversion component data of the N rows of YUV format pixel data is greater than the compression budget value D of the conversion component data; i Quantify.

6. The multi-pixel parallel ultra-low delay encoding method according to any one of claims 1 to 3, characterized in that: The high-definition video data includes frame rate and resolution; The compression budget 7. A multi-pixel parallel digital wavelet transform ultra-low delay decoding method, characterized in that: The method comprises: Obtaining a target bitstream, wherein the target bitstream is obtained by encoding a high-definition video using the multi-pixel parallel ultra-low delay encoding method according to any one of claims 1 to 6; Determine whether to compress the conversion component data or quantize the high-frequency sub-band data of the conversion component data. When the conversion component data is compressed, obtain Y component data, U component data, and V component data through digital wavelet inverse transform; when the high-frequency sub-band data of the conversion component data is quantized, perform data compensation on part of the quantized data of the high-frequency sub-band data, and then obtain Y component data, U component data, and V component data through digital wavelet inverse transform.

8. The multi-pixel parallel digital wavelet transform ultra-low delay decoding method according to claim 7, characterized in that: The data compensation for part of the quantized high-frequency sub-band data comprises: The high frequency sub-band data is partially quantized in its own format, and the data compensation is to perform data format compensation on the quantized high frequency sub-band data.

9. A high-definition video transmission device, characterized in that: include: A memory and a processor coupled to the memory, wherein the memory is used to store application instructions, and the processor is configured to call the application instructions to execute the encoding method according to any one of claims 1 to 6.

10. A high-definition video receiving device, characterized in that: include: A memory and a processor coupled to the memory, wherein the memory is used to store application instructions, and the processor is configured to call the application instructions to execute the decoding method according to any one of claims 7 to 8.

Images