Multi-pixel parallel high-definition video sending and receiving method and device

Abstract

The invention relates to a multi-pixel parallel high-definition video sending and receiving method and device, and the sending method comprises the steps: extracting pixel data in a target high-definition video, and converting the pixel data into a YUV pixel format; splitting the pixel data to obtain Y component data, U component data and V component data; carrying out digital wavelet transform on the data to obtain Y conversion component data, U conversion component data and V conversion component data; according to the current local area network bandwidth, a preset compression budget value D of target video information and a pixel data line number N forming a data packet, the size of the compression budget value D and the sum of the byte numbers of Y conversion component data, U conversion component data and V conversion component data of N lines is judged, and the Y conversion component data, the U conversion component data and the V conversion component data are quantized; and finally, the data packet is packaged and sent through a user-defined protocol, so that the problem of relatively poor shallow compression transmission efficiency of the high-definition video is solved.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a multi-pixel parallel high-definition video sending and receiving method and device. Background Art

[0002] In the prior art, there are two types of high-definition video transmission: uncompressed transmission and compressed transmission. When transmitting high-definition video without compression, the bandwidth required is very large, the requirements and cost of transmission equipment are high, and the scope of application is small. Compressed transmission is divided into deep compression and shallow compression. The deep compression algorithm of high-definition video is cumbersome, and the loss of high-definition video is large. The output video is difficult to meet the requirements of the professional audio and video field. Shallow compression of high-definition video can meet the requirements of the professional audio and video field and has been used more and more, but the light compression algorithm is mostly cumbersome and the transmission efficiency is poor. Summary of the invention

[0003] The present invention provides a multi-pixel parallel high-definition video sending and receiving method and device, which solves the problem of poor transmission efficiency of high-definition video shallow compression in the prior art.

[0004] To solve the above problems, the present invention is achieved through the following technical solutions:

[0005] A first aspect: A multi-pixel parallel high-definition video transmission method, comprising:

[0006] Obtain a target high-definition video, extract pixel data in the target high-definition video and convert the data into a YUV pixel format;

[0007] Each row of pixel data is split to obtain Y component data, U component data, and V component data;

[0008] The Y component data, the U component data, and the V component data are respectively transformed by digital wavelet to obtain Y conversion component data, U conversion component data, and V conversion component data;

[0009] According to the current LAN bandwidth and the preset compression budget value D of the target video information and the number of pixel data rows N constituting the data packet, the sum of the number of bytes of the Y conversion component data, the U conversion component data, and the V conversion component data of the N rows of YUV format pixel data and the size of the compression budget value D are determined;

[0010] When the sum of the number of bytes is greater than the compression budget value D, the Y conversion component data, the U conversion component data, and the V conversion component data are quantized respectively until the sum of the number of bytes is less than or equal to the compression budget value D, and the quantized Y conversion component data, U conversion component data, and V conversion component data are packaged and sent as data packets through a custom protocol;

[0011] When the sum of the number of bytes is less than or equal to the compression budget value D, the Y conversion component data, U conversion component data, and V conversion component data are not quantized, and the Y conversion component data, U conversion component data, and V conversion component data are packaged and sent as data packets through a custom protocol.

[0012] A preferred solution of the present invention: the compression budget value D and the number of YUV format pixel data rows N constituting the data packet are preset according to the current LAN bandwidth and the target video information;

[0013] The target video information includes frame rate and resolution;

[0014] The number N of pixel data rows constituting the data packet is 2 or 4;

[0015] The compression budget

[0016] A preferred solution of the present invention: the Y component data, the U component data, and the V component data are respectively transformed by digital wavelet transform to obtain Y conversion component data, U conversion component data, and V conversion component data;

[0017] Set the Y component data, U component data, and V component data to X i The Y conversion component data, the U conversion component data, and the V conversion component data are respectively composed of the high frequency sub-band data P i and low-frequency subband data to form Q i ,in,

[0018] X i ={X0,X1,X2,...X 2n-1} (1)

[0019]

[0020] A preferred solution of the present invention: the Y conversion component data, the U conversion component data, and the V conversion component data are quantized separately, including quantizing the high frequency sub-band P in the Y conversion component data, the U conversion component data, and the V conversion component data. i Quantify.

[0021] A preferred solution of the present invention: the data packets are packaged and sent through a custom protocol, the custom protocol packages the Y conversion component data, the U conversion component data, and the V conversion component data respectively, and adds header information at the end of the data packet, the header information includes the packet sequence number, splitting information, and quantization information of the data packet.

[0022] A second aspect: a multi-pixel parallel high-definition video receiving method,

[0023] Receive the data packet of the target high-definition video and obtain the header information of the data packet;

[0024] When the packet header information includes a packet sequence number and splitting information, the data packet is decapsulated to obtain Y conversion component data, U conversion component data, and V conversion component data, corresponding Y component data, U component data, and V component data are obtained by digital wavelet inverse transformation, the Y component data, U component data, and V component data are integrated by the splitting information to obtain pixel data, and a target high-definition video is output;

[0025] When the packet header information includes a packet sequence number, splitting information, and quantization information, the data packet is decapsulated to obtain Y conversion component data, U conversion component data, and V conversion component data; data compensation is performed on the Y conversion component data, U conversion component data, and V conversion component data through the quantization information; then, corresponding Y component data, U component data, and V component data are obtained through digital wavelet inverse transform; finally, the Y component data, U component data, and V component data are integrated according to the splitting information to obtain pixel data, and the target high-definition video is output.

[0026] A preferred solution of the present invention: data compensation is performed on Y conversion component data, U conversion component data, and V conversion component data through quantization information; including data format compensation for high frequency sub-band data according to the quantization information.

[0027] A preferred solution of the present invention: the output target high-definition video converts the integrated pixel data into the pixel format of the target high-definition video according to the original pixel format of the target high-definition video and transmits it.

[0028] The third aspect: A multi-pixel parallel high-definition video sending device, comprising: a memory and a processor coupled to the memory, the memory is used to store application instructions, and the processor is configured to call the application instructions to execute the above-mentioned high-definition video sending method.

[0029] A fourth aspect: A multi-pixel parallel high-definition video receiving device, comprising: a memory and a processor coupled to the memory, the memory being used to store application instructions, and the processor being configured to call the application instructions to execute the above-mentioned high-definition video receiving method.

[0030] Beneficial effects:

[0031] The present invention discloses a multi-pixel parallel high-definition video sending and receiving method and device. The sending method includes: splitting pixel data in YUV pixel format to obtain Y component data, U component data, and V component data, and respectively performing digital wavelet transform to obtain Y conversion component data, U conversion component data, and V conversion component data, so as to realize parallel processing of data and improve shallow compression transmission of video. According to the current LAN bandwidth and target video information, a compression budget value D and the number of pixel data rows N constituting a data packet are preset. According to the size of the compression budget value D, the Y conversion component data, the U conversion component data, and the V conversion component data are respectively quantized. The algorithm is simple and easy to realize, and the transmission rate is greatly improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solution of the embodiment of the present invention, the following will describe the required

[0033] The accompanying drawings are briefly introduced. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.

[0034] Figure 1 It is a schematic flow chart of a multi-pixel parallel high-definition video transmission method of the present invention;

[0035] Figure 2 It is a structural schematic diagram of a multi-pixel parallel high-definition video transmission device provided by the present invention;

[0036] Figure 3 The present invention provides a schematic diagram of the structure of a multi-pixel parallel high-definition video receiving device. DETAILED DESCRIPTION

[0037] The technical solution of the present invention will be described clearly and completely below in conjunction with the accompanying drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0038] A first aspect: A multi-pixel parallel high-definition video transmission method, comprising:

[0039] Acquire a target high-definition video, the target high-definition video including: an ultra-high-definition video in a YUV format or an ultra-high-definition video in an RGB format, extract pixel data in the target high-definition video, and convert all the pixel data in the YUV format or the pixel data in the RGB format into a YUV422 pixel format;

[0040] Each row of pixel data of a frame is split to obtain Y component data, U component data, and V component data;

[0041] The Y component data, the U component data, and the V component data are respectively transformed by digital wavelet to obtain Y conversion component data, U conversion component data, and V conversion component data;

[0042] According to the current LAN bandwidth and the preset compression budget value D of the target video information and the number of pixel data rows N constituting the data packet, the sum of the number of bytes of the Y conversion component data, the U conversion component data, and the V conversion component data of the N rows of YUV format pixel data and the size of the compression budget value D are determined;

[0043] When the sum of the number of bytes is greater than the compression budget value D, the data packet is greater than the current bandwidth and is not transmitted. The Y conversion component data, the U conversion component data, and the V conversion component data are quantized respectively until the sum of the number of bytes is less than or equal to the compression budget value D, so that the data packet can be transmitted by the current LAN bandwidth. The quantized Y conversion component data, U conversion component data, and V conversion component data are packaged and sent as data packets through a custom protocol.

[0044] When the sum of the number of bytes is less than or equal to the compression budget value D, the data packet can be transmitted by the current LAN bandwidth, and the Y conversion component data, U conversion component data, and V conversion component data are not quantized. The Y conversion component data, U conversion component data, and V conversion component data are packaged and sent through a custom protocol.

[0045] A preferred solution of the present invention: the compression budget value D and the number of YUV format pixel data rows N constituting the data packet are preset according to the current LAN bandwidth and the target video information;

[0046] The target video information includes frame rate and resolution;

[0047] The number N of pixel data rows constituting the data packet is 2 or 4. If the number N is determined, the total amount of data packets per frame is also determined.

[0048] The compression budget

[0049] A preferred solution of the present invention: the Y component data, the U component data, and the V component data are respectively transformed by digital wavelet transform to obtain Y conversion component data, U conversion component data, and V conversion component data;

[0050] Set the Y component data, U component data, and V component data to X i The Y conversion component data, the U conversion component data, and the V conversion component data are respectively composed of the high frequency sub-band data P iand low-frequency subband data to form Q i ,in,

[0051] X i ={X0,X1,X2,...X 2n-1} (1)

[0052]

[0053] For example, the Y component data is transformed into the Y conversion component data by digital wavelet transform, and the Y component data is combined with the X i Corresponding to each other, the high-frequency sub-band data P is obtained through the digital wavelet transform formula i The collection and low frequency subband data Q i Set; similarly, the U component data and the V component data are transformed as above.

[0054] A preferred solution of the present invention: the Y conversion component data, the U conversion component data, and the V conversion component data are quantized separately, including quantizing the high frequency sub-band P in the Y conversion component data, the U conversion component data, and the V conversion component data. i Quantify.

[0055] Among them, the high frequency subband P in the Y conversion component data, the U conversion component data, and the V conversion component data i Quantization is performed, compared to quantizing the low-frequency subband data Q i The display loss of the target video after transmission is minimal.

[0056] A preferred solution of the present invention: the data packets are packaged and sent through a custom protocol, the custom protocol packages the Y conversion component data, the U conversion component data, and the V conversion component data respectively, and adds header information at the end of the data packet, the header information includes the packet sequence number, splitting information, and quantization information of the data packet.

[0057] The packet numbers of the data packets formed by each frame are arranged in order, the splitting information is the information that N rows of pixel data are split into Y component data, U component data, and V component data, and the quantization information is the high frequency sub-band P i Information on quantifying data.

[0058] A second aspect: a multi-pixel parallel high-definition video receiving method,

[0059] Receive the data packet of the target high-definition video and obtain the header information of the data packet;

[0060] When the packet header information includes a packet sequence number and splitting information, the data packet is decapsulated to obtain Y conversion component data, U conversion component data, and V conversion component data, corresponding Y component data, U component data, and V component data are obtained by digital wavelet inverse transformation, the Y component data, U component data, and V component data are integrated by the splitting information to obtain pixel data, and a target high-definition video is output;

[0061] When the packet header information includes a packet sequence number, splitting information, and quantization information, the data packet is decapsulated to obtain Y conversion component data, U conversion component data, and V conversion component data; data compensation is performed on the Y conversion component data, U conversion component data, and V conversion component data through the quantization information; then, corresponding Y component data, U component data, and V component data are obtained through digital wavelet inverse transform; finally, the Y component data, U component data, and V component data are integrated according to the splitting information to obtain pixel data, and the target high-definition video is output.

[0062] A preferred solution of the present invention: data compensation is performed on Y conversion component data, U conversion component data, and V conversion component data through quantization information; including data format compensation for high frequency sub-band data according to the quantization information.

[0063] The data format compensation for the high frequency sub-band data according to the quantization information includes compensating for the missing data after quantization and formatting the data according to the original format so that the data meets the original data format.

[0064] A preferred solution of the present invention: the output target high-definition video converts the integrated pixel data into the pixel format of the target high-definition video according to the original pixel format of the target high-definition video and transmits it.

[0065] The third aspect: A multi-pixel parallel high-definition video sending device, comprising: a memory and a processor coupled to the memory, the memory is used to store application instructions, and the processor is configured to call the application instructions to execute the above-mentioned high-definition video sending method.

[0066] like Figure 2 As shown, the sending device 30 may include but is not limited to: a memory 301 , a processor 302 and a WI FI communication module 303 .

[0067] Memory 301, can be used to: store application instructions and target high-definition video

[0068] The processor 302 may be used to: call the application program instructions stored in the memory 301 to implement Figure 1 The multi-pixel parallel high-definition video sending method based on digital wavelet transform.

[0069] The processor 302 can be used to: convert the acquired pixel data of the target high-definition video to obtain pixel data in YUV pixel format, split each row of the pixel data to obtain Y component data, U component data, and V component data; according to the current LAN bandwidth and the preset compression budget value D of the target video information and the number of pixel data rows N constituting the data packet, determine the size of the sum of the number of bytes of the Y conversion component data, the U conversion component data, and the V conversion component data of the N rows of YUV format pixel data and the compression budget value D, and encapsulate the conversion component data rows of the target high-definition video that meet the conditions into a data packet.

[0070] The processor 302 can be used to obtain target high-definition video information, for example, resolutions of 1920*1200, 1920*1080, 1280*720, 1680*1050, 1600*1200; the target high-definition video includes ultra-high-definition video in YUV format or ultra-high-definition video in RGB format.

[0071] More specifically, the processor 302 may be configured to:

[0072] The target high-definition video obtained through the HDMI to BT1120 interface chip input is analyzed to obtain the resolution, pixel format, etc. of the target video.

[0073] The processor 302 may also be used to: perform quantization processing on the Y conversion component data, the U conversion component data, and the V conversion component data respectively:

[0074] It should be understood that the sending device 30 is only an example provided by an embodiment of the present invention, and the sending device 30 may have more or fewer components than those shown, may combine two or more components, or may have different configurations of components.

[0075] Understandable, about Figure 2 For specific implementations of the functional components included in the sending device 30, please refer to Figure 1 The embodiments are not described in detail here.

[0076] A fourth aspect: A multi-pixel parallel high-definition video receiving device, comprising: a memory and a processor coupled to the memory, the memory being used to store application instructions, and the processor being configured to call the application instructions to execute the above-mentioned high-definition video receiving method.

[0077] The present invention provides a high-definition video receiving device, which can be used to implement Figure 2 The multi-pixel parallel high-definition video receiving method based on digital wavelet transform described in the embodiment. Figure 3 The receiving device shown can be used to perform Figure 2 Description of the embodiments.

[0078] like Figure 3 As shown, the receiving device 40 may include but is not limited to: a memory 401 , a processor 402 and a communication module 403 .

[0079] Memory 401, can be used for: application program instructions

[0080] Processor 402 can be used to: call the application program instructions stored in memory 401 to implement Figure 2 The method for receiving high-definition video.

[0081] WI FI communication module 403 can be a wired network communication module, such as twisted pair CAT5 CAT6, and optical fiber transmission, etc., which can be used to: receive data packets sent by the sending device

[0082] The processor 402 may be used to: decapsulate the data packet received by the WIFI communication module 403 into the custom protocol parameters and the video data;

[0083] The processor 402 may be specifically configured to: determine whether the target high-definition video needs data compensation according to the custom protocol parameters;

[0084] When the target high-definition video does not need data compensation, the corresponding Y component data, U component data, and V component data are obtained by digital wavelet inverse transformation, and the Y component data, U component data, and V component data are integrated by splitting information to obtain pixel data, and the target high-definition video is output;

[0085] When the target high-definition video requires data compensation, the Y conversion component data, U conversion component data, and V conversion component data are compensated by quantization information, and then the corresponding Y component data, U component data, and V component data are obtained by digital wavelet inverse transform. Finally, the Y component data, U component data, and V component data are integrated according to the splitting information to obtain pixel data, and the target high-definition video is output.

[0086] It should be understood that the receiving device 40 is only an example provided in an embodiment of the present invention, and the receiving device 40 may have more or fewer components than those shown, may combine two or more components, or may have different configurations of components.

[0087] Understandable, about Figure 2 For specific implementations of the functional components included in the receiving device 40, please refer to Figure 2 The method embodiments are not described in detail here.

[0088] Those of ordinary skill in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed in the present invention can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0089] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described equipment, devices or modules can refer to the corresponding process in the aforementioned method embodiment and will not be repeated here.

[0090] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, apparatuses or methods can be implemented in other ways. For example, the composition and steps of each example have been described. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0091] The embodiments of the devices and equipment described above are merely illustrative. For example, the division of the modules is merely a logical function division. There may be other division methods in actual implementation, such as multiple modules or components may be combined or integrated into another device, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, devices, apparatuses or modules, or may be an electrical, mechanical or other form of connection.

[0092] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, and may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiments of the present invention.

[0093] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above integrated modules may be implemented in the form of hardware or in the form of software functional modules.

[0094] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0095] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A multi-pixel parallel high-definition video transmission method, characterized in that: include: Obtain a target high-definition video, extract pixel data in the target high-definition video and convert the data into a YUV pixel format; Each row of pixel data is split to obtain Y component data, U component data, and V component data; The Y component data, the U component data, and the V component data are respectively transformed by digital wavelet to obtain Y conversion component data, U conversion component data, and V conversion component data; According to the current LAN bandwidth and the preset compression budget value D of the target video information, and the number of pixel data rows N constituting the data packet, the sum of the number of bytes of the Y conversion component data, the U conversion component data, and the V conversion component data of the N rows of YUV format pixel data and the compression budget value D are determined; When the sum of the number of bytes is greater than the compression budget value D, the Y conversion component data, the U conversion component data, and the V conversion component data are quantized respectively until the sum of the number of bytes is less than or equal to the compression budget value D, and the quantized Y conversion component data, U conversion component data, and V conversion component data are packaged and sent as data packets through a custom protocol; When the sum of the number of bytes is less than or equal to the compression budget value D, the Y conversion component data, U conversion component data, and V conversion component data are not quantized, and the Y conversion component data, U conversion component data, and V conversion component data are packaged and sent as data packets through a custom protocol.

2. The multi-pixel parallel high-definition video transmission method according to claim 1, characterized in that: The compression budget value D and the number of YUV format pixel data rows N constituting the data packet are preset according to the current LAN bandwidth and the target video information; The target video information includes frame rate and resolution; The number N of pixel data rows constituting the data packet is 2 or 4; The compression budget 3. The multi-pixel parallel high-definition video transmission method according to claim 2, characterized in that: The Y component data, the U component data, and the V component data are respectively transformed by digital wavelet to obtain Y conversion component data, U conversion component data, and V conversion component data; Set the Y component data, U component data, and V component data to X i The Y conversion component data, the U conversion component data, and the V conversion component data are respectively composed of the high frequency sub-band data P i and low-frequency sub-band data to form Qi, where X i {X0,X1,X2,...X 2n-1 } (1) 4. The multi-pixel parallel high-definition video transmission method according to claim 3, characterized in that: The Y conversion component data, the U conversion component data, and the V conversion component data are quantized respectively, including quantizing the high frequency sub-band P in the Y conversion component data, the U conversion component data, and the V conversion component data. i Quantify.

5. The multi-pixel parallel high-definition video transmission method according to any one of claims 1 to 4, characterized in that: The data packets are packaged and sent through a custom protocol, and the custom protocol packages the Y conversion component data, the U conversion component data, and the V conversion component data respectively, and adds header information at the end of the data packet, and the header information includes the packet sequence number, splitting information, and quantization information of the data packet.

6. A multi-pixel parallel high-definition video receiving method, characterized in that: Receive the data packet of the target high-definition video and obtain the header information of the data packet; When the packet header information includes a packet sequence number and splitting information, the data packet is decapsulated to obtain Y conversion component data, U conversion component data, and V conversion component data, corresponding Y component data, U component data, and V component data are obtained by digital wavelet inverse transformation, the Y component data, U component data, and V component data are integrated by the splitting information to obtain pixel data, and a target high-definition video is output; When the packet header information includes a packet sequence number, splitting information, and quantization information, the data packet is decapsulated to obtain Y conversion component data, U conversion component data, and V conversion component data; data compensation is performed on the Y conversion component data, U conversion component data, and V conversion component data through the quantization information; then, corresponding Y component data, U component data, and V component data are obtained through digital wavelet inverse transform; finally, the Y component data, U component data, and V component data are integrated according to the splitting information to obtain pixel data, and the target high-definition video is output.

7. The multi-pixel parallel high-definition video receiving method according to claim 6, characterized in that: Data compensation is performed on the Y conversion component data, the U conversion component data, and the V conversion component data through the quantization information, including data format compensation for the high frequency sub-band data according to the quantization information.

8. The multi-pixel parallel high-definition video receiving method according to claim 6, characterized in that: The output target high-definition video converts the integrated pixel data into the pixel format of the target high-definition video according to the original pixel format of the target high-definition video and transmits it.

9. A multi-pixel parallel high-definition video transmission device, characterized in that: include: A memory and a processor coupled to the memory, wherein the memory is used to store application instructions, and the processor is configured to call the application instructions to execute the high-definition video sending method according to any one of claims 1 to 5.

10. A multi-pixel parallel high-definition video receiving device, characterized in that: include: A memory and a processor coupled to the memory, wherein the memory is used to store application instructions, and the processor is configured to call the application instructions to execute the high-definition video receiving method as described in any one of claims 6 to 8.

Images