Image compression processing method, device, electronic device and storage medium

Abstract

The present invention provides an image compression processing method, apparatus, electronic device, and storage medium, wherein the method comprises: obtaining a Bayer image to be processed; wherein the Bayer image to be processed adopts a GRBG* color arrangement; formatting the GRBG* color arrangement data of the Bayer image to be processed to obtain target color array data; filtering based on a combination of channel data in the target color array data; and compressing the filtered target color array data. The image compression processing method, apparatus, electronic device, and storage medium provided by the present invention consider both the correlation of pixels in the same color space and the correlation between adjacent channels of pixels, reducing redundancy between pixels and thereby improving compression efficiency.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to an image compression processing method, device, electronic equipment and storage medium. Background Art

[0002] A wireless capsule endoscope is a medical device used to examine the gastrointestinal tract. It consists of a capsule containing a micro-camera, a light-emitting diode (LED), a battery, and a radio transmitter. As the capsule passes through the digestive tract, the micro-camera continuously captures images and transmits these images to the outside of the body for medical examinations. Because wireless capsule endoscopes are battery-powered, image compression is often required to reduce power consumption during transmission.

[0003] In the related art, the red, green and blue color channels of the image collected by the wireless capsule endoscope are usually low-pass filtered and compressed respectively.

[0004] However, in the above-mentioned related technologies, the three color channels are filtered and compressed separately, and only the correlation of pixels in the same color space is considered, which increases the redundancy between pixels and thus reduces the compression efficiency. Summary of the Invention

[0005] In view of the problems existing in the prior art, embodiments of the present invention provide an image compression processing method, device, electronic device and storage medium.

[0006] The present invention provides an image compression processing method, comprising:

[0007] Obtaining a Bayer image to be processed; wherein the Bayer image to be processed adopts a GRBG* color arrangement;

[0008] Convert the GRBG* color array data of the Bayer image to be processed into a target color array data;

[0009] Performing filtering based on a combination of channel data in the target color array data;

[0010] The filtered target color array data is compressed.

[0011] According to an image compression processing method provided by the present invention, the format of the GRBG* color arrangement data of the Bayer image to be processed is converted to obtain target color array data, including:

[0012] For each set of preset number of rows of the GRBG* color arrangement data, the G channel data of each of the GRBG* color arrangement data are continuously arranged; wherein the G channel data includes the G channel data and G* channel data in the GRBG* color arrangement data;

[0013] Continuously arranging the R channel data of each of the GRBG* data on a first side of all of the G channel data;

[0014] The B channel data of each of the GRBG* data is continuously arranged on the second side of the G channel data to obtain the target color array data.

[0015] According to an image compression processing method provided by the present invention, the filtering based on the combination of each channel data in the target color array data includes:

[0016] Filtering the R channel data based on the G channel data, the G* channel data, and the R channel data in the target color array data;

[0017] The B channel data is filtered based on the G channel data, the G* channel data, and the B channel data in the target color array data.

[0018] According to an image compression processing method provided by the present invention, filtering the R channel data based on the G channel data, the G* channel data, and the R channel data in the target color array data includes:

[0019] Filtering the R channel data based on formula (1);

[0020]

[0021]

[0022] in, represents the filtered R channel data, n represents the row number of the matrix composed of the R channel data or the B channel data in the target color array data, m represents the column number of the matrix composed of the R channel data or the B channel data in the target color array data, and I represents the channel data in the target color array data.

[0023] According to an image compression processing method provided by the present invention, filtering the B channel data based on the G channel data, the G* channel data, and the B channel data in the target color array data includes:

[0024] Filter the B channel data based on formula (2);

[0025]

[0026] in, Indicates the B channel data after filtering.

[0027] The present invention also provides an image compression processing device, comprising:

[0028] An acquisition unit, configured to acquire a Bayer image to be processed; wherein the Bayer image to be processed adopts a GRBG* color arrangement;

[0029] a conversion unit, configured to convert the format of the GRBG* color arrangement data of the Bayer image to be processed to obtain target color array data;

[0030] a filtering unit, configured to perform filtering based on a combination of channel data in the target color array data;

[0031] The processing unit is used to compress the filtered target color array data.

[0032] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the above-described image compression processing methods when executing the program.

[0033] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which implements the steps of any of the above-mentioned image compression processing methods when executed by a processor.

[0034] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the steps of any one of the above-mentioned image compression processing methods are implemented.

[0035] The present invention provides an image compression processing method, device, electronic device, and storage medium. After converting the GRBG* color arrangement data of the Bayer image to be processed into target color array data, filtering is performed based on the combination of each channel data in the target color array data. This takes into account both the correlation of pixels in the same color space and the correlation between adjacent channels of pixels, reduces redundancy between pixels, and thus improves compression efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0037] Figure 1 It is a flowchart of the image compression processing method provided by the present invention;

[0038] Figure 2 This is one of the schematic diagrams of the GRBG* color arrangement provided by the present invention;

[0039] Figure 3 This is the second schematic diagram of the GRBG* color arrangement provided by the present invention;

[0040] Figure 4 Schematic diagram of converting GRBG* color array data into target color array data provided by the present invention;

[0041] Figure 5 It is a structural schematic diagram of the image compression processing device provided by the present invention;

[0042] Figure 6 It is a schematic diagram of the physical structure of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0043] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0044] The following combination Figure 1-Figure 4 The image compression processing method of the present invention is described.

[0045] Figure 1 FIG. 1 is a flow chart of the image compression processing method provided by the present invention, as shown in FIG. Figure 1 As shown, the image compression processing method includes the following steps:

[0046] Step 101: Obtain a Bayer image to be processed.

[0047] The Bayer image to be processed adopts the GRBG* color arrangement.

[0048] For example, an original Bayer image captured by a capsule endoscope is obtained, and the original Bayer image is arranged in GRBG* color to obtain a Bayer image to be processed, where each GRBG* color arrangement corresponds to a 2*2 pixel block. Figure 2 This is one of the schematic diagrams of the GRBG* color arrangement provided by the present invention, such as Figure 2As shown, the upper left pixel of the 2*2 pixel block is marked as G, indicating the data of the G channel; the upper right pixel is marked as B, indicating the data of the B channel; the lower left pixel is marked as R, indicating the data of the R channel; the lower right pixel is marked as G*, indicating the data of the G* channel, and all the data of the original Bayer image are arranged in this way.

[0049] Figure 3 This is the second schematic diagram of the GRBG* color arrangement provided by the present invention, such as Figure 3 As shown, the data of each channel is marked according to the row and column, and a pixel block with a resolution of 8*8 is obtained. For example, Figure 3 G in 11 Represents the G channel data of the pixel in the first row and first column, G 24 * Represents the G* channel data of the pixel in the second row and fourth column, B 16 Represents the B channel data of the pixel in the first row and sixth column, R 25 Represents the R channel data of the pixel in the second row and fifth column.

[0050] It should be noted that G represents green, R represents red, and B represents blue.

[0051] Step 102: Convert the format of the GRBG* color arrangement data of the Bayer image to be processed to obtain target color array data.

[0052] Optionally, for each group of preset number of rows of GRBG* color arrangement data, the G channel data of each GRBG* color arrangement data is arranged continuously; wherein the G channel data includes the G channel data and G* channel data in the continuously arranged GRBG*; the R channel data of each GRBG* data is arranged continuously on the first side of all the G channel data; and the B channel data of each GRBG* data is arranged continuously on the second side of the G channel data, to obtain the target color array data.

[0053] For example, all data arranged in GRBG* colors need to be format-converted. Assuming that the preset number of rows is two rows, the data of every two rows are mixed together for conversion. The purpose of the format conversion is to achieve separation of color channels.

[0054] Figure 4 Schematic diagram of converting GRBG* color array data into target color array data provided by the present invention, as shown in FIG. Figure 4 As shown, for the first two rows of 4 2*2 pixel blocks, the G in the first 2*2 pixel block is 11 and G 22 *Arrange them continuously, and then arrange the G in the second 2*2 pixel block continuously 13 and G 24 * , then arrange the G in the third 2*2 pixel block continuously 15 and G 26 * , and then arrange the G in the fourth 2*2 pixel block continuously 17 and G 28 * ; Then B in 4 2*2 pixel blocks 12 、B 14 、B 16 and B 18 Arrange them on the first side of all the markers G (for example, the first side is the left side), and finally put the R in the four 2*2 pixel blocks 21 、R 23 、R 25 and R 27 The pixel blocks in other rows are converted into the same format using the same method. The target color matrix data is as follows: Figure 4 shown.

[0055] Step 103: Filter based on a combination of channel data in the target color array data.

[0056] Optionally, the R channel data is filtered based on the G channel data, the G* channel data and the R channel data in the target color array data.

[0057] Specifically, the R channel data is filtered based on formula (1);

[0058]

[0059] in, represents the filtered R channel data, n represents the row number of the matrix composed of the R channel data or the B channel data in the target color array data, m represents the column number of the matrix composed of the R channel data or the B channel data in the target color array data, It represents rounding down the included data, and I represents the channel data in the target color array data.

[0060] For example, when filtering the R channel data, all R channel data in the first column are not filtered, that is, when m=1, the R channel data before filtering is equal to the R channel data after filtering; all R channel data except the first column need to be filtered.

[0061] When n=1, m=2,

[0062] When n=1, m=3,

[0063] When n=1, m=4,

[0064] When n=2, m=2,

[0065] When n=2, m=3,

[0066] When n=2, m=4,

[0067] When n=3, m=2,

[0068] When n=3, m=3,

[0069] When n=3, m=4,

[0070] When n=4, m=2,

[0071] When n=4, m=3,

[0072] When n=4, m=4,

[0073] From the above filtering method, it can be seen that when filtering the data of each R channel, it is filtered based on the data of the G channel, the data of the G* channel, and the data of the R channel. It can be seen that when filtering the data of the R channel, the data of the G channel and the G* channel are combined, reflecting the correlation between adjacent channels of pixels; the combination of the data of the G channel and the G* channel reflects the correlation between pixels in the same color space, thereby reducing the high-frequency components between pixels, reducing the redundancy between pixels, and ensuring the accuracy of the image data.

[0074] It should be noted that for the pixel points participating in the filtering at the edge of the image, the extension filling method is adopted. For example, in the case of n=4, m=4, for R 87 When filtering, you need to 87 Add 0 below, that is 0 in .

[0075] Optionally, the B channel data is filtered based on the G channel data, the G* channel data and the B channel data in the target color array data.

[0076] Specifically, the B channel data is filtered based on formula (2);

[0077]

[0078] in, Indicates the B channel data after filtering.

[0079] For example, when filtering the B channel data, all B channel data in the first row are not filtered, that is, when n=1, the B channel data before filtering is equal to the B channel data after filtering; all B channel data except the first row need to be filtered.

[0080] When n=2, m=1,

[0081] When n=2, m=2,

[0082] When n=2, m=3,

[0083] When n=2, m=4,

[0084] When n=3, m=1,

[0085] When n=3, m=2,

[0086] When n=3, m=3,

[0087] When n=3, m=4,

[0088] When n=4, m=1,

[0089] When n=4, m=2,

[0090] When n=4, m=3,

[0091] When n=4, m=4,

[0092] From the above filtering method, it can be seen that when filtering the data of each B channel, it is filtered based on the data of the G channel, the data of the G* channel, and the data of the B channel. It can be seen that when filtering the data of the B channel, the data of the G channel and the G* channel are combined, reflecting the correlation between adjacent channels of pixels; the combination of the data of the G channel and the G* channel reflects the correlation between pixels in the same color space, thereby reducing the high-frequency components between pixels, reducing redundancy between pixels, and ensuring the accuracy of the image data.

[0093] Step 104: compress the filtered target color array data.

[0094] For example, the filtered target color array data is losslessly compressed using one of JPEG2000 lossless compression, FELICS and JPEG-LS lossless compression methods, thereby improving the image data compression ratio.

[0095] The present invention provides an image compression processing method. After converting the GRBG* color arrangement data of the Bayer image to be processed into target color array data, filtering is performed based on the combination of each channel data in the target color array data. This method takes into account both the correlation of pixels in the same color space and the correlation between adjacent channels of pixels, reduces redundancy between pixels, and thus improves compression efficiency.

[0096] In addition, during filtering, the correlation between adjacent channels of pixels and the correlation between pixels in the same color space are reflected, thereby reducing the high-frequency components between pixels, reducing the redundancy between pixels, and ensuring the accuracy of image data; moreover, the complexity of the operation is low, and it is easy to realize real-time processing of continuous images; at the same time, the image data has a greater compression ratio, reducing the power consumption brought by the image data and reducing the bandwidth of image communication; and the algorithm of the present invention is simple and easy to embed.

[0097] The image compression processing device provided by the present invention is described below. The image compression processing device described below and the image compression processing method described above can be referred to in correspondence with each other.

[0098] Figure 5 FIG. 1 is a schematic diagram of the structure of the image compression processing device provided by the present invention. Figure 5 As shown, the image compression processing device includes an acquisition unit 501, a conversion unit 502, a filtering unit 503 and a processing unit 504; wherein:

[0099] An acquisition unit 501 is configured to acquire a Bayer image to be processed; wherein the Bayer image to be processed adopts a GRBG* color arrangement;

[0100] The conversion unit 502 is used to convert the format of the GRBG* color arrangement data of the Bayer image to be processed to obtain target color array data;

[0101] A filtering unit 503 is configured to perform filtering based on a combination of channel data in the target color array data;

[0102] The processing unit 504 is configured to compress the filtered target color array data.

[0103] The present invention provides an image compression processing device, which converts the GRBG* color arrangement data of the Bayer image to be processed into target color array data and then performs filtering based on the combination of each channel data in the target color array data. This takes into account both the correlation of pixels in the same color space and the correlation between adjacent channels of pixels, reduces redundancy between pixels, and thus improves compression efficiency.

[0104] Based on any of the above embodiments, the conversion unit 502 is specifically configured to:

[0105] For each set of preset number of rows of the GRBG* color arrangement data, the G channel data of each of the GRBG* color arrangement data are continuously arranged; wherein the G channel data includes the G channel data and G* channel data in the GRBG* color arrangement data;

[0106] Continuously arranging the R channel data of each of the GRBG* data on a first side of all of the G channel data;

[0107] The B channel data of each of the GRBG* data is continuously arranged on the second side of the G channel data to obtain the target color array data.

[0108] Based on any of the above embodiments, the filtering unit 503 is specifically configured to:

[0109] Filtering the R channel data based on the G channel data, the G* channel data, and the R channel data in the target color array data;

[0110] The B channel data is filtered based on the G channel data, the G* channel data, and the B channel data in the target color array data.

[0111] Based on any of the above embodiments, the filtering unit 503 is specifically configured to:

[0112] Filtering the R channel data based on formula (1);

[0113]

[0114] in, represents the filtered R channel data, n represents the row number of the matrix composed of the R channel data or the B channel data in the target color array data, m represents the column number of the matrix composed of the R channel data or the B channel data in the target color array data, and I represents the channel data in the target color array data.

[0115] Based on any of the above embodiments, the filtering unit 503 is specifically configured to:

[0116] Filter the B channel data based on formula (2);

[0117]

[0118] in, Indicates the B channel data after filtering.

[0119] Figure 6 This is a schematic diagram of the physical structure of the electronic device provided by the present invention, such as Figure 6 As shown, the electronic device may include: a processor 610, a communication interface 620, a memory 630, and a communication bus 640, wherein the processor 610, the communication interface 620, and the memory 630 communicate with each other via the communication bus 640. The processor 610 may call logic instructions in the memory 630 to execute an image compression processing method, which includes: obtaining a Bayer image to be processed; wherein the Bayer image to be processed adopts a GRBG* color arrangement;

[0120] Convert the GRBG* color array data of the Bayer image to be processed into a target color array data;

[0121] Performing filtering based on a combination of channel data in the target color array data;

[0122] The filtered target color array data is compressed.

[0123] In addition, the logic instructions in the above-mentioned memory 630 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0124] On the other hand, the present invention further provides a computer program product, comprising a computer program, which may be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can perform the image compression processing method provided by the above methods, the method comprising: obtaining a Bayer image to be processed; wherein the Bayer image to be processed adopts a GRBG* color arrangement;

[0125] Convert the GRBG* color array data of the Bayer image to be processed into a target color array data;

[0126] Performing filtering based on a combination of channel data in the target color array data;

[0127] The filtered target color array data is compressed.

[0128] In another aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the image compression processing method provided by the above methods is implemented. The method comprises: obtaining a Bayer image to be processed; wherein the Bayer image to be processed adopts a GRBG* color arrangement;

[0129] Convert the GRBG* color array data of the Bayer image to be processed into a target color array data;

[0130] Performing filtering based on a combination of channel data in the target color array data;

[0131] The filtered target color array data is compressed.

[0132] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0133] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, or of course, by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the existing technology can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or certain parts of the embodiments.

[0134] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. An image compression processing method, characterized in that: include: Obtaining a Bayer image to be processed; wherein the Bayer image to be processed adopts a GRBG* color arrangement; Performing format conversion on the GRBG* color arrangement data of the Bayer image to be processed to obtain target color array data, wherein the format conversion is used to achieve separation of color channels; Performing filtering based on a combination of channel data in the target color array data; compressing the filtered target color array data; The filtering based on a combination of channel data in the target color array data includes: Filtering the R channel data based on the G channel data, the G* channel data, and the R channel data in the target color array data; Filtering the B channel data based on the G channel data, the G* channel data, and the B channel data in the target color array data; The step of converting the GRBG* color arrangement data of the Bayer image to be processed to obtain target color array data includes: For each set of preset number of rows of the GRBG* color arrangement data, the G channel data of each of the GRBG* color arrangement data are continuously arranged; wherein the G channel data includes the G channel data and G* channel data in the GRBG* color arrangement data; Continuously arranging the R channel data of each of the GRBG* data on a first side of all of the G channel data; Continuously arranging the B channel data of each of the GRBG* data on the second side of the G channel data to obtain the target color array data; The filtering of the R channel data based on the G channel data, the G* channel data, and the R channel data in the target color array data includes: Filtering the R channel data based on formula (1); in, represents the filtered R channel data, n represents the row number of the matrix composed of the R channel data or the B channel data in the target color array data, m represents the column number of the matrix composed of the R channel data or the B channel data in the target color array data, and I represents the channel data in the target color array data; The filtering of the B channel data based on the G channel data, the G* channel data, and the B channel data in the target color array data includes: Filter the B channel data based on formula (2); in, Indicates the B channel data after filtering.

2. An image compression processing device, characterized in that: include: An acquisition unit, configured to acquire a Bayer image to be processed; wherein the Bayer image to be processed adopts a GRBG* color arrangement; a conversion unit, configured to perform format conversion on the GRBG* color arrangement data of the Bayer image to be processed to obtain target color array data, wherein the format conversion is used to achieve separation of color channels; a filtering unit, configured to perform filtering based on a combination of channel data in the target color array data; a processing unit, configured to compress the filtered target color array data; The filtering unit is specifically used for: Filtering the R channel data based on the G channel data, the G* channel data, and the R channel data in the target color array data; Filtering the B channel data based on the G channel data, the G* channel data, and the B channel data in the target color array data; The conversion unit is specifically used for: For each set of preset number of rows of the GRBG* color arrangement data, the G channel data of each of the GRBG* color arrangement data are continuously arranged; wherein the G channel data includes the G channel data and G* channel data in the GRBG* color arrangement data; Continuously arranging the R channel data of each of the GRBG* data on a first side of all of the G channel data; Continuously arranging the B channel data of each of the GRBG* data on the second side of the G channel data to obtain the target color array data; The filtering unit is specifically used for: Filtering the R channel data based on formula (1); in, represents the filtered R channel data, n represents the row number of the matrix composed of the R channel data or the B channel data in the target color array data, m represents the column number of the matrix composed of the R channel data or the B channel data in the target color array data, and I represents the channel data in the target color array data; The filtering unit is specifically used for: Filter the B channel data based on formula (2); in, Indicates the B channel data after filtering.

3. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the steps of the image compression processing method according to claim 1 are implemented.

4. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the image compression processing method according to claim 1 are implemented.

5. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the image compression processing method according to claim 1 are implemented.

Images