Encoding device and program
The encoding device addresses encoding inefficiencies by generating filters and using secondary units for intra- and inter-screen predictions, enhancing encoding efficiency and accuracy.
Patent Information
- Application Number
- JP2021003740
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-01-13
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2041-01-13
AI Technical Summary
Conventional encoding technologies suffer from artifacts such as blurring and block distortion when encoding difficult-to-encode moving images, leading to reduced encoding efficiency.
An encoding device that generates filters to alter image frequency components, performs spatial high frequency power analysis, and uses secondary units for intra- and inter-screen predictions, increasing the variety and difference of filter coefficients based on encoding difficulty.
Improves image compression encoding efficiency by enhancing intra- and inter-screen predictions with secondary units, thereby improving coding accuracy and efficiency.
Smart Images

Figure 0007581060000006 
Figure 0007581060000007 
Figure 0007581060000008
Abstract
Description
[Technical field]
[0001] The present invention relates to an encoding device and a program. [Background technology]
[0002] It is known that video coding is performed using pixel correlation in H.265 / HEVC (High Efficiency Video Coding), H.266 / VVC (Versatile Video Coding), etc. (see, for example, Non-Patent Document 1). In intra-frame prediction, prediction is performed using peripheral pixels belonging to decoded units above or to the left of the unit to be predicted. In inter-frame prediction, prediction is performed using decoded units in frames before and after the unit to be predicted. In general, when the unit to be predicted and the peripheral pixels belonging to the decoded units above or to the left of the unit to be predicted are the same object, or when the unit to be predicted and the decoded units in the frames before and after the unit to be predicted are the same object, pixel correlation between the same objects is considered to be high, and therefore intra-frame and inter-frame prediction can be performed with high accuracy. [Prior art documents] [Non-patent literature]
[0003] [Non-Patent Document 1] Edited by Eiichiro Okubo, "Impress Standard Textbook Series H.265 / HEVC Textbook," Impress Japan Co., Ltd., October 21, 2013 Summary of the Invention [Problem to be solved by the invention]
[0004] However, when conventional coding techniques are used to code moving images that are extremely difficult to code, there is a problem in that artifacts such as blurring and block distortion are likely to occur in the decoded units, and coding efficiency is likely to decrease.
[0005] In view of the above circumstances, an object of the present invention is to provide a coding device and a program capable of improving coding efficiency. [Means for solving the problem]
[0006] An encoding device according to one embodiment is an encoding device that encodes an original image, the encoding device including: a filter generation unit that generates a filter that changes a frequency component of the image; and a secondary unit generation unit that applies the filter to a decoded unit that is obtained by encoding a divided block of the original image and then decoding the decoded unit to generate a secondary unit. a spatial high frequency power analysis unit that calculates the variation and magnitude of spatial high frequency power in the decoded unit; an intra prediction unit that performs intra prediction by referring to the decoded unit and the secondary unit; and an inter prediction unit that performs inter prediction by referring to the decoded unit and the secondary unit. The filter generating unit increases the number of types of filters as the variation in the spatial high-frequency power increases, and increases the difference between the maximum and minimum values of the filter coefficients as the magnitude of the spatial high-frequency power increases. do.
[0009] Furthermore, in one embodiment, the spatial high frequency power analysis unit may perform an orthogonal transform on the decoded unit to obtain the power of each element, and may determine the sum of the powers of elements in the high frequency region whose frequencies exceed a threshold as the spatial high frequency power of the decoded unit.
[0010] Furthermore, in one embodiment, a residual signal power analysis unit is provided that determines the variance and magnitude of residual signal power indicating the power of a differential signal between the decoded unit and the original image, and the filter generation unit may be configured to increase the number of filter types as the variance of the residual signal power increases, and to increase the difference between the maximum and minimum values of the filter coefficients as the magnitude of the residual signal power increases.
[0011] Furthermore, in one embodiment, an encoding quality analysis unit is provided that determines the variance and magnitude of the quantization parameter used when generating the decoded unit, and the filter generation unit may increase the number of filter types as the variance of the quantization parameter increases, and increase the difference between the maximum and minimum values of the filter coefficients as the magnitude of the quantization parameter increases.
[0012] Furthermore, in one embodiment, the apparatus includes a residual signal power analysis unit that determines the variance and magnitude of residual signal power indicating the power of a differential signal between the decoded unit and the original image, and an encoding quality analysis unit that determines the variance and magnitude of a quantization parameter used when generating the decoded unit, and the filter generation unit may increase the number of filter types as the variance of the spatial high frequency power, the residual signal power, or the quantization parameter increases, and increase the difference between the maximum and minimum values of the filter coefficients as the variance of the spatial high frequency power, the residual signal power, or the magnitude of the quantization parameter increases.
[0013] Furthermore, in one embodiment, the secondary unit generation unit may perform an orthogonal transform on the decoded unit to generate orthogonal transform coefficients, multiply the orthogonal transform coefficients by a matrix that transforms the filter to a size of the decoded unit to generate filtered orthogonal transform coefficients, and perform an inverse orthogonal transform on the filtered orthogonal transform coefficients to generate the secondary unit.
[0014] Moreover, a program according to an embodiment causes a computer to function as the encoding device. Effect of the Invention
[0015] According to the present invention, it is possible to improve the efficiency of image compression encoding. [Brief description of the drawings]
[0016] [Figure 1] 1 is a block diagram showing an example of the configuration of an encoding device according to an embodiment. FIG. [Diagram 2] 2 is a block diagram showing an example of the configuration of an image processing unit in an encoding device according to an embodiment. FIG. [Diagram 3] 11 is a diagram illustrating an example of processing by a spatial high frequency power analysis unit in the encoding device according to an embodiment. FIG. [Figure 4] 10A to 10C are diagrams illustrating an example of processing by a secondary unit generation unit in an encoding device according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] Hereinafter, one embodiment will be described in detail with reference to the drawings.
[0018] Fig. 1 is a block diagram showing an example of the configuration of an encoding device according to an embodiment. The encoding device 1 shown in Fig. 1 includes an image processing unit 10, a block division unit 11, a subtraction unit 12, a conversion unit 13, a visual activity calculation unit 14, a QP determination unit 15, a quantization unit 16, a dequantization unit 17, an inverse conversion unit 18, an addition unit 19, a frame memory 20, an intra-screen prediction unit 21, an inter-screen prediction unit 22, a switching unit 23, and an entropy encoding unit 24.
[0019] The block division unit 11 divides an input image (original image) into divided blocks, generates them as coding units (CUs), and outputs them to the subtraction unit 12, the visual activity calculation unit 14, and the inter prediction unit 22.
[0020] The subtraction unit 12 subtracts each pixel value of the prediction unit input from the intra-screen prediction unit 21 or the inter-screen prediction unit 22 described later from each pixel value of the coding unit input from the block division unit 11 to generate a residual signal indicating the difference between the coding unit and the prediction unit and the pixel values, and outputs the residual signal to the conversion unit 13.
[0021] The transform unit 13 further divides the residual signal input from the subtraction unit 12 into transform units (TUs), performs a transform process such as an orthogonal transform for each TU, calculates transform coefficients, and outputs the transform coefficients to the quantization unit 16.
[0022] The visual activity calculation unit 14 calculates the visual activity of the coding unit input from the block division unit 11, and outputs the calculated visual activity to the QP determination unit 15. If the coding unit contains many high frequency components, the visual activity becomes large, and if the coding unit does not contain many high frequency components, the visual activity becomes small.
[0023] The QP determination unit 15 determines a quantization parameter (QP value) based on the visual activity input from the visual activity calculation unit 14, and outputs the quantization parameter to the quantization unit 16 and the image processing unit 10.
[0024] The quantization unit 16 generates quantization coefficients by dividing the transformation coefficients input from the transformation unit 13 by a quantization step corresponding to the QP value input from the QP determination unit 15 and quantizing the quantized coefficients, and outputs the quantized coefficients to the inverse quantization unit 17 and the entropy coding unit 24.
[0025] The inverse quantization unit 17 restores the transform coefficients by multiplying the quantization coefficients input from the quantization unit 16 by the quantization step, and outputs the restored transform coefficients to the inverse transform unit 18.
[0026] The inverse transform unit 18 performs inverse transform processing (processing for undoing the transform performed by the transform unit 13) on the transform coefficients input from the inverse quantization unit 17 to restore a residual signal, and outputs the residual signal to the addition unit 19. For example, when the transform unit 13 performs a discrete cosine transform, the inverse transform unit 18 performs an inverse discrete cosine transform.
[0027] The adder 19 adds the residual signal input from the inverse transformer 18 and the prediction unit input from the switcher 23 to generate a decoded unit, and outputs the decoded unit to the frame memory 20 and the intra prediction unit 21 .
[0028] The frame memory 20 stores the decoded unit input from the adder 19 .
[0029] The inverse quantization unit 17, the inverse transform unit 18, and the addition unit 19 constitute a local decoding unit. That is, the local decoding unit multiplies the quantization coefficient by the quantization step to restore the transform coefficient, performs an inverse transform process on the transform coefficient to restore a residual signal, and adds the residual signal to a prediction unit to generate a decoded unit.
[0030] The image processing unit 10 performs image processing on the decoded units (i.e., decoded units used for intra prediction and inter prediction) input from the adder 19 and the frame memory 20 to generate secondary units, and outputs the secondary units to the intra prediction unit 21 and the inter prediction unit 22. The image processing unit 10 will be described in detail later.
[0031] The intra prediction unit 21 performs intra prediction (intra prediction) for each prediction unit (PU: Prediction Unit) with reference to the secondary unit input from the image processing unit 10 and the decoded unit input from the adder 19 to generate an intra prediction image, and outputs it to the switching unit 23. While conventional encoding devices perform intra prediction with reference to only the decoded unit, the encoding device 1 differs in that it performs intra prediction with reference to the secondary unit in addition to the decoded unit.
[0032] The inter prediction unit 22 divides the coding unit input from the block division unit 11 into prediction units. Then, the inter prediction unit 22 references the secondary unit input from the image processing unit 10 and the decoded unit input from the frame memory 20 to generate a motion vector for each prediction unit by a technique such as block matching. The inter prediction unit 22 performs motion compensation prediction based on the motion vector for each prediction unit to generate an inter prediction image, and outputs it to the switching unit 23. A conventional encoding device performs inter prediction by referring only to the decoded unit, but the encoding device 1 differs in that it performs inter prediction by referring to the secondary unit in addition to the decoded unit.
[0033] The switching unit 23 switches between the intra prediction image input from the intra prediction unit 21 and the inter prediction image input from the inter prediction unit 22 to obtain a prediction image, and outputs the prediction image to the subtraction unit 12 and the addition unit 19.
[0034] The entropy coding unit 24 performs entropy coding on the quantization coefficients input from the quantization unit 16, the prediction mode information input from the intra prediction unit 21, the motion vector information input from the inter prediction unit 22, and the like, compresses the data, generates a bit stream, and outputs it to the outside of the coding device 1. For the entropy coding, any entropy coding method such as zeroth-order exponential Golomb coding or context-based adaptive binary arithmetic coding (CABAC) can be used.
[0035] <Image processing unit> Next, the processing of the image processing unit 10 will be described. Fig. 2 is a block diagram showing an example of the configuration of the image processing unit 10. The image processing unit 10 shown in Fig. 2 includes a spatial high frequency power analysis unit 101, a residual signal power analysis unit 102, an encoding quality analysis unit 103, a filter generation unit 104, and a secondary unit generation unit 105. The image processing unit 10 may include at least one of the spatial high frequency power analysis unit 101, the residual signal power analysis unit 102, and the encoding quality analysis unit 103. The decoded unit input (acquired) by the image processing unit 10 is a decoded unit used for intra prediction and inter prediction, which is decoded after encoding a divided block of an original image.
[0036] The spatial high frequency power analysis unit 101 finds the variation and magnitude of spatial high frequency power in the decoded units input from the adder 19 and the frame memory 20, and outputs the results to the filter generation unit 104. For example, the spatial high frequency power analysis unit 101 finds a standard deviation value as the variation, and a representative value (e.g., the maximum value) as the magnitude.
[0037] The spatial high frequency power analysis unit 101 performs an orthogonal transform on the decoded unit to obtain the power of each element, and the sum of the powers of the elements in the high frequency region whose frequencies exceed a threshold is regarded as the spatial high frequency power of the decoded unit. Note that the spatial high frequency power analysis unit 101 may divide the decoded unit into block regions and apply an orthogonal transform to each block for processing.
[0038] A method of calculating spatial high frequency power by the spatial high frequency power analysis unit 101 will be specifically described with reference to Fig. 3. Fig. 3 is a diagram for explaining an example of a method of calculating spatial high frequency power by the spatial high frequency power analysis unit 101. Fig. 3 shows decoded units when performing intra-frame prediction. The spatial high frequency power analysis unit 101 performs the same process for each decoded unit, but Fig. 3 illustrates the process for the decoded unit U-1. The spatial high frequency power analysis unit 101 divides the decoded unit U-1 into block regions (blocks 1, 2, ...), applies an orthogonal transform such as Type-II DCT, and then calculates the average value of power for each element position of all blocks.
[0039] Next, the spatial high frequency power analysis unit 101 converts the average value of the power for each element position of all blocks into a one-dimensional data string using a zigzag scan or the like, and determines the sum of the power of elements higher than the threshold value α as the spatial high frequency power of the decoded unit U-1. The threshold value α is, for example, half the value of the number of elements in the block. The spatial high frequency power analysis unit 101 similarly determines the spatial high frequency power for all decoded units (decoded units U-2, U-3, ...), and then calculates their variation and magnitude.
[0040] The residual signal power analysis unit 102 calculates the variance and magnitude of the residual signal power indicating the power of the difference signal between the decoded unit input from the adder 19 and frame memory 20 and the encoding unit (i.e., the original image) input from the block division unit 11, and outputs the variance and magnitude to the filter generation unit 104. For example, the residual signal power analysis unit 102 calculates a standard deviation value as the variance and a representative value (e.g., the maximum value) as the magnitude.
[0041] The encoding quality analysis unit 103 obtains a QP value used in generating a decoded unit input from the adder 19 and the frame memory 20 by performing the same processing as the visual activity calculation unit 14 and the QP determination unit 15. Alternatively, the encoding quality analysis unit 103 inputs a QP value used in generating a decoded unit used in intra prediction and inter prediction from the QP determination unit 15. Then, the encoding quality analysis unit 103 obtains the variation and magnitude of the QP value, and outputs it to the filter generation unit 104. For example, the encoding quality analysis unit 103 obtains a standard deviation value as the variation, and obtains a representative value (e.g., a maximum value) as the magnitude.
[0042] The filter generation unit 104 generates a plurality of filters that change the frequency components of an image, and outputs them to the secondary unit generation unit 105. In this embodiment, the filter generation unit 104 generates a plurality of types of filters that blur high-frequency components (frequency components exceeding a threshold) of an image, and a plurality of types of filters that sharpen high-frequency components (frequency components exceeding a threshold) of an image. The high-frequency components of an image can be set arbitrarily, and can be set, for example, to components whose horizontal and vertical frequencies are 50% or more of the maximum frequency (Nyquist frequency). The filter generation unit 104 may generate only one of the filters that blur high-frequency components of an image and the filters that sharpen high-frequency components of an image, depending on the type of image input to the encoding device 1.
[0043] When the image processing unit 10 includes the spatial high-frequency power analysis unit 101, the filter generation unit 104 inputs the variance and magnitude of the spatial high-frequency power from the spatial high-frequency power analysis unit 101. It is considered that the greater the variance and magnitude of the spatial high-frequency power, the more difficult the encoding becomes, and the worse the encoding efficiency becomes. Therefore, the filter generation unit 104 increases the number of filter types as the variance of the spatial high-frequency power increases. Also, the filter generation unit 104 increases the difference between the maximum and minimum values of the filter coefficients in the multiple types of filters as the magnitude of the spatial high-frequency power increases. In other words, the filter generation unit 104 sets coefficients such that the greater the magnitude of the spatial high-frequency power, the greater the amount of change in the frequency components of the image when filtering is performed using the multiple types of filters.
[0044] Filter generation unit 104 holds or acquires in advance a table relating to the settings of filter types and filter coefficients. Table 1 shows an example of setting filter types and filter coefficients with respect to the standard deviation value and maximum value of spatial high frequency power. Note that these setting values are only an example, and can be appropriately determined and set experimentally. Here, the ±N of the filter coefficients means that the maximum value is +N with 1.0 as the center, and the minimum value is -N with 1.0 as the center.
[0045] [Table 1]
[0046] For example, if there are 9 types of filters and the filter coefficients are ±0.3, the filter coefficients are divided into 4 in each of the positive and negative directions, and the coefficients of the high frequency region of each filter are {0.700, 0.775, 0.850, 0.925, 1.000, 1.075, 1.150, 1.225, 1.300}. For example, if the filter is a 4-by-4 matrix and the 2-by-2 matrix on the bottom right is the high frequency region, the filter coefficients are
number
number
[0047] When the image processing unit 10 includes the residual signal power analysis unit 102, the filter generation unit 104 inputs the variance and magnitude of the residual signal power from the residual signal power analysis unit 102. It is considered that the greater the variance and magnitude of the residual signal power, the more difficult the encoding becomes, and the worse the encoding efficiency becomes. Therefore, the filter generation unit 104 increases the number of filter types as the variance of the residual signal power increases. Also, the filter generation unit 104 increases the difference between the maximum and minimum values of the filter coefficients in the multiple types of filters as the magnitude of the residual signal power increases. In other words, the filter generation unit 104 sets coefficients such that the greater the magnitude of the residual signal power, the greater the amount of change in the frequency components of the image when filtering is performed using the multiple types of filters.
[0048] Table 2 shows an example of the filter type and filter coefficient settings for the standard deviation and maximum value of the residual signal power. Note that these settings are just an example, and can be determined experimentally as appropriate. Here, the ±N filter coefficients mean that the maximum value is +N with 1.0 at the center, and the minimum value is -N with 1.0 at the center.
[0049] [Table 2]
[0050] When the image processing unit 10 includes the encoding quality analysis unit 103, the filter generation unit 104 inputs the variation and magnitude of the QP value from the encoding quality analysis unit 103. It is considered that the greater the variation and magnitude of the QP value, the more difficult the encoding and the worse the encoding efficiency. Therefore, the filter generation unit 104 increases the number of filter types as the variation of the QP value increases. Also, the filter generation unit 104 increases the difference between the maximum and minimum values of the filter coefficients in the multiple types of filters as the magnitude of the QP value increases. In other words, the filter generation unit 104 sets coefficients such that the greater the magnitude of the QP value, the greater the amount of change in the frequency components of the image when filtering is performed using the multiple types of filters.
[0051] Table 3 shows an example of the filter type and filter coefficient settings for the standard deviation and maximum value of the QP value. Note that these settings are just an example, and can be determined experimentally as appropriate. Here, the ±N filter coefficients mean that the maximum value is +N with 1.0 at the center, and the minimum value is -N with 1.0 at the center.
[0052] [Table 3]
[0053] When the image processing unit 10 includes two or more of the spatial high frequency power analysis unit 101, the residual signal power analysis unit 102, and the coding quality analysis unit 103, the filter generation unit 104 adopts the filter with the largest number of types found from each table and the filter with the largest change amount found from each table. For example, when the image processing unit 10 includes all of the spatial high frequency power analysis unit 101, the residual signal power analysis unit 102, and the coding quality analysis unit 103, and the number of filter types is {3, 5, 9} and the change amounts of the filter coefficients are {±0.3, ±0.1, ±0.2}, the number of filter types is set to 9 and the change amount of the filter coefficient is set to ±0.3.
[0054] In the above, the filter coefficient values are 1.0±N, but the filter coefficient values may be from 1.0-N1 to 1.0+N2 (N1≠N2). Also, N1=0 or N2=0 may be used.
[0055] The secondary unit generation unit 105 applies the filter input from the filter generation unit 104 to the decoded unit input from the addition unit 19 and the frame memory 20 (i.e., the decoded unit decoded after encoding the divided block of the original image) to generate a secondary unit, and outputs it to the intra-screen prediction unit 21 and the inter-screen prediction unit 22.
[0056] A method for calculating a secondary unit by the secondary unit generation unit 105 will be specifically described with reference to Fig. 4. Fig. 4 is a diagram for explaining an example of a method for calculating a secondary unit by the secondary unit generation unit 105. The secondary unit generation unit 105 divides the decoded unit U1 into block regions and performs an orthogonal transform such as Type-II DCT on each block to generate an orthogonal transform coefficient C1 (step S1).
[0057] Since there are various sizes of the decoded unit such as 32×32, 16×16, 8×8, and 4×4, the size of the filter F1 generated by the filter generating unit 104 may be 4×4, which is the minimum unit of the decoded unit, and the secondary unit generating unit 105 may generate a multiplication filter F2 by enlarging the filter F1 to the size of the decoded unit U1 (step S2). Any method such as the nearest neighbor method, the bilinear method, or the bicubic method may be used to enlarge the filter F1.
[0058] Then, the secondary unit generation unit 105 multiplies the orthogonal transform coefficients C1 by the multiplication filter F2 to generate filtered orthogonal transform coefficients C2 (step S3).
[0059] Finally, the secondary unit generation unit 105 performs an inverse orthogonal transform on the filtered orthogonal transform coefficients C2 to generate a secondary unit U2 (step S4).
[0060] 4, the secondary unit generation unit 105 performs an orthogonal transform on the decoded unit to generate orthogonal transform coefficients, multiplies the orthogonal transform coefficients by a matrix obtained by transforming a filter to the size of the decoded unit to generate filtered orthogonal transform coefficients, and performs an inverse orthogonal transform on the filtered orthogonal transform coefficients to generate secondary units. The secondary unit generation unit 105 applies the above processing to all decoded units using all types of filters input from the filter generation unit 104, and generates multiple secondary units.
[0061] In this embodiment, the image processing unit 10 performs image processing on the decoded unit to generate a secondary unit, but may also perform similar image processing on the unit to be predicted to generate a secondary unit.
[0062] (program) A computer capable of executing program instructions can be used to function as the above-mentioned encoding device 1. Here, the computer may be a general-purpose computer, a dedicated computer, a workstation, a PC (Personal Computer), an electronic notepad, etc. The program instructions may be program code, code segments, etc. for performing the necessary tasks.
[0063] The computer includes a processor, a storage unit, an input unit, an output unit, and a communication interface. The processor is specifically a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), a SoC (System on a Chip), etc., and may be composed of multiple processors of the same or different types. The processor reads and executes a program from the storage unit to control each of the above components and perform various arithmetic processing.
[0064] The program may be recorded on a computer-readable recording medium. By using such a recording medium, the program can be installed on the computer. Here, the recording medium on which the program is recorded may be a non-transitory recording medium. The non-transitory recording medium is not particularly limited, and may be, for example, a CD-ROM, a DVD-ROM, or a USB (Universal Serial Bus) memory. In addition, the program may be in a form that is downloaded from an external device via a network.
[0065] As described above, the encoding device 1 or program according to the present invention generates a filter that changes the frequency components of an image, and applies the filter to a decoded unit to generate a secondary unit. Then, intra prediction is performed by referring to the decoded unit and the secondary unit, and inter prediction is performed by referring to the decoded unit and the secondary unit. Therefore, the number of units referred to in intra prediction and inter prediction is increased compared to conventional encoding methods, and therefore it is possible to improve the encoding accuracy and the encoding efficiency.
[0066] The filter is preferably a filter that blurs the high frequency components of the image and a filter that sharpens the high frequency components of the image. Even when encoding an image with low correlation within a screen or between screens, it is expected that the correlation between the secondary unit and the prediction unit will be improved by blurring the decoded unit using a filter. In addition, when the original image of the prediction unit is sharper than the decoded unit, it is expected that the correlation between the secondary unit and the prediction unit will be improved by sharpening the decoded unit using a filter.
[0067] Although the above-mentioned embodiment has been described as a representative example, it is obvious to those skilled in the art that many modifications and substitutions can be made within the spirit and scope of the present invention. Therefore, the present invention should not be interpreted as being limited by the above-mentioned embodiment, and various modifications or changes can be made without departing from the scope of the claims. For example, it is possible to integrate multiple building blocks shown in the configuration diagram of the embodiment, or to divide one building block. [Explanation of symbols]
[0068] 1 Encoding device 10 Image processing section 11 Block division section 12 Subtraction section 13 Conversion section 14 Visual activity calculation unit 15 QP decision section 16 Quantization section 17 Inverse quantization section 18 Reverse conversion section 19 Addition section 20 Frame Memory 21 In-screen prediction section 22 Inter-frame prediction unit 23 Switching section 24 Entropy coding unit 101 Spatial High Frequency Power Analysis Section 102 Residual signal power analysis section 103 Encoding quality analysis section 104 Filter Generation Unit 105 Secondary Unit Generation Section
Claims
1. An encoding device for encoding an original image, comprising: a filter generating unit that generates a filter that changes a frequency component of an image; a secondary unit generating unit that applies the filter to a decoded unit obtained by encoding a divided block of the original image and then decoding the decoded unit to generate a secondary unit; a spatial high frequency power analysis unit that calculates the variation and magnitude of spatial high frequency power in the decoded unit; an intra prediction unit that performs intra prediction by referring to the decoded unit and the secondary unit; an inter prediction unit that performs inter prediction by referring to the decoded unit and the secondary unit; Equipped with The filter generation unit increases the number of types of filters as the variation in the spatial high frequency power increases, and increases the difference between the maximum and minimum values of the filter coefficients as the magnitude of the spatial high frequency power increases.
2. The encoding device according to claim 1 , wherein the spatial high frequency power analysis unit performs an orthogonal transform on the decoded unit to obtain the power of each element, and determines the sum of the powers of elements in the high frequency region whose frequencies exceed a threshold as the spatial high frequency power of the decoded unit.
3. A coding device for coding an original image, comprising: a filter generating unit that generates a filter that changes a frequency component of an image; a secondary unit generating unit that applies the filter to a decoded unit obtained by encoding a divided block of the original image and then decoding the decoded unit to generate a secondary unit; a residual signal power analysis unit for determining a variance and a magnitude of a residual signal power indicating a power of a difference signal between the decoded unit and the original image; an intra prediction unit that performs intra prediction by referring to the decoded unit and the secondary unit; an inter prediction unit that performs inter prediction by referring to the decoded unit and the secondary unit; Equipped with The filter generation unit increases the number of types of filters as the variation in the residual signal power increases, and increases the difference between the maximum and minimum values of the filter coefficients as the magnitude of the residual signal power increases.
4. A coding device for coding an original image, comprising: a filter generating unit that generates a filter that changes a frequency component of an image; a secondary unit generating unit that applies the filter to a decoded unit obtained by encoding a divided block of the original image and then decoding the decoded unit to generate a secondary unit; a coding quality analysis unit for determining a variation and a magnitude of a quantization parameter used in generating the decoded unit; an intra prediction unit that performs intra prediction by referring to the decoded unit and the secondary unit; an inter prediction unit that performs inter prediction by referring to the decoded unit and the secondary unit; Equipped with The filter generation unit increases the number of types of filters as the variation in the quantization parameter increases, and increases the difference between the maximum and minimum values of the filter coefficients as the magnitude of the quantization parameter increases.
5. a residual signal power analysis unit for determining a variance and a magnitude of a residual signal power indicating a power of a difference signal between the decoded unit and the original image; a coding quality analysis unit that determines the variation and magnitude of a quantization parameter used in generating the decoded unit; 3. The encoding device according to claim 1, wherein the filter generation unit increases the number of types of filters as the variation in the spatial high frequency power, the residual signal power, or the quantization parameter increases, and increases a difference between a maximum value and a minimum value of a filter coefficient as the spatial high frequency power, the residual signal power, or the magnitude of the quantization parameter increases.
6. 6. The encoding device according to claim 1, wherein the secondary unit generation unit performs an orthogonal transform on the decoded unit to generate orthogonal transform coefficients, multiplies the orthogonal transform coefficients by a matrix obtained by transforming the filter to a size of the decoded unit to generate filtered orthogonal transform coefficients, and performs an inverse orthogonal transform on the filtered orthogonal transform coefficients to generate the secondary unit.
7. A program for causing a computer to function as the encoding device according to any one of claims 1 to 6.
Citation Information
Patent Citations
Image processing device and method
WO2019244669A1
