Image coding device, image coding method, image decoding device, and image decoding method
By independently dividing and predicting luminance and color difference signals, and limiting luminance chrominance intra prediction when necessary, the method enhances encoding efficiency and reduces processing complexity in image encoding and decoding.
Patent Information
- Application Number
- JP2024139055
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-20
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2037-04-28
AI Technical Summary
The dependency relationship between processing for primary and secondary signals in image encoding and decoding increases the amount of processing and makes parallel processing difficult.
The image is divided into blocks, with luminance and color difference signals being independently divided and predicted, and the use of luminance chrominance intra prediction is prohibited when the size of the luminance signal block is larger than a predetermined size.
This approach allows for improved encoding efficiency with reduced processing, enabling efficient image encoding and decoding without excessive processing loads.
Smart Images

Figure 2024161543000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a technique for dividing an image into blocks and encoding and decoding the divided blocks. [Background technology]
[0002] In image encoding and decoding, an image is divided into blocks, which are sets of a predetermined number of pixels, and encoding and decoding are performed on a block-by-block basis. By dividing the images into appropriate blocks, the encoding efficiency of intra-frame prediction (intra-prediction) and inter-frame prediction (inter-prediction) is improved. In intra-prediction, the encoding efficiency is also improved by predicting a secondary signal from a decoded image of a primary signal. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2013-90015 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, predicting a secondary signal from a decoded image of a primary signal increases the amount of processing and creates a dependency between the processing for the primary signal and the processing for the secondary signal, making parallel processing difficult.
[0005] The present invention has been made in view of the above circumstances, and has as its object to provide a technique for improving coding efficiency by performing block division suitable for image coding and decoding. [Means for solving the problem]
[0006] In order to solve the above problem, an image coding device of one aspect of the present invention is an image coding device that divides an image into blocks and performs coding on a block-by-block basis, and includes a luminance signal block division unit that divides a luminance signal of the image into rectangles of a predetermined size to generate luminance signal blocks, a chrominance signal block division unit that divides a chrominance signal of the image into rectangles of a predetermined size to generate chrominance signal blocks, a luminance signal prediction unit that predicts the luminance signal, and a chrominance signal prediction unit that predicts the chrominance signal, wherein the luminance signal blocks and the chrominance signal blocks are divided independently in the case of intra prediction and are divided together in the case of inter prediction, the chrominance signal prediction unit is capable of luminance-chrominance intra prediction that predicts the chrominance signal from a decoded luminance signal, and the use of the luminance-chrominance intra prediction is prohibited if the size of the luminance signal block is equal to or larger than a predetermined size.
[0007] Another aspect of the present invention is an image coding method, which divides an image into blocks and performs coding in units of the divided blocks, and includes a luminance signal block dividing step of dividing a luminance signal of the image into rectangles of a predetermined size to generate luminance signal blocks, a chrominance signal block dividing step of dividing a chrominance signal of the image into rectangles of a predetermined size to generate chrominance signal blocks, a luminance signal prediction step of predicting a luminance signal, and a chrominance signal prediction step of predicting a chrominance signal, in which the luminance signal blocks and the chrominance signal blocks are divided independently in the case of intra prediction and are divided together in the case of inter prediction, and the chrominance signal prediction step is capable of luminance-chrominance intra prediction for predicting a chrominance signal from a decoded luminance signal, and prohibits use of the luminance-chrominance intra prediction when the size of the luminance signal block is equal to or larger than a predetermined size.
[0008] Yet another aspect of the present invention is an image decoding device that performs decoding on a block basis by dividing an image, and includes a luminance signal block dividing unit that divides a luminance signal of the image into rectangles of a predetermined size to generate luminance signal blocks, a chrominance signal block dividing unit that divides a chrominance signal of the image into rectangles of a predetermined size to generate chrominance signal blocks, a luminance signal prediction unit that predicts a luminance signal, and a chrominance signal prediction unit that predicts a chrominance signal, the luminance signal blocks and the chrominance signal blocks being divided independently in the case of intra prediction and being divided together in the case of inter prediction, the chrominance signal prediction unit being capable of luminance-chrominance intra prediction that predicts a chrominance signal from a decoded luminance signal, and prohibiting use of the luminance-chrominance intra prediction when the size of the luminance signal block is equal to or larger than a predetermined size.
[0009] Yet another aspect of the present invention is an image decoding method, which performs decoding on a block basis by dividing an image, and includes a luminance signal block dividing step of dividing a luminance signal of the image into rectangles of a predetermined size to generate luminance signal blocks, a chrominance signal block dividing step of dividing a chrominance signal of the image into rectangles of a predetermined size to generate chrominance signal blocks, a luminance signal prediction step of predicting a luminance signal, and a chrominance signal prediction step of predicting a chrominance signal, in which the luminance signal blocks and the chrominance signal blocks are divided independently in the case of intra prediction and are divided together in the case of inter prediction, and the chrominance signal prediction step is capable of luminance-chrominance intra prediction for predicting a chrominance signal from a decoded luminance signal, and prohibits use of the luminance-chrominance intra prediction when the size of the luminance signal block is equal to or larger than a predetermined size.
[0010] Any combination of the above components, and any transformation of the present invention into a method, device, system, recording medium, computer program, etc., are also effective as aspects of the present invention. Effect of the Invention
[0011] According to the present invention, block division suitable for image encoding and decoding becomes possible, encoding efficiency is improved, and image encoding and decoding with a small amount of processing can be provided. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is a configuration diagram of an image encoding device according to a first embodiment. [Diagram 2] FIG. 1 is a configuration diagram of an image decoding device according to a first embodiment. [Diagram 3] 11 is a flowchart illustrating division into tree blocks and division within tree blocks. [Figure 4] FIG. 13 is a diagram showing how an input image is divided into tree blocks. [Diagram 5] FIG. 1 is a diagram illustrating a z-scan. [Figure 6] This is a diagram showing a treeblock divided into four horizontally and vertically. [Figure 7] This is a diagram showing a tree block divided horizontally into two. [Figure 8] This is a diagram showing a tree block divided vertically into two. [Figure 9] 13 is a flowchart illustrating a process for each divided block when a tree block is divided into four in the horizontal and vertical directions. [Figure 10] 13 is a flowchart illustrating processing of each divided block when a tree block is divided into two in the horizontal direction. [Figure 11] FIG. 13 is a diagram showing how a divided block is re-divided when a tree block is divided into two horizontally. [Figure 12] 13 is a flowchart illustrating processing of each divided block when a tree block is divided into two vertically. [Figure 13] FIG. 13 is a diagram showing how a divided block is re-divided when a tree block is divided into two vertically. [Figure 14]FIG. 4 illustrates an example of syntax related to block division according to the first embodiment. [Figure 15] FIG. 1 is a diagram illustrating intra prediction. [Figure 16] FIG. 1 is a diagram illustrating inter prediction. [Figure 17] FIG. 2 is a diagram illustrating a color difference format. [Figure 18] FIG. 1 is a diagram illustrating luminance and chrominance intra prediction. [Figure 19] 13 is a flowchart illustrating luminance and chrominance intra prediction. [Figure 20] FIG. 13 is a diagram illustrating a case where the size of a chrominance block is larger than the size of a luminance block. [Figure 21] FIG. 13 is a diagram illustrating a case where the size of a chrominance block is smaller than the size of a luminance block. [Figure 22] 13 is a diagram illustrating an example of the syntax of an intra color difference prediction mode. [Figure 23] 11A and 11B are diagrams illustrating an example of limiting intra color difference prediction by replacing surrounding pixels. [Figure 24] FIG. 13 is a diagram illustrating luminance and chrominance intra prediction depending on differences in the size of luminance blocks. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] An embodiment of the present invention provides an image coding technique that divides an image into rectangular blocks and codes / decodes the divided blocks.
[0014] (First embodiment) An image coding device 100 and an image decoding device 200 according to the first embodiment of the present invention will be described.
[0015] Fig. 1 is a configuration diagram of an image coding device 100 according to a first embodiment. Fig. 1 shows only the flow of data related to image signals, and does not show the flow of data related to additional information, which is supplied by each component to an encoded bitstream generator 105 to generate corresponding encoded data, such as motion vectors and prediction modes.
[0016] The block division unit 101 divides an image into coding target blocks, which are processing units for encoding, and supplies an image signal in the coding target block to the residual signal generation unit 103. The block division unit 101 also supplies an image signal of the coding target block to a predicted image generation unit 102 in order to evaluate the degree of matching of the predicted image.
[0017] The block division unit 101 recursively divides an image into rectangles of a predetermined size to generate a block to be coded. The block division unit 101 includes a quartering unit that divides the target block in the recursive division into four blocks in the horizontal and vertical directions to generate four blocks, and a two-division unit that divides the target block in the recursive division into two blocks in the horizontal or vertical direction to generate two blocks. The detailed operation of the block division unit 101 will be described later.
[0018] The predicted image generating unit 102 performs intra-picture prediction (intra prediction) or inter-picture prediction (inter prediction) based on a prediction mode from the decoded image signal supplied from the decoded image memory 108, and generates a predicted image signal. The image signal in the encoding target block supplied from the block dividing unit 101 is used for evaluation of intra prediction and inter prediction. In intra prediction, a predicted image signal is generated using the image signal of the encoding target block supplied from the block dividing unit 101 and the image signal of a surrounding encoded block adjacent to the encoding target block existing in the same picture as the encoding target block supplied from the decoded image memory 108. In inter prediction, the image signal of the encoding target block supplied from the block dividing unit 101 is used as a reference picture with an encoded picture stored in the decoded image memory 108 that is chronologically before or after the picture (encoded picture) including the encoding target block, and block matching evaluation such as block matching is performed between the encoded picture and the reference picture, a motion vector indicating the amount of motion is obtained, and motion compensation is performed from the reference picture based on the amount of motion to generate a predicted image signal. The predicted image generating unit 102 supplies the predicted image signal thus generated to the residual signal generating unit 103 .
[0019] The residual signal generation unit 103 performs subtraction between the image signal to be coded and the prediction signal generated by the prediction image generation unit 102 to generate a residual signal, and supplies the residual signal to the orthogonal transform / quantization unit 104 .
[0020] The orthogonal transform / quantization unit 104 orthogonally transforms and quantizes the residual signal supplied from the residual signal generation unit 103, and supplies the orthogonally transformed and quantized residual signal to the coded bitstream generation unit 105 and the inverse quantization / inverse orthogonal transform unit 106.
[0021] The coded bitstream generation unit 105 generates a coded bitstream for the orthogonally transformed and quantized residual signal supplied from the orthogonal transform and quantization unit 104. The coded bitstream generation unit 105 also generates coded bitstreams corresponding to additional information such as a motion vector, a prediction mode, and block division information.
[0022] The inverse quantization and inverse orthogonal transform unit 106 inverse quantizes and inverse orthogonally transforms the orthogonally transformed and quantized residual signal supplied from the orthogonal transform and quantization unit 104, and supplies the inverse quantized and inverse orthogonally transformed residual signal to a decoded image signal superimposition unit 107.
[0023] The decoded image signal superimposition unit 107 superimposes the predicted image signal generated by the predicted image generation unit 102 and the residual signal that has been inverse quantized and inverse orthogonal transformed by the inverse quantization and inverse orthogonal transformation unit 106 to generate a decoded image, which is stored in the decoded image memory 108. Note that the decoded image may also be subjected to a filtering process for reducing block distortion and the like caused by encoding before being stored in the decoded image memory 108.
[0024] Fig. 2 is a configuration diagram of an image decoding device 200 according to embodiment 1. Fig. 2 shows only the flow of data related to image signals, and does not show the flow of data related to additional information other than image signals, such as motion vectors and prediction modes, which are supplied by the bitstream decoding unit 201 to each component for use in corresponding processing.
[0025] The bit stream decoding unit 201 decodes the supplied coded bit stream, and supplies the orthogonally transformed and quantized residual signal to the block division unit 202 .
[0026] The block division unit 202 determines the shape of the block to be decoded based on the decoded block division information, and supplies the orthogonally transformed and quantized residual signal of the determined block to be decoded to the inverse quantization and inverse orthogonal transformation unit 203.
[0027] The block division unit 202 recursively divides an image into rectangles of a predetermined size based on the decoded block division information to generate a block to be decoded. The block division unit 202 includes a quartering unit that divides the target block in the recursive division into four in the horizontal and vertical directions to generate four blocks, and a two-division unit that divides the target block in the recursive division into two in the horizontal or vertical direction to generate two blocks. The detailed operation of the block division unit 202 will be described later.
[0028] The inverse quantization and inverse orthogonal transformation unit 203 performs inverse orthogonal transformation and inverse quantization on the orthogonally transformed and quantized residual signal supplied thereto, thereby obtaining an inverse orthogonally transformed and inverse quantized residual signal.
[0029] The predicted image generating unit 204 generates a predicted image signal from the decoded image signal supplied from the decoded image memory 206 , and supplies the generated predicted image signal to a decoded image signal superimposing unit 205 .
[0030] The decoded image signal superimposition unit 205 generates a decoded image signal by superimposing the predicted image signal generated by the predicted image generation unit 204 and the residual signal that has been inverse orthogonally transformed and inverse quantized by the inverse quantization and inverse orthogonal transformation unit 203, and outputs the decoded image signal and stores it in the decoded image memory 206. Note that the decoded image may also be subjected to a filtering process to reduce block distortion and the like caused by encoding before being stored in the decoded image memory 206.
[0031] A detailed description will now be given of the operation of the block division unit 101 of the image encoding device 100. Fig. 3 is a flowchart illustrating division into tree blocks and division inside a tree block.
[0032] First, an input image is divided into tree blocks of a predetermined size (S1000). For example, the tree block is 128 pixels x 128 pixels. However, the tree block is not limited to 128 pixels x 128 pixels, and any size and shape may be used as long as it is rectangular. The size and shape of the tree block may be fixed and determined between the encoding device and the decoding device, or may be determined by the encoding device and recorded in the encoded bit stream, and the decoding device may use the recorded block size. The division of an input image into tree blocks is shown in FIG. 4. The tree blocks are encoded and decoded in raster scan order, that is, from left to right and from top to bottom.
[0033] The inside of the tree block is further divided into rectangular blocks. Encoding and decoding is performed inside the tree block in z-scan order. Figure 5 shows the z-scan order. With z-scan, encoding and decoding are performed in the order of top left, top right, bottom left, bottom right. The inside of the tree block can be divided into four or two parts; a four-part division is performed both horizontally and vertically. A two-part division is performed either horizontally or vertically. Figure 6 shows a tree block divided into four parts horizontally and vertically. Figure 7 shows a tree block divided into two parts horizontally. Figure 8 shows a tree block divided into two parts vertically.
[0034] Referring again to Fig. 3, it is determined whether or not the inside of the tree block is divided into four horizontally and vertically (S1001).
[0035] If it is determined that the inside of the tree block should be divided into four (S1001: Yes), the inside of the tree block is divided into four (S1002), and each of the blocks divided into four horizontally and vertically is processed (S1003). The re-division process of the block divided into four will be described later (FIG. 9).
[0036] If it is determined that the inside of the tree block should not be divided into four (S1001: No), it is determined whether or not to divide the inside of the tree block into two (S1004).
[0037] If it is determined that the inside of the tree block is to be divided into two (S1004: Yes), it is determined whether the direction of division into two is the horizontal direction (S1005).
[0038] If it is determined that the direction of division is horizontal (S1005: Yes), the inside of the tree block is divided horizontally into two (S1006), and each block divided horizontally into two is processed (S1007). The re-division process of the block divided horizontally into two will be described later (FIG. 10).
[0039] If it is determined that the direction of division is vertical rather than horizontal (S1005: No), the inside of the tree block is divided vertically into two (S1008), and each block divided vertically into two is processed (S1009). The re-division process of a block divided horizontally into two will be described later (FIG. 11).
[0040] If it is determined that the inside of the tree block is not to be divided into two (S1004: No), the block division process is terminated without dividing the inside of the tree block into blocks (S1010).
[0041] Next, the processing of each of the divided blocks when the tree block is divided into four in the horizontal and vertical directions will be described with reference to the flowchart of FIG.
[0042] It is determined whether or not the inside of the block should be divided again into four parts horizontally and vertically (S1101).
[0043] If it is determined that the inside of the block should be divided into four again (S1101: Yes), the inside of the block is divided into four again (S1102), and each block divided into four horizontally and vertically is processed (S1103).
[0044] If it is determined that the inside of the block is not to be divided into four again (S1101: No), it is determined whether or not to divide the inside of the block into two (S1104).
[0045] If it is determined that the inside of the block is to be divided into two (S1104: Yes), it is determined whether the direction of division into two is the horizontal direction (S1105).
[0046] If it is determined that the direction of division into two is the horizontal direction (S1105: Yes), the inside of the block is divided into two horizontally (S1106), and each process of the blocks divided into two horizontally is performed (S1107).
[0047] If it is determined that the direction of division is vertical rather than horizontal (S1105: No), the block is divided vertically into two (S1108), and each block divided vertically into two is processed (S1109).
[0048] If it is determined that the inside of the block is not to be divided into two (S1104: No), the block division process ends without dividing the inside of the block into blocks (S1110).
[0049] The process shown in the flowchart of Fig. 9 is executed for each of the four divided blocks. Encoding and decoding are also performed within each of the four divided blocks in the z-scan order.
[0050] Next, the processing of each divided block when a tree block is divided horizontally into two will be described with reference to the flowchart of FIG.
[0051] When the tree block is divided into two blocks in the horizontal direction, first, for each of the divided blocks, it is determined whether or not the inside of the block should be divided into four blocks in the horizontal and vertical directions (S1201).
[0052] If it is determined that the inside of the block should be divided into four (S1201: Yes), the inside of the block is divided into four (S1202), and each of the blocks divided into four in the horizontal and vertical directions is processed (S1203).
[0053] If it is determined that the inside of the block is not to be divided into four (S1201: No), it is determined whether or not to divide the inside of the block into two again (S1204).
[0054] If it is determined that the block should be divided into two again (S1204: Yes), the block is divided vertically (S1205), and each process of the blocks divided vertically into two is carried out (S1206).
[0055] If it is determined that the block should not be divided into two again (S1204: No), the block division process ends without dividing the inside of the block again (S1207).
[0056] Figure 11 shows how a divided block is re-divided when the tree block is divided into two horizontally. Here, when the parent tree block is divided into two horizontally, the divided block is automatically divided into two vertically, and only the vertical division is permitted. Also, when the parent tree block is divided into two, it is possible to completely prohibit the child block from being divided into four. This makes it possible to prohibit the block from being divided in the same direction as the parent block, preventing block division into elongated rectangles in the horizontal direction, making encoding and decoding easier.
[0057] The process shown in the flowchart of Fig. 10 is executed for each block divided into two in the horizontal direction. The inside of each block divided into two is also coded and decoded in the order of top to bottom.
[0058] Next, the processing of each divided block when a tree block is divided into two vertically will be described with reference to the flowchart of FIG.
[0059] When a tree block is divided into two blocks vertically, first, for each of the divided blocks, it is determined whether or not the block should be divided into four blocks horizontally and vertically (S1301).
[0060] If it is determined that the inside of the block should be divided into four (S1301: Yes), the inside of the block is divided into four (S1302), and each of the blocks divided into four horizontally and vertically is processed (S1303).
[0061] If it is determined that the inside of the block is not to be divided into four (S1301: No), it is determined whether or not to divide the inside of the block into two again (S1304).
[0062] If it is determined that the block should be divided into two again (S1304: Yes), the block is divided horizontally (S1305), and each process of the blocks divided horizontally into two is carried out (S1306).
[0063] If it is determined that the block should not be divided into two again (S1304: No), the block division process ends without dividing the inside of the block again (S1307).
[0064] Figure 13 shows how a divided block is re-divided when a tree block is divided into two vertically. Here, when a parent tree block is divided into two vertically, the divided block is automatically divided into two horizontally, and only horizontal division is permitted. Also, when a parent tree block is divided into two, it is possible to completely prohibit the child block from being divided into four. This makes it possible to prohibit blocks from being divided in the same direction as the parent block, preventing block division into vertically elongated rectangles, and facilitating encoding and decoding processes.
[0065] The process shown in the flowchart of Fig. 12 is executed for each block divided into two vertically. Inside each divided block, coding and decoding are also performed in the order of left, right.
[0066] Although the re-division of the divided blocks when the tree block is divided has been described above, the parent block does not have to be a tree block. For example, if a tree block (128x128) is divided into four, and the four-divided blocks (64x64) are further divided into four or in two, the above process is also applied to the division of the further divided blocks.
[0067] Next, the operation of the block division unit 202 of the image decoding device 200 will be described. Blocks are divided using the same processing procedure as the block division unit 101 of the image encoding device 100, but the block division unit 101 of the image encoding device 100 selects a block division pattern and outputs the selected block division information, whereas the block division unit 202 of the image decoding device divides blocks using block division information decoded from the encoded bitstream, and also differs in that when decoding the block division information from the encoded bitstream, in a situation where re-division in the same direction is prohibited, information with no options is not transmitted in the bitstream in a syntax structure.
[0068] An example of the syntax (syntax rules of encoded bit stream) related to block division in the first embodiment is shown in FIG. 14. For dividing the inside of a tree block, first, a flag (4_division_flag) indicating whether or not to divide into four is transmitted and received. If dividing into four is to be performed (4_division_flag is 1), the tree block is divided into four and the process is terminated. After that, the inside of the block divided into four is again divided using the syntax shown in FIG. 14. If dividing into four is not to be performed (4_division_flag is 0), a flag (2_division_flag) indicating whether or not to divide into two is transmitted and received. If dividing into two is to be performed (2_division_flag is 1), a flag (2_division_direction) indicating the direction of division into two is further transmitted and received. If 2_division_direction is 1, it indicates division in the vertical direction, and if 2_division_direction is 0, it indicates division in the horizontal direction. After that, the inside of the block divided into two is again divided using the syntax shown in FIG. 14. If the tree block is not to be divided into two (2_division_flag is 0), the process ends without dividing the tree block.
[0069] Here, a process of re-dividing the inside of a block divided into four or two will be described. The process of re-dividing the inside of a block also uses the syntax shown in FIG. 14, but it is different from the case of dividing a tree block in that there is a restriction on the division direction when dividing into two. In other words, when a tree block is divided into two, when the inside of the block divided into two is to be re-divided, it is prohibited to divide the tree block in the same direction as the division direction in which the tree block was divided into two. This prevents the divided block from becoming a more elongated rectangle, and prevents an increase in memory bandwidth required for intra prediction or inter prediction. Details of preventing an increase in memory bandwidth will be described later.
[0070] In addition, it is also possible to count the number of times the image is divided into two in the same direction and restrict further division in the same direction when the number of times exceeds a certain limit. For example, division into two in the same direction is permitted up to two times, but division into two in the same direction is prohibited from the third time onwards.
[0071] In FIG. 14, the syntax is such that 4-division is selected with priority, and information on whether to divide into 4 or not is transmitted and received before information on whether to divide into 2 or not. On the other hand, when 2-division is selected with priority, it is also possible to use a syntax in which information on whether to divide into 2 or not is transmitted and received before information on whether to divide into 4 or not. This is because the amount of code transmitted as a bit stream is reduced by transmitting and receiving an event that is more likely to occur stochastically first. In other words, it is also possible to use a syntax in which it is estimated in advance whether 4-division or 2-division is more likely to occur, and the division information that is more likely to occur is transmitted and received first. For example, by transmitting and receiving information on whether to prioritize 4-division or 2-division in the header information of the image, the encoding device can adaptively determine the prioritized number of divisions with high encoding efficiency, and the decoding device can divide the inside of the tree block using a syntax based on the selected prioritized number of divisions.
[0072] In the image encoding device 100 and the image decoding device 200, intra prediction and inter prediction are performed using the divided blocks. Both intra prediction and inter prediction involve copying pixels from memory.
[0073] An example of intra prediction is shown in FIG. 15(a) to FIG. 15(d). FIG. 15(a) and FIG. 15(b) show the prediction direction and mode number of intra prediction. In intra prediction, as shown in FIG. 15(c) and FIG. 15(d), a predicted image of a block to be coded / decoded is generated by copying pixels from pixels that have already been coded / decoded and are adjacent to the block to be coded / decoded. In intra prediction, the process from predicted image generation to coded / decoded pixel generation is repeated for each block, so the processing order is sequential for each block, and the more the inside of the block is divided into smaller parts, the heavier the overall processing load becomes. Also, the more elongated the shape of the block is, the heavier the processing of copying pixels from memory becomes. Also, since orthogonal transformation of residual signals is performed for coding / decoding, the more types of rectangular sizes are required, the more types of orthogonal transformation are required, which results in an increase in the circuit scale. Therefore, when dividing the inside of a block into two, by restricting the division into two in the same direction as the division method of the parent block, the increase in memory bandwidth required for intra prediction can be prevented.
[0074] FIG. 16 shows an example of inter prediction. In inter prediction, a predicted image of a block to be coded / decoded is generated by copying pixels from pixels included in a coded / decoded image in block units. In inter prediction, when copying pixels from a reference image in block units, the device is often configured to acquire memory containing the necessary pixels in management units. Therefore, the smaller the block is divided and the more elongated the shape of the block is, the heavier the overall processing load becomes. In addition, when performing decimal precision motion compensation using an interpolation filter on a reference image, it is necessary to copy pixels by adding several pixels to the pixels included in the block, and the smaller the size of the block, the larger the relative ratio of the several pixels to be added becomes, and the heavier the overall processing load becomes. Therefore, when dividing the inside of a block into two, by restricting the division into two in the same direction as the division direction of the parent block, it is possible to prevent an increase in the memory bandwidth required for inter prediction.
[0075] Next, the relationship between the luminance signal and the chrominance signal in intra prediction will be described. As formats between the luminance signal and the chrominance signal, 4:2:0, 4:2:2, 4:4:4, etc. have been conventionally known. In the 4:2:0 format shown in FIG. 17(a), the luminance signal is sampled at two pixels in both the horizontal and vertical directions, whereas the chrominance signal is sampled at one pixel in both the horizontal and vertical directions. Since the human eye can perceive the luminance signal more sensitively than the chrominance signal, the amount of information of the chrominance signal is reduced more than that of the luminance signal. In the 4:2:2 format shown in FIG. 17(b), the luminance signal is sampled at two pixels in the horizontal direction, whereas the chrominance signal is sampled at one pixel in the horizontal direction. In the vertical direction, the luminance signal is sampled at two pixels in the vertical direction, whereas the chrominance signal is sampled at two pixels in the vertical direction. In the 4:4:4 format shown in FIG. 17(c), the luminance signal is sampled at two pixels in the horizontal and vertical directions, whereas the chrominance signal is sampled at two pixels in both the horizontal and vertical directions.
[0076] The present embodiment will be described with an example of the 4:2:0 format, which is the most widely used format in image coding. The block division units 101 and 202 include a luminance block division unit that divides the luminance signal of an image to generate luminance blocks, and a chrominance block division unit that divides the chrominance signal of an image to generate chrominance blocks, and in intra prediction, the luminance signal and the chrominance signal are divided into blocks independently. That is, in intra prediction, the size of the luminance block and the size of the chrominance block are determined independently. In intra prediction, since each of the luminance signal and the chrominance signal copies pixel values from surrounding pixels, the prediction efficiency is improved if the luminance signal and the chrominance signal are divided into blocks independently. In contrast, in inter prediction, the luminance signal and the chrominance signal are treated together and divided into blocks. That is, in inter prediction, the size of the luminance block and the size of the chrominance block are the same. This is because in inter prediction, it is not necessary to distinguish between luminance and chrominance in motion compensation.
[0077] The predicted image generating units 102 and 204 include a luminance signal prediction unit that predicts a luminance signal and a chrominance signal prediction unit that predicts a chrominance signal. The chrominance signal prediction unit performs luminance and chrominance intra prediction that predicts a chrominance signal from coded and decoded pixels of the luminance signal in order to improve the prediction efficiency of the chrominance signal in intra prediction. In the luminance and chrominance intra prediction, the primary signal is coded and decoded before the secondary signal, and the coded and decoded primary signal is used to predict the secondary signal. Here, in the 4:2:0 format and the 4:2:2 format, the amount of information of the luminance signal is greater than that of the chrominance signal, so the luminance signal is the primary signal and the chrominance signal is the secondary signal. In the 4:4:4 format, the amount of information of the luminance signal and the chrominance signal is the same, but it is common to use the luminance signal as the primary signal and the chrominance signal as the secondary signal in accordance with other formats.
[0078] FIG. 18 is a diagram illustrating luminance and chrominance intra prediction, and FIG. 19 is a flowchart illustrating luminance and chrominance intra prediction.
[0079] As shown in Fig. 18, luminance and chrominance intra prediction is performed based on the degree of correlation between coded and decoded peripheral pixels 12a, 12b of a luminance block 10 and coded and decoded peripheral pixels 16a, 16b of a chrominance block 14. Since luminance and chrominance intra prediction predicts a chrominance signal, the peripheral pixels for which the degree of correlation is to be calculated are specified based on the peripheral pixels of the chrominance block to be coded and decoded. In other words, the peripheral pixels of the luminance block that are located at the same positions as the peripheral pixels determined for the chrominance block are used to calculate the degree of correlation.
[0080] First, the degree of correlation between the peripheral pixels of the encoded / decoded luminance signal and the peripheral pixels of the color difference signal is calculated (S1901). Then, the encoded / decoded luminance signal of the block to be encoded / decoded is downsampled (S1902). Here, a plurality of filter types for downsampling may be prepared so that the filter type can be selected. For example, a plurality of filter types may be selected by preparing filters with different strengths, or a plurality of filter types may be selected by preparing filters with different numbers of taps. The filter type may be automatically selected using the degree of correlation between the peripheral pixels, or the filter type may be encoded / decoded and transmitted in a bit stream. In addition, if the downsampling filter for the luminance signal of the block to be encoded / decoded is not determined using the degree of correlation between the peripheral pixels, the processing of steps S1901 and S1902 may be performed in any order, and steps S1901 and S1902 may be processed in parallel.
[0081] Finally, a color difference signal is predicted from the downsampled luminance signal based on the degree of correlation between surrounding pixels (S1903). Downsampling is 1 / 2 in the horizontal and vertical directions in the case of 4:2:0 format. Downsampling is 1 / 2 in the horizontal direction and not downsampled in the vertical direction in the case of 4:2:2 format. Downsampling is 1 / 2 in the horizontal direction and not downsampled in the vertical direction in the case of 4:4:4 format.
[0082] In luminance and chrominance intra prediction, prediction processing of the chrominance signal can start after the coding / decoding of the luminance signal of the block to be coded / decoded is completed. Therefore, the timing at which prediction processing of the chrominance block can start depends on the size of the luminance block and the size of the chrominance block.
[0083] Figures 20(a) and 20(b) are diagrams illustrating luminance and chrominance intra prediction when the size of the chrominance block is larger than the size of the luminance block. The number of pixels of the first to fourth luminance blocks 20a, 20b, 20c, and 20d divided into four shown in Figure 20(a) is 16x16, and the number of pixels of the chrominance block 20e shown in Figure 20(b) is 16x16.
[0084] Here, the comparison of the sizes of the luminance block and the chrominance block is not a comparison of the number of pixels in the block, but a comparison of the areas taking into account the chrominance format. That is, in the 4:2:0 format, the area occupied by the luminance block is half the area occupied by the chrominance block, so if the number of pixels in the luminance block is 16x16 and the number of pixels in the chrominance block is 16x16, the size of the luminance block is smaller. In the 4:2:0 format, if the number of pixels in the luminance block is 16x16 and the number of pixels in the chrominance block is 8x8, the areas occupied by both blocks are the same, and the luminance block and the chrominance block are the same size.
[0085] To compare the sizes of luminance blocks and chrominance blocks by comparing the number of pixels in the blocks rather than the area of the blocks, the number of pixels in the chrominance blocks can be converted to the number of pixels in the luminance blocks based on the ratio of the luminance signal to the chrominance signal in the chrominance format. In the case of the 4:2:0 format, the number of pixels in the luminance signal is twice the number of pixels in the chrominance signal, so the number of pixels in the chrominance blocks is doubled to convert to the number of pixels in the luminance blocks. For example, in the 4:2:0 format, if the size of the luminance block is 16x16 and the size of the chrominance block is 16x16, the converted size of the chrominance block converted to the number of pixels in the luminance block is 32x32, which shows that the size of the chrominance block is larger.
[0086] Intra prediction allows prediction of the following block after the decoding process is completed in block units. That is, after the decoding of the first luminance block 20a is completed, the decoding of the second luminance block 20b is completed, the decoding of the third luminance block 20c is completed, and the decoding of the third luminance block 20c is completed, and the decoding of the fourth luminance block 20d is completed.
[0087] When the size of the chrominance block is larger than the size of the luminance block, the surrounding pixels required for prediction processing of the chrominance block 20e, both the luminance pixels and the chrominance pixels, are present before the decoding of the four luminance blocks 20a, 20b, 20c, and 20d, and it is therefore possible to calculate the degree of correlation between the surrounding pixels of the luminance signal and the surrounding pixels of the chrominance signal in step S1901 of FIG. 19 without waiting for the decoding of the four luminance blocks 20a, 20b, 20c, and 20d.
[0088] Next, after the first luminance block 20a is decoded, downsampling of the luminance signal is performed in step S1902 of FIG. 19. Without waiting for the completion of the decoding of the second luminance block 20b, the pixels of the chrominance block 20e corresponding to the position of the first luminance block 20a can be predicted. Similarly, after the second luminance block 20b is decoded, downsampling of the luminance signal is performed, and without waiting for the completion of the decoding of the third luminance block 20c, the pixels of the chrominance block 20e corresponding to the position of the second luminance block 20b are predicted. Furthermore, after the third luminance block 20c is decoded, downsampling of the luminance signal is performed, and without waiting for the completion of the decoding of the fourth luminance block 20d, the pixels of the chrominance block 20e corresponding to the position of the third luminance block 20c are predicted. Finally, after the fourth luminance block 20d is decoded, downsampling of the luminance signal is performed, and the pixels of the chrominance block 20e corresponding to the position of the fourth luminance block 20d are predicted.
[0089] Figures 21(a) and 21(b) are diagrams illustrating luminance and chrominance intra prediction when the size of the chrominance block is smaller than the size of the luminance block. The number of pixels of the luminance block 21a shown in Figure 21(a) is 16x16, and the number of pixels of the first to fourth chrominance blocks 21b, 21c, 21d, and 21e divided into four shown in Figure 21(b) is 4x4.
[0090] In the 4:2:0 format, the area occupied by a luminance block is half the area occupied by a chrominance block, so if the number of pixels in the luminance block is 16x16 and the number of pixels in the chrominance block is 4x4, the size of the chrominance block is smaller. To compare the sizes of the luminance block and the chrominance block by comparing the number of pixels in the block rather than the area of the blocks, in the 4:2:0 format, the number of pixels in the chrominance block is doubled to convert it to the number of pixels in the luminance block. In the 4:2:0 format, if the size of the luminance block is 16x16 and the size of the chrominance block is 4x4, the converted size of the chrominance block converted to the number of pixels in the luminance block is 8x8, which shows that the size of the chrominance block is smaller.
[0091] When the size of the chrominance block is smaller than that of the luminance block, the peripheral pixels of the first chrominance block 21b can be used as both luminance and chrominance pixels before the decoding of the luminance block 21a, but the peripheral pixels of the second to fourth chrominance blocks 21c, 21d, and 21e cannot be used until the decoding of the luminance block 21a is completed. In other words, the degree of correlation between the peripheral pixels of the luminance signal and the peripheral pixels of the chrominance signal for the second chrominance block 21c in step S1901 of FIG. 19 cannot be calculated until the decoding of the luminance block 21a is completed and the decoding of the first and second chrominance blocks 21b and 21c is completed. Similarly, the degree of correlation between the peripheral pixels of the luminance signal and the peripheral pixels of the chrominance signal for the third chrominance block 21d cannot be calculated until the decoding of the luminance block 21a is completed and the decoding of the first and second chrominance blocks 21b and 21c is completed. Similarly, for the fourth chrominance block 21e, the degree of correlation between the surrounding pixels of the luminance signal and the surrounding pixels of the chrominance signal cannot be calculated for the fourth chrominance block 21e until the decoding of the luminance block 21a is completed and the decoding of the first to third chrominance blocks 21b, 21c, and 21d is completed.
[0092] In this way, when the size of a chrominance block is smaller than that of a luminance block, performing luminance / chrominance intra prediction results in a processing dependency between the luminance block and the chrominance block, and between the chrominance blocks, which is not suitable for parallel processing. Therefore, when the size of a chrominance block is smaller than that of a luminance block, luminance / chrominance intra prediction is restricted. Methods for restricting luminance / chrominance intra prediction include (1) restricting by syntax, (2) replacing the intra chrominance mode, and (3) replacing surrounding pixels.
[0093] FIG. 22 shows an example of the syntax of the intra chrominance prediction mode. When the chrominance prediction mode number is 0, the same intra prediction mode as the luminance prediction mode is used for the chrominance prediction mode. For example, when the luminance prediction mode is a horizontal prediction mode, the chrominance prediction mode is also a horizontal prediction mode. When the chrominance prediction mode number is 1, average value mode (DC mode) is used. DC mode performs intra prediction using the average value of surrounding pixels. When the chrominance prediction mode number is 2, luminance and chrominance intra prediction mode is used.
[0094] As a method for restricting luminance and chrominance intra prediction, (1) when restricting by syntax, mode 2 is prohibited from use because it represents luminance and chrominance intra prediction. In other words, mode 2 is not transmitted, and the intra chrominance mode is selected from mode 0 and mode 1.
[0095] As a method of restricting luminance and chrominance intra prediction, (2) when replacing an intra chrominance mode, if the chrominance prediction mode number is specified as mode 2, a vertical prediction mode is used instead of the luminance and chrominance intra prediction mode. However, the prediction mode to be replaced is not limited to a vertical prediction mode, and other prediction modes may be used. It is more preferable that the luminance prediction mode of mode 0 and the mode to be replaced in mode 2 are the same, so that the modes to be used do not overlap.
[0096] As a method for limiting luminance and chrominance intra prediction, (3) in the case of replacing surrounding pixels, surrounding pixels for calculating the degree of correlation between surrounding pixels of the luminance signal and surrounding pixels of the chrominance signal in step S1901 in Fig. 19 are replaced. This enables the degree of correlation between surrounding pixels in the second to fourth chrominance blocks 21c, 21d, and 21e in Fig. 21 to be calculated without waiting for the decoding of the luminance block 21a.
[0097] An example of replacement of peripheral pixels is shown in Fig. 23. Normally, pixels in the first chrominance block 21b are used as peripheral pixels on the left side of the second chrominance block 21c, but to use pixels in the first chrominance block 21b, it is necessary to wait for the completion of decoding of the luminance block 21a and the first chrominance block 21b. Therefore, the region 21f that can be used without waiting for the completion of decoding of the luminance block 21a is used as peripheral pixels of the second chrominance block 21c. Similarly, for the third chrominance block 21d, the region 21f that can be used without waiting for the completion of decoding of the luminance block 21a is used as peripheral pixels of the third chrominance block 21d. Similarly, for the fourth chrominance block 21e, the region 21f that can be used without waiting for the completion of decoding of the luminance block 21a is used as peripheral pixels of the fourth chrominance block 21e.
[0098] In this manner, in the first embodiment, when performing luminance / chrominance intra prediction, if the size of the chrominance block is smaller than the size of the luminance block, the processing dependency between the luminance block and the chrominance block can be alleviated by restricting the luminance / chrominance intra prediction. This enables parallel processing of the luminance block and the chrominance block, thereby reducing the amount of encoding / decoding processing.
[0099] (Second embodiment) A second embodiment of the present invention will be described below. The second embodiment differs from the first embodiment in that luminance and chrominance intra prediction is restricted by evaluating the sizes of luminance blocks and chrominance blocks independently, rather than by the size relationship between luminance blocks and chrominance blocks. Other configurations and operations are the same as those of the first embodiment.
[0100] First, the restriction based on the size of the luminance block will be described. Fig. 24(a) to Fig. 24(c) show luminance and chrominance intra prediction according to the difference in the size of the luminance block. As shown in Fig. 24(a) and Fig. 24(b), the first luminance block 24a corresponds to the position of the first chrominance block 24e, the second luminance block 24b corresponds to the position of the second chrominance block 24f, the third luminance block 24c corresponds to the position of the third chrominance block 24g, and the fourth luminance block 24d corresponds to the position of the fourth chrominance block 24h. Moreover, the luminance block 24i in Fig. 24(c) corresponds to the positions of the first to fourth chrominance blocks 24e, 24f, 24g, and 24h in Fig. 24(b).
[0101] The dependency between the luminance block and the chrominance block will be described. When the size of the luminance block is small as shown in FIG. 24(a), when the decoding of the first luminance block 24a is completed, the decoding of the first chrominance block 24e becomes possible. When the decoding of the second luminance block 24b is completed, the decoding of the second chrominance block 24f becomes possible. When the decoding of the third luminance block 24c is completed, the decoding of the third chrominance block 24g becomes possible. When the decoding of the fourth luminance block 24d is completed, the decoding of the fourth chrominance block 24h becomes possible.
[0102] On the other hand, when the size of the luminance block is large as in FIG. 24(c), the first to fourth chrominance blocks 24e, 24f, 24g, and 24h cannot all be decoded unless the decoding of the luminance block 24i is completed.
[0103] When the division of the luminance block and the division of the chrominance block are determined independently, if the absolute size of the luminance block is large, the size of the chrominance block is more likely to be smaller than the size of the luminance block. Therefore, when the absolute size of the luminance block is equal to or larger than a predetermined size, the luminance and chrominance intra prediction of the corresponding chrominance block is restricted.
[0104] Similarly, when the absolute size of the chrominance block is small, the size of the chrominance block is more likely to be smaller than the size of the luma block. Therefore, when the absolute size of the chrominance block is equal to or smaller than a predetermined size, the luminance and chrominance intra prediction of the chrominance block is restricted.
[0105] The method of limiting luminance and chrominance intra prediction is the same as in the first embodiment.
[0106] In this way, in the second embodiment, when the absolute size of the luma block is larger than the threshold or when the absolute size of the chroma block is smaller than the threshold, luma / chroma intra prediction is restricted. This makes it possible to predict a case where the size of the chroma block is smaller than the luma block, thereby restricting luma / chroma intra prediction and probabilistically relaxing the processing dependency between the luma block and the chroma block.
[0107] (Third embodiment) A third embodiment of the present invention will be described. The third embodiment is different from the first embodiment in that the block division unit 101 divides the chrominance block so that the size of the chrominance block is not smaller than the size of the luminance block, but other configurations and operations are the same as those of the first embodiment. When dividing the chrominance block, the block division unit 101 prohibits division such that the size of the chrominance block is smaller than the size of the luminance block. This prevents the size of the chrominance block from becoming smaller than the size of the luminance block in luminance / chrominance intra prediction, and allows parallel processing of the luminance block and the chrominance block at all times.
[0108] The encoded bit stream of images output by the image encoding device of the above-described embodiments has a specific data format so that it can be decoded according to the encoding method used in the embodiment, and an image decoding device corresponding to the image encoding device can decode the encoded bit stream of this specific data format.
[0109] When a wired or wireless network is used to exchange coded bitstreams between an image coding device and an image decoding device, the coded bitstream may be converted into a data format suitable for the transmission mode of the communication channel and then transmitted. In this case, a transmitting device is provided that converts the coded bitstream output by the image coding device into coded data in a data format suitable for the transmission mode of the communication channel and transmits the coded bitstream to the network, and a receiving device is provided that receives the coded data from the network, restores it to a coded bitstream, and supplies it to the image decoding device.
[0110] The transmitting device includes a memory that buffers the coded bit stream output by the image coding device, a packet processing unit that packetizes the coded bit stream, and a transmitting unit that transmits the packetized coded data via a network. The receiving device includes a receiving unit that receives the packetized coded data via the network, a memory that buffers the received coded data, and a packet processing unit that packetizes the coded data to generate a coded bit stream and provides it to the image decoding device.
[0111] Also, by adding a display unit for displaying the image decoded by the image decoding device, it is possible to configure the device as a display device. In this case, the display unit reads out the decoded image signal generated by the decoded image signal superimposition unit 205 and stored in the decoded image memory 206, and displays it on a screen.
[0112] In addition, it is possible to configure the image encoding device by adding an imaging unit and inputting a captured image to the image encoding device. In this case, the imaging unit inputs a captured image signal to the block division unit 101.
[0113] The above encoding and decoding processes can be realized not only as a hardware-based transmission, storage, and receiving device, but also as firmware stored in a ROM (read-only memory) or flash memory, or as software for a computer, etc. The firmware and software programs can be provided by recording them on a computer-readable recording medium, or by providing them from a server via a wired or wireless network, or as data broadcasting via terrestrial or satellite digital broadcasting.
[0114] The present invention has been described above based on the embodiments. The embodiments are merely examples, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component and each treatment process, and that such modifications are also within the scope of the present invention. [Explanation of symbols]
[0115] 100 image encoding device, 101 block division unit, 102 predicted image generation unit, 103 residual signal generation unit, 104 orthogonal transform and quantization unit, 105 encoded bit string generation unit, 106 inverse quantization and inverse orthogonal transform unit, 107 decoded image signal superposition unit, 108 decoded image memory, 200 image decoding device, 201 bit string decoding unit, 202 block division unit, 203 inverse quantization and inverse orthogonal transform unit, 204 predicted image generation unit, 205 decoded image signal superposition unit, 206 decoded image memory.
Claims
1. 1. An image coding device that divides an image into blocks, codes the divided blocks, and generates a bit stream, comprising: a primary signal block division unit that divides a primary signal of the image into rectangles of a first predetermined size to generate primary signal blocks; a secondary signal block division unit that divides a secondary signal of the image into rectangles of a second predetermined size to generate secondary signal blocks; a primary signal prediction unit for predicting a primary signal; a secondary signal prediction unit for predicting a secondary signal, The primary signal block and the secondary signal block are divided independently in the case of intra prediction; the primary signal is a luminance signal and the secondary signal is a color difference signal; The secondary signal prediction unit is capable of inter-component intra prediction for predicting a secondary signal from an encoded primary signal, and when a size of the primary signal block is equal to or larger than a third predetermined size, prohibits use of the inter-component intra prediction; The secondary signal prediction unit downsamples the primary signal in the inter-component intra prediction according to a format between the primary signal and the secondary signal.
1. An image encoding device comprising:
2. 1. An image coding method for dividing an image into blocks, coding the divided blocks, and generating a bitstream, comprising the steps of: a primary signal block division step of dividing a primary signal of the image into rectangles of a first predetermined size to generate primary signal blocks; a secondary signal block division step of dividing the secondary signal of the image into rectangles of a second predetermined size to generate secondary signal blocks; a primary signal prediction step of predicting a primary signal; and a secondary signal prediction step of predicting a secondary signal, The primary signal block and the secondary signal block are divided independently in the case of intra prediction; the primary signal is a luminance signal and the secondary signal is a color difference signal; The secondary signal prediction step includes: prohibiting use of the inter-component intra prediction for predicting the secondary signal from the encoded primary signal when the inter-component intra prediction is possible and the size of the primary signal block is equal to or larger than a third predetermined size; The secondary signal prediction step includes downsampling the primary signal according to a format between the primary signal and the secondary signal in the inter-component intra prediction.
13. An image coding method comprising:
3. An image decoding device that decodes an image in units of blocks obtained by dividing the image, a primary signal block division unit that divides a primary signal of the image into rectangles of a first predetermined size to generate primary signal blocks; a secondary signal block division unit that divides a secondary signal of the image into rectangles of a second predetermined size to generate secondary signal blocks; a primary signal prediction unit for predicting a primary signal; a secondary signal prediction unit for predicting a secondary signal, The primary signal block and the secondary signal block are partitioned independently in the case of intra prediction, and are partitioned together in the case of inter prediction; the primary signal is a luminance signal and the secondary signal is a color difference signal; The secondary signal prediction unit is capable of inter-component intra prediction for predicting a secondary signal from a decoded primary signal, and when a size of the primary signal block is equal to or larger than a third predetermined size, prohibits use of the inter-component intra prediction; The secondary signal prediction unit downsamples the primary signal in the inter-component intra prediction according to a format between the primary signal and the secondary signal.
2. An image decoding device comprising:
4. An image decoding method for decoding an image in units of blocks obtained by dividing the image, comprising the steps of: a primary signal block division step of dividing a primary signal of the image into rectangles of a first predetermined size to generate primary signal blocks; a secondary signal block division step of dividing the secondary signal of the image into rectangles of a second predetermined size to generate secondary signal blocks; a primary signal prediction step of predicting a primary signal; and a secondary signal prediction step of predicting a secondary signal, The primary signal block and the secondary signal block are divided independently in the case of intra prediction; the primary signal is a luminance signal and the secondary signal is a color difference signal; The secondary signal prediction step includes: prohibiting use of the inter-component intra prediction for predicting the secondary signal from the decoded primary signal when the inter-component intra prediction is possible and the size of the primary signal block is equal to or larger than a third predetermined size; The secondary signal prediction step includes downsampling the primary signal according to a format between the primary signal and the secondary signal in the inter-component intra prediction.
2. An image decoding method comprising:
5. A method for storing a bit stream generated according to the image coding method according to claim 2 on a recording medium.
6. A transmission method for transmitting a bit stream generated according to the image coding method according to claim 2.
Citation Information
Patent Citations
Image encoder, image encoding method and image encoding program
JP2013005343A
Image processing device and image processing method
JP2013034163A
Intra prediction apparatus, encoder, decoder and program
JP2013090015A
