Moving picture encoding device and moving picture decoding device

By exclusively using tile and wavefront in the tile group in HEVC and changing the tile size in the tile group unit, the complex processing problems caused by the inexclusive use of tile, wavefront and slice in HEVC are solved, and efficient Parallel tile group encoding and decoding improves encoding and decoding efficiency.

CN113228669BActive Publication Date: 2024-11-08SHARP KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980085198.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-12-21
Filing Date
2019-12-20
Publication Date
2024-11-08
Estimated Expiration
2039-12-20

AI Technical Summary

Technical Problem

The use of tile, wavefront and slices in HEVC is not exclusive, resulting in complex processing, and it is impossible to efficiently encode and decode in units of tile groups, and it is impossible to flexibly change the width and height of the tile.

Method used

Design a moving image decoding and encoding device, by exclusively using tile and wavefronts within the tile group, and changing the width and height of the tile in the tile group unit, use processor and storage programs for decoding and encoding, using The WPP valid flag and segmented last bits are encoded and decoded.

Benefits of technology

The encoding and decoding processing of tile groups is simplified and efficient, and parallel processing within tile groups is realized, which can flexibly change the size of tiles and improve the encoding and decoding efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113228669B_ABST
    Figure CN113228669B_ABST
Patent Text Reader

Abstract

A motion picture decoding device for decoding encoded data of a tile group has at least one processor and a storage device coupled to the at least one processor and storing a program. The tile group is generated by dividing a picture into one or more rectangular areas and is composed of one or more segments. When the program is executed, the wavefront parallel processing WPP valid flag of the tile group is used, and the last bit in the one or more segments in the tile group is decoded. When the WPP valid flag is 1, after decoding the syntax structure of the CTU at the right end of the CTU row of the tile group, the last bit of the first segment with a fixed value in the one or more segments is decoded. When the WPP valid flag is 0, after decoding the syntax structure of the lower right CTU in the rectangular tile of the tile group, the last bit of the second segment with a fixed value in the one or more segments is decoded.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] One aspect of the present invention relates to a moving picture decoding device and a moving picture encoding device. Background Art

[0002] In order to efficiently transmit or record moving images, a moving image encoding device that generates encoded data by encoding the moving image and a moving image decoding device that generates a decoded image by decoding the encoded data are used.

[0003] Specific moving picture coding methods include, for example, H.264 / AVC, HEVC (High-Efficiency Video Coding), and the like.

[0004] In this motion image coding method, images (pictures) constituting the motion image are managed through a hierarchical structure and encoded / decoded for each CU. The hierarchical structure includes slices obtained by dividing the image, coding tree units (CTU: Coding Tree Unit) obtained by dividing the slices, coding units (sometimes also called coding units (Coding Unit: CU)) obtained by dividing the coding tree units, and transform units (TU: Transform Unit) obtained by dividing the coding units.

[0005] In addition, in such a moving picture coding method, a prediction image is usually generated based on a local decoded image obtained by notifying an input image, and a prediction error (sometimes also referred to as a "difference image" or "residual image") obtained by subtracting the prediction image from the input image (original image) is encoded. Examples of a method for generating a prediction image include inter-picture prediction (inter-frame prediction) and intra-picture prediction (intra-frame prediction).

[0006] In addition, as a method of dividing a screen into a plurality of units for transmission, a method of dividing into slices, CTU lines (wavefront parallel, hereinafter referred to as segmentation), and tiles is known.

[0007] In addition, as a recent technology for motion picture encoding and decoding, non-patent document 1 can be cited, and in the future, it is planned to correspond to a tile group as a sub-stream that combines multiple tiles. Non-patent document 2 discloses the technology of the tile group, and a specific syntax example of the tile group is disclosed in non-patent document 3.

[0008] Prior art literature

[0009] Non-patent literature

[0010] Non-patent document 1: “Versatile Video Coding (Draft 3)”, JVET-L1001, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO / IEC JTC 1 / SC 29 / WG 11, 2018-11-08

[0011] Non-patent document 2: “Tile groups for VVC”, JVET-L0415, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO / IEC JTC 1 / SC 29 / WG 11, 2018-09-25

[0012] Non-patent document 3: “Spec text for the agreed starting point on slicing and tiling”, JVET-L0686, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO / IEC JTC 1 / SC 29 / WG 11, 2018-10-12 Summary of the invention

[0013] Problem that the invention aims to solve

[0014] In HEVC, there is the following problem: although it corresponds to the wavefront parallel processing (WPP) that divides the picture into rectangular tiles, divides it into CTU rows, and divides it into slices of a set of continuous CTUs, the use of tiles, wavefronts, and slices is not exclusive for one area, so the processing becomes complicated. In addition, as described in non-patent documents 2 and 3, there is the following problem: it does not correspond to the tile group, so when using tile and wavefront parallelization, only the entry point indicating the start position of the encoded data can be encoded in units of pictures, and it cannot be encoded in units of groups obtained by dividing the screen.

[0015] The tiles described in non-patent documents 2 and 3 have the following problems: tiles can be notified in groups, but they do not correspond to slices of segmentation positions that realize efficient and highly parallel wavefront parallel processing or segmentation at arbitrary positions outside a rectangle. In addition, the type of segmentation cannot be switched in tile groups.

[0016] Furthermore, in the tiles described in Non-Patent Documents 2 and 3, a method of dividing the tiles in units of pictures is defined, and therefore the width and height of the tiles cannot be changed in units of picture groups.

[0017] Therefore, the present invention is made in view of the above problems, and its purpose is to simplify and improve the efficiency of encoding and decoding processing by exclusively using tiles, wavefronts, and slices in a tile group. In addition, the width and height of the tile are also changed in the unit of the picture group.

[0018] Technical Solution

[0019] One scheme of the present invention is a motion picture decoding device that decodes coded data of a tile group. The tile group is generated by dividing a picture into one or more rectangular areas and is composed of one or more segments. Each of the one or more rectangular areas is composed of one or more coding tree units CTU, and each of the one or more segments is a unit for dividing and sending the tile group. The scheme is characterized in that the motion picture decoding device has at least one processor and a storage device coupled to the at least one processor and storing a program. When the program is executed by the at least one processor, the at least one processor decodes a wavefront parallel processing WPP valid flag, the WPP valid flag indicating which of the CTU rows with a rectangular tile and a height of a coding tree unit CTU exists in the one or more segments in the tile group, wherein the tile group is a collection of CTUs; and decodes the last bit in the one or more segments in the tile group. When the WPP valid flag is 1, after decoding the syntax structure of the CTU at the right end of the CTU row of the tile group, the last bit of the first segment with a fixed value among the one or more segments is decoded. When the WPP valid flag is 0, after decoding the syntax structure of the CTU at the bottom right of the rectangular tile of the tile group, the last bit of the second segment with a fixed value among the one or more segments is decoded.

[0020] One scheme of the present invention is a motion picture coding device that encodes coded data of a tile group. The tile group is generated by dividing a picture into one or more rectangular areas and is composed of one or more segments. Each of the one or more rectangular areas is composed of one or more coding tree units CTU, and each of the one or more segments is a unit for dividing and sending the tile group. The scheme is characterized in that the motion picture coding device has at least one processor and a storage device coupled to the at least one processor and storing a program. When the program is executed by the at least one processor, the at least one processor encodes a wavefront parallel processing WPP valid flag, the WPP valid flag indicating which of the CTU rows with a rectangular tile and a height of a coding tree unit CTU exists in the one or more segments in the tile group, wherein the tile group is a set of CTUs; and the last bit in the one or more segments in the tile group is encoded. When the WPP valid flag is 1, after encoding the syntax structure of the CTU at the right end of the CTU row of the tile group, the last bit of the first segment with a fixed value among the one or more segments is encoded. When the WPP valid flag is 0, after encoding the syntax structure of the CTU at the bottom right of the rectangular tile of the tile group, the last bit of the second segment with a fixed value among the one or more segments is encoded.

[0021] One solution of the present invention is a motion picture decoding device that decodes coded data of a tile group. The tile group is generated by dividing a picture into one or more rectangular areas and is composed of one or more segments, each of the one or more rectangular areas is composed of one or more coding tree units CTU, and each of the one or more segments is a unit for dividing and sending the tile group. The solution is characterized in that the motion picture decoding device has at least one processor and a storage device coupled to the at least one processor and storing a program. When the program is executed by the at least one processor, when the tile group uses wavefront parallel processing WPP, the tile group has a coding tree unit CTU row, and the last bit and byte alignment of the segment of the CTU at the right end of the CTU row in the tile group are decoded, and when the tile group does not use WPP, the tile group has a rectangular tile, and the last bit and byte alignment of the lower right CTU in the rectangular tile of the tile group are decoded. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is a schematic diagram showing the configuration of the image transmission system according to the present embodiment.

[0023] Figure 2 This is a diagram showing the configuration of a transmitting device equipped with a moving picture encoding device according to this embodiment and a receiving device equipped with a moving picture decoding device. Figure 2 (a) represents a transmitting device equipped with a motion picture encoding device, Figure 2 (b) represents a receiving device equipped with a motion picture decoding device.

[0024] Figure 3 This is a diagram showing the configuration of a recording device equipped with a moving picture encoding device according to this embodiment and a reproducing device equipped with a moving picture decoding device. Figure 3 (a) represents a recording device equipped with a motion picture encoding device, Figure 3 (b) shows a reproduction device equipped with a motion picture decoding device.

[0025] Figure 4 This is a diagram showing the hierarchical structure of coded stream data.

[0026] Figure 5 This is a diagram showing an example of image segmentation.

[0027] Figure 6 This is a diagram for explaining a tile group.

[0028] Figure 7 This is a flowchart for explaining encoding or decoding of a tile group according to this embodiment.

[0029] Figure 8 This is a diagram for explaining the tile group according to this embodiment.

[0030] Fig. 9 This is a schematic diagram showing the structure of a moving picture decoding device.

[0031] Fig.10 This is a flowchart for explaining the schematic operation of the moving picture decoding device.

[0032] Fig.11 It is a syntax table related to tile information, etc.

[0033] Fig.12 This is a diagram showing the syntax structure of a tile group according to this embodiment.

[0034] Fig.13 This is a diagram for explaining the tile group according to this embodiment.

[0035] Fig.14 This is a diagram showing the syntax structure of the picture parameter set according to the present embodiment.

[0036] Fig.15 This is an example of using different types of segments in tile group (segment group) units.

[0037] Fig.16 This is a diagram illustrating the exclusive configuration of picture block segmentation and CTU row segmentation.

[0038] Fig.17 This is a diagram for explaining the operation of the header decoding unit in the exclusive configuration of tiles and wavefronts.

[0039] Fig.18 This is a diagram showing the syntax structure of a tile group according to this embodiment.

[0040] Fig.19 This is a diagram showing the syntax structure of a tile group according to this embodiment.

[0041] Fig. 20 This is a diagram for explaining the exclusive structure of tile segments and slice segments.

[0042] Fig.21 This is a diagram showing the syntax structure of a tile group according to this embodiment.

[0043] Fig. 22 This is a diagram illustrating the exclusive structures of tile segmentation, CTU row segmentation, and slice segmentation.

[0044] Fig.23 This is a diagram showing the syntax structure of a tile group according to this embodiment.

[0045] Fig.24 This is a block diagram showing the structure of a moving picture encoding device.

[0046] Fig.25 This is a diagram showing the syntax structure of a tile group according to this embodiment.

[0047] Fig.26 This is a flowchart for explaining the schematic operation of the moving picture decoding device. DETAILED DESCRIPTION

[0048] (First Embodiment)

[0049] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0050] Figure 1 It is a schematic diagram showing the configuration of the image transmission system 1 according to the present embodiment.

[0051] The image transmission system 1 is a system for transmitting a coded stream obtained by encoding a coding target image, and decoding the transmitted coded stream to display the image. The image transmission system 1 is configured to include: a moving image encoding device (image encoding device) 11, a network 21, a moving image decoding device (image decoding device) 31, and a moving image display device (image display device) 41.

[0052] The moving image encoding device 11 is input with an image T.

[0053] The network 21 transmits the encoded stream Te generated by the moving image encoding device 11 to the moving image decoding device 31. The network 21 is the Internet, a wide area network (WAN), a local area network (LAN), or a combination thereof. The network 21 is not necessarily limited to a two-way communication network and may also be a one-way communication network that transmits broadcast waves such as terrestrial digital broadcasts and satellite broadcasts. In addition, the network 21 may be replaced by a storage medium such as a DVD (Digital Versatile Disc, registered trademark) or a BD (Blue-ray Disc, registered trademark) on which the encoded stream Te is recorded.

[0054] The moving image decoding device 31 decodes the encoded stream Te transmitted by the network 21 respectively to generate one or more decoded images Td after decoding.

[0055] The moving image display device 41 displays all or part of the one or more decoded images Td generated by the moving image decoding device 31. The moving image display device 41 includes, for example, a display device such as a liquid crystal display or an organic EL (Electro-luminescence) display. As the form of the display, a fixed type, a mobile type, an HMD, etc. can be cited. In addition, when the moving image decoding device 31 has high processing power, an image with high image quality is displayed, and when it only has low processing power, an image that does not require high processing power and high display ability is displayed.

[0056] <Operator>

[0057] The following describes the operators used in this specification.

[0058] (>>) is a right shift, (<<) is a left shift, (&) is a bitwise AND, (|) is a bitwise OR, (|=) is an OR assignment operator, and (||) represents a logical OR.

[0059] (x? y : z) is a ternary operator that takes y when x is true (non-zero) and takes z when x is false (0).

[0060] (Clip3(a, b, c)) is a function that clips c to a value between a and b (inclusive), and returns a when c < a, returns b when c > b, and returns c in other cases (where a <= b).

[0061] (abs(a)) is a function that returns the absolute value of a.

[0062] Int(a) is a function that returns the integer value of a.

[0063] floor(a) is a function that returns the largest integer below a.

[0064] ceil(a) is a function that returns the smallest integer greater than a.

[0065] a / d means a divided by d (discarding decimal places).

[0066] <Structure of coded stream Te>

[0067] Before describing in detail the moving picture encoding device 11 and the moving picture decoding device 31 of the present embodiment, the data structure of the coded stream Te generated by the moving picture encoding device 11 and decoded by the moving picture decoding device 31 will be described.

[0068] Figure 4 : is a diagram showing the hierarchical structure of data in a coded stream Te. The coded stream Te exemplarily includes a sequence and a plurality of pictures constituting the sequence. Figure 4 (a) to (f) respectively represent a coded video sequence of a given sequence SEQ, a coded picture of a specified picture PICT, a coded picture block group of a specified picture block group, a segment of a specified picture block (e.g., a coded picture block, a CTU row, a slice), a coding tree unit included in a segment, and a coding unit included in a coding tree unit.

[0069] (Encoded video sequence)

[0070] In the coded video sequence, a set of data that the moving image decoding device 31 refers to in order to decode the sequence SEQ to be processed is specified. Figure 4 As shown in (a), the sequence SEQ includes a sequence parameter set SPS (Sequence Parameter Set), a picture parameter set PPS (Picture Parameter Set), a picture PICT and supplemental enhancement information SEI (Supplemental Enhancement Information).

[0071] In the sequence parameter set SPS, a set of coding parameters that the motion picture decoding device 31 refers to in order to decode the object sequence is specified. For example, information related to the width, height, and shape of the picture, and information related to the opening / closing of the decoding tool are specified. It should be noted that there can be multiple SPSs. In this case, any one of the multiple SPSs is selected from the PPS.

[0072] In the picture parameter set PPS, a set of coding parameters that the motion image decoding device 31 refers to in order to decode each picture in the object sequence is specified. For example, it includes information related to the number, width, and height of the tiles that constitute the picture. It should be noted that there can be multiple PPSs. In this case, any one of the multiple PPSs is selected from each picture in the object sequence.

[0073] (Encoded image)

[0074] In the coded picture, a set of data that the moving image decoding device 31 refers to in order to decode the picture PICT to be processed is specified. Figure 4 As shown in (b) of FIG. 1 , the picture PICT includes tile group 0 to tile group NTG-1 (NTG is the total number of tiles included in the picture PICT).

[0075] (segments, tile groups)

[0076] A segment is a unit for dividing a picture and transmitting it, and is encoded and decoded as a byte-aligned bit string in the encoded data.

[0077] Tiles, CTU rows, and slices are segments used to divide and send pictures.

[0078] A segment group (tile group) refers to a group of segments that is a set of CTUs, and may also be referred to as a segment group. It should be noted that each segment is a unit having the following characteristics, and can be decoded in parallel.

[0079] ·Corresponding to the set of CTUs on the screen

[0080] Byte alignment on the encoded data

[0081] Initialize context-based adaptive binary arithmetic coding (CABAC) at the beginning of the segment

[0082] Can restrict prediction between segments within the same picture (can restrict reference to other segments)

[0083] The restriction of prediction means, for example, that when the segmentation is a tile, a restriction is imposed on not performing intra-frame prediction of an image using a tile different from the object tile. The same is true when the segmentation is a slice, and a restriction is imposed on not performing intra-frame prediction of an image using a slice different from the object slice. When the segmentation is WPP, intra-frame prediction of a portion of an image using a CTU row different from the object CTU row is allowed. Specifically, in WPP, the CTU row above the object CTU row can be referenced. However, in the CTU row above the object CTU row, the CTU whose horizontal coordinate exceeds the object CTU cannot be referenced. In addition, the reference can be turned on / off according to a flag.

[0084] In a tile group (segment group), by encoding a header common to the segments only once in the segments, the encoding efficiency is improved.

[0085] Figure 5 The image is divided into four tile groups TileGr0 to TileGr3. The tile group can be further divided into one or more segments. The number after TileGr ( Figure 5 0 to 3 in the figure) is an identifier of a tile group, and is set in a raster scanning order from the upper left to the lower right of the picture. The tile group identifier is a different value for each tile group, and is a value that increases monotonically in the scanning order.

[0086] Figure 6 (a) is a diagram illustrating a block address when a segment is divided into blocks. Figure 6 The number after the tile Tile in (a) is the address of the tile in the picture (TileAddrInPic). TileAddrInPic is set in raster scanning order from the upper left to the lower right of the picture. Figure 6 The tile group TileGr0 in (a) includes tiles Tile0, Tile1, Tile4, and Tile5. TileGr1 includes Tile2, Tile3, Tile6, and Tile7. TileGr2 includes Tile8 and Tile9. TileGr3 includes Tile10 and Tile11. When TileAddrInPic is used as the tile address, the tile address is not continuous within the tile group.

[0087] Figure 6 (b) is another diagram illustrating the block address when the segments are divided into blocks.

[0088] Figure 6 The number after the tile Tile in (b) is the address of the tile in the tile group (TileAddrInTG). TileAddrInTG is set in raster scanning order from the upper left to the lower right of the tile group. Figure 6The tile group TileGr0 in (b) includes tiles Tile0, Tile1, Tile2, and Tile3. TileGr1 includes Tile4, Tile5, Tile6, and Tile7. TileGr2 includes Tile8 and Tile9. TileGr3 includes Tile10 and Tile11. When TileAddrInTG is used as the tile address, the tile addresses are continuous within the tile group.

[0089] (Encoding tile group)

[0090] The coded tile group specifies a set of data that the video decoding device 31 refers to in order to decode the tile group to be processed. Figure 4 As shown in (c), the tile group includes a tile group header and tile group data. In addition, the tile group data may include suffix data (rbsp_tile_group_trailing_bits) for byte alignment.

[0091] Figure 7 This is a flowchart for explaining the encoding or decoding of a tile group according to this embodiment. The components for executing each step are described in Fig. 9 , Fig.24 , which will be described later.

[0092] S2001: The header encoding unit 1110 and the header decoding unit 3020 encode or decode the tile group header.

[0093] S2002: The CT information encoding unit 1111 and the CT information decoding unit 3021 encode or decode the tile group data.

[0094] S2003: The header encoding unit 1110 and the header decoding unit 3020 encode or decode the suffix data. The suffix data may include a bit string for byte alignment. In addition, after byte alignment, it may also include a bit string indicating segmentation.

[0095] The tile group header includes a coding parameter group for determining a decoding method of the object tile group and parameters common to the tiles in the tile group. The tile group data is composed of coded data of one or more segments included in the tile group. The segments are composed of CTUs. When the segments are tiles, the tile group data is composed of one or more coded tiles.

[0096] (Tile Group Header)

[0097] The tile group header may include tile group type designation information (tile_group_type).

[0098] The types of tile groups that can be specified by the tile group type designation information include: (1) an I tile group that uses only intra-frame prediction during encoding; (2) a P tile group that uses unidirectional prediction or intra-frame prediction during encoding; (3) a B tile group that uses unidirectional prediction, bidirectional prediction, or intra-frame prediction during encoding, etc. It should be noted that inter-frame prediction is not limited to unidirectional prediction and bidirectional prediction, and more reference pictures can also be used to generate a predicted image. Hereinafter, the P and B tile groups refer to tile groups that include blocks that can use inter-frame prediction.

[0099] It should be noted that the tile group header may include a reference to the picture parameter set PPS (pic_parameter_set_id).

[0100] (Encoding block)

[0101] In the coded picture block, a set of data that the video decoding device 31 refers to in order to decode the picture block to be processed is specified. Figure 4 As shown in (d) of FIG. 1 , a tile includes a CTU. A CTU is a block of a fixed size (eg, 128×128) constituting a tile, and is sometimes referred to as a Largest Coding Unit (LCU).

[0102] (tiles, WPP, slices)

[0103] Figure 8 (a) is an example of dividing the tile group TileGr0 into multiple tiles Tile0 to Tile3 (rectangles with thick solid lines). A tile is a segment of a rectangle consisting of one or more CTUs. The address of each CTU (CTU address ctbAddrTs in tile scan order) is set from the upper left to the lower right of each tile in raster scan order.

[0104] Figure 8 (b) is an example of dividing a tile group into multiple CTU rows. Figure 8 As shown in (b), a CTU row is a segment consisting of a set of CTUs of one row (the height is the CTU height, and the width is the segment width). As described later, the segmentation of the CTU row is used in WPP.

[0105] Figure 8 (c) is an example of dividing a tile group into a set of continuous CTUs. Figure 8 As shown in (c), a slice is a segment consisting of a set of CTUs in encoding and decoding order.

[0106] (Coding Tree Unit)

[0107] exist Figure 4In (e), a set of data that the motion image decoding device 31 refers to in order to decode the CTU of the processing object is specified. The CTU is divided into coding units CU, which are basic units of encoding processing, by recursive quadtree partitioning (QT (Quad Tree) partitioning), binary tree partitioning (BT (Binary Tree) partitioning) or ternary tree partitioning (TT (Ternary Tree) partitioning). BT partitioning and TT partitioning are collectively referred to as multi-tree partitioning (MT (Multi Tree) partitioning). The nodes of the tree structure obtained by recursive quadtree partitioning are called coding nodes (Coding Node). The intermediate nodes of the quadtree, binary tree and ternary tree are coding nodes, and the CTU itself is also specified as the top-level coding node.

[0108] (Coding unit)

[0109] like Figure 4 As shown in (f), a set of data that the moving image decoding device 31 refers to in order to decode the coding unit of the processing object is specified. Specifically, the CU is composed of a CU header, prediction parameters, transformation parameters, quantized transformation coefficients, etc. The prediction mode, etc. are specified in the CU header (CU header: CUH).

[0110] (Configuration of Moving Image Decoding Device)

[0111] The video decoding device 31 ( Fig. 9 ) is described below.

[0112] The motion picture decoding device 31 is configured to include: a parameter decoding unit (prediction image decoding device) 302, a loop filter 305, a reference picture memory 306, a prediction parameter memory 307, a prediction image generation unit (prediction image generation device) 308, an inverse quantization / inverse transformation unit 311, and an addition unit 312. It should be noted that according to the motion picture encoding device 11 described later, there is also a configuration in which the loop filter 305 is not included in the motion picture decoding device 31. The parameter decoding unit 302 further includes an entropy decoding unit 301, a header decoding unit 3020, a CT information decoding unit 3021, and a CU decoding unit 3022, and the CU decoding unit 3022 further includes a TU decoding unit 3024.

[0113] (Decoding module)

[0114] The following describes the schematic operation of each module. The parameter decoding unit 302 performs decoding processing on parameters such as header information, partition information, prediction information, and quantized transform coefficients.

[0115] The entropy decoding unit 301 decodes syntax elements from binary data. More specifically, the entropy decoding unit 301 decodes syntax elements from coded data based on entropy coding methods such as CABAC based on syntax elements supplied by the supplier and returns the syntax elements to the supplier. In the example shown below, the supplier of syntax elements is the CT information decoding unit 3021 and the CU decoding unit 3022.

[0116] (Basic process)

[0117] Fig.10 This is a flowchart for explaining the schematic operation of the moving picture decoding device 31 .

[0118] (S1100: Parameter set information decoding) The header decoding unit 3020 decodes parameter set information such as SPS and PPS and tile information from the encoded data.

[0119] Information related to the number of divisions or size of a tile is called tile information. The width ColWidth and height RowHeight of the tile are derived using the width PicWidthInCtbsY and height PicHeightInCtbsY of the picture, as well as the number of tiles NumTileColumns and NumTileRows in the horizontal and vertical directions within the picture. The unit of ColWidth, RowHeight, PicWidthInCtbsY, and PicHeightInCtbsY is CTU. The header decoding unit 3020 uses the pixel unit width pic_width_in_luma_samples and height pic_height_in_luma_samples of the picture, and the value log2_ctu_size_minus2 obtained by subtracting 2 from the logarithm of the CTU size, to derive the information using the following formula. pic_width_in_luma_samples, pic_height_in_luma_samples, log2_ctu_size_minus2 are obtained by Fig.11 (a) sequence_parameter_set_rbsp() (referred to as SPS) is notified (signal notification). Hereinafter, "notifying" a certain information means including the certain information in the coded data (bit stream), encoding the information in the motion picture coding device, and decoding the information in the motion picture decoding device. ctuWidth = ctuHeight = 1 << (log2_ctu_size_minus2+2)

[0120] PicWidthInCtbsY=Ceil(pic_width_in_luma_samples / ctuWidth)

[0121] PicHeightInCtbsY=Ceil(pic_height_in_luma_samples / ctuHeight)

[0122] The division ( / ) here uses decimal precision.

[0123] The number of tiles NumTileColumns and NumTileRows in the horizontal and vertical directions of the image are determined by Fig.11 (b) PPS (pic_parameter_set_rbsp()) is notified. For example, tile information can be single_tile_in_pic_flag, num_tile_columns_minus1, num_tile_rows_minus1, uniform_tile_spacing_flag, tile_column_width_minus1[i], tile_row_height_minus1[i]. Here, single_tile_in_pic_flag is a flag indicating whether there are multiple tiles in the picture. If it is 1, there is one tile in the picture and the picture is equivalent to a tile. If it is 0, multiple tiles are included in the picture. num_tile_columns_minus1 and num_tile_rows_minus1 are the values ​​obtained by subtracting 1 from the number of tiles NumTileColumns and NumTileRows in the horizontal and vertical directions of the picture, respectively. uniform_spacing_flag is a flag indicating whether the picture is divided into tiles as equally as possible.

[0124] The header decoding unit 3020 derives the number of tiles NumTileColumns and NumTileRows in the horizontal and vertical directions of the picture and the total number of tiles NumTilesInPic in the picture through the following formula: NumTileColumns=num_tile_columns_minus1+1

[0125] NumTileRows=num_tile_rows_minus1+1

[0126] NumTilesInPic=NumTileColumns*NumTileRows

[0127] The header decoding unit 3020 can derive the tile size through the following formula.

[0128]

[0129] When the value of uniform_spacing_flag is 0, the width and height of each tile of the picture are set individually. In the moving image encoding device, the width ColWidth[m] and height RowHeight[n] of each tile are encoded for each tile. The header decoding unit 3020 of the moving image decoding device decodes ColWidth[m] and RowHeight[n] for each tile in the following manner.

[0130] ColWidth[m] = tile_column_width_minus1[m] + 1 (0 <= m < NumTileColumns - 1)

[0131] RowHeight[n] = tile_row_height_minus1[m] + 1 (0 <= n < NumTileRows - 1)

[0132] ColWidth[NumTileColumns - 1] = PicWidthInCtbsY - sum_m(ColWidth[m])

[0133] RowHeight[NumTileRows - 1] = PicHeightInCtbsY - sum_n(RowHeight[n])

[0134] Here, sum_m(ColWidth[m]) represents the sum of ColWidth[m] (0 <= m < NumTileColumns - 1), and sum_n(RowHeight[n]) represents the sum of RowHeight[m] (0 <= NumTileRows < N - 1).

[0135] (S1200: Tile group information decoding) The header decoding unit 3020 decodes the tile group header (tile group information) from the encoded data.

[0136] Fig.12(a) is the syntax of a tile group header representing a coded tile group. In the tile group header, tile_group_pic_parameter_set_id, tile_group_address, num_tiles_in_tile_group_minus1, tile_group_type, and entry_point() are notified. tile_group_pic_parameter_set_id represents the picture parameter set identifier pps_pic_parameter_set_id of the picture that includes the tile group. tile_group_address represents the tile address of the first tile in the tile group, and is a value in the range of 0 to NumTilesInPic-1. The tile_group_address of the tile groups included in the same picture are different values. num_tiles_in_tile_group_minus1+1 represents the number of tiles in the tile group. tile_group_type represents the coding type of the tile group (I tile group, P tile group, B tile group). entry_point() is the syntax of the entry point, in Fig.12 An example is shown in (b) of FIG.

[0137] The parameter decoding unit 302 first decodes tile_group_pic_parameter_set_id. Next, if the number of tiles in the tile group NumTilesInPic is greater than 1, tile_group_address and num_tiles_in_tile_group_minus1 are decoded. Otherwise (NumTilesInPic==1), tile_group_address and num_tiles_in_tile_group_minus1 are set to 0. Next, tile_group_type is decoded.

[0138] When a tile group includes a plurality of tiles (num_tiles_in_tile_group_minus1>0), the parameter decoding unit 302 decodes offset_len_minus1 and NumEntryPoint entry points entry_point_offset_minus1[i]. When the segment is a tile, NumEntryPoint is set to num_tiles_in_tile_group_minus1. When there is only one tile in the tile group (num_tiles_in_tile_group_minus1=0), the parameter decoding unit 302 does not decode the entry point.

[0139] The entry point is the starting point address of the segment in the encoded data (for example, the offset position in byte units with the starting point on the encoded data of the tile group header to which the object segment belongs or the starting point of the existing segment set to zero). When the segment is a tile, it is the starting point address of each tile. entry_point_offset_minus1[i]+1 can be the difference between the i+1th entry point and the i-th entry point in the encoded data. The 0th entry point is the starting point address of the tile group header (the position of the starting point of the tile group header, i.e., zero), and is not notified. offset_len_minus1+1 is the number of bits representing entry_point_offset_minus1[i].

[0140] When the offset position of the byte unit with the starting point on the coded data of the tile group header described in the target segment set to zero is expressed as firstByte[k], and the offset position of the byte unit of the last bit of the segment is expressed as lastByte[k], it can be derived as follows from entry_point_offset_minus1[i]. firstByte[k] = Σ(entry_point_offset_minus1[n-1]+1)

[0141] Σ represents the sum of n=1 to k.

[0142] lastByte[k]=firstByte[k]+entry_point_offset_minus1[k]

[0143] Thereafter, the video decoding device 31 derives a decoded image of each CTU by repeatedly performing the processes from S1300 to S5000 on each CTU included in the target picture.

[0144] (S1300: CTU Information Decoding) The CT information decoding unit 3021 decodes CTU from the coded data. CT (Coding Tree) information includes coding tree partition information.

[0145] Fig.12 (c) is an example of the syntax of the tile group data for coding the tile group. In the tile group data, CTU data coding_tree_unit() of the tile group is encoded or decoded, and the segment end bit end_of_tile_one_bit of a fixed value is encoded or decoded at the end of the segment.

[0146] When the segment is a tile, the CT information decoding unit 3021 decodes the fixed value end_of_tile_one_bit through the CTU at the end of the tile (lower right of the tile), and decodes the bit string byte_alignment() used for byte alignment. It should be noted that the decoding of byte_alignment() can be limited to the case where i is less than num_tiles_in_tile_group_minus1. That is, in the last segment in the tile group (i == num_tiles_in_tile_group_minus1), the suffix data for byte alignment is decoded later, so the decoding of byte_alignment() can be omitted.

[0147] The CT information decoding unit 3021 sets tile_group_address to tileIdx. tileIdx is an identifier of a tile, and tile_group_address is a tile address of the first tile in a tile group. Each tile in a tile group is identified using tileIdx, so tileIdx is incremented by 1 each time the CT information decoding unit 3021 processes a tile.

[0148] The CT information decoding unit 3021 uses tileIdx and FirstCtbAddrTs[] to derive the CTU address ctbAddrTs of the tile scanning order within the tile through the following formula: Tile scanning refers to a scanning method that sequentially processes from the upper left to the lower right of the tile within the tile.

[0149] ctbAddrTs=FirstCtbAddrTs[tileIdx]

[0150] FirstCtbAddrTs[] is a table that converts tileIdx to the first CTU address of a tile, derived as follows.

[0151]

[0152] Here, TileId[] is a table that converts CTU addresses in tile scanning order into tile identifiers.

[0153] An example is shown below.

[0154]

[0155] Here, RowBD[] and ColBD[] are tables storing the maximum vertical coordinates of each tile row and the maximum horizontal coordinates of each tile column, and are expressed in units of CTU. An example is shown below.

[0156]

[0157] Furthermore, CtbAddrRsToTs[] is a table that converts CTU addresses in a raster scan order within a picture into CTU addresses in a tile scan order. An example is shown below.

[0158]

[0159] The CT information decoding unit 3021 uses ctbAddrTs and CtbAddrTsToRs[] to derive the CTU address ctbAddrRs in the raster scanning order through the following formula.

[0160] ctbAddrRs=CtbAddrTsToRs[ctbAddrTs]

[0161] CtbAddrTsToRs[] is a table that converts CTU addresses in tile scan order to CTU addresses in raster scan order, and is derived as follows.

[0162] for(ctbAddrRs=0;ctbAddrRs <PicSizeInCtbsY;ctbAddrRs++)

[0163] CtbAddrTsToRs[CtbAddrRsToTs[ctbAddrRs]]=ctbAddrRs

[0164] The CT information decoding unit 3021 decodes each CTU in the tile in the tile scanning order, and decodes the end_of_tile_one_bit after decoding all CTUs.

[0165] (S1400: CT Information Decoding) The CT information decoding unit 3021 decodes CT from the encoded data.

[0166] (S1500: CU Decoding) The CU decoding unit 3022 implements S1510 and S1520, and decodes the CU from the encoded data.

[0167] (S1510: CU Information Decoding) The CU decoding unit 3022 decodes CU information, prediction information, TU split flag split_transform_flag, CU residual flags cbf_cb, cbf_cr, cbf_luma, etc. from the encoded data.

[0168] (S1520: TU information decoding) When the prediction error is included in the TU, the TU decoding unit 3024 decodes the QP update information (quantization correction value) and the quantization prediction error (residual_coding) from the encoded data. It should be noted that the QP update information is a difference value from the quantization parameter prediction value qPpred which is a prediction value of the quantization parameter QP.

[0169] (S2000: Prediction Image Generation) The prediction image generation unit 308 generates a prediction image for each block included in the target CU based on the prediction information.

[0170] (S3000: Inverse Quantization / Inverse Transformation Unit) The inverse quantization / inverse transformation unit 311 performs an inverse quantization / inverse transformation process on each TU included in the target CU.

[0171] (S4000: Decoded Image Generation) The adder 312 generates a decoded image of the target CU by adding the predicted image supplied from the predicted image generation unit 308 and the prediction error supplied from the inverse quantization / inverse transformation unit 311.

[0172] (S5000: Loop Filtering) The loop filter 305 applies loop filtering such as deblocking filtering, sampling adaptive offset (SAO), and adaptive loop filtering (ALF) to the decoded image to generate a decoded image.

[0173] (Variation 1) Example of Changing Tile Size for Each Tile Group

[0174] In the above example, the width and height of a tile are defined in picture units (PPS), but in Modification 1, an example in which the tile size is flexibly set for each tile group of a divided picture will be described.

[0175] Fig.13 This is an example of dividing a picture into four tile groups TileGr0 to TileGr3, and then dividing the tile groups into tiles. Figure 6 The tile division is different, and its characteristic is that different tile width and height are set for each tile group. Fig.13 The number after Tile in the Tile is the address of the tile in the tile group (TileAddrInTG). Fig.13 The tile group TileGr0 in includes tiles Tile0, Tile1, Tile2, and Tile3. TileGr1 includes Tile4 and Tile5. TileGr2 includes Tile6, Tile7, and Tile8. TileGr3 includes Tile9.

[0176] exist Fig.14 An example of the syntax of variant example 1 is shown in FIG. Fig.14 As shown, the syntax may be, for example, single_tile_group_in_pic_flag, num_tile_group_columns_minus1, num_tile_rows_group_minus1, tile_group_column_width_minus1[i], tile_group_row_height_minus1[i].

[0177] Here, single_tile_group_in_pic_flag is a flag indicating whether there are multiple tile groups in the picture. If it is 1, there is only one tile group in the picture and the picture is equivalent to the tile group. If it is 0, the picture includes multiple tile groups. num_tile_group_columns_minus1 and num_tile_group_rows_minus1 are the values ​​obtained by subtracting 1 from the number of tile groups NumTileGrColumns and NumTileGrRows in the horizontal and vertical directions of the picture, respectively.

[0178] Next, the syntax of the tile is notified for each tile group. For example, for each tile in the jth tile group, single_tile_in_pic_flag[j], num_tile_columns_minus1[j], num_tile_rows_minus1[j], uniform_tile_spacing_flag[j], tile_column_width_minus1[j][i], tile_row_height_minus1[j][i] are notified. The meaning of each syntax is the same as Fig.11 The syntax of (b) is the same as that of (b).

[0179] The header decoding unit 3020 derives the width and height (CTU unit) of the j-th tile group in the following manner.

[0180] TileGrWidthInCtbsY[j]=Ceil((tile_group_column_width_minus1[j]+1) / ctuWidth)

[0181] TileGrHeightInCtbsY[j]=Ceil((tile_group_height_in_luma_samples[j]+1) / ctuHeight)

[0182] The header decoding unit 3020 derives the numbers of tile groups NumTileGrColumns and NumTileGrRows in the horizontal and vertical directions in the picture and the total number of tile groups NumTileGrsInPic in the picture in the following manner.

[0183] NumTileGrColumns=num_tile_group_columns_minus1+1

[0184] NumTileGrRows=num_tile_group_rows_minus1+1

[0185] NumTilesGrsInPic=NumTileGrColumns*NumTileGrRows

[0186] The header decoding unit 3020 derives the number of tiles NumTileColumns[j] and NumTileRows[j] in the horizontal and vertical directions in the j-th tile group and the total number of tiles NumTilesInPic[j] in the tile group in the following manner.

[0187] NumTileColumns[j]=num_tile_columns_minus1[j]+1

[0188] NumTileRows[j]=num_tile_rows_minus1[j]+1

[0189] NumTilesInPic[j]=NumTileColumns[j]*NumTileRows[j]

[0190] The header decoding unit 3020 decodes the width ColWidth[j][m] and the height RowHeight[j][n] of each tile in the j-th tile group in the following manner.

[0191] ColWidth[j][m]=tile_column_width_minus1[j][m]+1(0<=m <NumTileColumns[j]-1)

[0192] RowHeight[j][n]=tile_row_height_minus1[j][m]+1(0<=n <NumTileRows[j]-1)

[0193] ColWidth[j][NumTileColumns[j] - 1] = TileGrWidthInCtbsY[j] - sum_m(ColWidth[j][m])

[0194] RowHeight[j][NumTileRows[j] - 1] = TileGrHeightInCtbsY[j] - sum_n(RowHeight[j][n])

[0195] Here, sum_m(ColWidth[j][m]) represents the sum of ColWidth[j][m] (0 <= m < NumTileColumns[j] - 1), and sum_n(RowHeight[j][n]) represents the sum of RowHeight[j][m] (0 <= NumTileRows[j] < N - 1).

[0196] In Modification Example 1, the syntax of the tile group header and tile group data is the same as that of (a) in Fig.12 and (c) in Fig.12 , but the method of deriving the table TileId[] that converts the CTU address of the tile scan order into a tile identifier is different. The method of deriving this table in Modification Example 1 is shown below.

[0197]

[0198] The processing of the header decoding unit 3020 other than this is the same as the example of specifying the width and height of the tile by the above-mentioned PPS.

[0199] As described above, by encoding or decoding the syntax representing the width and height of the tile for each tile group, tiles of different sizes for each tile group can be used, and tile segmentation can be performed more flexibly.

[0200] (Wavefront Parallel Processing)

[0201] Wavefront Parallel Processing (WPP) uses the CTU row as a segment, and while suppressing the reduction in coding efficiency, can achieve parallel encoding or parallel decoding of a large number of segments. Hereinafter, when the CTU row is used as a segment, WPP is used.

[0202] (Exclusive Structure within a Segment Group)

[0203] Fig.15This shows an example of using different types of segments in units of tile groups (segment groups). This example shows an example of using tiles as segments in TileGr0 and TileGr1, using CTU rows as segments in TileGr2, and using slices as segments in TileGr3.

[0204] In the subsequent implementation, it is characterized in that, within a segment group (within a tile group), the segmentation category is limited to one, and tiles, CTU rows, and slices are processed exclusively. That is, within a tile group (segment group), only any one of the tile segmentation (multiple tile segments), CTU row segmentation, and slice segmentation can be made valid. For example, within a tile group, only any one of the tiles and CTU rows can be made valid. In the above description, making a tile valid means the situation where the tile group is composed of more than two tiles (the tile group is divided into more than two tiles).

[0205] (Variant 2) Processing when segmentation can be performed using tiles and CTU rows

[0206] In Modification 2, a case where segmentation is either a tile or a CTU row (CTU row), and either a tile or a CTU is used in units of a tile group will be described.

[0207] Fig.16 This is a diagram illustrating the exclusive configuration of picture block segmentation and CTU row segmentation.

[0208] entropy_coding_sync_enabled_flag is a flag (WPP enabled flag) indicating whether the CTU line is set as a segment (whether WPP is implemented). It should be noted that when the CTU line is set as a segment, CABAC synchronization processing is performed. That is, in CABAC, the CABAC state at the time point when the second CTU of a CTU line ends is used to perform CABAC initialization of the starting CTU of the CTU line. Fig.16As shown, when num_tiles_in_tile_group_minus1 is greater than 0, that is, when there are multiple tiles, entropy_coding_sync_enabled_flag can only take 0. In this case, only multiple tiles are valid. When num_tiles_in_tile_group_minus1 is 0, that is, when there is only one tile, entropy_coding_sync_enabled_flag can take 1. In this case, only multiple CTU rows (wavefronts) are valid. At the end, when num_tiles_in_tile_group_minus1 is 0 and entropy_coding_sync_enabled_flag is 0, it is the case that there is only one tile in the tile group. As described later, in this case, the slice can also be enabled.

[0209] As described above, the structure has the effect of making it possible to use the entry points of tiles and wavefronts in common in one tile group (within a segment group).

[0210] In addition, it is possible to make a tile (a plurality of tiles) effective in a certain tile group and make a wavefront effective in another tile group.

[0211] In variant 2, in order to realize the exclusive composition of tiles and wavefronts, when the number of tiles in a tile group is 1 (the tile group is the same as the tile, that is, multiple tiles are not enabled in the target tile group), the CTU row can be used as a segment by notifying the entropy_coding_sync_enabled_flag flag, otherwise (the tile group includes multiple tiles), the tile is used as a segment. Therefore, there are the following cases: Figure 5 As shown in FIG. 1 , the picture is divided into four groups of tiles; each group of tiles is as follows Figure 8 The case where the image is divided into multiple blocks as shown in (a); Figure 8 The case where the image is divided into multiple CTU rows as shown in (b); and the case where the tile group consists of one tile (the case where the tile in the tile group is one and is not divided into CTU rows).

[0212] In order to encode or decode a plurality of tiles or a plurality of CTU lines included in a tile group in parallel, a start point address (entry point) of the tiles or CTU lines is encoded or decoded through a tile group header.

[0213] is used Fig.17 , which is a diagram for explaining the operation of the header coding unit 1110 and the header decoding unit 3020 having a structure in which tiles and wavefronts are exclusively configured. Fig.18(a) shows the syntax structure of the tile group header to be encoded and decoded in this embodiment.

[0214] As shown in the flowchart and syntax structure, when num_tiles_in_tile_group_minus1 is 0 (Yes in S3001), that is, when there is one tile in the tile group, the header encoding unit 1110 or the header decoding unit 3020 encodes or decodes entropy_coding_sync_enabled_flag (S3002). Otherwise, entropy_coding_sync_enabled_flag is set to 0 (WPP is off).

[0215] if(num_tiles_in_tile_group_minus1==0)

[0216] entropy_coding_sync_enabled_flag

[0217] Fig.18 (b) is a diagram showing the syntax structure of the entry point. Fig.18 In (b), TileGrHeightInCtbsY is the height of the tile group in CTU units, and num_tiles_in_tile_group_minus1 is the value obtained by subtracting 1 from the number of tiles in the tile group.

[0218] The header coding unit 1110 or the header decoding unit 3020 derives the number of entry points NumEntryPoint. When the segment included in the tile group uses WPP (entropy_coding_sync_enabled_flag=1), the number of CTU rows included in the tile group - 1 (here, TileGrHeightInCtbsY-1) is set as NumEntryPoint.

[0219] NumEntryPoint=TileGrHeightInCtbsY-1

[0220] In addition, the number of tiles included in the tile group - 1 (here, num_tiles_in_tile_group_minus1) is set as NumEntryPoint.

[0221] NumEntryPoint=num_tiles_in_tile_group_minus1

[0222] When NumEntryPoint is greater than 0, the header encoding unit 1110 or the header decoding unit 3020 encodes or decodes the entry point information (offset_len_minus1 and NumEntryPoint entry_point_offset_minus1).

[0223] Fig.18 (c) is a diagram showing the syntax structure of the tile group data. coding_tree_unit() is the coded data of the CTU included in the CTU row. end_of_subset_one_bit is a flag showing the end of the segment.

[0224] The CT information encoding unit 1111 or the CT information decoding unit 3021 encodes or decodes the object CTUcoding_tree_unit() in a loop process (loop variable i) for processing a tile in a tile group and further in a loop process (loop variable j) related to a CTU in a tile.

[0225] The CT information encoding unit 1111 or the CT information decoding unit 3021 uses ctbAddrTs and FirstCtbAddrTs[] to derive ctbAddrInTile by the following formula: ctbAddrInTile is the address of the existing CTU in the tile, ctbAddrTs is the address of the tile scanning order of the existing CTU, and FirstCtbAddrTs[] is the address of the first CTU of the tile group.

[0226] ctbAddrInTile=ctbAddrTs-FirstCtbAddrTs[tile_group_address]

[0227] When WPP is turned on, the CT information encoding unit 1111 or the CT information decoding unit 3021 encodes or decodes end_of_subset_one_bit after the decoding of the CTU line is completed. end_of_subset_one_bit is a bit inserted at the end of the CTU line. Whether it is the end of the CTU line is determined by the following formula.

[0228] entropy_coding_sync_enabled_flag&&(CtbAddrInTile+1)%TileWidthInCtbsY==0

[0229] That is, when (entropy_coding_sync_enabled_flag && (CtbAddrInTile + 1) % TileWidthInCtbsY == 0), that is, when entropy_coding_sync_enabled_flag is 1, the CT information decoding unit 3021 decodes the fixed value end_of_subset_one_bit at the right end of the CTU row after CTU decoding. In addition, before encoding or decoding the target CTU coding_tree_unit(), when the target CTU is the starting point (left end) of the CTU row, the same process can be performed by decoding the bit string representing the end of the segment (here, the CTU row).

[0230] When j == NumCtusInTile[tileIdx] - 1, that is, for the last CTU in the tile group, the CT information encoding unit 1111 or the CT information decoding unit 3021 encodes or decodes the fixed value end_of_subset_one_bit.

[0231] Moreover, except for the last segment of the tile group (except when encoding the suffix data immediately afterwards), the CT information encoding unit 1111 or the CT information decoding unit 3021 decodes the byte-aligned bit string after end_of_subset_one_bit. It should be noted that j < NumCtusInTile[tileIdx] - 1 is for CTUs other than the last CTU in the segment, and i < num_tiles_in_tile_group_minus1 is for segments other than the last segment. Through the union of the two, CTUs other than the last segment of the tile group can be determined.

[0232] Fig.25 It is a diagram showing other syntax components of the tile group data in the exclusive composition of the tile and the wavefront. The composition of the tile group header and the entry point is the same as that of (a) and (b) in Fig.18 In Fig.25 In addition to end_of_subset_one_bit, which is a fixed value notified at the end of the segment and represents the last bit of WPP, it also includes end_of_tile_one_bit, which represents the last bit of the tile. Fig.26 It is a flowchart showing the operation of the CT information decoding unit 3021 for decoding the Fig.25 syntax.

[0233] Set the identifier of the tile (S2602).

[0234] The processing of S2604 to S2624 is performed for each tile (loop variable i) in the tile group. It should be noted that when WPP is turned on, the tile group consists of one tile, and the tile group is equal to the tile. As described above, even if the WPP-on configuration can be used when the tile group consists of one tile, the configuration of one tile can also be used when WPP is turned on.

[0235] The starting point CTU address of the tile group is set ( S2604 ).

[0236] ctbAddrInTile=ctbAddrTs-FirstCtbAddrTs[tile_group_address]

[0237] In the loop processing (loop variable j) related to the CTU in the tile, the CTU address in the tile is set ( S2606 ), and the target CTU is decoded ( S2608 ).

[0238] For example, the following formula is used to determine whether WPP is enabled and whether it is the last CTU in the CTU row ( S2610 ).

[0239] entropy_coding_sync_enabled_flag&&((CtbAddrInTile+1)%TileWidthInCtbsY)==0

[0240] If WPP is enabled and the CTU is at the end of the CTU row, the process proceeds to S2612. Otherwise, the process proceeds to the next CTU decoding process.

[0241] The end_of_subset_one_bit is decoded (S2610). The end_of_subset_one_bit is a bit inserted at the end of the CTU row.

[0242] For example, the following formula is used to determine whether it is the last CTU in the tile group (S2614). <NumCtusInTile[tileIdx]-1

[0243] If it is the last CTU of the tile group, the next CTU decoding process is performed. Otherwise, the bit string for byte alignment is decoded (S2616).

[0244] The processing of S2604 to S2616 is repeated until the processing of all CTUs in the tile is completed.

[0245] Determine whether WPP is closed (S2618). If WPP is not closed, end the process. If WPP is open, proceed to S2620.

[0246] The end_of_tile_one_bit is decoded. The end_of_tile_one_bit is a bit inserted at the end of the tile (S2620).

[0247] It is determined whether it is the last tile of the tile group (S2622). If it is the last tile of the tile group, the process ends. Otherwise, the byte-aligned bit string is decoded (S2624).

[0248] The above process is repeated until the processing of all the tiles in the tile group is completed.

[0249] It should be noted that in the CT information encoding unit 1111, Fig.26 The process of replacing "decoding" with "encoding".

[0250] In the above process, when WPP is used (entropy_coding_sync_enabled_flag==1), a bit indicating the end of the segment and byte alignment are inserted at the end of each CTU row, but the byte alignment is omitted at the end of the CTU row (j==NumCtusInTile[tileIdx]-1) which is equivalent to the end of the tile group. In WPP, the tile group is composed of CTU rows, so the end of the tile group = the end of the CTU row. When WPP is not used (entropy_coding_sync_enabled_flag==0), a bit indicating the end of the segment and byte alignment are inserted at the end of the tile, but the byte alignment is omitted at the end of the tile group (i==num_tiles_in_tile_group_minus1). This is because, as already Figure 4 As described in (c) of FIG. 1 , in a configuration including suffix data (rbsp_tile_group_trailing_bits) for byte alignment after the tile group data, the byte alignment inserted in the suffix data is avoided from being repeated. In a configuration where byte alignment is not performed in the suffix data, a byte alignment can be inserted in the tile group data even at the end of the tile group.

[0251] exist Fig.25 , Fig.26 By distinguishing between the bit inserted at the end of the CTU row in the wavefront (end_of_subset_one_bit) and the bit inserted at the end of the tile in the tile (end_of_tile_one_bit), the wavefront and the tile can be clearly distinguished.

[0252] As described above, by using either a tile or a CTU row in units of a tile group, multiple processes with a parallel processing function can be performed exclusively in one tile group, so the coding efficiency is good. In addition, for tiles and CTU rows, a common entry point can be used, and it is known which of the starting address of the tile and the starting address of the CTU row the entry point points to for each tile group, so the processing is simple.

[0253] Fig.19 is another example of the syntax structure of the tile group header for encoding and decoding in this embodiment. Fig.19 As shown, entropy_coding_sync_enabled_flag can be encoded and decoded first, and when entropy_coding_sync_enabled_flag is 0, that is, WPP is closed, num_tiles_in_tile_group_minus1 is notified. In this case, the header encoding unit 1110 and the header decoding unit 3020 encode or decode entropy_coding_sync_enabled_flag, and encode or decode num_tiles_in_tile_group_minus1 when NumTilesInPic is greater than 1 and entropy_coding_sync_enabled_flag is 0. Otherwise (NumTilesInPic is less than 1, or entropy_coding_sync_enabled_flag is 1), the header encoding unit 1110 and the header decoding unit 3020 set num_tiles_in_tile_group_minus1 to 0.

[0254] (Variant 3) Processing when segmentation can be performed using tiles and slices

[0255] In Modification 3, a case where either tiles or slices are exclusively used as segments in a tile group will be described.

[0256] Fig. 20 This is a diagram for explaining the exclusive structure of tile segments and slice segments.

[0257] slice_enabled_flag is a flag indicating whether the slice is set to be segmented (whether the slice is used). It should be noted that CABAC is initialized at the start of the slice. Fig. 20As shown, when num_tiles_in_tile_group_minus1 is greater than 0, that is, when there are multiple tiles, slice_enabled_flag can only be 0. In this case, only multiple tiles are valid. When num_tiles_in_tile_group_minus1 is 0, that is, when there is only one tile, slice_enabled_flag can be 1. In this case, only slices are valid. When num_tiles_in_tile_group_minus1 is 0 and entropy_coding_sync_enabled_flag is 0 at the end, it is the case that there is only one tile in the tile group. In this case, WPP can be set to be valid.

[0258] In variant 3, when the number of tiles in a tile group is 1 (the tile group is the same as the tile), the slice can be used as a segment. Otherwise (the tile group includes multiple tiles), the tile is used in the segment. For example, there are the following situations: Figure 5 As shown in FIG. 1 , the picture is divided into four groups of tiles; each group of tiles is as follows Figure 8 The case where the image is divided into multiple blocks as shown in (a); Figure 8 In the case where the image is divided into multiple slices as shown in (c), it can also be divided into one tile. That is, when there is one tile in the tile group and the tile group is not divided into CTU rows, the tile group includes one tile.

[0259] In a slice, at the end of the coded data of a CTU, a slice end flag end_of_slice_segment_flag indicating whether it is the end of a segment is notified, thereby enabling the segment to be ended at any position in the CTU unit. A segment whose size can be changed in such a CTU unit is called a slice segment. For example, a slice is used when it is desired to set the segment division within a specified bit amount. In addition, a structure in which a marker (unique code, start code: start code) is inserted at the start of a slice for the purpose of parallel decoding of slices can be adopted. By using the marker, the motion picture decoding device can retrieve the start position on the bit stream of each slice and identify the position. It should be noted that in the structure in which a marker is inserted at the start of a slice, the structure of the tile group can be ended every time a slice is inserted (that is, when end_of_slice_segment_flag is 1). In this structure, since one slice is included in the tile group, a tile group header is always attached to the start of the slice to serve as a marker.

[0260] When encoding or decoding the slice start point by marking, a unique code such as "0x00000100" (32 bits) is inserted in front of the slice, and the motion picture decoding device can detect the slice start point in the encoded data by decoding the encoded data in advance.

[0261] In order to process tiles and slices in parallel, the starting address (entry point) of the tile can be notified through the tile group header. Fig.21 An example of a tile group header is shown in (a) of FIG. Fig.21 In the slice_enabled_flag, slice_enabled_flag is notified. Slice_enabled_flag is a flag indicating whether to perform slice segmentation.

[0262] When num_tiles_in_tile_group_minus1 is 0, that is, when there is one tile in the tile group, the header coding unit 1110 and the header decoding unit 3020 encode or decode slice_enabled_flag and num_slices_in_tile_minus1. Otherwise, slice_enabled_flag is set to 0 (slice disabled).

[0263] It should be noted that the configuration may not include notifying num_slices_in_tile_minus1 through the tile group header.

[0264] The encoding and decoding order of the number of tiles num_tiles_in_tile_group_minus1 and the slice enabled flag slice_enabled_flag is not limited to the above, and can be processed as follows.

[0265] (Slices, tiles)

[0266] When the slice enable flag slice_enabled_flag and the number of tiles num_tiles_in_tile_group_minus1 are notified in this order, the following processing is performed. The header coding unit 1110 and the header decoding unit 3020 encode or decode slice_enabled_flag through the tile group header. When slice_enabled_flag is 0, num_tiles_in_tile_group_minus1 is encoded or decoded. When num_tiles_in_tile_group_minus1 and slice_enabled_flag are not decoded, they are set to 0 respectively.

[0267] The header encoding unit 1110 and the header decoding unit 3020 derive NumEntryPoint. NumEntryPoint is the number of entry points. When tiles are used, num_tiles_in_tile_group_minus1 is set. When NumEntryPoint is greater than 0, the header encoding unit 1110 and the header decoding unit 3020 encode or decode the entry point information (offset_len_minus1 and NumEntryPoint entry_point_offset_minus1).

[0268] When slice is on, the CT information decoding unit 3021 decodes end_of_slice_segment_flag after decoding of one CTU is completed. end_of_slice_segment_flag is a bit inserted at the end of a CTU row.

[0269] Fig.21 (c) is an example of a syntax for encoding tile group data of a tile group. Fig.21 (c) indicates a configuration in which end_of_slice_segment_flag is encoded or decoded after decoding of 1 CTU. end_of_slice_segment_flag is a flag indicating whether it is the end of a slice. If it is 1, it is the end of the slice, otherwise, it is not the end of the slice.

[0270] As described above, by using either tiles or slices in units of tile groups, a plurality of processes having a parallel processing function can be executed exclusively in one tile group, which is efficient.

[0271] (Variant 4) Processing when Slice Uses Entry Point

[0272] In the following example, a configuration is shown in which the start point address of a slice is used as an entry point for encoding or decoding, thereby specifying the start point position of the slice on a bit stream.

[0273] In order to process tiles and slices in parallel, the starting address (entry point) of tiles and slices is notified through the tile group header. Fig.21 In one example of the tile group header shown in (a) of FIG. 1 , num_slices_in_tile_minus1 may be notified after slice_enabled_flag. Num_slices_in_tile_minus1 is a value obtained by subtracting 1 from the number of slices in the tile.

[0274] Additionally, change the entry point syntax to Fig.21 is shown in (b). Fig.21 (c) indicates the use of slice_enabled_flag and num_slices_in_tile_minus1 in the derivation of NumEntryPoint.

[0275] When num_tiles_in_tile_group_minus1 is 0, that is, when there is one tile in the tile group, the header decoding unit 3020 decodes slice_enabled_flag and num_slices_in_tile_minus1. Otherwise, slice_enabled_flag is set to 0 (slice disabled).

[0276] The header decoding unit 3020 derives NumEntryPoint, which is the number of entry points. When slices are used, num_slices_in_tile_minus1 is set, and when tiles are used, num_tiles_in_tile_group_minus1 is set. When NumEntryPoint is greater than 0, the header decoding unit 3020 decodes the entry point information (offset_len_minus1 and NumEntryPoint entry_point_offset_minus1).

[0277] The processing other than the above is the same as that of Modification Example 2.

[0278] Next, the tile group data will be described.

[0279] Fig.21 (c) is an example of a syntax for encoding tile group data of a tile group. Fig.21 (c) indicates a configuration in which end_of_slice_segment_flag is encoded or decoded after decoding of 1 CTU. end_of_slice_segment_flag is a flag (bit) indicating whether it is the end of a slice. If it is 1, it is the end of the slice, otherwise, it is not the end of the slice.

[0280] When slice is on, the CT information decoding unit 3021 decodes end_of_slice_segment_flag after decoding of 1 CTU is completed.

[0281] As described above, by using either a tile or a slice in a tile group unit, multiple processes with a parallel processing function can be executed exclusively in one tile group, and the efficiency is good. In addition, the entry point can be shared with the tile and the slice, and it is known that the entry point points to which of the start address of the tile and the start address of the slice for each tile group, so the processing is simple. Alternatively, the start point of the slice can be notified by a unique mark without using the entry point.

[0282] (Variant 5) Segmentation using tiles, CTU rows, and slices

[0283] In variation 5, an example of exclusively setting tiles, CTU rows, and slices is described. Fig. 22 This is a diagram for explaining the exclusive configuration of tile segmentation, CTU row segmentation, and slice segmentation. Fig. 22 As shown, in variant example 5, any of the following cases is adopted: a case where there are multiple tile segments in a tile group; a case where there is CTU row segmentation; a case where there is slice segmentation; and a case where there is a single segment (referred to as a tile here) in a tile group.

[0284] More specifically, when a tile group includes a plurality of tiles, a tile is used, and when a tile group consists of one tile, a CTU line or a slice is used. When a tile group consists of one tile and neither a CTU line nor a slice is used, the tile group is set to one tile.

[0285] (The notification structure is in the order of the number of tiles, WPP valid flag, and slice valid flag)

[0286] Fig.23 (a) is an example of a tile group header. Fig.23 In (a), when the number of tiles is 1, entropy_coding_sync_enabled_flag is notified, and when entropy_coding_sync_enabled_flag is 0 (WPP is off), slice_enabled_flag is encoded or decoded.

[0287] The header encoding unit 1110 and the header decoding unit 3020 encode or decode entropy_coding_sync_enabled_flag when num_tiles_in_tile_group_minus1 is 0. Next, slice_enabled_flag is encoded or decoded when entropy_coding_sync_enabled_flag is 0. When num_tiles_in_tile_group_minus1 is not 0, entropy_coding_sync_enabled_flag and slice_enabled_flag are set to 0. When num_tiles_in_tile_group_minus1 is 0 and entropy_coding_sync_enabled_flag is not 0, slice_enabled_flag is set to 0.

[0288] The processing other than this is the same as that in the example where the segments are only tiles.

[0289] Fig.23 (b) is an example of a syntax for encoding tile group data of a tile group. Fig.23 As shown in (b), in this embodiment, when the segment is a tile and when it is a CTU row (wavefront), at the end of the segment, the end_of_subset_one_bit that is 1 must be encoded or decoded, and when the segment is a slice, the end_of_slice_segment_flag that can be 0 or 1 indicating whether the CTU is the last bit of the segment is encoded or decoded. The method of encoding or decoding the end_of_subset_one_bit has been described in Fig.18 The method for encoding or decoding end_of_slice_segment_flag has been described in (c) of FIG. Fig.21 It has been explained in (c) and therefore the explanation is omitted.

[0290] As described above, by using tiles, CTU rows, and slices exclusively in tile groups, the encoding and decoding process of the segments can be simplified. In addition, the starting point and the end point of the segments are made clear. For example, there is no confusion such as the starting point of a slice, the starting point of a tile, and the starting point of a CTU row.

[0291] The order of encoding and decoding the number of tiles num_tiles_in_tile_group_minus1, the WPP valid flag entropy_coding_sync_enabled_flag, and the slice valid flag slice_enabled_flag is not limited to the above, and can be processed as follows.

[0292] (Tiles, Slices, WPP)

[0293] When num_tiles_in_tile_group_minus1, slice_enabled_flag, and entropy_coding_sync_enabled_flag are notified in this order, the following processing is performed. The header coding unit 1110 and the header decoding unit 3020 encode or decode num_tiles_in_tile_group_minus1. When num_tiles_in_tile_group_minus1 is 0, slice_enabled_flag is encoded or decoded. Next, when slice_enabled_flag is 0, entropy_coding_sync_enabled_flag is encoded or decoded. When num_tiles_in_tile_group_minus1, entropy_coding_sync_enabled_flag, and slice_enabled_flag are not decoded, they are set to 0, respectively.

[0294] (WPP, tiles, slices)

[0295] When notifying in the order of entropy_coding_sync_enabled_flag, num_tiles_in_tile_group_minus1, and slice_enabled_flag, the following processing is performed. The header encoding unit 1110 and the header decoding unit 3020 encode or decode entropy_coding_sync_enabled_flag through the tile group header. When entropy_coding_sync_enabled_flag is 0, num_tiles_in_tile_group_minus1 is encoded or decoded. Next, when num_tiles_in_tile_group_minus1 is 0, slice_enabled_flag is encoded or decoded. When num_tiles_in_tile_group_minus1, entropy_coding_sync_enabled_flag, and slice_enabled_flag are not decoded, they are set to 0 respectively.

[0296] (WPP, slices, tiles)

[0297] When notifying in the order of entropy_coding_sync_enabled_flag, slice_enabled_flag, and num_tiles_in_tile_group_minus1, the following processing is performed. The header encoding unit 1110 and the header decoding unit 3020 encode or decode entropy_coding_sync_enabled_flag through the tile group header. When entropy_coding_sync_enabled_flag is 0, slice_enabled_flag is encoded or decoded. Next, when slice_enabled_flag is 0, num_tiles_in_tile_group_minus1 is encoded or decoded. When num_tiles_in_tile_group_minus1, entropy_coding_sync_enabled_flag, and slice_enabled_flag are not decoded, they are set to 0 respectively.

[0298] (Slices, Tiles, WPP)

[0299] When notifying in the order of slice_enabled_flag, num_tiles_in_tile_group_minus1, and entropy_coding_sync_enabled_flag, the following processing is performed. The header encoding unit 1110 and the header decoding unit 3020 encode or decode slice_enabled_flag through the tile group header. When slice_enabled_flag is 0, num_tiles_in_tile_group_minus1 is encoded or decoded. Next, when num_tiles_in_tile_group_minus1 is 0, entropy_coding_sync_enabled_flag is encoded or decoded. When num_tiles_in_tile_group_minus1, entropy_coding_sync_enabled_flag, and slice_enabled_flag are not decoded, they are set to 0 respectively.

[0300] (Slice, WPP, Tile)

[0301] When slice_enabled_flag, entropy_coding_sync_enabled_flag, and num_tiles_in_tile_group_minus1 are notified in this order, the following processing is performed. The header encoding unit 1110 and the header decoding unit 3020 encode or decode slice_enabled_flag through the tile group header. When slice_enabled_flag is 0, entropy_coding_sync_enabled_flag is encoded or decoded. Next, when entropy_coding_sync_enabled_flag is 0, num_tiles_in_tile_group_minus1 is encoded or decoded. When num_tiles_in_tile_group_minus1, entropy_coding_sync_enabled_flag, and slice_enabled_flag are not decoded, they are set to 0 respectively.

[0302] The entropy decoding unit 301 outputs the inter prediction parameter to the inter prediction parameter decoding unit 303. Also, the intra prediction parameter is output to the intra prediction parameter decoding unit 304. Also, the quantized transform coefficient is output to the inverse quantization / inverse transform unit 311.

[0303] The entropy decoding unit 301 includes a CABAC initialization unit 3011, a CABAC decoding unit 3012, an initialization table 3013, and a spatial prediction storage unit 3015 (including a spatial prediction table 3016). The spatial prediction storage unit 3015 stores the CABAC state in the internal spatial prediction table 3016. The stored CABAC state is referred to when decoding a segment other than the target segment, such as a subsequent segment of the target picture, and is used for initializing the CABAC state. The CABAC decoding unit 3012 decodes syntax from the coded data (bitstream) according to the CABAC state internally stored.

[0304] The entropy decoding unit 301 uses the CABAC initialization unit 3011 to initialize the CABAC state at the starting point of the segment. The CABAC state refers to, for example, StateIdx representing the state of the probability of the context unit, MpsVal indicating which of 0 and 1 is more likely, the coefficient StatCoeff, etc. The context is determined by the elements of the binary string (a string consisting of 0 and 1) that constitutes the syntax. CABAC (Context-adaptive binary arithmetic coding) means inferring the probability of encoding as 0 or 1 based on the context, and encoding the binary based on the probability, thereby enabling efficient encoding. At this time, it is necessary to set the initial value of the probability StateIdx (and the binary Mps with a high probability), which is called CABAC initialization. TableStateIdx, TableMpsVal, and TableStatCoeff are tables consisting of StateIdx, MpsVal, and StatCoeff.

[0305] When the segment is a tile, the CABAC initialization unit 3011 uses the upper left CTU of the rectangular tile as the decoding start time point (tile boundary time point) and initializes the CABAC state using the initialization table. When the segment is a CTU row (entropy_coding_sync_enabled_flag is 1, WPP), the CABAC state stored in the spatial prediction storage unit 3015 is used at the left end of the CTU row for initialization. In the case of WPP, the CABAC state of the second CTU of each CTU row is stored in the spatial prediction storage unit 3015 and used in subsequent segmentation. When the segment is a slice (slice_enabled_flag is 1), the CABAC state can be initialized using the initialization table. Here, the tile boundary can be determined by whether the tile identifiers of the adjacent CTUs are different (TileId[CtbAddrTs]!=TileId[CtbAddrTs-1]). Here, the left end of the CTU row may be determined by (CtbAddrInTile%TileWidthInCtbsY==0). In addition, the slice start point may be determined by whether the CTU address CtbAddrRs is consistent with the CTU address of the slice start point (CtbAddrRs==slice_segment_address).

[0306] The loop filter 305 is a filter provided in the encoding loop, and is a filter for improving image quality by removing block distortion and ringing distortion. The loop filter 305 performs filtering such as deblocking filtering, sample adaptive offset (SAO), and adaptive loop filtering (ALF) on the decoded image of the CU generated by the adding unit 312.

[0307] The reference picture memory 306 stores the CU decoded image generated by the adding unit 312 at a predetermined position for each target picture and target CU.

[0308] The prediction parameter memory 307 stores the prediction parameter at a predetermined position for each CTU or CU to be decoded. Specifically, the prediction parameter memory 307 stores the parameters decoded by the parameter decoding unit 302 and the prediction mode predMode separated by the entropy decoding unit 301 .

[0309] The prediction image generation unit 308 receives the prediction mode predMode, prediction parameters, and the like as input. In addition, the prediction image generation unit 308 reads a reference picture from the reference picture memory 306. The prediction image generation unit 308 generates a prediction image of a block or a sub-block using the prediction parameters and the read reference picture (reference picture block) in the prediction mode indicated by the prediction mode predMode. Here, the reference picture block refers to a set of pixels on the reference picture (usually a rectangular block, so it is called a block), which is a region referenced to generate a prediction image.

[0310] The inverse quantization / inverse transformation unit 311 inversely quantizes the quantized transform coefficients input from the entropy decoding unit 301 to obtain transform coefficients. The quantized transform coefficients are coefficients obtained by performing frequency transformation such as DCT (Discrete Cosine Transform) on the prediction error in the encoding process and quantizing it. The inverse quantization / inverse transformation unit 311 performs inverse frequency transformation such as inverse DCT on the obtained transform coefficients to calculate the prediction error. The inverse quantization / inverse transformation unit 311 outputs the prediction error to the addition unit 312.

[0311] The adding unit 312 adds the predicted image of the block input from the predicted image generating unit 308 and the prediction error input from the inverse quantization / inverse transform unit 311 for each pixel to generate a decoded image of the block. The adding unit 312 stores the decoded image of the block in the reference picture memory 306 and outputs it to the loop filter 305.

[0312] (Configuration of Moving Image Coding Device)

[0313] Next, the configuration of the moving picture encoding device 11 according to this embodiment will be described. Fig.24 1 is a block diagram showing the structure of the video encoding device 11 of the present embodiment. The video encoding device 11 includes a prediction image generation unit 101, a subtraction unit 102, a transformation / quantization unit 103, an inverse quantization / inverse transformation unit 105, an addition unit 106, a loop filter 107, a prediction parameter memory 109, a coding parameter determination unit 110, a parameter coding unit 111, and an entropy coding unit 104.

[0314] The predicted image generation unit 101 generates a predicted image for each CU which is a region obtained by dividing each picture of each image T. The predicted image generation unit 101 performs the same operation as the predicted image generation unit 308 described above.

[0315] The subtraction unit 102 generates a prediction error by subtracting the pixel value of the predicted image of the block input from the predicted image generation unit 101 from the pixel value of the image T. The subtraction unit 102 outputs the prediction error to the transformation / quantization unit 103 .

[0316] The transform / quantization unit 103 calculates transform coefficients by frequency transforming the prediction error input from the subtraction unit 102 , and derives quantized transform coefficients by quantization. The transform / quantization unit 103 outputs the quantized transform coefficients to the entropy coding unit 104 and the inverse quantization / inverse transform unit 105 .

[0317] The inverse quantization / inverse transformation unit 105 and the inverse quantization / inverse transformation unit 311 ( Fig. 9 The calculated prediction error is input to the adding unit 106.

[0318] The parameter coding unit 111 includes a header coding unit 1110 , a CT information coding unit 1111 , a CU coding unit 1112 (prediction mode coding unit), an entropy coding unit 104 , and inter prediction parameter coding units 112 and intra prediction parameter coding units 113 , which are not shown. The CU coding unit 1112 further includes a TU coding unit 1114 .

[0319] The following describes the schematic operation of each module. The parameter encoding unit 111 performs encoding processing of parameters such as header information, partition information, prediction information, and quantized transform coefficients.

[0320] The CT information encoding unit 1111 encodes QT, MT (BT, TT) division information and the like.

[0321] The CU encoding unit 1112 encodes CU information, prediction information, TU partition flag, CU residual flag, and the like.

[0322] When a prediction error is included in a TU, the TU coding unit 1114 codes the QP update information (quantization correction value) and the quantized prediction error (residual_coding).

[0323] The entropy coding unit 104 converts the syntax elements supplied from the supplier into binary data, generates coded data by entropy coding such as CABAC, and outputs the coded data. Fig.24 In the example shown in , the suppliers of syntax elements are the CT information encoding unit 1111 and the CU encoding unit 1112 .

[0324] The adder 106 generates a decoded image by adding pixel values ​​of the block prediction image input from the prediction image generator 101 and the prediction error input from the inverse quantization / inverse transform unit 105 for each pixel. The adder 106 stores the generated decoded image in the reference picture memory 109.

[0325] The loop filter 107 performs deblocking filtering, SAO, and ALF on the decoded image generated by the adding unit 106. It should be noted that the loop filter 107 does not necessarily have to include the above three types of filters.

[0326] The prediction parameter memory 108 stores the prediction parameter generated by the encoding parameter determination unit 110 in a predetermined position for each target picture and CU.

[0327] The reference picture memory 109 stores the decoded image generated by the loop filter 107 at a predetermined position for each target picture and CU.

[0328] The coding parameter determination unit 110 selects one of a plurality of sets of coding parameters. The coding parameters refer to the QT, BT or TT partition information, prediction parameters or parameters generated in association with them as the coding target. The predicted image generation unit 101 generates a predicted image using these coding parameters.

[0329] The coding parameter determination unit 110 calculates the rate-distortion (RD) cost value representing the amount of information and the coding error for each of the multiple sets, and selects the set of coding parameters with the smallest cost value. Thus, the entropy coding unit 104 outputs the selected set of coding parameters as the coded stream Te. The coding parameter determination unit 110 stores the determined coding parameters in the prediction parameter memory 108.

[0330] It should be noted that a part of the moving image encoding device 11 and the moving image decoding device 31 in the above-mentioned embodiment can be implemented by a computer, for example, the entropy decoding unit 301, the parameter decoding unit 302, the loop filter 305, the predicted image generation unit 308, the inverse quantization / inverse transformation unit 311, the addition unit 312, the predicted image generation unit 101, the subtraction unit 102, the transformation / quantization unit 103, the entropy encoding unit 104, the inverse quantization / inverse transformation unit 105, the loop filter 107, the encoding parameter determination unit 110 and the parameter encoding unit 111. In this case, the program for realizing the control function can be recorded in a computer-readable recording medium, and the computer system can read the program recorded in the recording medium and execute it. It should be noted that the "computer system" mentioned here refers to a computer system built into any one of the moving image encoding device 11 and the moving image decoding device 31, and a computer system including hardware such as an operating system (Operation system: OS) and peripheral devices is used. In addition, "computer-readable recording medium" refers to removable media such as floppy disks, magneto-optical disks, read-only memories (ROM), read-only optical disks (CD-ROM), and storage devices such as hard disks built into computer systems. Moreover, "computer-readable recording medium" may also include: recording media that dynamically store programs in a short period of time, such as communication lines in the case of sending programs via networks such as the Internet or communication lines such as telephone lines; and recording media that store programs for a fixed time, such as volatile memories inside computer systems that serve as servers or clients in this case. In addition, the above-mentioned program may be a program for realizing a part of the above-mentioned functions, or a program that can realize the above-mentioned functions by combining with programs already recorded in the computer system.

[0331] In addition, part or all of the moving picture encoding device 11 and the moving picture decoding device 31 in the above-mentioned embodiment can also be implemented as an integrated circuit such as LSI (Large Scale Integration). Each functional block of the moving picture encoding device 11 and the moving picture decoding device 31 can be individually processor-based, or part or all of them can be integrated to be processor-based. In addition, the method of integrated circuitization is not limited to LSI, and it can also be implemented by a dedicated circuit or a general-purpose processor. In addition, when a technology for integrated circuitization that replaces LSI appears with the advancement of semiconductor technology, an integrated circuit based on this technology can also be used.

[0332] As mentioned above, one embodiment of the present invention has been described in detail with reference to the drawings, but the specific configuration is not limited to the above embodiment, and various design changes and the like can be made within the scope not departing from the gist of the present invention.

[0333] A motion image decoding device according to one embodiment of the present invention is a motion image decoding device that decodes encoded data of a tile group that divides a picture into one or more rectangular areas and is composed of one or more segments, and is characterized in that it comprises a header decoding unit that decodes from a tile group header the number of tiles in the object tile group, a WPP valid flag, and a slice valid flag indicating which of the segments in the object tile group is a rectangular tile, a CTU row of 1CTU height, and a slice of a CTU unit, and the header decoding unit only decodes any one of the tile numbers being two or more, the WPP valid flag being 1, and the slice valid flag being 1 in one tile group.

[0334] In a motion picture decoding device of one embodiment of the present invention, it is characterized in that the above-mentioned header decoding unit decodes the WPP valid flag when the number of tiles of the object tile group is 1, and does not decode the WPP valid flag but sets it to 0 when the number of tiles of the object tile group is 2 or more, and the CT information decoding unit decodes the fixed value of the segment last bit after decoding the CTU at the right end of the CTU row when the WPP valid flag is 1.

[0335] In a motion picture decoding device of one embodiment of the present invention, it is characterized in that the above-mentioned header decoding unit decodes the WPP valid flag when the number of blocks in the target block group is 1, and does not decode the WPP valid flag but sets it to 0 when the number of blocks in the target block group is 2 or more, and the CT information decoding unit decodes the first segment last bit of a fixed value after decoding the CTU at the right end of the CTU row when the WPP valid flag is 1, and decodes the second segment last bit of a fixed value after decoding the CTU at the lower right of the block when the WPP valid flag is 0, and the first segment last bit is different from the second segment last bit.

[0336] In a motion picture decoding device of one embodiment of the present invention, it is characterized in that the above-mentioned header decoding unit decodes the number of tiles when the WPP valid flag of the object tile group is 0, does not decode the number of tiles but sets the number of tiles to 1 when the WPP valid flag of the object tile group is 1, and the CT information decoding unit decodes the fixed value of the segment last bit after decoding the CTU at the right end of the CTU row when the WPP valid flag is 1.

[0337] In a motion picture decoding device of one embodiment of the present invention, it is characterized in that the above-mentioned header decoding unit decodes the number of tiles when the WPP valid flag of the object tile group is 0, and does not decode the number of tiles but sets it to 1 when the WPP valid flag of the object tile group is 1; the CT information decoding unit decodes the first segment last bit of a fixed value after decoding the CTU at the right end of the CTU row when the WPP valid flag is 1, and decodes the second segment last bit of a fixed value after decoding the CTU at the lower right of the tile when the WPP valid flag is 0, and the first segment last bit is different from the second segment last bit.

[0338] In a motion picture decoding device of one embodiment of the present invention, it is characterized in that the above-mentioned header decoding unit decodes the slice valid flag when the number of tiles of the target tile group is 1, and does not decode the slice valid flag but sets it to 0 when the number of tiles of the target tile group is 2 or more, and the CT information decoding unit decodes the slice end flag after CTU decoding when the slice valid flag is 1.

[0339] In a motion picture decoding device of one embodiment of the present invention, it is characterized in that the above-mentioned header decoding unit decodes the number of tiles when the slice valid flag of the object tile group is 0, and does not decode the number of tiles but sets it to 1 when the slice end flag of the object tile group is 1, and the CT information decoding unit decodes the slice end flag after CTU decoding when the slice valid flag is 1.

[0340] In a motion picture decoding device of one embodiment of the present invention, it is characterized in that the above-mentioned header decoding unit decodes the WPP valid flag when the number of tiles of the target tile group is 1, and does not decode the WPP valid flag but sets it to 0 when the number of tiles of the above-mentioned target tile group is 2 or more, and further decodes the slice valid flag when the above-mentioned WPP valid flag is 0, and does not decode the slice end flag but sets it to 0 when the WPP valid flag is 1, and the CT information decoding unit decodes the slice end flag after CTU decoding when the slice valid flag is 1.

[0341] In a motion picture decoding device of one embodiment of the present invention, it is characterized in that the above-mentioned header decoding unit decodes the number of tiles when the WPP valid flag of the object tile group is 0, does not decode the number of tiles but sets it to 1 when the WPP valid flag of the object tile group is 1, and further decodes the slice valid flag when the number of tiles is 1, and does not decode the slice valid flag but sets it to 0 when the number of tiles is 2 or more, and the CT information decoding unit decodes the slice end flag after CTU decoding when the slice valid flag is 1.

[0342] [Application Examples]

[0343] The above-mentioned moving picture encoding device 11 and moving picture decoding device 31 can be mounted on various devices for sending, receiving, recording, and reproducing moving pictures. It should be noted that the moving pictures can be natural moving pictures taken by a camera or the like, or artificial moving pictures (including CG and GUI) generated by a computer or the like.

[0344] First, refer to Figure 2 A case where the above-mentioned moving picture encoding device 11 and moving picture decoding device 31 can be used for transmission and reception of moving pictures will be described.

[0345] Figure 2 (a) is a block diagram showing the structure of a transmitting device PROD_A equipped with a motion picture encoding device 11. Figure 2 As shown in (a), the transmitting device PROD_A includes: an encoding unit PROD_A1 that obtains encoded data by encoding a moving image, a modulation unit PROD_A2 that obtains a modulated signal by modulating a carrier using the encoded data obtained by the encoding unit PROD_A1, and a transmitting unit PROD_A3 that transmits the modulated signal obtained by the modulation unit PROD_A2. The moving image encoding device 11 described above is used as the encoding unit PROD_A1.

[0346] As a supplier of moving images input to the encoding unit PROD_A1, the transmitting device PROD_A may further include: a camera PROD_A4 for shooting moving images, a recording medium PROD_A5 for recording moving images, an input terminal PROD_A6 for inputting moving images from the outside, and an image processing unit A7 for generating or processing images. Figure 2 (a) shows an example in which the transmitting device PROD_A has all of these structures, but some of them may be omitted.

[0347] It should be noted that the recording medium PROD_A5 may be a medium on which an uncoded moving image is recorded, or may be a medium on which a moving image coded in a recording coding method different from a transmission coding method is recorded. In the latter case, it is preferred that a decoding unit (not shown) that decodes coded data read from the recording medium PROD_A5 in accordance with the recording coding method is interposed between the recording medium PROD_A5 and the coding unit PROD_A1.

[0348] Figure 2 (b) is a block diagram showing the structure of a receiving device PROD_B equipped with a motion picture decoding device 31. Figure 2 As shown in (b), the receiving device PROD_B includes: a receiving unit PROD_B1 that receives a modulated signal, a demodulating unit PROD_B2 that obtains coded data by demodulating the modulated signal received by the receiving unit PROD_B1, and a decoding unit PROD_B3 that obtains a moving image by decoding the coded data obtained by the demodulating unit PROD_B2. The moving image decoding device 31 described above is used as the decoding unit PROD_B3.

[0349] The receiving device PROD_B, as a supply destination of the moving image output by the decoding unit PROD_B3, may further include a display PROD_B4 for displaying the moving image, a recording medium PROD_B5 for recording the moving image, and an output terminal PROD_B6 for outputting the moving image to the outside. Figure 2 (b) shows an example in which the receiving device PROD_B has all of these structures, but some of them may be omitted.

[0350] It should be noted that the recording medium PROD_B5 may be a medium for recording uncoded moving images, or may be a medium coded in a recording coding method different from a transmission coding method. In the latter case, it is preferred that a coding unit (not shown) that codes the moving images obtained from the decoding unit PROD_B3 in a recording coding method is interposed between the decoding unit PROD_B3 and the recording medium PROD_B5.

[0351] It should be noted that the transmission medium for transmitting the modulated signal can be wireless or wired. In addition, the transmission scheme for transmitting the modulated signal can be broadcast (here, it refers to a transmission scheme in which the transmission destination is not predetermined) or communication (here, it refers to a transmission scheme in which the transmission destination is predetermined). That is, the transmission of the modulated signal can be achieved through any one of wireless broadcasting, wired broadcasting, wireless communication and wired communication.

[0352] For example, a broadcasting station (broadcasting equipment, etc.) / receiving station (television receiver, etc.) of terrestrial digital broadcasting is an example of a transmitting device PROD_A / receiving device PROD_B that transmits and receives modulated signals via wireless broadcasting. In addition, a broadcasting station (broadcasting equipment, etc.) / receiving station (television receiver, etc.) of cable television broadcasting is an example of a transmitting device PROD_A / receiving device PROD_B that transmits and receives modulated signals via wired broadcasting.

[0353] In addition, a server (workstation, etc.) / client (television receiver, personal computer, smart phone, etc.) of a VOD (Video On Demand) service or a motion picture sharing service using the Internet is an example of a transmitter PROD_A / receiver PROD_B that transmits and receives a modulated signal through communication (usually, a wireless or wired transmission medium is used as a transmission medium in a LAN, and a wired transmission medium is used as a transmission medium in a WAN). Here, a personal computer includes a desktop PC, a laptop PC, and a tablet PC. In addition, a smart phone also includes a multifunctional portable phone terminal.

[0354] It should be noted that the client of the moving image sharing service has the function of decoding the encoded data downloaded from the server and displaying it on the display, and also has the function of encoding the moving images captured by the camera and uploading them to the server. That is, the client of the moving image sharing service plays the role of both the sending device PROD_A and the receiving device PROD_B.

[0355] Next, refer to Figure 3 , a description is given of a case where the above-mentioned motion image encoding device 11 and motion image decoding device 31 can be used for recording and reproducing motion images.

[0356] Figure 3 (a) is a block diagram showing the structure of a recording device PROD_C equipped with the above-mentioned motion picture encoding device 11. Figure 3 As shown in (a) of FIG. 1 , the recording device PROD_C includes a coding unit PROD_C1 for obtaining coded data by coding a moving picture, and a writing unit PROD_C2 for writing the coded data obtained by the coding unit PROD_C1 into the recording medium PROD_M. The moving picture coding device 11 described above is used as the coding unit PROD_C1.

[0357] It should be noted that the recording medium PROD_M can be (1) a type of recording medium built into the recording device PROD_C such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), or (2) a type of recording medium connected to the recording device PROD_C such as an SD memory card or a USB (Universal Serial Bus) flash memory, or (3) a recording medium loaded into a drive device (not shown) built into the recording device PROD_C such as a DVD (Digital Versatile Disc, registered trademark) or a BD (Blu-ray Disc, registered trademark).

[0358] In addition, as a supplier of moving images input to the encoding unit PROD_C1, the recording device PROD_C may further include: a camera PROD_C3 for shooting moving images, an input terminal PROD_C4 for inputting moving images from the outside, a receiving unit PROD_C5 for receiving moving images, and an image processing unit PROD_C6 for generating or processing images. Figure 3 (a) shows an example in which the recording device PROD_C has all of these structures, but some of them may be omitted.

[0359] It should be noted that the receiving unit PROD_C5 can receive uncoded moving images, or can receive coded data coded in a transmission coding method different from the recording coding method. In the latter case, it is preferable to place a transmission decoding unit (not shown) that decodes the coded data coded in the transmission coding method between the receiving unit PROD_C5 and the coding unit PROD_C1.

[0360] Examples of such recording device PROD_C include DVD recorders, BD recorders, and HDD (Hard Disk Drive) recorders (in this case, the input terminal PROD_C4 or the receiving unit PROD_C5 is the main supplier of motion images). In addition, portable cameras (in this case, the camera PROD_C3 is the main supplier of motion images), personal computers (in this case, the receiving unit PROD_C5 or the image processing unit C6 is the main supplier of motion images), and smart phones (in this case, the camera PROD_C3 or the receiving unit PROD_C5 is the main supplier of motion images) are also examples of such recording device PROD_C.

[0361] Figure 3(B) is a block diagram showing the structure of a playback device PROD_D equipped with the above-mentioned motion picture decoding device 31. Figure 3 As shown in (b) of FIG. 1 , the playback device PROD_D includes a reading unit PROD_D1 for reading coded data written in the recording medium PROD_M and a decoding unit PROD_D2 for obtaining a moving image by decoding the coded data read by the reading unit PROD_D1. The moving image decoding device 31 described above is used as the decoding unit PROD_D2.

[0362] It should be noted that the recording medium PROD_M can be (1) a type of recording medium built into the reproduction device PROD_D such as an HDD, SSD, etc., or (2) a type of recording medium connected to the reproduction device PROD_D such as an SD memory card, USB flash memory, etc., or (3) a recording medium loaded into a drive device (not shown) built into the reproduction device PROD_D such as a DVD, BD, etc.

[0363] In addition, as a supply destination of the moving image output by the decoding unit PROD_D2, the reproduction device PROD_D may further include: a display PROD_D3 for displaying the moving image, an output terminal PROD_D4 for outputting the moving image to the outside, and a transmission unit PROD_D5 for transmitting the moving image. Figure 3 (b) shows an example in which the playback device PROD_D has all of these structures, but some of them may be omitted.

[0364] It should be noted that the sending unit PROD_D5 can send uncoded moving images or can send coded data coded in a transmission coding method different from the recording coding method. In the latter case, it is better to place a coding unit (not shown) that encodes the moving images in the transmission coding method between the decoding unit PROD_D2 and the sending unit PROD_D5.

[0365] Examples of such a reproduction device PROD_D include a DVD player, a BD player, and an HDD player (in this case, the output terminal PROD_D4 connected to a television receiver or the like is the main supply destination of the motion image). In addition, a television receiver (in this case, the display PROD_D3 is the main supply destination of the motion image), a digital signage (also called an electronic billboard, an electronic bulletin board, etc., the display PROD_D3 or the transmission unit PROD_D5 is the main supply destination of the motion image), a desktop PC (in this case, the output terminal PROD_D4 or the transmission unit PROD_D5 is the main supply destination of the motion image), a laptop or tablet PC (in this case, the display PROD_D3 or the transmission unit PROD_D5 is the main supply destination of the motion image), and a smartphone (in this case, the display PROD_D3 or the transmission unit PROD_D5 is the main supply destination of the motion image) are also examples of such a reproduction device PROD_D.

[0366] (Hardware implementation and software implementation)

[0367] Furthermore, each block of the above-described moving picture decoding device 31 and moving picture encoding device 11 may be implemented in hardware by a logic circuit formed on an integrated circuit (IC chip), or may be implemented in software by using a CPU (Central Processing Unit).

[0368] In the latter case, each of the above-mentioned devices has: a CPU that executes commands of a program that realizes each function, a ROM (Read Only Memory) that stores the above-mentioned program, a RAM (Random Access Memory) that expands the above-mentioned program, and a storage device (recording medium) such as a memory that stores the above-mentioned program and various data. Then, the purpose of the embodiment of the present invention can also be achieved in the following manner: a recording medium that records the program code (executable form program, intermediate code program, source program) of the control program of the software that realizes the above-mentioned functions, i.e., the above-mentioned each device in a computer-readable manner is supplied to the above-mentioned each device, and the computer (or CPU, MPU) reads the program code recorded in the recording medium and executes it.

[0369] As the above-mentioned recording medium, for example, the following tapes can be used: tapes such as magnetic tapes and cassette tapes; disks including floppy disks (registered trademark) / hard disks, CD-ROMs (Compact Disc Read-Only Memory) / MO disks (Magneto-Optical disc) / MD (Mini Disc) / DVD (Digital Versatile Disc) / CD-R (CD Recordable) / Blu-ray Discs (registered trademark) and the like; cards such as IC cards (including memory cards) / optical cards; semiconductor memories such as mask ROMs / EPROMs (Erasable Programmable Read-Only Memory) / EEPROMs (Electrically Erasable and Programmable Read-Only Memory) / flash ROMs; or logic circuits such as PLDs (Programmable logic device) and FPGAs (Field Programmable Gate Array), etc.

[0370] In addition, each of the above-mentioned devices can also be configured to be connected to a communication network, and the above-mentioned program code can be supplied via the communication network. The communication network can transmit program codes without being particularly limited. For example, the Internet, intranet, extranet, LAN (Local Area Network), ISDN (Integrated Services Digital Network), VAN (Value-Added Network), CATV (Community Antenna television / Cable Television) communication network, virtual private network (Virtual Private Network), telephone line network, mobile communication network, satellite communication network, etc. can be used. In addition, the transmission medium constituting the communication network can also be a medium capable of transmitting program codes, and is not limited to a specific structure or type. For example, it can be used in wired communication such as IEEE (Institute of Electrical and Electronic Engineers) 1394, USB, power line transmission, wired TV line, telephone line, ADSL (Asymmetric Digital Subscriber Line) line, or wireless communication such as IrDA (Infrared Data Association), infrared such as remote controller, BlueTooth (registered trademark), IEEE802.11 wireless, HDR (High Data Rate), NFC (Near Field Communication), DLNA (Digital Living Network Alliance, registered trademark), mobile phone network, satellite line, terrestrial digital broadcasting network, etc. It should be noted that the embodiments of the present invention can be implemented in the form of a computer data signal embedded in a carrier wave to embody the above-mentioned program code through electronic transmission.

[0371] The embodiments of the present invention are not limited to the above-mentioned embodiments, and various modifications can be made within the scope of the claims. That is, embodiments obtained by combining technical solutions appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

[0372] Industrial Applicability

[0373] The embodiments of the present invention can be preferably applied to a motion picture decoding device that decodes coded data obtained by encoding image data, and a motion picture encoding device that generates coded data obtained by encoding image data. In addition, the embodiments of the present invention can be preferably applied to a data structure of coded data generated by a motion picture encoding device and referred to by a motion picture decoding device.

[0374] (Cross-reference of related applications)

[0375] This application claims the benefit of priority to U.S. patent application No. 62 / 783,640 filed on December 21, 2018, and the entire contents of which are incorporated into this specification by reference thereto.

[0376] Description of Reference Numerals

[0377] 11 Motion picture encoding device

[0378] 31. Motion picture decoding device

[0379] 101, 308 Prediction image generation unit

[0380] 104 entropy coding unit (coding unit)

[0381] 107, 305 loop filter

[0382] 111 parameter encoding unit

[0383] 301 Entropy Decoding Unit

[0384] 302 parameter decoding unit (splitting unit)

[0385] 3020 Header decoding unit

[0386] 3021 CT Information Decoding Department

[0387] 3022 CU decoding unit

[0388] 104 Entropy Coding Unit

[0389] 1110 Header Encoding Unit

[0390] 1111 CT Information Coding Department

[0391] 1112 CU Coding Department

Claims

1. A moving picture decoding device, for decoding coded data of a plurality of tile groups into which a picture is divided, wherein the tile group is generated by dividing the picture into one or more rectangular areas and is composed of one or more segments, each of the one or more rectangular areas is composed of one or more coding tree units (CTUs), and each of the one or more segments is a unit for dividing and transmitting the tile group, characterized in that: The video decoding device comprises: at least one processor; as well as A storage device coupled to the at least one processor and storing a program, the program, when executed by the at least one processor, causing the at least one processor to: decoding a wavefront parallel processing (WPP) valid flag, the WPP valid flag indicating that a rectangular tile or a CTU row having a height of one coding tree unit (CTU) exists in the one or more segments within the tile group, wherein the tile group is a set of CTUs; and Decoding the last bits of the one or more segments in the tile group, wherein: When the WPP valid flag is 1, after decoding the syntax structure of the CTU at the right end of the CTU row in the tile group, decoding the last bit of the first segment having a fixed value in the one or more segments, wherein the tile group includes a plurality of tiles, and the CTU at the right end of the CTU row in each tile is determined by the width of the tile; and When the WPP valid flag is 0, after decoding the syntax structure of the lower right CTU in the rectangular tile of the tile group, the last bit of the second segment having a fixed value among the one or more segments is decoded.

2. The moving picture decoding device according to claim 1, characterized in that The last bit of the first segment is the same as the last bit of the second segment.

3. The moving picture decoding device according to claim 2, characterized in that The last bit of the first segment and the last bit of the second segment are both equal to 1.

4. A moving picture encoding device, encoding coded data of a plurality of picture block groups into which a picture is divided, wherein the picture block groups are generated by dividing the picture into one or more rectangular areas and are composed of one or more segments, each of the one or more rectangular areas is composed of one or more coding tree units (CTUs), and each of the one or more segments is a unit for dividing and transmitting the picture block group, characterized in that: The video encoding device comprises: at least one processor; as well as A storage device coupled to the at least one processor and storing a program, the program, when executed by the at least one processor, causing the at least one processor to: a coding wavefront parallel processing (WPP) valid flag, wherein the WPP valid flag indicates that a rectangular tile or a CTU row having a height of one coding tree unit (CTU) exists in the one or more segments within the tile group, wherein the tile group is a set of CTUs; and The last bits in the one or more segments in the tile group are encoded, wherein: When the WPP valid flag is 1, after encoding the syntax structure of the CTU at the right end of the CTU row in the tile group, encoding the last bit of the first segment having a fixed value in the one or more segments, wherein the tile group includes a plurality of tiles, and the CTU at the right end of the CTU row in each tile is determined by the width of the tile; and When the WPP valid flag is 0, after encoding the syntax structure of the lower right CTU in the rectangular tile of the tile group, the last bit of the second segment having a fixed value among the one or more segments is encoded.

5. A moving image decoding device, for decoding coded data of a plurality of tile groups into which a picture is divided, wherein the tile group is generated by dividing the picture into one or more rectangular areas and is composed of one or more segments, each of the one or more rectangular areas is composed of one or more coding tree units (CTUs), and each of the one or more segments is a unit for dividing and transmitting the tile group, characterized in that: The video decoding device comprises: at least one processor; as well as A storage device coupled to the at least one processor and storing a program, the program, when executed by the at least one processor, causing the at least one processor to: In the case where the tile group uses wavefront parallel processing WPP, the tile group has a coding tree unit CTU row, and the last bit and byte alignment of the segment of the CTU at the right end in the CTU row in the tile group are decoded, wherein the tile group includes a plurality of tiles, and the CTU at the right end in the CTU row in each tile is determined by the width of the tile; as well as In the case that the tile group does not use WPP, the tile group has a rectangular tile, and the last bit and byte alignment of the lower right CTU in the rectangular tile of the tile group are decoded.