Transmission method, transmission device, reception device, and reception method

Abstract

To make it possible to transmit a video stream well.SOLUTION: Image data of each picture constituting moving image data is hierarchically encoded, and a video stream having encoded image data of pictures of each layer is generated. A container of a predetermined format including the video stream is transmitted. A descriptor in which a value necessary for decoding is described is fixedly inserted into a layer of the container. The value required for this decoding is fixed to the maximum magnitude value. An operation on a transmitting side becomes easy, and a receiving side can easily recognize the maximum scale value of the values necessary for decoding in the layer of the container.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present technology relates to a transmitting device, a transmitting method, a receiving device, and a receiving method, and in particular to a transmitting device or the like that continuously transmits video streams of multiple programs. [Background technology]

[0002] In broadcasting, it is possible to transmit a mixture of programs (events) with different image formats, such as different frame rates (frame frequencies). For example, sports programs may be provided at 100p, and other programs at 50p.

[0003] Conventionally, for example, in HEVC (High Efficiency Video Coding), temporal scalability has been proposed by hierarchically encoding image data of each picture constituting video data (see Non-Patent Document 1). On the receiving side, the layer of each picture can be identified based on temporal ID (temporal_id) information inserted in the header of a NAL (Network Abstraction Layer) unit, and selective decoding up to the layer corresponding to the decoding capability becomes possible. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Gary J. Sullivan, Jens-Rainer Ohm, Woo-Jin Han, Thomas Wiegand, “Overview of the High Efficiency Video Coding (HEVC) Standard” IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECNOROGY, VOL. 22, NO. 12, pp. 1649-1668, DECEMBER 2012 Summary of the Invention [Problem to be solved by the invention]

[0005] The purpose of this technology is to enable good transmission of video streams. [Means for solving the problem]

[0006] The concept of this technology is: an image encoding unit that hierarchically encodes image data of each picture constituting moving image data, and generates a video stream having encoded image data of the pictures of each hierarchy; a transmitting unit that transmits a container in a predetermined format including the video stream; A descriptor containing the values ​​required for decoding is inserted into the container layer. The value required for the above decoding is fixed to the maximum magnitude value. Located in the transmitting device.

[0007] In the present technology, an image encoding unit hierarchically encodes image data of each picture constituting video data, and generates a video stream having encoded image data of the pictures of each layer. For example, the image encoding unit may encode video data of a first frame rate to generate a first video stream, and encode video data of a second frame rate higher than the first frame rate to generate a second video stream, and the transmitter may transmit a container in a predetermined format that successively includes the first video stream and the second video stream generated by the image encoding unit.

[0008] In this case, for example, the first video stream may consist of a basic stream having coded image data of pictures in all layers, and the second video stream may consist of a basic stream having coded image data of pictures in lower layers and an extended stream having coded image data of pictures in higher layers. In this case, the video stream is distributed in a mode that is backward compatible with HFR (High Frame Rate).

[0009] In this case, for example, the hierarchical level of a picture included in the extended stream may be a fixed hierarchical level that is higher than the maximum hierarchical level that a picture in the basic stream can have. This makes it possible to appropriately extract coded image data of pictures in each hierarchical level included in the basic stream even when the hierarchical structure of each picture in the basic stream changes.

[0010] In this case, for example, the first video stream and the second video stream may each be composed of an elementary stream having coded image data of pictures of all hierarchical layers, in which case the video stream is distributed in a mode that does not have backward compatibility with HFR (High Frame Rate).

[0011] A descriptor describing a value required for decoding is fixedly inserted into a layer of the container. The value required for decoding is fixed to a maximum value. For example, the value required for decoding may be a level specification value of the video stream and the maximum and minimum values ​​of the hierarchy of the coded image data of each picture included in the video stream.

[0012] According to this technology, a descriptor describing the values ​​required for decoding is fixedly inserted into the container layer, and the value required for decoding is fixed to the largest value, which makes operation easier on the sending side and allows the receiving side to easily recognize the largest value required for decoding in the container layer.

[0013] In this technology, for example, the container may be a transport stream, the descriptor may be an HEVC VIDEO descriptor, and a component descriptor describing frame rate information and compatibility information corresponding to each video stream for each program (event) may be inserted into the container layer. This enables the receiving side to accurately determine the status of the received video stream and perform appropriate processing by combining the description contents of the HEVC VIDEO descriptor and the component descriptor.

[0014] Another concept of the present technology is a receiving unit for receiving a container in a predetermined format including a video stream having coded image data of pictures of each layer generated by hierarchical coding of image data of each picture constituting moving image data; A descriptor containing the values ​​required for decoding is fixedly inserted into the layer of the container. The value required for the above decoding is fixed to the maximum value, The decoder further includes a control unit that controls the decoding process of the video stream based on the contents of the descriptor. It is in the receiving device.

[0015] In this technology, a receiving unit receives a container in a predetermined format including a video stream having coded image data of pictures of each layer, generated by hierarchically coding the image data of each picture that constitutes video image data.

[0016] A descriptor describing the values ​​required for decoding is fixedly inserted into the container layer. The values ​​required for decoding are fixed to the maximum value. The control unit controls the decoding process of the video stream based on the contents of the descriptor.

[0017] In this way, according to the present technology, the decoding process of the video stream is controlled based on a descriptor that is inserted into the layer of the container and in which the value required for decoding is fixed to the maximum value, thereby making it possible to perform the decoding process of the video stream appropriately.

[0018] In the present technology, for example, the container may be a transport stream, the descriptor may be an HEVC VIDEO descriptor, component descriptors each corresponding to a video stream for each program (event) and describing frame rate information and compatibility information may be inserted into the container layer, and the control unit may control the decoding process of the video stream based on the description content of the HEVC VIDEO descriptor and the description content of the component descriptor. This enables the control unit to accurately determine the status of the received video stream by combining the description content of the HEVC VIDEO descriptor and the component descriptor and perform appropriate processing. [Effects of the Invention]

[0019] According to the present technology, video streams can be transmitted satisfactorily. Note that the effects described herein are not necessarily limited to those described herein, and may be any of the effects described in this disclosure. [Brief explanation of the drawings]

[0020] [Figure 1] 1 is a block diagram showing an example of the configuration of a transmission / reception system according to an embodiment; [Figure 2] FIG. 1 is a diagram illustrating an example of hierarchical coding. [Figure 3] 1 is a diagram showing an example structure of a NAL unit header and the contents of main parameters in the example structure. [Figure 4] FIG. 10 is a diagram illustrating an example structure of an HEVC VIDEO descriptor. [Figure 5] FIG. 10 is a diagram showing an example of the structure of an EIT and the contents of related elements in the example structure. [Figure 6] FIG. 10 is a diagram illustrating an example of the structure of a component descriptor and the contents of the main elements in the example structure. [Figure 7] FIG. 10 is a diagram showing the correspondence between each value of "component_type" and the video stream identified by it. [Figure 8]FIG. 10 is a diagram illustrating an example of the structure of a stream identifier descriptor. [Figure 9] FIG. 10 is a diagram illustrating an example of the correspondence between the description content of an HEVC VIDEO descriptor and the description content of a component descriptor. [Figure 10] FIG. 2 is a block diagram illustrating an example of the configuration of a transmitting device. [Figure 11] A figure showing an example of state changes in a sequence parameter set, an HEVC VIDEO descriptor, and a component descriptor when switching from a 50 Hz program to a 100 Hz program in distribution in a backward compatible mode. [Figure 12] FIG. 10 is a diagram showing an example of the structure of a transport stream TS when transmitting a 50 Hz program in a backward compatible mode of distribution. [Figure 13] FIG. 10 is a diagram showing an example of the structure of a transport stream TS when transmitting a 100 Hz program in a backward compatible mode of distribution. [Figure 14] FIG. 10 is a diagram showing an example of state changes of a conventional sequence parameter set and an HEVC VIDEO descriptor. [Figure 15] A figure showing an example of state changes in a sequence parameter set, an HEVC VIDEO descriptor, and a component descriptor when switching from a 50 Hz program to a 100 Hz program in distribution in a mode without backward compatibility. [Figure 16] FIG. 10 is a diagram showing an example of the structure of a transport stream TS when transmitting a 50 Hz program in a distribution mode without backward compatibility. [Figure 17] FIG. 10 is a diagram showing an example of the structure of a transport stream TS when transmitting a 100 Hz program in a distribution mode without backward compatibility. [Figure 18] FIG. 10 is a diagram showing an example of state changes of a conventional sequence parameter set and an HEVC VIDEO descriptor. [Figure 19]FIG. 2 is a block diagram illustrating an example of the configuration of a receiving device. [Figure 20] FIG. 2 is a diagram illustrating an example of the configuration of a TS analysis unit. [Figure 21] 10A and 10B are diagrams showing an example of EPG display etc. performed based on user operation in the receiving device. DETAILED DESCRIPTION OF THE INVENTION

[0021] The following describes modes for carrying out the invention (hereinafter referred to as "embodiments") in the following order: 1. Embodiment 2. Variations

[0022] <1. Embodiment> [Transmitting and receiving system] 1 shows an example of the configuration of a transmission / reception system 10 according to an embodiment. The transmission / reception system 10 includes a transmission device 100 and a reception device 200.

[0023] The transmitting device 100 transmits a transport stream TS as a container (multiplexed stream) via broadcast waves or network packets. This transport stream TS contains a series of video streams of multiple programs (events). The video stream is generated by hierarchically encoding the image data of each picture that constitutes the video data, and contains encoded image data of the pictures in each layer.

[0024] The multiple programs include programs related to video data at a first frame rate (first frame frequency) and programs related to video data at a second frame rate (second frame frequency) higher than the first frame rate. For example, the first frame rate is 50 Hz and the second frame rate is 100 Hz, or the first frame rate is 60 Hz and the second frame rate is 120 Hz. Here, an example will be described in which the first frame rate is 50 Hz and the second frame rate is 100 Hz.

[0025] Depending on the service, multiple programs are delivered in either a mode that is backward compatible with HFR (High Frame Rate) (HFR Backward Compatible Mode) or a mode that is not backward compatible with HFR (HFR Non-Backward Compatible Mode).

[0026] For programs involving 50 Hz video data, the video data is encoded to generate a first video stream, while for programs involving 100 Hz video data, the video data is encoded to generate a second video stream.

[0027] Here, in the backward compatible mode of delivery, the first video stream consists of a basic stream that has coded image data of pictures in all layers, and in the backward compatible mode of delivery, the second video stream consists of a basic stream that has coded image data of pictures in lower layers and an extended stream that has coded image data of pictures in higher layers.

[0028] In this case, the hierarchical level of the pictures included in the extended stream is fixed to a higher level than the maximum hierarchical level that the pictures in the basic stream can have. This makes it possible to properly extract coded image data for pictures in each hierarchical level included in the basic stream even when the hierarchical structure of each picture in the basic stream changes.

[0029] In a mode without backward compatibility, the first video stream consists of elementary streams with coded image data for pictures of all layers, and in this mode without backward compatibility, the second video stream also consists of elementary streams with coded image data for pictures of all layers.

[0030] Figure 2(a) shows an example of hierarchical coding of a primary video stream (basic stream) in a backward compatible mode, or a primary video stream (basic stream) in a non-backward compatible mode. Each rectangular box represents a picture. In this example, the highest hierarchical layer is "4." The primary video stream (basic stream) contains coded image data of pictures in layers "0" to "4."

[0031] Figure 2(b) shows an example of hierarchical coding of a second video stream (basic stream, extended stream) in a backward compatible mode. Each rectangular box represents a picture. In this example, the highest hierarchical layer is "5." The basic stream contains coded image data of pictures in layers "0" to "4." The extended stream contains coded image data of pictures in layer "5."

[0032] Figure 2(c) shows an example of hierarchical coding of a secondary video stream (basic stream) in a non-backward compatible mode. Each rectangular box represents a picture. In this example, the highest hierarchical layer is "5." The secondary video stream (basic stream) will have coded image data of pictures in layers "0" to "5."

[0033] In hierarchical coding, for example, coding such as H.264 / AVC or H.265 / HEVC is performed, and the referenced picture is coded so that it belongs to the same hierarchical layer and / or a hierarchical layer lower than the same hierarchical layer. Layer identification information (temporal_id) for identifying the layer to which each picture belongs is added to the coded image data of the picture in each hierarchical layer. "nuh_temporal_id_plus1" which means the layer identification information (temporal_id) is placed in the header of the NAL unit (nal_unit) of each picture. By adding the layer identification information in this way, the receiving side can know the layer to which each picture belongs.

[0034] Figure 3(a) shows an example of the structure (Syntax) of a NAL unit header, and Figure 3(b) shows the contents (Semantics) of the main parameters in that example structure. The 1-bit field "Forbidden_zero_bit" must be 0. The 6-bit field "Nal_unit_type" indicates the NAL unit type. The 6-bit field "Nuh_layer_id" is assumed to be 0. The 3-bit field "Nuh_temporal_id_plus1" indicates "temporal_id" and takes a value (1 to 7) with 1 added.

[0035] A descriptor describing values ​​required for decoding, in this case an HEVC VIDEO descriptor as a PMT descriptor, is fixedly inserted into a container layer. The values ​​required for decoding described in this HEVC VIDEO descriptor are fixed to maximum values. Examples of values ​​required for decoding include the level specification value of the video stream and the maximum and minimum values ​​of the hierarchy of the coded image data of each picture included in the video stream.

[0036] Figure 4 shows an example structure (Syntax) of an HEVC VIDEO descriptor (HEVC_video_descriptor). The 8-bit field "descriptor_tag" indicates the descriptor type, which in this case indicates that it is an HEVC VIDEO descriptor. The 8-bit field "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0037] The 8-bit field "level_idc" indicates the level specification value of the video stream. Also, when "temporal_layer_subset_flag = 1", the 5-bit fields "temporal_id_min" and "temporal_id_max" exist. "temporal_id_min" indicates the "temporal_id" value of the lowest layer of the hierarchically coded data contained in the corresponding video stream. "temporal_id_max" indicates the "temporal_id" value of the highest layer of the hierarchically coded data contained in the corresponding video stream.

[0038] Furthermore, a component descriptor (Component_descriptor) that describes frame rate information and compatibility information corresponding to each video stream for each program (event) is inserted into the container layer. This component descriptor is placed in the EIT (Event Information Table).

[0039] Figure 5(a) shows an example of the structure (Syntax) of an EIT. Figure 5(b) shows the contents (Semantics) of related elements in the example of the EIT structure. The 16-bit field "service_id" is an ID that indicates the distribution service. The 16-bit field "event_id" indicates an ID that identifies the program (event). The 40-bit field "start_time" indicates the start time of the program, expressed in UTC (Universal Time, Coordinated). A descriptor is inserted in the "descriptor()" field. N descriptors can be inserted.

[0040] Figure 6(a) shows an example of the structure (Syntax) of a component descriptor. Figure 6(b) shows the contents (Semantics) of the main elements in the example of the structure of a component descriptor. The 4-bit field of "stream_content_ext" indicates whether the distribution is backward compatible or not. "0x1" indicates compatibility, and "0x0" indicates incompatibility.

[0041] The 4-bit field of "stream_content" indicates the type of stream. For example, "0x9" may be an HEVC encoded stream. The 8-bit field of "component_type" is identification information that indicates a combination of stream parameters.

[0042] Figure 7 shows the correspondence between each value of "component_type" and the video stream identified by it. When "stream_content_ext = 0x0" and "component_type = 0x05", it indicates that the video is an UHD (Ultra High Definition) video with HEVC Main 10 Profile and a single 50Hz stream (basic stream). When "stream_content_ext = 0x0" and "component_type = 0x06", it indicates that the video is an UHD video with HEVC Main 10 Profile and a single 60Hz stream (basic stream).

[0043] Also, when "stream_content_ext = 0x0" and "component_type = 0x07", it indicates a 100Hz single stream (basic stream) of HD (High Definition) video with HEVC Main 10 Profile. Also, when "stream_content_ext = 0x0" and "component_type = 0x08", it indicates a 120Hz single stream (basic stream) of HD (High Definition) video with HEVC Main 10 Profile.

[0044] Also, when "stream_content_ext = 0x0" and "component_type = 0x09", it indicates that the video is a 100Hz single stream (basic stream) of UHD video with the HEVC Main 10 profile. Also, when "stream_content_ext = 0x0" and "component_type = 0x0A", it indicates that the video is a 120Hz single stream (basic stream) of UHD video with the HEVC Main 10 profile.

[0045] Also, when "stream_content_ext = 0x1" and "component_type = 0x07", it indicates that it is an extension stream for HEVC Main 10 Profile HD video, combined with the basic stream, to achieve 100 Hz. Also, when "stream_content_ext = 0x1" and "component_type = 0x08", it indicates that it is an extension stream for HEVC Main 10 Profile HD video, combined with the basic stream, to achieve 120 Hz.

[0046] Also, when "stream_content_ext = 0x1" and "component_type = 0x09", it indicates that it is an extension stream for HEVC Main 10 Profile UHD video, combined with the basic stream, to achieve 100 Hz. Also, when "stream_content_ext = 0x1" and "component_type = 0x0A", it indicates that it is an extension stream for HEVC Main 10 Profile UHD video, combined with the basic stream, to achieve 120 Hz.

[0047] Returning to Figure 6, the 8-bit field of "component_tag" indicates the component tag, which matches the component tag of the stream identifier descriptor placed together with the corresponding HEVC VIDEO descriptor. This associates the PMT with the EIT, that is, associates the HEVC VIDEO descriptor with the component descriptor. Figure 8 shows an example of the structure (Syntax) of a stream identifier descriptor. The 24-bit field of "ISO_639_language_code" represents the language to be displayed in the "text_char" field as a 3-character code.

[0048] Figure 9 shows an example of the correspondence between the contents of an HEVC VIDEO descriptor and the contents of a component descriptor. "Service 1" is an example of distribution in a backward-compatible mode. In this "Service 1," an HEVC VIDEO descriptor is permanently inserted into the ES loop corresponding to each basic stream and extended stream in the PMT, and the values ​​required for decoding described in each HEVC VIDEO descriptor (such as the bitrate level specification value and maximum layer value) are fixed to the maximum value.

[0049] In the ES loop corresponding to the basic stream, information such as the stream type and PID (packet identifier) ​​is placed corresponding to the basic stream. The value of "Stream_type" is set to "0x24", and the PID information is set to "PID1" which is assigned to the PES packet of the basic stream.

[0050] Additionally, an HEVC VIDEO descriptor and a stream identifier descriptor are inserted into the ES loop corresponding to this elementary stream. In the HEVC VIDEO descriptor, "level_idc" is set to "153", i.e., "level 5.1", and "temporal_id_max" is set to "4" (see Figure 2(a) and (b)).

[0051] Additionally, in the ES loop corresponding to the extended stream, information such as the stream type and PID (packet identifier) ​​is placed corresponding to the extended stream. The value of "Stream_type" is set to "0x25", and the PID information is set to "PID2" which is assigned to the PES packet of the extended stream.

[0052] Additionally, an HEVC VIDEO descriptor and a stream identifier descriptor are inserted into the ES loop corresponding to this extended stream. In the HEVC VIDEO descriptor, "level_idc" is set to "156", i.e., "level 5.2", and "temporal_id_max" is set to "5" (see Figure 2(b)).

[0053] In addition, the component tag in the stream identifier descriptor is set to "Component_tag1," and the HEVC VIDEO descriptor and component descriptor are associated. The contents of the component descriptor form EPG (Electronic Program Guide) information.

[0054] The EPG information also includes frame rate information and compatibility information for each video stream for each event. For example, the existence of one video stream is indicated for a program (event) whose start time (start_time) is "6:00:00." This video stream has "stream_content_ext = 0x0" and "component_type = 0x05," indicating that it is a single 50Hz stream (basic stream) of UHD (Ultra High Definition) video in the HEVC Main 10 profile.

[0055] For example, for a program (event) with a start time (start_time) of "7:00:00," two video streams exist, indicating that the stream is compatible with UHD 100 Hz. One of the video streams is a 50 Hz basic stream of UHD (Ultra High Definition) video with the HEVC Main 10 profile, as indicated by the elements "stream_content_ext = 0x0" and "component_type = 0x05" indicated by "Component_tag1_1." The other video stream is a 100 Hz UHD video with the HEVC Main 10 profile, as indicated by the elements "stream_content_ext = 0x1" and "component_type = 0x09."

[0056] "Service 2" is also an example of distribution in a backward compatible mode. Since it is similar to the above-mentioned "Service 1," a detailed description thereof will be omitted.

[0057] "Service 3" is an example of distribution in a mode without backward compatibility. In this "Service 3," an HEVC VIDEO descriptor is fixedly inserted into the ES loop corresponding to the basic stream in the PMT, and the values ​​required for decoding described in the HEVC VIDEO descriptor (such as the bitrate level specification value and maximum layer value) are fixed to maximum scale values.

[0058] In the ES loop corresponding to the basic stream, information such as the stream type and PID (packet identifier) ​​is placed corresponding to the basic stream. The value of "Stream_type" is set to "0x24", and the PID information is set to "PID1" which is assigned to the PES packet of the basic stream.

[0059] Additionally, an HEVC VIDEO descriptor and a stream identifier descriptor are inserted into the ES loop corresponding to this basic stream. In the HEVC VIDEO descriptor, "level_idc" is set to "156," i.e., "level 5.2." Also, "temporal_id_max" is set to "5" (see Figure 2(c)). Even if the video stream level specification value is "level 5.1," the HEVC VIDEO descriptor indicates "level 5.2." Since 100p broadcasting with one stream originally requires an incompatible service, receivers that can only receive 50p broadcasts are not eligible for "Service 3."

[0060] In addition, the component tag in the stream identifier descriptor is set to "Component_tag3," and the HEVC VIDEO descriptor and component descriptor are associated. The contents of the component descriptor form EPG (Electronic Program Guide) information.

[0061] The EPG information also includes frame rate information and compatibility information for each video stream for each event. For example, the existence of one video stream is indicated for a program (event) whose start time (start_time) is "6:00:00." This single video stream is an HEVC Main 10 profile UHD (Ultra High Definition) video stream with a single 50 Hz stream (basic stream) because the elements indicated by "Component_tag3" are "stream_content_ext = 0x0" and "component_type = 0x05."

[0062] For example, a program (event) with a start time (start_time) of "7:00:00" has one video stream, indicating that it is a non-compatible distribution of UHD 100Hz. This video stream is a single 100Hz stream (basic stream) of UHD video in the HEVC Main 10 profile, as the elements indicated by "Component_tag3" are "stream_content_ext = 0x0" and "component_type = 0x09."

[0063] Returning to Fig. 1, the receiving device 200 receives the above-mentioned transport stream TS transmitted by broadcast waves or network packets from the transmitting device 100. As described above, this transport stream TS includes continuous video streams of multiple programs (events). Here, the multiple programs include a program related to 50 Hz video data and a program related to 100 Hz video data.

[0064] In a backward compatible mode of distribution, for programs involving 50 Hz video data, only a basic stream containing coded image data of pictures at all hierarchical levels exists, and for programs involving 100 Hz video data, a basic stream containing coded image data of pictures at lower hierarchical levels and an extended stream containing coded image data of pictures at higher hierarchical levels exist.

[0065] On the other hand, in distribution in a mode without backward compatibility, for programs involving 50 Hz video data, only basic streams with coded image data of pictures at all layers exist, and for programs involving 100 Hz video data, only basic streams with coded image data of pictures at all layers exist.

[0066] An HEVC VIDEO descriptor as a PMT descriptor is fixedly inserted into the container layer, and the value required for decoding described in the HEVC VIDEO descriptor is fixed to the maximum value (see Figure 9).

[0067] Additionally, a component descriptor containing frame rate information and compatibility information is inserted into the container layer for each video stream of each program (event), and the HEVC VIDEO descriptor and the component descriptor are associated with each other by the component tag (see Figure 9).

[0068] The receiving device 200 controls the decoding process of the video stream based on the description content of the HEVC VIDEO descriptor, or the description content of the HEVC VIDEO descriptor and the description content of the component descriptor, and displays images of each program.

[0069] For example, in the case of a program (event) that is distributed in a backward compatible mode (see services 1 and 2 in Figure 9) and that only has a single 50 Hz stream (basic stream), both a receiving device 200 that can only receive 50p broadcasts and a receiving device 200 that can also receive 100p broadcasts will decode the basic stream and display the image of the program.

[0070] Also, for example, if distribution is in a backward compatible mode (see services 1 and 2 in Figure 9) and there are two video streams: a single 50 Hz stream (basic stream) and an extended stream that combines with the basic stream to make 100 Hz, a receiving device 200 that can only receive 50p broadcasts will decode the basic stream to display images of the program, and a receiving device 200 that can also receive 100p broadcasts will decode both the basic stream and the extended stream to display images of the program.

[0071] Furthermore, for example, in the case of a program (event) that is distributed in a mode without backward compatibility (see service 3 in FIG. 9) and has a single stream (basic stream) of 50 Hz or 100 Hz, a receiving device 200 that can only receive 50p broadcasting will not decode the basic stream and will not display an image of the program, but a receiving device 200 that can also receive 100p broadcasting will decode the basic stream and display an image of the program.

[0072] "Configuration of transmitting device" 10 shows an example of the configuration of a transmitting device 100. This transmitting device 100 has a CPU (Central Processing Unit) 101, an encoder 102, a compressed data buffer (cpb: coded picture buffer) 103, a TS formatter (multiplexer) 104, and a transmitting unit 105. The CPU 101 is a control unit and controls the operation of each unit of the transmitting device 100.

[0073] The encoder 102 selectively inputs video data VDA of a program with a frame rate of 50 Hz (hereinafter referred to as a "50 Hz program") and video data VDB of a program with a frame rate of 100 Hz (hereinafter referred to as a "100 Hz program"), and performs encoding using, for example, H.264 / AVC, H.265 / HEVC, etc. to generate a video stream. In this case, the video stream is generated by hierarchically encoding the image data of each picture that makes up the video data.

[0074] When distribution is performed in a mode that has backward compatibility with HFR (HFR Backward Compatible Mode), a basic stream containing coded image data of pictures in all layers is generated for video data VDA of a 50 Hz program (see Figure 2(a)). In this case, a basic stream containing coded image data of pictures in lower layers and an extended stream containing coded image data of pictures in higher layers are generated for video data VDB of a 100 Hz program (see Figure 2(b)).

[0075] Furthermore, when distribution is performed in a mode that does not have HFR backward compatibility (HFR Non-Backward Compatible Mode), a basic stream containing coded image data of pictures in all layers is generated for video data VDA of a 50 Hz program (see Figure 2(a)). In this case, a basic stream containing coded image data of pictures in all layers is also generated for video data VDB of a 100 Hz program (see Figure 2(c)).

[0076] A compressed data buffer (cpb) 103 temporarily stores the video stream generated by the encoder 103. A TS formatter 104 reads the video stream stored in the compressed data buffer 103, packetizes it into PES packets, and further multiplexes them into transport packets to obtain a transport stream TS as a multiplexed stream.

[0077] This transport stream TS contains a video stream for a 50 Hz program and a video stream for a 100 Hz program consecutively. In a backward compatible mode of distribution, only the basic stream exists as the video stream for a 50 Hz program, and both the basic stream and the extended stream exist as the video stream for a 100 Hz program. In a non-backward compatible mode of distribution, only the basic stream exists as the video stream for both a 50 Hz program and a 100 Hz program.

[0078] Furthermore, the TS formatter 104 permanently inserts an HEVC VIDEO descriptor as a PMT descriptor into the layer of the container, and fixes the value required for decoding, which is described in the HEVC VIDEO descriptor, to the maximum scale value.

[0079] In backward-compatible streaming, HEVC VIDEO descriptors are fixedly inserted into the ES loops corresponding to the basic stream and the extended stream in the PMT. The HEVC VIDEO descriptor inserted into the ES loop corresponding to the basic stream has "level_idc" set to "153" and "temporal_id_max" set to "4," while the HEVC VIDEO descriptor inserted into the ES loop corresponding to the extended stream has "level_idc" set to "156" and "temporal_id_max" set to "5" (see services 1 and 2 in Figure 9).

[0080] On the other hand, for distribution in a mode without backward compatibility, an HEVC VIDEO descriptor is fixedly inserted into the ES loop corresponding to the basic stream in the PMT. In this HEVC VIDEO descriptor, "level_idc" is set to "156" and "temporal_id_max" is set to "5" (see Service 3 in Figure 9).

[0081] The TS formatter 104 also assigns a fixed PID (=PID_1) to the basic stream and a fixed PID (=PID_2) to the extended stream.

[0082] The TS formatter 104 also inserts component descriptors, each containing frame rate information and compatibility information, into the container layer for each video stream of each program (event), and associates the HEVC VIDEO descriptor with the component descriptor using a component tag (see FIG. 9). This component descriptor is placed in the EIT.

[0083] The transmitting unit 105 transmits the transport stream TS obtained by the TS formatter 104 to the receiving device 200 via broadcast waves or network packets.

[0084] The operation of the transmitting device 100 shown in Fig. 10 will be briefly described. The encoder 102 selectively receives input of moving image data VDA of a 50 Hz program and moving image data VDB of a 100 Hz program. The encoder 102 performs hierarchical coding on the input moving image data to generate a video stream. This video stream is temporarily stored in a compressed data buffer (cpb) 103.

[0085] Here, when distribution is performed in a mode with HFR backward compatibility, a basic stream containing coded image data of pictures in all layers is generated for video data VDA of a 50 Hz program (see Figure 2(a)). Also, in this case, a basic stream containing coded image data of pictures in lower layers and an extended stream containing coded image data of pictures in higher layers are generated for video data VDB of a 100 Hz program (see Figure 2(b)).

[0086] Furthermore, when distribution is performed in a mode that does not have HFR backward compatibility, an elementary stream containing coded image data of pictures in all layers is generated for video data VDA of a 50 Hz program (see Figure 2(a)). In this case, an elementary stream containing coded image data of pictures in all layers is also generated for video data VDB of a 100 Hz program (see Figure 2(c)).

[0087] In the TS formatter 104, the video stream stored in the compressed data buffer 103 is read out, packetized into PES packets, and further multiplexed into transport packets, thereby obtaining a transport stream TS as a multiplexed stream.

[0088] This transport stream TS includes a video stream for a 50 Hz program and a video stream for a 100 Hz program consecutively. In a backward compatible mode, the video stream for a 50 Hz program includes only the basic stream, and the video stream for a 100 Hz program includes both the basic stream and the extended stream. In a non-backward compatible mode, the video streams for a 50 Hz program and a 100 Hz program include only the basic stream.

[0089] Furthermore, the TS formatter 104 fixes an HEVC VIDEO descriptor as a PMT descriptor into the container layer, and the value required for decoding described in the HEVC VIDEO descriptor is fixed to the largest value. In this case, in distribution in a backward compatible mode, the HEVC VIDEO descriptor is fixedly inserted into the ES loop corresponding to each of the basic stream and extended stream in the PMT. On the other hand, in distribution in a non-backward compatible mode, the HEVC VIDEO descriptor is fixedly inserted into the ES loop corresponding to the basic stream in the PMT.

[0090] Furthermore, the TS formatter 104 assigns a fixed PID (=PID_1) to the basic stream and a fixed PID (=PID_2) to the extended stream.

[0091] In addition, the TS formatter 104 inserts a component descriptor, which describes frame rate information and compatibility information, into the container layer corresponding to each video stream for each program (event), and associates the HEVC VIDEO descriptor with the component descriptor using a component tag.

[0092] The transport stream TS obtained by the TS formatter 104 is sent to the transmitting unit 105. In the transmitting unit 105, the transport stream TS obtained by the TS formatter 104 is transmitted to the receiving device 200 via broadcast waves or network packets.

[0093] Figure 11 shows an example of the state changes of the sequence parameter set (SPS), HEVC video descriptor (HEVC_video_descriptor), and component descriptor (Component_descriptor) when switching from a 50 Hz program to a 100 Hz program in a backward compatible mode of distribution.

[0094] Only the base stream exists as a video stream for a 50 Hz program. This base stream contains coded image data for pictures of all layers from 0 to 4. In this case, in the SPS of the base stream, "general_level_idc" is set to "level5.1" and "sps_max_sublayer_minus1" is set to "4".

[0095] The video streams for a 100 Hz program consist of a base stream and an enhanced stream. The base stream contains coded image data for pictures in layers 0 to 4, and the enhanced stream contains coded image data for pictures in layer 5. In this case, in the SPS of the base stream, "general_level_idc" is set to "level5.2" and "sps_max_sublayer_minus1" is set to "5".

[0096] Just before the start of the transmission period of a 50 Hz program, a PMT corresponding to that 50 Hz program is inserted into the container layer. Here, although only the basic stream exists as the video stream of the 50 Hz program, an HEVC VIDEO descriptor corresponding to the basic stream and an HEVC VIDEO descriptor corresponding to the extended stream are inserted into the PMT. This is because the PMT descriptor is inserted permanently in this technology.

[0097] In this case, in the HEVC VIDEO descriptor corresponding to the basic stream, "level_idc" is set to "level5.1", furthermore, "temporal_id_min" is set to "0", and "temporal_id_max" is set to "4". Also, in the HEVC VIDEO descriptor corresponding to the extended stream, "level_idc" is set to "level5.2", furthermore, "temporal_id_min" is set to "5", and "temporal_id_max" is set to "5".

[0098] There is a component descriptor associated with the HEVC VIDEO descriptor corresponding to the elementary stream, where "stream_content_ext" is set to "0x0" and "component_type" is set to "0x05", indicating the presence of a single 50Hz stream (elementary stream).

[0099] Similarly, during the transmission period of a 50 Hz program, just before the start of the transmission period of a 100 Hz program, a PMT corresponding to that 100 Hz program is inserted into the container layer. Here, the video stream of the 100 Hz program consists of a basic stream and an extended stream, and an HEVC VIDEO descriptor corresponding to the basic stream and an HEVC VIDEO descriptor corresponding to the extended stream are inserted into the PMT.

[0100] In this case, the content of each HEVC VIDEO descriptor is the same as the content of each HEVC VIDEO descriptor in the PMT corresponding to a 50 Hz program. That is, in the HEVC VIDEO descriptor corresponding to the basic stream, "level_idc" is set to "level5.1", "temporal_id_min" is set to "0", and "temporal_id_max" is set to "4". In addition, in the HEVC VIDEO descriptor corresponding to the extended stream, "level_idc" is set to "level5.2", "temporal_id_min" is set to "5", and "temporal_id_max" is set to "5".

[0101] There is a first component descriptor associated with the HEVC VIDEO descriptor corresponding to the elementary stream, and a second component descriptor associated with the HEVC VIDEO descriptor corresponding to the extended stream. In the first component descriptor, "stream_content_ext" is set to "0x0" and "component_type" is set to "0x05", indicating the presence of a single 50 Hz stream (elementary stream). In the second component descriptor, "stream_content_ext" is set to "0x1" and "component_type" is set to "0x09", indicating the presence of an extended stream that combines with the elementary stream to form a 100 Hz stream.

[0102] In this way, in this technology, a PMT descriptor (HEVC VIDEO descriptor) is fixedly inserted into the container layer. In other words, the PMT descriptor corresponding to a 50 Hz program and the PMT descriptor corresponding to a 100 Hz program are made exactly the same. The value required for decoding described in this PMT descriptor is fixed to the maximum value.

[0103] 12 shows an example of the structure of a transport stream TS when transmitting a 50 Hz program. In this example, there is a PES packet "video PES1" of the elementary stream identified by PID1. Here, PID1 is a fixed PID for the elementary stream.

[0104] The coded image data of each picture in the basic stream contains NAL units such as AUD, VPS, SPS, PPS, SLICE, and SEI. As mentioned above, the header of each NAL unit contains "nuh_temporal_id_plus1," which indicates the layer identification information (temporal_id) of the picture. The SPS contains "general_level_idc," which specifies the level of the video stream. Here, "general_level_idc" is set to "level5.1."

[0105] The transport stream TS also contains a PMT (Program Map Table) as PSI (Program Specific Information). PSI is information that describes which program each elementary stream contained in the transport stream belongs to. The PMT contains a program loop that describes information related to the entire program. The PMT also contains an ES loop that contains information related to each elementary stream. In this configuration example, there is a video ES loop (video ES1 loop) that corresponds to an actually existing basic stream (video PES1), and a video ES loop (video ES2 loop) that corresponds to an actually non-existent extended stream (video PES2).

[0106] In the video ES loop (video ES1 loop), information such as stream type and PID (packet identifier) ​​is arranged corresponding to the elementary stream (video PES1), and a descriptor describing information related to the video stream is also arranged. The value of "Stream_type" of the elementary stream is set to "0x24", and the PID information indicates PID1 assigned to the PES packet "video PES1" of the elementary stream as described above.

[0107] Additionally, an HEVC VIDEO descriptor and a stream identifier descriptor are inserted into the video ES1 loop. In this HEVC VIDEO descriptor, "level_idc" is set to "level5.1". Also, "temporal_id_min" is set to "0" and "temporal_id_max" is set to "4". The stream identifier descriptor associates the HEVC VIDEO descriptor with the component descriptor under the EIT using the component tag "Component_tag1".

[0108] In the video ES loop (video ES2 loop), information such as stream type and PID (packet identifier) ​​is arranged corresponding to the extended stream (video PES2), and a descriptor describing information related to the video stream is also arranged. The value of "Stream_type" of the extended stream is set to "0x25", and the PID information indicates PID2 assigned to the PES packet "video PES2" of the extended stream as described above.

[0109] Additionally, an HEVC VIDEO descriptor and a stream identifier descriptor are inserted into the video ES2 loop. In this HEVC VIDEO descriptor, "level_idc" is set to "level5.2". Also, "temporal_id_min" is set to "5", and "temporal_id_max" is set to "5". The stream identifier descriptor associates the HEVC VIDEO descriptor with the component descriptor (component_descriptor) under the EIT using the component tag "Component_tag2".

[0110] Figure 13 shows an example of the structure of a transport stream TS when transmitting a 100 Hz program. In this example, there is a basic stream PES packet "video PES1" identified by PID1 and an extended stream PES packet "video PES2" identified by PID2. Here, PID1 is a fixed PID for the basic stream, and PID2 is a fixed PID for the extended stream.

[0111] The coded image data of each picture in the elementary stream includes NAL units such as AUD, VPS, SPS, PPS, SLICE, SEI, etc. As described above, the header of each NAL unit contains "nuh_temporal_id_plus1," which indicates the layer identification information (temporal_id) of the picture.

[0112] The SPS contains "general_level_idc," which is the level specification value for the video stream. Here, "general_level_idc" is set to "level5.2." In addition, the pictures belonging to each layer indicated by "temporal_id" are grouped together as sublayers (sub_layers) in the SPS, and "sublayer_level_presented_flag" is set to "1," which inserts "sublayer_level_idc," which is the level specification value for the bitrate for each sublayer. Here, "sublayer_level_idc[4]" is set to "level5.1."

[0113] On the other hand, the coded image data of each picture in the extended stream includes NAL units such as AUD, PPS, SLICE, etc. The header of each NAL unit contains "nuh_temporal_id_plus1," which indicates the layer identification information (temporal_id) of the picture.

[0114] The transport stream TS also contains a PMT (Program Map Table) as PSI (Program Specific Information). PSI is information that describes which program each elementary stream contained in the transport stream belongs to. The PMT contains a program loop that describes information related to the entire program. The PMT also contains an ES loop that contains information related to each elementary stream. In this configuration example, there is a video ES loop (video ES1 loop) that corresponds to the basic stream (video PES1) and a video ES loop (video ES2 loop) that corresponds to the extended stream (video PES2).

[0115] In the video ES loop (video ES1 loop), information such as stream type and PID (packet identifier) ​​is arranged corresponding to the elementary stream (video PES1), and a descriptor describing information related to the video stream is also arranged. The value of "Stream_type" of the elementary stream is set to "0x24", and the PID information indicates PID1 assigned to the PES packet "video PES1" of the elementary stream as described above.

[0116] Additionally, an HEVC VIDEO descriptor and a stream identifier descriptor are inserted into the video ES1 loop. In this HEVC VIDEO descriptor, "level_idc" is set to "level5.1". Also, "temporal_id_min" is set to "0" and "temporal_id_max" is set to "4". The stream identifier descriptor associates the HEVC VIDEO descriptor with the component descriptor under the EIT using the component tag "Component_tag1".

[0117] In the video ES loop (video ES2 loop), information such as stream type and PID (packet identifier) ​​is arranged corresponding to the extended stream (video PES2), and a descriptor describing information related to the video stream is also arranged. The value of "Stream_type" of the extended stream is set to "0x25", and the PID information indicates PID2 assigned to the PES packet "video PES2" of the extended stream as described above.

[0118] Additionally, an HEVC VIDEO descriptor and a stream identifier descriptor are inserted into the video ES2 loop. In this HEVC VIDEO descriptor, "level_idc" is set to "level5.2". Also, "temporal_id_min" is set to "5", and "temporal_id_max" is set to "5". The stream identifier descriptor associates the HEVC VIDEO descriptor with the component descriptor (component_descriptor) under the EIT using the component tag "Component_tag2".

[0119] Figure 14 shows an example of the state changes of a conventional sequence parameter set and HEVC VIDEO descriptor, comparable to the example in Figure 11. In the conventional case, a PMT corresponding to a 50 Hz program only contains an HEVC VIDEO descriptor corresponding to the basic stream, and no HEVC VIDEO descriptor corresponding to an extended stream is inserted. From this point of view, in the conventional case, the HEVC VIDEO descriptor as a PMT descriptor is not inserted in a fixed manner. Note that the description content (element values) of each HEVC VIDEO descriptor is fixed.

[0120] FIG. 15 shows an example of state changes in the sequence parameter set (SPS), HEVC video descriptor (HEVC_video_descriptor), and component descriptor (Component_descriptor) when switching from a 50 Hz program to a 100 Hz program in a non-backward compatible mode of distribution.

[0121] Only the base stream exists as a video stream for a 50 Hz program. This base stream contains coded image data for pictures of all layers from 0 to 4. In this case, in the SPS of the base stream, "general_level_idc" is set to "level5.1" and "sps_max_sublayer_minus1" is set to "4".

[0122] Even for a video stream of a 100 Hz program, only a base stream exists. This base stream contains coded image data for pictures in layers 0 to 5. In this case, in the SPS of the base stream, "general_level_idc" is set to "level5.2" and "sps_max_sublayer_minus1" is set to "5".

[0123] Just before the start of the transmission period of a 50 Hz program, a PMT corresponding to that 50 Hz program is inserted into the container layer. This PMT contains an HEVC VIDEO descriptor corresponding to the elementary stream.

[0124] The HEVC VIDEO descriptor corresponding to this basic stream corresponds to a 50 Hz program, but like the one corresponding to a 100 Hz program described below, "level_idc" is set to "level5.2", and further, "temporal_id_min" is set to "0", and "temporal_id_max" is set to "5". This is because in this technology, the PMT descriptor is fixedly inserted and the value required for decoding described in the descriptor is fixed to the maximum value.

[0125] There is a component descriptor associated with the HEVC VIDEO descriptor corresponding to this elementary stream, where "stream_content_ext" is set to "0x0" and "component_type" is set to "0x05", indicating the presence of a single 50Hz stream (elementary stream).

[0126] Similarly, during the transmission period of a 50 Hz program, just before the start of the transmission period of a 100 Hz program, a PMT corresponding to that 100 Hz program is inserted into the container layer. An HEVC VIDEO descriptor corresponding to the elementary stream is inserted into this PMT. In the HEVC VIDEO descriptor corresponding to this elementary stream, "level_idc" is set to "level5.2", and further, "temporal_id_min" is set to "0", and "temporal_id_max" is set to "5".

[0127] There is a component descriptor associated with the HEVC VIDEO descriptor corresponding to this elementary stream, where "stream_content_ext" is set to "0x0" and "component_type" is set to "0x09", indicating the presence of a single 100Hz stream (elementary stream).

[0128] In this way, in this technology, a PMT descriptor (HEVC VIDEO descriptor) is fixedly inserted into the container layer. In other words, the PMT descriptor corresponding to a 50 Hz program and the PMT descriptor corresponding to a 100 Hz program are made exactly the same. The value required for decoding described in this PMT descriptor is fixed to the maximum value.

[0129] 16 shows an example of the structure of a transport stream TS when transmitting a 50 Hz program. In this example, there is a PES packet "video PES1" of the elementary stream identified by PID1. Here, PID1 is a fixed PID for the elementary stream.

[0130] The coded image data of each picture in the basic stream contains NAL units such as AUD, VPS, SPS, PPS, SLICE, and SEI. As mentioned above, the header of each NAL unit contains "nuh_temporal_id_plus1," which indicates the layer identification information (temporal_id) of the picture. The SPS contains "general_level_idc," which specifies the level of the video stream. Here, "general_level_idc" is set to "level5.1."

[0131] The transport stream TS also contains a PMT (Program Map Table) as PSI (Program Specific Information). PSI is information that describes which program each elementary stream contained in the transport stream belongs to. The PMT contains a program loop that describes information related to the entire program. The PMT also contains an ES loop that contains information related to each elementary stream. In this configuration example, there is a video ES loop (video ES1 loop) that corresponds to the basic stream (video PES1).

[0132] In the video ES loop (video ES1 loop), information such as stream type and PID (packet identifier) ​​is arranged corresponding to the elementary stream (video PES1), and a descriptor describing information related to the video stream is also arranged. The value of "Stream_type" of the elementary stream is set to "0x24", and the PID information indicates PID1 assigned to the PES packet "video PES1" of the elementary stream as described above.

[0133] Additionally, an HEVC VIDEO descriptor and a stream identifier descriptor are inserted into the video ES1 loop. In this HEVC VIDEO descriptor, "level_idc" is set to "level5.2". Furthermore, "temporal_id_min" is set to "0" and "temporal_id_max" is set to "5". The stream identifier descriptor associates the HEVC VIDEO descriptor with the component descriptor under the EIT using the component tag "Component_tag1".

[0134] 17 shows an example of the structure of a transport stream TS when transmitting a 100 Hz program. In this example, there is a PES packet "video PES1" of the elementary stream identified by PID1. Here, PID1 is a fixed PID for the elementary stream.

[0135] The coded image data of each picture in the elementary stream includes NAL units such as AUD, VPS, SPS, PPS, SLICE, SEI, etc. As described above, the header of each NAL unit contains "nuh_temporal_id_plus1," which indicates the layer identification information (temporal_id) of the picture.

[0136] The SPS contains "general_level_idc," which is the level specification value for the video stream. Here, "general_level_idc" is set to "level5.2." In addition, the pictures belonging to each layer indicated by "temporal_id" are grouped together as sublayers (sub_layers) in the SPS, and "sublayer_level_presented_flag" is set to "1," which inserts "sublayer_level_idc," which is the level specification value for the bitrate for each sublayer. Here, "sublayer_level_idc[4]" is set to "level5.1."

[0137] The transport stream TS also contains a PMT (Program Map Table) as PSI (Program Specific Information). PSI is information that describes which program each elementary stream contained in the transport stream belongs to. The PMT contains a program loop that describes information related to the entire program. The PMT also contains an ES loop that contains information related to each elementary stream. In this configuration example, there is a video ES loop (video ES1 loop) that corresponds to the basic stream (video PES1).

[0138] In the video ES loop (video ES1 loop), information such as stream type and PID (packet identifier) ​​is arranged corresponding to the elementary stream (video PES1), and a descriptor describing information related to the video stream is also arranged. The value of "Stream_type" of the elementary stream is set to "0x24", and the PID information indicates PID1 assigned to the PES packet "video PES1" of the elementary stream as described above.

[0139] Additionally, an HEVC VIDEO descriptor and a stream identifier descriptor are inserted into the video ES1 loop. In this HEVC VIDEO descriptor, "level_idc" is set to "level5.2". Furthermore, "temporal_id_min" is set to "0" and "temporal_id_max" is set to "5". The stream identifier descriptor associates the HEVC VIDEO descriptor with the component descriptor under the EIT using the component tag "Component_tag1".

[0140] Figure 18 shows an example of the state changes of a conventional sequence parameter set and HEVC VIDEO descriptor, comparable to the example in Figure 15. The description content of the HEVC VIDEO descriptor corresponding to the elementary stream corresponds to the description content of the SPS in the video stream of a 50 Hz program. That is, "level_idc" is set to "level5.1". Also, "temporal_id_min" is set to "0", and "temporal_id_max" is set to "4". From this point of view, in the conventional case, the description content (element values) of the HEVC VIDEO descriptor as a PMT descriptor is not fixed to the maximum value required for decoding.

[0141] "Configuration of receiving device" 19 shows an example of the configuration of a receiving device 200. This receiving device 200 has a CPU (Central Processing Unit) 201, a receiving section 202, a TS analyzing section (demultiplexer) 203, and a compressed data buffer (cpb: coded picture buffer) 204. This receiving device 200 also has a decoder 205, an uncompressed data buffer (dpb: decoded picture buffer) 206, a post-processing section 207, and a display section 208. The CPU 201 constitutes a control section and controls the operation of each section of the receiving device 200.

[0142] The receiving unit 202 receives the transport stream TS transmitted by broadcast waves or network packets from the transmitting device 100. The TS analyzing unit 203 extracts the streams constituting the video stream contained in the transport stream TS by filtering with a PID filter, and sends the extracted streams to a compressed data buffer (cpb: coded picture buffer) 204.

[0143] In this case, a fixed PID is assigned to each basic stream and extended stream. Therefore, even if the service is switched, for example, from a 50 Hz program (50p service) to a 100 Hz program (100p service) or vice versa, there is no need to change the settings of the filters extracting each stream. This prevents display muting and enables seamless display.

[0144] 20 shows an example of the configuration of the TS analyzer 203. The TS analyzer 203 includes a PID filter 231, multiplexing buffers 232_0 to 232_n, 232_null, and 232_c, a section filter 233, and a PMT analyzer 234.

[0145] The PID filter 231 passes section data and null packets contained in the transport stream TS based on the PID. In the illustrated example, the PID value of the section data is PID_c, and the PID of the null packets is PID_null. Null packets do not have their own PID value, and may be transmitted so as to be inserted into the video PID stream. This allows the receiver's multiplexing buffer to detect null packets and use them to determine when switching occurs.

[0146] The PID filter 231 also passes TS packets that are included in the transport stream TS and correspond to program numbers corresponding to broadcast service channels based on the set PID values. In the illustrated example, the PID values ​​that can be set for TS packets are PID_0 to PID_n.

[0147] The multiplexing buffers 232_0 to 232_n, 232_null, and 232_c temporarily store the TS packets, section data, and null packets that have passed through the PID filter 231. That is, the multiplexing buffers are managed by PID value in the TS analysis unit 203. The section filter 233 extracts a program map table (PMT) from the section data stored in the multiplexing buffer 232_c based on the PID value.

[0148] The PMT analysis unit 234 analyzes the PMT extracted by the section filter 233, and sets the PID value of the TS packet to be passed in the PID filter 231 based on the analysis result.

[0149] For example, consider the case of a program (event) that is distributed in a backward compatible mode (see services 1 and 2 in FIG. 9 ) and that only has a single 50 Hz stream (basic stream). In this case, both a receiving device 200 that can only receive 50p broadcasts and a receiving device 200 that can also receive 100p broadcasts set "PID1," a fixed PID value assigned to the basic stream, as PID_0. Note that a receiving device 200 that can receive 100p broadcasts may set "PID1," a fixed PID value assigned to the basic stream, as PID_0, and may set "PID2," a fixed PID value assigned to the extended stream, as PID_1.

[0150] Also, for example, consider a case where distribution is performed in a backward-compatible mode (see services 1 and 2 in FIG. 9 ) and there are two video streams: a single 50 Hz stream (basic stream) and an extended stream that combines with the basic stream to make 100 Hz. In this case, a receiving device 200 that can only receive 50p broadcasts sets PID_0 to "PID1," which is the fixed PID value assigned to the basic stream. In this case, a receiving device 200 that can also receive 100p broadcasts sets PID_0 to "PID1," which is the fixed PID value assigned to the basic stream, and sets PID_1 to "PID2," which is the fixed PID value assigned to the extended stream.

[0151] Also, for example, consider the case of a program (event) that is distributed in a mode without backward compatibility (see service 3 in FIG. 9) and has a single stream (basic stream) of 50 Hz or 100 Hz. In this case, since the receiving device 200 that can only receive 50p broadcasts is not eligible for reception, no PID values ​​are set for PID_0 and PID_1. In addition, in this case, for receiving devices 200 that can also receive 100p broadcasts, "PID1," which is the fixed PID value assigned to the basic stream, is set as PID_0.

[0152] Here, we will explain program recognition by descriptor analysis in the PMT analyzer 234. First, we will explain distribution in a backward compatible mode. The PMT analyzer 234 identifies information on a program (event) basis in the distribution stream from the "component_type" and "stream_type_ext" of the component descriptor.

[0153] The component descriptor is associated with the HEVC VIDEO descriptor in the PMT by the component tag (component_tag) via the stream identifier descriptor. Therefore, when a 50 Hz program is distributed, the PMT analyzer 234 recognizes that "level_idc" = "level5.1" and "temporal_id_max" = "4" in the HEVC VIDEO descriptor of "PID1" correspond to "stream_content_ext" = "0x0" and "component_type" = "0x05" in the component descriptor, and that "level_idc" = "level5.1" and "temporal_id_max" = "4" in the UHD 50 Hz distribution stream.

[0154] Furthermore, the PMT analysis unit 234 recognizes that when a 100 Hz program is distributed, "level_idc"="level5.1" and "temporal_id_max"="4" in the HEVC VIDEO descriptor of PID1" correspond to "stream_content_ext"="0x0" and "component_type"="0x05" in the component descriptor, and that in the UHD 50 Hz distribution stream, "level_idc"="level5.1" and "temporal_id_max"="4".

[0155] At the same time, the PMT analysis unit 234 recognizes that "level_idc"="level5.2" and "temporal_id_max"="5" in the HEVC VIDEO descriptor of "PID2" correspond to "stream_content_ext"="0x1" and "component_type"="0x09" in the component descriptor, and that the UHD 100Hz distribution stream has "level_idc"="level5.2" and "temporal_id_max"="5".

[0156] In this case, since there are two component descriptors at the same time, the PMT analysis unit 234 recognizes that this program is being distributed in two streams in a 50 Hz receiver compatible mode.

[0157] Next, distribution in a mode without backward compatibility will be described. The PMT analysis unit 234 identifies information for each program (event) of the distribution stream from the "component_type" and "stream_type_ext" of the component descriptor.

[0158] The component descriptor is associated with the HEVC VIDEO descriptor in the PMT by the component tag (component_tag) via the stream identifier descriptor. Therefore, the PMT analyzer 234 recognizes that when a 50 Hz program is distributed, "level_idc" = "level5.2" and "temporal_id_max" = "5" in the HEVC VIDEO descriptor of "PID1" correspond to "stream_content_ext" = "0x0" and "component_type" = "0x05" in the component descriptor, and that in the UHD 50 Hz distribution stream, "level_idc" = "level5.1" and "temporal_id_max" = "4".

[0159] Furthermore, the PMT analysis unit 234 recognizes that when a 100 Hz program is distributed, the “level_idc”="level5.2" and “temporal_id_max”="5" in the HEVC VIDEO descriptor of PID1" correspond to “stream_content_ext”="0x0" and “component_type”="0x09" in the component descriptor, and that this is a UHD 100 Hz distribution stream with one stream, with “level_idc”="level5.2" and “temporal_id_max”="5".

[0160] In this case, the presence of one component descriptor at the same time allows the PMT analysis unit 234 to recognize that this program is being distributed as one stream in the 100 Hz receiver incompatible mode.

[0161] 20, the TS analysis unit 203 transfers the TS packets accumulated in the multiplexing buffers 232_0 to 232_n by PID value to the compressed data buffer 204. For example, in the case of delivery in a backward compatible mode (see services 1 and 2 in FIG. 9) and the receiving device 200 can only receive 50p broadcasts, the TS packets related to the basic stream accumulated in the multiplexing buffer 232_0 are transferred to the compressed data buffer 204.

[0162] Also, for example, in the case of a receiving device 200 that is distributed in a backward compatible mode (see services 1 and 2 in Figure 9) and can also receive 100p broadcasts, the TS packets related to the basic stream stored in the multiplexing buffer 232_0 and the TS packets related to the extended stream stored in the multiplexing buffer 232_1 are transferred to the compressed data buffer 204.

[0163] Furthermore, in the case of distribution in a mode without backward compatibility (see service 3 in FIG. 9) and the receiving device 200 can also receive 100p broadcasting, the TS packets related to the basic stream stored in the multiplexing buffer 232_0 are transferred to the compressed data buffer 204. Note that in the case of distribution in a mode without backward compatibility (see service 3 in FIG. 9) and the receiving device 200 can only receive 50p broadcasting, the TS packets are not to be received, so they are not stored in the multiplexing buffer 232_0 and the TS packets are not transferred to the compressed data buffer 204.

[0164] 19 , the compressed data buffer (cpb) 204 temporarily stores the TS packets, and therefore the coded image data of each picture, transferred from the TS analysis unit 203. The decoder 205 reads and decodes the coded image data of each picture stored in the compressed data buffer 204 at the decoding timing given by the DTS (Decoding Time Stamp) of that picture, and sends the decoded data to the uncompressed data buffer (dpb) 206.

[0165] An uncompressed data buffer (dpb) 206 temporarily stores image data of each picture decoded by the decoder 205. A post-processing unit 207 performs processing to adjust the frame rate of the image data of each picture sequentially read out from the uncompressed data buffer (dpb) 206 at the display timing given by a PTS (Presentation Time Stamp) to match the display capability.

[0166] For example, if the frame rate of the image data of each picture after decoding is 50 fps and the display capability is 100 fps, the post-processing unit 207 performs interpolation processing on the image data of each picture after decoding so that the temporal resolution is doubled, and sends the image data to the display unit 208 as 100 fps image data. Note that post-processing is not limited to frame frequency; for example, if the decoder output is HD resolution, post-processing may also convert the resolution to a higher resolution by resolution conversion. In this case, if the decoder output is already UHD resolution, resolution conversion is bypassed.

[0167] The display unit 208 is configured with, for example, an LCD (Liquid Crystal Display), an organic EL (Organic Electro-Luminescence) panel, etc. Note that the display unit 208 may be an external device connected to the receiving device 200.

[0168] The operation of the receiving device 200 shown in Fig. 19 will be briefly described. The receiving unit 202 receives the transport stream TS transmitted from the transmitting device 100 via broadcast waves or network packets. This transport stream TS is sent to the TS analyzing unit 203. The TS analyzing unit 203 extracts the streams constituting the video stream contained in the transport stream TS by filtering with a PID filter and sends the extracted streams to a compressed data buffer (cpb) 204.

[0169] In this case, the stream to be filtered is controlled depending on whether the distribution is in a backward compatible mode or a non-backward compatible mode, and whether the receiving device 200 can only receive 50p broadcasts or can also receive 100p broadcasts.

[0170] In this embodiment, the PMT descriptor (HEVC VIDEO descriptor) is inserted in a fixed manner, and the value required for decoding described in this descriptor is fixed to a maximum value. However, the program is properly recognized by analyzing the component descriptor associated with the HEVC VIDEO descriptor by the component tag.

[0171] In the decoder 205, the coded image data of each picture stored in the compressed data buffer 204 is decoded at the decoding timing of that picture, sent to the uncompressed data buffer (dpb) 206, and temporarily stored therein. Then, the image data of each picture is sequentially read out from the uncompressed data buffer (dpb) 206 at the display timing and sent to the post-processing unit 207. In the post-processing unit 207, interpolation or sub-sampling is performed on the image data of each picture to match the frame rate with the display capability. The image data of each picture processed by the post-processing unit 207 is supplied to the display unit 208, where the moving image is displayed.

[0172] 21(a) shows an example of an EPG display performed in the receiving device 200, for example, based on a user operation. Frame rate information and compatibility information for each program (event) are displayed in the column for each program according to the description content of the component descriptor corresponding to that program. For example, for a program that starts at 6:00:00 on channel 1 (service 1), "UHD 50Hz" is displayed in the column for that program, indicating that it is a 50 Hz program.

[0173] Also, for example, in the case of a program that starts at 9:00:00 on channel 1 (service 1), the column for that program will say "UHD 100Hz compatible distribution," which indicates that although it is a 100Hz program, it is a compatible distribution and can be received even on a receiving device 200 that can only receive 50p broadcasts. Figure 21(b) shows an example of a UI display when this program is selected on a receiving device 200 that can only receive 50p broadcasts.

[0174] Also, for example, in the case of a program that starts at 9:00:00 on channel 3 (service 3), the column for that program will say "UHD 100Hz incompatible distribution," indicating that it is a 100Hz program, but that it is distributed incompatible, and that it cannot be received by a receiving device 200 that can only receive 50p broadcasts. Fig. 21(c) shows an example of a UI display when this program is selected on a receiving device 200 that can only receive 50p broadcasts, for example.

[0175] As described above, in the transmission / reception system 10 shown in Fig. 1, a PMT descriptor (HEVC VIDEO descriptor) describing values ​​required for decoding is fixedly inserted into the container layer, and the value required for decoding is fixed to the maximum value. This facilitates operation on the transmitting side, and enables the receiving side to easily recognize the maximum value required for decoding from the container layer.

[0176] 1, a component descriptor describing frame rate information and compatibility information corresponding to each video stream for each event is inserted into the container layer. Therefore, the receiving side can accurately determine the status of the received video stream and perform appropriate processing by combining the contents of the HEVC VIDEO descriptor and the component descriptor.

[0177] <2. Modifications> In the above-described embodiment, the transmission / reception system 10 including the transmission device 100 and the reception device 200 is illustrated, but the configuration of the transmission / reception system to which the present technology can be applied is not limited to this. For example, the reception device 200 may be configured as a set-top box and a monitor connected via a digital interface such as HDMI (High-Definition Multimedia Interface). Note that "HDMI" is a registered trademark. In addition, an example has been shown in which a basic stream or an extended stream is identified based on the values ​​of the "component_type" and "stream_content_ext" elements of the component descriptor when performing compatible distribution, but the present invention is not limited to this, and a basic stream or an extended stream may be identified based only on the value of "component_type".

[0178] In addition, in the above-described embodiment, an example has been shown in which the container is a transport stream (MPEG-2 TS). However, the present technology can be similarly applied to a system configured to distribute to a receiving terminal using a network such as the Internet. In Internet distribution, distribution is often performed using containers in MP4 or other formats. In other words, containers in various formats such as the transport stream (MPEG-2 TS) adopted in the digital broadcasting standard and MP4 used in Internet distribution are applicable.

[0179] The present technology can also be configured as follows. (1) an image encoding unit that hierarchically encodes image data of each picture constituting video data and generates a video stream having encoded image data of the pictures of each layer; a transmitting unit that transmits a container in a predetermined format including the video stream; A descriptor containing the values ​​required for decoding is inserted into the container layer. The value required for the above decoding is fixed to the maximum magnitude value. Transmitting device. (2) The values ​​required for the decoding are the level specification value of the video stream and the maximum and minimum values ​​of the hierarchy of the coded image data of each picture included in the video stream. The transmitting device according to (1) above. (3) the image encoding unit encodes video data at a first frame rate to generate a first video stream, and encodes video data at a second frame rate higher than the first frame rate to generate a second video stream; The transmitting unit transmits the container in the predetermined format that successively includes the first video stream and the second video stream generated by the image encoding unit. The transmitting device according to (1) or (2). (4) The first video stream is composed of a basic stream having coded image data of pictures of all layers; The second video stream is composed of a basic stream having coded image data of pictures on the lower layer side and an extended stream having coded image data of pictures on the higher layer side. The transmitting device according to (3) above. (5) The hierarchy of the picture included in the extended stream is a fixed hierarchy that is higher than the maximum hierarchy that the picture in the basic stream can have. The transmitting device according to (4) above. (6) The first video stream and the second video stream each consist of a basic stream having coded image data of pictures of all layers. The transmitting device according to (3) above. (7) The container is a transport stream, The descriptor is an HEVC VIDEO descriptor, A component descriptor describing frame rate information and compatibility information is inserted into the container layer in correspondence with each of the video streams for each program. The transmitting device according to any one of (1) to (6). (8) an image encoding step in which an image encoding unit hierarchically encodes image data of each picture constituting the video image data to generate a video stream having encoded image data of the pictures of each layer; a transmitting step in which a transmitting unit transmits a container in a predetermined format including the video stream; A descriptor containing the values ​​required for decoding is inserted into the container layer. The value required for the above decoding is fixed to the maximum magnitude value. Sending method. (9) A receiving unit for receiving a container in a predetermined format including a video stream having coded image data of pictures of each layer generated by hierarchical coding of image data of each picture constituting moving image data, A descriptor containing the values ​​required for decoding is fixedly inserted into the layer of the container. The value required for the above decoding is fixed to the maximum value, The decoder further includes a control unit that controls the decoding process of the video stream based on the contents of the descriptor. Receiving device. (10) The container is a transport stream, The descriptor is an HEVC VIDEO descriptor, a component descriptor, in which frame rate information and compatibility information are described, corresponding to each of the video streams for each program is inserted into a layer of the container; The control unit controls the decoding process of the video stream based on the description content of the HEVC VIDEO descriptor and the description content of the component descriptor. The receiving device according to (9) above. (11) The container is a transport stream, The descriptor is an HEVC VIDEO descriptor, a component descriptor, in which frame rate information and compatibility information are described, corresponding to each of the video streams for each program is inserted into a layer of the container; The control unit controls the display of frame rate information and compatibility information of each program in the column of each program in the EPG display based on the description content of the component descriptor. The receiving device according to (9) or (10) above. (12) The container is a transport stream, The descriptor is an HEVC VIDEO descriptor, a component descriptor, in which frame rate information and compatibility information are described, corresponding to each of the video streams for each program is inserted into a layer of the container; The control unit controls so that when a predetermined program is selected, a UI is displayed based on the frame rate information and compatibility information of the predetermined program. The receiving device according to any one of (9) to (11). (13) A receiving step is provided in which a receiving unit receives a container in a predetermined format including a video stream having coded image data of pictures of each layer generated by hierarchical coding of image data of each picture constituting moving image data, A descriptor containing the values ​​required for decoding is fixedly inserted into the layer of the container. The value required for the above decoding is fixed to the maximum value, The method further includes a control step in which a control unit controls a decoding process of the video stream based on the description content of the descriptor. Receiving method.

[0180] The main feature of this technology is that it simplifies operation on the sending side and makes it easy to recognize the maximum value required for decoding on the receiving side in the container layer by fixedly inserting a PMT descriptor (HEVC VIDEO descriptor) that describes the value required for decoding in the container layer and fixing this value required for decoding to the maximum value (see Figures 11 and 15). [Explanation of symbols]

[0181] 10. Transmitting and receiving system 100 Transmitting device 101 CPU 102 Encoder 103 Compressed Data Buffer (cpb) 104···TS formatter (multiplexer) 105 Transmitter 200 Receiving device 201 CPU 202 Receiving unit 203 TS analysis unit (demultiplexer) 204 Compressed Data Buffer (cpb) 205... Decoder 206 Uncompressed Data Buffer (dpb) 207 Post-processing section 208...Display section 231···PID filter 232_0~232_n, 232_null, 232_c... Multiplexing buffer 233···Section Filter 234...PMT analysis department

Claims

1. an image encoding unit that hierarchically encodes image data of each picture constituting moving image data, and generates a video stream having encoded image data of the pictures of each hierarchy; a transmitting unit that transmits a container in a predetermined format including the video stream; A descriptor containing the values ​​required for decoding is inserted into the container layer. The value required for the above decoding is fixed to the maximum magnitude value. Transmitting device.

2. The values ​​required for the decoding are the level designation value of the video stream and the maximum and minimum values ​​of the hierarchy of the coded image data of each picture included in the video stream. The transmitting device according to claim 1 .

3. the image encoding unit encodes moving image data at a first frame rate to generate a first video stream, and encodes moving image data at a second frame rate higher than the first frame rate to generate a second video stream; The transmitting unit transmits the container in the predetermined format that successively includes the first video stream and the second video stream generated by the image encoding unit. The transmitting device according to claim 1 .

4. the first video stream is made up of elementary streams having coded image data of pictures of all layers; The second video stream is composed of a basic stream having coded image data of pictures on the lower layer side and an extended stream having coded image data of pictures on the higher layer side. The transmitting device according to claim 3 .

5. The hierarchy of the pictures included in the extension stream is a fixed hierarchy that is higher than the maximum hierarchy that the pictures in the basic stream can have. The transmitting device according to claim 4.

6. The first video stream and the second video stream each consist of an elementary stream having coded image data of pictures of all layers. The transmitting device according to claim 3 .

7. the container is a transport stream, The descriptor is a HEVC VIDEO descriptor, A component descriptor describing frame rate information and compatibility information is inserted into the container layer in correspondence with each of the video streams for each program. The transmitting device according to claim 1 .

8. an image encoding step in which an image encoding unit hierarchically encodes image data of each picture constituting the video data to generate a video stream having encoded image data of the pictures of each hierarchy; a transmitting step in which a transmitting unit transmits a container in a predetermined format including the video stream; A descriptor containing the values ​​required for decoding is inserted into the container layer. The value required for the above decoding is fixed to the maximum magnitude value. Sending method.

9. a receiving unit for receiving a container in a predetermined format including a video stream having coded image data of pictures of each layer generated by hierarchical coding of image data of each picture constituting moving image data; A descriptor containing the values ​​required for decoding is fixedly inserted into the layer of the container. The value required for the above decoding is fixed to the maximum value, The decoder further includes a control unit that controls the decoding process of the video stream based on the contents of the descriptor. Receiving device.

10. the container is a transport stream, The descriptor is a HEVC VIDEO descriptor, a component descriptor, in which frame rate information and compatibility information are described, corresponding to each of the video streams for each program is inserted into a layer of the container; The control unit controls the decoding process of the video stream based on the description content of the HEVC VIDEO descriptor and the description content of the component descriptor.

10. The receiving device according to claim 9.

11. the container is a transport stream, The descriptor is a HEVC VIDEO descriptor, a component descriptor, in which frame rate information and compatibility information are described, corresponding to each of the video streams for each program is inserted into a layer of the container; The control unit controls the display of frame rate information and compatibility information of each program in the column of each program on the EPG display based on the description content of the component descriptor.

10. The receiving device according to claim 9.

12. the container is a transport stream, The descriptor is a HEVC VIDEO descriptor, a component descriptor, in which frame rate information and compatibility information are described, corresponding to each of the video streams for each program is inserted into a layer of the container; The control unit controls, when a predetermined program is selected, to display a UI based on the frame rate information and compatibility information of the predetermined program.

10. The receiving device according to claim 9.

13. a receiving step in which a receiving unit receives a container in a predetermined format including a video stream having coded image data of pictures of each layer generated by hierarchical coding of image data of each picture constituting moving image data; A descriptor containing the values ​​required for decoding is fixedly inserted into the layer of the container. The value required for the above decoding is fixed to the maximum value, The method further includes a control step in which a control unit controls a decoding process of the video stream based on the description content of the descriptor. Receiving method.

Images