Data generation device, data output device, encoding device, and decoding device

Abstract

To realize backward compatibility.SOLUTION: A data generation device generates a video elementary stream with a second luminance dynamic range wider than a first luminance dynamic range, the video elementary stream having reproduction compatibility with a first device that does not support reproduction of video having the second luminance dynamic range but supports reproduction of video having the first luminance dynamic range. The video elementary stream includes: VUI for storing first transfer function information for identifying a first OETF to be referred to by the first device when the first device decodes the video elementary stream; and SEI for storing second transfer function information for identifying a second OETF to be referred to by a second device supporting reproduction of video having the second luminance dynamic range when the second device decodes the video elementary stream.SELECTED DRAWING: Figure 13

Description

Technical Field

[0001] The present invention relates to a data generation method, a data reproduction method, a data generation device, and a data reproduction device.

Background Art

[0002] As technologies for generating, encoding, and multiplexing video, there are the technologies described in Non-Patent Documents 1 to 3.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Non-Patent Document 2

Non-Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the generation of such video data, although new methods are constantly being devised, it is desired to achieve backward compatibility with conventional devices.

[0005] Therefore, an object of the present invention is to provide a data generation method, a data reproduction method, a data generation apparatus, or a data reproduction apparatus that can achieve backward compatibility.

Means for Solving the Problems

[0006] In order to achieve the above object, a data generation apparatus according to an aspect of the present invention is a video elementary stream having a second luminance dynamic range wider than a first luminance dynamic range, which does not support reproduction of an image having the second luminance dynamic range and is compatible with reproduction on a first device that supports reproduction of an image having the first luminance dynamic range. The data generation apparatus generates a video elementary stream, and includes an encoding unit that generates the video elementary stream by performing encoding compliant with a video encoding standard. The video elementary stream includes VUI (video usability information) that stores first transfer function information for specifying a first OETF (Opto-Electronic Transfer Function) referenced by the first device when the first device decodes the video elementary stream, and SEI (supplemental enhancement information) that stores second transfer function information for specifying a second OETF referenced by a second device when the second device that supports reproduction of an image having the second luminance dynamic range decodes the video elementary stream. The VUI is included in an SPS (Sequence Parameter Set).

[0007] Note that these general or specific aspects may be implemented by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, or may be implemented by any combination of a system, a method, an integrated circuit, a computer program, and a recording medium.

Advantages of the Invention

[0008] The present invention can provide a data generation method, a data reproduction method, a data generation apparatus, or a data reproduction apparatus that can achieve backward compatibility.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Embodiments for Carrying Out the Invention

[0010] (Findings on which the present invention is based) As a method corresponding to a luminance range in which the maximum luminance value is expanded in order to represent bright light such as specular reflection light that cannot be represented by the current TV signal with a more realistic brightness while maintaining the dark gradation in the conventional video, HDR (High Dynamic Range) has attracted attention. Specifically, the method of the luminance range corresponding to the conventional TV signal is called SDR (Standard Dynamic Range), and while the maximum luminance value was 100 nit, in HDR, it is assumed that the maximum luminance value is expanded up to 1000 nit or more.

[0011] On the other hand, it is desired that video data corresponding to such HDR can be played back even on a playback device that only supports the conventional SDR. That is, video data that can play back HDR video on an HDR-compatible playback device and SDR video on an SDR-compatible playback device is desired.

[0012] A data generation method according to an aspect of the present invention is a data generation method for generating video data having a second luminance dynamic range wider than a first luminance dynamic range, which is compatible with playback on a first device that does not support playback of video having the second luminance dynamic range and supports playback of video having the first luminance dynamic range. The method includes: generating a video signal included in the video data using a second OETF (Opto-Electrical Transfer Function) referred to by a second device when the second device that supports playback of video having the second luminance dynamic range decodes the video data; storing first transfer function information for specifying a first OETF referred to by the first device when the first device decodes the video data in VUI (Video Usability Information) in the video data; and storing second transfer function information for specifying the second OETF in SEI (Supplemental enhancement information) in the video data.

[0013] According to this, in a device that only supports playback of video with a first luminance dynamic range, video data can be played back using the first transfer function information, and in a device that supports playback of video with a second luminance dynamic range, video data can be played back using the second function information. Thus, the data generation method can generate backward-compatible video data.

[0014] For example, the data generation method may further include a step of storing, in a descriptor of a multiplexing layer, hybrid information indicating whether the video data is video data with the second luminance dynamic range.

[0015] According to this, in a data playback device that plays back video data, it is possible to prepare for switching the playback method in advance using the hybrid information in the multiplexing layer. Thereby, the switching of the playback method in the data playback device can be performed smoothly.

[0016] For example, the first OETF may be an OETF defined by a linear term of the luminance of the video data in a first range of the luminance of the video data and defined by a power term of the luminance of the video data in a second range larger than the first range.

[0017] For example, the second OETF may be an OETF defined by a linear term of the luminance of the video data in a third range of the luminance of the video data, defined by a power term of the luminance of the video data in a fourth range larger than the third range, and defined by a logarithmic term of the luminance of the video data in a fifth range larger than the fourth range.

[0018] For example, the first OETF may be an OETF defined by a power term of the luminance of the video data.

[0019] For example, the second OETF may be an OETF defined by a power term of the luminance of the video data in a sixth range of the luminance of the video data and defined by a logarithmic term of the luminance of the video data in a seventh range larger than the sixth range.

[0020] For example, the first OETF may be an OETF defined by BT.709 or BT.2020, and the second OETF may be a hybrid gamma OETF.

[0021] For example, the data generation method may further include a step of storing, in the SEI, dynamic range increase information indicating a difference between the luminance dynamic range of the video data and the first luminance dynamic range.

[0022] For example, the data generation method may further include a step of storing, in the SEI, picture maximum average level information indicating the maximum average luminance value among the average luminance values of each of all the pictures included in the video sequence.

[0023] Also, a data playback method according to an aspect of the present invention is a data playback method for playing back video data having a second luminance dynamic range wider than a first luminance dynamic range, the video data being incompatible with playback on a first device that does not support playback of video having the second luminance dynamic range and is compatible with playback of video having the first luminance dynamic range. The video data includes VUI (Video Usability Information) storing first transfer function information for specifying a first OETF (Opto-Electrical Transfer Function) referred to by the first device when the first device decodes the video data, and SEI (Supplemental enhancement information) storing second transfer function information for specifying a second OETF referred to by a second device when the second device decodes the video data, the second device being compatible with playback of video having the second luminance dynamic range. The data playback method includes a step of acquiring the second transfer function information included in the SEI, and a step of playing back a video signal included in the video data with reference to the second OETF specified by the acquired second transfer function information.

[0024] According to this, the data playback method can play back backward-compatible video data.

[0025] For example, the video data further includes hybrid information stored in a descriptor of a multiplexed layer indicating whether the video data is video data of the second luminance dynamic range, and the data playback method further includes: obtaining the hybrid information from the video data; based on the obtained hybrid information, preparing to switch between playback of the first luminance dynamic range and playback of the second luminance dynamic range; and switching between playback of the first luminance dynamic range and playback of the second luminance dynamic range at a timing when the video sequence switches.

[0026] According to this, preparation for switching the playback method can be performed in advance using the hybrid information in the multiplexed layer. Thereby, the switching of the playback method can be performed smoothly.

[0027] For example, the first OETF may be an OETF defined by a linear term of the luminance of the video data in a first range of the luminance of the video data and defined by a power term of the luminance of the video data in a second range larger than the first range.

[0028] For example, the second OETF may be an OETF defined by a linear term of the luminance of the video data in a third range of the luminance of the video data, defined by a power term of the luminance of the video data in a fourth range larger than the third range, and defined by a logarithmic term of the luminance of the video data in a fifth range larger than the fourth range.

[0029] For example, the first OETF may be an OETF defined by a power term of the luminance of the video data.

[0030] For example, the second OETF may be an OETF defined by a power term of the luminance of the video data in a sixth range of the luminance of the video data and defined by a logarithmic term of the luminance of the video data in a seventh range larger than the sixth range.

[0031] For example, the first OETF is an OETF defined by BT.709 or BT.2020, and the second OETF may be a hybrid gamma OETF.

[0032] For example, the data playback method may further include a step of obtaining dynamic range increase information indicating a difference between the luminance dynamic range of the video data and the first luminance dynamic range from the SEI.

[0033] For example, the data playback method may further include a step of obtaining picture maximum average level information indicating the maximum average luminance value among the average luminance values of each of all the pictures included in the video sequence from the SEI.

[0034] Also, a data generation device according to an aspect of the present invention is a video data having a second luminance dynamic range wider than a first luminance dynamic range, which does not support playback of the video of the second luminance dynamic range and is compatible with playback on a first device that supports playback of the video of the first luminance dynamic range. A data generation device that generates video data, a generation unit that generates a video signal included in the video data using a second OETF (Opto-Electrical Transfer Function) referred to by the second device when the second device that supports playback of the video of the second luminance dynamic range decodes the video data, and a first storage unit that stores first transfer function information for specifying a first OETF referred to by the first device when the first device decodes the video data in VUI (Video Usability Information) in the video data, and a second storage unit that stores second transfer function information for specifying the second OETF in SEI (Supplemental enhancement information) in the video data.

[0035] According to this, on a device that supports only playback of video with a first luminance dynamic range, the video data can be played back using the first transfer function information, and on a device that supports playback of video with a second luminance dynamic range, the video data can be played back using the second function information. In this way, the data generation device can generate video data with backward compatibility.

[0036] Also, a data playback device according to an aspect of the present invention is a video data having a second luminance dynamic range wider than a first luminance dynamic range, which does not support playback of the video of the second luminance dynamic range and is compatible with playback on a first device that supports playback of the video of the first luminance dynamic range. The video data includes a VUI (Video Usability Information) storing first transfer function information for specifying a first OETF (Opto-Electrical Transfer Function) referred to by the first device when the first device decodes the video data, and an SEI (Supplemental enhancement information) storing second transfer function information for specifying a second OETF referred to by a second device when the second device that supports playback of the video of the second luminance dynamic range decodes the video data. The data playback device includes an acquisition unit that acquires the second transfer function information included in the SEI, and a playback unit that plays back a video signal included in the video data with reference to the second OETF specified by the acquired second transfer function information.

[0037] According to this, the data playback device can play back backward-compatible video data.

[0038] Note that these general or specific aspects may be implemented by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, or may be implemented by any combination of a system, a method, an integrated circuit, a computer program, and a recording medium.

[0039] Hereinafter, embodiments will be specifically described with reference to the drawings.

[0040] Note that all the embodiments described below show specific examples of the present invention. The numerical values, shapes, materials, components, arrangement positions and connection forms of the components, steps, order of steps, etc. shown in the following embodiments are merely examples and are not intended to limit the present invention. In addition, among the components in the following embodiments, the components not described in the independent claims indicating the highest-level concept are described as optional components.

[0041] In addition, detailed descriptions of terms, data configurations, processing contents, etc. may be omitted below, but one example of these specific examples conforms to the contents described in Non-Patent Document 1, Non-Patent Document 2, and Non-Patent Document 3, for example.

[0042] First, the configuration of the system according to this embodiment will be described. FIG. 1 is a block diagram showing the configuration of the system according to this embodiment. The system shown in FIG. 1 includes a data generation device 110 and a data playback device 120.

[0043] The data generation device 110 generates video data having a second luminance dynamic range (e.g., HDR) wider than the first luminance dynamic range (e.g., SDR), which is incompatible with playback of video with the second luminance dynamic range and is compatible with playback on a first device that supports playback of video with the first luminance dynamic range.

[0044] This data generation device 110 includes a video signal generation unit 111, an encoding unit 112, and a multiplexing unit 113.

[0045] The video signal generation unit 111 converts the luminance value of the original image corresponding to HDR into a code value using an OETF (Opto-Electrical Transfer Function). Here, as shown in FIG. 2, the OETF is a function for converting the luminance value of the original image into a code value. Specifically, the video signal generation unit 111 uses an SDR-compatible HDR OETF. Details thereof will be described later.

[0046] The symbolization unit 112 generates a video elementary stream by performing encoding compliant with a video encoding standard such as HEVC on the obtained code value. The multiplexing unit 113 generates a transport stream (for example, a DVB transport stream) by multiplexing the video elementary stream.

[0047] The generated transport stream is transmitted to the data playback device 120 by, for example, a broadcast wave or the like. Here, an example in which a broadcast wave is used is described, but transmission via a network or the like may also be possible, or transmission via a recording medium such as a BD disc may also be possible.

[0048] The data playback device 120 plays back the video data generated by the data generation device 110. This data playback device 120 includes a demultiplexing unit 121, a decoding unit 122, and a playback unit 123.

[0049] The demultiplexing unit 121 generates a video elementary stream by demultiplexing video data (transport stream). The decoding unit 122 generates a code value by performing decoding compliant with a video encoding standard such as HEVC on the obtained video elementary stream.

[0050] The playback unit 123 restores the video by converting the obtained code value into a luminance value using an EOTF (Electro-Optical Transfer Function) corresponding to the above OETF. Here, the EOTF is the inverse function of the OETF and is a function for converting a code value into a luminance value. The obtained video is displayed on a display unit or the like provided in or connected to the data playback device 120.

[0051] Hereinafter, the signaling of the transfer function (OETF) of the present embodiment will be described.

[0052] The transfer function is signaled using the transfer_characteristics within the VUI (Video Usability Information) included in the SPS (Sequence Parameter Set) in the HEVC and AVC video coding standards.

[0053] Also, only the OETF is signaled and the EOTF is not signaled.

[0054] Figure 3 is a diagram showing the syntax of the VUI parameters. As shown in Figure 3, the VUI includes the first transfer function information (transfer_characteristics). Figure 4 is a table showing the meaning of transfer_characteristics. The values 1 and 14 are assigned to the OETF of the SDR supported by the DVB (Digital Video Broadcasting) UHD (Ultra HD) phase 1 receiver.

[0055] transfer_characteristics indicates the opto-electrical voltage characteristic of the original image as described in Non-Patent Document 1 and the like.

[0056] Note that signaling means including, in the transmission signal, a signal for specifying the desired information or a signal indicating the information itself so that the receiving side can acquire the desired information. For example, in the examples of Figures 3 and 4, transfer_characteristics for specifying the OETF are included in the transmission signal, and the receiving side specifies the OETF based on the received transfer_characteristics.

[0057] Hereinafter, an example of an extension for the new OETF according to this embodiment will be described.

[0058] In the HEVC and AVC standards, reserved values for further extension are provided. Therefore, these reserved values can be assigned to the OETF of SDR-compatible HDR (hereinafter referred to as the hybrid OETF). For example, as shown in FIG. 5, the hybrid OETF is assigned to the values 18 to 20, which are reserved values.

[0059] However, in this case, an old-specification data playback device (receiver) that does not support HDR cannot recognize this new value and will recognize it as a reserved value. As a result, there is a problem that backward compatibility cannot be achieved when a new value is used for the hybrid OETF. Here, the hybrid OETF is an OETF that includes a part expressed by the power of luminance and a part expressed by the logarithm of luminance, such as the BBC Hybrid Gamma OETF.

[0060] In this embodiment, the value of the first transfer function information (transfer_characteristics) is set to 1 (BT.709) or 14 (BT.2020) as in the conventional SDR.

[0061] Also, the second transfer function information (HDR_transfer_characteristic) is signaled separately from the first transfer function information to identify the hybrid OETF. Thereby, in a data playback device that does not support HDR, the OETF for SDR can be identified using the first transfer function information (transfer_characteristics), and in a data playback device that supports HDR, the OETF for HDR can be identified using the second transfer function information.

[0062] Here, the second transfer function information (HDR_transfer_characteristic) is used for signaling the OETF for HDR. Specifically, the OETF for HDR is compatible with the OEFT for SDR specified by the first transfer function information (transfer_characteristics).

[0063] For example, the second transfer function information (HDR_transfer_characteristic) indicates any one of the three hybrid OETFs shown in FIG. 5. Note that the second transfer function information may be information indicating whether a hybrid OETF is used. Also, the number of selectable hybrid OETFs may be arbitrary as long as it is 1 or more.

[0064] Also, as shown in FIG. 2, the hybrid OETF has characteristics that substantially match those of the SDR OETF in the low-luminance range. That is, the luminance reproduced in the low-luminance range is almost the same whether the video signal generated using the hybrid OETF is reproduced using the hybrid OETF or using the SDR OETF. Thereby, since the difference in luminance values between when reproduced on an HDR device and when reproduced on an SDR device can be reduced, a video with little discomfort can be reproduced even when reproduced using the SDR OETF.

[0065] Hereinafter, a plurality of methods for storing the second transfer function information will be described. Roughly divided, there are a method of storing the second transfer function information in a Video Coding Layer and a method of storing it in a Multiplaxing Layer.

[0066] First, a method of storing the second transfer function information in the video coding layer will be described.

[0067] FIG. 6 is a diagram showing the syntax of an HDR hybrid gamma SEI message (hereinafter referred to as a hybrid SEI message) according to the present embodiment. As shown in FIG. 6, the second transfer function information (HDR_transfer_characteristic) is included in the hybrid SEI message.

[0068] The hybrid SEI message exists only within an IRAP NAL unit or an I picture and is valid for the subsequent encoded video sequence.

[0069] Note that the hybrid SEI message may be a prefix or suffix SEI message.

[0070] Also, in the application standardization document, the presence of this SEI message may be obligatory when HDR_transfer_characteristi has a predetermined fixed value.

[0071] Also, as shown in FIG. 7, the hybrid SEI message may include dynamic_range_increase and maximum_average_picture_level information in addition to or instead of the second transfer function information.

[0072] The dynamic_range_increase information is used for the calculation of the coefficient k and takes only values of 0, 1, or 2. The coefficient k indicates the difference from the dynamic range of the SDR and is obtained by the following (Equation 1). Specifically, the coefficient k indicates the magnification of the dynamic range of the video with respect to the dynamic range of the SDR.

[0073] k = 2 × dynamic_range_increase + 4 ···(Equation 1)

[0074] The maximum_average_picture_level information indicates the maximum average picture level among all the pictures included in the video sequence. Here, the average picture level is the average value of the luminance of the pixels expressed as a percentage of the maximum luminance.

[0075] In this way, by using the dynamic_range_increase information and the maximum_average_picture_level information, the difference from the SDR can be set within an arbitrary range.

[0076] Also, in the application standardization document, the presence of this SEI message may be obligatory when k is a predetermined fixed value. For example, in DVB, k = 4, and in BDA, k = 8.

[0077] FIG. 8 is a diagram showing the configuration of an extended SPS. As shown in FIG. 8, dynamic_range_increase and maximum_average_picture_level may be included in the SPS.

[0078] Next, a method for storing the second transfer function information in the multiplexing layer will be described.

[0079] FIG. 9 is a diagram showing the configuration of a hybrid descriptor (HDR_hybrid_gamma_descriptor), which is a new descriptor at the MPEG2-TS level according to this embodiment.

[0080] As shown in FIG. 9, the hybrid descriptor includes a hybrid OETF flag (HDR_hybrid_gamma_OETF_flag) and second transfer function information (HDR_transfer_characteristic).

[0081] The hybrid OETF flag (HDR_hybrid_gamma_OETF_flag) indicates whether the content is HDR-encoded using the hybrid OETF. For example, when the hybrid OETF flag is 1, the content is HDR-encoded using the hybrid OETF.

[0082] Note that the hybrid OETF flag is not necessarily required, and only the second transfer function information may be used.

[0083] In addition, the hybrid descriptor is stored in at least one of the PMT (Program Map Table) defined in MPEG, the SDT (Service Description Table) defined in DVB within the DVB-SI standard, and the EIT (Event Information Table) defined in DVB within the DVB-SI standard.

[0084] The PMT indicates the PID of the TS packet storing an image or audio, etc. The data playback device can extract the TS packet of the desired image or audio by obtaining the PID of the desired image or audio from the PMT.

[0085] The SDT indicates the name of the channel (service), the type of EIT transmitted on each channel, and digital copy control information, etc.

[0086] The EIT indicates information related to the program such as the name of the program, the broadcast date and time, and the broadcast content.

[0087] When the hybrid descriptor is included in the PMT, the hybrid descriptor is only assigned to the video elementary stream. However, in this case, it is necessary to control the modification of the PMT at the broadcasting station, and this modification may be difficult.

[0088] When the hybrid descriptor is included in the SDT, the content of the hybrid descriptor is not frequently updated. Therefore, it is preferable when applying the content of the hybrid descriptor to the entire service.

[0089] When the hybrid descriptor is included in the EIT, there is an advantage that the content of the hybrid descriptor can be changed on an event-by-event basis.

[0090] FIG. 10 is a diagram showing another configuration of the hybrid descriptor according to the present embodiment. As shown in FIG. 10, the hybrid descriptor may include dynamic_range_increase and maximum_average_picture_level in addition to or instead of the second transfer function information.

[0091] Further, FIG. 11 is a diagram showing the configuration of the HEVC descriptor (HEVC_descriptor) according to the present embodiment. The HEVC descriptor is a descriptor at the MPEG2-TS level. As shown in FIG. 11, the reserved value of the HEVC descriptor is replaced with the hdr_hybrid_gamma_coded_content_flag and the dynamic_range_increase. Note that the hybrid coding flag is the same flag as the above-described HDR_hybrid_gamma_OETF_flag. Also, the above-described other information (the second transfer function information and the maximum average picture level information) may be included in the HEVC descriptor.

[0092] Also, a similar extension may be made to the AVC descriptor (AVC_video_descriptor).

[0093] Also, the above-described hybrid descriptor (HDR_hybrid_gamma_descriptor) and the signaling of the OETF to the video elementary stream (hybrid SEI message) may be combined. Thereby, the switching of parameters in the data playback device can be performed smoothly.

[0094] Hereinafter, this operation will be described in detail. FIG. 12 is a diagram showing the configuration of the stream and the operation of the data playback device.

[0095] A hybrid descriptor (HDR_hybrid_gamma_descriptor) including a hybrid OETF flag (HDR_hybrid_gamma_OETF_flag) is sent starting a little before the actual change. The data playback device that receives this hybrid OETF flag prepares for the change between SDR and HDR.

[0096] Also, in order to enable parameter changes, an EOS (End Of Sequence) indicating the end of the video sequence is inserted into the video elementary stream. Also, there are cases where a hybrid SEI message adapted to the hybrid descriptor signaled immediately before is stored and not stored at the RAP (Random Access Point) following the EOS.

[0097] The data playback device detects whether an EOS and a hybrid SEI message exist and makes changes according to the detection result.

[0098] In the example shown in FIG. 12, in the state where the data playback device is performing HDR operation, it acquires a hybrid descriptor including HDR_hybrid_gamma_OETF_flag = 0. Thereby, the data playback device starts preparing for the operation switch from HDR to SDR. Next, the data playback device switches from HDR to SDR at the timing when it acquires the EOS. Also, there is no hybrid SEI message in the SDR video elementary stream, and the data playback device does not acquire the hybrid SEI message.

[0099] Next, in the state where the data playback device is performing SDR operation, it acquires a hybrid descriptor including HDR_hybrid_gamma_OETF_flag = 1. Thereby, the data playback device starts preparing for the operation switch from SDR to HDR. Next, the data playback device switches from SDR to HDR at the timing when it acquires the EOS.

[0100] The operations of the data generation device 110 and the data playback device 120 based on the above will be described below.

[0101] FIG. 13 is a flowchart of the operation of the data generation device 110 according to the present embodiment. The data generation device 110 generates video data that is HDR video data and is compatible with playback on a first device that does not support HDR video playback but supports SDR video playback.

[0102] First, the video signal generation unit 111 generates a video signal by converting the luminance value of the original image into a code value using the second OETF (S101). Next, the encoding unit 112 generates a video elementary stream by encoding the video signal. At this time, the encoding unit 112 stores first transfer function information for specifying a first OETF referred to by the first device when the first device that supports only SDR plays back the video data, in the VUI in the video data (video elementary stream). Also, second transfer function information for specifying a second OETF referred to by the second device when the second device that supports HDR decodes the video data, is stored in the SEI in the video data (S102).

[0103] Here, the VUI and the SEI belong to the video encoding layer. Also, the first OETF is, for example, an OETF defined by BT.709 or BT.2020, and the second OETF is, for example, the BBC hybrid gamma OETF.

[0104] Also, the encoding unit 112 may further store dynamic range increase information indicating the difference between the luminance dynamic range of the video data and the luminance dynamic range of SDR, in the SEI. Also, the encoding unit 112 may further store picture maximum average level information indicating the maximum average luminance value among the average luminance values of all the pictures included in the video sequence, in the SEI.

[0105] Next, the multiplexing unit 113 generates a transport stream by multiplexing video elementary stream data. At this time, the multiplexing unit 113 stores hybrid information (hybrid OETF flag) indicating whether the video data is HDR video data in the hybrid descriptor of the multiplexing layer (S103).

[0106] In the example shown in FIG. 12, an example in which the hybrid descriptor includes at least the hybrid OETF flag is shown. However, the hybrid descriptor may further include second transfer function information, dynamic range increase information, or picture maximum average level information.

[0107] Similarly, the hybrid SEI message may include at least one of the hybrid OETF flag, the second transfer function information, the dynamic range increase information, and the picture maximum average level information.

[0108] Also, in the above description, the hybrid OETF flag and the second transfer function information are described as individual information, but the second transfer function information may be used instead of the hybrid OETF flag. That is, the hybrid OETF flag may not be used. For example, whether the video data is HDR video data (whether the hybrid OETF is used) can be signaled depending on whether the second transfer function information is included in the video data. Or, whether the video data is HDR video data may be signaled depending on whether the hybrid OETF or the SDR OETF is indicated by the second transfer function information.

[0109] In the above description, an example in which the hybrid OETF is indicated by the second transfer function information has been described. However, as shown in FIG. 12, when HDR video and SDR video are mixed in the video data, the SDR OETF may also be indicated by the second transfer function information for the SDR video. Thereby, in a data playback device compatible with HDR, regardless of whether the video data is SDR or HDR, the second transfer function information may always be referred to. That is, the data playback device does not have to refer to the first transfer function information. Thereby, the processing of the data playback device can be simplified.

[0110] FIG. 14 is a flowchart of the operation of the data playback device 120 according to the present embodiment. The data playback device 120 plays back video data of HDR that is compatible with playback on a first device that does not support playback of HDR video and supports playback of SDR video. Here, this video data is, for example, video data generated by the data generation device 110.

[0111] First, the demultiplexing unit 121 generates a video elementary stream by demultiplexing the video data (transport stream). At this time, the demultiplexing unit 121 acquires hybrid information (for example, hybrid OETF flag) from the hybrid descriptor of the video data (S121). Note that the demultiplexing unit 121 may further acquire at least one of the dynamic range increase information and the picture maximum average level information from the hybrid descriptor.

[0112] Next, the data playback device 120 prepares to switch between SDR playback and HDR playback based on the acquired hybrid information (S122).

[0113] Next, the decoding unit 122 generates a video signal (code value) by decoding the video elementary stream. When it is indicated by the immediately preceding hybrid OETF flag that the hybrid OETF is being used, the decoding unit 122 acquires the second transfer function information included in the hybrid SEI within the video elementary stream (S123). Note that the decoding unit 122 may further acquire at least one of the dynamic range increase information and the picture maximum average level information from the hybrid SEI.

[0114] The playback unit 123 plays back the video signal included in the video data with reference to the second OETF specified by the acquired second transfer function information (S124). Also, the playback unit 123 switches between SDR playback and HDR playback at the timing when the video sequence switches. Specifically, the playback unit 123 plays back the data after EOS in the changed format. Also, when the dynamic range increase information or the picture maximum average level information is acquired, playback is performed using this information.

[0115] Note that when it is indicated by the immediately preceding hybrid OETF flag that the hybrid OETF is not being used, in step S123, the decoding unit 122 acquires the first transfer function information included in the VUI within the video elementary stream. In step S124, the playback unit 123 plays back the video signal included in the video data with reference to the second OETF specified by the acquired first transfer function information. Note that as described above, when the first OETF or the second OEFT is selectively indicated by the second transfer function information, the decoding unit 122 may always acquire the second transfer function information, and the playback unit 123 may refer to the first OETF or the second OETF indicated by the second transfer function information.

[0116] As described above, in the present embodiment, in addition to the first transfer function information stored in the VUI, the second transfer function information is stored in the SEI message. Thereby, HDR encoding using a hybrid OETF such as the BBC Hybrid Gamma OETF can be realized.

[0117] Specifically, it can be indicated whether the content is HDR-encoded by the hybrid OETF through signaling to the multiplexing layer using descriptors.

[0118] Also, by combining a new SEI message and a new descriptor, smooth switching between HDR and SDR by a data playback device can be realized.

[0119] Also, the first OETF may be a function defined by the following (Equation 2).

[0120]

Equation

[0121] Here, L is the luminance of the image, which is normalized to 0 ≦ L ≦ 1 at the reference white level. V is a numerical value corresponding to the electrical signal. Also, α, β, γ, δ, ρ are certain constants, and as specific numerical examples, α = 4.5, β = 0.018, γ = 1.099, δ = 0.45, ρ = 0.099.

[0122] That is, as shown in (Equation 2), the first OETF may be an OETF defined by a linear term of the luminance of the video data in a first range of the luminance of the video data and defined by a power term of the luminance of the video data in a second range larger than the first range.

[0123] Furthermore, the first OETF may be a function expressed by the following (Equation 3).

[0124]

Equation

[0125] Here, L is the luminance of the image, which is normalized such that 0 ≦ L ≦ 1. E is a value corresponding to the voltage normalized by the reference white level, and is proportional to the absolute light intensity detected in the reference camera color channels RGB. As a result, E’ becomes a non-linear signal. Also, α, β, γ, δ are certain constants. As specific numerical examples, α = 4.5, β = 0.018 (for 10-bit system) or 0.0181 (for 12-bit system), γ = 1.099 (for 10-bit system) or 1.0993 (for 12-bit system), δ = 0.45, ρ = 0.099.

[0126] Also, the second OETF may be a function defined by the following (Equation 4). In this OETF, at high luminance, the conversion function is defined by a logarithmic term.

[0127]

Equation

[0128] Here, L is the luminance of the image, which is normalized by the reference white level. However, L may exceed 1. That is, this conversion function supports luminance greater than the reference white. V is a value corresponding to the electrical signal. μ is the breakpoint between the gamma curve and the logarithmic curve, which determines the maximum value of L when V is 1 or less. Also, α, β, γ, δ, ρ are certain constants. As specific numerical examples, α = 4.5, β = 0.018, γ = 1.099, δ = 0.45, ρ = 0.099.

[0129] That is, as shown in (Equation 4), the second OETF may be an OETF that is defined by a linear term of the luminance of the video data in the third range of the luminance of the video data, by a power term of the luminance of the video data in a fourth range larger than the third range, and by a logarithmic term of the luminance of the video data in a fifth range larger than the fourth range.

[0130] Alternatively, the first OETF may be a function defined by the following (Equation 5).

[0131] [Number]

[0132] Here, L is the luminance of the image, which is normalized to 0 ≦ L ≦ 1 at the reference white level. V is a numerical value corresponding to the electrical signal. Also, α is a certain constant, and as a specific numerical example, α = 0.5.

[0133] That is, as shown in (Equation 5), the first OETF may be an OETF defined by a power term of the luminance of the video data.

[0134] Alternatively, the second OETF may be a function defined by the following (Equation 6). In this OETF, at high luminance, the conversion function is defined by a logarithmic term.

[0135] [Number]

[0136] Also, α is a certain constant, and as a specific numerical example, α = 0.5.

[0137] That is, as shown in (Equation 6), the second OETF may be an OETF defined by a power term of the luminance of the video data in the sixth range of the luminance of the video data and defined by a logarithmic term of the luminance of the video data in a seventh range larger than the sixth range.

[0138] The data generation device (data generation method) and data playback device (data playback method) according to one or more aspects have been described based on the embodiments. However, the present invention is not limited to these embodiments. Without departing from the spirit of the present invention, various modifications conceived by those skilled in the art applied to these embodiments, or forms constructed by combining components in different embodiments, may also be included within the scope of one or more aspects.

[0139] For example, in each of the above embodiments, each component may be configured by dedicated hardware such as a circuit, or may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

Industrial Applicability

[0140] The present invention can be applied to a data transmission device or a data playback device such as a BD device.

Explanation of Signs

[0141] 110 Data generation device 111 Video signal generation unit 112 Encoding unit 113 Multiplexing unit 120 Data playback device 121 Demultiplexing unit 122 Decoding unit 123 Playback unit

Claims

1. 1. A data generating device that generates a video elementary stream having a second luminance dynamic range wider than a first luminance dynamic range, the video elementary stream being compatible for playback in a first device that does not support playback of video images having the second luminance dynamic range and supports playback of video images having the first luminance dynamic range, An encoding unit that generates the video elementary stream by performing encoding in accordance with a video encoding standard, The video elementary stream includes: A VUI (Video Usability Information) storing first transfer function information for specifying a first OETF (Opto-Electrical Transfer Function) referred to by the first device when the first device decodes the video elementary stream; and a supplemental enhancement information (SEI) storing second transfer function information for specifying a second OETF to be referenced by a second device when the second device, which is compatible with playback of the image in the second luminance dynamic range, decodes the video elementary stream; The VUI is included in the SPS (Sequence Parameter Set). Data generation device.

2. 2. A data output device for transmitting the video elementary stream according to claim 1 via broadcast waves or a network.

3. 1. An encoding device that generates a video elementary stream having a second luminance dynamic range wider than a first luminance dynamic range, the video elementary stream being compatible for playback on a first device that does not support playback of video having the second luminance dynamic range and supports playback of video having the first luminance dynamic range, An encoding unit that generates the video elementary stream by performing encoding in accordance with a video encoding standard, The encoding unit generates a VUI (Video Usability Information) and a SEI (Supplemental enhancement information) in the video elementary stream, The encoding unit stores in the VUI first transfer function information for specifying a first OETF (Opto-Electrical Transfer Function) to be referred to by the first device when the first device decodes the video elementary stream; The encoding unit stores, in the SEI, second transfer function information for specifying a second OETF to be referenced by a second device when the second device, which supports playback of the image in the second luminance dynamic range, decodes the video elementary stream; The VUI is included in the SPS (Sequence Parameter Set). Encoding device.

4. 1. A decoding device that decodes a video elementary stream having a second luminance dynamic range wider than a first luminance dynamic range, the video elementary stream being compatible for playback on a first device that does not support playback of video having the second luminance dynamic range and supports playback of video having the first luminance dynamic range, A decoding unit that decodes the video elementary stream by performing decoding in accordance with a video encoding standard, The video elementary stream includes: A VUI (Video Usability Information) storing first transfer function information for specifying a first OETF (Opto-Electrical Transfer Function) referred to by the first device when the first device decodes the video elementary stream; and a supplemental enhancement information (SEI) storing second transfer function information for specifying a second OETF to be referenced by a second device when the second device, which is compatible with playback of the image in the second luminance dynamic range, decodes the video elementary stream; The VUI is included in the SPS (Sequence Parameter Set). Decryption device.

Images