Signal processing device and method

Abstract

To display content with a wide dynamic range of brightness at appropriate brightness. [Solution] A signal processing device according to one aspect of the present technology receives coded data of a standard video obtained by performing luminance conversion on an extended video, which is a video having a second luminance range wider than a first luminance range, where the standard video is a video having the first luminance range, luminance characteristic information representing the luminance characteristics of the extended video, and luminance conversion definition information used when performing the luminance conversion from the standard video to the extended video, decodes the coded data, converts the standard video obtained by decoding the coded data into an extended video based on the luminance conversion definition information, adjusts the luminance of the extended video in accordance with the luminance characteristic information, and controls display of the extended video. This technology can be applied to television receivers.

Description

[Technical field]

[0001] The present technology relates to a signal processing device and method, and more particularly to a signal processing device and method that enable content with a wide dynamic range of luminance to be displayed at an appropriate brightness. [Background technology]

[0002] Blu-ray (registered trademark) Disc (hereinafter, BD) is a recording medium for contents such as movies. Conventionally, authoring of videos to be recorded on BD has been done on a standard brightness (100nit = 100cd / m 2 The dynamic range of the master video is compressed, assuming that the video will be viewed on a 32-bit monitor.

[0003] The master video is shot with a high quality camera and has a dynamic range that is greater than or equal to the dynamic range that can be displayed on a standard brightness monitor. By compressing the master video, the dynamic range is of course lost. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2009-58692 A [Patent Document 2] JP 2009-89209 A Summary of the Invention [Problem to be solved by the invention]

[0005] With the advancement of display technologies such as organic EL (Electroluminescence) displays and LCD (Liquid Crystal Displays), monitors that are brighter than the standard, such as 500nit or 1000nit, are now available on the market. There is a demand for content that can take advantage of the performance of such monitors with a wide dynamic range.

[0006] The present technology has been made in consideration of such circumstances, and makes it possible to display content with a wide dynamic range of luminance at an appropriate brightness. [Means for solving the problem]

[0007] A signal processing device according to one aspect of the present technology includes a receiving unit that receives encoded data of a standard video obtained by performing luminance conversion of an extended video, which is a video having a second luminance range wider than a first luminance range, the standard video being a video having the first luminance range, the encoded data, luminance characteristic information representing luminance characteristics of the extended video, and luminance conversion definition information used when performing luminance conversion from the standard video to the extended video, a process of decoding the encoded data, a process of converting the standard video obtained by decoding the encoded data into the extended video based on the luminance conversion definition information, and a process of calculating a relationship between the luminance characteristic information and display performance. If the result of comparing the above shows that the extended image cannot be displayed as is, The display device includes a control unit that controls a process for adjusting the brightness of the converted extended image, and a display control unit that controls the display of the extended image.

[0008] In this technology, encoded data of a standard image obtained by performing luminance conversion of an extended image, which is an image having a second luminance range wider than a first luminance range, is received, the standard image being an image having the first luminance range, the encoded data, luminance characteristic information representing the luminance characteristics of the extended image, and luminance conversion definition information used when performing luminance conversion from the standard image to the extended image. Then, the encoded data is decoded, and the standard image obtained by decoding the encoded data is converted into the extended image based on the luminance conversion definition information, and the luminance characteristic information and display performance are calculated. If the result of comparing the above shows that the extended image cannot be displayed as is, The brightness of the converted augmented image is adjusted, and the display of the augmented image is controlled. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing an example of the configuration of a recording and reproducing system according to an embodiment of the present technology. [Diagram 2] FIG. 13 is a diagram illustrating an example of signal processing in mode-i. [Diagram 3] FIG. 13 is a diagram showing the flow of signals processed in mode-i. [Figure 4] FIG. 11 is a diagram illustrating an example of signal processing in mode-ii. [Diagram 5] FIG. 13 is a diagram showing the flow of signals processed in mode-ii. [Figure 6] FIG. 2 is a diagram showing the structure of an HEVC access unit. [Figure 7] A diagram showing the syntax of Tone mapping information. [Figure 8] A figure showing an example of information used as tone mapping definition information and HDR information. [Figure 9] A figure showing an example of a tone curve indicated by Tone mapping information where tone_map_model_id=0. [Figure 10]A figure showing an example of a step function indicated by Tone mapping information for tone_map_model_id=2. [Figure 11] A figure showing an example of a broken line function indicated by Tone mapping information for tone_map_model_id=3. [Figure 12] FIG. 1 is a diagram showing an example of each piece of information included in HDR information. [Figure 13] FIG. 11 is a diagram showing an example of a management structure of an AV stream in the BD-ROM format. [Figure 14] FIG. 1 is a diagram showing the structure of a Main Path and a Sub Path. [Figure 15] FIG. 2 is a diagram illustrating an example of a file management structure. [Figure 16] A diagram showing the syntax of a PlayList file. [Figure 17] FIG. 13 is a diagram showing the syntax of a Clip Information file. [Figure 18] FIG. 18 is a diagram showing the syntax of ProgramInfo() in FIG. 17. [Figure 19] FIG. 20 is a diagram showing the syntax of StreamCodingInfo in FIG. 18. [Figure 20] FIG. 2 is a block diagram showing an example of the configuration of a recording device. [Figure 21] 21 is a block diagram showing an example of the configuration of an encoding processing unit in FIG. 20. [Figure 22] FIG. 11 is a diagram illustrating an example of signal processing by an HDR-STD conversion unit. [Diagram 23] FIG. 13 is a diagram illustrating an example of tone mapping. [Figure 24] FIG. 2 is a block diagram showing an example of the configuration of a playback device. [Diagram 25] 25 is a block diagram showing an example of the configuration of a decoding processing unit in FIG. 24. [Figure 26] FIG. 1 is a block diagram showing a configuration example of a display device. [Figure 27] 10 is a flowchart illustrating a recording process of the recording device. [Figure 28] 28 is a flowchart illustrating the encoding process in mode-i performed in step S2 of FIG. 27. [Figure 29] 28 is a flowchart illustrating the encoding process in mode-ii performed in step S3 of FIG. 27. [Diagram 30] 28 is a flowchart illustrating a Database information generating process performed in step S4 of FIG. 27. [Diagram 31] 11 is a flowchart illustrating a playback process of the playback device. [Diagram 32] 32 is a flowchart illustrating the decoding process in mode-i performed in step S44 of FIG. 31. [Diagram 33] 32 is a flowchart illustrating the decoding process in mode-ii performed in step S45 of FIG. 31. [Diagram 34] 11 is a flowchart illustrating a display process of the display device. [Diagram 35] FIG. 17 is a diagram showing an example of the syntax of AppInfoPlayList() included in the PlayList file of FIG. 16. [Diagram 36] FIG. 17 is a diagram showing the syntax of PlayList() included in the PlayList file of FIG. 16. [Figure 37] A diagram showing the syntax of PlayItem() in Figure 36. [Figure 38] A diagram showing the syntax of STN_table() in Figure 37. [Figure 39] A diagram showing the syntax of stream_attributes() in Figure 38. [Diagram 40] FIG. 13 is a diagram illustrating an example of PSR allocation. [Diagram 41] A figure showing an example of signal processing in mode-i when the brightness adjustment of HDR video is performed on the playback device side. [Diagram 42]A figure showing an example of signal processing in mode-ii when the brightness adjustment of HDR video is performed on the playback device side. [Diagram 43] FIG. 26 is a block diagram showing an example configuration of the HDR video output unit of FIG. [Diagram 44] 32 is a flowchart illustrating the decoding process in mode-i performed in step S44 of FIG. 31. [Diagram 45] 32 is a flowchart illustrating the decoding process in mode-ii performed in step S45 of FIG. 31. [Diagram 46] 11 is a flowchart illustrating a display process of the display device. [Figure 47] FIG. 11 is a diagram showing an example of recognition based on information transmitted and received via HDMI. [Figure 48] 13A and 13B are diagrams illustrating another example of recognition based on information transmitted and received via HDMI. [Figure 49] FIG. 13 is a diagram illustrating an example of an HDR EDID. [Figure 50] FIG. 1 is a diagram illustrating an example of an HDR InfoFrame. [Figure 51] 11 is a flowchart illustrating HDR EDID setting processing of the display device. [Figure 52] 11 is a flowchart illustrating a playback process of the playback device. [Diagram 53] 53 is a flowchart illustrating the HDR raw output process performed in step S227 of FIG. 52. [Figure 54] 53 is a flowchart illustrating the HDR·cooked output process performed in step S228 of FIG. 52. [Figure 55] 53 is a flowchart illustrating the STD output process performed in step S229 of FIG. 52. [Figure 56] 11 is a flowchart illustrating a display process of the display device. [Figure 57] FIG. 2 is a block diagram showing an example of the configuration of a computer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present technology will be described in the following order. 1. Recording and playback system 2. About HEVC 3. About the BD format 4. Configuration of each device 5. Operation of each device 6. Variations 7. Example of adjusting brightness on the playback device 8. Example of application to HDMI 9. Other Modifications

[0011] <1. Recording and playback system> FIG. 1 is a diagram showing an example of the configuration of a recording and reproducing system according to an embodiment of the present technology.

[0012] 1 is composed of a recording device 1, a playback device 2, and a display device 3. The playback device 2 and the display device 3 are connected via an HDMI (registered trademark) (High Definition Multimedia Interface) cable 4. The playback device 2 and the display device 3 may be connected via a cable of another standard, or may be connected via wireless communication.

[0013] The recording device 1 records content, and the playback device 2 plays back the content. The recording device 1 provides the content to the playback device 2 by using an optical disc 11. The optical disc 11 is a disc on which the content is recorded in, for example, a BD-ROM (Blu-ray (registered trademark) Disc Read-Only) format.

[0014] The content may be recorded on the optical disc 11 in other formats such as BD-R, -RE, etc. Furthermore, the content may be provided from the recording device 1 to the playback device 2 using removable media other than an optical disc, such as a memory card equipped with a flash memory.

[0015] If the optical disc 11 is a BD-ROM disc, the recording device 1 is, for example, a device used by a content author. In the following description, it is assumed that the optical disc 11 on which the content is recorded by the recording device 1 is provided to the playback device 2. In reality, however, optical discs are duplicated based on a master disc on which the content is recorded by the recording device 1, and the optical disc 11, which is one of the duplicated optical discs, is provided to the playback device 2.

[0016] HDR (High Dynamic Range) video, which is video having a dynamic range (luminance range) greater than or equal to the dynamic range that can be displayed on a monitor with standard luminance, is input to the recording device 1. The standard luminance is, for example, 100 cd / m 2 (=100nits).

[0017] The recording device 1 records the input master HDR video as is, that is, as a video having a dynamic range equal to or greater than the dynamic range that can be displayed on a monitor having standard brightness, onto the optical disc 11. In this case, information indicating the brightness characteristics of the master HDR video and information used when converting the HDR video into a STD video are also recorded onto the optical disc 11.

[0018] STD video (standard video) is video with a dynamic range that can be displayed on a monitor with standard brightness. If the dynamic range of STD video is 0-100%, the dynamic range of HDR video is expressed as a range from 0% to 101% or more, such as 0-500%, 0-1000%, etc.

[0019] Furthermore, the recording device 1 converts the input master HDR video into STD video, that is, into a video having a dynamic range that can be displayed on a monitor having standard brightness, and records the video on the optical disc 11. In this case, information indicating the brightness characteristics of the master HDR video and information used when converting the STD video into the HDR video are also recorded on the optical disc 11.

[0020] The HDR video recorded by the recording device 1, or the STD video obtained by converting the HDR video, is a so-called 4K resolution video with a horizontal and vertical resolution of, for example, 4096 x 2160 or 3840 x 2160 pixels. For example, HEVC (High Efficiency Video Coding) is used for encoding the video data by the recording device 1.

[0021] Information indicating the luminance characteristics of the master HDR video and information used when converting HDR video to STD video or when converting STD video to HDR video are inserted into the HEVC encoded data as SEI (Supplemental Enhancement Information). The HEVC stream with the SEI inserted into the HEVC encoded data is recorded on the optical disc 11 in BD format.

[0022] The playback device 2 communicates with the display device 3 via the HDMI cable 4, and acquires information about the display performance of the display device 3. The playback device 2 identifies whether the display device 3 is a device having an HDR monitor that is a monitor capable of displaying HDR video, or a device having a STD monitor that is a monitor that is only capable of displaying STD video.

[0023] Furthermore, the playback device 2 drives the drive, reads out the HEVC stream recorded on the optical disc 11, and decodes it.

[0024] For example, when the video data obtained by decoding is HDR video data and the display device 3 has an HDR monitor, the playback device 2 outputs the HDR video data obtained by decoding the HEVC stream to the display device 3. In this case, the playback device 2 outputs information indicating the luminance characteristics of the master HDR video to the display device 3 together with the HDR video data.

[0025] On the other hand, when the video data obtained by decoding is HDR video data and the display device 3 has a STD monitor, the playback device 2 converts the HDR video obtained by decoding the HEVC stream into STD video and outputs the STD video data. The conversion of HDR video into STD video is performed using information recorded on the optical disc 11 that is used when converting HDR video into STD video.

[0026] When the video data obtained by decoding is STD video data and the display device 3 has an HDR monitor, the playback device 2 converts the STD video obtained by decoding the HEVC stream into HDR video and outputs the HDR video data to the display device 3. The conversion of the STD video into the HDR video is performed using information that is recorded on the optical disc 11 and is used when converting the STD video into the HDR video. In this case, the playback device 2 outputs information indicating the luminance characteristics of the master HDR video to the display device 3 together with the HDR video.

[0027] On the other hand, if the video data obtained by decoding is STD video data and the display device 3 has an STD monitor, the playback device 2 outputs the STD video data obtained by decoding the HEVC stream to the display device 3.

[0028] The display device 3 receives the video data transmitted from the playback device 2 and displays the video of the content on a monitor. The playback device 2 also transmits audio data of the content. Based on the audio data transmitted from the playback device 2, the display device 3 outputs the sound of the content from a speaker.

[0029] For example, when information indicating the luminance characteristics of a master HDR video is transmitted together with the video data, the display device 3 recognizes that the video data transmitted from the playback device 2 is HDR video data. As described above, information indicating the luminance characteristics of the master HDR video is transmitted together with the HDR video data to the display device 3 having an HDR monitor.

[0030] In this case, the display device 3 displays the image of the HDR video according to the characteristics specified by the information indicating the luminance characteristics of the master HDR video. That is, if the monitor of the display device 3 has a dynamic range of 0-500%, and the information indicating the luminance characteristics of the master HDR video specifies that the dynamic range of the HDR video has a predetermined characteristic of 0-500%, the display device 3 adjusts the luminance in the range of 0-500% according to the predetermined characteristic and displays the image.

[0031] By being able to specify the luminance characteristics of the master HDR video, content authors can ensure that the video is displayed with the luminance they intended.

[0032] Normally, a display device such as a TV recognizes an externally input video as a video with a dynamic range of 0-100%. Also, if the display device's own monitor has a wider dynamic range than that, the display device will expand the luminance by itself according to the monitor's characteristics and display the image. By specifying the luminance characteristics and adjusting the luminance of the HDR video according to the specified characteristics, it is possible to prevent the display device from making luminance adjustments that the author does not intend.

[0033] Furthermore, playback devices that output video to display devices such as TVs usually convert the luminance according to the characteristics of the transmission path before outputting the video. The display device that receives the video converts the luminance of the received video according to the characteristics of the monitor and displays the image. By outputting HDR video directly from the playback device 2 to the display device 3 without converting the luminance in the playback device 2, the number of luminance conversions can be reduced, and an image with a luminance closer to the master can be displayed on the display device 3.

[0034] On the other hand, when the video data transmitted from the playback device 2 is STD video data, the display device 3 displays the STD video image. The fact that STD video is transmitted from the playback device 2 means that the display device 3 is a device having a STD monitor.

[0035] Hereinafter, the mode in which the master HDR video is recorded as HDR video on the optical disc 11 as is will be referred to as mode-i. In mode-i, information indicating the luminance characteristics of the master HDR video and information used when converting the HDR video to STD video are recorded on the optical disc 11.

[0036] Moreover, a mode in which the master HDR video is converted into STD video and recorded on the optical disc 11 is called mode-ii. In the case of mode-ii, information indicating the luminance characteristics of the master HDR video and information used when converting the STD video into the HDR video are recorded on the optical disc 11.

[0037] [Signal processing in mode-i] FIG. 2 is a diagram showing an example of signal processing in mode-i.

[0038] The process on the left side enclosed by a solid line L1 indicates the encoding process performed in the recording device 1, and the process on the right side enclosed by a solid line L2 indicates the decoding process performed in the playback device 2.

[0039] When a master HDR video is input, the recording device 1 detects the luminance of the master HDR video and generates HDR information that is information indicating the luminance characteristics of the master HDR video, as indicated by the tip of arrow #1. The recording device 1 also encodes the master HDR video in HEVC, as indicated by the tip of arrow #2.

[0040] The recording device 1 converts the master HDR video into STD video, as indicated by the tip of the arrow #3. The STD video image obtained by the conversion is displayed on a monitor (not shown). The conversion of the HDR video into the STD video is performed while the author visually checks the converted STD video image and adjusts the conversion parameters as appropriate.

[0041] Based on the adjustments made by the author, the recording device 1 generates tone mapping definition information for HDR-STD conversion, which is information used when converting HDR video into STD video, as indicated by the tip of arrow #4.

[0042] Tone mapping definition information is information that defines the correspondence between each pixel value indicating the brightness of a dynamic range, such as 0-400%, which is wider than the standard dynamic range, and each pixel value indicating the brightness of the standard dynamic range, 0-100%.

[0043] As indicated by the arrow #5, the recording device 1 inserts the HDR information and tone mapping definition information as SEI into the HEVC encoded data to generate an HEVC stream. The recording device 1 records the generated HEVC stream in BD format on an optical disc 11, and provides it to the playback device 2 as indicated by the arrow #11.

[0044] In this way, information indicating the luminance characteristics of the master HDR video and information used when converting the HDR video to STD video are provided to the playback device 2 by being inserted into the stream using the HEVC SEI.

[0045] The playback device 2 reads the HEVC stream from the optical disc 11, and extracts HDR information and tone mapping definition information from the SEI of the HEVC stream, as indicated by the ends of arrows #21 and #22.

[0046] Furthermore, the playback device 2 decodes the HEVC encoded data, as indicated by the tip of arrow #23. If the display device 3 has an HDR monitor, the playback device 2 adds HDR information to the HDR video data obtained by decoding the encoded data, as shown at the end of arrow #24, and outputs it to the display device 3, as shown at the end of arrow #25.

[0047] On the other hand, when the display device 3 has an STD monitor, the playback device 2 converts the HDR video obtained by decoding the encoded data into STD video using tone mapping definition information for HDR-STD conversion extracted from the HEVC stream, as indicated by the arrow #26. The playback device 2 outputs the STD video data obtained by the conversion to the display device 3, as indicated by the arrow #27.

[0048] In this way, the HDR video data obtained by decoding the HEVC encoded data is output together with the HDR information to the display device 3 having an HDR monitor. Also, the HDR video data obtained by decoding the HEVC encoded data is converted to STD video, and then output to the display device 3 having an STD monitor.

[0049] FIG. 3 is a diagram showing the flow of processing from when a master HDR video is input to the recording device 1 until the video data is output from the playback device 2.

[0050] As indicated by the tip of white arrow #51, the master HDR video is provided to the playback device 2 together with HDR information generated in the recording device 1 based on the master HDR video and tone mapping definition information for HDR-STD conversion. The HDR information includes, for example, information indicating that the dynamic range has been expanded to a range of 0-400%.

[0051] When the display device 3 has an HDR monitor, as indicated by arrows #52 and #53, HDR information is added to HDR video data obtained by decoding the HEVC encoded data in the playback device 2. In addition, the HDR video data with the HDR information added is output to the display device 3 as indicated by arrow #54.

[0052] On the other hand, when the display device 3 has an STD monitor, in the playback device 2, as indicated by arrows #55 and #56, the HDR video obtained by decoding the HEVC encoded data is converted to STD video using tone mapping definition information for HDR-STD conversion. Furthermore, the STD video data obtained by the conversion is output to the display device 3 as indicated by arrow #57. In Fig. 3, the amplitude of the waveform indicating the HDR video and the amplitude of the waveform indicating the STD video each indicate a dynamic range.

[0053] Thus, in mode-i, the master HDR video is recorded as HDR video on the optical disc 11. Also, depending on the performance of the display device 3 that is the output destination, it is possible to switch between adding HDR information to the HDR video obtained by decoding the encoded data and outputting it as is, or converting the HDR video to STD video and outputting it.

[0054] [Signal processing in mode-ii] FIG. 4 is a diagram showing an example of signal processing in mode-ii.

[0055] When a master HDR video is input, the recording device 1 detects the luminance of the master HDR video and generates HDR information as indicated by the tip of arrow #71.

[0056] As indicated by the tip of arrow #72, recording device 1 converts the master HDR video into STD video. The image of the STD video obtained by the conversion is displayed on a monitor (not shown).

[0057] Based on the adjustments made by the author, the recording device 1 generates tone mapping definition information for STD-HDR conversion, which is information used when converting STD video into HDR video, as indicated by the tip of arrow #73.

[0058] Furthermore, as indicated by the tip of arrow #74, the recording device 1 encodes the STD video obtained by converting the master HDR video in HEVC.

[0059] As indicated by the arrow #75, the recording device 1 inserts the HDR information and tone mapping definition information as SEI into the HEVC encoded data to generate an HEVC stream. The recording device 1 records the generated HEVC stream in BD format on the optical disc 11, and provides it to the playback device 2 as indicated by the arrow #91.

[0060] The playback device 2 reads the HEVC stream from the optical disc 11, and extracts HDR information and tone mapping definition information from the SEI of the HEVC stream, as indicated by the ends of arrows #101 and #102.

[0061] Furthermore, the playback device 2 decodes the HEVC encoded data, as indicated by the arrow #103. If the display device 3 has an STD monitor, the playback device 2 outputs STD video data obtained by decoding the encoded data to the display device 3, as indicated by the arrow #104.

[0062] On the other hand, when the display device 3 has an HDR monitor, the playback device 2 converts the STD video obtained by decoding the encoded data into HDR video using the tone mapping definition information for STD-HDR conversion extracted from the HEVC stream, as indicated by arrow #105. The playback device 2 adds HDR information to the HDR video data obtained by conversion, as indicated by arrow #106, and outputs the data to the display device 3, as indicated by arrow #107.

[0063] In this way, the STD video data obtained by decoding the HEVC encoded data is converted into HDR video, and then output together with HDR information to the display device 3 having an HDR monitor. Also, the STD video data obtained by decoding the HEVC encoded data is output as is to the display device 3 having an STD monitor.

[0064] FIG. 5 is a diagram showing the flow of processing from when a master HDR video is input to the recording device 1 until the video data is output from the playback device 2.

[0065] The master HDR video is converted to STD video, as indicated by the white arrow #121, and then provided to the playback device 2 together with HDR information generated in the recording device 1 based on the master HDR video and tone mapping definition information for STD-HDR conversion.

[0066] When the display device 3 has an HDR monitor, in the playback device 2, as indicated by arrows #122 and #123, the STD video obtained by decoding the HEVC encoded data is converted into HDR video using tone mapping definition information for STD-HDR conversion. Also, as indicated by arrows #124 and #125, HDR information is added to the HDR video data obtained by converting the STD video, and the data is output to the display device 3 as indicated by arrow #126.

[0067] On the other hand, if the display device 3 has an STD monitor, in the playback device 2, as indicated by the end of arrow #127, the STD video obtained by decoding the HEVC encoded data is output to the display device 3.

[0068] Thus, in mode-ii, the master HDR video is converted to STD video and recorded on the optical disc 11. Also, depending on the performance of the display device 3 that is the output destination, the STD video obtained by decoding the encoded data is converted to HDR video, and it is possible to switch between adding HDR information to the converted video and outputting it, or outputting the STD video as is.

[0069] The configurations and operations of the recording device 1 and playback device 2 described above will be described in detail later.

[0070] <2.About HEVC> Here, we will explain HEVC.

[0071] FIG. 6 is a diagram showing the structure of an HEVC access unit.

[0072] An HEVC stream is composed of access units, which are a collection of Network Abstraction Layer (NAL) units. One access unit contains video data for one picture.

[0073] As shown in Figure 6, one access unit consists of an AU delimiter (Access Unit delimiter), a Video Parameter Set (VPS), a Sequence Parameter Set (SPS), a Picture Parameter Set (PPS), an SEI, a Video Coding Layer (VCL), an End of Sequence (EOS), and an End of Stream (EOS).

[0074] The AU delimiter indicates the beginning of an access unit. The VPS contains metadata that describes the contents of the bitstream. The SPS contains information that the HEVC decoder needs to refer to throughout the decoding process of the sequence, such as picture size and CTB (Coding Tree Block) size. The PPS contains information that the HEVC decoder needs to refer to in order to perform the decoding process of the picture. The VPS, SPS, and PPS are used as header information.

[0075] The SEI is auxiliary information including timing information for each picture and information regarding random access. HDR information and tone mapping definition information are included in Tone mapping information, which is one of the SEIs. The VCL is data for one picture. EOS (End of Sequence) indicates the end position of the sequence, and EOS (End of Stream) indicates the end position of the stream.

[0076] FIG. 7 is a diagram showing the syntax of Tone mapping information.

[0077] Using the tone mapping information, the brightness and color of the decoded picture are converted to match the performance of the monitor to which the picture is output. Note that the line numbers and colons (:) on the left side of Fig. 7 are shown for the sake of convenience and are not information contained in the tone mapping information. The main information contained in the tone mapping information will be explained below.

[0078] The tone_map_id in the second line is identification information for the Tone mapping information. The purpose of the Tone mapping information is identified by the tone_map_id.

[0079] For example, an ID for mode-i and an ID for mode-ii are secured. When the recording mode is mode-i, an ID for mode-i is set in tone_map_id of Tone mapping information inserted in SEI of coded data of HDR video. When the recording mode is mode-ii, an ID for mode-ii is set in tone_map_id of Tone mapping information inserted in SEI of coded data of STD video. In the optical disc 11, one of the ID for mode-i and the ID for mode-ii is set in tone_map_id.

[0080] The tone_map_model_id on the eighth line indicates the model of the tone map used to convert the coded data.

[0081] In the recording device 1, one piece of Tone mapping information in which a value of 0, 2, or 3 is set as tone_map_model_id, and one piece of Tone mapping information in which a value of 4 is set as tone_map_model_id are generated.

[0082] 8, Tone mapping information in which tone_map_model_id is set to any one of 0, 2, and 3 is used as tone mapping definition information for HDR-STD conversion or STD-HDR conversion. Also, information included in Tone mapping information in which tone_map_model_id is set to 4 is used as HDR information.

[0083] Lines 9 to 11 in Figure 7 are descriptions related to tone_map_model_id=0. When tone_map_model_id=0, min_value and max_value are described.

[0084] FIG. 9 is a diagram showing an example of a tone curve indicated by Tone mapping information where tone_map_model_id=0.

[0085] The horizontal axis of Fig. 9 indicates coded_data (RGB values ​​before conversion), and the vertical axis indicates target_data (RGB values ​​after conversion). When the tone curve of Fig. 9 is used, RGB values ​​equal to or less than coded data D1 are converted to RGB values ​​indicated by min_value as indicated by hollow arrow #151. Also, RGB values ​​equal to or more than coded data D2 are converted to RGB values ​​indicated by max_value as indicated by hollow arrow #152.

[0086] Tone mapping information with tone_map_model_id=0 is used as tone mapping definition information for HDR-STD conversion. When using Tone mapping information with tone_map_model_id=0, luminance (luminance expressed by RGB values) above max_value and below min_value will be lost, but the load of the conversion process will be lighter.

[0087] 7 are descriptions relating to tone_map_model_id=2. When tone_map_model_id=2, start_of_coded_interval[i], which represents a step function and whose number is the same as the number of max_target_data, is described.

[0088] FIG. 10 is a diagram showing an example of a step function indicated by Tone mapping information of tone_map_model_id=2.

[0089] 10, for example, coded_data=5 is converted to target_data=3. If start_of_coded_interval[i] is {1, 3, 4, 5, 5, 5, 7, 7,}, the coded_data-target_data conversion table is expressed as {0, 1, 1, 2, 3, 5, 5,}.

[0090] Tone mapping information for tone_map_model_id=2 is used as tone mapping definition information for STD-HDR conversion or HDR-STD conversion. Because tone mapping information for tone_map_model_id=2 has a large amount of data, it needs to be convoluted into a conversion table when it is created, but the load of the conversion process is light.

[0091] Lines 18 to 23 in Fig. 7 are descriptions relating to tone_map_model_id=3. When tone_map_model_id=3, coded_pivot_value[i] and target_pivot_value[i], the number of which is specified by num_pivots and which represent a broken line function, are described.

[0092] FIG. 11 is a diagram illustrating an example of a broken line function indicated by Tone mapping information of tone_map_model_id=3.

[0093] 11 is used, for example, coded_data=D11 is converted to target_data=D11', and coded_data=D12 is converted to target_data=D12'. Tone mapping information with tone_map_model_id=3 is used as tone mapping definition information for STD-HDR conversion or HDR-STD conversion.

[0094] In this way, Tone mapping information in which a value of 0, 2, or 3 is set as tone_map_model_id is used as tone mapping definition information for STD-HDR conversion or HDR-STD conversion, and is transmitted from the recording device 1 to the playback device 2.

[0095] Lines 24 to 39 in Fig. 7 are descriptions related to tone_map_model_id=4. Of the information related to tone_map_model_id=4, ref_screen_luminance_white, extended_range_white_level, nominal_black_level_code_value, nominal_white_level_code_value, and extended_white_level_code_value are parameters that configure HDR information.

[0096] FIG. 12 is a diagram showing an example of each piece of information included in the HDR information.

[0097] The horizontal axis in Fig. 12 indicates each RGB pixel value. When the bit length is 10 bits, each pixel value has a value from 0 to 1023. The vertical axis in Fig. 12 indicates brightness (luminance). Curve L11 shows the relationship between pixel value and brightness on a monitor with standard luminance. The dynamic range of a monitor with standard luminance is 0-100%.

[0098] ref_screen_luminance_white is the standard monitor brightness (cd / m 2 12, the value of extended_range_white_level is set to 400.

[0099] The nominal_black_level_code_value indicates the pixel value of black (0% brightness), and the nominal_white_level_code_value indicates the pixel value of white (100% brightness) on a monitor with standard brightness. The extended_white_level_code_value indicates the white pixel value in the extended dynamic range.

[0100] 12, the dynamic range of 0-100% is extended to a dynamic range of 0-400% according to the value of extended_range_white_level, as indicated by the outlined arrow #161. Also, the pixel value corresponding to a brightness of 400% is specified by extended_white_level_code_value.

[0101] The luminance characteristics of HDR video are those represented by curve L12, where the values ​​of nominal_black_level_code_value, nominal_white_level_code_value, and extended_white_level_code_value are 0%, 100%, and 400% brightness, respectively.

[0102] In this way, the luminance characteristics of the master HDR video are indicated by the Tone mapping information in which a value of 4 is set as tone_map_model_id, and is transmitted from the recording device 1 to the playback device 2.

[0103] <3.About the BD format> Here, the BD-ROM format will be explained.

[0104] [Data management structure] FIG. 13 is a diagram showing an example of the management structure of an AV stream in the BD-ROM format.

[0105] AV streams including HEVC streams are managed using two layers: PlayList and Clip. AV streams may be recorded not only on the optical disc 11, but also in the local storage of the playback device 2.

[0106] A pair of one AV stream and its associated Clip Information is managed as one object. The pair of an AV stream and Clip Information is called a Clip.

[0107] An AV stream is expanded on a time axis, and the access point of each Clip is specified in a PlayList mainly by a timestamp. Clip Information is used to find an address in the AV stream at which to start decoding.

[0108] A PlayList is a collection of playback sections of an AV stream. One playback section in an AV stream is called a PlayItem. A PlayItem is represented by a pair of IN and OUT points of the playback section on the time axis. As shown in Figure 13, a PlayList is made up of one or more PlayItems.

[0109] The first PlayList from the left in FIG. 13 is made up of two PlayItems, and these two PlayItems refer to the first and second halves of the AV stream included in the Clip on the left, respectively.

[0110] The second PlayList from the left is made up of one PlayItem, which references the entire AV stream contained in the Clip on the right.

[0111] The third PlayList from the left is made up of two PlayItems, and these two PlayItems reference a certain part of the AV stream contained in the Clip on the left and a certain part of the AV stream contained in the Clip on the right, respectively.

[0112] For example, when the left PlayItem included in the first PlayList from the left is specified by the disc navigation program as the playback target, the first half of the AV stream included in the left Clip referenced by that PlayItem is played back. In this way, the PlayList is used as playback management information for managing the playback of the AV stream.

[0113] A playback path created in a PlayList by a sequence of one or more PlayItems is called a Main Path. A playback path created in a PlayList by a sequence of one or more SubPlayItems in parallel with the Main Path is called a Sub Path.

[0114] FIG. 14 is a diagram showing the structure of the Main Path and the Sub Path.

[0115] A PlayList has one Main Path and one or more Sub Paths. The PlayList in Fig. 14 has one Main Path and three Sub Paths made up of a sequence of three PlayItems.

[0116] An ID is set for each PlayItem constituting the Main Path, in order from the top. IDs Subpath_id=0, Subpath_id=1, and Subpath_id=2 are also set for each Sub Path, in order from the top.

[0117] In the example of Fig. 14, the Sub Path with Subpath_id=0 includes one SubPlayItem, the Sub Path with Subpath_id=1 includes two SubPlayItems, and the Sub Path with Subpath_id=2 includes one SubPlayItem.

[0118] An AV stream referenced by one PlayItem includes at least a video stream (main image data). The AV stream may or may not include one or more audio streams that are played at the same timing (synchronized) with the video stream included in the AV stream.

[0119] The AV stream may or may not include one or more streams of bitmap subtitle data (PG (Presentation Graphic)) that are played back in synchronization with the video stream included in the AV stream.

[0120] An AV stream may or may not include one or more IG (Interactive Graphic) streams that are played in synchronization with the video stream included in the AV stream file. The IG stream is used to display graphics such as buttons that are operated by the user.

[0121] In the AV stream referenced by one PlayItem, a video stream, and an audio stream, a PG stream, and an IG stream that are played in synchronization with the video stream are multiplexed.

[0122] Furthermore, one SubPlayItem references a video stream, an audio stream, a PG stream, etc. that are different from the AV stream referenced by the PlayItem.

[0123] In this way, AV streams including HEVC streams are played back using PlayList and Clip Information. The PlayList and Clip Information including information related to the playback of AV streams are referred to as Database information as appropriate.

[0124] [Directory Structure] FIG. 15 is a diagram showing an example of the management structure of files recorded on the optical disc 11. As shown in FIG.

[0125] Each file recorded on the optical disc 11 is managed hierarchically by a directory structure. One root directory is created on the optical disc 11.

[0126] The BDMV directory is placed under the root directory.

[0127] Under the BDMV directory, an Index file, which is a file named "Index.bdmv", and a MovieObject file, which is a file named "MovieObject.bdmv", are stored.

[0128] Under the BDMV directory, a PLAYLIST directory, a CLIPINF directory, a STREAM directory, etc. are provided.

[0129] The PLAYLIST directory contains PlayList files that describe PlayLists. Each PlayList file has a name that combines a five-digit number and the extension ".mpls". The file name "00000.mpls" is set for one PlayList file shown in FIG.

[0130] Clip Information files are stored in the CLIPINF directory. Each Clip Information file is given a name that combines a five-digit number with the extension ".clpi." The three Clip Information files in Fig. 15 are given the file names "00001.clpi," "00002.clpi," and "00003.clpi," respectively.

[0131] The STREAM directory stores stream files. Each stream file is named with a five-digit number and the extension ".m2ts". The three stream files in Figure 15 are named "00001.m2ts", "00002.m2ts", and "00003.m2ts", respectively.

[0132] A Clip Information file and a stream file that have the same five-digit number in their file names make up one Clip. When playing the stream file "00001.m2ts", the Clip Information file "00001.clpi" is used, and when playing the stream file "00002.m2ts", the Clip Information file "00002.clpi" is used. As will be described later, Clip Information files used to play AV streams, including HEVC streams, contain information regarding HDR video processing.

[0133] [Syntax of each file] Here, the main descriptions of the syntax of each file will be explained.

[0134] FIG. 16 is a diagram showing the syntax of a PlayList file.

[0135] A PlayList file is a file stored in the PLAYLIST directory of FIG. 15 and has the extension ".mpls."

[0136] AppInfoPlayList() stores parameters related to the playback control of the PlayList, such as playback restrictions.

[0137] PlayList() stores parameters related to the Main Path and Sub Path.

[0138] PlayListMark() stores mark information of the PlayList, that is, information about a mark that is a jump destination (jump point) in a user operation or command that instructs a chapter jump or the like.

[0139] FIG. 17 is a diagram showing the syntax of the Clip Information file.

[0140] The Clip Information file is a file stored in the CLIPINF directory in FIG. 15 and has the extension ".clpi."

[0141] ClipInfo() stores information indicating the type of AV stream that constitutes the Clip, information indicating the recording rate of the AV stream, and the like.

[0142] SequenceInfo() includes information indicating the position on the time axis of the source packets that make up the AV stream, information indicating the display time, and the like.

[0143] ProgramInfo() includes the PID of the AV stream that constitutes the Clip, information about the encoding of the AV stream, and so on.

[0144] FIG. 18 is a diagram showing the syntax of ProgramInfo() in FIG.

[0145] The number_of_program_sequences indicates the number of program sequences described in ProgramInfo(). A program sequence is made up of a sequence of source packets that make up a program.

[0146] SPN_program_sequence_start[i] indicates the source packet number at the start of the program sequence.

[0147] StreamCodingInfo includes information related to the coding of the AV stream that constitutes the Clip.

[0148] FIG. 19 is a diagram showing the syntax of StreamCodingInfo in FIG.

[0149] The stream_coding_type indicates the coding method of the elementary stream included in the AV stream. For example, in StreamCodingInfo of Clip Information used for playing back an HEVC stream, a value indicating that the coding method is HEVC is set as stream_coding_type.

[0150] The video_format indicates a video scanning method. In the video_format used for playing back an HEVC stream, a value indicating a 4K scanning method such as 2160p (2160 line progressive) is set as stream_coding_type.

[0151] The frame_rate indicates the frame rate of the video stream.

[0152] aspect_ratio indicates the aspect ratio of the video.

[0153] cc_flag is a 1-bit flag that indicates whether closed caption data is included in the video stream.

[0154] HDR_flag is a 1-bit flag that indicates whether or not recording is being performed with HDR video as the master. For example, HDR_flag=1 indicates that recording is being performed with HDR video as the master. Also, HDR_flag=0 indicates that recording is being performed with STD video as the master.

[0155] Mode_flag is a 1-bit flag that indicates the recording mode of the HEVC stream. Mode_flag is enabled when HDR_flag=1. For example, mode_flag=1 indicates that the recording mode is mode-i. Also, mode_flag=0 indicates that the recording mode is mode-ii.

[0156] In this way, the Clip Information includes a flag indicating whether the HEVC stream included in the AV stream played using the Clip Information is a stream whose master is HDR video, and a flag indicating the recording mode of the HEVC stream.

[0157] By referring to the flag included in the Clip Information, the playback device 2 is able to determine whether the master video is an HDR video, without actually analyzing the HEVC stream.

[0158] <4. Configuration of each device> Here, the configuration of each device will be described.

[0159] [Configuration of Recording Device 1] FIG. 20 is a block diagram showing an example of the configuration of the recording device 1.

[0160] The recording device 1 is made up of a controller 21, an encoding processing unit 22, and a disk drive 23. A master HDR video is input to the encoding processing unit 22.

[0161] The controller 21 includes a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), etc. The controller 21 executes a predetermined program and controls the overall operation of the recording device 1.

[0162] A Data Base information generating unit 21A is realized by executing a predetermined program in the controller 21. The Data Base information generating unit 21A generates a PlayList and Clip Information, which are Data Base information, and outputs them to the disc drive .

[0163] The encoding processing unit 22 encodes the master HDR video. The encoding processing unit 22 outputs the HEVC stream obtained by encoding the master HDR video to the disc drive 23.

[0164] The disc drive 23 records the PlayList and Clip Information supplied from the controller 21, and the file storing the HEVC stream supplied from the encoding processing unit 22, on the optical disc 11 in accordance with the directory structure of FIG.

[0165] FIG. 21 is a block diagram showing an example of the configuration of the encoding processing unit 22 in FIG.

[0166] The encoding processing unit 22 is composed of an HDR information generation unit 31, an HEVC encoder 32, an HDR-STD conversion unit 33, a definition information generation unit 34, and an HEVC stream generation unit 35.

[0167] The HDR information generation unit 31 detects the luminance of the input master HDR video, and generates HDR information including each piece of information described with reference to Fig. 12. The HDR information generation unit 31 outputs the generated HDR information to the HEVC stream generation unit 35.

[0168] When the recording mode is mode-i, the HEVC encoder 32 encodes the input master HDR video in HEVC. When the recording mode is mode-ii, the HEVC encoder 32 encodes the STD video supplied from the HDR-STD conversion unit 33 in HEVC. The HEVC encoder 32 outputs the encoded data of the HDR video or the encoded data of the STD video to the HEVC stream generation unit 35.

[0169] The HDR-STD conversion unit 33 converts the input master HDR video into STD video. The conversion by the HDR-STD conversion unit 33 is performed according to conversion parameters input by the author as appropriate. The HDR-STD conversion unit 33 outputs information indicating the correspondence between the input data and the output data, where the RGB signal of the HDR video is the input data and the RGB signal of the STD video is the output data, to the definition information generation unit 34.

[0170] FIG. 22 is a diagram showing an example of signal processing by the HDR-STD conversion unit 33.

[0171] As indicated by the tip of arrow #201, HDR-STD conversion unit 33 converts the YCrCb signals of the input master HDR video into RGB signals, and performs tone mapping on each RGB signal to each RGB signal of the STD video.

[0172] The HDR-STD conversion unit 33 outputs information indicating the correspondence between the RGB signals of the HDR video, which is the input data, and the RGB signals of the STD video, which is the output data, to the definition information generation unit 34. The information output to the definition information generation unit 34 is used to generate tone mapping definition information, as indicated by the tip of arrow #202.

[0173] Furthermore, as indicated by the tip of arrow #203, HDR-STD conversion unit 33 converts the RGB signals of the STD video into YCrCb signals and outputs them.

[0174] FIG. 23 is a diagram illustrating an example of tone mapping.

[0175] The RGB signals of the HDR video are converted into RGB signals of the STD video by compressing high luminance components and expanding mid- and low-frequency luminance components, for example, as shown in Fig. 23. Information indicating a function F that associates the RGB signals of the HDR video with the RGB signals of the STD video as shown in Fig. 23 is generated by the definition information generating unit 34. Note that the function F shown in Fig. 23 is Tone mapping information of tone_map_model_id=3 that indicates the relationship between coded_data and target_data by a broken line function, as described with reference to Fig. 11.

[0176] Returning to the description of FIG. 21, when the recording mode is mode-ii, the HDR-STD conversion unit 33 outputs the STD video obtained by converting the HDR video to the HEVC encoder 32.

[0177] The definition information generation unit 34 generates tone mapping definition information for HDR-STD conversion based on the information supplied from the HDR-STD conversion unit 33.

[0178] For example, when tone_map_model_id=0 is used, the definition information generating unit 34 generates Tone mapping information including the values ​​of min_value and max_value in FIG. 9 as tone mapping definition information for HDR-STD conversion.

[0179] Furthermore, when tone_map_model_id=2 is used, the definition information generating unit 34 generates Tone mapping information including start_of_coded_interval[i] in FIG. 10 as tone mapping definition information for HDR-STD conversion.

[0180] Furthermore, when tone_map_model_id=3 is used, the definition information generation unit 34 generates Tone mapping information including the number of coded_pivot_value[i] and target_pivot_value[i] specified by num_pivots in Figure 11 as tone mapping definition information for HDR-STD conversion.

[0181] The HEVC stream generation unit 35 sets the same value according to the recording mode to the Tone mapping information including the HDR information supplied from the HDR information generation unit 31 and the tone_map_id of the Tone mapping information including the tone mapping definition information supplied from the definition information generation unit 34. Furthermore, the HEVC stream generation unit 35 inserts the Tone mapping information including the HDR information and the Tone mapping information including the tone mapping definition information as SEI into the encoded data to generate an HEVC stream. The HEVC stream generation unit 35 outputs the generated HEVC stream to the disc drive 23.

[0182] [Configuration of playback device 2] FIG. 24 is a block diagram showing an example of the configuration of the playback device 2.

[0183] The playback device 2 includes a controller 51 , a disk drive 52 , a memory 53 , a local storage 54 , a network interface 55 , a decoding processing unit 56 , an operation input unit 57 , and an HDMI communication unit 58 .

[0184] The controller 51 is composed of a CPU, a ROM, a RAM, etc. The controller 51 executes a predetermined program and controls the overall operation of the playback device 2.

[0185] The disc drive 52 reads data from the optical disc 11, and outputs the read data to the controller 51, the memory 53, or the decoding processing unit 56. For example, the disc drive 52 outputs Database information read from the optical disc 11 to the controller 51, and outputs the HEVC stream to the decoding processing unit 56.

[0186] The memory 53 stores data necessary for the controller 51 to execute various processes. A register 53A, which is a PSR (Player Status Register), is formed in the memory 53. Various pieces of information that the playback device 2, which is a BD Player, refers to when playing back the optical disc 11, are stored in the register 53A.

[0187] The local storage 54 is configured by, for example, a hard disk drive (HDD). Streams downloaded from a server and the like are recorded in the local storage 54.

[0188] The network interface 55 communicates with a server via a network such as the Internet, and supplies data downloaded from the server to the local storage 54 .

[0189] The decoding processing unit 56 decodes the HEVC stream supplied from the disc drive 52, and outputs the HDR video or STD video data to the HDMI communication unit 58. When outputting HDR video, the decoding processing unit 56 outputs HDR information to the HDMI communication unit 58 together with the HDR video data.

[0190] The operation input unit 57 is composed of input devices such as buttons, keys, and a touch panel, and a receiving unit that receives signals such as infrared rays transmitted from a predetermined remote commander. The operation input unit 57 detects user operations and supplies a signal representing the contents of the detected operations to the controller 51.

[0191] The HDMI communication unit 58 communicates with the display device 3 via the HDMI cable 4. For example, the HDMI communication unit 58 acquires information on the performance of the monitor of the display device 3 and outputs the information to the controller 51. In addition, the HDMI communication unit 58 outputs the HDR video or STD video data supplied from the decoding processing unit 56 to the display device 3.

[0192] FIG. 25 is a block diagram showing an example of the configuration of the decoding processing unit 56 in FIG.

[0193] The decoding processing unit 56 is composed of a parameter extraction unit 71, an HEVC decoder 72, an HDR-STD conversion unit 73, an STD-HDR conversion unit 74, and an output unit 75. The output unit 75 is composed of an HDR video output unit 75A and an STD video output unit 75B.

[0194] The HEVC stream read by the disk drive 52 is input to the parameter extraction unit 71. For example, the controller 51 supplies the decoding processing unit 56 with information indicating the recording mode specified by mode_flag included in the Clip Information and information on the performance of the monitor of the display device 3 specified by information acquired from the display device 3.

[0195] The parameter extraction unit 71 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. For example, when the recording mode is mode-i and HDR video is to be output to the display device 3, the parameter extraction unit 71 outputs HDR information to the HDR video output unit 75A. In addition, when the recording mode is mode-i and STD video is to be output to the display device 3, the parameter extraction unit 71 outputs tone mapping definition information for HDR-STD conversion to the HDR-STD conversion unit 73.

[0196] On the other hand, when the recording mode is mode-ii and HDR video is output to the display device 3, the parameter extraction unit 71 outputs HDR information to the HDR video output unit 75A and outputs tone mapping definition information for STD-HDR conversion to the STD-HDR conversion unit 74. When the recording mode is mode-ii and STD video is output to the display device 3, the extracted HDR information and tone mapping definition information are not used.

[0197] In addition, the parameter extraction unit 71 outputs the encoded data included in the HEVC stream to the HEVC decoder 72.

[0198] The HEVC decoder 72 decodes the HEVC encoded data supplied from the parameter extraction unit 71. When the recording mode is mode-i, the HEVC decoder 72 outputs the HDR video obtained by decoding to the HDR-STD conversion unit 73 and the HDR video output unit 75A. When the recording mode is mode-ii, the HEVC decoder 72 outputs the STD video obtained by decoding to the STD-HDR conversion unit 74 and the STD video output unit 75B.

[0199] The HDR-STD conversion unit 73 converts the HDR video supplied from the HEVC decoder 72 into an STD video based on the tone mapping definition information for HDR-STD conversion supplied from the parameter extraction unit 71. The HDR-STD conversion unit 73 outputs the STD video obtained by the conversion to the STD video output unit 75B.

[0200] The STD-HDR conversion unit 74 converts the STD video supplied from the HEVC decoder 72 into an HDR video based on the tone mapping definition information for STD-HDR conversion supplied from the parameter extraction unit 71. The STD-HDR conversion unit 74 outputs the HDR video obtained by the conversion to the HDR video output unit 75A.

[0201] When the HDR video output unit 75A of the output unit 75 outputs HDR video to the display device 3, it outputs the HDR video supplied from the HEVC decoder 72 or the HDR video supplied from the STD-HDR conversion unit 74 together with the HDR information supplied from the parameter extraction unit 71.

[0202] When outputting STD video to the display device 3, the STD video output unit 75B outputs the STD video supplied from the HEVC decoder 72 or the STD video supplied from the HDR-STD conversion unit 73.

[0203] The data output from the HDR video output unit 75A and the STD video output unit 75B is transmitted to the display device 3 by the HDMI communication unit 58.

[0204] [Configuration of display device 3] FIG. 26 is a block diagram showing an example of the configuration of the display device 3. As shown in FIG.

[0205] The display device 3 includes a controller 101, an HDMI communication unit 102, a signal processing unit 103, and a monitor 104. The controller 101 includes a memory 101A.

[0206] The controller 101 is composed of a CPU, a ROM, a RAM, etc. The controller 101 executes a predetermined program and controls the overall operation of the display device 3.

[0207] For example, the controller 101 stores and manages EDID (Extended display identification data) indicating the performance of the monitor 104 in the memory 101A. When authenticating the playback device 2, the controller 101 outputs the EDID stored in the memory 101A to the HDMI communication unit 102 and causes it to be transmitted to the playback device 2. The playback device 2 identifies the performance of the monitor 104 of the display device 3 based on the EDID.

[0208] The HDMI communication unit 102 communicates with the playback device 2 via the HDMI cable 4. The HDMI communication unit 102 receives video data transmitted from the playback device 2, and outputs the data to the signal processing unit 103. In addition, the HDMI communication unit 102 transmits the EDID supplied from the controller 101 to the playback device 2.

[0209] The signal processing unit 103 processes the video data supplied from the HDMI communication unit 102 and displays the video on the monitor 104 .

[0210] <5. Operation of each device> Here, the operation of each device having the above configuration will be described.

[0211] [RECORDING PROCESSING] First, the recording process of the recording device 1 will be described with reference to the flowchart in Fig. 27. The process in Fig. 27 starts when a master HDR video is input to the recording device 1.

[0212] In step S1, the controller 21 of the recording device 1 determines whether the recording mode is mode-i. The recording mode is set by, for example, an author.

[0213] If it is determined in step S1 that the recording mode is mode-i, in step S2, the encoding processing unit 22 performs encoding processing in mode-i. The HEVC stream generated by the encoding processing in mode-i is supplied to the disc drive 23.

[0214] On the other hand, if it is determined in step S1 that the recording mode is mode-ii, in step S3, the encoding processing unit 22 performs encoding processing in mode-ii. The HEVC stream generated by the encoding processing in mode-ii is supplied to the disc drive 23.

[0215] In step S4, the Data Base information generating unit 21A performs a Data Base information generating process. The PlayList file and the Clip Information file generated by the Data Base information generation process are supplied to the disc drive 23.

[0216] In step S5, the disc drive 23 records the PlayList file, the Clip Information file, and the stream file that stores the HEVC stream on the optical disc 11. Then, the process ends.

[0217] Next, the encoding process in mode-i performed in step S2 in FIG. 27 will be described with reference to the flowchart in FIG.

[0218] In step S11, the HDR information generation unit 31 of the encoding processing unit 22 detects the luminance of the master HDR video and generates HDR information.

[0219] In step S12, the HEVC encoder 32 performs HEVC encoding on the master HDR video to generate encoded data of the HDR video.

[0220] In step S13, the HDR-STD conversion unit 33 converts the input master HDR video into an STD video. Information indicating the correspondence between the input data and the output data, where the RGB signal of the HDR video is the input data and the RGB signal of the STD video is the output data, is supplied to the definition information generation unit 34.

[0221] In step S14, the definition information generating unit 34 generates tone mapping definition information for HDR-STD conversion based on the information supplied from the HDR-STD conversion unit 33.

[0222] In step S15, the HEVC stream generation unit 35 sets an ID for mode-i to the Tone mapping information including HDR information generated by the HDR information generation unit 31 and the tone_map_id of the Tone mapping information including tone mapping definition information generated by the definition information generation unit 34. The HEVC stream generation unit 35 also inserts the Tone mapping information including HDR information and the Tone mapping information including tone mapping definition information into the encoded data to generate an HEVC stream. After that, the process returns to step S2 in Fig. 27, and the subsequent processes are performed.

[0223] Next, the encoding process in mode-ii performed in step S3 in FIG. 27 will be described with reference to the flowchart in FIG.

[0224] In step S21, the HDR information generation unit 31 of the encoding processing unit 22 detects the luminance of the master HDR video and generates HDR information.

[0225] In step S22, the HDR-STD conversion unit 33 converts the input master HDR video into an STD video. Information indicating the correspondence between the input data and the output data, where the RGB signal of the HDR video is the input data and the RGB signal of the STD video is the output data, is supplied to the definition information generation unit 34.

[0226] In step S23, the definition information generating unit 34 generates tone mapping definition information for STD-HDR conversion based on the information supplied from the HDR-STD conversion unit 33.

[0227] In step S24, the HEVC encoder 32 performs HEVC encoding on the STD video obtained by converting the master HDR video, and generates encoded data of the STD video.

[0228] In step S25, the HEVC stream generation unit 35 sets an ID for mode-ii to the Tone mapping information including the HDR information generated by the HDR information generation unit 31 and the tone_map_id of the Tone mapping information including the tone mapping definition information generated by the definition information generation unit 34. The HEVC stream generation unit 35 also inserts the Tone mapping information including the HDR information and the Tone mapping information including the tone mapping definition information into the encoded data to generate an HEVC stream. Then, the process returns to step S3 in Fig. 27, and subsequent processes are performed.

[0229] Next, the Database information generating process performed in step S4 in FIG. 27 will be described with reference to the flowchart in FIG.

[0230] In step S31, the Data Base information generating unit 21A of the controller 21 generates a PlayList including each piece of information described with reference to Fig. 16. The PlayList generated by the Data Base information generating unit 21A includes information on a PlayItem that specifies an HEVC stream as a playback section.

[0231] In step S32, the Data Base information generating unit 21A generates Clip Information including HDR_flag and mode_flag in StreamCodingInfo of ProgramInfo(). In this example, since the master video is an HDR video, the Data Base information generating unit 21A sets the value of HDR_flag to 1, which indicates that.

[0232] Also, when encoding processing is performed in mode-i in step S2 of Fig. 27, the Data Base information generating unit 21A sets the value of mode_flag to 1, which is a value indicating that the recording mode is mode-i. On the other hand, when encoding processing is performed in mode-ii in step S3 of Fig. 27, the Data Base information generating unit 21A sets the value of mode_flag to 0, which is a value indicating that the recording mode is mode-ii. Then, the process returns to step S4 of Fig. 27, and the subsequent processes are performed.

[0233] In the recording device 1, the HEVC stream and Data Base information generated by the above processing are recorded on the optical disc 11.

[0234] [Reproduction processing] Next, the playback process of the playback device 2 will be described with reference to the flowchart of FIG.

[0235] At a predetermined timing, such as before starting playback of the optical disc 11, the controller 51 of the playback device 2 controls the HDMI communication unit 58 to communicate with the display device 3 and reads the EDID from the memory 101A of the display device 3. The controller 51 stores and manages information indicating the performance of the monitor of the display device 3 in a register 53A.

[0236] In step S41, the controller 51 controls the disc drive 52 to read the PlayList and Clip Information, which are Database information, from the optical disc 11. The controller 51 also identifies an HEVC stream to be played back based on information included in the PlayList, and controls the disc drive 52 to read an AV stream including the identified HEVC stream from the optical disc 11.

[0237] In step S42, the controller 51 refers to HDR_flag and mode_flag included in the Clip Information. In this example, a value indicating that recording has been performed with the master being HDR video is set in HDR_flag. This puts the playback device 2 into a state in which it plays back HDR video or STD video obtained by converting the HDR video.

[0238] In step S43, the controller 51 determines whether the recording mode is mode-i based on the value of mode_flag.

[0239] If it is determined in step S43 that the recording mode is mode-i, then in step S44 the decoding processing unit 56 performs decoding processing in mode-i.

[0240] On the other hand, if it is determined in step S43 that the recording mode is mode-ii, then in step S45 the decoding processing section 56 performs decoding processing in mode-ii.

[0241] After the decoding process is performed in step S44 or step S45, the process ends.

[0242] Note that, here, the determination of whether the recording mode is mode-i or not is performed based on the value of mode_flag, but it may be performed based on tone_map_id of the Tone mapping information inserted in the HEVC stream.

[0243] Next, the decoding process in mode-i performed in step S44 in FIG. 31 will be described with reference to the flowchart in FIG.

[0244] In step S61, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the HEVC encoded data included in the HEVC stream to the HEVC decoder 72.

[0245] In step S62, the HEVC decoder 72 decodes the HEVC encoded data, and outputs the HDR video obtained by the decoding to the HDR-STD conversion unit 73 and the HDR video output unit 75A.

[0246] In step S63, the controller 51 determines whether the monitor of the display device 3 is an HDR monitor based on the information stored in the register 53A. As described above, the register 53A stores information about the performance of the monitor of the display device 3 based on the HDMI EDID read from the display device 3.

[0247] If it is determined in step S63 that the monitor of the display device 3 is an HDR monitor, in step S64, the HDR video output unit 75A outputs the HDR video supplied from the HEVC decoder 72 together with the HDR information supplied from the parameter extraction unit 71.

[0248] On the other hand, if it is determined in step S63 that the monitor of the display device 3 is not an HDR monitor but an STD monitor, in step S65, the HDR-STD conversion unit 73 converts the HDR video supplied from the HEVC decoder 72 into an STD video based on the tone mapping definition information for HDR-STD conversion supplied from the parameter extraction unit 71.

[0249] In step S66, the STD video output unit 75B outputs the STD video obtained by the conversion performed by the HDR-STD conversion unit 73.

[0250] After the HDR video is output in step S64, or after the STD video is output in step S66, the controller 51 determines in step S67 whether or not the playback has ended.

[0251] If it is determined in step S67 that the playback has not ended, the controller 51 returns to step S61 and repeats the above processing. If it is determined in step S67 that the playback has ended, the controller 51 returns to step S44 in FIG. 31 and performs the subsequent processing.

[0252] Next, the decoding process in mode-ii performed in step S45 in FIG. 31 will be described with reference to the flowchart in FIG.

[0253] In step S81, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the HEVC encoded data included in the HEVC stream to the HEVC decoder 72.

[0254] In step S82, the HEVC decoder 72 decodes the HEVC encoded data, and outputs the STD video obtained by the decoding to the STD-HDR conversion unit 74 and the STD video output unit 75B.

[0255] In step S83, the controller 51 determines whether or not the monitor of the display device 3 is an HDR monitor, based on the information stored in the register 53A.

[0256] If it is determined in step S83 that the monitor of the display device 3 is an HDR monitor, in step S84, the STD-HDR conversion unit 74 converts the STD video supplied from the HEVC decoder 72 into HDR video based on the tone mapping definition information for STD-HDR conversion supplied from the parameter extraction unit 71.

[0257] In step S85, the HDR video output unit 75A outputs the HDR video obtained by the conversion performed by the STD-HDR conversion unit 74, together with the HDR information supplied from the parameter extraction unit 71.

[0258] On the other hand, if it is determined in step S83 that the monitor of the display device 3 is the STD monitor, the STD video output unit 75B outputs the STD video supplied from the HEVC decoder 72 in step S86.

[0259] After the HDR video is output in step S85, or after the STD video is output in step S86, in step S87, the controller 51 determines whether or not the playback has ended.

[0260] If it is determined in step S87 that the playback has not ended, the controller 51 returns to step S81 and repeats the above processing. If it is determined in step S87 that the playback has ended, the controller 51 returns to step S45 in FIG. 31 and performs the subsequent processing.

[0261] [Display processing] Next, the display process of the display device 3 will be described with reference to the flowchart of FIG.

[0262] Here, a case will be described in which the monitor 104 of the display device 3 is an HDR monitor. HDR video with HDR information added is transmitted from the playback device 2 to the display device 3 having an HDR monitor.

[0263] In step S101, the HDMI communication unit 102 of the display device 3 receives the HDR video and HDR information transmitted from the playback device 2.

[0264] In step S102, the controller 101 refers to the HDR information and determines whether or not the HDR video transmitted from the playback device 2 can be displayed as is. The HDR information includes information indicating the luminance characteristics of the master HDR video, i.e., the HDR video transmitted from the playback device 2. The determination in step S102 is made by comparing the luminance characteristics of the HDR video specified by the HDR information with the display performance of the monitor 104.

[0265] For example, if the dynamic range of the HDR video specified by the HDR information is 0-400%, and the dynamic range of the monitor 104 is 0-500% (e.g., 100% brightness is 100 cd / m 2 That would be 500cd / m 2 ), it is determined that the HDR video can be displayed as is. On the other hand, if the dynamic range of the HDR video specified by the HDR information is 0-400% and the dynamic range of the monitor 104 is 0-300%, it is determined that the HDR video cannot be displayed as is.

[0266] If it is determined in step S102 that the HDR video can be displayed as is, in step S103, the signal processing unit 103 causes the monitor 104 to display the HDR video image according to the luminance specified by the HDR information. For example, if the luminance characteristics shown by curve L12 in Fig. 12 are specified by the HDR information, each pixel value represents a brightness in the range of 0-400% shown by curve L12.

[0267] On the other hand, if it is determined in step S102 that the HDR video cannot be displayed as is, in step S104, the signal processing unit 103 adjusts the luminance according to the display performance of the monitor 104, and displays the HDR video image with the adjusted luminance. For example, if the luminance characteristics shown by the curve L12 in Fig. 12 are specified by the HDR information and the dynamic range of the monitor 104 is 0-300%, each pixel value is compressed to represent a brightness in the range of 0-300%.

[0268] After the HDR video image is displayed in step S103 or step S104, in step S105, the controller 101 determines whether or not to end the display, and if it is determined not to end, the processes from step S101 onward are repeated. If it is determined in step S105 that the display is to end, the controller 101 ends the process.

[0269] Through the series of processes described above, the recording device 1 can record the master HDR video as an HDR video onto the optical disc 11, and have the playback device 2 play back the HDR video image and display it on the display device 3.

[0270] Furthermore, the recording device 1 can convert the master HDR video into a STD video and record it on the optical disc 11, and can cause the playback device 2 to restore the HDR video and display the HDR video image on the display device 3.

[0271] By allowing the brightness characteristics of the master HDR video to be specified by HDR information when playing HDR video, content authors can display HDR video images with the brightness they intended.

[0272] <6. Variations> [Flag storage location] In the above, HDR_flag and mode_flag are stored in Clip Information, but they may be stored in a PlayList.

[0273] First example of storage position FIG. 35 is a diagram showing an example of the syntax of AppInfoPlayList() included in the PlayList file of FIG.

[0274] As described above, AppInfoPlayList() stores parameters related to the playback control of the PlayList, such as playback restrictions, etc. In the example of Fig. 35, MVC_Base_view_R_flag is followed by HDR_flag and mode_flag.

[0275] In this way, it is also possible to describe HDR_flag and mode_flag in the AppInfoPlayList() of the PlayList file.

[0276] Second example of storage position FIG. 36 is a diagram showing the syntax of PlayList() included in the PlayList file of FIG.

[0277] The number_of_PlayItems indicates the number of PlayItems in the PlayList. In the example of Fig. 14, the number of PlayItems is 3. The value of PlayItem_id is assigned from 0 in the order in which the PlayItem() appears in the PlayList.

[0278] The number_of_SubPaths indicates the number of Sub Paths in the PlayList. In the example of Fig. 14, the number of Sub Paths is 3. The value of the SubPath_id is assigned from 0 in the order in which the SubPath() appears in the PlayList.

[0279] As shown in FIG. 36, in the PlayList(), the same number of PlayItem() as the number of PlayItems is described, and the same number of SubPath() as the number of SubPaths is described.

[0280] FIG. 37 is a diagram showing the syntax of PlayItem() in FIG.

[0281] Clip_Information_file_name[0] indicates the name of the Clip Information file of the Clip referenced by the PlayItem. Clip_codec_identifier[0] indicates the codec format of the Clip.

[0282] IN_time indicates the start position of the playback section of the PlayItem, and OUT_time indicates the end position. After OUT_time, UO_mask_table(), PlayItem_random_access_mode, and still_mode are included.

[0283] STN_table() includes information on the AV stream referenced by the PlayItem. If there is a SubPath that is associated with the PlayItem and played back, it also includes information on the AV stream referenced by the SubPlayItem that composes the SubPath.

[0284] FIG. 38 is a diagram showing the syntax of STN_table() in FIG.

[0285] number_of_video_stream_entries indicates the number of video streams entered (registered) in STN_table(), number_of_audio_stream_entries indicates the number of 1st audio stream streams entered in STN_table(), and number_of_audio_stream2_entries indicates the number of 2nd audio stream streams entered in STN_table().

[0286] "number_of_PG_textST_stream_entries" indicates the number of PG_textST streams entered in STN_table(). PG_textST streams are PG (Presentation Graphics) streams that are run-length encoded bitmap subtitles and text subtitle files (textST). "number_of_IG_stream_entries" indicates the number of IG (Interactive Graphics) streams entered in STN_table().

[0287] STN_table() describes stream_entry() and stream_attributes(), which are information about each video stream, 1st audio stream, 2nd audio stream, PG_textST stream, and IG stream. stream_entry() contains the PID of the stream, and stream_attributes() contains attribute information of the stream.

[0288] FIG. 39 is a diagram showing an example of a description related to a video stream, out of the descriptions in stream_attributes() in FIG.

[0289] In the example of stream_attributes() in Fig. 39, stream_coding_type, video_format, and frame_rate are described as attribute information of the video stream, followed by HDR_flag and mode_flag. Note that stream_coding_type indicates the coding method of the video stream, video_format indicates the video format, and frame_rate indicates the frame rate of the video.

[0290] In this way, it is also possible to describe HDR_flag and mode_flag in the STN_table() of the PlayList file.

[0291] It is also possible to describe HDR_flag and mode_flag at a position in the PlayList file other than AppInfoPlayList() and STN_table(). Similarly, it is also possible to describe HDR_flag and mode_flag at a position in the Clip Information file other than StreamCodingInfo described with reference to FIG. 19.

[0292] The positions where HDR_flag and mode_flag are described are arbitrary; for example, one of HDR_flag and mode_flag may be described in the Clip Information file and the other in the PlayList file.

[0293] [PSR] FIG. 40 is a diagram showing an example of PSR allocation.

[0294] As described above, register 53A of the playback device 2 is used as a PSR. In a BD, a PSR number is assigned to each PSR, and the use of each PSR is defined.

[0295] HDR_capability_flag is stored in PSR29, which is a PSR with a PSR number of 29. For example, a value of 1 for HDR_capability_flag in PSR29 indicates that the playback device 2 supports HDR video playback. A value of 0 for HDR_capability_flag in PSR29 indicates that the playback device 2 does not support HDR video playback.

[0296] HDR_capability_flag is referenced by the controller 51 executing the disc navigation program, for example, when an optical disc in which the value of HDR_flag in Clip Information is set to 1, that is, an optical disc on which recording has been performed with HDR video as the master, is inserted. If the value of HDR_capability_flag is set to 0, a message is displayed requesting that a display device compatible with HDR video processing be connected to the playback device 2.

[0297] PSR25, which is a PSR with a PSR number of 25, is used as the PSR that records information indicating the HDR video compatibility of the connected monitor. In this case, information indicating the performance of the monitor of the display device 3, which is indicated by the EDID obtained from the display device 3, is stored in PSR25.

[0298] For example, PSR25 for HDR Display Capability stores information indicating HDR_display_capability_flag and brightness specifications. A value of 1 for HDR_display_capability_flag indicates that the connected monitor is capable of displaying HDR video. A value of 0 for HDR_display_capability_flag indicates that the connected monitor is not capable of displaying HDR video.

[0299] As information indicating the brightness specifications, for example, information indicating up to what percentage of brightness display is possible is stored.

[0300] Instead of using PSR25 for HDR display capability, information indicating HDR_display_capability_flag and the luminance specification may be stored in PSR23, which is a PSR for display capability.

[0301] <7. Example of adjusting brightness on the playback device> In the above, it has been described that the display device 3 adjusts the brightness by itself when the HDR video transmitted from the playback device 2 cannot be displayed as is, but the brightness adjustment of the HDR video may also be performed by the playback device 2. The display device 3 receives the HDR video whose brightness has been adjusted by the playback device 2, and displays the image of the HDR video.

[0302] [Signal processing in mode-i] FIG. 41 is a diagram showing an example of signal processing in mode-i when the luminance adjustment of HDR video is performed by the playback device 2.

[0303] Of the processes shown in Fig. 41, the processes performed by the recording device 1 and the processes related to the output of STD video performed by the playback device 2 are the same as those described with reference to Fig. 2. Duplicate descriptions will be omitted as appropriate. It is assumed that the register 53A of the playback device 2 stores the above-mentioned HDR_display_capability_flag and information indicating the brightness specifications.

[0304] The playback device 2 reads the HEVC stream from the optical disc 11, and extracts HDR information and tone mapping definition information from the SEI of the HEVC stream, as indicated by the ends of arrows #21 and #22.

[0305] Furthermore, the playback device 2 decodes the HEVC encoded data, as indicated by the tip of arrow #23. If the display device 3 has an HDR monitor but cannot display the HDR video as is, the playback device 2 adjusts the brightness of the HDR video obtained by decoding the encoded data, as shown at the end of arrow #301.

[0306] For example, if the dynamic range of the HDR video indicated by the HDR information is 0-400%, and the information indicating the brightness specifications stored in the register 53A indicates that the dynamic range of the monitor 104 is 0-300%, the playback device 2 adjusts the brightness. In this case, the brightness of each pixel value is compressed to the range of 0-300%.

[0307] When the brightness of the HDR video is adjusted, the playback device 2 rewrites the HDR information, as indicated by the tip of arrow #302. The rewritten HDR information becomes information that indicates the brightness characteristics of the HDR video after the brightness adjustment.

[0308] As indicated by arrow #303, the playback device 2 adds HDR information to the brightness-adjusted HDR video data, and outputs the data to the display device 3, as indicated by arrow #304.

[0309] [Signal processing in mode-ii] FIG. 42 is a diagram showing an example of signal processing in mode-ii when the luminance adjustment of HDR video is performed by the playback device 2.

[0310] Of the processes shown in Fig. 42, the processes performed by the recording device 1 and the processes related to outputting the STD video performed by the playback device 2 are the same as the processes described with reference to Fig. 4. Duplicate descriptions will be omitted as appropriate.

[0311] The playback device 2 reads the HEVC stream from the optical disc 11, and extracts HDR information and tone mapping definition information from the SEI of the HEVC stream, as indicated by the ends of arrows #101 and #102.

[0312] Furthermore, the playback device 2 decodes the HEVC encoded data, as indicated by the arrow #103. If the display device 3 has an HDR monitor, the playback device 2 converts the STD video obtained by decoding the encoded data into HDR video, as indicated by the arrow #105, using tone mapping definition information for STD-HDR conversion extracted from the HEVC stream.

[0313] If the display device 3 has an HDR monitor but cannot display the HDR video as is, the playback device 2 adjusts the brightness of the HDR video, as shown at the end of arrow #311, and rewrites the HDR information, as shown at the end of arrow #312.

[0314] As indicated by arrow #313, the playback device 2 adds HDR information to the brightness-adjusted HDR video data, and outputs the data to the display device 3, as indicated by arrow #314.

[0315] In this way, when the brightness of the HDR video is adjusted by the playback device 2, the HDR information is rewritten to represent the brightness characteristics after the adjustment, and is transmitted to the display device 3 together with the HDR video data.

[0316] The display device 3 recognizes that an HDR video is being transmitted based on the HDR information, and can display the HDR video image on the monitor 104 according to the luminance specified by the rewritten HDR information.

[0317] [Configuration of playback device 2] FIG. 43 is a block diagram showing an example configuration of the HDR video output unit 75A in FIG.

[0318] The HDR video output unit 75A is composed of a brightness adjustment unit 111 and a rewriting unit 112. The HDR video supplied from the HEVC decoder 72 or the STD-HDR conversion unit 74 is input to the brightness adjustment unit 111. In addition, the HDR information supplied from the parameter extraction unit 71 is input to the rewriting unit 112.

[0319] The brightness adjustment unit 111 adjusts the brightness of the HDR video and outputs the brightness-adjusted HDR video.

[0320] The rewriting unit 112 rewrites the HDR information so as to represent the adjusted luminance characteristics based on the adjustment result by the luminance adjustment unit 111. The rewritten HDR information is added to the luminance-adjusted HDR video and transmitted to the display device 3.

[0321] [Decryption process of playback device 2] Here, the decoding process in mode-i performed in step S44 in Fig. 31 will be described with reference to the flowchart in Fig. 44. In the process in Fig. 44, the luminance of the HDR video is adjusted as appropriate.

[0322] Among the processes shown in Fig. 44, the processes in steps S151 to S153 and S158 to S160 are the same as the processes in steps S61 to S63 and S65 to S67 in Fig. 32, respectively. Duplicate descriptions will be omitted as appropriate.

[0323] In step S151, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream.

[0324] In step S152, the HEVC decoder 72 decodes the HEVC encoded data and outputs the HDR video obtained by the decoding.

[0325] In step S153, the controller 51 determines whether or not the monitor of the display device 3 is an HDR monitor.

[0326] When it is determined in step S153 that the monitor of the display device 3 is an HDR monitor, in step S154, the controller 51 determines whether or not the HDR video can be displayed on the monitor 104 of the display device 3 as is.

[0327] If it is determined in step S154 that the HDR video cannot be displayed as is, in step S155, the brightness adjustment unit 111 of the HDR video output unit 75A adjusts the brightness of the HDR video decoded by the HEVC decoder 72 in accordance with the display performance of the monitor 104.

[0328] In step S156, the rewriting unit 112 rewrites the HDR information based on the result of the luminance adjustment.

[0329] In step S157, the HDR video output unit 75A outputs the HDR video after the brightness adjustment together with the rewritten HDR information.

[0330] If it is determined in step S154 that the HDR video can be displayed as is, the processes of steps S155 and S156 are skipped. In this case, in step S157, the HDR video output unit 75A outputs the HDR video decoded by the HEVC decoder 72 together with the HDR information extracted by the parameter extraction unit 71.

[0331] In step S160, it is determined whether or not playback has ended, and if it is determined that playback has ended, the process ends. After that, the process returns to step S44 in Fig. 31, and the subsequent processes are performed.

[0332] Next, the decoding process in mode-ii performed in step S45 in Fig. 31 will be described with reference to the flowchart in Fig. 45. In the process in Fig. 45, the luminance of the HDR video is adjusted as appropriate.

[0333] Among the processes shown in Fig. 45, the processes in steps S171 to S174, S179, and S180 are the same as the processes in steps S81 to S84, S86, and S87, respectively, in Fig. 33. Duplicate descriptions will be omitted as appropriate.

[0334] In step S171, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream.

[0335] In step S172, the HEVC decoder 72 decodes the HEVC encoded data, and outputs the STD video obtained by the decoding.

[0336] In step S173, the controller 51 determines whether or not the monitor of the display device 3 is an HDR monitor.

[0337] If it is determined in step S173 that the monitor of the display device 3 is an HDR monitor, in step S174, the STD-HDR conversion unit 74 converts the decoded STD video into HDR video based on tone mapping definition information for STD-HDR conversion.

[0338] In step S175, the controller 51 determines whether or not the HDR video obtained by converting the STD video can be displayed on the monitor 104 of the display device 3 as is.

[0339] If it is determined in step S175 that the HDR video cannot be displayed as is, in step S176, the brightness adjustment unit 111 of the HDR video output unit 75A adjusts the brightness of the HDR video obtained by converting the STD video in accordance with the display performance of the monitor 104.

[0340] In step S177, the rewriting unit 112 rewrites the HDR information based on the luminance adjustment result.

[0341] In step S178, the HDR video output unit 75A outputs the HDR video after the brightness adjustment together with the rewritten HDR information.

[0342] If it is determined in step S175 that the HDR video can be displayed as is, the processes of steps S176 and S177 are skipped. In this case, in step S178, the HDR video output unit 75A outputs the HDR video obtained by converting the STD video together with the HDR information extracted by the parameter extraction unit 71.

[0343] In step S180, it is determined whether or not playback has ended, and if it is determined that playback has ended, the process ends. After that, the process returns to step S45 in Fig. 31, and the subsequent processes are performed.

[0344] [Display processing of display device 3] Next, the display process of the display device 3 will be described with reference to the flowchart of FIG.

[0345] The processing in Fig. 46 is performed after the processing in Fig. 44 or 45 by the playback device 2. To the display device 3 having an HDR monitor, the playback device 2 transmits, together with the HDR information, an original HDR video without brightness adjustment or an HDR video after brightness adjustment.

[0346] In step S191, the HDMI communication unit 102 of the display device 3 receives the HDR video and HDR information transmitted from the playback device 2.

[0347] In step S192, the signal processing unit 103 displays the HDR video image on the monitor 104 according to the luminance specified by the HDR information.

[0348] In step S193, the controller 101 determines whether or not to end the display, and if it is determined not to end the display, the processes from step S191 onward are repeated. If it is determined in step S193 that the display is to end, the controller 101 ends the process.

[0349] In this way, when the brightness adjustment is performed by the playback device 2, the display device 3 does not need to determine whether or not it can directly display the HDR video transmitted from the playback device 2. Furthermore, the display device 3 does not need to adjust the brightness of the HDR video by itself.

[0350] When it is necessary to adjust the brightness of HDR video, the user of the playback device 2 may be able to set whether the brightness adjustment is to be performed on the playback device 2 side or on the display device 3 side.

[0351] Furthermore, the display device 3 may notify the playback device 2 as to whether the brightness adjustment will be performed on the playback device 2 side or on the display device 3 side, and the processing performed in the playback device 2 may be switched in response to the notification. For example, if the display device 3 has a function for adjusting the brightness of HDR video, the display device 3 may be notified that the brightness adjustment will be performed on its side, and if the display device 3 does not have the function for adjusting the brightness of HDR video, the display device 3 may be notified that the brightness adjustment will be performed on its side.

[0352] When notified by the display device 3 that the brightness adjustment will be performed on the playback device 2 side, the playback device 2 performs the process of Fig. 44 or Fig. 45 as the decoding process. When notified by the display device 3 that the brightness adjustment will be performed on the display device 3 side, the playback device 2 performs the process of Fig. 32 or Fig. 33 as the decoding process.

[0353] The parameters used for the brightness adjustment performed by the playback device 2 may differ from those used by the display device 3. In this case, it is considered preferable from the viewpoint of image quality to have the brightness adjustment performed by the display device 3, which has a monitor 104 and can perform adjustment more suited to the characteristics of the monitor 104.

[0354] By having the display device 3 select whether the brightness adjustment is performed on the playback device 2 side or on the display device 3 side, it becomes possible to display HDR video with good image quality. The selection of whether the brightness adjustment is performed on the playback device 2 side or on the display device 3 side can be made based on a user's operation. For example, when a user operates a remote controller or a button provided on the main body of the display device 3 to instruct the display of a menu screen, the controller 101 of the display device 3 controls the signal processing unit 103 to display a menu screen including setting items related to HDR video on the monitor 104. When a setting item related to HDR video is selected, a screen used for selecting whether the brightness adjustment is performed on the playback device 2 side or on the display device 3 side is displayed, and the user selects one of them. The display device 3 notifies the playback device 2 of whether the brightness adjustment of HDR video is performed on the playback device 2 side or on the display device 3 side by transmitting information indicating the user's selection to the playback device 2 via the HDMI cable 4.

[0355] Notification as to whether the brightness of HDR video is to be adjusted on the playback device 2 side or on the display device 3 side can be realized by using HDMI EDID.

[0356] <8. Example of application to HDMI> [HDR EDID and HDR InfoFrame] FIG. 47 is a diagram showing an example of recognition based on information transmitted and received via HDMI.

[0357] As shown on the left side of Fig. 47, the playback device 2, which is a BD player compatible with 4K resolution HDR video processing, reads out EDID stored in memory 101A of the display device 3. The memory 101A of the display device 3 stores multiple EDIDs, such as an EDID that indicates the performance of the monitor 104 of the display device 3.

[0358] When the EDID read from the display device 3 includes an HDR EDID, the playback device 2 recognizes that the display device 3 is a device with an HDR monitor and is capable of outputting HDR video to the display device 3. The HDR EDID includes information about the output of HDR video. The HDR EDID is used to notify whether the brightness of the HDR video will be adjusted on the playback device 2 side or on the display device 3 side.

[0359] As shown on the right side of Fig. 47, the playback device 2 adds an HDR InfoFrame to data of each frame of HDR video to be output to the display device 3. In the HDMI standard, an InfoFrame is added to each frame of video. The video InfoFrame contains information about the video specifications, such as information indicating whether the video data is RGB data or YCbCr data, and information indicating the aspect ratio.

[0360] The HDR InfoFrame is an InfoFrame that includes information about the specifications of HDR video. HDR information indicating the luminance characteristics of HDR video is transmitted using the HDR InfoFrame. The playback device 2 outputs HDR video data with the HDR InfoFrame added to the display device 3.

[0361] When an HDR InfoFrame is added to the video data transmitted from the playback device 2, the display device 3 recognizes that the video data transmitted from the playback device 2 is HDR video data. After that, the display device 3 displays the HDR video image on the HDR monitor.

[0362] FIG. 48 is a diagram showing another example of recognition based on information transmitted and received via HDMI.

[0363] 48, if the EDID read from the display device 3 does not include an HDR EDID, the playback device 2 recognizes that the display device 3 is a device that does not have an HDR monitor. In this case, the playback device 2 outputs only STD video data to the display device 3. No HDR InfoFrame is added to the STD video data output by the playback device 2.

[0364] On the other hand, as shown on the right side of Fig. 48, if an HDR InfoFrame is not added to the video data transmitted from the playback device 2, the display device 3 recognizes that the video data transmitted from the playback device 2 is STD video data. After that, the display device 3 displays the STD video image on the STD monitor.

[0365] In this way, it is possible to use HDMI InfoFrame to transmit HDR information from the playback device 2 to the display device 3. Also, it is possible to use HDMI EDID to notify the playback device 2 from the display device 3 whether the brightness of the HDR video will be adjusted on the playback device 2 side or the display device 3 side.

[0366] FIG. 49 is a diagram illustrating an example of HDR EDID.

[0367] The HDR EDID contains information indicating the maximum brightness of the monitor, information indicating the maximum expansion level, and a raw / cooked flag-1, which indicates whether the HDR video is output unprocessed or after adjusting the brightness of the HDR video if necessary.

[0368] The value of raw / cooked flag-1 being 1 indicates that the display device 3 is requesting that the HDR video be output without processing, that is, that the HDR video be output without brightness adjustment on the playback device 2 side. When the value of raw / cooked flag-1 is 1, the playback device 2 outputs the HDR video without adjusting the brightness, even if the dynamic range of the HDR video exceeds the display performance of the monitor 104.

[0369] For example, if the display device 3 has a function for adjusting the brightness of HDR video, the display device 3 sets the value of raw / cooked flag-1 to 1.

[0370] Furthermore, a value of 0 for raw / cooked flag-1 indicates that the display device 3 is requesting that the playback device 2 adjust the luminance of the HDR video before outputting it, if necessary. When the value of raw / cooked flag-1 is 0 and the dynamic range of the HDR video exceeds the display performance of the monitor 104, the playback device 2 adjusts the luminance of the HDR video in accordance with the display performance of the monitor 104, and outputs the adjusted HDR video.

[0371] For example, if the display device 3 does not have a function for adjusting the brightness of HDR video, the display device 3 sets the value of raw / cooked flag-1 to 0.

[0372] The decoding process of Fig. 32 or 33, in which the brightness adjustment is not performed on the playback device 2 side but on the display device 3 side, corresponds to the process when the value of raw / cooked flag-1 is 1. Also, the decoding process of Fig. 44 or 45, in which the brightness adjustment is performed on the playback device 2 side, corresponds to the process when the value of raw / cooked flag-1 is 0.

[0373] Hereinafter, the unprocessed output of HDR video by the playback device 2 will be referred to as raw output, and the output of HDR video after the playback device 2 adjusts the brightness of the HDR video if necessary will be referred to as cooked output.

[0374] FIG. 50 is a diagram showing an example of an HDR InfoFrame.

[0375] The HDR InfoFrame includes HDR information parameters ref_screen_luminance_white, extended_range_white_level, nominal_black_level_code_value, nominal_white_level_code_value, extended_white_level_code_value, and raw / cooked flag-2.

[0376] In addition, the HDR InfoFrame includes the raw / cooked flag-2, which indicates whether the output HDR video is a raw HDR video without brightness adjustment or an HDR video after brightness adjustment.

[0377] A value of 1 for raw / cooked flag-2 indicates that the output HDR video is unprocessed HDR video for which no brightness adjustment has been performed by the playback device 2. For example, when the value of raw / cooked flag-1 included in the HDR EDID is 1, the playback device 2 adds an HDR InfoFrame in which the value of raw / cooked flag-2 is set to 1 to the HDR video data and outputs the HDR InfoFrame.

[0378] Furthermore, a value of 0 for raw / cooked flag-2 indicates that the output HDR video is an HDR video after brightness adjustment. For example, when the value of raw / cooked flag-1 included in the HDR EDID is 0 and the dynamic range of the HDR video exceeds the display performance of the monitor 104, the playback device 2 adjusts the brightness and sets the value of raw / cooked flag-2 to 0. The playback device 2 adds an HDR InfoFrame in which the value of raw / cooked flag-2 is set to 0 to data of the HDR video after brightness adjustment, and outputs the HDR InfoFrame.

[0379] 32 or 33, where brightness adjustment is not performed on the playback device 2 side, raw / cooked flag-2 of the HDR InfoFrame is set to a value of 1. Also, in the decoding process of FIG. 44 or 45, where brightness adjustment may be performed on the playback device 2 side, raw / cooked flag-2 of the HDR InfoFrame may be set to a value of 0.

[0380] [Processing of playback device 2 and display device 3] Here, the processing of the playback device 2 and the display device 3 using HDR EDID and HDR InfoFrame will be described.

[0381] First, the process of the display device 3 for setting HDR EDID will be described with reference to the flowchart in FIG.

[0382] In step S211, the controller 101 of the display device 3 sets the value of raw / cooked flag-1 to 1 or 0, and stores information indicating the maximum brightness of the monitor, information indicating the maximum expansion level, and an HDR EDID consisting of raw / cooked flag-1 in the memory 101A.

[0383] In step S212, in response to the request from the playback device 2, the HDMI communication unit 102 reads out a plurality of EDIDs including the HDR EDID from the memory 101A and transmits the EDIDs to the playback device 2.

[0384] Next, the playback process of the playback device 2 will be described with reference to the flowchart in FIG. The process in FIG. 52 is started, for example, after the process in FIG.

[0385] In step S221, the controller 51 controls the disc drive 52 to read the PlayList and Clip Information, which are Database information, from the optical disc 11. The controller 51 also identifies an HEVC stream to be played back based on information included in the PlayList, and controls the disc drive 52 to read an AV stream including the identified HEVC stream from the optical disc 11.

[0386] In step S222, the controller 51 refers to HDR_flag and mode_flag included in the Clip Information. In this example, a value indicating that recording is being performed with the master as HDR video is set in HDR_flag.

[0387] In step S223, the controller 51 controls the HDMI communication unit 58 to read the EDID from the display device 3. The HDMI communication unit 58 requests the HDMI communication unit 102 of the playback device 2 to read the EDID, and the HDMI communication unit 58 acquires the multiple EDIDs transmitted in response to the request.

[0388] In step S224, the controller 51 determines whether the EDID read from the display device 3 includes an HDR EDID.

[0389] If it is determined in step S224 that the HDR EDID is included, the controller 51 recognizes that it is possible to output HDR video to the display device 3, and in step S225, stores information indicating the display performance of the monitor 104 in the register 53A. For example, the controller 51 stores information indicating the maximum luminance and maximum expansion level of the monitor, which are included in the HDR EDID, in the PSR 25 as information indicating the luminance specifications of the monitor. In addition, the controller 51 sets a value indicating that the monitor 104 is capable of displaying HDR video to HDR_display_capability_flag of the PSR 25.

[0390] In step S226, the controller 51 determines whether or not raw output is requested by the display device 3 based on the raw / cooked flag-1 included in the HDR EDID. In the case of the above example, the controller 51 determines that raw output is requested when the value of the raw / cooked flag-1 is 1, and determines that cooked output is requested when the value is 0.

[0391] When it is determined in step S226 that the raw output is requested, in step S227, the controller 51 performs HDR raw output processing which is processing for outputting the HDR video in raw form.

[0392] When it is determined in step S226 that the raw output is not requested, in step S228, the controller 51 performs HDR cooked output processing which is processing for outputting cooked HDR video.

[0393] On the other hand, if it is determined in step S224 that the HDR EDID is not included, in step S229, the controller 51 performs STD output processing, which is processing for outputting STD video. The output destination of the STD video by the STD output processing is a display device that does not have an HDR monitor, which is different from the display device 3.

[0394] After the video data is output in steps S227, S228, and S229, the process ends.

[0395] Next, the HDR raw output processing performed in step S227 in FIG. 52 will be described with reference to the flowchart in FIG.

[0396] In step S241, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the HEVC encoded data included in the HEVC stream to the HEVC decoder 72.

[0397] In step S242, the HEVC decoder 72 decodes the HEVC encoded data. When the recording mode is mode-i, the HDR video data obtained by decoding the encoded data is supplied to the HDR video output unit 75A. When the recording mode is mode-ii, the STD video data obtained by decoding the encoded data is supplied to the STD-HDR conversion unit 74.

[0398] In step S243, the controller 51 determines whether the recording mode is mode-i based on the value of mode_flag.

[0399] When it is determined in step S243 that the recording mode is mode-ii, in step S244, the STD-HDR conversion unit 74 converts the STD video supplied from the HEVC decoder 72 into HDR video based on the tone mapping definition information for STD-HDR conversion supplied from the parameter extraction unit 71. When it is determined in step S243 that the recording mode is mode-i, the processing of step S244 is skipped.

[0400] In step S245, the HDR video output unit 75A sets the value of 1, which indicates that the HDR video is an unprocessed HDR video that has not been subjected to brightness adjustment, to the raw / cooked flag-2. In addition, the HDR video output unit 75A generates an HDR InfoFrame that includes each parameter of the HDR information extracted by the parameter extraction unit 71 and the raw / cooked flag-2.

[0401] In step S246, the HDR video output unit 75A adds the HDR InfoFrame to the data of each frame of the HDR video and outputs it to the display device 3.

[0402] In step S247, the controller 51 judges whether or not the playback has ended, and if it is judged that the playback has not ended, the process returns to step S241 and repeats the above processing. If it is judged in step S247 that the playback has ended, the process returns to step S227 in FIG. 52 and the subsequent processing is performed.

[0403] Next, the HDR·cooked output process performed in step S228 in FIG. 52 will be described with reference to the flowchart in FIG.

[0404] In step S261, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the HEVC encoded data included in the HEVC stream to the HEVC decoder 72.

[0405] In step S262, the HEVC decoder 72 decodes the HEVC encoded data. When the recording mode is mode-i, the HDR video data obtained by decoding the encoded data is supplied to the HDR video output unit 75A. When the recording mode is mode-ii, the STD video data obtained by decoding the encoded data is supplied to the STD-HDR conversion unit 74.

[0406] In step S263, the controller 51 determines whether the recording mode is mode-i based on the value of mode_flag.

[0407] When it is determined in step S263 that the recording mode is mode-ii, in step S264, the STD-HDR conversion unit 74 converts the STD video supplied from the HEVC decoder 72 into HDR video based on the tone mapping definition information for STD-HDR conversion supplied from the parameter extraction unit 71. When it is determined in step S263 that the recording mode is mode-i, the processing of step S264 is skipped.

[0408] In step S265, the controller 51 compares the luminance characteristics of the HDR video indicated by the HDR information with the performance of the monitor 104 indicated by the information included in the HDR EDID, and determines whether the HDR video can be displayed as is on the monitor 104.

[0409] If it is determined in step S265 that the HDR video cannot be displayed as is, the brightness adjustment unit 111 of the HDR video output unit 75A adjusts the brightness of the HDR video according to the display performance of the monitor 104 in step S266.

[0410] In step S267, the rewriting unit 112 rewrites the HDR information based on the result of the luminance adjustment. If it is determined in step S265 that the HDR video can be displayed as is, the processes of steps S266 and S267 are skipped.

[0411] In step S268, the HDR video output unit 75A sets a predetermined value to the raw / cooked flag-2, and generates an HDR InfoFrame including each parameter of the HDR information.

[0412] For example, if the brightness of the HDR video has not been adjusted, the HDR video output unit 75A sets the value of raw / cooked flag-2 to 1, indicating this, and generates an HDR InfoFrame that includes the raw / cooked flag-2 and each parameter of the HDR information extracted by the parameter extraction unit 71.

[0413] On the other hand, if the brightness of the HDR video is adjusted, the HDR video output unit 75A sets the value of raw / cooked flag-2 to 0, indicating this, and generates an HDR InfoFrame that includes raw / cooked flag-2 and each parameter of the rewritten HDR information.

[0414] In step S269, the HDR video output unit 75A adds the HDR InfoFrame to the data of each frame of the HDR video and outputs it to the display device 3.

[0415] In step S270, the controller 51 judges whether or not the playback has ended, and if it is judged that the playback has not ended, the process returns to step S261 and repeats the above processing. If it is judged in step S270 that the playback has ended, the process returns to step S228 in FIG. 52 and the subsequent processing is performed.

[0416] Next, the STD output process performed in step S229 in FIG. 52 will be described with reference to the flowchart in FIG.

[0417] As described above, the process in FIG. 55 is a process for outputting video data to a display device that is different from the display device 3 and does not have an HDR monitor.

[0418] In step S281, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the HEVC encoded data included in the HEVC stream to the HEVC decoder 72.

[0419] In step S282, the HEVC decoder 72 decodes the HEVC encoded data. When the recording mode is mode-i, the HDR video data obtained by decoding the encoded data is supplied to the HDR-STD conversion unit 73. When the recording mode is mode-ii, the STD video data obtained by decoding the encoded data is supplied to the STD video output unit 75B.

[0420] In step S283, the controller 51 determines whether the recording mode is mode-i based on the value of mode_flag.

[0421] When it is determined in step S283 that the recording mode is mode-i, in step S284, the HDR-STD conversion unit 73 converts the HDR video supplied from the HEVC decoder 72 into an STD video based on the tone mapping definition information for HDR-STD conversion supplied from the parameter extraction unit 71. When it is determined in step S283 that the recording mode is mode-ii, the processing of step S284 is skipped.

[0422] In step S285, the STD video output unit 75B outputs the STD video supplied from the HEVC decoder 72 or the STD video supplied from the HDR-STD conversion unit 73.

[0423] In step S286, the controller 51 judges whether or not the playback has ended, and if it is judged that the playback has not ended, the process returns to step S281 and repeats the above processing. If it is judged in step S286 that the playback has ended, the process returns to step S229 in FIG. 52 and the subsequent processing is performed.

[0424] Next, the display process of the display device 3 will be described with reference to the flowchart of FIG.

[0425] An HDR InfoFrame is added to the video data transmitted by the playback device 2 to the display device 3 having an HDR monitor. The controller 101 of the display device 3 recognizes that the video data transmitted from the playback device 2 is HDR video data based on the HDR InfoFrame.

[0426] In step S301, the HDMI communication unit 102 of the display device 3 receives the HDR video data transmitted from the playback device 2. HDR InfoFrame is added to the data of each frame of the HDR video.

[0427] In step S302, the controller 101 determines whether or not the HDR video data is raw output data, based on the raw / cooked flag-2 included in the HDR InfoFrame.

[0428] When the value of raw / cooked flag-2 is set to 1, the controller 101 determines that the HDR video data is raw output data. Also, when the value of raw / cooked flag-2 is set to 0, the controller 101 determines that the HDR video data is cooked output data.

[0429] If it is determined in step S302 that the HDR video data is raw output data, in step S303, the signal processing unit 103 refers to the HDR information included in the HDR InfoFrame. When the dynamic range of the HDR video exceeds the display performance of the monitor 104, the signal processing unit 103 appropriately adjusts the luminance of the HDR video and causes the monitor 104 to display the image of the HDR video after the luminance adjustment.

[0430] On the other hand, if it is determined in step S302 that the HDR video data is cooked output data, in step S304, the signal processing unit 103 causes the monitor 104 to display the HDR video image in accordance with the HDR information included in the HDR InfoFrame.

[0431] After the image of the HDR video is displayed in step S303 or step S304, in step S305, the controller 101 determines whether or not to end the display of the HDR video, and if it is determined not to end, the processes from step S301 onward are repeated. If it is determined in step S305 that the display is to end, the controller 101 ends the process.

[0432] Through the above series of processes, the playback device 2 can use the HDMI InfoFrame to transmit HDR information to the display device 3. In addition, the display device 3 can use the HDMI EDID to request whether the brightness adjustment of the HDR video should be performed on the playback device 2 side or on the display device 3 side.

[0433] <9. Other variations> When HDR video data is transmitted from the playback device 2 to the display device 3, HDR information is added and transmitted, but the data may be transmitted without adding HDR information.

[0434] Although the above description is mainly based on the case where the playback device 2 is a BD player, the above-mentioned functions of the playback device 2 may be incorporated in a mobile terminal. In this case, the mobile terminal will function as the playback device 2.

[0435] Furthermore, although the content played back by the playback device 2 has been described as being content recorded on a removable medium, the above-described technology can also be applied to the case of playing back content distributed over a network. In this case, the playback device 2 receives content transmitted from a server connected over a network such as the Internet, plays the content, and outputs the HDR video to the display device 3.

[0436] [Example of computer configuration] The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed from a program recording medium into a computer incorporated in dedicated hardware, or into a general-purpose personal computer, etc.

[0437] FIG. 57 is a block diagram showing an example of the hardware configuration of a computer that executes the above-mentioned series of processes by a program.

[0438] The CPU 501 , ROM 502 , and RAM 503 are connected to each other via a bus 504 .

[0439] An input / output interface 505 is further connected to the bus 504. An input unit 506 including a keyboard, a mouse, etc., and an output unit 507 including a display, a speaker, etc. are connected to the input / output interface 505. In addition, a storage unit 508 including a hard disk, a non-volatile memory, etc., a communication unit 509 including a network interface, etc., and a drive 510 that drives a removable media 511 are connected to the input / output interface 505.

[0440] In the computer configured as above, the CPU 501 loads a program stored in the storage unit 508 into the RAM 503 via the input / output interface 505 and the bus 504 and executes the program, thereby performing the above-mentioned series of processes.

[0441] The programs executed by the CPU 501 are installed in the storage unit 508 by being recorded on a removable medium 511, or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting.

[0442] In addition, the program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called.

[0443] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

[0444] In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.

[0445] [Examples of configuration combinations] The present technology can also be configured as follows.

[0446] (1) a reading unit that reads out, from a recording medium on which encoded data of an extended video, which is a video having a second luminance range wider than a first luminance range, luminance characteristic information indicating luminance characteristics of the extended video, and luminance conversion definition information used when performing luminance conversion from the extended video to a standard video, which is a video having the first luminance range, the encoded data, the luminance characteristic information, and the luminance conversion definition information are recorded; A decoding unit that decodes the encoded data; a conversion unit that converts the extended video obtained by decoding the encoded data into the standard video based on the luminance conversion definition information; an output unit that outputs the data of the extended video and the luminance characteristic information to a display device capable of displaying the extended video, and outputs the data of the standard video to a display device that cannot display the extended video; A playback device comprising: (2) The luminance characteristic information and the luminance conversion definition information are inserted into a stream including the encoded data as auxiliary information of the encoded data, and are recorded on the recording medium. The playback device according to (1) above. (3) The encoded data is HEVC encoded data, and the luminance characteristic information and the luminance conversion definition information are SEI of an HEVC stream. The playback device according to (2) above. (4) the luminance conversion definition information is first Tone mapping information in which a value of tone_map_model_id is set to any one of 0, 2, and 3; The luminance characteristic information is second Tone mapping information in which the value of tone_map_model_id is set to 4. The playback device according to (3) above. (5) The first Tone mapping information and the second Tone mapping information are set to the same value indicating the recording mode of the recording medium in tone_map_model_id. The playback device according to (4) above. (6) information related to playback of the encoded data, including a flag indicating whether or not recording has been performed using the extended video as a master, is further recorded on the recording medium; The decoding unit decodes the encoded data when the flag indicates that recording has been performed using the extended video as a master. A playback device according to any one of (1) to (5). (7) the recording medium is a Blu-ray disc, The flag is included in a Clip Information file as information related to the playback. The playback device according to (6) above. (8) the recording medium is a Blu-ray disc, The flag is included in a PlayList file as information related to the playback. The playback device according to (6) above. (9) reading out, from a recording medium on which encoded data of an extended video, which is a video having a second luminance range wider than a first luminance range, luminance characteristic information indicating luminance characteristics of the extended video, and luminance conversion definition information used when performing luminance conversion from the extended video to a standard video, which is a video having the first luminance range, the encoded data, the luminance characteristic information, and the luminance conversion definition information are recorded; Decoding the encoded data; converting the extended video obtained by decoding the encoded data into the standard video based on the luminance conversion definition information; outputting the extended video data and the luminance characteristic information to a display device capable of displaying the extended video; Outputting the standard video data to a display device that cannot display the extended video data. A method of reproduction including steps. (10) Encoded data of an extended video, which is a video having a second luminance range wider than the first luminance range; and luminance characteristic information indicating a luminance characteristic of the extended video. luminance conversion definition information used when performing luminance conversion from the extended video to a standard video which is a video of the first luminance range; A recording medium having the following recorded thereon: In the reproducing device for reproducing the recording medium, reading out the encoded data, the luminance characteristic information, and the luminance conversion definition information from the recording medium; Decoding the encoded data; converting the extended video obtained by decoding the encoded data into the standard video based on the luminance conversion definition information; outputting the extended video data and the luminance characteristic information to a display device capable of displaying the extended video; Outputting the standard video data to a display device that cannot display the extended video data. The recording medium on which processing takes place. (11) a reading unit for reading out, from a recording medium on which encoded data of a standard video, which is a video having a first luminance range obtained by performing luminance conversion on an extended video, which is a video having a second luminance range wider than a first luminance range, luminance characteristic information indicating luminance characteristics of the extended video, and luminance conversion definition information used when performing luminance conversion from the standard video to the extended video, the encoded data, the luminance characteristic information, and the luminance conversion definition information are recorded; A decoding unit that decodes the encoded data; a conversion unit that converts the standard video obtained by decoding the encoded data into the extended video based on the luminance conversion definition information; an output unit that outputs the data of the extended video and the luminance characteristic information to a display device capable of displaying the extended video, and outputs the data of the standard video to a display device that cannot display the extended video; A playback device comprising: (12) The luminance characteristic information and the luminance conversion definition information are inserted into a stream including the encoded data as auxiliary information of the encoded data, and are recorded on the recording medium. The playback device according to (11) above. (13) The encoded data is HEVC encoded data, and the luminance characteristic information and the luminance conversion definition information are SEI of an HEVC stream. The playback device according to (12) above. (14) the luminance conversion definition information is first Tone mapping information in which a value of tone_map_model_id is set to any one of 0, 2, and 3; The luminance characteristic information is second Tone mapping information in which the value of tone_map_model_id is set to 4. The playback device according to (13) above. (15) The first Tone mapping information and the second Tone mapping information are set to the same value indicating the recording mode of the recording medium in tone_map_model_id. The playback device according to (14) above. (16) information related to playback of the encoded data, including a flag indicating whether or not recording has been performed using the extended video as a master, is further recorded on the recording medium; The decoding unit decodes the encoded data when the flag indicates that recording has been performed using the extended video as a master. The playback device according to any one of (11) to (15). (17) the recording medium is a Blu-ray disc, The flag is included in a Clip Information file as information related to the playback. The playback device according to (16) above. (18) the recording medium is a Blu-ray disc, The flag is included in a PlayList file as information related to the playback. The playback device according to (16) above. (19) reading out, from a recording medium on which encoded data of a standard video, which is a video having a first luminance range, obtained by performing luminance conversion on an extended video, which is a video having a second luminance range wider than a first luminance range, luminance characteristic information indicating luminance characteristics of the extended video, and luminance conversion definition information used when performing luminance conversion from the standard video to the extended video, the encoded data, the luminance characteristic information, and the luminance conversion definition information are recorded; Decoding the encoded data; converting the standard video obtained by decoding the encoded data into the extended video based on the luminance conversion definition information; outputting the extended video data and the luminance characteristic information to a display device capable of displaying the extended video; Outputting the standard video data to a display device that cannot display the extended video data. A method of reproduction including steps. (20) Encoded data of a standard video, which is a video having a first luminance range, obtained by performing luminance conversion on an extended video, which is a video having a second luminance range wider than a first luminance range; brightness characteristic information indicating a brightness characteristic of the extended video; luminance conversion definition information used when performing luminance conversion from the standard video to the extended video; A recording medium having the following recorded thereon: In the reproducing device for reproducing the recording medium, reading out the encoded data, the luminance characteristic information, and the luminance conversion definition information from the recording medium; Decoding the encoded data; converting the standard video obtained by decoding the encoded data into the extended video based on the luminance conversion definition information; outputting the extended video data and the luminance characteristic information to a display device capable of displaying the extended video; Outputting the standard video data to a display device that cannot display the extended video data. The recording medium on which processing takes place. [Explanation of symbols]

[0447] 1 Recording device, 2 Playback device, 3 Display device, 11 Optical disk, 21 Controller, 21A Data Base information generation unit, 22 Encoding processing unit, 23 Disk drive, 31 HDR information generation unit, 32 HEVC encoder, 33 HDR-STD conversion unit, 34 Definition information generation unit, 35 HEVC stream generation unit, 51 Controller, 52 Disk drive, 53 Memory, 56 Decoding processing unit, 58 HDMI communication unit, 71 Parameter extraction unit, 72 HEVC decoder, 73 HDR-STD conversion unit, 74 STD-HDR conversion unit, 75 Output unit

Claims

1. a receiving unit for receiving encoded data of a standard image obtained by performing luminance conversion of an extended image, which is an image having a second luminance range wider than a first luminance range, the standard image being an image having the first luminance range, the encoded data, luminance characteristic information representing luminance characteristics of the extended image, and luminance conversion definition information used when performing luminance conversion from the standard image to the extended image; a control unit for controlling a process of decoding the encoded data, a process of converting the standard image obtained by decoding the encoded data into the extended image based on the luminance conversion definition information, and a process of adjusting the luminance of the converted extended image when the extended image cannot be displayed as is as a result of comparing the luminance characteristic information with a display performance; a display control unit that controls display of the extended image; A signal processing device comprising:

2. The luminance characteristic information and the luminance conversion definition information are inserted into a stream including the encoded data as auxiliary information of the encoded data. The signal processing device according to claim 1 .

3. The encoded data is encoded data of HEVC (High Efficiency Video Coding), and the brightness characteristic information and the brightness conversion definition information are inserted as SEI (Supplemental Enhancement Information) of an HEVC stream. The signal processing device according to claim 2 .

4. The luminance characteristic information includes a parameter representing the luminance of a standard monitor.

4. A signal processing device according to claim 1.

5. The brightness characteristic information includes a parameter representing a maximum brightness of the extended image.

5. A signal processing device according to claim 1.

6. The luminance characteristic information includes a parameter representing a black level and a parameter representing a white level.

6. A signal processing device according to claim 1.

7. The receiving unit receives the encoded data of the standard video via a network.

7. A signal processing device according to claim 1.

8. A signal processing device, receiving encoded data of a standard image obtained by performing luminance conversion of an extended image, which is an image having a second luminance range wider than a first luminance range, the standard image being an image having the first luminance range; luminance characteristic information representing luminance characteristics of the extended image; and luminance conversion definition information used when performing luminance conversion from the standard image to the extended image; Decoding the encoded data; converting the standard image obtained by decoding the encoded data into the extended image based on the luminance conversion definition information; If the expanded image cannot be displayed as is as a result of comparing the brightness characteristic information with the display performance, the brightness of the converted expanded image is adjusted to control the display of the expanded image. Signal processing methods.

9. The luminance characteristic information and the luminance conversion definition information are inserted into a stream including the encoded data as auxiliary information of the encoded data. The signal processing method according to claim 8.

10. The encoded data is HEVC encoded data, and the brightness characteristic information and the brightness conversion definition information are inserted as SEI of an HEVC stream.

10. The signal processing method according to claim 8 or 9.

11. The luminance characteristic information includes a parameter representing the luminance of a standard monitor. A signal processing method according to any one of claims 8 to 10.

12. The brightness characteristic information includes a parameter representing a maximum brightness of the extended image. A signal processing method according to any one of claims 8 to 11.

13. The luminance characteristic information includes a parameter representing a black level and a parameter representing a white level. A signal processing method according to any one of claims 8 to 12.

14. The encoded data of the standard video is received via a network. A signal processing method according to any one of claims 8 to 13.

Images