Display device and display control method

Abstract

To allow content with a wide dynamic range of luminance to be displayed with appropriate brightness.SOLUTION: A display device of one aspect of the present technique includes: a display unit that supports the display of HDR video; a communication unit that receives the HDR video reproduced by a reproduction device based on the performance information of luminance of the display unit, together with luminance characteristic information in data of each frame; and a control unit that causes the display unit to display video according to the luminance characteristic information, when the display unit has luminance performance capable of displaying the HDR video output from the reproduction device, and causes the display unit to display video, after adjusting the luminance of the HDR video output from the reproduction device according to the luminance performance of the display unit when the display unit does not have the luminance performance capable of displaying the HDR video output from the reproduction device. This technique can be applied to television receivers.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present technology relates to a display device and a display control method, and more particularly to a display device and a display control method capable of displaying content with a wide dynamic range of luminance at an appropriate brightness.

Background Art

[0002] As a recording medium for content such as movies, there is a Blu-ray (registered trademark) Disc (hereinafter, appropriately referred to as BD). Conventionally, the mastering of videos recorded on BD has been performed by compressing the dynamic range of the master video on the premise of viewing it on a monitor with a standard luminance (100 nit = 100 cd / m 2 ).

[0003] The master video is shot with a high-quality camera and has a dynamic range greater than the dynamic range that can be displayed on a monitor with a standard luminance. By being compressed, the dynamic range of the master video is naturally impaired.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] Due to the progress of display technologies such as organic EL (Electroluminescence) displays and LCD (Liquid Crystal Display), monitors brighter than the standard, such as 500 nit or 1000 nit, are commercially available. There is a demand for content that takes advantage of the performance of such monitors with a wide dynamic range.

[0006] This technology has been developed in view of such a situation, and enables content with a wide dynamic range of luminance to be displayed at an appropriate brightness.

Means for Solving the Problem

[0007] A display device according to one aspect of this technology includes a display unit corresponding to the display of HDR video, a communication unit that receives the HDR video reproduced by a reproduction device together with luminance characteristic information in the data of each frame based on the luminance performance information of the display unit, and when the display unit has the performance of displaying the HDR video output from the reproduction device at a displayable luminance, causes the display unit to display an image according to the luminance characteristic information, and when the display unit does not have the performance of displaying the HDR video output from the reproduction device at a displayable luminance, adjusts the luminance of the HDR video output from the reproduction device according to the luminance performance of the display unit, and then causes the display unit to display an image.

[0008] A display control method according to one aspect of the present technology is such that a display device having a display unit corresponding to the display of an HDR video receives an HDR video reproduced by a playback device based on performance information of the luminance of the display unit and output from the playback device, and luminance characteristic information indicating the characteristics of luminance. When the display unit has the performance of luminance capable of displaying the HDR video output from the playback device, the display device causes the display unit to display the video without adjusting the luminance of the HDR video output from the playback device. When the display unit does not have the performance of luminance capable of displaying the HDR video output from the playback device, the display device adjusts the luminance of the HDR video output from the playback device based on the luminance characteristic information and then causes the display unit to display the video.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Figure 42

Figure 43

Figure 44

Figure 45

Figure 46

Figure 47

Figure 48

Figure 49

Figure 50

Figure 51

Figure 52

Figure 53

Figure 54

Figure 55

Figure 56

Figure 57

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments for carrying out the present technology will be described. The description will be given in the following order. 1. About the recording / playback system 2. About HEVC 3. About the BD format 4. About the configuration of each device 5. About the operation of each device 6. Modification examples 7. Example when adjusting the luminance on the playback device side 8. Example applied to HDMI 9. Other modification examples

[0011] <1. About the recording / playback system> FIG. 1 is a diagram showing a configuration example of a recording / playback system according to an embodiment of the present technology.

[0012] The recording / playback system in FIG. 1 is composed of a recording device 1, a playback device 2, and a display device 3. The playback device 2 and the display device 3 are connected via an HDMI (registered trademark) (High Definition Multimedia Interface) cable 4. The playback device 2 and the display device 3 may be connected via a cable of another standard, or may be connected via wireless communication.

[0013] The recording device 1 records content, and the playback device 2 plays back the content. The provision of content from the recording device 1 to the playback device 2 is performed using an optical disc 11. The optical disc 11 is a disc on which content is recorded in, for example, the BD-ROM (Blu-ray (registered trademark) Disc Read-Only) format.

[0014] The content may be recorded on the optical disc 11 in other formats such as BD-R and -RE. Also, the content may be provided from the recording device 1 to the playback device 2 using a removable medium other than an optical disc, such as a memory card equipped with a flash memory.

[0015] When the optical disc 11 is a BD-ROM disc, the recording device 1 becomes, for example, a device used by the content author. Hereinafter, it will be described that the optical disc 11 on which the content is recorded by the recording device 1 is provided to the playback device 2. However, actually, an optical disc is replicated based on the master disc on which the content is recorded by the recording device 1, and one of them, the optical disc 11, is provided to the playback device 2.

[0016] An HDR (High Dynamic Range) video, which is a video having a dynamic range (luminance range) greater than the dynamic range that can be displayed on a monitor with a standard luminance, is input to the recording device 1. The standard luminance is, for example, 100 cd / m 2 (=100 nit).

[0017] The recording device 1 records the input master HDR video as it is, that is, as a video having a dynamic range greater than the dynamic range that can be displayed on a monitor with a standard luminance, on the optical disc 11. In this case, information indicating the luminance characteristics of the master HDR video and information used when converting the HDR video to STD video are also recorded on the optical disc 11.

[0018] STD video (standard video) is a video having a dynamic range that can be displayed on a monitor with a standard luminance. If the dynamic range of STD video is 0 - 100%, the dynamic range of HDR video is represented as a range from 0% to 101% or more, such as 0 - 500% and 0 - 1000%.

[0019] Further, the recording device 1 converts the input master HDR video into an STD video, that is, converts it into a video having a dynamic range that can be displayed on a monitor having a standard luminance, and records it on the optical disk 11. In this case, information indicating the luminance characteristics of the master HDR video and information used when converting the STD video into an HDR video are also recorded on the optical disk 11.

[0020] The HDR video recorded by the recording device 1, or the STD video obtained by converting the HDR video, is, for example, a so-called 4K resolution video with a horizontal × vertical resolution of 4096 × 2160, 3840 × 2160 pixels, etc. For example, HEVC (High Efficiency Video Coding) is used for the encoding of video data by the recording device 1.

[0021] Information indicating the luminance characteristics of the master HDR video and information used when converting the HDR video into an STD video or the STD video into an HDR video are inserted into the HEVC encoded data as SEI (Supplemental Enhancement Information). The HEVC stream with SEI inserted into the HEVC encoded data is recorded on the optical disk 11 in the BD format.

[0022] The playback device 2 communicates with the display device 3 via the HDMI cable 4 and acquires information regarding the display performance of the display device 3. The playback device 2 identifies whether the display device 3 is a device having an HDR monitor, which is a monitor capable of displaying HDR video, or a device having an STD monitor, which is a monitor capable of displaying only STD video.

[0023] Further, the playback device 2 drives the drive, reads out and decodes the HEVC stream recorded on the optical disk 11.

[0024] For example, when the video data obtained by decoding in the playback device 2 is HDR video data and the display device 3 has an HDR monitor, the playback device 2 outputs the HDR video data obtained by decoding the HEVC stream to the display device 3. In this case, the playback device 2 outputs information indicating the luminance characteristics of the master HDR video to the display device 3 together with the HDR video data.

[0025] On the other hand, when the video data obtained by decoding in the playback device 2 is HDR video data and the display device 3 has an STD monitor, the playback device 2 converts the HDR video obtained by decoding the HEVC stream into STD video and outputs the STD video data. The conversion of the HDR video to STD video is performed using information recorded on the optical disc 11 and used when converting the HDR video to STD video.

[0026] When the video data obtained by decoding in the playback device 2 is STD video data and the display device 3 has an HDR monitor, the playback device 2 converts the STD video obtained by decoding the HEVC stream into HDR video and outputs the HDR video data to the display device 3. The conversion of the STD video to HDR video is performed using information recorded on the optical disc 11 and used when converting the STD video to HDR video. In this case, the playback device 2 outputs information indicating the luminance characteristics of the master HDR video to the display device 3 together with the HDR video.

[0027] On the other hand, when the video data obtained by decoding in the playback device 2 is STD video data and the display device 3 has an STD monitor, the playback device 2 outputs the STD video data obtained by decoding the HEVC stream to the display device 3.

[0028] The display device 3 receives the video data transmitted from the playback device 2 and displays the video of the content on the monitor. Audio data of the content is also transmitted from the playback device 2. The display device 3 outputs the audio of the content from the speaker based on the audio data transmitted from the playback device 2.

[0029] For example, when information indicating the luminance characteristics of the master's HDR video is transmitted together with the video data, the display device 3 recognizes that the video data transmitted from the playback device 2 is data of an HDR video. As described above, for the display device 3 having an HDR monitor, information indicating the luminance characteristics of the master's HDR video is transmitted together with the data of the HDR video.

[0030] In this case, the display device 3 displays the HDR video image according to the characteristics specified by the information indicating the luminance characteristics of the master's HDR video. That is, when the monitor of the display device 3 itself is a monitor having a dynamic range of 0 - 500%, and the information indicating the luminance characteristics of the master's HDR video designates that the dynamic range of the HDR video is a predetermined characteristic of 0 - 500%, the luminance is adjusted within the range of 0 - 500% according to the predetermined characteristic to display the image.

[0031] By enabling the specification of the luminance characteristics of the master's HDR video, the content author (Author) can display the video image with the intended luminance.

[0032] Normally, a display device such as a TV recognizes the video input from the outside as a video having a dynamic range of 0 - 100%. Also, when the monitor of the display device itself has a wider dynamic range, the display device expands the luminance by itself according to the characteristics of the monitor to display the video image. By specifying the luminance characteristics and adjusting the luminance of the HDR video according to the specified characteristics, it becomes possible to prevent the unintended luminance adjustment on the display device side.

[0033] Also, generally, a playback device that outputs video to a display device such as a TV converts the luminance according to the characteristics of the transmission path and then outputs the video. The display device that receives the video converts the luminance of the received video according to the characteristics of the monitor and displays the video. By outputting the HDR video as it is from the playback device 2 to the display device 3 without performing luminance conversion in the playback device 2, the number of luminance conversion times can be reduced, and it becomes possible to display a video with luminance closer to that of the master on the display device 3.

[0034] On the other hand, when the video data transmitted from the playback device 2 is STD video data, the display device 3 displays the STD video. The fact that STD video is transmitted from the playback device 2 means that the display device 3 is a device having an STD monitor.

[0035] Hereinafter, a mode in which the HDR video of the master is recorded on the optical disk 11 as it is is appropriately referred to as mode-i. In the case of mode-i, information indicating the luminance characteristics of the HDR video of the master and information used when converting the HDR video to STD video are recorded on the optical disk 11.

[0036] Also, a mode in which the HDR video of the master is converted to STD video and recorded on the optical disk 11 is referred to as mode-ii. In the case of mode-ii, information indicating the luminance characteristics of the HDR video of the master and information used when converting STD video to HDR video are recorded on the optical disk 11.

[0037] [Signal processing in mode-i] FIG. 2 is a diagram showing an example of signal processing in mode-i.

[0038] The left-side processing surrounded by the solid line L1 indicates the encoding process performed in the recording device 1, and the right-side processing surrounded by the solid line L2 indicates the decoding process performed in the playback device 2.

[0039] When the master's HDR video is input, the recording device 1 detects the luminance of the master's HDR video and generates HDR information, which is information indicating the luminance characteristics of the master's HDR video, as shown at the tip of arrow #1. Also, as shown at the tip of arrow #2, the recording device 1 encodes the master's HDR video using HEVC.

[0040] As shown at the tip of arrow #3, the recording device 1 converts the master's HDR video into STD video. The video of the converted STD video is displayed on a monitor (not shown). The conversion of the HDR video to STD video is appropriately performed while the author visually checks the video of the converted STD video and adjusts the conversion parameters.

[0041] Based on the adjustment by the author, as shown at the tip of arrow #4, the recording device 1 generates tone mapping definition information for HDR-STD conversion, which is information used when converting the HDR video into STD video.

[0042] The tone mapping definition information is information that defines the correspondence between each pixel value indicating brightness in a dynamic range such as 0 - 400% (wider than the standard dynamic range) and each pixel value indicating brightness in a dynamic range of 0 - 100% (the standard dynamic range).

[0043] As shown at the tip of arrow #5, the recording device 1 inserts the HDR information and the tone mapping definition information into the encoded data of HEVC as SEI and generates an HEVC stream. The recording device 1 records the generated HEVC stream on the optical disc 11 in BD format and provides it to the playback device 2 as shown at the tip of arrow #11.

[0044] In this way, the information indicating the luminance characteristics of the master's HDR video and the information used when converting the HDR video into STD video are provided to the playback device 2 in a form inserted into the stream using the SEI of HEVC.

[0045] The playback device 2 reads the HEVC stream from the optical disc 11 and extracts HDR information and tone mapping definition information from the SEI of the HEVC stream as shown at the tips of arrows #21 and #22.

[0046] Also, the playback device 2 decodes the encoded data of HEVC as shown at the tip of arrow #23. When the display device 3 has an HDR monitor, the playback device 2 adds HDR information to the data of the HDR video obtained by decoding the encoded data and outputs it to the display device 3 as shown at the tip of arrow #24.

[0047] On the other hand, when the display device 3 has an STD monitor, the playback device 2 uses the tone mapping definition information for HDR-STD conversion extracted from the HEVC stream to convert the HDR video obtained by decoding the encoded data into an STD video. The playback device 2 outputs the data of the converted STD video to the display device 3 as shown at the tip of arrow #27.

[0048] In this way, the data of the HDR video obtained by decoding the encoded data of HEVC is output to the display device 3 having an HDR monitor together with the HDR information. Also, the data of the HDR video obtained by decoding the encoded data of HEVC is output to the display device 3 having an STD monitor after being converted into an STD video.

[0049] Figure 3 is a diagram showing the flow of processing from when the master HDR video is input to the recording device 1 until the video data is output from the playback device 2.

[0050] The master HDR video is provided to the playback device 2 together with the HDR information and the tone mapping definition information for HDR-STD conversion generated in the recording device 1 based on the master HDR video as shown at the tip of the white arrow #51. The HDR information includes, for example, information indicating that the dynamic range is extended to the range of 0 - 400%.

[0051] When the display device 3 has an HDR monitor, in the playback device 2, as shown at the tips of arrows #52 and #53, HDR information is added to the data of the HDR video obtained by decoding the HEVC encoded data. Further, the data of the HDR video with HDR information added is output to the display device 3 as shown at the tip of arrow #54.

[0052] On the other hand, when the display device 3 has an STD monitor, in the playback device 2, as shown at the tips of arrows #55 and #56, the HDR video obtained by decoding the HEVC encoded data is converted to an STD video using tone mapping definition information for HDR-STD conversion. Further, the data of the converted STD video is output to the display device 3 as shown at the tip of arrow #57. In FIG. 3, the amplitudes of the waveforms indicating the HDR video and the STD video respectively indicate the dynamic range.

[0053] In this way, in mode-i, the master HDR video is recorded on the optical disc 11 as an HDR video. Also, depending on the performance of the display device 3 that is the output destination, it can be switched whether to output the HDR video obtained by decoding the encoded data as it is with HDR information added, or to convert the HDR video to an STD video and output it.

[0054] [Signal processing in mode-ii] FIG. 4 is a diagram showing an example of signal processing in mode-ii.

[0055] When the master HDR video is input, the recording device 1 detects the luminance of the master HDR video and generates HDR information as shown at the tip of arrow #71.

[0056] The recording device 1 converts the master HDR video to an STD video as shown at the tip of arrow #72. The video of the converted STD video is displayed on a monitor (not shown).

[0057] Based on the adjustment by the author, as shown at the tip of arrow #73, the recording device 1 generates tone mapping definition information for STD-HDR conversion, which is information used when converting STD video to HDR video.

[0058] Also, as shown at the tip of arrow #74, the recording device 1 encodes the STD video obtained by converting the master HDR video with HEVC.

[0059] As shown at the tip of arrow #75, the recording device 1 inserts HDR information and tone mapping definition information into the encoded data of HEVC as SEI and generates a HEVC stream. The recording device 1 records the generated HEVC stream on the optical disc 11 in BD format and provides it to the playback device 2 as shown at the tip of arrow #91.

[0060] The playback device 2 reads the HEVC stream from the optical disc 11 and extracts HDR information and tone mapping definition information from the SEI of the HEVC stream as shown at the tips of arrows #101 and #102.

[0061] Also, as shown at the tip of arrow #103, the playback device 2 decodes the encoded data of HEVC. When the display device 3 has an STD monitor, as shown at the tip of arrow #104, the playback device 2 outputs the data of the STD video obtained by decoding the encoded data to the display device 3.

[0062] On the other hand, when the display device 3 has an HDR monitor, as shown at the tip of arrow #105, the playback device 2 uses the tone mapping definition information for STD-HDR conversion extracted from the HEVC stream to convert the STD video obtained by decoding the encoded data into an HDR video. As shown at the tip of arrow #106, the playback device 2 adds HDR information to the data of the converted HDR video and outputs it to the display device 3 as shown at the tip of arrow #107.

[0063] In this way, the data of the STD video obtained by decoding the encoded data of HEVC is converted into HDR video and then output to the display device 3 having an HDR monitor together with the HDR information. Further, the data of the STD video obtained by decoding the encoded data of HEVC is output as it is to the display device 3 having an STD monitor.

[0064] FIG. 5 is a diagram showing the flow of processing from when the master HDR video is input to the recording device 1 until the video data is output from the playback device 2.

[0065] The master HDR video is converted into STD video as shown at the tip of the white arrow #121 and then provided to the playback device 2 together with the HDR information generated in the recording device 1 based on the master HDR video and the tone mapping definition information for STD-HDR conversion.

[0066] When the display device 3 has an HDR monitor, in the playback device 2, as shown at the tips of the arrows #122 and #123, the STD video obtained by decoding the encoded data of HEVC is converted into HDR video using the tone mapping definition information for STD-HDR conversion. Also, as shown at the tips of the arrows #124 and #125, the HDR information is added to the data of the HDR video obtained by converting the STD video, and it is output to the display device 3 as shown at the tip of the arrow #126.

[0067] On the other hand, when the display device 3 has an STD monitor, in the playback device 2, as shown at the tip of the arrow #127, the STD video obtained by decoding the encoded data of HEVC is output to the display device 3.

[0068] In this way, in mode-ii, the master HDR video is converted into STD video and recorded on the optical disk 11. Also, depending on the performance of the display device 3 that is the output destination, it is switched whether the STD video obtained by decoding the encoded data is converted into HDR video, the HDR information is added and output, or the STD video is output as it is.

[0069] Details of the configuration and operation of the recording device 1 and the playback device 2 as described above will be described later.

[0070] <2. About HEVC> Here, HEVC will be described.

[0071] FIG. 6 is a diagram showing the configuration of an access unit of HEVC.

[0072] The HEVC stream is composed of access units that are a collection of NAL (Network Abstraction Layer) units. One access unit contains video data of one picture.

[0073] As shown in FIG. 6, one access unit is composed of an AU delimiter (Access Unit delimiter), a VPS (Video Parameter Set), an SPS (Sequence Parameter Set), a PPS (Picture Parameter Set), SEI, a VCL (Video Coding Layer), an EOS (End of Sequence), and an EOS (End of Stream).

[0074] The AU delimiter indicates the start of the access unit. The VPS contains metadata representing the content of the bitstream. The SPS contains information such as the picture size and CTB (Coding Tree Block) size that the HEVC decoder needs to refer to through the decoding process of the sequence. The PPS contains information that the HEVC decoder needs to refer to in order to execute the decoding process of the picture. The VPS, SPS, and PPS are used as header information.

[0075] SEI is auxiliary information that includes timing information of each picture, information related to random access, etc. HDR information and tone mapping definition information are included in Tone mapping information, which is one type of SEI. VCL is the data of one picture. EOS (End of Sequence) indicates the end position of the sequence, and EOS (End of Stream) indicates the end position of the stream.

[0076] Figure 7 is a diagram showing the syntax of Tone mapping information.

[0077] Using Tone mapping information, the brightness and color of the decoded picture are converted according to the performance of the monitor where the picture will be output. Note that the line numbers and colons (:) on the left side of Figure 7 are shown for convenience of explanation and are not information included in Tone mapping information. The main information included in Tone mapping information will be described.

[0078] The tone_map_id on the second line is the identification information of Tone mapping information. The purpose of Tone mapping information is identified by tone_map_id.

[0079] For example, IDs for mode-i and mode-ii are reserved. When the recording mode is mode-i, the ID for mode-i is set for the tone_map_id of Tone mapping information inserted into the SEI of the encoded data of the HDR video. Also, when the recording mode is mode-ii, the ID for mode-ii is set for the tone_map_id of Tone mapping information inserted into the SEI of the encoded data of the STD video. On the optical disc 11, either the ID for mode-i or the ID for mode-ii is set for tone_map_id.

[0080] The tone_map_model_id in the 8th row represents the model of the tone map used for the conversion of coded data.

[0081] In the recording device 1, one Tone mapping information with any value of 0, 2, or 3 set as the tone_map_model_id and one Tone mapping information with the value of 4 set as the tone_map_model_id are generated.

[0082] As shown in FIG. 8, the Tone mapping information with any value of 0, 2, or 3 set as the tone_map_model_id is used as the tone mapping definition information for HDR-STD conversion or STD-HDR conversion. Also, the information included in the Tone mapping information with the value of 4 set as the tone_map_model_id is used as HDR information.

[0083] Lines 9 to 11 in FIG. 7 are descriptions regarding tone_map_model_id = 0. When tone_map_model_id = 0, min_value and max_value are described.

[0084] FIG. 9 is a diagram showing an example of the tone curve indicated by the Tone mapping information with tone_map_model_id = 0.

[0085] The horizontal axis in FIG. 9 indicates the coded_data (RGB value before conversion), and the vertical axis indicates the target_data (RGB value after conversion). When using the tone curve in FIG. 9, the RGB values below the coded data D1 are converted to the RGB values indicated by min_value as shown by the white arrow #151. Also, the RGB values above the coded data D2 are converted to the RGB values indicated by max_value as shown by the white arrow #152.

[0086] The Tone mapping information with tone_map_model_id = 0 is used as the tone mapping definition information for HDR-STD conversion. When the Tone mapping information with tone_map_model_id = 0 is used, the luminance above max_value and below min_value (luminance represented by RGB values) will be lost, but the load of the conversion process will be reduced.

[0087] Lines 15 to 17 of FIG. 7 are descriptions regarding tone_map_model_id = 2. When tone_map_model_id = 2, the same number of start_of_coded_interval[i] as the number of max_target_data representing a step function is described.

[0088] FIG. 10 is a diagram showing an example of the step function indicated by the Tone mapping information with tone_map_model_id = 2.

[0089] When the step function of FIG. 10 is used, for example, coded_data = 5 is converted to target_data = 3. Assuming start_of_coded_interval[i] is {1, 3, 4, 5, 5, 5, 7, 7, ···}, the coded_data - target_data conversion table is represented as {0, 1, 1, 2, 3, 5, 5, ···}.

[0090] The Tone mapping information with tone_map_model_id = 2 is used as the tone mapping definition information for STD-HDR conversion or HDR-STD conversion. Since the amount of data of the Tone mapping information with tone_map_model_id = 2 is large, it is necessary to perform convolution on the conversion table during its creation, but the load of the conversion process is light.

[0091] Lines 18 to 23 of FIG. 7 describe tone_map_model_id = 3. When tone_map_model_id = 3, the number of coded_pivot_value[i] and target_pivot_value[i] specified by num_pivots, which represent a piecewise linear function, are described.

[0092] FIG. 11 is a diagram showing an example of a piecewise linear function indicated by the Tone mapping information of tone_map_model_id = 3.

[0093] When the piecewise linear function of FIG. 11 is used, for example, coded_data = D11 is converted to target_data = D11’, and coded_data = D12 is converted to target_data = D12’. The Tone mapping information of tone_map_model_id = 3 is used as tone mapping definition information for STD-HDR conversion or HDR-STD conversion.

[0094] In this way, the Tone mapping information with any one of the values 0, 2, and 3 set as tone_map_model_id is used as tone mapping definition information for STD-HDR conversion or HDR-STD conversion and is transmitted from the recording device 1 to the playback device 2.

[0095] Lines 24 to 39 of FIG. 7 describe tone_map_model_id = 4. Among the information regarding tone_map_model_id = 4, ref_screen_luminance_white, extended_range_white_level, nominal_black_level_code_value, nominal_white_level_code_value, and extended_white_level_code_value are parameters that constitute HDR information.

[0096] FIG. 12 is a diagram showing an example of each piece of information included in the HDR information.

[0097] The horizontal axis of FIG. 12 indicates each pixel value of RGB. When the bit length is 10 bits, each pixel value becomes a value from 0 to 1023. The vertical axis of FIG. 12 indicates brightness (luminance). Curve L11 shows the relationship between the pixel value and the brightness in a monitor with a standard luminance. The dynamic range of a monitor with a standard luminance is 0 - 100%.

[0098] ref_screen_luminance_white indicates the brightness (cd / m 2 ) of the standard monitor. extended_range_white_level indicates the maximum value of the brightness of the extended dynamic range. In the example of FIG. 12, the value of 400 is set as the value of extended_range_white_level.

[0099] nominal_black_level_code_value indicates the pixel value of black (brightness 0%), and nominal_white_level_code_value indicates the pixel value of white (brightness 100%) in a monitor with a standard luminance. extended_white_level_code_value indicates the pixel value of white in the extended dynamic range.

[0100] In the example of FIG. 12, as indicated by the white arrow #161, the dynamic range of 0 - 100% is extended to a dynamic range of 0 - 400% according to the value of extended_range_white_level. Also, the pixel value corresponding to a brightness of 400% is specified by extended_white_level_code_value.

[0101] The luminance characteristics of the HDR video are the characteristics shown by the curve L12 where the values of nominal_black_level_code_value, nominal_white_level_code_value, and extended_white_level_code_value are 0%, 100%, and 400% of brightness respectively.

[0102] In this way, the luminance characteristics of the master HDR video are shown by the Tone mapping information with the value of 4 set as the tone_map_model_id and are transmitted from the recording device 1 to the playback device 2.

[0103] <3. Regarding the BD format> Here, the BD-ROM format will be explained.

[0104] [Data management structure] Figure 13 is a diagram showing an example of the management structure of the AV stream in the BD-ROM format.

[0105] The management of the AV stream including the HEVC stream is performed using two layers of PlayList and Clip. The AV stream may be recorded not only on the optical disc 11 but also on the local storage of the playback device 2.

[0106] A pair of one AV stream and Clip Information which is the information associated with it is managed as one object. A pair of an AV stream and Clip Information is called a Clip.

[0107] The AV stream is expanded on the time axis, and the access points of each Clip are mainly specified in the PlayList by time stamps. Clip Information is used, for example, to find the address at which decoding in the AV stream should start.

[0108] A PlayList is a collection of playback segments of an AV stream. One playback segment in the AV stream is called a PlayItem. A PlayItem is represented by a pair of an IN point and an OUT point of the playback segment on the time axis. As shown in FIG. 13, a PlayList is composed of one or more PlayItems.

[0109] The first PlayList from the left in FIG. 13 is composed of two PlayItems, and by these two PlayItems, the first half and the second half of the AV stream included in the left Clip are respectively referenced.

[0110] The second PlayList from the left is composed of one PlayItem, and thereby, the entire AV stream included in the right Clip is referenced.

[0111] The third PlayList from the left is composed of two PlayItems, and by these two PlayItems, a certain part of the AV stream included in the left Clip and a certain part of the AV stream included in the right Clip are respectively referenced.

[0112] For example, when the left PlayItem included in the first PlayList from the left is specified by a disk navigation program as the playback target, the first half of the AV stream included in the left Clip referenced by that PlayItem is played back. In this way, a PlayList is used as playback management information for managing the playback of an AV stream.

[0113] Among PlayLists, a playback path created by the arrangement of one or more PlayItems is called a Main Path. Also, among PlayLists, a playback path created by the arrangement of one or more SubPlayItems in parallel with the Main Path is called a Sub Path.

[0114] FIG. 14 is a diagram showing the structures of the Main Path and the Sub Path.

[0115] A PlayList has one Main Path and one or more Sub Paths. The PlayList in FIG. 14 has one Main Path and three Sub Paths created by the sequence of three PlayItems.

[0116] For the PlayItems that make up the Main Path, IDs are set in order from the beginning. For the Sub Paths, IDs of Subpath_id = 0, Subpath_id = 1, and Subpath_id = 2 are set in order from the beginning.

[0117] In the example of FIG. 14, the Sub Path with Subpath_id = 0 contains one SubPlayItem, the Sub Path with Subpath_id = 1 contains two SubPlayItems, and the Sub Path with Subpath_id = 2 contains one SubPlayItem.

[0118] The AV stream referred to by one PlayItem contains at least a video stream (main image data). The AV stream may or may not contain one or more audio streams that are played back at the same timing (synchronized) as the video stream contained in the AV stream.

[0119] The AV stream may or may not contain one or more streams of bitmap subtitle data (PG (Presentation Graphic)) that are played back in synchronization with the video stream contained in the AV stream.

[0120] The AV stream may or may not contain one or more streams of IG (Interactive Graphic) that are played back in synchronization with the video stream contained in the AV stream file. The IG stream is used to display graphics such as buttons operated by the user.

[0121] In the AV stream referred to by one PlayItem, a video stream, an audio stream, a PG stream, and an IG stream that are played synchronously therewith are multiplexed.

[0122] Also, one SubPlayItem refers to a video stream, an audio stream, a PG stream, etc. of a stream different from the AV stream referred to by the PlayItem.

[0123] In this way, the playback of the AV stream including the HEVC stream is performed using the PlayList and Clip Information. The PlayList and Clip Information including information regarding the playback of the AV stream are hereinafter referred to as Data Base information as appropriate.

[0124] [Directory Structure] FIG. 15 is a diagram showing an example of the management structure of files recorded on the optical disc 11.

[0125] Each file recorded on the optical disc 11 is hierarchically managed by a directory structure. One root directory is created on the optical disc 11.

[0126] Below the root directory, a BDMV directory is placed.

[0127] Below the BDMV directory, an Index file which is a file named "Index.bdmv" and a MovieObject file which is a file named "MovieObject.bdmv" are stored.

[0128] Below the BDMV directory, a PLAYLIST directory, a CLIPINF directory, a STREAM directory, etc. are provided.

[0129] The PLAYLIST directory stores PlayList files that describe PlayLists. Each PlayList file is named by combining a 5-digit number and the extension ".mpls". One of the PlayList files shown in Fig. 15 is named "00000.mpls".

[0130] The CLIPINF directory stores Clip Information files. Each Clip Information file is named by combining a 5-digit number and the extension ".clpi". The three Clip Information files in Fig. 15 are named "00001.clpi", "00002.clpi", and "00003.clpi", respectively.

[0131] The STREAM directory stores stream files. Each stream file is named by combining a 5-digit number and the extension ".m2ts". The three stream files in Fig. 15 are named "00001.m2ts", "00002.m2ts", and "00003.m2ts", respectively.

[0132] The Clip Information file and the stream file with the same 5-digit number in their file names form the files that constitute one Clip. When playing the stream file "00001.m2ts", the Clip Information file "00001.clpi" is used, and when playing the stream file "00002.m2ts", the Clip Information file "00002.clpi" is used. As will be described later, the Clip Information file used for playing an AV stream including an HEVC stream contains information related to the processing of HDR video.

[0133] [Syntax of Each File] Here, the main descriptions of the syntax of each file will be explained.

[0134] FIG. 16 is a diagram showing the syntax of a PlayList file.

[0135] The PlayList file is a file with the extension ".mpls" that is stored in the PLAYLIST directory of FIG. 15.

[0136] In AppInfoPlayList(), parameters related to the playback control of the PlayList, such as playback restrictions, are stored.

[0137] In PlayList(), parameters related to the Main Path and Sub Path are stored.

[0138] In PlayListMark(), mark information of the PlayList, that is, information related to marks that are jump destinations (jump points) in user operations or commands such as chapter jumps is stored.

[0139] FIG. 17 is a diagram showing the syntax of a Clip Information file.

[0140] The Clip Information file is a file with the extension ".clpi" that is stored in the CLIPINF directory of FIG. 15.

[0141] In ClipInfo(), information indicating the type of the AV stream constituting the Clip, information indicating the recording rate of the AV stream, and the like are stored.

[0142] In SequenceInfo(), information indicating the position on the time axis of the source packet constituting the AV stream, information indicating the display time, and the like are included.

[0143] ProgramInfo() includes the PID of the AV streams that make up the Clip, information regarding the encoding of the AV streams, and so on.

[0144] Figure 18 is a diagram showing the syntax of ProgramInfo() in Figure 17.

[0145] number_of_program_sequences indicates the number of program sequences described in ProgramInfo(). A program sequence is composed of the order of source packets that make up the program.

[0146] SPN_program_sequence_start[i] indicates the number (source packet number) of the source packet at the start of the program sequence.

[0147] StreamCodingInfo includes information regarding the encoding of the AV streams that make up the Clip.

[0148] Figure 19 is a diagram showing the syntax of StreamCodingInfo in Figure 18.

[0149] stream_coding_type indicates the encoding method of the elementary streams included in the AV stream. For example, in the StreamCodingInfo of Clip Information used for playing back an HEVC stream, a value indicating that the encoding method is HEVC is set as stream_coding_type.

[0150] video_format indicates the scanning method of the video. For video_format used for playing back an HEVC stream, a value indicating a 4K scanning method such as 2160p (2160-line progressive) is set as stream_coding_type.

[0151] The frame_rate indicates the frame rate of the video stream.

[0152] The aspect_ratio indicates the aspect ratio of the video.

[0153] The cc_flag is a 1-bit flag indicating whether closed caption data is included in the video stream.

[0154] The HDR_flag is a 1-bit flag indicating whether recording is performed with an HDR video as the master. For example, HDR_flag = 1 indicates that recording is performed with an HDR video as the master. Also, HDR_flag = 0 indicates that recording is performed with an STD video as the master.

[0155] The mode_flag is a 1-bit flag indicating the recording mode of the HEVC stream. The mode_flag is valid when HDR_flag = 1. For example, mode_flag = 1 indicates that the recording mode is mode-i. Also, mode_flag = 0 indicates that the recording mode is mode-ii.

[0156] Thus, the Clip Information includes a flag indicating whether the HEVC stream included in the AV stream played using the Clip Information has an HDR video as the master, and a flag indicating the recording mode of the HEVC stream.

[0157] By referring to the flags included in the Clip Information, the playback device 2 can identify whether the master video is an HDR video without actually analyzing the HEVC stream.

[0158] <4. Configuration of Each Device> Here, the configuration of each device will be described.

[0159] [Configuration of Recording Device 1] FIG. 20 is a block diagram showing a configuration example of the recording device 1.

[0160] The recording device 1 is composed of a controller 21, an encoding processing unit 22, and a disk drive 23. The master HDR video is input to the encoding processing unit 22.

[0161] The controller 21 is composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The controller 21 executes a predetermined program and controls the overall operation of the recording device 1.

[0162] In the controller 21, a Data Base information generation unit 21A is realized by executing a predetermined program. The Data Base information generation unit 21A generates a PlayList and Clip Information which are Data Base information, and outputs them to the disk drive 23.

[0163] The encoding processing unit 22 performs encoding of the master HDR video. The encoding processing unit 22 outputs the HEVC stream obtained by encoding the master HDR video to the disk drive 23.

[0164] The disk drive 23 records, in accordance with the directory structure of FIG. 15, a file for storing the PlayList, Clip Information supplied from the controller 21, and the HEVC stream supplied from the encoding processing unit 22 on the optical disk 11.

[0165] FIG. 21 is a block diagram showing a configuration example of the encoding processing unit 22 in FIG. 20.

[0166] The encoding processing unit 22 is composed of an HDR information generation unit 31, an HEVC encoder 32, an HDR-STD conversion unit 33, a definition information generation unit 34, and an HEVC stream generation unit 35.

[0167] The HDR information generation unit 31 detects the luminance of the input master HDR video and generates HDR information including each piece of information described with reference to FIG. 12. The HDR information generation unit 31 outputs the generated HDR information to the HEVC stream generation unit 35.

[0168] When the recording mode is mode-i, the HEVC encoder 32 encodes the input master HDR video with HEVC. Also, when the recording mode is mode-ii, the HEVC encoder 32 encodes the STD video supplied from the HDR-STD conversion unit 33 with HEVC. The HEVC encoder 32 outputs the encoded data of the HDR video or the encoded data of the STD video to the HEVC stream generation unit 35.

[0169] The HDR-STD conversion unit 33 converts the input master HDR video into STD video. The conversion by the HDR-STD conversion unit 33 is appropriately performed according to the conversion parameters input by the author. The HDR-STD conversion unit 33 outputs information indicating the correspondence relationship between the input data with the RGB signal of the HDR video as the input data and the RGB signal of the STD video as the output data to the definition information generation unit 34.

[0170] FIG. 22 is a diagram showing an example of signal processing by the HDR-STD conversion unit 33.

[0171] As shown at the tip of arrow #201, the HDR-STD conversion unit 33 converts the YCrCb signal of the input master HDR video into an RGB signal, and performs conversion (tone mapping) of each RGB signal into each RGB signal of the STD video for each RGB signal.

[0172] The HDR-STD conversion unit 33 outputs information indicating the correspondence between the RGB signal of the HDR video, which is the input data, and the RGB signal of the STD video, which is the output data, to the definition information generation unit 34. The information output to the definition information generation unit 34 is used for generating tone mapping definition information as shown at the tip of arrow #202.

[0173] Also, as shown at the tip of arrow #203, the HDR-STD conversion unit 33 converts the RGB signal of the STD video into a YCrCb signal and outputs it.

[0174] Figure 23 is a diagram showing an example of tone mapping.

[0175] The RGB signal of the HDR video is converted into the RGB signal of the STD video by compressing the high-luminance components and expanding the medium- and low-range luminance components, for example, as shown in Figure 23. Information indicating the function F that associates the RGB signal of the HDR video and the RGB signal of the STD video as shown in Figure 23 is generated by the definition information generation unit 34. Note that the function F shown in Figure 23 is the Tone mapping information with tone_map_model_id = 3 that shows the relationship between coded_data and target_data by a broken-line function, which was described with reference to Figure 11.

[0176] Returning to the description of Figure 21, also, when the recording mode is mode-ii, the HDR-STD conversion unit 33 outputs the STD video obtained by converting the HDR video to the HEVC encoder 32.

[0177] The definition information generation unit 34 generates tone mapping definition information for HDR-STD conversion based on the information supplied from the HDR-STD conversion unit 33.

[0178] For example, when tone_map_model_id = 0 is used, the definition information generation unit 34 generates Tone mapping information including the values of min_value and max_value in FIG. 9 as tone mapping definition information for HDR-STD conversion.

[0179] Also, when tone_map_model_id = 2 is used, the definition information generation unit 34 generates Tone mapping information including start_of_coded_interval[i] in FIG. 10 as tone mapping definition information for HDR-STD conversion.

[0180] Furthermore, when tone_map_model_id = 3 is used, the definition information generation unit 34 generates Tone mapping information including the number of coded_pivot_value[i] and target_pivot_value[i] specified by num_pivots in FIG. 11 as tone mapping definition information for HDR-STD conversion.

[0181] The HEVC stream generation unit 35 sets the same value according to the recording mode to the tone_map_id of the Tone mapping information including the HDR information supplied from the HDR information generation unit 31 and the Tone mapping information including the tone mapping definition information supplied from the definition information generation unit 34. Also, the HEVC stream generation unit 35 inserts the Tone mapping information including the HDR information and the Tone mapping information including the tone mapping definition information into the encoded data as SEI, and generates an HEVC stream. The HEVC stream generation unit 35 outputs the generated HEVC stream to the disk drive 23.

[0182] [Configuration of the playback device 2] FIG. 24 is a block diagram showing a configuration example of the playback device 2.

[0183] The playback device 2 is composed of a controller 51, a disk drive 52, a memory 53, a local storage 54, a network interface 55, a decoding processing unit 56, an operation input unit 57, and an HDMI communication unit 58.

[0184] The controller 51 is composed of a CPU, a ROM, a RAM, etc. The controller 51 executes a predetermined program and controls the overall operation of the playback device 2.

[0185] The disk drive 52 reads data from the optical disk 11 and outputs the read data to the controller 51, the memory 53, or the decoding processing unit 56. For example, the disk drive 52 outputs the Data Base information read from the optical disk 11 to the controller 51 and outputs the HEVC stream to the decoding processing unit 56.

[0186] The memory 53 stores data necessary for the controller 51 to execute various processes. A register 53A, which is a PSR (Player Status Register), is formed in the memory 53. Various types of information that the playback device 2, which is a BD Player, refers to during the playback of the optical disk 11 are stored in the register 53A.

[0187] The local storage 54 is composed of, for example, an HDD (Hard Disk Drive). Streams downloaded from a server and the like are recorded in the local storage 54.

[0188] The network interface 55 communicates with a server via a network such as the Internet and supplies the data downloaded from the server to the local storage 54.

[0189] The decoding processing unit 56 decodes the HEVC stream supplied from the disk drive 52 and outputs the data of the HDR video or the STD video to the HDMI communication unit 58. When outputting the HDR video, the decoding processing unit 56 outputs the HDR information to the HDMI communication unit 58 together with the data of the HDR video.

[0190] The operation input unit 57 is composed of an input device such as a button, a key, a touch panel, and a receiving unit that receives signals such as infrared rays transmitted from a predetermined remote commander. The operation input unit 57 detects the operation of the user and supplies a signal representing the content of the detected operation to the controller 51.

[0191] The HDMI communication unit 58 communicates with the display device 3 via the HDMI cable 4. For example, the HDMI communication unit 58 acquires information regarding the performance of the monitor included in the display device 3 and outputs it to the controller 51. Also, the HDMI communication unit 58 outputs the data of the HDR video or the STD video supplied from the decoding processing unit 56 to the display device 3.

[0192] FIG. 25 is a block diagram showing a configuration example of the decoding processing unit 56 in FIG. 24.

[0193] The decoding processing unit 56 is composed of a parameter extraction unit 71, an HEVC decoder 72, an HDR-STD conversion unit 73, an STD-HDR conversion unit 74, and an output unit 75. The output unit 75 is composed of an HDR video output unit 75A and an STD video output unit 75B.

[0194] The HEVC stream read by the disk drive 52 is input to the parameter extraction unit 71. Information representing the recording mode specified by the mode_flag included in the Clip Information and information regarding the performance of the monitor included in the display device 3 specified by the information acquired from the display device 3 are supplied to the decoding processing unit 56 from the controller 51.

[0195] The parameter extraction unit 71 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. For example, when the recording mode is mode-i and an HDR video is output to the display device 3, the parameter extraction unit 71 outputs the HDR information to the HDR video output unit 75A. Also, when the recording mode is mode-i and an STD video is output to the display device 3, the parameter extraction unit 71 outputs the tone mapping definition information for HDR-STD conversion to the HDR-STD conversion unit 73.

[0196] On the other hand, when the recording mode is mode-ii and an HDR video is output to the display device 3, the parameter extraction unit 71 outputs the HDR information to the HDR video output unit 75A and outputs the tone mapping definition information for STD-HDR conversion to the STD-HDR conversion unit 74. When the recording mode is mode-ii and an STD video is output to the display device 3, the extracted HDR information and tone mapping definition information are not used.

[0197] Also, the parameter extraction unit 71 outputs the encoded data included in the HEVC stream to the HEVC decoder 72.

[0198] The HEVC decoder 72 decodes the HEVC encoded data supplied from the parameter extraction unit 71. When the recording mode is mode-i, the HEVC decoder 72 outputs the decoded HDR video to the HDR-STD conversion unit 73 and the HDR video output unit 75A. Also, when the recording mode is mode-ii, the HEVC decoder 72 outputs the decoded STD video to the STD-HDR conversion unit 74 and the STD video output unit 75B.

[0199] The HDR-STD conversion unit 73 converts the HDR video supplied from the HEVC decoder 72 into an STD video based on the tone mapping definition information for HDR-STD conversion supplied from the parameter extraction unit 71. The HDR-STD conversion unit 73 outputs the converted STD video to the STD video output unit 75B.

[0200] The STD-HDR conversion unit 74 converts the STD video supplied from the HEVC decoder 72 into an HDR video based on the tone mapping definition information for STD-HDR conversion supplied from the parameter extraction unit 71. The STD-HDR conversion unit 74 outputs the obtained HDR video to the HDR video output unit 75A.

[0201] When the HDR video output unit 75A of the output unit 75 outputs an HDR video to the display device 3, it outputs the HDR video supplied from the HEVC decoder 72 or the HDR video supplied from the STD-HDR conversion unit 74 together with the HDR information supplied from the parameter extraction unit 71.

[0202] When the STD video output unit 75B outputs an STD video to the display device 3, it outputs the STD video supplied from the HEVC decoder 72 or the STD video supplied from the HDR-STD conversion unit 73.

[0203] The data output from the HDR video output unit 75A and the STD video output unit 75B is transmitted to the display device 3 by the HDMI communication unit 58.

[0204] [Configuration of Display Device 3] FIG. 26 is a block diagram showing a configuration example of the display device 3.

[0205] The display device 3 includes a controller 101, an HDMI communication unit 102, a signal processing unit 103, and a monitor 104. The controller 101 has a memory 101A.

[0206] The controller 101 is composed of a CPU, a ROM, a RAM, etc. The controller 101 executes a predetermined program and controls the overall operation of the display device 3.

[0207] For example, the controller 101 stores and manages in the memory 101A the EDID (Extended display identification data) representing the performance of the monitor 104. When authenticating with the playback device 2, the controller 101 outputs the EDID stored in the memory 101A to the HDMI communication unit 102 and causes it to be transmitted to the playback device 2. Based on the EDID, the performance of the monitor 104 of the display device 3 is specified by the playback device 2.

[0208] The HDMI communication unit 102 communicates with the playback device 2 via the HDMI cable 4. The HDMI communication unit 102 receives the video data transmitted from the playback device 2 and outputs it to the signal processing unit 103. Also, the HDMI communication unit 102 transmits the EDID supplied from the controller 101 to the playback device 2.

[0209] The signal processing unit 103 processes the video data supplied from the HDMI communication unit 102 and causes the video to be displayed on the monitor 104.

[0210] <5. Operations of Each Device> Here, the operations of each device having the above configuration will be described.

[0211] [Recording Process] First, with reference to the flowchart of FIG. 27, the recording process of the recording device 1 will be described. The process of FIG. 27 starts when the master's HDR video is input to the recording device 1.

[0212] In step S1, the controller 21 of the recording device 1 determines whether the recording mode is mode-i. The recording mode is set by the author, for example.

[0213] If it is determined in step S1 that the recording mode is mode-i, then in step S2, the encoding processing unit 22 performs the encoding process in mode-i. The HEVC stream generated by the encoding process in mode-i is supplied to the disk drive 23.

[0214] On the other hand, when it is determined in step S1 that the recording mode is mode-ii, in step S3, the encoding processing unit 22 performs encoding processing in mode-ii. The HEVC stream generated by the encoding processing in mode-ii is supplied to the disk drive 23.

[0215] In step S4, the Data Base information generation unit 21A performs Data Base information generation processing. The PlayList file and the Clip Information file generated by the Data Base information generation processing are supplied to the disk drive 23.

[0216] In step S5, the disk drive 23 records the PlayList file, the Clip Information file, and the stream file storing the HEVC stream on the optical disk 11. Then, the process ends.

[0217] Next, with reference to the flowchart of FIG. 28, the encoding processing in mode-i performed in step S2 of FIG. 27 will be described.

[0218] In step S11, the HDR information generation unit 31 of the encoding processing unit 22 detects the luminance of the master HDR video and generates HDR information.

[0219] In step S12, the HEVC encoder 32 performs encoding by HEVC on the master HDR video and generates encoded data of the HDR video.

[0220] In step S13, the HDR-STD conversion unit 33 converts the input master HDR video into an STD video. Information indicating the correspondence between the RGB signal of the HDR video as input data and the RGB signal of the STD video as output data is supplied to the definition information generation unit 34.

[0221] In step S14, the definition information generation unit 34 generates tone mapping definition information for HDR-STD conversion based on the information supplied from the HDR-STD conversion unit 33.

[0222] In step S15, the HEVC stream generation unit 35 sets the ID for mode-i to the tone_map_id of the Tone mapping information including the HDR information generated by the HDR information generation unit 31 and the Tone mapping information including the tone mapping definition information generated by the definition information generation unit 34. Further, the HEVC stream generation unit 35 inserts the Tone mapping information including the HDR information and the Tone mapping information including the tone mapping definition information into the encoded data to generate an HEVC stream. Then, it returns to step S2 in FIG. 27, and the subsequent processing is performed.

[0223] Next, with reference to the flowchart of FIG. 29, the encoding process in mode-ii performed in step S3 of FIG. 27 will be described.

[0224] In step S21, the HDR information generation unit 31 of the encoding process unit 22 detects the luminance of the master HDR video and generates HDR information.

[0225] In step S22, the HDR-STD conversion unit 33 converts the input master HDR video into an STD video. Information indicating the correspondence relationship between the RGB signal of the HDR video as input data and the RGB signal of the STD video as output data is supplied to the definition information generation unit 34.

[0226] In step S23, the definition information generation unit 34 generates tone mapping definition information for STD-HDR conversion based on the information supplied from the HDR-STD conversion unit 33.

[0227] In step S24, the HEVC encoder 32 performs encoding by HEVC on the STD video obtained by converting the master HDR video, and generates encoded data of the STD video.

[0228] In step S25, the HEVC stream generation unit 35 sets the ID for mode-ii to the tone_map_id of the Tone mapping information including the HDR information generated by the HDR information generation unit 31 and the Tone mapping information including the tone mapping definition information generated by the definition information generation unit 34. Further, the HEVC stream generation unit 35 inserts the Tone mapping information including the HDR information and the Tone mapping information including the tone mapping definition information into the encoded data to generate an HEVC stream. Then, it returns to step S3 in FIG. 27, and subsequent processing is performed.

[0229] Next, with reference to the flowchart of FIG. 30, the Data Base information generation process performed in step S4 of FIG. 27 will be described.

[0230] In step S31, the Data Base information generation unit 21A of the controller 21 generates a PlayList including each piece of information described with reference to FIG. 16. The PlayList generated by the Data Base information generation unit 21A includes information regarding a PlayItem that designates the HEVC stream as a reproduction section.

[0231] In step S32, the Data Base information generation unit 21A generates Clip Information including HDR_flag and mode_flag in the StreamCodingInfo of ProgramInfo(). In this example, since the master video is an HDR video, the Data Base information generation unit 21A sets 1, which is a value indicating that fact, as the value of HDR_flag.

[0232] Also, when the encoding process in mode-i is performed in step S2 of FIG. 27, the Data Base information generation unit 21A sets 1, which is a value indicating that the recording mode is mode-i, as the value of mode_flag. On the other hand, when the encoding process in mode-ii is performed in step S3 of FIG. 27, the Data Base information generation unit 21A sets 0, which is a value indicating that the recording mode is mode-ii, as the value of mode_flag. Then, it returns to step S4 of FIG. 27, and the subsequent processing is performed.

[0233] In the recording apparatus 1, the HEVC stream and the Data Base information generated by the above processing are recorded on the optical disk 11.

[0234] [Playback processing] Next, with reference to the flowchart of FIG. 31, the playback processing of the playback apparatus 2 will be described.

[0235] At a predetermined timing such as before starting the playback of the optical disk 11, the controller 51 of the playback apparatus 2 controls the HDMI communication unit 58 to communicate with the display apparatus 3, and reads the EDID from the memory 101A of the display apparatus 3. The controller 51 stores and manages the information representing the performance of the monitor included in the display apparatus 3 in the register 53A.

[0236] In step S41, the controller 51 controls the disk drive 52 to read the PlayList and Clip Information, which are the Data Base information, from the optical disk 11. Also, the controller 51 identifies the HEVC stream to be played back based on the information included in the PlayList, and reads an AV stream including the identified HEVC stream from the optical disk 11 by controlling the disk drive 52.

[0237] In step S42, the controller 51 refers to the HDR_flag and mode_flag included in the Clip Information. In this example, a value indicating that recording has been performed with the master as an HDR video is set in the HDR_flag. As a result, the state of the playback device 2 becomes a state in which it plays back an HDR video or an STD video obtained by converting the HDR video.

[0238] In step S43, the controller 51 determines whether the recording mode is mode-i based on the value of the mode_flag.

[0239] If it is determined in step S43 that the recording mode is mode-i, in step S44, the decoding processing unit 56 performs decoding processing in mode-i.

[0240] On the other hand, if it is determined in step S43 that the recording mode is mode-ii, in step S45, the decoding processing unit 56 performs decoding processing in mode-ii.

[0241] After the decoding process is performed in step S44 or step S45, the process ends.

[0242] Here, it is assumed that the determination of whether the recording mode is mode-i is made based on the value of the mode_flag, but it may be made based on the tone_map_id of the Tone mapping information inserted into the HEVC stream.

[0243] Next, with reference to the flowchart of FIG. 32, the decoding process in mode-i performed in step S44 of FIG. 31 will be described.

[0244] In step S61, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the encoded data of HEVC included in the HEVC stream to the HEVC decoder 72.

[0245] In step S62, the HEVC decoder 72 decodes the encoded data of HEVC and outputs the decoded HDR video to the HDR-STD conversion unit 73 and the HDR video output unit 75A.

[0246] In step S63, the controller 51 determines whether the monitor of the display device 3 is an HDR monitor based on the information stored in the register 53A. As described above, information regarding the performance of the monitor of the display device 3 is stored in the register 53A based on the HDMI EDID read from the display device 3.

[0247] If it is determined in step S63 that the monitor of the display device 3 is an HDR monitor, then in step S64, the HDR video output unit 75A outputs the HDR video supplied from the HEVC decoder 72 together with the HDR information supplied from the parameter extraction unit 71.

[0248] On the other hand, if it is determined in step S63 that the monitor of the display device 3 is not an HDR monitor but a STD monitor, then in step S65, the HDR-STD conversion unit 73 converts the HDR video supplied from the HEVC decoder 72 into a STD video based on the tone mapping definition information for HDR-STD conversion supplied from the parameter extraction unit 71.

[0249] In step S66, the STD video output unit 75B outputs the STD video obtained by the conversion performed by the HDR-STD conversion unit 73.

[0250] After the HDR video is output in step S64, or after the STD video is output in step S66, in step S67, the controller 51 determines whether playback has ended.

[0251] If it is determined in step S67 that playback has not ended, the controller 51 returns to step S61 and repeats the above processing. If it is determined in step S67 that playback has ended, it returns to step S44 in FIG. 31 and subsequent processing is performed.

[0252] Next, with reference to the flowchart of FIG. 33, the decoding process in mode-ii performed in step S45 of FIG. 31 will be described.

[0253] In step S81, the parameter extraction unit 71 of the decoding process unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the encoded data of HEVC included in the HEVC stream to the HEVC decoder 72.

[0254] In step S82, the HEVC decoder 72 decodes the encoded data of HEVC and outputs the decoded STD video to the STD-HDR conversion unit 74 and the STD video output unit 75B.

[0255] In step S83, the controller 51 determines whether the monitor included in the display device 3 is an HDR monitor based on the information stored in the register 53A.

[0256] If it is determined in step S83 that the monitor included in the display device 3 is an HDR monitor, in step S84, the STD-HDR conversion unit 74 converts the STD video supplied from the HEVC decoder 72 into an HDR video based on the tone mapping definition information for STD-HDR conversion supplied from the parameter extraction unit 71.

[0257] In step S85, the HDR video output unit 75A outputs the HDR video obtained by the conversion performed by the STD-HDR conversion unit 74, together with the HDR information supplied from the parameter extraction unit 71.

[0258] On the other hand, when it is determined in step S83 that the monitor included in the display device 3 is an STD monitor, in step S86, the STD video output unit 75B outputs the STD video supplied from the HEVC decoder 72.

[0259] After the HDR video is output in step S85, or after the STD video is output in step S86, in step S87, the controller 51 determines whether playback has ended.

[0260] If it is determined in step S87 that playback has not ended, the controller 51 returns to step S81 and repeatedly executes the above processing. If it is determined in step S87 that playback has ended, it returns to step S45 in FIG. 31, and subsequent processing is performed.

[0261] [Display Processing] Next, with reference to the flowchart of FIG. 34, the display processing of the display device 3 will be described.

[0262] Here, the case where the monitor 104 included in the display device 3 is an HDR monitor will be described. For the display device 3 having an HDR monitor, an HDR video with HDR information added is transmitted from the playback device 2.

[0263] In step S101, the HDMI communication unit 102 of the display device 3 receives the HDR video and the HDR information transmitted from the playback device 2.

[0264] In step S102, the controller 101 refers to the HDR information and determines whether the HDR video transmitted from the playback device 2 can be directly displayed. The HDR information includes information indicating the luminance characteristics of the master HDR video, that is, the HDR video transmitted from the playback device 2. The determination in step S102 is made by comparing the luminance characteristics of the HDR video specified by the HDR information with the display performance of the monitor 104.

[0265] For example, if the dynamic range of the HDR video specified by the HDR information is 0 - 400% and the dynamic range of the monitor 104 is 0 - 500% (for example, with a brightness of 100% being 100 cd / m 2 then it is 500 cd / m 2 ), it is determined that the HDR video can be directly displayed. On the other hand, if the dynamic range of the HDR video specified by the HDR information is 0 - 400% and the dynamic range of the monitor 104 is 0 - 300%, it is determined that the HDR video cannot be directly displayed.

[0266] If it is determined in step S102 that the HDR video can be directly displayed, then in step S103, the signal processing unit 103 causes the monitor 104 to display the video of the HDR video according to the luminance specified by the HDR information. For example, if the luminance characteristics shown by the curve L12 in FIG. 12 are specified by the HDR information, each pixel value represents the brightness in the range of 0 - 400% shown by the curve L12.

[0267] On the other hand, if it is determined in step S102 that the HDR video cannot be directly displayed, then in step S104, the signal processing unit 103 adjusts the luminance according to the display performance of the monitor 104 and causes the monitor 104 to display the video of the HDR video with the adjusted luminance. For example, if the luminance characteristics shown by the curve L12 in FIG. 12 are specified by the HDR information and the dynamic range of the monitor 104 is 0 - 300%, it is compressed so that each pixel value represents the brightness in the range of 0 - 300%.

[0268] After the HDR video image is displayed in step S103 or step S104, in step S105, the controller 101 determines whether to end the display. If it is determined not to end, the processing after step S101 is repeated. If it is determined to end the display in step S105, the controller 101 ends the processing.

[0269] Through the above series of processes, the recording device 1 can record the master HDR video on the optical disc 11 as an HDR video, play it on the playback device 2, and display the HDR video image on the display device 3.

[0270] Also, the recording device 1 can convert the master HDR video into an STD video, record it on the optical disc 11, restore it to an HDR video on the playback device 2, and display the HDR video image on the display device 3.

[0271] When playing an HDR video, by enabling the luminance characteristics of the master HDR video to be specified by HDR information, the content author can display the HDR video image with the intended luminance.

[0272] <6. Modification Example> [Storage Location of Flag] In the above, it is assumed that the HDR_flag and mode_flag are stored in the Clip Information, but they may be stored in the PlayList.

[0273] ·First Example of Storage Location FIG. 35 is a diagram showing an example of the syntax of AppInfoPlayList() included in the PlayList file of FIG. 16.

[0274] As described above, parameters related to the playback control of the PlayList, such as playback restrictions, are stored in AppInfoPlayList(). In the example of FIG. 35, following MVC_Base_view_R_flag, HDR_flag and mode_flag are described.

[0275] In this way, it is also possible to describe HDR_flag and mode_flag in AppInfoPlayList() of the PlayList file.

[0276] ·Second example of storage location FIG. 36 is a diagram showing the syntax of PlayList() included in the PlayList file of FIG. 16.

[0277] number_of_PlayItems indicates the number of PlayItems in the PlayList. In the case of the example of FIG. 14, the number of PlayItems is 3. The value of PlayItem_id is assigned from 0 in the order in which PlayItem() appears in the PlayList.

[0278] number_of_SubPaths indicates the number of Sub Paths in the PlayList. In the case of the example of FIG. 14, the number of Sub Paths is 3. The value of SubPath_id is assigned from 0 in the order in which SubPath() appears in the PlayList.

[0279] As shown in FIG. 36, in PlayList(), PlayItem() is described as many times as the number of PlayItems, and SubPath() is described as many times as the number of Sub Paths.

[0280] FIG. 37 is a diagram showing the syntax of PlayItem() of FIG. 36.

[0281] Clip_Information_file_name[0] represents the name of the Clip Information file of the Clip referenced by the PlayItem. Clip_codec_identifier[0] represents the codec format of the Clip.

[0282] IN_time represents the start position of the playback section of the PlayItem, and OUT_time represents the end position. After OUT_time, UO_mask_table(), PlayItem_random_access_mode, and still_mode are included.

[0283] The STN_table() contains information about the AV streams referenced by the PlayItem. If there is a Sub Path played in association with the PlayItem, information about the AV streams referenced by the SubPlayItems that make up that Sub Path is also included.

[0284] Figure 38 is a diagram showing the syntax of the STN_table() in Figure 37.

[0285] number_of_video_stream_entries represents the number of video streams entered (registered) in the STN_table(). number_of_audio_stream_entries represents the number of streams of the 1st audio stream entered in the STN_table(). number_of_audio_stream2_entries represents the number of streams of the 2nd audio stream entered in the STN_table().

[0286] The number_of_PG_textST_stream_entries represents the number of PG_textST streams entered in STN_table(). The PG_textST stream is a PG (Presentation Graphics) stream obtained by run-length encoding a bitmap subtitle and a text subtitle file (textST). The number_of_IG_stream_entries represents the number of IG (Interactive Graphics) streams entered in STN_table().

[0287] In STN_table(), stream_entry() and stream_attributes() which are information of each video stream, the 1st audio stream, the 2nd audio stream, the PG_textST stream, and the IG stream are described. stream_entry() contains the PID of the stream, and stream_attributes() contains the attribute information of the stream.

[0288] Figure 39 is a diagram showing an example of the description of the video stream among the descriptions of stream_attributes() in Figure 38.

[0289] In the example of stream_attributes() in Figure 39, stream_coding_type, video_format, and frame_rate are described as the attribute information of the video stream, and then HDR_flag and mode_flag are described. Note that stream_coding_type indicates the encoding method of the video stream, video_format indicates the video format, and frame_rate indicates the frame rate of the video.

[0290] In this way, it is also possible to describe HDR_flag and mode_flag in the STN_table() of the PlayList file.

[0291] It is also possible to have the HDR_flag and mode_flag described at positions in the PlayList file other than AppInfoPlayList() and STN_table(). Similarly, it is also possible to have the HDR_flag and mode_flag described at positions in the Clip Information file other than StreamCodingInfo described with reference to FIG. 19.

[0292] The description positions of the HDR_flag and mode_flag are arbitrary, such as one of the HDR_flag and mode_flag being described in the Clip Information file and the other being described in the PlayList file.

[0293] [PSR] FIG. 40 is a diagram showing an example of PSR allocation.

[0294] As described above, the register 53A of the playback device 2 is used as the PSR. In a BD, a PSR number is assigned to the PSR, and the use of each PSR is defined.

[0295] The HDR_capability_flag is stored in PSR29, which is the PSR with a PSR number of 29. For example, a value of 1 for the HDR_capability_flag of PSR29 indicates that the playback device 2 supports the playback of HDR videos. Also, a value of 0 for the HDR_capability_flag of PSR29 indicates that the playback device 2 does not support the playback of HDR videos.

[0296] The HDR_capability_flag is referred to by the controller 51 that executes the disc navigation program when, for example, an optical disc in which 1 is set as the value of the HDR_flag of the Clip Information, that is, an optical disc on which recording has been performed with the master being HDR video, is inserted. When the value of the HDR_capability_flag is set to 0, a message is displayed requesting that a display device corresponding to the processing of HDR video be connected to the playback device 2.

[0297] PSR25, which is the PSR with a PSR number of 25, is used as the PSR that records information indicating the correspondence status of the HDR video of the connected monitor. In this case, the information indicating the performance of the monitor of the display device 3 indicated by the EDID acquired from the display device 3 is stored in PSR25.

[0298] For example, in PSR25 for HDR Display Capability, the HDR_display_capability_flag and information indicating the luminance specification are stored. The fact that the value of the HDR_display_capability_flag is 1 indicates that the connected monitor is capable of displaying HDR video. Also, the fact that the value of the HDR_display_capability_flag is 0 indicates that the connected monitor is not capable of displaying HDR video.

[0299] As the information indicating the luminance specification, for example, information indicating up to what percentage of brightness can be displayed is stored.

[0300] Instead of using PSR25 for HDR Display Capability, the HDR_display_capability_flag and information indicating the luminance specification may be stored in PSR23, which is the PSR for Display Capability.

[0301] <Example when adjusting luminance on the playback device side> In the above description, when the display device 3 cannot directly display the HDR video transmitted from the playback device 2, the display device 3 adjusts the brightness by itself. However, the brightness of the HDR video may also be adjusted by the playback device 2. The display device 3 receives the HDR video with the brightness adjusted by the playback device 2 and displays the video of the HDR video.

[0302] [Signal processing in mode-i] FIG. 41 is a diagram showing an example of signal processing in mode-i when the brightness of the HDR video is adjusted by the playback device 2.

[0303] Among the processes shown in FIG. 41, the processes performed by the recording device 1 and the processes related to the output of the STD video performed by the playback device 2 are the same as the processes described with reference to FIG. 2. Redundant descriptions will be omitted as appropriate. It is assumed that the above-described HDR_display_capability_flag and information indicating the brightness specification are stored in the register 53A of the playback device 2.

[0304] The playback device 2 reads the HEVC stream from the optical disk 11 and extracts the HDR information and the tone mapping definition information from the SEI of the HEVC stream as shown at the tips of arrows #21 and #22.

[0305] Also, the playback device 2 decodes the encoded data of HEVC as shown at the tip of arrow #23. When the display device 3 has an HDR monitor but cannot directly display the HDR video, the playback device 2 adjusts the brightness of the HDR video obtained by decoding the encoded data as shown at the tip of arrow #301.

[0306] For example, when the dynamic range of the HDR video indicated by the HDR information is 0 - 400% and the information indicating the luminance specification stored in the register 53A shows that the dynamic range of the monitor 104 is 0 - 300%, the playback device 2 performs luminance adjustment. In this case, the brightness of each pixel value is compressed within the range of 0 - 300%.

[0307] When adjusting the luminance of the HDR video, the playback device 2 rewrites the HDR information as shown at the tip of arrow #302. The HDR information after rewriting becomes information indicating the luminance characteristics of the HDR video after luminance adjustment.

[0308] As shown at the tip of arrow #303, the playback device 2 adds the HDR information to the data of the HDR video after luminance adjustment and outputs it to the display device 3 as shown at the tip of arrow #304.

[0309] [Signal processing in mode-ii] FIG. 42 is a diagram showing an example of signal processing in mode-ii when the luminance of the HDR video is adjusted by the playback device 2.

[0310] Among the processes shown in FIG. 42, the processes performed by the recording device 1 and the processes related to the output of the STD video performed by the playback device 2 are the same as the processes described with reference to FIG. 4. Redundant explanations will be omitted as appropriate.

[0311] The playback device 2 reads the HEVC stream from the optical disk 11 and extracts the HDR information and the tone mapping definition information from the SEI of the HEVC stream as shown at the tips of arrows #101 and #102.

[0312] Also, the playback device 2 decodes the encoded data of HEVC as shown at the tip of arrow #103. When the display device 3 has an HDR monitor, the playback device 2 uses the tone mapping definition information for STD-HDR conversion extracted from the HEVC stream to convert the STD video obtained by decoding the encoded data into an HDR video as shown at the tip of arrow #105.

[0313] When the display device 3 has an HDR monitor but cannot directly display the HDR video as it is, as shown at the tip of arrow #311, the playback device 2 adjusts the brightness of the HDR video and, as shown at the tip of arrow #312, rewrites the HDR information.

[0314] As shown at the tip of arrow #313, the playback device 2 adds the HDR information to the data of the HDR video after brightness adjustment and outputs it to the display device 3 as shown at the tip of arrow #314.

[0315] In this way, when the brightness of the HDR video is adjusted by the playback device 2, the HDR information is rewritten to represent the characteristics of the adjusted brightness and is transmitted to the display device 3 together with the data of the HDR video.

[0316] The display device 3 can recognize that the HDR video is being transmitted based on the HDR information and display the video of the HDR video on the monitor 104 according to the brightness specified by the rewritten HDR information.

[0317] [Configuration of Playback Device 2] FIG. 43 is a block diagram showing a configuration example of the HDR video output unit 75A in FIG. 25.

[0318] The HDR video output unit 75A is composed of a brightness adjustment unit 111 and a rewriting unit 112. The HDR video supplied from the HEVC decoder 72 or the STD-HDR conversion unit 74 is input to the brightness adjustment unit 111. Also, the HDR information supplied from the parameter extraction unit 71 is input to the rewriting unit 112.

[0319] The brightness adjustment unit 111 adjusts the brightness of the HDR video and outputs the HDR video after brightness adjustment.

[0320] The rewriting unit 112 rewrites the HDR information so as to represent the characteristics of the adjusted luminance based on the adjustment result by the luminance adjustment unit 111. The rewritten HDR information is added to the HDR video after luminance adjustment and transmitted to the display device 3.

[0321] [Decoding process of the playback device 2] Here, with reference to the flowchart of FIG. 44, the decoding process in mode-i performed in step S44 of FIG. 31 will be described. In the process of FIG. 44, the luminance of the HDR video is adjusted as appropriate.

[0322] Among the processes shown in FIG. 44, the processes of steps S151 to S153 and S158 to S160 are the same as the processes of steps S61 to S63 and S65 to S67 in FIG. 32, respectively. Redundant explanations will be omitted as appropriate.

[0323] In step S151, the parameter extraction unit 71 of the decoding process unit 56 extracts the HDR information and the tone mapping definition information from the SEI of the HEVC stream.

[0324] In step S152, the HEVC decoder 72 decodes the encoded data of HEVC and outputs the decoded HDR video.

[0325] In step S153, the controller 51 determines whether the monitor included in the display device 3 is an HDR monitor.

[0326] If it is determined in step S153 that the monitor included in the display device 3 is an HDR monitor, then in step S154, the controller 51 determines whether the HDR video can be directly displayed on the monitor 104 of the display device 3.

[0327] If it is determined in step S154 that the HDR video cannot be directly displayed, then in step S155, the luminance adjustment unit 111 of the HDR video output unit 75A adjusts the luminance of the HDR video decoded by the HEVC decoder 72 according to the display performance of the monitor 104.

[0328] In step S156, the rewriting unit 112 rewrites the HDR information based on the luminance adjustment result.

[0329] In step S157, the HDR video output unit 75A outputs the luminance-adjusted HDR video together with the rewritten HDR information.

[0330] If it is determined in step S154 that the HDR video can be directly displayed, the processes of steps S155 and S156 are skipped. In this case, in step S157, the HDR video output unit 75A outputs the HDR video decoded by the HEVC decoder 72 together with the HDR information extracted by the parameter extraction unit 71.

[0331] In step S160, it is determined whether the playback has ended. If it is determined that the playback has ended, the process is terminated. Then, it returns to step S44 in FIG. 31, and the subsequent processes are performed.

[0332] Next, with reference to the flowchart of FIG. 45, the decoding process in mode-ii performed in step S45 of FIG. 31 will be described. In the process of FIG. 45, the luminance of the HDR video is appropriately adjusted.

[0333] Among the processes shown in FIG. 45, the processes of steps S171 to S174, S179, and S180 are the same as the processes of steps S81 to S84, S86, and S87 in FIG. 33, respectively. Redundant explanations will be omitted as appropriate.

[0334] In step S171, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream.

[0335] In step S172, the HEVC decoder 72 decodes the encoded data of HEVC and outputs the decoded STD video.

[0336] In step S173, the controller 51 determines whether the monitor included in the display device 3 is an HDR monitor.

[0337] If it is determined in step S173 that the monitor included in the display device 3 is an HDR monitor, in step S174, the STD-HDR conversion unit 74 converts the decoded STD video into an HDR video based on the tone mapping definition information for STD-HDR conversion.

[0338] In step S175, the controller 51 determines whether the HDR video obtained by converting the STD video can be directly displayed on the monitor 104 of the display device 3.

[0339] If it is determined in step S175 that the HDR video cannot be directly displayed, in step S176, the luminance adjustment unit 111 of the HDR video output unit 75A adjusts the luminance of the HDR video obtained by converting the STD video according to the display performance of the monitor 104.

[0340] In step S177, the rewriting unit 112 rewrites the HDR information based on the luminance adjustment result.

[0341] In step S178, the HDR video output unit 75A outputs the luminance-adjusted HDR video together with the rewritten HDR information.

[0342] If it is determined in step S175 that the HDR video can be directly displayed, the processes in steps S176 and S177 are skipped. In this case, in step S178, the HDR video output unit 75A outputs the HDR video obtained by converting the STD video, together with the HDR information extracted by the parameter extraction unit 71.

[0343] In step S180, it is determined whether playback has ended. If it is determined that playback has ended, the process ends. Thereafter, the process returns to step S45 in FIG. 31, and subsequent processes are performed.

[0344] [Display Processing of Display Device 3] Next, with reference to the flowchart of FIG. 46, the display processing of the display device 3 will be described.

[0345] The process of FIG. 46 is performed after the process of FIG. 44 or FIG. 45 by the playback device 2. For the display device 3 having an HDR monitor, the original HDR video without brightness adjustment or the HDR video after brightness adjustment is transmitted from the playback device 2 together with the HDR information.

[0346] In step S191, the HDMI communication unit 102 of the display device 3 receives the HDR video and the HDR information transmitted from the playback device 2.

[0347] In step S192, the signal processing unit 103 causes the monitor 104 to display the video of the HDR video according to the brightness specified by the HDR information.

[0348] In step S193, the controller 101 determines whether to end the display. If it is determined not to end, the processes after step S191 are repeated. If it is determined in step S193 to end the display, the controller 101 ends the process.

[0349] Thus, when the brightness adjustment is performed by the playback device 2, the display device 3 does not need to determine whether it can directly display the HDR video transmitted from the playback device 2. Also, the display device 3 does not need to adjust the brightness of the HDR video by itself.

[0350] When the brightness adjustment of the HDR video is necessary, the user of the playback device 2 may be able to set whether to perform the brightness adjustment on the playback device 2 side or the display device 3 side.

[0351] Also, the display device 3 may notify the playback device 2 whether to perform the brightness adjustment on the playback device 2 side or the display device 3 side, and the processing performed in the playback device 2 may be switched according to the notification. For example, when the display device 3 has a brightness adjustment function for the HDR video, it is notified that the brightness adjustment is performed on the display device 3 side, and when it does not have a brightness adjustment function for the HDR video, it is notified that the brightness adjustment is performed on the playback device 2 side.

[0352] When it is notified from the display device 3 that the brightness adjustment is performed on the playback device 2 side, the playback device 2 performs the processing of FIG. 44 or FIG. 45 as the decoding process. Also, when it is notified from the display device 3 that the brightness adjustment is performed on the display device 3 side, the playback device 2 performs the processing of FIG. 32 or FIG. 33 as the decoding process.

[0353] There may be a difference in the parameters used for the brightness adjustment performed by the playback device 2 and the brightness adjustment performed by the display device 3. In this case, from the viewpoint of image quality, it is considered desirable to let the display device 3 having the monitor 104 perform the brightness adjustment that is more suitable according to the characteristics of the monitor 104.

[0354] By allowing the display device 3 to select whether to adjust the brightness on the playback device 2 side or the display device 3 side, it becomes possible to display a high-quality HDR video. It is possible to make the selection of whether to adjust the brightness on the playback device 2 side or the display device 3 side based on the user's operation. For example, when the user operates a remote controller or a button provided on the main body of the display device 3 to instruct the display of the menu screen, the controller 101 of the display device 3 controls the signal processing unit 103 or the like to display a menu screen including setting items related to the HDR video on the monitor 104. When a setting item related to the HDR video is selected, a screen used for selecting whether to adjust the brightness on the playback device 2 side or the display device 3 side is displayed, and the user will select one of them. The display device 3 notifies the playback device 2 whether to adjust the brightness of the HDR video on the playback device 2 side or the display device 3 side by transmitting information representing the user's selection content to the playback device 2 via the HDMI cable 4.

[0355] The notification of whether to adjust the brightness of the HDR video on the playback device 2 side or the display device 3 side can be realized using the HDMI EDID.

[0356] <8. Example Applied to HDMI> [HDR EDID and HDR InfoFrame] FIG. 47 is a diagram showing an example of recognition based on information transmitted and received via HDMI.

[0357] As shown on the left side of FIG. 47, the playback device 2, which is a BD Player corresponding to the processing of a 4K resolution HDR video, reads the EDID stored in the memory 101A of the display device 3. A plurality of EDIDs such as the EDID representing the performance of the monitor 104 of the display device 3 are stored in the memory 101A of the display device 3.

[0358] When the HDR EDID is included in the EDID read from the display device 3, the playback device 2 recognizes that the display device 3 is a device having an HDR monitor and is capable of outputting HDR video to the display device 3. The HDR EDID includes information regarding the output of HDR video. A notification as to whether the adjustment of the luminance of the HDR video is to be performed on the side of the playback device 2 or on the side of the display device 3 is made using the HDR EDID.

[0359] As shown on the right side of FIG. 47, the playback device 2 adds an HDR InfoFrame to the data of each frame of the HDR video output to the display device 3. In the HDMI standard, an InfoFrame is added to each frame of video. The InfoFrame of the video includes information regarding the specifications of the video, such as information indicating whether the video data is RGB data or YCbCr data, and information indicating the aspect ratio.

[0360] The HDR InfoFrame is an InfoFrame including information regarding the specifications of the HDR video. Transmission of HDR information indicating the luminance characteristics of the HDR video is performed using the HDR InfoFrame. The playback device 2 outputs the data of the HDR video with the HDR InfoFrame added thereto to the display device 3.

[0361] When the HDR InfoFrame is added to the video data transmitted from the playback device 2, the display device 3 recognizes that the video data transmitted from the playback device 2 is the data of the HDR video. Thereafter, the display device 3 causes the HDR monitor to display the video of the HDR video.

[0362] FIG. 48 is a diagram showing another example of recognition based on information transmitted and received via HDMI.

[0363] As shown on the left side of FIG. 48, when the HDR EDID is not included in the EDID read from the display device 3 by the playback device 2, the playback device 2 recognizes that the display device 3 is a device that does not have an HDR monitor. In this case, the playback device 2 will output only the STD video data to the display device 3. The HDR InfoFrame is not added to the STD video data output by the playback device 2.

[0364] On the other hand, as shown on the right side of FIG. 48, when the HDR InfoFrame is not added to the video data transmitted from the playback device 2, the display device 3 recognizes that the video data transmitted from the playback device 2 is STD video data. Thereafter, the display device 3 causes the STD monitor to display the STD video image.

[0365] In this way, it is possible to transmit HDR information from the playback device 2 to the display device 3 using the HDMI InfoFrame. Also, it is possible to use the HDMI EDID to notify the playback device 2 from the display device 3 whether to adjust the brightness of the HDR video on the playback device 2 side or the display device 3 side.

[0366] FIG. 49 is a diagram showing an example of HDR EDID.

[0367] The HDR EDID includes information indicating the maximum brightness of the monitor, information indicating the maximum extension level, and raw / cooked flag-1. The raw / cooked flag-1 indicates whether to output the HDR video raw or, if necessary, after adjusting the brightness of the HDR video.

[0368] The value of raw / cooked flag-1 being 1 indicates that the display device 3 requests the playback device 2 to output the HDR video in its raw form, i.e., without performing brightness adjustment on the playback device 2 side. When the value of raw / cooked flag-1 is 1, the playback device 2 outputs the HDR video without performing brightness adjustment even if the dynamic range of the HDR video exceeds the display performance of the monitor 104.

[0369] For example, if the display device 3 has a function to adjust the brightness of the HDR video, it sets the value of raw / cooked flag-1 to 1.

[0370] Also, the value of raw / cooked flag-1 being 0 indicates that the display device 3 requests the playback device 2 to perform brightness adjustment on the HDR video on the playback device 2 side if necessary and then output it. When the value of raw / cooked flag-1 is 0, the playback device 2 adjusts the brightness of the HDR video according to the display performance of the monitor 104 when the dynamic range of the HDR video exceeds the display performance of the monitor 104, and outputs the adjusted HDR video.

[0371] For example, if the display device 3 does not have a function to adjust the brightness of the HDR video, it sets the value of raw / cooked flag-1 to 0.

[0372] The decoding process in FIG. 32 or FIG. 33 where the brightness adjustment is performed on the display device 3 side without performing it on the playback device 2 side corresponds to the process when the value of raw / cooked flag-1 is 1. Also, the decoding process in FIG. 44 or FIG. 45 where the brightness adjustment is performed on the playback device 2 side corresponds to the process when the value of raw / cooked flag-1 is 0.

[0373] Hereinafter, appropriately, the playback device 2 outputting the HDR video in its raw form is referred to as raw output. Also, the playback device 2 performing brightness adjustment on the HDR video if necessary and then outputting it is referred to as cooked output.

[0374] FIG. 50 is a diagram showing an example of an HDR InfoFrame.

[0375] The HDR InfoFrame includes parameters of HDR information, namely, ref_screen_luminance_white, extended_range_white_level, nominal_black_level_code_value, nominal_white_level_code_value, extended_white_level_code_value, and raw / cooked flag-2.

[0376] The HDR InfoFrame also includes raw / cooked flag-2. The raw / cooked flag-2 indicates whether the output HDR video is an unprocessed HDR video without luminance adjustment or an HDR video after luminance adjustment.

[0377] A value of 1 for raw / cooked flag-2 indicates that the output HDR video is an unprocessed HDR video without luminance adjustment on the side of the playback device 2. For example, when the value of raw / cooked flag-1 included in the HDR EDID is 1, the playback device 2 adds an HDR InfoFrame with a value of 1 set as raw / cooked flag-2 to the HDR video data and outputs it.

[0378] Also, a value of 0 for raw / cooked flag-2 indicates that the output HDR video is an HDR video after luminance adjustment. For example, when the value of raw / cooked flag-1 included in the HDR EDID is 0 and the dynamic range of the HDR video exceeds the display performance of the monitor 104, the playback device 2 performs luminance adjustment and sets a value of 0 as raw / cooked flag-2. The playback device 2 adds an HDR InfoFrame with a value of 0 set as raw / cooked flag-2 to the HDR video data after luminance adjustment and outputs it.

[0379] In the decoding process of FIG. 32 or FIG. 33 where the playback device 2 does not perform brightness adjustment, a value of 1 is set for the raw / cooked flag-2 in the HDR InfoFrame. Also, in the decoding process of FIG. 44 or FIG. 45 where the playback device 2 may perform brightness adjustment, a value of 0 may be set for the raw / cooked flag-2 in the HDR InfoFrame.

[0380] [Processing of Playback Device 2 and Display Device 3] Here, the processing of the playback device 2 and the display device 3 using the HDR EDID and the HDR InfoFrame will be described.

[0381] First, referring to the flowchart of FIG. 51, the processing of the display device 3 for setting the HDR EDID will be described.

[0382] In step S211, the controller 101 of the display device 3 sets a value of 1 or 0 for the raw / cooked flag-1, and stores in the memory 101A the HDR EDID consisting of the information indicating the maximum brightness of the monitor, the information indicating the maximum extension level, and the raw / cooked flag-1.

[0383] In step S212, the HDMI communication unit 102 reads out a plurality of EDIDs including the HDR EDID from the memory 101A in response to a request from the playback device 2, and transmits them to the playback device 2.

[0384] Next, referring to the flowchart of FIG. 52, the playback processing of the playback device 2 will be described. The processing of FIG. 52 starts, for example, after the processing of FIG. 51 is performed in the display device 3.

[0385] In step S221, the controller 51 controls the disk drive 52 to read the PlayList and Clip Information, which are Data Base information, from the optical disk 11. Further, the controller 51 identifies the HEVC stream to be played back based on the information included in the PlayList, and controls the disk drive 52 to read an AV stream including the identified HEVC stream from the optical disk 11.

[0386] In step S222, the controller 51 refers to the HDR_flag and mode_flag included in the Clip Information. In this example, a value indicating that recording has been performed with the master as an HDR video is set in the HDR_flag.

[0387] In step S223, the controller 51 controls the HDMI communication unit 58 to read the EDID from the display device 3. The HDMI communication unit 58 requests the HDMI communication unit 102 of the playback device 2 to read the EDID, and a plurality of EDIDs transmitted in response to the request are acquired by the HDMI communication unit 58.

[0388] In step S224, the controller 51 determines whether the HDR EDID is included in the EDID read from the display device 3.

[0389] If it is determined in step S224 that the HDR EDID is included, the controller 51 recognizes that it is possible to output an HDR video to the display device 3, and in step S225, stores information indicating the display performance of the monitor 104 in the register 53A. For example, the controller 51 stores information indicating the maximum luminance of the monitor and information indicating the maximum extended level included in the HDR EDID in the PSR25 as information indicating the luminance specification of the monitor. Further, the controller 51 sets a value indicating that the monitor 104 is capable of displaying an HDR video in the HDR_display_capability_flag of the PSR25.

[0390] In step S226, the controller 51 determines whether a raw output is requested from the display device 3 based on the raw / cooked flag-1 included in the HDR EDID. In the case of the example described above, the controller 51 determines that a raw output is requested when the value of the raw / cooked flag-1 is 1, and determines that a cooked output is requested when the value is 0.

[0391] If it is determined in step S226 that a raw output is requested, in step S227, the controller 51 performs an HDR·raw output process, which is a process of raw outputting the HDR video.

[0392] If it is determined in step S226 that a raw output is not requested, in step S228, the controller 51 performs an HDR·cooked output process, which is a process of cooked outputting the HDR video.

[0393] On the other hand, if it is determined in step S224 that the HDR EDID is not included, in step S229, the controller 51 performs an STD output process, which is a process of outputting the STD video. The output destination of the STD video by the STD output process is a display device that does not have an HDR monitor and is different from the display device 3.

[0394] After the video data is output in steps S227, S228, and S229, the process ends.

[0395] Next, with reference to the flowchart of FIG. 53, the HDR·raw output process performed in step S227 of FIG. 52 will be described.

[0396] In step S241, the parameter extraction unit 71 of the decoding process unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the encoded data of HEVC included in the HEVC stream to the HEVC decoder 72.

[0397] In step S242, the HEVC decoder 72 decodes the encoded data of HEVC. When the recording mode is mode-i, the data of the HDR video obtained by decoding the encoded data is supplied to the HDR video output unit 75A. Also, when the recording mode is mode-ii, the data of the STD video obtained by decoding the encoded data is supplied to the STD-HDR conversion unit 74.

[0398] In step S243, the controller 51 determines whether the recording mode is mode-i based on the value of mode_flag.

[0399] If it is determined in step S243 that the recording mode is mode-ii, then in step S244, the STD-HDR conversion unit 74 converts the STD video supplied from the HEVC decoder 72 into an HDR video based on the tone mapping definition information for STD-HDR conversion supplied from the parameter extraction unit 71. If it is determined in step S243 that the recording mode is mode-i, the process of step S244 is skipped.

[0400] In step S245, the HDR video output unit 75A sets a value of 1 indicating that the HDR video is an unprocessed HDR video without luminance adjustment to raw / cooked flag-2. Also, the HDR video output unit 75A generates an HDR InfoFrame including each parameter of the HDR information extracted by the parameter extraction unit 71 and raw / cooked flag-2.

[0401] In step S246, the HDR video output unit 75A adds the HDR InfoFrame to the data of each frame of the HDR video and outputs it to the display device 3.

[0402] In step S247, the controller 51 determines whether playback has ended. If it is determined that playback has not ended, the process returns to step S241 and the above processing is repeatedly executed. If it is determined in step S247 that playback has ended, the process returns to step S227 in FIG. 52, and subsequent processing is performed.

[0403] Next, with reference to the flowchart of FIG. 54, the HDR·cooked output processing performed in step S228 of FIG. 52 will be described.

[0404] In step S261, the parameter extraction unit 71 of the decoding processing unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the encoded data of HEVC included in the HEVC stream to the HEVC decoder 72.

[0405] In step S262, the HEVC decoder 72 decodes the encoded data of HEVC. When the recording mode is mode-i, the data of the HDR video obtained by decoding the encoded data is supplied to the HDR video output unit 75A. When the recording mode is mode-ii, the data of the STD video obtained by decoding the encoded data is supplied to the STD-HDR conversion unit 74.

[0406] In step S263, the controller 51 determines whether the recording mode is mode-i based on the value of mode_flag.

[0407] If it is determined in step S263 that the recording mode is mode-ii, in step S264, the STD-HDR conversion unit 74 converts the STD video supplied from the HEVC decoder 72 into an HDR video based on the tone mapping definition information for STD-HDR conversion supplied from the parameter extraction unit 71. If it is determined in step S263 that the recording mode is mode-i, the processing of step S264 is skipped.

[0408] In step S265, the controller 51 compares the luminance characteristics of the HDR video indicated by the HDR information with the performance of the monitor 104 indicated by the information included in the HDR EDID, and determines whether the monitor 104 can display the HDR video as it is.

[0409] If it is determined in step S265 that the HDR video cannot be displayed as it is, in step S266, the luminance adjustment unit 111 of the HDR video output unit 75A adjusts the luminance of the HDR video according to the display performance of the monitor 104.

[0410] In step S267, the rewriting unit 112 rewrites the HDR information based on the luminance adjustment result. If it is determined in step S265 that the HDR video can be displayed as it is, the processes of steps S266 and S267 are skipped.

[0411] In step S268, the HDR video output unit 75A sets a predetermined value in the raw / cooked flag-2 and generates an HDR InfoFrame including each parameter of the HDR information.

[0412] For example, when the luminance of the HDR video is not adjusted, the HDR video output unit 75A sets a value of 1 indicating that in the raw / cooked flag-2, and generates an HDR InfoFrame including the raw / cooked flag-2 and each parameter of the HDR information extracted by the parameter extraction unit 71.

[0413] On the other hand, when the luminance of the HDR video is adjusted, the HDR video output unit 75A sets a value of 0 indicating that in the raw / cooked flag-2, and generates an HDR InfoFrame including the raw / cooked flag-2 and each parameter of the rewritten HDR information.

[0414] In step S269, the HDR video output unit 75A adds the HDR InfoFrame to the data of each frame of the HDR video and outputs it to the display device 3.

[0415] In step S270, the controller 51 determines whether playback has ended. If it is determined that playback has not ended, the process returns to step S261 and the above processing is repeatedly executed. If it is determined in step S270 that playback has ended, the process returns to step S228 in FIG. 52 and subsequent processing is performed.

[0416] Next, with reference to the flowchart of FIG. 55, the STD output process performed in step S229 of FIG. 52 will be described.

[0417] As described above, the process of FIG. 55 is a process of outputting video data to a display device that does not have an HDR monitor and is different from the display device 3.

[0418] In step S281, the parameter extraction unit 71 of the decoding process unit 56 extracts HDR information and tone mapping definition information from the SEI of the HEVC stream. The parameter extraction unit 71 outputs the encoded data of HEVC included in the HEVC stream to the HEVC decoder 72.

[0419] In step S282, the HEVC decoder 72 decodes the encoded data of HEVC. When the recording mode is mode-i, the data of the HDR video obtained by decoding the encoded data is supplied to the HDR-STD conversion unit 73. When the recording mode is mode-ii, the data of the STD video obtained by decoding the encoded data is supplied to the STD video output unit 75B.

[0420] In step S283, the controller 51 determines whether the recording mode is mode-i based on the value of mode_flag.

[0421] When it is determined in step S283 that the recording mode is mode-i, in step S284, the HDR-STD conversion unit 73 converts the HDR video supplied from the HEVC decoder 72 into an STD video based on the tone mapping definition information for HDR-STD conversion supplied from the parameter extraction unit 71. When it is determined in step S283 that the recording mode is mode-ii, the process of step S284 is skipped.

[0422] In step S285, the STD video output unit 75B outputs the data of the STD video supplied from the HEVC decoder 72 or the STD video supplied from the HDR-STD conversion unit 73.

[0423] In step S286, the controller 51 determines whether playback has ended. If it is determined that playback has not ended, the process returns to step S281 and the above processing is repeatedly executed. If it is determined in step S286 that playback has ended, the process returns to step S229 in FIG. 52 and subsequent processing is performed.

[0424] Next, with reference to the flowchart of FIG. 56, the display process of the display device 3 will be described.

[0425] An HDR InfoFrame is added to the video data transmitted by the playback device 2 to the display device 3 having an HDR monitor. The controller 101 of the display device 3 recognizes that the video data transmitted from the playback device 2 is HDR video data based on the HDR InfoFrame.

[0426] In step S301, the HDMI communication unit 102 of the display device 3 receives the data of the HDR video transmitted from the playback device 2. An HDR InfoFrame is added to the data of each frame of the HDR video.

[0427] In step S302, the controller 101 determines whether the data of the HDR video is raw output data based on the raw / cooked flag-2 included in the HDR InfoFrame.

[0428] If the value 1 is set for the raw / cooked flag-2, the controller 101 determines that the data of the HDR video is raw output data. Also, if the value 0 is set for the raw / cooked flag-2, the controller 101 determines that the data of the HDR video is cooked output data.

[0429] If it is determined in step S302 that the data of the HDR video is raw output data, in step S303, the signal processing unit 103 refers to the HDR information included in the HDR InfoFrame. When the dynamic range of the HDR video exceeds the display performance of the monitor 104, the signal processing unit 103 appropriately adjusts the luminance of the HDR video and causes the monitor 104 to display the video of the luminance-adjusted HDR video.

[0430] On the other hand, if it is determined in step S302 that the data of the HDR video is cooked output data, in step S304, the signal processing unit 103 causes the monitor 104 to display the video of the HDR video according to the HDR information included in the HDR InfoFrame.

[0431] After the video of the HDR video is displayed in step S303 or step S304, in step S305, the controller 101 determines whether to end the display of the HDR video. If it is determined not to end, the processing after step S301 is repeated. If it is determined in step S305 to end the display, the controller 101 ends the processing.

[0432] Through the above series of processes, the playback device 2 can transmit HDR information to the display device 3 using the HDMI InfoFrame. Also, the display device 3 can request whether to adjust the brightness of the HDR video on the side of the playback device 2 or on the side of the display device 3 using the HDMI EDID.

[0433] <9. Other Modification Examples> When transmitting the data of the HDR video from the playback device 2 to the display device 3, it was assumed that the HDR information was added and transmitted, but it may be transmitted without adding the HDR information.

[0434] Also, although the case where the playback device 2 is a BD Player has been mainly described, the above-described functions of the playback device 2 may be installed in a mobile terminal. In this case, the mobile terminal will have the role of the playback device 2.

[0435] Furthermore, although it was assumed that the content played by the playback device 2 is the content recorded on the removable media, the above-described technology is also applicable when playing the content distributed via the network. In this case, the playback device 2 will receive the content transmitted from the server connected via a network such as the Internet, play it, and output the HDR video to the display device 3.

[0436] [Configuration Example of Computer] The above series of processes can be executed by hardware or by software. When the series of processes are executed by software, the program constituting the software is installed from a program recording medium into a computer in which the program is incorporated in dedicated hardware, or a general-purpose personal computer or the like.

[0437] FIG. 57 is a block diagram showing a configuration example of the hardware of a computer that executes the above series of processes by a program.

[0438] The CPU 501, ROM 502, and RAM 503 are interconnected by a bus 504.

[0439] The bus 504 is further connected to an input / output interface 505. Connected to the input / output interface 505 are an input unit 506 composed of a keyboard, a mouse, etc., and an output unit 507 composed of a display, a speaker, etc. Also connected to the input / output interface 505 are a storage unit 508 composed of a hard disk, a non-volatile memory, etc., a communication unit 509 composed of a network interface, etc., and a drive 510 for driving a removable medium 511.

[0440] In the computer configured as described above, the CPU 501 loads and executes, for example, a program stored in the storage unit 508 into the RAM 503 via the input / output interface 505 and the bus 504, thereby performing the series of processes described above.

[0441] The program executed by the CPU 501 is recorded, for example, on the removable medium 511, or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting, and installed in the storage unit 508.

[0442] Note that the program executed by the computer may be a program in which processing is performed in time series in accordance with the order described in this specification, or a program in which processing is performed in parallel or at a necessary timing such as when a call is made.

[0443] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

[0444] In addition, in this specification, the term "system" refers to a collection of a plurality of components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device in which a plurality of modules are housed in one housing are both systems.

[0445] [Example of Configuration Combination] The present technology can also have the following configuration.

[0446] (1) A reading unit that reads out the encoded data, the luminance characteristic information, and the luminance conversion definition information from a recording medium that records the encoded data of an extended video that is video in a second luminance range wider than the first luminance range, the luminance characteristic information indicating the luminance characteristics of the extended video, and the luminance conversion definition information used when performing luminance conversion from the extended video to a standard video that is video in the first luminance range; A decoding unit that decodes the encoded data; A conversion unit that converts the extended video obtained by decoding the encoded data into the standard video based on the luminance conversion definition information; An output unit that outputs the data of the extended video and the luminance characteristic information to a display device capable of displaying the extended video, and outputs the data of the standard video to a display device incapable of displaying the extended video A playback device comprising: (2) The luminance characteristic information and the luminance conversion definition information are inserted as auxiliary information of the encoded data into a stream including the encoded data and recorded on the recording medium The playback device according to (1) above. (3) The encoded data is HEVC encoded data, and the luminance characteristic information and the luminance conversion definition information are SEIs of an HEVC stream The playback device according to (2) above. (4) The luminance conversion definition information is the first Tone mapping information with any one of the values 0, 2, or 3 set as the value of tone_map_model_id, The luminance characteristic information is the second Tone mapping information with the value 4 set as the value of tone_map_model_id The playback device according to (3) above. (5) The same value representing the recording mode of the recording medium is set for the tone_map_model_id of the first Tone mapping information and the second Tone mapping information. The playback device according to (4) above. (6) The recording medium further records information regarding the playback of the encoded data, including a flag indicating whether recording has been performed with the extended video as the master. When the flag indicates that recording has been performed with the extended video as the master, the decoding unit decodes the encoded data. The playback device according to any one of (1) to (5) above. (7) The recording medium is a Blu-ray Disc, The flag is included in the Clip Information file as the information regarding the playback. The playback device according to (6) above. (8) The recording medium is a Blu-ray Disc, The flag is included in the PlayList file as the information regarding the playback. The playback device according to (6) above. (9) Encoded data of an extended video that is a video with a second luminance range wider than the first luminance range, luminance characteristic information indicating the luminance characteristics of the extended video, and luminance conversion definition information used when performing luminance conversion from the extended video to a standard video that is a video with the first luminance range are read from a recording medium that records the encoded data, the luminance characteristic information, and the luminance conversion definition information, the encoded data is decoded, based on the luminance conversion definition information, the extended video obtained by decoding the encoded data is converted into the standard video, for a display device capable of displaying the extended video, the data of the extended video and the luminance characteristic information are output, for a display device that cannot display the extended video, the data of the standard video is output A playback method including steps. (10) Encoded data of an extended video that is a video with a second luminance range wider than the first luminance range, luminance characteristic information indicating the luminance characteristics of the extended video, and luminance conversion definition information used when performing luminance conversion from the extended video to a standard video that is a video with the first luminance range A recording medium that records In a playback device that plays back the recording medium, the encoded data, the luminance characteristic information, and the luminance conversion definition information are read from the recording medium, the encoded data is decoded, based on the luminance conversion definition information, the extended video obtained by decoding the encoded data is converted into the standard video, for a display device capable of displaying the extended video, the data of the extended video and the luminance characteristic information are output, for a display device that cannot display the extended video, the data of the standard video is output A recording medium on which processing is performed. (11) Encoded data of the standard video which is the video of the first luminance range, luminance characteristic information indicating the luminance characteristics of the extended video, and luminance conversion definition information used when performing luminance conversion from the standard video to the extended video, obtained by performing luminance conversion on the extended video which is the video of the second luminance range wider than the first luminance range, from a recording medium recording the above, a reading unit that reads out the encoded data, the luminance characteristic information, and the luminance conversion definition information, A decoding unit that decodes the encoded data, A conversion unit that converts the standard video obtained by decoding the encoded data into the extended video based on the luminance conversion definition information, An output unit that outputs the data of the extended video and the luminance characteristic information to a display device capable of displaying the extended video, and outputs the data of the standard video to a display device incapable of displaying the extended video A playback device comprising: (12) The luminance characteristic information and the luminance conversion definition information are inserted as auxiliary information of the encoded data into a stream including the encoded data and recorded on the recording medium The playback device according to (11) above. (13) The encoded data is encoded data of HEVC, and the luminance characteristic information and the luminance conversion definition information are SEIs of the HEVC stream The playback device according to (12) above. (14) The luminance conversion definition information is the first Tone mapping information in which any one of the values 0, 2, and 3 is set as the value of tone_map_model_id, The luminance characteristic information is the second Tone mapping information in which the value 4 is set as the value of tone_map_model_id The playback device according to (13) above. (15) The same value representing the recording mode of the recording medium is set for the tone_map_model_id of the first Tone mapping information and the second Tone mapping information. The playback device according to (14) above. (16) The recording medium further records information regarding playback of the encoded data, including a flag indicating whether recording has been performed with the extended video as the master. When the flag indicates that recording has been performed with the extended video as the master, the decoding unit decodes the encoded data. The playback device according to any one of (11) to (15) above. (17) The recording medium is a Blu-ray Disc. The flag is included in a Clip Information file as the information regarding playback. The playback device according to (16) above. (18) The recording medium is a Blu-ray Disc. The flag is included in a PlayList file as the information regarding playback. The playback device according to (16) above. (19) Read the encoded data, the luminance characteristic information, and the luminance conversion definition information from a recording medium that records the encoded data of the standard video, which is a video in the first luminance range, obtained by performing luminance conversion on an extended video that is a video in a second luminance range wider than the first luminance range, the luminance characteristic information indicating the luminance characteristics of the extended video, and the luminance conversion definition information used when performing luminance conversion from the standard video to the extended video. Decode the encoded data. Based on the luminance conversion definition information, convert the standard video obtained by decoding the encoded data into the extended video. Output the data of the extended video and the luminance characteristic information to a display device capable of displaying the extended video. Outputting the data of the standard video to a display device that cannot display the extended video A playback method including steps (20) The encoded data of the standard video, which is the video of the first luminance range obtained by performing luminance conversion on the extended video, which is the video of the second luminance range wider than the first luminance range, and Luminance characteristic information indicating the luminance characteristics of the extended video, and Luminance conversion definition information used when performing luminance conversion from the standard video to the extended video A recording medium that records In a playback device that plays back the recording medium, Reading out the encoded data, the luminance characteristic information, and the luminance conversion definition information from the recording medium, Decoding the encoded data, Converting the standard video obtained by decoding the encoded data into the extended video based on the luminance conversion definition information, Outputting the data of the extended video and the luminance characteristic information to a display device capable of displaying the extended video, Outputting the data of the standard video to a display device that cannot display the extended video A recording medium on which processing is performed

Explanation of Signs

[0447] 1 Recording device, 2 Playback device, 3 Display device, 11 Optical disk, 21 Controller, 21A Data Base information generation unit, 22 Encoding processing unit, 23 Disk drive, 31 HDR information generation unit, 32 HEVC encoder, 33 HDR-STD conversion unit, 34 Definition information generation unit, 35 HEVC stream generation unit, 51 Controller, 52 Disk drive, 53 Memory, 56 Decoding processing unit, 58 HDMI communication unit, 71 Parameter extraction unit, 72 HEVC decoder, 73 HDR-STD conversion unit, 74 STD-HDR conversion unit, 75 Output unit

Claims

1. A display that supports HDR video, A communication unit that receives HDR video played by a playback device based on the luminance performance information of the display unit, together with luminance characteristic information in data of each frame; a control unit that, when the display unit has a luminance performance capable of displaying the HDR video output from the playback device, causes the display unit to display an image according to the luminance characteristic information, and, when the display unit does not have a luminance performance capable of displaying the HDR video output from the playback device, causes the display unit to display the image after adjusting the luminance of the HDR video output from the playback device according to the luminance performance of the display unit; A display device comprising:

2. The luminance characteristic information includes a parameter indicating the luminance of a standard monitor. The display device according to claim 1 .

3. The luminance characteristic information further includes a parameter indicating a black level and a parameter indicating a white level. The display device according to claim 2 .

4. The control unit determines whether the HDR video output from the playback device is adjusted by comparing a luminance range represented by the luminance performance information with a luminance range represented by the luminance characteristic information. The display device according to claim 1 .

5. The display device further includes a signal processing unit that adjusts the brightness of the HDR video output from the playback device based on the brightness characteristic information.

5. The display device according to claim 1.

6. The HDR video output from the playback device is an HDR video obtained by decoding the coded data including the luminance characteristic information, or an HDR video obtained by extending the luminance of a video obtained by decoding the coded data including the luminance characteristic information. The display device according to claim 1 .

7. The reproduction device extends the luminance based on luminance conversion definition information included in the encoded data. The display device according to claim 6.

8. The data of each frame is an HDMI InfoFrame. The display device according to claim 1 .

9. The data includes data of reference screen luminance white. The display device according to claim 1 .

10. The data includes extended range white level data. The display device according to claim 1 .

11. The data includes nominal black level code data. The display device according to claim 1 .

12. The data includes nominal white level code data. The display device according to claim 1 .

13. The data includes extended white level code data. The display device according to claim 1 .

14. The brightness of the HDR video output from the playback device is adjusted by compressing the brightness of the HDR video. The display device according to claim 1 .

15. The luminance of the HDR video output from the playback device is not compressed, and the image is displayed on the display unit according to the luminance characteristic information. The display device according to claim 1 .

16. A display device having a display unit capable of displaying HDR video, Receive an HDR video that is reproduced by a reproduction device based on the luminance performance information of the display unit and output from the reproduction device, and luminance characteristic information indicating luminance characteristics; When the display unit has a luminance performance capable of displaying the HDR video output from the playback device, the display unit displays the image without adjusting the luminance of the HDR video output from the playback device; If the display unit does not have a luminance performance capable of displaying the HDR video output from the playback device, the luminance of the HDR video output from the playback device is adjusted based on the luminance characteristic information, and then the image is displayed on the display unit. Display control method.

17. The brightness of the HDR video output from the playback device is adjusted by compressing the brightness of the HDR video. The display control method according to claim 16.

18. The luminance of the HDR video output from the playback device is not compressed, and the image is displayed on the display unit according to the luminance characteristic information. A display control method according to any one of claims 16 to 17.

Images