Video reception method and video reception apparatus

The video reception method and device address the challenge of displaying video images across multiple luminance dynamic ranges by using transfer characteristic information to control the display unit's luminance range, ensuring accurate and appropriate image display.

JP2025071115AInactive Publication Date: 2025-05-02PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2025020139
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2015-09-14
Filing Date
2025-02-10
Publication Date
2025-05-02
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing video reception and transmission methods struggle to accurately display video images corresponding to multiple luminance dynamic ranges, such as SDR and HDR, leading to inappropriate image display.

Method used

A video reception method and device that receive and decode video signals, along with transfer characteristic information, to control the luminance dynamic range of the display unit, allowing for accurate switching between SDR and HDR modes based on the received information.

Benefits of technology

Enables the display of more appropriate video images by accurately controlling the luminance dynamic range of the display unit, ensuring seamless switching between SDR and HDR modes, and preventing excessively bright images during errors.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025071115000001_ABST
    Figure 2025071115000001_ABST
Patent Text Reader

Abstract

To display appropriate video.SOLUTION: A video reception method is performed by a video reception apparatus 100 including a display unit 105. The video reception method includes: a receiving step (S111) of receiving a reception signal 111 including a video signal; an acquisition step (S112A) of acquiring, from the reception signal 111, the video signal 112 and first transfer characteristics information 113 for identifying a transfer function corresponding to the luminance dynamic range of the video signal 112; and a decoding step (S113) of acquiring video data 114 by decoding the video signal 112 acquired. The transfer characteristics information is information for identifying a first transfer function corresponding to a standard dynamic range (SDR), or a second transfer function corresponding to a high dynamic range (HDR) that is wider than the SDR.SELECTED DRAWING: Figure 15
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a video receiving method, a video transmitting method, a video receiving device, and a video transmitting device. [Background technology]

[0002] HDR (High Dynamic Range) is attracting attention as a method that supports a luminance range with an expanded maximum luminance value in order to express bright light such as specular reflections that cannot be expressed with current TV signals in a more realistic brightness while maintaining the dark gradation of conventional images. Specifically, the luminance range method supported by conventional TV signals is called SDR (Standard Dynamic Range), which has a maximum luminance value of 100 nits, whereas HDR is expected to expand the maximum luminance value to over 1000 nits. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] ARIB STANDARD ARIB STD-B67 Version 1.0 July 3, 2015 Summary of the Invention [Problem to be solved by the invention]

[0004] In transmitting or receiving such video signals corresponding to a plurality of luminance dynamic ranges, it is desirable for the receiving device to be able to display a more appropriate image.

[0005] SUMMARY OF THE PRESENT DISCLOSURE An object of the present invention is to provide a video receiving method, a video transmitting method, a video receiving device, or a video transmitting device that can display appropriate video. [Means for solving the problem]

[0006] A video receiving method according to one embodiment of the present invention is a video receiving method in a video receiving device, and includes a receiving step of receiving a received signal including a video signal, an acquisition step of acquiring from the received signal the video signal, transfer characteristic information for identifying a transfer function corresponding to a luminance dynamic range of the video signal, and information for identifying the transfer function in a unit corresponding to an MPU (Media Processing Unit), and a decoding step of acquiring video data by decoding the acquired video signal, wherein the transfer characteristic information is information for identifying a first transfer function corresponding to SDR (Standard Dynamic Range) or a second transfer function corresponding to HDR (High Dynamic Range) which is wider than the SDR.

[0007] A video transmission method according to one embodiment of the present invention includes an encoding step of generating a video signal by encoding video data, a generation step of generating a transmission signal including the generated video signal, transfer characteristic information for identifying a transfer function corresponding to a luminance dynamic range of the video signal, and information for identifying the transfer function in a unit corresponding to an MPU (Media Processing Unit), and a transmission step of transmitting the transmission signal, wherein the transfer characteristic information is information for identifying a first transfer function corresponding to a first luminance dynamic range or a second transfer function corresponding to a second dynamic range wider than the first luminance dynamic range.

[0008] Furthermore, these general or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, or may be realized by any combination of a system, a method, an integrated circuit, a computer program, and a recording medium. Effect of the Invention

[0009] The present invention can provide a video receiving method, a video transmitting method, a video receiving device, or a video transmitting device that can display appropriate images. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram of a video receiving device according to the first embodiment. [Diagram 2] FIG. 2 is a flowchart of a process performed by a display control unit according to the first embodiment. [Diagram 3] FIG. 3 is a flowchart of a video reception process according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an operation when the transfer characteristic changes according to the first embodiment. [Diagram 5] FIG. 5 is a diagram showing an operation when the transfer characteristic changes according to the first embodiment. [Figure 6] FIG. 6 is a block diagram of the video transmitting device according to the first embodiment. [Figure 7] FIG. 7 is a flowchart of the video transmission process according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing an abnormal operation when the transfer characteristic changes according to the second embodiment. [Figure 9] FIG. 9 is a block diagram of a video receiving device according to the second embodiment. [Figure 10] FIG. 10 is a flowchart of a process performed by a display control unit according to the second embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of a time stamp descriptor according to the third embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of an extended time stamp descriptor according to the third embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a video component descriptor according to the third embodiment. [Figure 14] FIG. 14 is a flowchart of a process performed by a display control unit according to the third embodiment. [Figure 15] FIG. 15 is a flowchart of a video reception process according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] (Findings on which the present invention is based) In the video coding standard ITU-T H.265|ISO / IEC 23008-2 HEVC, for example, the OETF (Optical-Electro Transfer Function) or EOTF (Electro-Optical Transfer Function) of a video signal is notified by a syntax called transfer characteristics in Video Usability Information (VUI) in the Sequence Parameter Set (SPS). By using the transfer characteristics of this SPS, it is possible to notify switching of transfer characteristics (transfer functions) with frame accuracy. The video receiving device determines a control method for the video display unit based on the transfer characteristics.

[0012] In the MPEG-2 TS (Transport Stream) standard, which is used when multiplexing and transmitting video and audio signals such as those for television broadcasting, a method is known in which the parameters and parameter-related information contained in the SPS are described in the Program-specific information (PSI) Descriptor, and information related to the operation of the video receiving device is notified at a higher layer. Regarding the transmission characteristics, by using the PSI descriptor, the video receiving device can more easily determine the control method for the video display unit. Generally, PSI is inserted into the multiplexed stream at a fixed cycle, so it is not synchronized with the frames of the video signal. Note that the MPEG-H MMT standard specifies a mechanism similar to PSI as MMT-SI.

[0013] The transfer characteristics are specified in ITU-R BT.2020 (hereinafter referred to as BT.2020), ARIB STD-B67 (hereinafter referred to as STD-B67), and SMPTE ST2084 (hereinafter referred to as ST2084), etc. STD-B67 and ST2084 can handle video signals that contain 10 to 100 times higher brightness than conventional BT.2020, which is called high dynamic range (HDR). In contrast to HDR, conventional BT.2020 and other standards are called standard dynamic range (SDR).

[0014] In HDR-compatible television broadcasts, HDR and SDR may coexist for each program or commercial, so video receiving devices must switch the display control depending on whether HDR or SDR is being displayed.

[0015] A video receiving method according to one embodiment of the present invention is a video receiving method in a video receiving device equipped with a display unit, and includes a receiving step of receiving a received signal in which a video signal and an audio signal are multiplexed, a demultiplexing step of demultiplexing the received signal to obtain the video signal and transfer characteristic information for identifying a transfer function corresponding to the luminance dynamic range of the video signal for each random access unit, a decoding step of decoding the obtained video signal to obtain video data, and a display step of displaying the video data while controlling the luminance dynamic range of the display unit for each random access unit in accordance with the transfer characteristic information.

[0016] This allows the brightness dynamic range of the display unit to be controlled for each random access unit, so that more appropriate images can be displayed. In addition, the video receiving device can acquire the transfer characteristic prior to decoding the video signal by using the transfer characteristic information included in the multiplexing layer, so that the transfer characteristic switching process can be easily performed.

[0017] For example, the transmission characteristic information may be included in control information for each random access unit included in the received signal.

[0018] For example, the transmission characteristic information may be included in control information of a program, which is included in the received signal and which includes a plurality of random access units.

[0019] For example, the transfer characteristic information may include first information for identifying a current transfer function, second information indicating whether the transfer function will be switched within the program, third information for identifying the transfer function after the switch, and fourth information for identifying a random access unit in which the transfer function will be switched.

[0020] For example, the transfer characteristic information is information for identifying, with frame accuracy, a first transfer function corresponding to a first luminance dynamic range or a second transfer function corresponding to a second dynamic range wider than the first luminance dynamic range, and in the display step, the luminance dynamic range of the display unit may be switched between the first luminance dynamic range and the second luminance dynamic range.

[0021] For example, the video receiving method may further include a determination step of determining whether the video data was correctly acquired in the receiving step, and in the display step, if it is determined in the determination step that the video data was not correctly acquired, the luminance dynamic range of the display unit may be set to the first luminance dynamic range.

[0022] This makes it possible to prevent an excessively bright image from being displayed when an error occurs.

[0023] For example, in the determining step, the determination may be made as to whether an intra-coded frame has been correctly decoded.

[0024] For example, the video signal may be a video signal of a first resolution or a second resolution higher than the first resolution, and the video receiving method may further include a conversion step of converting the video signal of the first resolution into a video signal of the second resolution when the resolution of the video signal switches between the first resolution and the second resolution.

[0025] This makes it possible to prevent the occurrence of switching of the resolution.

[0026] For example, the video receiving method may further include a conversion step of converting the resolution of the video signal to a maximum resolution specified by a broadcast service of the received signal if the resolution of the video signal is lower than the maximum resolution specified by the broadcast service of the received signal.

[0027] This makes it possible to prevent the occurrence of switching of the resolution.

[0028] In addition, a video transmission method according to one embodiment of the present invention includes an encoding step of generating a video signal by encoding video data, a multiplexing step of multiplexing the generated video signal and an audio signal to generate a transmission signal including transfer characteristic information for identifying a transfer function corresponding to the luminance dynamic range of the video signal for each random access unit, and a transmission step of transmitting the transmission signal.

[0029] As a result, a video receiving device that receives a signal generated by the video transmission method can control the luminance dynamic range of the display unit for each random access unit, thereby displaying a more appropriate video. In addition, the video receiving device can acquire the transfer characteristic prior to decoding the video signal by using the transfer characteristic information included in the multiplexing layer, thereby easily performing transfer characteristic switching processing.

[0030] For example, the transmission characteristic information may be included in control information for each random access unit included in the transmission signal.

[0031] For example, the transmission characteristic information may be included in control information for each of a plurality of random access units included in the transmission signal.

[0032] For example, the transfer characteristic information may include first information for identifying a current transfer function, second information indicating whether the transfer function will be switched in the multiple random access units, third information for identifying the transfer function after the switch, and fourth information for identifying the random access unit in which the transfer function will be switched.

[0033] For example, the transfer characteristic information is information for identifying, with frame accuracy, a first transfer function corresponding to a first luminance dynamic range or a second transfer function corresponding to a second dynamic range wider than the first luminance dynamic range, and in the display step, the luminance dynamic range of the display unit may be switched between the first luminance dynamic range and the second luminance dynamic range.

[0034] In addition, a video receiving device according to one embodiment of the present invention includes a receiving unit that receives a received signal in which a video signal and an audio signal are multiplexed, a demultiplexing unit that demultiplexes the received signal to obtain the video signal and transfer characteristic information for identifying a transfer function corresponding to the luminance dynamic range of the video signal for each random access unit, a decoding unit that decodes the obtained video signal to obtain video data, and a display unit that displays the video data while controlling the luminance dynamic range for each random access unit in accordance with the transfer characteristic information.

[0035] This allows the video receiving device to control the luminance dynamic range of the display unit for each random access unit, thereby enabling more appropriate video display. In addition, the video receiving device can acquire the transfer characteristic prior to decoding the video signal by using the transfer characteristic information included in the multiplexing layer, thereby facilitating the transfer characteristic switching process.

[0036] In addition, a video transmission device according to one embodiment of the present invention includes an encoding unit that generates a video signal by encoding video data, a multiplexing unit that multiplexes the generated video signal and an audio signal to generate a transmission signal including transfer characteristic information for identifying a transfer function corresponding to the luminance dynamic range of the video signal for each random access unit, and a transmitting unit that transmits the transmission signal.

[0037] As a result, the video receiving device that receives the signal generated by the video transmitting device can control the luminance dynamic range of the display unit for each random access unit, so that it can display more appropriate images. In addition, the video receiving device can acquire the transfer characteristic prior to decoding the video signal by using the transfer characteristic information included in the multiplexing layer, so that it can easily perform the transfer characteristic switching process.

[0038] Hereinafter, the embodiment will be specifically described with reference to the drawings.

[0039] Note that the embodiments described below each show a specific example of the present invention. The numerical values, shapes, materials, components, the arrangement and connection of the components, steps, and the order of steps shown in the following embodiments are merely examples and are not intended to limit the present invention. Furthermore, among the components in the following embodiments, components that are not described in an independent claim showing a superordinate concept are described as optional components.

[0040] (Embodiment 1) The video receiving device according to the present embodiment controls the luminance dynamic range of the display unit with frame accuracy by using transfer characteristic information indicating transfer characteristics with frame accuracy, thereby enabling the video receiving device to display more appropriate video.

[0041] First, the configuration of a video receiving device according to this embodiment will be described. Fig. 1 is a block diagram of a video receiving device 100 according to this embodiment. The video receiving device 100 is, for example, a television or the like, and receives a reception signal 111 transmitted by broadcast waves and displays a video based on the received reception signal 111. The video receiving device 100 includes a receiving unit 101, a demultiplexing unit 102, a video decoding unit 103, a display control unit 104, and a display unit 105.

[0042] The receiving unit 101 receives a reception signal 111. The reception signal 111 is a system stream in which a video signal and an audio signal are multiplexed.

[0043] The demultiplexer 102 generates a video signal 112, which is a video stream, by demultiplexing (system decoding) the received signal 111. The demultiplexer 102 also outputs a transfer characteristic acquired from a descriptor or the like included in the received signal 111 as first transfer characteristic information 113. That is, the first transfer characteristic information 113 is included in a multiplexing layer.

[0044] The video decoding unit 103 generates video data 114 by decoding the video signal 112. Furthermore, the video decoding unit 103 outputs the transfer characteristic acquired from the SPS as second transfer characteristic information 115. That is, the second transfer characteristic information 115 is included in a video coding layer.

[0045] The second transfer characteristic information 115 is information for specifying a transfer function (OETF or EOTF) with frame accuracy corresponding to the luminance dynamic range of the video data 114. For example, the second transfer characteristic information 115 is information for specifying a first transfer function corresponding to a first luminance dynamic range (SDR) or a second transfer function corresponding to a second dynamic range (HDR) wider than the first luminance dynamic range with frame accuracy. That is, the second transfer characteristic information 115 indicates whether the video data 114 is SDR or HDR. In addition, when there are multiple formats of HDR, the second transfer characteristic information 115 may indicate which format of HDR it is. That is, the second transfer characteristic information 115 indicates the luminance dynamic range of the video data 114, and indicates, for example, any one of multiple predetermined luminance dynamic ranges.

[0046] Moreover, the SPS is control information included in the video signal 112 in sequence units (multiple frames).

[0047] The display control unit 104 generates control information 116 for controlling the display unit 105 in accordance with the first transfer characteristic information 113 and the second transfer characteristic information 115 .

[0048] The display unit 105 displays the video data 114 while controlling the luminance dynamic range with frame accuracy in accordance with the control information 116 (i.e., the first transfer characteristic information 113 and the second transfer characteristic information 115). The display unit 105 includes an image characteristic conversion unit 106 and a display device 107.

[0049] The image characteristic conversion unit 106 converts the image data 114 in accordance with the control information 116 to generate an input signal 117. Specifically, the image characteristic conversion unit 106 converts the image data 114 into the input signal 117 by using a transfer function indicated by the first transfer characteristic information 113 or the second transfer characteristic information 115.

[0050] Display device 107 is, for example, a liquid crystal panel, and changes the luminance dynamic range of the image to be displayed in accordance with control information 116. For example, when display device 107 is a liquid crystal panel, display device 107 changes the maximum luminance of the backlight.

[0051] Next, the operation of the video receiving device 100 will be described. Although Fig. 1 shows a configuration using both the first transfer characteristic information 113 and the second transfer characteristic information 115, it is sufficient to use at least the second transfer characteristic information 115. Hereinafter, the control using the second transfer characteristic information 115 will be described in detail.

[0052] Fig. 2 is a flowchart of a display control process by the display control unit 104. Note that the process shown in Fig. 2 is performed on a frame-by-frame basis or every time the second transfer characteristic information 115 is changed.

[0053] First, the display control unit 104 determines whether the second transfer characteristic information 115 indicates SDR or HDR (S101).

[0054] When the second transfer characteristic information 115 indicates HDR (Yes in S101), the display control unit 104 outputs control information 116 for HDR display (S102). As a result, the display unit 105 displays the image in a luminance dynamic range corresponding to HDR.

[0055] On the other hand, if the second transfer characteristic information 115 indicates SDR (No in S101), the display control unit 104 outputs control information 116 for displaying SDR (S103). This causes the display unit 105 to display an image with a luminance dynamic range corresponding to SDR.

[0056] In this way, by switching the control information 116 in response to the second transfer characteristic information 115 notified with frame accuracy, it is possible to synchronize the switching of the transfer characteristic and the control of the display unit 105 with frame accuracy.

[0057] In addition, when there are multiple HDR methods (for example, STD-B67 and ST2084), identification information of the HDR method may be included in the control information 116 for HDR display. This allows the display unit 105 to display an image with a luminance dynamic range of the corresponding method.

[0058] 3 is a flowchart of the video reception process by the video receiving device 100. First, the receiving unit 101 receives the received signal 111 (S111). Next, the demultiplexing unit 102 demultiplexes the received signal 111 to generate a video signal 112 (S112). Next, the video decoding unit 103 decodes the video signal 112 to generate video data 114, and acquires second transfer characteristic information 115 (S113).

[0059] Next, the display control unit 104 controls the luminance dynamic range of the display unit 105 according to the second transfer characteristic information 115. Specifically, the display control unit 104 determines whether each frame is HDR or SDR with frame accuracy based on the second transfer characteristic information 115 (S114). If it is HDR (Yes in S114), the display unit 105 displays the image with the luminance dynamic range of HDR (S115). If it is SDR (No in S114), the display unit 105 displays the image with the luminance dynamic range of SDR (S116).

[0060] Fig. 4 is a diagram showing a state when switching from an SDR program to an HDR program. Fig. 5 is a diagram showing a state when switching from an HDR program to an SDR program. As shown in Fig. 4 and Fig. 5, the above processing makes it possible to appropriately switch between SDR and HDR with frame accuracy.

[0061] Hereinafter, a description will be given of a video transmitting device 200 that generates a transmission signal 212 corresponding to the above-mentioned received signal 111. Fig. 6 is a block diagram of the video transmitting device 200 according to the present embodiment. The video transmitting device 200 shown in Fig. 6 includes a generating unit 201 and a transmitting unit 202.

[0062] The generating unit 201 generates a transmission signal 212 including video data and second transfer characteristic information for specifying a transfer function corresponding to the luminance dynamic range of the video data with frame accuracy. The generating unit 201 includes a video encoding unit 203 and a multiplexing unit 204.

[0063] 7 is a flowchart of a video transmission process by the video transmitting device 200. First, the video encoding unit 203 generates a video signal 211 by encoding video data and second transfer characteristic information (S201). This second transfer characteristic information corresponds to the above-mentioned second transfer characteristic information 115, and is information for specifying, with frame accuracy, a first transfer function corresponding to a first luminance dynamic range (for example, SDR) or a second transfer function corresponding to a second dynamic range (for example, HDR) wider than the first luminance dynamic range. In addition, the second transfer characteristic information is stored in an SPS included in the video signal 211.

[0064] Next, the multiplexing unit 204 multiplexes the encoded video signal 211 and audio signal to generate the transmission signal 212 (S202). Next, the transmitting unit 202 transmits the generated transmission signal 212 (S203).

[0065] In this way, the video transmitting device 200 generates the transmission signal 212 including the second transfer characteristic information for identifying the transfer function with frame accuracy. This allows the video receiving device receiving the transmission signal 212 to control the luminance dynamic range of the display unit with frame accuracy, thereby enabling more appropriate video to be displayed.

[0066] (Embodiment 2) In TV broadcasting, errors may occur due to the radio wave conditions of terrestrial waves or satellites. FIG. 8 is a diagram showing a state in which a reception error occurs due to radio wave interference or the like. As shown in FIG. 8, when switching from SDR to HDR, it is assumed that after the video receiving device acquires the second transfer characteristic information 115 in the SPS, the video stream is lost due to radio wave interference or the like, and the first frame of HDR cannot be acquired. In this case, the video decoding unit 103 continues to display the previous frame to conceal the error. In other words, the frames of the SDR program are repeatedly displayed.

[0067] In this case, when this frame is referenced by subsequent frames, abnormal images that contain images of past programs are displayed as subsequent images.

[0068] In addition, immediately after the switch, the brightness dynamic range of the display is set to HDR, so frames from SDR programs are displayed in the HDR brightness dynamic range, resulting in a problem of images being displayed that are brighter than originally intended.

[0069] In this embodiment, a video receiving device that addresses this problem will be described. Fig. 9 is a block diagram of a video receiving device 100A according to this embodiment. The video receiving device 100A shown in Fig. 9 further includes an abnormality detection unit 108 and a message superimposition unit 109 in a display unit 105A in addition to the components of the video receiving device 100 shown in Fig. 1. Also, a function is added to the display control unit 104A.

[0070] The abnormality detection unit 108 judges whether the video data 114 (video signal 112) has been correctly acquired. Specifically, the abnormality detection unit 108 detects packet loss based on the sequence number of the packet, and determines whether all of the frame data has been acquired (normal) or whether only a part of the frame data has been acquired (abnormal) by analyzing the payload of the packet and acquiring the starting position of the frame data. The abnormality detection unit 108 also outputs abnormality notification information 118 indicating the judgment result to the display control unit 104A. In other words, the occurrence of an abnormality or information for identifying the frame in which the abnormality has occurred is notified to the display control unit 104A.

[0071] The display control unit 104A generates control information 116 and a message 119 in response to the abnormality notification information 118, in addition to the first transfer characteristic information 113 and the second transfer characteristic information 115. Specifically, when an abnormality occurs, the display control unit 104A generates a message 119 indicating that an abnormality occurs, and also generates control information 116 for SDR display.

[0072] The message superimposing unit 109 generates an input signal 120 by superimposing the message 119 on the video data (input signal 117) in accordance with the control information 116 and the message 119, and outputs the generated input signal 120 to the display device 107. In this way, a message such as "An error has occurred" is displayed on the display device 107, thereby informing the viewer that the problem is not due to a malfunction of the equipment.

[0073] 10 is a flowchart of the display control process by the display control unit 104A. First, the display control unit 104A determines whether the second transfer characteristic information 115 has been updated (S121). If the second transfer characteristic information 115 has been updated (Yes in S121), the display control unit 104A starts determining whether to switch the display control.

[0074] First, the display control unit 104A judges whether the video data has been correctly acquired. Specifically, the display control unit 104A judges whether the intra-coded frame has been correctly decoded based on the abnormality notification information 118 (S122). If the intra-coded frame has not been correctly decoded (No in S122), the display control unit 104A outputs the control information 116 for SDR display (S123). This causes the display unit 105 to display the video in a luminance dynamic range corresponding to SDR. In other words, if it is judged that the video data has not been correctly acquired, the display control unit 104A sets the luminance dynamic range of the display unit 105 to SDR (first luminance dynamic range).

[0075] If an error occurs during switching, the displayed frame may contain pixels from the frame before switching. In response to this, in this embodiment, by setting the display control for SDR display in such a case, it is possible to prevent frames of an SDR program from being displayed with the high brightness setting of HDR.

[0076] Furthermore, when an intra-coded frame that guarantees jump-in playback, such as IDR or CRA of HEVC, is normally decoded (Yes in S122), the display control is switched in the same manner as in the first embodiment. That is, the display control unit 104A determines whether the updated second transfer characteristic information 115 indicates SDR or HDR (S124). When the second transfer characteristic information 115 indicates HDR (Yes in S124), the display control unit 104A outputs control information 116 for HDR display (S125). On the other hand, when the second transfer characteristic information 115 indicates SDR (No in S124), the display control unit 104A outputs control information 116 for SDR display (S126).

[0077] In this way, the video receiving device 100A according to the present embodiment displays video in the luminance dynamic range of SDR when an error occurs, thereby making it possible to prevent an excessively bright video from being displayed when an error occurs.

[0078] (Embodiment 3) In this embodiment, a description will be given of details of the first transfer characteristic information 113 and processing using the first transfer characteristic information 113. First, an example of a transfer characteristic acquired in the demultiplexer 102 will be described.

[0079] When MMT is used as the multiplexing method, the PTS and DTS of the access unit (corresponding to a picture) that is the first in decoding order in a random access unit called an MPU (Media Processing Unit) can be transmitted by a descriptor. For example, in STD-B60 of the Association of Radio Industries and Business (ARIB), the PTS of the first access unit of the MPU, or the DTS of the first access unit of the MPU and the DTS and PTS of the subsequent access unit are transmitted as program control information, respectively, using an MPU timestamp descriptor or an MPU extended timestamp descriptor.

[0080] Fig. 11 is a diagram showing an example of the syntax of an MPU timestamp descriptor (MPU_Timestamp_Discriptor) including the HDR identification information 301. Fig. 12 is a diagram showing an example of the syntax of an MPU extended timestamp descriptor (MPU_Extended_Timestamp_Discriptor) including the HDR identification information 301.

[0081] As shown in Fig. 11 or 12, by extending the MPU timestamp descriptor or the MPU extended timestamp descriptor, HDR identification information 301 (mpu_hdr_indicator) indicating whether the EOTF of the access unit constituting the MPU is HDR or SDR can be added to the transmission signal 212 (received signal 111). Note that when there are multiple HDR EOTFs, such as when both STD-B67 and SMPTE ST2084 are usable, the HDR identification information 301 may include information for identifying the type of HDR EOTF. Also, other descriptors may be used as long as the EOTF identification information for each MPU can be transmitted.

[0082] When MPEG-2 TS is used as the multiplexing method, 13818-1 AMD6 (Delivery of Timeline for External Data) may be extended to associate the PTS or DTS of an access unit with the identification information of the EOTF. Alternatively, the EOTF identification information of a random access unit may be stored using a descriptor as in the case of MMT, or the EOTF identification information of a random access unit may be signaled using the header information of the PES or TS.

[0083] In this way, the first transfer characteristic information 113 is included in the control information for each random access unit included in the transmission signal 212 (received signal 111). Here, a random access unit is a unit consisting of a plurality of access units (frames) in which any access is guaranteed.

[0084] The first transfer characteristic information 113 may be stored in information per program including multiple MPUs, rather than as information per MPU, such as an MPU timestamp descriptor. In ARIB, the resolution, aspect ratio, and frame rate of a video stream are stored in a video component descriptor, which is information per program. Therefore, the first transfer characteristic information 113 can also be stored in this video component descriptor. However, since information per program is transmitted periodically, such as every 0.5 or 0.1 seconds, there are cases where the information cannot be updated per frame or random access. Therefore, in this case, transfer characteristic information that will become valid in the future is stored together with currently valid transfer characteristic information.

[0085] Figure 13 is a diagram showing an example of the syntax of a video component descriptor. Current_EOTF (first information) indicates the currently valid EOTF (transfer function), and EOTF_update_flag (second information) indicates whether the EOTF will be changed in the future. In other words, EOTF_update_flag (second information) indicates whether the transfer function will be changed in the program.

[0086] When the EOTF_update_flag (second information) indicates that the EOTF is to be changed, the video component descriptor includes new_EOTF (third information) indicating the new EOTF, and new_EOTF_start_mpu_sequence_number (fourth information) indicating the sequence number of the MPU for which the new EOTF is valid. In other words, new_EOTF_start_mpu_sequence_number (fourth information) is information for identifying the random access unit for which the EOTF is to be changed.

[0087] In addition, when there is only one type of HDR, it is necessary to know whether it is HDR or SDR. In other words, since the EOTF after switching can be determined only by EOTF_update_flag, the new_EOTF field may be omitted.

[0088] By transmitting the transfer characteristics as described above, the video receiving device can obtain the transfer characteristics of the access units constituting the MPU based only on the information of the multiplexing layer (attribute information of the AV data to be multiplexed and header information of the packet storing the AV data). Furthermore, in the conventional seamless connection in ARIB, the PID of the TS packet storing the video stream or the asset ID (or packet ID) of the MMT packet is switched before and after switching the resolution, etc., which makes it difficult to manage the STD (System Target Decoder) buffer for packets with the same ID, or causes a temporary interruption of data supply on the sending side at the switching point. By using this method, this problem can be solved.

[0089] This technique can also be applied to seamlessly switching between multiple audio codecs.

[0090] Also, the configuration of the video receiving device 100A according to the present embodiment is different from that of the second embodiment in that a function is added to the display control unit 104A in the configuration shown in FIG.

[0091] First, prior to decoding the video signal 112, the demultiplexer 102 acquires the above-mentioned transfer characteristics (HDR identification information 301, etc.) from the information of the multiplexing layer, and outputs first transfer characteristic information 113 for identifying the acquired transfer characteristic to the display control unit 104A.

[0092] In this way, the video receiving device 100A can acquire the first transfer characteristic information 113 prior to decoding the video signal 112, and can acquire the first transfer characteristic information 113 earlier than the second transfer characteristic information 115. This can lengthen the period from when the display control unit 104A acquires the transfer characteristic information to when it actually controls the video characteristic conversion unit 106 and the display device 107. In particular, assuming switching of transfer characteristics on an access unit basis, when acquiring transfer characteristics based on the decoding result, the higher the frame rate, the less time there is, so it is highly effective to acquire transfer characteristics in advance from the multiplexing layer.

[0093] Fig. 14 is a flowchart of a display control process by the display control unit 104A. The process shown in Fig. 14 differs from the process shown in Fig. 10 in steps S121A and S124A.

[0094] In step S121A, the display control unit 104A determines whether the first transfer characteristic information 113 has been updated in addition to the second transfer characteristic information 115. Since the first access unit of the MPU is an intra-coded frame, in step S122, when the display control unit 104A operates based on the first transfer characteristic information 113, the display control unit 104A operates based on the first transfer characteristic information 113 corresponding to the sequence number (mpu_sequence_number) of the same MPU and the decoded result of the intra-coded frame. In step S124A, the display control unit 104A operates based on the first transfer characteristic information 113 or the second transfer characteristic information 115.

[0095] Although FIG. 14 shows an example in which both the first transfer characteristic information 113 and the second transfer characteristic information 115 are used, only the first transfer characteristic information 113 may be used.

[0096] 15 is a flowchart of a video reception process by the video receiving device 100A according to the present embodiment. First, the receiving unit 101 receives a received signal 111 (S111). Next, the demultiplexing unit 102 demultiplexes the received signal 111 to generate a video signal 112 and obtains the first transfer characteristic information 113 (S112A).

[0097] Here, the first transfer characteristic information 113 is information for specifying a transfer function (OETF or EOTF) corresponding to the luminance dynamic range of the video data 114 (video signal 112) for each random access unit (MPU unit). For example, the first transfer characteristic information 113 is information for specifying a first transfer function corresponding to a first luminance dynamic range (SDR) or a first transfer function corresponding to a second dynamic range (HDR) wider than the first luminance dynamic range for each random access unit. That is, the first transfer characteristic information 113 indicates whether the video data 114 is SDR or HDR. In addition, when there are multiple formats of HDR, the first transfer characteristic information 113 may indicate which format of HDR it is. That is, the first transfer characteristic information 113 indicates the luminance dynamic range of the video data 114, and indicates, for example, any one of multiple predetermined luminance dynamic ranges.

[0098] Next, the video decoding unit 103 generates video data 114 by decoding the video signal 112 (S113).

[0099] Next, the display control unit 104A controls the luminance dynamic range of the display unit 105 according to the first transfer characteristic information 113. Specifically, the display control unit 104A determines whether each MPU is HDR or SDR on an MPU-by-MPU basis based on the first transfer characteristic information 113 (S114A). If it is HDR (Yes in S114A), the display unit 105 displays the image in the HDR luminance dynamic range (S115). If it is SDR (No in S114A), the display unit 105 displays the image in the SDR luminance dynamic range (S116).

[0100] As a result, the video receiving device 100A can control the luminance dynamic range of the display unit 105 for each random access unit, and can display more appropriate video. Also, the video receiving device 100A can acquire the transfer characteristic prior to decoding the video signal 112 by using the first transfer characteristic information 113 included in the multiplexing layer, and can easily perform the transfer characteristic switching process.

[0101] Moreover, the configuration and operation of the video transmitting device 200 that generates the transmission signal 212 corresponding to the above-mentioned received signal 111 are generally similar to those in the above-mentioned first embodiment.

[0102] Specifically, in step S202 shown in FIG. 7, the multiplexer 204 generates the transmission signal 212 including the first transfer characteristic information 113.

[0103] In this way, the video transmitting device 200 generates a transmission signal 212 including first transfer characteristic information for identifying a transfer function for each random access unit. This allows the video receiving device receiving the transmission signal 212 to control the luminance dynamic range of the display unit for each random access unit, thereby enabling more appropriate video to be displayed. Furthermore, since the first transfer characteristic information 113 is included in the multiplexing layer, the video receiving device can easily perform a process of switching the transfer characteristics.

[0104] A modification of this embodiment will now be described.

[0105] In cases where a video receiving device such as an STB (Set Top Box), DVD device, or Blu-ray (registered trademark) device receives a system stream and outputs it to a display device such as a television, the video receiving device and the display device are connected via a communication protocol such as HDMI (registered trademark). Here, in HDMI (registered trademark) and the like, a protocol re-authentication procedure occurs when the resolution of the stream is changed.

[0106] Therefore, when a resolution change such as between 2K (e.g., 1920×1080 pixels) and 4K (e.g., 3840×2160 pixels) may occur, it is desirable for the video receiving device to output a video signal according to the maximum resolution at the start of playback. In other words, when 2K and 4K are mixed, even when playback starts from a 2K stream, the receiving device upconverts the 2K stream to 4K and outputs it. In this way, even if the signal switches to 4K midway, the resolution remains at 4K and no resolution change occurs. For example, when a switch between 2K SDR and 4K HDR occurs, the video receiving device converts 2K SDR to 4K SDR and outputs it.

[0107] That is, the video signal (video data 114) is a video signal with a first resolution or a second resolution higher than the first resolution. When the resolution of the video signal switches between the first resolution and the second resolution, the video receiving device 100A converts the video signal with the first resolution into a video signal with the second resolution.

[0108] In addition, in broadcasting, since identification information of the maximum resolution allowed in the broadcasting service is indicated by a descriptor or the like, the video receiving device may operate to always match the output signal to HDMI (registered trademark) to the maximum resolution. For example, in the case of UHD (Ultra High Definition) service, the maximum resolution is specified as either 4K or 8K. Furthermore, if the multiplexing method is TS, the maximum resolution is specified as 2K, and if the multiplexing method is MMT, the maximum resolution is specified as 4K. In this way, the video receiving device may always convert and output the video signal to the maximum resolution according to the multiplexing method.

[0109] That is, when the resolution of the video signal (video data 114) is lower than the maximum resolution defined by the broadcast service of the received signal 111, the video receiving device 100A converts the resolution of the video signal into the maximum resolution.

[0110] Although the video receiving device and the video transmitting device according to the embodiment of the present invention have been described above, the present invention is not limited to this embodiment.

[0111] Furthermore, each processing unit included in the video receiving device and the video transmitting device according to the above-mentioned embodiments is typically realized as an LSI, which is an integrated circuit. These may be individually implemented as single chips, or some or all of them may be included in a single chip.

[0112] The integrated circuit is not limited to an LSI, but may be realized by a dedicated circuit or a general-purpose processor. A field programmable gate array (FPGA) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connections and settings of the circuit cells inside the LSI may also be used.

[0113] In each of the above embodiments, each component may be implemented by dedicated hardware or by executing a software program suitable for each component. Each component may be implemented by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0114] Furthermore, the present invention may be realized as a video receiving method or a video transmitting method executed by a video receiving device or a video transmitting device.

[0115] In addition, the division of functional blocks in the block diagram is an example, and multiple functional blocks may be realized as one functional block, one functional block may be divided into multiple blocks, or some functions may be transferred to another functional block. Furthermore, the functions of multiple functional blocks having similar functions may be processed in parallel or in a time-sharing manner by a single piece of hardware or software.

[0116] The order in which the steps are executed in the flowchart is merely an example for specifically explaining the present invention, and the steps may be executed in an order other than the above. Some of the steps may be executed simultaneously (in parallel) with other steps.

[0117] Although the video receiving device and the video transmitting device according to one or more aspects have been described based on the embodiments, the present invention is not limited to these embodiments. As long as they do not deviate from the spirit of the present invention, various modifications conceived by those skilled in the art to the present embodiments and configurations constructed by combining components of different embodiments may also be included within the scope of one or more aspects. [Industrial Applicability]

[0118] The present invention can be applied to video receiving devices and video transmitting devices such as TVs. [Explanation of symbols]

[0119] 100, 100A Video receiving device 101 Receiving unit 102 Demultiplexer 103 Video Decoding Unit 104, 104A Display control unit 105, 105A display section 106 Video characteristics conversion section 107 Display Devices 108 Anomaly detection unit 109 Message Overlay Unit 111 Received signal 112, 211 Video signal 113 First transmission characteristic information 114 Video Data 115 Second transmission characteristic information 116 Control Information 117, 120 Input signal 118 Abnormality notification information 119 Messages 200 Video transmission device 201 Generation part 202 Transmitter 203 Video Encoding Unit 204 Multiplexer 212 Transmitted Signal 301 HDR Identification Information

Claims

1. A video receiving method in a video receiving device, comprising: a receiving step of receiving a reception signal including a video signal; an acquisition step of acquiring, from the received signal, the video signal, transfer characteristic information for specifying a transfer function corresponding to a luminance dynamic range of the video signal, and information for specifying the transfer function in a unit corresponding to an MPU (Media Processing Unit); and a decoding step of decoding the acquired video signal to acquire video data, The transfer characteristic information is information for specifying a first transfer function corresponding to a standard dynamic range (SDR) or a second transfer function corresponding to a high dynamic range (HDR) that is wider than the SDR. Video reception method.

2. A receiving unit that receives a reception signal including a video signal; an acquisition unit that acquires, from the received signal, the video signal, transfer characteristic information for identifying a transfer function corresponding to a luminance dynamic range of the video signal, and information for identifying the transfer function in a unit corresponding to an MPU (Media Processing Unit); a decoding unit that obtains video data by decoding the obtained video signal, The transfer characteristic information is information for specifying a first transfer function corresponding to a standard dynamic range (SDR) or a second transfer function corresponding to a high dynamic range (HDR) that is wider than the SDR. Video receiving device.

Citation Information

Patent Citations

  • Digital signal recording and reproducing device

    JP1999191877A

  • Transmission method and reception method

    JP2015005977A

  • Image decoder and control method of the same

    JP2015019287A

  • HDR metadata transport

    WO2015007910A1

  • Transmission device, transmission method, receiving device and receiving method

    WO2015111467A1