Display control device, display control method and storage medium

Abstract

The present invention provides a display control device, a display control method and a storage medium. The display control device controls the display of an image for a display device capable of displaying a high dynamic range image, and includes: a determination unit for determining a focus area of ​​interest of a user from the image; and a control unit for controlling the display brightness of the display device based on the relationship between the value of the maximum hue of the display of the display device and the value of the maximum hue of the focus area, so that when the image is displayed on the display device, the peak brightness of the display of the focus area is equal to or greater than the peak brightness of the standard dynamic range display, and equal to or less than the peak brightness of the high dynamic range display.

Description

Technical Field

[0001] The present invention relates to a display control technology in a display device capable of high dynamic range (HDR) display. Background Art

[0002] In an image pickup device such as a digital camera and a digital video camera, an image can be captured (captured and recorded) while displaying the captured image on an electronic viewfinder (EVF). For example, a display panel of the image pickup device or a display device (external device) connected to the image pickup device is used as an EVF, and a user views the captured image displayed on the EVF to confirm various feature values ​​of the captured image. The brightness value (brightness level) of the captured image is included as one of the feature values ​​that the user may wish to confirm.

[0003] In recent years, in order to generate a viewing experience close to that of an optical viewfinder (OVF), HDR, which has a wider dynamic range (brightness range) than standard dynamic range (SDR), is increasingly being used in imaging and display technologies. Standards related to HDR and products using HDR are also being developed. For example, the HDR10+ standard requires additional information such as the maximum content light level (MaxCLL) indicating the maximum brightness value of each scene.

[0004] However, although HDR display improves image quality, it also increases power consumption. Specifically, since MaxCLL is determined based on the maximum hue of the scene, power is wasted by setting the brightness higher than required when the area the user is viewing is not the maximum hue area.

[0005] For example, in Japanese Patent Laid-Open No. 2016-213809, a device is described that converts the brightness of a video based on peak brightness information (MaxCLL) included in obtained video data and the peak brightness of a display device.

[0006] However, in the known technology described in Japanese Patent Laid-Open No. 2016-213809, the area of ​​interest to the user is not taken into consideration, and thus power consumption cannot be reduced. Summary of the invention

[0007] The present invention has been made in view of the above-mentioned problems, and aims to provide a display control device capable of both improving the visibility of a displayed image and reducing power consumption.

[0008] According to a first aspect of the present invention, a display control device is provided, which controls the display of an image for a display device capable of displaying a high dynamic range image, the display control device comprising: a determination unit, which is used to determine a focus area of ​​the image that a user focuses on; and a control unit, which is used to control the display brightness of the display device based on the relationship between the value of the maximum hue of the display of the display device and the value of the maximum hue of the focus area, so that when the image is displayed on the display device, the peak brightness of the display of the focus area is equal to or greater than the peak brightness of the standard dynamic range display, and is equal to or less than the peak brightness of the high dynamic range display.

[0009] According to a second aspect of the present invention, there is provided a display control method for controlling the display of an image for a display device capable of displaying high dynamic range images, the display control method comprising: determining a focus area of ​​interest to which a user is focused from the image; and controlling the display brightness of the display device based on the relationship between the value of the maximum hue of the display of the display device and the value of the maximum hue of the focus area, so that when the image is displayed on the display device, the peak brightness of the display of the focus area is equal to or greater than the peak brightness of the standard dynamic range display, and is equal to or less than the peak brightness of the high dynamic range display.

[0010] According to a third aspect of the present invention, there is provided a non-transitory computer-readable storage medium storing a program for causing a computer to execute the steps of the above-mentioned display control method.

[0011] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1A and Figure 1B is a diagram showing the appearance of a digital camera according to a first embodiment of the present invention.

[0013] Figure 2 is a diagram showing a block configuration of a digital camera.

[0014] Figure 3 : is a flowchart showing an operation of controlling the peak brightness of display corresponding to the area of ​​interest in the first embodiment.

[0015] Figure 4 is a diagram showing an example of tone characteristics of a video signal in the first embodiment.

[0016] Figure 5 : is a flowchart showing the operation of determining the region of interest in the first embodiment.

[0017] FIG. 6A to FIG. 6Iis a diagram showing an example of attention region determination in the first embodiment.

[0018] FIG. 7A to FIG. 7D : is a diagram showing an example of switching composition according to the first embodiment.

[0019] Figure 8 : is a flowchart showing an operation of controlling the tone characteristic of a video signal corresponding to a region of interest in the second embodiment.

[0020] Fig. 9 is a diagram showing an example of tone characteristics of a video signal in the second embodiment. DETAILED DESCRIPTION

[0021] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the invention as claimed. A plurality of features are described in the embodiments, but it is not necessary to limit the invention to all these features, and these features can be appropriately combined. In addition, in the accompanying drawings, the same reference numerals are given to the same or similar structures, and their repeated description is omitted.

[0022] First embodiment

[0023] Figure 1A and Figure 1B is a diagram showing the appearance of a digital camera 100 according to the first embodiment of the present invention. Figure 1A is a front perspective view of the digital camera 100, and Figure 1B It is a rear perspective view of the digital camera 100 .

[0024] like Figure 1A and Figure 1B As shown, the display unit 28 is a display unit that displays images and various information provided on the back of the camera. The display unit 28 is capable of displaying high dynamic range images. The touch panel 70a can detect touch operations on the display surface (operation surface) of the display unit 28. The non-viewfinder display unit 43 is a display unit provided on the upper surface of the camera, which displays the shutter speed, aperture, and various other setting values ​​of the camera.

[0025] The shutter button 61 is an operation unit for performing an image capturing instruction. The mode selection switch 60 is an operation unit for selecting various modes. The terminal cover 40 is a cover for protecting a connector (not shown) for connecting the digital camera 100 to a connection cable connected to an external device. Examples of the connector include a connection terminal (not shown) for a universal serial bus (USB) cable and an output interface (I / F) 20 (see FIG. 1 ) which is a high-definition multimedia interface (HDMI) (registered trademark) output terminal. Figure 2 ).

[0026] The main electronic dial 71 is a rotational operation member provided in the operation unit 70. For example, by rotating the main electronic dial 71, setting values ​​such as shutter speed and aperture can be changed. The power switch 72 is an operation member for turning on and off the power of the digital camera 100. The sub-electronic dial 73 is a rotational operation member provided in the operation unit 70, which can, for example, move a selection frame and advance to an image.

[0027] The four-way key 74 is a four-way key provided in the operation unit 70, which can be pressed at the upper, lower, left and right parts. The four-way key 74 enables operations corresponding to the pressed parts of the four-way key 74. The setting button 75 is a button provided in the operation unit 70, which is mainly used to set the selected item. The video button 76 is used to instruct the start and stop of video shooting (recording). An automatic exposure (AE) lock button 77 is provided in the operation unit 70. By pressing the AE lock button 77 in the camera standby state, the exposure state can be fixed.

[0028] The zoom button 78 is an operation button provided in the operation unit 70, and is used to turn the zoom mode on and off in the live view display in the camera mode. By operating the main electronic dial 71 when the zoom mode is turned on, the size of the live view image can be enlarged or reduced. In the reproduction mode, the zoom button 78 is used as a zoom button to enlarge the reproduced image or increase the magnification. The reproduction button 79 is an operation button provided in the operation unit 70 for switching to the camera mode and the reproduction mode. When the reproduction button 79 is pressed in the camera mode, it switches to the reproduction mode, and the latest image among the images recorded in the recording medium 200 can be displayed on the display unit 28, the EVF 29, or the external device 210.

[0029] A menu button 81 is provided in the operation unit 70. By pressing the menu button 81, a menu screen in which various settings can be set is displayed on the display unit 28, the EVF 29, or the external device 210. The user intuitively sets various settings using the menu screen displayed on the display unit 28, the EVF 29, or the external device 210, as well as the four-way key 74 and the setting button 75. The communication terminal 10 is a communication terminal used for communication between the digital camera 100 and a (detachable) lens unit 150 described below.

[0030] The eyepiece unit 16 is an eyepiece unit of an eyepiece finder (peep-type finder). Via the eyepiece unit 16, the user can visually check an image displayed on the EVF 29 in which a high dynamic range image can be displayed. The eye approach detection unit 57 is an eyepiece detection sensor that detects whether the user approaches the eyepiece unit 16. The cover 202 is a cover for a slot for accommodating the recording medium 200.

[0031] The grip unit 90 is a holding unit having a shape that is easy to hold with the right hand when the user is using the digital camera 100. The shutter button 61 and the main electronic dial 71 are arranged at positions that allow operation with the index finger of the right hand when the digital camera is held by holding the grip unit 90 with the little finger, ring finger, and middle finger of the right hand. Moreover, the sub-electronic dial 73 is arranged at a position that allows operation by the thumb of the right hand when in the same state.

[0032] Figure 2 1 is a diagram showing a block configuration of a digital camera 100 according to the present embodiment.

[0033] exist Figure 2 , the lens unit 150 is a lens unit to which an interchangeable imaging lens is mounted. Although the lens 103 is generally composed of a plurality of lenses, it is simply shown here as only one lens. The communication terminal 6 is a communication terminal for communication between the lens unit 150 and the digital camera 100. The lens unit 150 communicates with the system control unit 50 via the communication terminal 6 and the communication terminal 10 on the digital camera 100 side. In addition, the aperture 1 is controlled by the internal lens system control circuit 4 via the aperture drive circuit 2, and the position of the lens 103 is moved for focusing by using the auto focus (AF) drive circuit 3.

[0034] The shutter 101 is a focal plane shutter, which can freely control the exposure time of the imaging unit 22 by the control of the system control unit 50. The imaging unit 22 is provided with an image sensor for converting an optical image into an electrical signal, which is composed of a charge coupled device (CCD), a complementary metal oxide semiconductor (CMOS) element, etc. The analog-to-digital (A / D) converter 23 is used to convert the analog signal output from the imaging unit 22 into a digital signal.

[0035] The image processing unit 24 performs predetermined pixel interpolation, resizing processing such as reduction, color conversion processing, and the like on data from the A / D converter 23 or from the memory control unit 15 described below. In addition, the image processing unit 24 performs predetermined calculation processing using the captured image data. The system control unit 50 performs exposure control and focus adjustment control based on the calculation results obtained by the image processing unit 24. In this way, through-the-lens (TTL) type automatic focus (AF) processing, automatic exposure (AE) processing, pre-flash emission (EF) processing, and the like are performed. The image processing unit 24 also performs predetermined calculation processing using the captured image data, and performs TTL type automatic white balance (AWB) based on the obtained calculation results.

[0036] The memory control unit 15 controls transmission and reception of data between the A / D converter 23, the image processing unit 24, and the memory 32. The output data from the A / D converter 23 is directly written on the memory 32 via the image processing unit 24 and the memory control unit 15 or via the memory control unit 15. The memory 32 stores image data of an image obtained by the camera unit 22 and converted into digital data by the A / D converter 23, image data for display on the display unit 28, the EVF 29, or the external device 210, and the like. The memory 32 is provided with sufficient storage capacity to store a predetermined number of still images, a predetermined amount of time of video and audio, and the like.

[0037] In addition, the memory 32 is also used as a memory (video memory) for image display. The digital to analog (D / A) converter 19 converts the data for image display stored in the memory 32 into an analog signal and supplies the analog signal to the display unit 28 and the EVF 29. In this way, the image data for display written on the memory 32 is displayed by the display unit 28 and the EVF 29 via the D / A converter 19. The display unit 28 and the EVF 29 perform display corresponding to the analog signal from the D / A converter 19 on a display such as a liquid crystal display (LCD), an organic electroluminescence (EL), or the like.

[0038] The output I / F 20 supplies the data for image display stored in the memory 32 to the external device 210 as a digital signal. In this way, the image data for display written on the memory 32 is displayed by the external device 210. Live view display (LV display) can be performed by sequentially transmitting and displaying the data A / D-converted by the A / D converter 23 and accumulated in the memory 32 on the display unit 28, the EVF 29, or the external device 210. Hereinafter, the image displayed by live view will be referred to as a live view image (LV image).

[0039] The infrared light emitting diode 166 is a light emitting element for detecting the user's line of sight position in the viewfinder screen, and irradiates the user's eyeball (eye) 161 with infrared light. The infrared light emitted from the infrared light emitting diode 166 is reflected on the eyeball (eye) 161, and the reflected infrared light reaches the dichroic mirror 162. The dichroic mirror 162 reflects only infrared light and allows visible light to pass. The infrared reflected light with a changed optical path forms an image on the imaging surface of the line of sight detection sensor 164 via the imaging lens 163. The imaging lens 163 is an optical component that constitutes the line of sight detection optical system. The line of sight detection sensor 164 includes an imaging device such as a CCD-type image sensor.

[0040] The line of sight detection sensor 164 photoelectrically converts the incident infrared reflected light into an electric signal, and outputs the electric signal to the line of sight detection circuit 165. The line of sight detection circuit 165 uses the output signal of the line of sight detection sensor 164 to detect the line of sight position of the user according to the movement of the eyeball (eye) 161 of the user, and outputs the detection information to the system control unit 50 and the gaze determination unit 170. Therefore, the line of sight detection unit 160 is composed of the dichroic mirror 162, the imaging lens 163, the line of sight detection sensor 164, the infrared light emitting diode 166 and the line of sight detection circuit 165, and the eyepiece unit 16 is used as a line of sight operation unit. The line of sight detection unit may have a configuration other than this.

[0041] The gaze determination unit 170 includes a predetermined threshold value, and determines that the user is gazing at an area when the time for which the user's gaze is determined to remain fixed in the area exceeds the predetermined threshold value using the detection information obtained from the sight line detection circuit 165. Note that the predetermined threshold value described above can be freely changed.

[0042] The non-viewfinder display unit 43 displays the shutter speed, aperture, and various other setting values ​​of the camera via the non-viewfinder display unit drive circuit 44 .

[0043] The nonvolatile memory 56 is, for example, an electrically erasable and recordable memory such as a flash read-only memory (ROM), etc. Constants, programs, etc. for the operation of the system control unit 50 are stored in the nonvolatile memory 56. Here, in the present embodiment, the program refers to a program for executing various flowcharts described below.

[0044] The system control unit 50 is a control unit including at least one processor or programmable device or circuit that controls the entire digital camera 100, and at least one memory that stores programs or instructions to be executed by the at least one processor. Various processes of the present embodiment described below are implemented by executing the programs or instructions recorded or stored in the above-mentioned non-volatile memory 56. For example, when the programs or instructions are executed by the processor, the processor is configured as various functional units or operates as described below. For example, constants and variables used for the operation of the system control unit 50 and programs read from the non-volatile memory 56 are expanded on the system memory 52 such as a random access memory (RAM). The RAM can also be loaded from the non-volatile memory 56 or a non-transitory storage medium using the programs or instructions that cause the processor to be configured as various functional units or operate, as described below. In addition, the system control unit 50 controls the memory 32, the display unit 28, and the EVF 29 to perform display control. At this time, the video signal conversion unit 181 controls the tone characteristics of the video signal output to the display unit 28, the EVF 29, or the external device 210. Here, it is also controlled to switch the display mode between the standard dynamic range (SDR) and the high dynamic range (HDR), and HDR has a wider dynamic range (brightness range) than SDR. In addition, the display brightness control unit 182 controls the display brightness of the display unit 28, the EVF 29, or the external device 210. The method of controlling the display brightness is described below. The focus area determination unit 180 determines the user's focus area in the display unit 28. The method of determining the focus area is described below.

[0045] The system timer 53 is a time measuring unit that measures time used by various controls, time of a built-in timer, and the like.

[0046] The mode selection switch 60, the first shutter switch 62, the second shutter switch 64 and the operation unit 70 are operation units for inputting various operation instructions to the system control unit 50. The mode selection switch 60 switches the operation mode of the system control unit 50 to any one of a still image shooting mode, a video shooting mode, etc. The modes included in the still image shooting mode are an automatic shooting mode, an automatic scene determination mode, a manual mode, an aperture priority mode (AV mode), a shutter speed priority mode (TV mode) and a program AE mode (P mode). Moreover, various types of scene modes (which include shooting settings unique to each shooting scene) and a custom mode are also included. The user can directly switch to any one of the modes by using the mode selection switch 60. Alternatively, after switching to a screen listing shooting modes using the mode selection switch 60, a mode can be selected from a plurality of displayed modes and switched to the mode using other operation members. In a similar manner, the video shooting mode can include a plurality of modes.

[0047] During the operation of the shutter button 61 provided on the digital camera 100, in other words, when the shutter button 61 is half-pressed (shooting preparation instruction), the first shutter switch 62 is turned on and a first shutter switch signal SW1 is generated. In response to the first shutter switch signal SW1, image capture preparation operations such as automatic focus (AF) processing, automatic exposure (AE) processing, automatic white balance (AWB) processing, and pre-flash emission (EF) processing are started.

[0048] When the operation of the shutter button 61 is completed, in other words, when the shutter button 61 is fully pressed (image capture instruction), the second shutter switch 64 is turned on and generates a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit 50 starts a series of image capture processing operations from reading out a signal from the image capture unit 22 to writing a captured image as an image file on the recording medium 200.

[0049] The operation unit 70 includes various operation members as an input unit for receiving operations from the user. The operation unit 70 includes at least the following operation units: a shutter button 61, a touch panel 70a, a main electronic dial 71, a power switch 72, a sub-electronic dial 73, a four-way key 74, a setting button 75, a video button 76, an AE lock button 77, an enlargement button 78, a reproduction button 79, and a menu button 81.

[0050] The power control unit 80 includes a battery detection circuit, a DC-DC converter, and a switch circuit for switching the blocks to be powered. The power control unit 80 detects whether a battery is installed, the type of battery, and the remaining battery power. In addition, the power control unit 80 controls the DC-DC converter based on the detection result and the instruction from the system control unit 50, and provides the required voltage to various components including the recording medium 200 at the required time. The power unit 30 includes a primary battery (such as an alkaline battery and a lithium battery, etc.), a secondary battery (such as a nickel-cadmium (NiCd) battery, a nickel metal halide (NiMH) battery, and a lithium ion (Li) battery, etc.) and / or an alternating current (AC) adapter.

[0051] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0052] The communication unit 54 is connected to an external device wirelessly or via a cable, and transmits and receives video signals and audio signals. The communication unit 54 can also be connected to a wireless local area network (LAN) and the Internet. In addition, the communication unit 54 can communicate with an external device via Bluetooth (registered trademark) or Bluetooth low energy. The communication unit 54 can transmit images (including LV images) captured by the camera unit 22 and images recorded on the recording medium 200, and can receive images and various other types of information from an external device.

[0053] The orientation detection unit 55 detects the orientation of the digital camera 100 with respect to the gravity direction. Whether the image captured by the imaging unit 22 is an image captured by the digital camera 100 in the landscape or portrait orientation can be determined based on the orientation detected by the orientation detection unit 55. The system control unit 50 can add orientation information based on the orientation detected by the orientation detection unit 55 to an image file of the image captured by the imaging unit 22, or rotate and record the image. For example, an acceleration sensor or a gyro sensor can be used as the orientation detection unit 55. It is also possible to detect the motion of the digital camera 100 (such as panning, tilting, lifting, and whether the digital camera 100 is stationary) by using the acceleration sensor or the gyro sensor constituting the orientation detection unit 55.

[0054] The eye approach detection unit 57 is an eye approach detection sensor that detects the movement of the eyeball (eye) 161 toward the eyepiece unit 16 of the viewfinder (eye approach) and away from the eyepiece unit 16 of the viewfinder (eye away). The system control unit 50 switches between display (display state) and non-display (non-display state) of the display unit 28 and the EVF 29 according to the state detected by the eye approach detection unit 57. More specifically, in a case where at least the image capture standby state is in place and the display destination switching is set to automatic, when the eye is not approaching, the display destination is set to the display unit 28 and the display is turned on, and the EVF 29 is set to non-display. In addition, when the eye is approaching, the display destination is set to the EVF 29 and the display is turned on, and the display unit 28 is set to non-display. The eye approach detection unit 57 can detect the approach of an object to the eyepiece unit 16 of the viewfinder built in the EVF 29 using, for example, an infrared proximity sensor. When the object approaches, infrared light from a light projection unit (not shown) of the eye approach detection unit 57 is reflected and received by a light receiving unit of the infrared proximity sensor. Using the amount of received infrared light, it is possible to determine how close the object is to the eyepiece unit 16 (eye proximity distance). In this way, the eye proximity detection unit 57 detects eye proximity by detecting the proximity distance of the object to the eyepiece unit 16.

[0055] In the case where it is detected that an object approaches from a non-eye approach state (non-approach state) to within a predetermined distance of the eyepiece unit 16, it is determined that eye approach has been detected. In the case where it is detected that the object detected as approaching has moved away by more than a predetermined distance, it is determined that eye departure has been detected. For example, a threshold for detecting eye approach and a threshold for detecting eye departure can be made different by providing a hysteresis. From the time when eye approach is detected until eye departure is detected, it is determined to be an eye approach state. From the time when eye departure is detected until eye approach is detected, it is determined to be a non-eye approach state. Note that an infrared proximity sensor is an example, and other sensors capable of detecting the proximity of an eye or an object considered for eye approach can be used as the eye proximity detection unit 57.

[0056] The line of sight input setting unit 167 is set to enable or disable line of sight detection by the line of sight detection circuit 165. Alternatively, the line of sight input setting unit 167 is set to enable or disable processing using line of sight input by the system control unit 50. For example, the setting can be made by the user using a menu setting. The system control unit 50 can detect the following operations and states regarding the eyepiece unit 16.

[0057] The line of sight that has not been input to the eyepiece unit 16 is newly input to the eyepiece unit 16. In other words, line of sight input is started.

[0058] A state where the line of sight is input to the eyepiece unit 16 .

[0059] · The state of the eyepiece unit 16 is observed.

[0060] · Remove the line of sight input to the eyepiece unit 16. In other words, end the line of sight input.

[0061] ·State where no line of sight is input to the eyepiece unit 16

[0062] The operation and state and position of inputting a line of sight on the eyepiece unit 16 are reported to the system control unit 50 via the internal bus, and the system control unit 50 determines what operation (line of sight operation) is performed on the eyepiece unit 16 based on the reported information.

[0063] The touch panel 70a and the display unit 28 may be integrally formed. For example, the touch panel 70a is configured to have a light transmittance that does not hinder the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. In addition, the input coordinates in the touch panel 70a are associated with the display coordinates on the display screen of the display unit 28. In this way, a graphical user interface (GUI) can be provided that enables the screen displayed on the display unit 28 to be directly operated by the user. The system control unit 50 can detect the following operations and states regarding the touch panel 70a.

[0064] A finger or a stylus pen that has not touched the touch panel 70a newly touches the touch panel 70a. In other words, a touch starts (hereinafter referred to as a touchdown).

[0065] A state where a finger or a stylus pen is touching the touch panel 70a (hereinafter referred to as touch-on).

[0066] A state in which a finger or a stylus moves while touching the touch panel 70a (hereinafter referred to as touch movement).

[0067] The finger or stylus touching the touch panel 70a is released. In other words, the touch ends (hereinafter referred to as touch-off).

[0068] A state where no object is touching the touch panel 70a (hereinafter referred to as "no touch").

[0069] When a touch is detected, touch duration can also be detected at the same time. After a touch, touch duration is usually detected continuously as long as touch cessation is not detected. In the case where touch duration is detected, touch movement is also detected. Even if touch duration is detected, touch movement is not detected unless the touch position is moving. No touch is related to after touch cessation is detected for all touching fingers and styluses.

[0070] The operation and state of the finger or stylus touching the touch panel 70a and the position coordinates are reported to the system control unit 50 via the internal bus, and the system control unit 50 determines what operation (touch operation) is performed on the touch panel 70a based on the reported information. With respect to the touch movement, the moving direction of the finger or stylus moving on the touch panel 70a can be determined for each vertical component and horizontal component on the touch panel 70a based on the change in the position coordinates. In the case where a touch movement of more than a predetermined distance is detected, it is determined that a sliding operation is performed. The operation of quickly moving a finger a certain distance while touching the touch panel and then releasing it is called "flicking". In other words, flicking is an operation of quickly pulling a finger on the touch panel 70a and then releasing it. In the case where a touch movement of more than a predetermined distance at a predetermined speed is detected and then the touch stops, it can be determined that a flick is performed (it can be determined that a flick is performed after the sliding operation). In addition, a touch operation of touching multiple points (for example, two points) at the same time and moving these touch positions so that they are close to each other is called "pinch-in", and a touch operation of moving these touch positions so that they are further separated is called "pinch-out". Pinch-in and pinch-out are collectively referred to as pinch operations (or simply "pinch"). For the touch panel 70a, various types of touch panels can be used, such as a resistive film type, an electrostatic capacitance type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type, etc. According to the method, a touch is detected in the case where the touch panel is touched, or a touch is detected in the case where a finger or a stylus pen approaches the touch panel, but either method may be adopted.

[0071] Next, we will refer to Figures 3 to 7D A method of controlling the peak brightness of a display corresponding to a region of interest according to a first embodiment of the present invention is described.

[0072] Figure 3 The flowchart shows the operation of controlling the peak brightness of the display corresponding to the region of interest in the first embodiment. The system control unit 50 expands the program stored in the nonvolatile memory 56 on the system memory 52, executes the program and controls the function blocks. Figure 3 The respective processes of the flowchart are shown in FIG. 1 . When the digital camera 100 is activated, the Figure 3 Flowchart of the process.

[0073] When the digital camera 100 is activated, in step S301, the system control unit 50 determines whether it is in the HDR display mode. If it is in the HDR display mode, the process proceeds to step S302. If it is not in the HDR display mode, the process proceeds to step S308.

[0074] In step S302, the system control unit 50 determines the region of interest 604. Then, the process proceeds to step S303. Figure 5 , FIG. 6A to FIG. 6I A method of determining a region of interest 604 is described.

[0075] In step S303, the system control unit 50 calculates the peak luminance La (cd / m 2 ). For example, as indicated in the following equation (1), using the maximum hue Tmax of the display, the peak brightness Lh (cd / m 2 ), peak brightness Ls (cd / m 2 ) and the maximum hue Ta of the target area 604 to calculate the peak brightness La (cd / m 2 ).

[0076] La={Ta(Lh-Ls) / Tmax}+Ls···(1)

[0077] In other words, based on the ratio (relationship) of the maximum hue Ta of the area of ​​interest 604 to the maximum hue Tmax of the display, the peak luminance La of the display of the area of ​​interest 604 is controlled to be equal to or greater than the peak luminance of the SDR display time and equal to or less than the peak luminance of the high dynamic range display time. Note that the part after the decimal point is rounded off. Specifically, if Tmax=255, Lh=1000, Ls=200, and Ta=204, then La=840. In this way, the peak luminance La (cd / m 2 ), and then the processing enters step S304.

[0078] In step S304, the system control unit 50 displays the peak luminance La (cd / m 2 ) performs display, and the process proceeds to step S305. For example, the brightness setting of the display unit 28, the EVF 29, or the external device 210 is changed and implemented. The characteristics of the image data may also be changed.

[0079] In step S305, the system control unit 50 determines whether a brightness reset condition is satisfied. FIG. 7A to FIG. 7D In the case of switching the composition as shown in the figure or in the case of performing a brightness reset operation using the operation unit 70, it is determined that the brightness reset condition is satisfied. In the case where the brightness reset condition is satisfied, the process returns to step S302. In the case where the brightness reset condition is not satisfied, the process proceeds to step S306. FIG. 7A to FIG. 7D .

[0080] In step S306, the system control unit 50 determines whether it has switched to the SDR display mode. In the case where it has switched to the SDR display mode, the process proceeds to step S308. In the case where it has not switched to the SDR display mode, the process proceeds to step S307.

[0081] In step S307, the system control unit 50 determines whether the display has been turned off. If the display has been turned off, the flow ends. If the display has not been turned off, the process returns to step S305.

[0082] In step S308 , the system control unit 50 performs SDR display, and the process proceeds to step S309 .

[0083] In step S309, the system control unit 50 determines whether it has switched to the HDR display mode. In the case where it has switched to the HDR display mode, the process returns to step S302. In the case where it has not switched to the HDR display mode, the process proceeds to step S310.

[0084] In step S310, the system control unit 50 determines whether the display has been turned off. If the display has been turned off, the flow ends. If the display has not been turned off, the process returns to step S309.

[0085] Figure 4 is a diagram showing an example of tone characteristics of a video signal in the first embodiment of the present invention.

[0086] The first hue 401 is the maximum hue displayed, and the second hue 402 is the maximum hue of the attention area 604 .

[0087] The first electro-optic transfer function (EOTF) characteristic 403 is an SDR display characteristic. The first peak brightness 404 is a peak brightness of the SDR display time. The first brightness 405 is the brightness of the region of interest 604 of the SDR display time.

[0088] The second EOTF characteristic 406 is an HDR display characteristic and is a characteristic different from the first EOTF characteristic 403. For example, the second EOTF characteristic 406 is a hybrid log-gamma (HLG) system characteristic. The second peak brightness 407 is the peak brightness of the HDR display time. The second brightness 408 is the brightness of the focus area 604 of the HDR display time.

[0089] The third EOTF characteristic 409 is an HDR display characteristic based on the area of ​​interest 604, and is a characteristic corresponding to the second EOTF characteristic 406, and the overall brightness of the third EOTF characteristic 409 is compressed according to the change in peak brightness to maintain the standardized characteristic. The third peak brightness 410 is the peak brightness based on the HDR display time of the area of ​​interest 604. The third brightness 411 is the brightness of the area of ​​interest 604 based on the HDR display time of the area of ​​interest 604, and is a value greater than the first brightness 405 and less than the second brightness 408, as indicated in equation (1).

[0090] Figure 5 : is a flowchart showing an operation of determining a user's attention area in the first embodiment. FIG. 6A to FIG. 6I 1 is a diagram showing an example of determination of a region of interest in the first embodiment. The system control unit 50 expands a program stored in the nonvolatile memory 56 on the system memory 52, executes the program, and controls the function blocks to achieve Figure 5 The various processes of the flowchart. Figure 3 In step S302, Figure 5 Now we will refer to Figure 5 , FIG. 6A to FIG. 6I Describes the operation of determining a region of interest.

[0091] In step S501, Fig. 6A As shown, the system control unit 50 determines whether the instruction method for the attention area is the line of sight input. If the instruction method is the line of sight input, the process proceeds to step S502. If the instruction method is not the line of sight input, the process proceeds to step S504.

[0092] In step S502, the system control unit 50 determines whether a line of sight input has been detected. In the case where a line of sight input has been detected, the process proceeds to step S503. In the case where a line of sight input has not been detected, step S502 is repeated.

[0093] In step S503, Figure 6B and Figure 6C As shown, the system control unit 50 sets the area of ​​the first width 604a and the second width 604b centered at the line of sight input position 606 as the focus area 604, and the flow ends.

[0094] In step S504, Fig.6D The system control unit 50 determines whether the instruction method for the attention area is touch input. In the case where the instruction method is touch input, the process proceeds to step S505. In the case where the instruction method is not touch input, the process proceeds to step S507.

[0095] In step S505, the system control unit 50 determines whether a touch input has been detected. In the case where a touch input has been detected, the process proceeds to step S506. In the case where a touch input has not been detected, step S505 is repeated.

[0096] In step S506, if Fig. 6E and Fig. 6F As shown, the system control unit 50 sets the area of ​​the first width 604a and the second width 604b centered at the touch input position 608 as the focus area 604, and the flow ends.

[0097] In step S507, Figure 6G As shown, the system control unit 50 determines that the instruction method for the attention area is the AF frame, and the process proceeds to step S508.

[0098] In step S508, the system control unit 50 determines whether the AF frame position has been specified. In the case where the AF frame position has been specified, the process proceeds to step S509. In the case where the AF frame position has not been specified, step S508 is repeated.

[0099] In step S509, if Figure 6H and Fig.6I As shown, the AF frame 609 is set as the focus area 604, and the process ends.

[0100] We will now describe in more detail Fig. 6A , Figure 6B and Figure 6C . The area of ​​interest 604 is an area selected based on a user operation and is displayed on the display of the EVF 29 in this embodiment. The first width 604a and the second width 604b are the widths of the area of ​​interest in the lateral and vertical directions, respectively. Display 600 is a menu display of instruction settings for the area of ​​interest 604. The first setting 601 indicates an instruction setting via line of sight input, the second setting 602 indicates an instruction setting via touch input, and the third setting 603 indicates an instruction setting via an AF frame. The information display 605 is information displayed on the EVF 29 together with the LV image. For example, the shutter speed, f-number, information related to imaging settings (such as ISO sensitivity, etc.), the remaining battery power, etc. are displayed.

[0101] Fig. 6A , Figure 6B and Figure 6CThere are shown a setting state of the display 600 in the case where the focus area is determined based on the line of sight input, an example of the line of sight input on the EVF 29, and an example of the display on the EVF 29. The position of the focus area 604 is determined based on the line of sight input position 606 from the eyeball (eye) 161. Specifically, this corresponds to an area of ​​a first width 604a and a second width 604b centered on the line of sight input position 606.

[0102] Fig.6D , Fig. 6E and Fig. 6F There are shown a setting state of the display 600 in the case where the region of interest is determined based on a touch input, an example of a touch input on the touch panel 70a, and an example of a display on the EVF 29. The position of the region of interest 604 is determined based on a touch input position 608 of a finger 607. Specifically, this corresponds to a region of a first width 604a and a second width 604b centered on the touch input position 608. Specifying a touch position in an absolute or relative manner is performed in a similar manner.

[0103] Figure 6G , Figure 6H and Fig.6I There are shown a setting state of the display 600 in the case where the area of ​​interest is determined based on the AF frame position, an example of the AF frame position on the EVF 29, and an example of the display on the EVF 29. The position of the area of ​​interest 604 is determined based on the position of the AF frame 609. Specifically, this corresponds to the same area as the AF frame 609 (the first width 604a and the second width 604b are the sizes of the AF frame 609).

[0104] FIG. 7A to FIG. 7D 2 is a diagram showing an example of a switching composition according to the first embodiment of the present invention displayed on the display of the EVF 29.

[0105] Fig. 7A An example of a composition before switching of the composition displayed on the EVF 29 is shown. Figure 7B Shown in the enlarged Fig. 7A An example of display on the EVF 29 in the case where the display of the EVF 29 is displayed and the angle of view is changed. For example, whether a change has occurred is determined by whether there is an operation of the zoom ring in the lens unit 150.

[0106] Figure 7C Shown in Fig. 7A 29. The presence of the subject 701 is determined by the image processing unit 24, for example.

[0107] Fig.7D Shown in Fig. 7A2 is an example of the display on the EVF 29 in the case where the main subject in the attention area 604 is lost in the display of . The presence of the subject in the attention area 604 is determined by the image processing unit 24, for example.

[0108] In this way, in the first embodiment, the peak brightness of the display is controlled according to the area of ​​interest. This allows brightness setting that does not impair user visibility. Moreover, a brightness setting lower than the display brightness set according to the maximum hue in the prior art can be achieved, and a reduction in power consumption can be achieved.

[0109] Second embodiment

[0110] The following will refer to Figure 8 and Fig. 9 The operation of controlling the tone characteristics of a video signal corresponding to a region of interest according to a second embodiment of the present invention is described. The configuration of the digital camera in the second embodiment is the same as that of the digital camera 100 in the first embodiment, so the description thereof is omitted. The differences from the first embodiment will be described below.

[0111] Figure 8 The flowchart is a flowchart showing the operation of controlling the tone characteristics of the video signal corresponding to the region of interest in the second embodiment. The system control unit 50 expands the program stored in the nonvolatile memory 56 on the system memory 52, executes the program, and controls the function blocks. Figure 8 Flowchart of each process. Note that Figure 3 The same steps in the flowchart are given the same symbols, and their description is omitted. Figure 8 Flowchart of the process.

[0112] When the digital camera 100 is activated, a process similar to Figure 3 The process of step S301 of the flowchart.

[0113] In step S801, the system control unit 50 corrects the tone characteristics of the video signal based on the determined attention area 604, and the process proceeds to step S802. This corresponds to, for example, Fig. 9 A fourth EOTF characteristic 901 is shown.

[0114] In step S802 , the system control unit 50 performs display with the corrected tone characteristics, and the process proceeds to step S305 .

[0115] Fig. 9 is a diagram showing an example of tone characteristics of a video signal in the second embodiment.

[0116] The fourth EOTF characteristic 901 is a characteristic of HDR display based on the region of interest 604 , and is, for example, a perceptual quantization (PQ) system characteristic with the second brightness 408 as a peak brightness.

[0117] In this way, according to the second embodiment, the tone characteristics of the video signal are controlled according to the region of interest. This allows brightness setting that does not impair user visibility. Moreover, a brightness setting lower than the display brightness set according to the maximum tone in the prior art can be achieved, and a reduction in power consumption can be achieved.

[0118] Preferred embodiments of the present invention have been described above. However, the present invention is not limited to these embodiments, and various changes and modifications can be made within the scope of the present invention. Preferred embodiments according to the present invention have been described above using a digital camera. However, the present invention is not limited to these specific embodiments, and various embodiments are included without departing from the scope of the present invention. The present invention can be applied to any electronic device including a display unit. For example, the present invention can be applied to a display device such as an image viewer. Moreover, the present invention can be applied to an audio device such as a music player, for example. Moreover, the present invention can be applied to a personal computer, a PDA, a mobile phone terminal, a printer device with a display, a digital photo frame, a game console, an e-book reader, a wearable device with a head-mounted display, and the like.

[0119] In the above embodiment, the maximum hue Tmax of the display and the peak brightness Lh (cd / m 2 ), peak brightness Ls (cd / m 2 ) and the maximum hue Ta of the focus area 604 to calculate the peak brightness La (cd / m 2 ). However, other values ​​may be used. For example, the average hue of the focus area 604 may be used. In addition, in the above-described embodiment, the brightness reset condition is to switch the composition or use the operation unit 70 to perform a brightness reset operation. However, other conditions may be used. For example, no condition may be set, and the brightness reset may be performed continuously. In addition, in the above-described embodiment, the focus area is determined based on a line of sight input, a touch input, or an AF frame. However, other methods may be used. In addition, in the above-described embodiment, the focus area 604 is specified by a first width 604a and a second width 604b. However, other designation methods may be used, and the shape may be changed.

[0120] Other embodiments

[0121] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0122] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. A display control device for controlling the display of an image on a display device capable of displaying a high dynamic range image, the display control device comprising: A determination unit, configured to determine a focus area of ​​interest to which a user is focusing from an image; as well as a control unit for calculating a target value of peak brightness of the display of the focus area based on a relationship between a value of a maximum tone of the display of the display device and a value of a maximum tone of the focus area, so that the target value is equal to or greater than a peak brightness of a standard dynamic range display and equal to or less than a peak brightness of a high dynamic range display, and controlling the display brightness of the display device so that the peak brightness of the display of the focus area is consistent with the target value, The control unit calculates a target value of the peak brightness of the display of the focus area based on the ratio of the maximum hue value of the focus area to the maximum hue value of the display of the display device, the peak brightness of the standard dynamic range display, and the peak brightness of the high dynamic range display.

2. The display control device according to claim 1, in, The control section controls the peak brightness of the display of the attention area by correcting the tone characteristics of the image.

3. The display control device according to claim 1, in, The control section resets the peak brightness of the display of the region of interest when the composition or viewing angle of the image changes.

4. The display control device according to claim 1, in, When receiving a user operation, the control section resets the peak brightness of the display of the attention area.

5. The display control device according to claim 1, in, The determination unit determines the target area by detecting a user's line of sight.

6. The display control device according to claim 1, in, The determination section determines the region of interest using a touch panel.

7. The display control device according to claim 1, in, The determination section determines the target area using an automatic focus frame. 8 . The display control apparatus according to claim 1 , further comprising a display device. 9 . The display control device according to claim 1 , further comprising an imaging unit for capturing an image of a subject.

10. A display control method for controlling the display of an image on a display device capable of displaying a high dynamic range image, the display control method comprising: determining a region of interest from the image at which the user is focused; as well as Calculating a target value of the peak brightness of the display of the area of ​​interest based on the relationship between the value of the maximum hue of the display of the display device and the value of the maximum hue of the area of ​​interest so that the target value is equal to or greater than the peak brightness of the standard dynamic range display and equal to or less than the peak brightness of the high dynamic range display, and controlling the display brightness of the display device so that the peak brightness of the display of the area of ​​interest is consistent with the target value Among them, the target value of the peak brightness of the display of the area of ​​interest is calculated based on the ratio of the value of the maximum hue of the area of ​​interest to the value of the maximum hue displayed by the display device, the peak brightness of the standard dynamic range display and the peak brightness of the high dynamic range display. 11 . A non-transitory computer-readable storage medium storing a program for causing a computer to execute the steps of the display control method according to claim 10 .

Images