Representation method

Abstract

To provide a display method which can properly display an image on a display in a finder while considering the convenience of a user.SOLUTION: A display method acquires first image data acquired by shooting, creates a plurality of pieces of second image data that show mutually-different gradation values on the basis of the first image data, displays a plurality of display images respectively corresponding to the plurality of pieces of second image data on a display, urges a user to use a finder when the plurality of display images are displayed on the display, and causes a storage device to store the second image data corresponding to the display image selected by the user from the plurality of display images.SELECTED DRAWING: Figure 22

Description

[Technical field]

[0001] The present invention relates to a display method, and more particularly to a display method for displaying an image on a display within a viewfinder. [Background technology]

[0002] A user who takes an image using a digital camera or the like can set and change the composition (i.e., the angle of view) when taking a picture while looking at the image displayed on the display in the viewfinder. In addition, the user may change the brightness of the image displayed on the display in the viewfinder.

[0003] In Patent Document 1, the brightness of external light is detected, and when the brightness of external light is equal to or greater than a predetermined value, γ correction is performed using an offset γ (gamma) curve on the signal of the image to be displayed on the display in the viewfinder (image signal for display). This configuration improves the visibility of the image to be displayed on the display in the viewfinder at high brightness. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2012-39271 A Summary of the Invention [Problem to be solved by the invention]

[0005] When setting the brightness of an image to be shown on a display, it is important to set it with consideration for user convenience, and there is a demand for the development of a display method and display device that realizes such a configuration.

[0006] The present invention has been made in consideration of the above circumstances, and has an object to provide a display method that can appropriately display an image on a display within a viewfinder while taking into consideration user convenience. Another object of the present invention is to provide a display device for implementing the above-mentioned display method. [Means for solving the problem]

[0007] In order to achieve the above object, the display method of the present invention is a display method using a display device equipped with a sensor for detecting the intensity of ambient light and a finder with a display provided therein, and includes an acquisition step of acquiring video data by shooting under ambient light, a creation step of creating display data based on the video data, and a display step of displaying a display video corresponding to the display data on the display. When the intensity of the ambient light is equal to or greater than a first threshold, the creation step or the display step is performed under a condition in which the brightness of the display video displayed on the display is brighter than the brightness of the first reference video, or when the intensity of the ambient light is equal to or less than a second threshold, the creation step or the display step is performed under a condition in which the brightness of the display video displayed on the display is darker than the brightness of the second reference video.

[0008] Furthermore, when the intensity of the ambient light is equal to or greater than a first threshold, the creating step may be performed under conditions in which the brightness of the display image to be displayed on the display is brighter than the brightness of the first reference image. In this case, the first reference image may be an image to be displayed on the display according to display data created based on image data acquired by shooting under ambient light with an intensity less than the first threshold.

[0009] Furthermore, when the intensity of the ambient light is equal to or less than a second threshold, the creating step may be performed under conditions in which the brightness of the display image to be displayed on the display is darker than the brightness of the second reference image. In this case, the second reference image may be an image displayed on the display according to display data created based on image data acquired by shooting under ambient light whose intensity exceeds the second threshold.

[0010] Furthermore, when the distance between the user and the display device is equal to or less than a predetermined distance, the display image may be displayed on the display.

[0011] The display data may indicate an output value for an input gradation value indicated by the video data, and the input gradation value may be specified within a numerical range including a first gradation value, a second gradation value, and an intermediate value between the first gradation value and the second gradation value. In this case, the creating step may create, as the display data, first display data and second display data having mutually different output values ​​for an input gradation value closer to the first gradation value or the second gradation value than the intermediate value. The display step may display, on the display, a display image corresponding to data selected from the first display data and the second display data based on the intensity of ambient light.

[0012] In addition, in the creation process, a correction is made to the output value for the input gradation value indicated by the video data in accordance with the intensity of ambient light, and display data indicating the corrected output value is created, and the amount of correction made to the output value in the creation process may be changed in accordance with the distance between the user and the viewfinder or the brightness within the viewfinder.

[0013] Also, before the usage time during which the user uses the viewfinder reaches a set time, in the creation step, a correction is performed on the output value for the input gradation value indicated by the video data according to the intensity of the ambient light to create display data indicating the corrected output value, and in the display step, a display image according to the display data indicating the corrected output value may be displayed on the display. Also, after the usage time reaches the set time, in the creation step, uncorrected display data indicating an output value for which no correction is performed may be created, and in the display step, a display image according to the uncorrected display data may be displayed on the display.

[0014] In addition, in the creating step, a correction may be performed on an output value corresponding to an input gradation value indicated by the video data according to the intensity of ambient light, and display data indicating the corrected output value may be created, and uncorrected display data indicating an output value not subjected to correction may be created. In this case, in the display step, a display image corresponding to the display data indicating the corrected output value and a display image corresponding to the uncorrected display data may be displayed together on a display.

[0015] The image data may indicate input gradation values ​​of each part of the angle of view at the time of shooting. When the intensity of the ambient light is equal to or greater than a first threshold, the creation process may be performed under conditions in which the brightness of the image to be displayed on the display is brighter than the brightness of the first reference image. When a first gradation part in the angle of view, in which the input gradation value is equal to or less than the first reference value, is equal to or greater than a predetermined width, the creation process may perform a first gradation correction that increases an output value for the input gradation value of the first gradation part to create the display data. In this case, the correction amount in the first gradation correction may be larger as the difference between the input gradation value of the first gradation part and the first reference value becomes larger.

[0016] The image data may indicate input gradation values ​​of each part of the angle of view at the time of shooting. When the intensity of the ambient light is equal to or less than a second threshold, the creation process may be performed under conditions in which the brightness of the image to be displayed on the display is darker than the brightness of the second reference image. When the second gradation part in the angle of view, in which the input gradation value is equal to or greater than the second reference value, is equal to or greater than a predetermined width, the creation process may perform a second gradation correction to lower the output value for the input gradation value of the second gradation part to create the display data. In this case, the correction amount in the second gradation correction may be larger as the difference between the input gradation value of the second gradation part and the second reference value becomes larger.

[0017] In order to achieve the above-mentioned object, a display device according to one embodiment of the present invention includes a processor, a sensor for detecting the intensity of ambient light, and a viewfinder with a display therein, the processor being configured to obtain video data by shooting under ambient light, create display data based on the video data, and display a display image according to the display data on the display. When the intensity of the ambient light is equal to or greater than a first threshold, the processor makes the brightness of the display image displayed on the display brighter than the brightness of a first reference image, or when the intensity of the ambient light is equal to or less than a second threshold, the processor makes the brightness of the display image displayed on the display darker than the brightness of a second reference image.

[0018] In addition, in order to achieve the above-mentioned object, a display method according to another embodiment of the present invention is a display method using a display device equipped with a viewfinder with an internal display, and includes an acquisition step of acquiring first image data by shooting, a creation step of creating multiple second image data showing different gradation values ​​based on the first image data, a display step of displaying multiple display images corresponding to each of the multiple second image data on the display, a prompting step of prompting a user to use the viewfinder when displaying the multiple display images on the display, and a storage step of storing in a storage device the second image data corresponding to a display image selected by the user from the multiple display images.

[0019] The plurality of second image data may include second image data in which correction has been performed on gradation values ​​indicated by the first image data. In this case, the creating step may create second image data in which a first gradation correction has been performed on gradation values ​​in the first image data that are equal to or less than a first reference value, and second image data in which a second gradation correction has been performed on gradation values ​​in the first image data that are equal to or greater than a second reference value. In the displaying step, a display image corresponding to the second image data in which the first gradation correction has been performed and a display image corresponding to the second image data in which the second gradation correction has been performed may be displayed side by side on a display.

[0020] In addition, when one of the first gradation correction and the second gradation correction is the first correction and the other is the second correction, the creating step may include a first creating step and a second creating step, and the displaying step may include a first displaying step and a second displaying step. In the first creating step, two or more pieces of 2A image data may be created by performing a plurality of first corrections having different correction amounts. In the first displaying step, two or more display images corresponding to each of the two or more pieces of 2A image data may be displayed on a display. In the second creating step, two or more pieces of 2B image data may be created by performing the first correction performed when creating the 2A image data corresponding to the display image selected in the first displaying step and a plurality of second corrections having different correction amounts. In the second displaying step, two or more display images corresponding to each of the two or more pieces of 2B image data may be displayed on a display, and in the storing step, the 2B image data corresponding to the display image selected in the second displaying step may be stored in a storage device.

[0021] In addition, in the acquiring step, a plurality of first image data having different exposure conditions may be acquired, and in the displaying step, a plurality of display images based on the plurality of first image data having different exposure conditions may be displayed together on the display.

[0022] In addition, in the display step, a difference portion in the display image where the grayscale values ​​differ between the plurality of second image data may be enlarged and displayed on the display. Furthermore, in the display step, the difference portion designated by the user may be enlarged and displayed on the display.

[0023] Furthermore, when the distance between the user and the display device is equal to or less than a predetermined distance, the display image may be displayed on the display. [Brief description of the drawings]

[0024] [Figure 1] 1 is a diagram showing the appearance of a display device according to an embodiment of the present invention; [Diagram 2] 1 is a diagram showing a configuration of a display device according to an embodiment of the present invention; [Diagram 3] FIG. 2 is a diagram showing a configuration of a video creation unit according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing a video display flow in the first embodiment. [Diagram 5] FIG. 2 is a diagram showing a procedure of a production process in the first embodiment. [Figure 6] 11 is a diagram showing the correspondence relationship between input gradation values ​​and output values ​​in gamma correction. FIG. [Figure 7] FIG. 11 is a diagram illustrating an example of a first gradation correction. [Figure 8] 13A and 13B are diagrams illustrating another example of the first gradation correction. [Figure 9] FIG. 11 is a diagram illustrating an example of a second gradation correction. [Figure 10] 13A and 13B are diagrams illustrating another example of the second gradation correction. [Figure 11] FIG. 1 is a diagram showing an example of a display image displayed on a display (part 1). [Figure 12] FIG. 2 is a diagram showing an example of a display image displayed on a display (part 2). [Figure 13] FIG. 11 is a diagram showing an example of a display image displayed on a display (part 3). [Figure 14] 11 is a diagram showing the correspondence relationship between the intensity of ambient light and the correction amount in the first tone correction. FIG. [Figure 15] 13 is a diagram showing the correspondence relationship between the intensity of ambient light and the correction amount in the second tone correction. FIG. [Figure 16] 13 is a diagram showing a change in the correction amount in the first gradation correction after the use time of the viewfinder reaches a set time. FIG. [Figure 17] 13 is a diagram showing a change in the correction amount in the second gradation correction after the use time of the viewfinder reaches a set time. FIG. [Figure 18] FIG. 13 is a diagram showing a display on which a corrected display image and an uncorrected display image are simultaneously displayed. [Figure 19] FIG. 13 is a diagram showing a case where the output luminance is changed in a bright environment. [Figure 20] FIG. 13 is a diagram showing a case where the output luminance is changed in a dark environment. [Figure 21] FIG. 11 is a diagram showing the configuration of a video creation unit according to the second embodiment. [Figure 22] FIG. 11 is a diagram showing a video display flow in the second embodiment. [Diagram 23] FIG. 1 is a diagram showing a display on which a plurality of display images are displayed. [Figure 24] 11A and 11B are diagrams showing another example of a display format of a display image on a display. [Diagram 25] FIG. 11 is a diagram showing a flow of a video display in another mode in the second embodiment. [Figure 26] FIG. 13 is a diagram showing a display in which a difference portion in a displayed image is enlarged and displayed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] Preferred embodiments (first and second embodiments) of the present invention will be described in detail below with reference to the accompanying drawings. However, the embodiments described below are merely examples given to facilitate understanding of the present invention and do not limit the present invention. In other words, the present invention may be modified or improved from the embodiments described below without departing from the spirit of the present invention. Furthermore, the present invention includes equivalents thereof.

[0026] <<First embodiment>> The first embodiment of the present invention relates to a display method using the display device shown in Figures 1 and 2. The display device according to the first embodiment is a device that displays an image of a subject during shooting, and is constituted by a shooting device 10 such as a digital camera. Note that in this specification, "image" includes still images and moving images.

[0027] [Configuration of the imaging device in the first embodiment] As shown in FIGS. 1 and 2, the photographing device 10 includes an imaging lens 12, an aperture 16, a shutter 18, an image sensor 20, a rear display 22, an operation unit 24, a viewfinder 30, a processor 40, and an internal memory 50.

[0028] The photographing device 10 is an integrated lens model or an interchangeable lens model, and photographs an image at an angle of view according to the imaging lens 12. During photographing, light transmitted through the imaging lens 12 is incident on the imaging element 20. The amount of light incident on the imaging element 20 is controlled by adjusting the aperture value of the aperture 16. The exposure time during photographing is controlled by adjusting the shutter speed of the shutter 18. Exposure conditions such as aperture value, shutter speed, and ISO sensitivity are controlled by a processor 40.

[0029] In this embodiment, the imaging element 20 is an image sensor having three color filters of RGB (Red, Green, Blue). However, the color filters are not necessarily required. The imaging element 20 can be configured by a CCD (Charged Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor Image Sensor), an organic imaging element, or the like. The imaging element 20 receives light (not limited to visible light) from a subject, converts the received light image into a video signal, which is an electrical signal, and outputs it.

[0030] The rear display 22 is provided on the rear of the photographing device 10 and displays images and various information, for example, a live view image as the display image during photographing. The live view image is a real-time image of the subject being photographed.

[0031] The operation unit 24 is provided on the outer surface of the photographing device 10 and accepts operations by the user. As shown in Fig. 2, the operation unit 24 includes a release button 25, a cross key-type or control wheel-type selection button 26, and a touch panel 27 provided on the rear display 22. The release button 25 is pressed when the user issues an instruction to store the displayed image during photographing. The selection button 26 and the touch panel 27 are operated, for example, when the user switches the displayed image, selects a displayed image, or specifies a part of the displayed image.

[0032] The viewfinder 30 is a peer-type viewfinder into which the user peers to check the angle of view and the like during shooting, and is more specifically an electronic viewfinder (EVF). The viewfinder 30 may be a hybrid type viewfinder that can switch between an optical viewfinder (OVF) mode and an EVF mode. The viewfinder 30 may be a viewfinder built into the photographing device 10, or an external viewfinder that is detachably connected to a connection unit 14 (hot shoe) provided on the top of the photographing device 10.

[0033] The viewfinder 30 includes a display 31, an observation optical system 32, and an eyepiece frame 33, as shown in FIG.

[0034] The display 31 is disposed inside the finder 30, and displays an image on the display 31. The display 31 is configured, for example, with an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an organic EL (Organic Electroluminescence) display, an LED (Light Emitting Diode) display, electronic paper, or the like. The display 31 may also include a backlight. In this case, the brightness of each part of the display 31, that is, the brightness of each part of the displayed image, can be changed by adjusting the luminance of the backlight for each pixel.

[0035] The observation optical system 32 is a lens or the like arranged between the display 31 and the eyepiece frame 33 in order to magnify the image or the like displayed on the display 31 . The eyepiece frame 33 is a frame surrounding a viewing window provided on the back of the photographing device 10. When the user looks into the inside of the viewfinder 30 (i.e., the display 31), the user approaches the photographing device 10 and brings the periphery of the eye into close contact with the eyepiece frame 33. This causes the area around the user's eyes to be surrounded by the eyepiece frame 33, suppressing light leaking into the viewfinder 30 from outside the photographing device 10. The amount of light leaking into the viewfinder 30 changes depending on the distance between the user and the viewfinder 30, i.e., the degree of close contact between the user's face and the eyepiece frame 33.

[0036] 1, a sensor 34 is provided at a predetermined position on the eyepiece frame 33 or in the vicinity of the eyepiece frame 33. The sensor 34 is configured with a known illuminance sensor or proximity sensor, etc., and detects the use of the viewfinder 30 by the user, and specifically, outputs a signal according to the distance between the user and the viewfinder 30.

[0037] The sensor 34 can be used as a sensor that detects the intensity of light in the shooting environment (hereinafter, referred to as ambient light). The ambient light includes light emitted from the subject and light from the entire shooting environment in which the shooting device 10 exists, such as light illuminating the periphery of the shooting device 10.

[0038] The sensor for detecting the ambient light is not limited to the above-mentioned sensor 34, and may be, for example, an image sensor constituting the image sensor 20. That is, the intensity of the ambient light may be detected from the amount of exposure detected by the image sensor, specifically, the integrated value of the amount of exposure calculated for automatic exposure control (AE control) or auto white balance control (AWB control).

[0039] Although not shown in FIGS. 1 and 2, the finder 30 may further include a photometry sensor that measures the brightness (light intensity) inside the finder 30, or a distance measuring sensor that measures the distance between the user and the finder 30.

[0040] The processor 40 is configured to control each part of the photographing device 10 and execute various processes including photographing, storing images, and displaying images. The processor 40 may be configured by one or more hardware devices, such as a central processing unit (CPU), a field programmable gate array (FPGA), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a graphics processing unit (GPU), a micro-processing unit (MPU), or other integrated circuits (ICs). Alternatively, the processor 40 may be configured by combining these. The processor 40 may be configured by a single integrated circuit (IC) chip, such as a system on chip (SoC). The hardware configuration of the processor 40 described above may be realized by an electric circuit (circuitry) that combines circuit elements such as semiconductor elements.

[0041] The internal memory 50 is an example of a storage device, and stores a program executed by the processor 40. When the program is executed by the processor 40, the processor 40 functions as a control processing unit 42 and a video creation unit 44 as shown in FIG. The display data creation circuit 47 may be provided inside the module of the rear display 22 or the display 31. The display data creation circuit 47 may be provided both inside and outside the above-mentioned module (inside the housing of the imaging device 10).

[0042] The programs executed by the processor 40 are not necessarily stored in the internal memory 50, but may be stored in a memory card 52, which is an example of a storage device. The memory card 52 is used by being inserted into a card slot (not shown) provided in the photographing device 10.

[0043] The control processing unit 42 is configured to control each part of the photographing device 10 in response to a user's operation performed through the operation unit 24 or in accordance with a predetermined control rule. For example, the control processing unit 42 controls the aperture 16, the shutter 18, and the image sensor 20 in response to the intensity of the ambient light to automatically change the exposure conditions. In addition, when the release button 25 is pressed, the control processing unit 42 stores data of the image photographed at that time (image data) in a storage device such as the internal memory 50 or the memory card 52.

[0044] The control processing unit 42 is also configured to display a display image on the rear display 22 or the display 31 during shooting. In the first embodiment, the control processing unit 42 displays a display image according to the display data created by the image creation unit 44, based on the display data. At this time, the control processing unit 42 determines whether the display image is to be displayed on the rear display 22 or the display 31. For example, when the sensor 34 detects that the distance between the user and the image capture device 10 is equal to or less than a predetermined distance (more specifically, that the user's face is in contact with the eyepiece frame 33), the control processing unit 42 displays the display image on the display 31.

[0045] The image creation unit 44 is configured to acquire image data by shooting under ambient light, and to create display data from the acquired image data in the first embodiment. The image creation unit 44 according to the first embodiment has an A / D (Analog / Digital) conversion circuit 45, an image data acquisition circuit 46, and a display data creation circuit 47, as shown in FIG.

[0046] The A / D conversion circuit 45 converts the video signal output from the image sensor 20 from an analog signal to a digital signal. The video data acquisition circuit 46 performs image processing such as gamma correction and white balance correction on the converted digital signal, and acquires video data by compressing the processed signal according to a predetermined standard. The video data is data that indicates the gradation values ​​of each part of the field of view during shooting, more specifically, the gradation values ​​of the three colors RGB, for each pixel. In the first embodiment, the gradation value indicated by the video data is called the "input gradation value." The input gradation value is defined within a numerical range that includes a lower limit value as the first gradation value, an upper limit value as the second gradation value, and an intermediate value located between them, and is defined within a numerical range of 0 to 255 when the video data is data in 8-bit format, for example.

[0047] The display data creation circuit 47 creates display data based on the video data, and more specifically, creates the display data by correcting the output value for the input gradation value indicated by the video data. The display data is data that indicates the output value for each pixel. In the following, unless otherwise specified, the output value indicated by the display data is assumed to be a gradation value (output gradation value) that is defined within the same numerical range as the input gradation value.

[0048] In the first embodiment, the correction performed by the display data creation circuit 47 to create display data is different from normal gamma correction and is a correction according to the intensity of ambient light. Hereinafter, the correction according to the intensity of ambient light performed by the display data creation circuit 47 will be simply called "correction."

[0049] The correction is a process for changing the output value for the input gradation value from the value obtained when normal gamma correction is performed, and includes the first gradation process and the second gradation correction described below. The display data creation circuit 47 performs the correction on the output value to create display data indicating the corrected output value.

[0050] In the first embodiment, as described above, when the distance between the user and the image capturing device 10 is equal to or shorter than a predetermined distance, a display image according to the display data is displayed on the display 31. The brightness of the display image displayed on the display 31 at this time is a brightness according to the output value indicated by the display data. Note that brightness is the physical brightness of each part of the display image, and is determined according to the output value, with the image becoming brighter as the output value increases.

[0051] [Video display flow in the first embodiment] Next, a video display flow in the first embodiment will be described. The video display flow is executed while a user is taking a picture using the photographing device 10. In the video display flow in the first embodiment, a video (live view image) of a subject being photographed can be displayed as a display video on the display 31 by the display method according to the first embodiment of the present invention.

[0052] As shown in FIG. 4, the image display flow in the first embodiment includes an acquisition step S001, a light detection step S002, a determination step S003, a creation step S004, and a display step S005, and these steps are executed by the processor 40 in that order.

[0053] In the acquisition step S001, video data is acquired by shooting under ambient light. More specifically, the video creation unit 44 acquires the video data based on the video signal output from the imaging element 20 at any time during shooting.

[0054] In the light detection step S002, the intensity of ambient light is detected by the sensor 34 or an image sensor or the like constituting the image pickup device 20 (hereinafter referred to as a light detection sensor) during shooting.

[0055] In the determination step S003, a magnitude relationship between the intensity of the ambient light detected by the light detection sensor and two thresholds (a first threshold and a second threshold) is determined. Specifically, it is determined whether the intensity of the ambient light is equal to or greater than the first threshold, or equal to or less than the second threshold. Each of the first threshold and the second threshold is a value used as a criterion for determining whether or not correction should be performed in the creation step S004, and is determined according to the brightness of the display 31. The brightness of the display 31 is the brightness determined as the device specifications of the display 31 (specifically, the rated output), or the brightness set in advance by the user as a usage condition of the display 31. The first threshold value is, for example, a value corresponding to a brightness that exceeds the brightness of the display 31, and the second threshold value is, for example, a value corresponding to a brightness that is sufficiently lower than the brightness of the display 31.

[0056] In the creation step S004, display data is created based on the video data. In the display step S005, a display image according to the created display data is displayed on the display 31. In the first embodiment, when the distance between the user and the image capturing device 10 is equal to or shorter than a predetermined distance, the display step S005 is performed and the display image is displayed on the display 31. This allows the image to be efficiently displayed on the display 31 according to the distance between the user and the image capturing device 10.

[0057] The above series of steps S001 to S005 are repeatedly executed during shooting. Then, when the user presses the release button 25 during execution of the display step S005, image data showing the image at that time is stored in a storage device such as the internal memory 50 or the memory card 52 by the control processing unit 42.

[0058] The procedure of the creation step S004 will be described in detail with reference to FIG. In the creation step S004, as shown in FIG. 5, an output value is determined for the input grayscale value indicated by the video data acquired in S001. When the intensity of the ambient light is within a normal range, the output value is the value obtained by performing gamma correction on the input gradation value. In the first embodiment, gamma correction is performed so that the input gradation value and the output value have a linear relationship as shown in FIG.

[0059] In the first embodiment, correction is performed on the output value according to the magnitude relationship between the intensity of the ambient light and the threshold value, and display data according to the intensity of the ambient light is created. Specifically, when the intensity of the ambient light is equal to or greater than the first threshold value (S021), display data is created (the creation process is performed) under conditions where the brightness of the display image displayed on the display 31 is brighter than the brightness of the first reference image. When the intensity of the ambient light is equal to or less than the second threshold value (S024), display data is created (the creation process is performed) under conditions where the brightness of the display image displayed on the display 31 is darker than the brightness of the second reference image.

[0060] Here, the first reference image and the second reference image are display images based on image data acquired by shooting under ambient light whose intensity is greater than the second threshold and less than the first threshold. That is, the first reference image and the second reference image are images based on image data acquired when the intensity of the ambient light is within a normal range, and more specifically, images displayed on the display 31 according to display data created based on that image data. Note that the first reference image and the second reference image may be images with the same brightness or images with different brightnesses.

[0061] If the intensity of the ambient light is equal to or greater than the first threshold value, or equal to or less than the second threshold value, correction is performed in the creation step S004 (S023, S026), and display data indicating the corrected output value is created (S028).

[0062] On the other hand, when the intensity of the ambient light is greater than the second threshold and less than the first threshold, uncorrected display data indicating output values ​​not subjected to correction (i.e., output values ​​subjected to only gamma correction) is created (S027). Note that the image displayed on the display 31 according to the uncorrected display data created in step S027 can be used as the first reference image and the second reference image described above.

[0063] In the first embodiment, the correction is a correction to the display image displayed on the display 31, and is not a correction to the image data in the acquisition step S001. Therefore, the correction in the first embodiment is not reflected in the image data stored in a storage device such as the memory card 52 and the internal memory 50.

[0064] The correction in the first embodiment includes a first gradation correction and a second gradation correction. The first gradation correction is performed when the intensity of the ambient light is equal to or greater than a first threshold value, and is a correction that raises the output value for the input gradation value of the first gradation portion to a value higher than the output value after gamma correction, as shown in FIG. 7. The first gradation portion is a portion of the angle of view at the time of shooting where the input gradation value is equal to or less than a first reference value, that is, a low gradation portion (dark portion). The first reference value (value Va in FIG. 7) is set to a value equivalent to 1 / 3 to 1 / 4 of the intermediate value in the numerical range (e.g., 0 to 255) that defines the input gradation value.

[0065] According to the first gradation correction, the output value of the first gradation portion is corrected from the value on the dashed line to the value on the solid line in Fig. 7, resulting in a gradation value higher than the value after gamma correction. In other words, the brightness of the first gradation portion after the first gradation correction is performed appears brighter than the brightness of the displayed image when no correction is performed, i.e., the first reference image.

[0066] The first gradation correction can make the first gradation portion more visible, for example, when the user looks into the viewfinder 30 while shooting under bright ambient light, until the user's eyes adapt to the dark. That is, the first gradation correction makes the portion of the image displayed on the display 31 that is difficult to see because the output value after gamma correction is below a certain value (value Ga in FIG. 7), specifically the portion indicated by symbol t1 in FIG. 7, more visible. This effect is particularly effective when the first gradation portion of the displayed image is difficult to see because of strong external light, such as in backlighting.

[0067] Furthermore, in the first embodiment, when the intensity of the ambient light is equal to or greater than a first threshold value, it is determined whether the first gradation portion in the angle of view is equal to or greater than a predetermined width, specifically, whether the number of pixels constituting the first gradation portion is equal to or greater than a predetermined number (S022). Then, if the first gradation portion is equal to or larger than a predetermined size, the first gradation correction is performed, and display data is created that indicates the output value after the correction. In this way, the first gradation correction is performed when the correction is effective, and conversely, if the first gradation portion is too small to obtain a sufficient effect of the correction, the first gradation correction can be omitted.

[0068] Moreover, from the viewpoint of improving visibility for the user, it is desirable to set the correction amount in the first gradation correction so that it increases as the difference between the input gradation value of the first gradation portion and the first reference value Va increases, as shown in Fig. 7. In other words, the lower the input gradation value of the first gradation portion, the greater the correction amount when correcting the output value for that input gradation value should be.

[0069] However, in the first gradation portion, in an area where the input gradation value is near the lower limit, if the amount of correction is increased, the area will appear dark in the actual image, but will appear bright in the image displayed on the display 31. As a result, the light-dark difference (contrast) in the displayed image will deviate from the actual image. For this reason, in the area where the input gradation value is near the lower limit, it is advisable to gradually decrease the amount of correction for the first gradation correction as the input gradation value decreases, as shown in FIG. 7, in consideration of the balance with the actual image. However, without being limited to this, as shown in FIG. 8, the amount of correction may be increased as the difference between the input gradation value and the first reference value Va increases across the entire first gradation portion, including the area where the input gradation value is near the lower limit value.

[0070] The second gradation correction is performed when the intensity of the ambient light is equal to or less than a second threshold value, and is a correction that reduces the output value for the input gradation value of the second gradation portion below the output value after gamma correction, as shown in Fig. 9. The second gradation portion is a portion of the field of view at the time of shooting where the input gradation value is equal to or greater than the second reference value, that is, a high gradation portion (bright portion). The second reference value (value Vb in Fig. 9) is set to a value equivalent to 2 / 3 to 3 / 4 of the middle value in the numerical range (e.g., 0 to 255) that defines the input gradation value.

[0071] According to the second gradation correction, the output value of the second gradation part is corrected from the value on the dashed line to the value on the solid line in FIG. 9, and the gradation value becomes lower than the value after gamma correction. That is, the brightness of the second gradation part after the second gradation correction is performed appears darker than the brightness of the display image when no correction is performed, i.e., the second reference image. This makes it possible to make the second gradation part more visible until the user's eyes become light-adapted, for example, when the user looks into the finder 30 while shooting under dark ambient light. That is, in the display image displayed on the display 31, the part that becomes difficult to see because the output value after gamma correction exceeds a certain value (the value indicated by the symbol Gb in FIG. 9), specifically, the part indicated by the symbol t2 in FIG. 9, becomes more visible by the second gradation correction.

[0072] In the first embodiment, when the intensity of the ambient light is equal to or less than the second threshold, it is determined whether the second gradation portion in the angle of view is equal to or greater than a predetermined width, specifically, whether the number of pixels constituting the second gradation portion is equal to or greater than a predetermined number (S025). If the second gradation portion is equal to or greater than the predetermined width, a second gradation correction is performed, and display data indicating the output value after the correction is created. In this way, the second gradation correction is performed when the effect of the correction is effectively exerted, and conversely, when the second gradation portion is too small to obtain a sufficient effect of the correction, the second gradation correction can be omitted.

[0073] Moreover, from the viewpoint of improving visibility for the user, it is desirable to set the amount of correction in the second gradation correction so that it increases as the difference between the input gradation value of the second gradation portion and the second reference value Vb increases, as shown in Fig. 9. In other words, the higher the input gradation value of the second gradation portion, the greater the amount of correction when correcting the output value for that input gradation value should be.

[0074] However, just as in the case of the first gradation correction, taking into consideration the balance with the actual image, in the area of ​​the second gradation portion where the input gradation value is close to the upper limit, it is advisable to gradually decrease the amount of correction of the second gradation correction as the input gradation value increases, as shown in FIG. 9. However, without being limited to this, as shown in FIG. 10, the amount of correction may be increased as the difference between the input gradation value and the second reference value Vb increases across the entire second gradation range, including the region where the input gradation value is close to the upper limit value.

[0075] The image display flow in the first embodiment will be described again with reference to Figs. 11 to 13. Figs. 11 to 13 show examples of display images displayed on the display 31, and the images shown in each figure are images of the same subject. The display image shown in Fig. 11 is an image captured when the intensity of the capturing light is within a normal range, and corresponds to the first reference image and the second reference image. Also, the images shown in each figure each have a first gradation portion and a second gradation portion. For example, in each figure, the portion located on the back side of the roof of the building and the portion located on the far side inside the building correspond to the first gradation portion (the portion surrounded by the dashed line in Fig. 12), and the clouds located beside the building correspond to the second gradation portion (the portion surrounded by the dashed line in Fig. 13).

[0076] When the intensity of ambient light is within the normal range, the display 31 displays the display image shown in FIG. 11 according to the uncorrected display data, i.e., a display image (first reference image or second reference image) whose brightness corresponds to the output value after gamma correction.

[0077] On the other hand, when the intensity of the ambient light is equal to or greater than the first threshold (hereinafter referred to as a bright environment), assume that display data indicating the output value after gamma correction, i.e., uncorrected display data, is created, and a display image corresponding to the uncorrected display data is displayed on the display 31. In this case, when the user looks into the viewfinder 30, the first gradation portion (dark area) in the displayed image becomes difficult to see. This is because when the user looks into the viewfinder 30 in a bright environment, the user's pupils are closed immediately after the look, and the first gradation portion is difficult to distinguish until the user's eyes adapt to the dark.

[0078] Therefore, in a bright environment, the brightness of the display image displayed on the display 31 is made brighter than the brightness of the first reference image. Specifically, in the creation process, a correction (more specifically, a first gradation correction) is performed on the output value after gamma correction, and display data indicating the corrected output value is created. Then, in the display process, a display image according to the display data indicating the corrected output value, that is, a display image in which the first gradation portion has a higher gradation, is displayed on the display 31. As a result, as shown in FIG. 12, the brightness of the first gradation portion (the portion surrounded by a dashed line in FIG. 12) in the display image becomes brighter than the brightness of the first gradation portion in the first reference image, making the first gradation portion easier for the user to see.

[0079] Furthermore, when the intensity of the ambient light is equal to or less than the second threshold (hereinafter referred to as a dark environment), assume that uncorrected display data indicating the output value after gamma correction is created, and a display image corresponding to the uncorrected display data is displayed on the display 31. In this case, when the user looks into the viewfinder 30, the second gradation portion (light portion) in the displayed image becomes difficult to see. This is because when the user looks into the viewfinder 30 in a dark environment, the user's pupils are open immediately after the look, and the second gradation portion is difficult to distinguish until the user's eyes become light-adapted.

[0080] Therefore, in a dark environment, the brightness of the display image displayed on the display 31 is made darker than the brightness of the second reference image. Specifically, in the creation process, correction (more specifically, second gradation correction) is performed on the gradation value after gamma correction, and display data indicating the corrected output value is created. Then, in the display process, a display image according to the display data indicating the corrected output value, that is, a display image in which the second gradation part has a lower gradation, is displayed on the display 31. As a result, as shown in FIG. 13, the brightness of the second gradation part in the display image (the part surrounded by the dashed line in FIG. 13) becomes darker than the brightness of the second gradation part in the second reference image, making it easier for the user to see the second gradation part.

[0081] The amount of correction (i.e., the amount of correction to the output value) when performing correction in the creation process is preferably changed according to the amount of light leaking into the viewfinder 30. This is because if too much light leaks into the viewfinder 30, the visibility of the display 31 decreases. Specifically, when making the correction, the distance between the user and the viewfinder 30 is measured by a distance sensor or the like, or the brightness inside the viewfinder 30 is measured by a photometry sensor or the like. These measurement results are parameters that determine the amount of light leaking into the viewfinder 30, so it is preferable to set the amount of correction according to the parameters. This makes it possible to adjust the brightness of the display image (particularly the first gradation part and the second gradation part) displayed on the display 31 so that it is easier to see, while taking into account the amount of light leaking into the viewfinder 30. The correspondence between the above parameters and the correction amounts may be expressed in a mathematical formula and stored as a conversion formula in advance, or may be stored as data in the form of a conversion table, so that it can be referenced when making corrections.

[0082] Furthermore, the correction amount may be changed according to the intensity of the ambient light, more precisely, the intensity detected by a light detection sensor. Specifically, as shown in Fig. 14, the correction amount in the first gradation correction may be increased as the difference between the intensity of the ambient light and the first threshold increases. Fig. 14 is a diagram showing the correspondence relationship between the correction amount and the intensity of light when the correction amount when the first gradation correction is performed on a certain output value is changed according to the intensity of the ambient light. Similarly, the amount of correction in the second gradation correction may be increased as the difference between the intensity of ambient light and the second threshold increases, as shown in Fig. 15. Fig. 15 is a diagram showing the correspondence relationship between the amount of correction and the intensity of light when the amount of correction when the second gradation correction is performed on a certain output value is changed according to the intensity of ambient light.

[0083] Furthermore, the user may set the amount of correction in advance before the correction is performed. Specifically, the user may perform a setting operation (e.g., an operation to input the amount of correction) through the operation unit 24 or the like, and the image creation unit 44 of the processor 40 may set the amount of correction according to the setting operation. The amount of correction when correcting the output value is generally determined according to the shooting scene and the subject, etc., but there are cases where the user requires a part of the displayed image (e.g., the first gradation part and the second gradation part) to be seen more clearly. Conversely, there may be cases where the user does not care about how the displayed image looks. In such cases, if the amount of correction can be set according to the user's setting operation, the brightness of the first gradation part and the second gradation part can be adjusted according to the user's preference, and convenience for the user is improved.

[0084] Furthermore, in the first embodiment, when the user starts using the viewfinder 30, the processor 40 times the usage time. Using the viewfinder 30 means that the user looks into the display 31 inside the viewfinder 30, and the usage time is the time that has elapsed since the user started looking into the display 31. Furthermore, the usage time may be the display time of the image displayed on the display 31, or may be a time measured by another method. A preset time is set for the usage time, and for example, the time required for the user's eyes to adapt to the dark or light is set as the set time.

[0085] In the first embodiment, in the case of a bright or dark environment, it is determined whether or not the usage time has reached the set time (S029), as shown in Fig. 5. Then, depending on whether or not the usage time has reached the set time, the display data created in the creation process is changed, in other words, the brightness of the display image displayed on the display 31 in the display process is changed.

[0086] Specifically, before the usage time reaches the set time, in the creation process, the output value is corrected (specifically, the first gradation correction or the second gradation correction) and display data indicating the corrected output value is created. Then, in the display process, a display image corresponding to the display data indicating the corrected output value is displayed on the display 31. On the other hand, after the usage time reaches the set time, a creation step creates uncorrected display data indicating output values ​​that are not corrected (i.e., output values ​​after gamma correction) (S031). Then, in the display step, a display image corresponding to the uncorrected display data is displayed on the display 31. This is because, when the usage time reaches the set time, the user's eyes have become dark-adapted or light-adapted, and thereafter, it is no longer necessary to change the brightness of the display image (particularly the first and second gradation parts) displayed on the display 31.

[0087] Also, in consideration of the visibility of the image, after the usage time reaches a set time, display data showing the corrected output value may be created while gradually decreasing the amount of correction for the output value according to the usage time, as shown in Figures 16 and 17. In this case, in the subsequent display process, the brightness of the display image (particularly the first gradation portion and the second gradation portion) displayed on the display 31 gradually changes, and approaches the brightness of the uncorrected state as the usage time becomes longer. Finally, in the creation process, display data with a correction amount of 0, that is, uncorrected display data, is created, and in the display process, a display image according to the uncorrected display data, that is, a display image with a brightness according to the output value after gamma correction, is displayed on the display 31.

[0088] Also, as a configuration different from the above configuration, for example, in the case of a bright environment or a dark environment, in the creation process, a correction is performed to create display data indicating the corrected output value, and uncorrected display data may also be created. Then, in the display process, as shown in FIG. 18, a display image (indicated by symbol M1 in the figure) corresponding to the display data indicating the corrected output value and a display image (indicated by symbol M2 in the figure) corresponding to the uncorrected display data may be displayed together (simultaneously) on the display 31. In this case, the user can simultaneously see the display image that has been made easier to see by the correction and the uncorrected display image (i.e., an image reflecting the image data to be stored) on the display 31. As a result, the user can confirm that the image data is normal data (so-called whiteout and blackout have not occurred). In this case, the fact that the user can confirm the gradation of the dark or bright area from the corrected display data or the uncorrected display data means that the gradation remains firmly in the image data to be stored.

[0089] In the above configuration, the brightness of the display image displayed on the display 31 is changed by changing the gradation value (output gradation value) indicated by the display data as the output value, but other methods are also possible. For example, the output value may be changed to represent the luminance of the backlight provided in the display 31, i.e., an output value indicating the physical luminance (hereinafter referred to as output luminance). In this case, the control processing unit 42 calculates the output luminance from the output gradation value indicated by the display data, and controls the luminance of the backlight for each pixel based on the calculated output luminance.

[0090] The output luminance is changed according to the intensity of the ambient light, and for example, when the intensity of the ambient light is equal to or greater than a first threshold value, the output luminance is changed from the value on the dashed line to the value on the solid line in Fig. 19, becoming a luminance higher than that obtained when only gamma correction is performed. As a result, in a bright environment, a portion of the image displayed on the display 31 that would be difficult to see with only gamma correction because the output luminance falls below a certain value (value Ka in Fig. 19), i.e., the first gradation portion, becomes easier to see.

[0091] Furthermore, when the intensity of the ambient light is equal to or lower than the second threshold value, the output luminance is changed from the value on the dashed line to the value on the solid line in Fig. 20, resulting in a lower luminance than when only gamma correction is performed. As a result, in a dark environment, the portion of the image displayed on the display 31 that would be difficult to see with only gamma correction because the output luminance exceeds a certain value (the value Kb in Fig. 20), i.e., the second gradation portion, becomes easier to see.

[0092] When the display 31 is configured by a liquid crystal display or the like, the brightness of the image displayed on the display 31 may be changed by changing the degree of rotation of the light (polarization plane) by the liquid crystal molecules.

[0093] In the first embodiment, the correction is performed in both the bright environment and the dark environment, but the correction may be performed in only one of the bright environment or the dark environment. That is, the output value may be corrected in the creation process and display data indicating the corrected output value may be created only when the intensity of the ambient light is equal to or greater than a first threshold. Alternatively, the output value may be corrected in the creation process and display data indicating the corrected output value may be created only when the intensity of the ambient light is equal to or less than a second threshold.

[0094] <<Second embodiment>> In the first embodiment, display data is created by performing correction (more specifically, additional correction to the output value after gamma correction) according to the intensity of the ambient light. However, in the first embodiment, the video data that is the source of the display data is not corrected and is stored in the storage device as is. On the other hand, a configuration in which the image data is corrected, that is, a configuration in which the gradation values ​​(input gradation values) indicated by the image data are corrected, is also possible. This configuration is called a second embodiment, and will be described below.

[0095] In the following, the second embodiment will be mainly described with respect to the differences from the first embodiment, and the devices in the second embodiment that are common to the first embodiment will be denoted by the same reference numerals as in the first embodiment. In the following description, "correcting video data" means correcting the gradation value indicated by the video data.

[0096] [Configuration of the imaging device in the second embodiment] In the second embodiment, similarly to the first embodiment, the image capturing device 10 is used as a display device. The image capturing device 10 according to the second embodiment is generally common to the image capturing device 10 according to the first embodiment, but the function of the processor 40 is different from that of the first embodiment.

[0097] In the second embodiment, the control processing unit 42 of the processor 40 urges the user to use the viewfinder 30 when displaying a predetermined display image on the display 31. Here, urging the user to use the viewfinder 30 means, for example, displaying a message or the like on the rear display 22 urging the user to use the viewfinder 30 during shooting. However, this is not limited to this, and for example, the display destination of the display image may be switched from the rear display 22 to the display 31, and the image display on the rear display 22 may be forcibly ended to urge the user to use the viewfinder 30.

[0098] In the second embodiment, the video creation unit 44 of the processor 40 includes an A / D conversion circuit 45, a first video data acquisition circuit 48, and a second video data creation circuit 49, as shown in FIG.

[0099] The first video data acquisition circuit 48 performs image processing such as gamma correction and white balance correction on the video signal converted into a digital signal by the A / D conversion circuit 45, and compresses the processed signal according to a predetermined standard to acquire the first video data. In other words, the first video data is the same data as the video data according to the first embodiment.

[0100] The second video data creation circuit 49 creates a plurality of second video data showing different gradation values ​​based on the first video data. Specifically, the second video data creation circuit 49 performs a plurality of partial gradation corrections on the first video data, more specifically, performs a first gradation correction and a second gradation correction with different correction amounts. This creates a plurality of second video data corrected with different correction amounts.

[0101] The multiple pieces of second image data to be created include at least one piece of second image data on which correction has been performed, but may also include second image data with a correction amount of 0 (i.e., no correction is performed) as reference data. Furthermore, in creating the second image data, correction is not limited to being performed on a portion of the gradation values ​​indicated by the first image data, but may be performed on all of the gradation values ​​indicated by the first image data. In this case, each of the multiple second image data indicates a gradation value that has been subjected to a correction different from normal gamma correction (specifically, gamma correction using a gamma curve with a different shape from normal or knee correction).

[0102] In the second embodiment, the processor 40 causes a display image corresponding to each of the created plurality of second video data to be displayed on the display 31. The display image corresponding to each of the plurality of second video data is an image that is displayed on the display 31 according to each converted data by performing a predetermined conversion process on each second video data to convert the second video data into data for display (display data).

[0103] [Video display flow in the second embodiment] Next, a video display flow in the second embodiment will be described. The video display flow in the second embodiment is executed while a user is taking a picture using the imaging device 10. In the video display flow in the second embodiment, a video of a subject (live view image) is displayed as a display video on the display 31 during shooting by a display method according to the second embodiment of the present invention. As shown in FIG. 22, the video display flow in the second embodiment includes an acquisition step S051, a creation step S052, a display step S053, a prompting step S054, a selection receiving step S055, and a storage step S056, and these steps are executed by the processor 40.

[0104] In the acquisition step S051, first image data is acquired by shooting. Specifically, the first image data acquisition circuit 48 of the processor 40 acquires the first image data from the image signal output from the image sensor 20 at any time during shooting. Also, if the exposure conditions are changed during shooting, the acquisition step S051 acquires a plurality of first image data with mutually changed exposure conditions, i.e., the first image data before the exposure conditions are changed and the first image data after the exposure conditions are changed.

[0105] In the creating step S052, a plurality of second image data indicating different gradation values ​​is created based on the first image data. Specifically, the second image data creating circuit 49 of the processor 40 performs a plurality of corrections with different correction amounts on the first image data.

[0106] More specifically, a plurality of first gradation corrections are performed by varying the amount of correction for gradation values ​​in the first image data that are equal to or less than a first reference value. Similarly, a plurality of second gradation corrections are performed by varying the amount of correction for gradation values ​​in the first image that are equal to or greater than a second reference value. This creates a plurality of second image data including second image data that has been subjected to the first gradation correction and second image data that has been subjected to the second gradation correction.

[0107] In the following, an example will be described in which the correction amounts of the first and second gradation corrections are set in three stages (+1, 0, -1) and the above two corrections are performed at each correction amount to create a total of nine pieces of second image data. In this case, the nine pieces of second image data include second image data with a correction amount of 0 (i.e., neither the first nor second gradation correction is performed) as a reference.

[0108] In the display step S053, a plurality of display images (i.e., nine display images) corresponding to the nine pieces of second image data are displayed on the display 31. In the display step S053, two or more display images are simultaneously displayed on the display 31, and for example, nine display images are arranged in a matrix as shown in FIG. In Fig. 23, for convenience of illustration, each display image is illustrated in a simplified form. In addition, in the figure, a display image with a correction amount of the first gradation correction at a step of "+1" is arranged in the first row from the top, a display image with a correction amount of "0" at the second row from the top, and a display image with a correction amount of "-1" at the third row from the top. In addition, a display image with a correction amount of the second gradation correction at a step of "+1" is arranged on the leftmost side, a display image with a correction amount of "0" at the center, and a display image with a correction amount of "-1" at the rightmost side.

[0109] Also in the second embodiment, similarly to the first embodiment, when the distance between the user and the image capturing device 10 is equal to or less than a predetermined distance, the display image may be displayed on the display 31. This allows the display image to be efficiently displayed on the display 31 according to the distance between the user and the image capturing device 10.

[0110] The prompting step S054 is performed when the nine display images are displayed on the display 31. In the prompting step S054, for example, a message or the like urging the user to use the viewfinder 30 is displayed on the rear display 22. This makes it possible to appropriately guide the user to look into the viewfinder 30 and see the display 31. Then, the user can compare the nine display images displayed on the display 31. At this time, when a display image corresponding to the second image data with a correction amount of 0 is included as a reference image among the nine display images, the user can compare the reference image with the other display images.

[0111] In the flow shown in FIG. 22, the prompting step S054 is performed after the displaying step S053, but this is not limited to the above, and the prompting step may be performed before the displaying step, or the prompting step and the displaying step may be performed together.

[0112] The selection receiving step S055 receives a selection operation performed by the user through the operation unit 24 while the nine display images are being displayed on the display 31. In the selection operation, the user selects one image from the nine display images, for example, an image in which the first and second gradation portions are clearly displayed and which is most easily visible, and inputs the selection result through the selection button 26 or the like.

[0113] In the storage step S056, based on the received selection operation, second image data corresponding to the display image selected by the user from among the nine display images is identified, and the second image data is stored in the internal memory 50, the memory card 52, or the like.

[0114] As described above, in the second embodiment, display images (specifically, nine display images) corresponding to each of the multiple second image data corrected with different correction amounts are displayed on the display 31 to encourage the user to use the viewfinder 30. This allows the user to compare the multiple display images displayed on the display 31 and understand, for example, which correction makes the image the clearest (in other words, the effect of each correction).

[0115] If nine display images are displayed on the rear display 22, if the intensity of the ambient light at that time is not appropriate (for example, if the outside light is too strong), there is a risk that the user will not be able to correctly grasp the clarity of each display image, that is, the effect of the correction. In contrast, in the second embodiment, nine display images are displayed on the display 31 in the viewfinder 30, so that it is possible to eliminate the influence of ambient light on each display image. This allows the user to properly check each display image, and therefore to properly select the second image data to be stored.

[0116] In addition, when the user looks into the viewfinder 30 in a situation where the intensity of the ambient light is high, such as when the external light is too strong, the image displayed on the display 31 becomes difficult to see until the user's eyes adapt to the dark. In consideration of this, it is preferable to have the display image displayed on the display 31 after a certain time has elapsed since the user looked into the viewfinder 30. Alternatively, as in the first embodiment, the brightness of the image displayed on the display 31 may be adjusted according to the intensity of the ambient light (that is, the gradation value indicated by the second image data may be corrected according to the intensity of the ambient light).

[0117] In the second embodiment, the second image data corresponding to the display image selected by the user from among the nine display images is stored, which allows the second image data to be stored from among the multiple second image data, reflecting the user's will, thereby improving convenience for the user.

[0118] As described above, in the acquisition step S051 of the second embodiment, a plurality of first image data having different exposure conditions may be acquired. In this case, in the display step S053, a plurality of display images based on the plurality of first image data with changed exposure conditions may be displayed on the display 31 together with the nine display images. The display images based on the plurality of first image data are images that are displayed on the display 31 according to the display data created by performing a predetermined conversion process on the first image data acquired before and after changing the exposure conditions.

[0119] As described above, by displaying on the display 31 a display image corresponding to the second image data and a display image based on the first image data after changing the exposure conditions together, the user can compare these display images. This allows the user to check the effect of corrections performed with different correction amounts together with the effect of changing the exposure conditions. As a result, the user can determine whether changing the exposure conditions is more effective than gradation correction in ensuring the clarity of the image.

[0120] In the second embodiment, a plurality of modes (display modes) in which the nine display images are displayed on the display 31 in the display step may be prepared. The first display mode is, for example, a mode in which nine display images are arranged in a matrix and simultaneously displayed (single screen display) as shown in Fig. 23. In this mode, the display size of each display image is small.

[0121] The second display mode is, for example, a mode in which some of the nine display images are displayed on the display 31. The number of images displayed in this mode is not particularly limited, but for example, two display images may be displayed together on the display 31 as shown in Fig. 24. Here, one of the two display images may be a display image corresponding to the second image data on which correction has been performed, and the other may be a display image corresponding to the second image data on which correction has not been performed (i.e., a display image for reference).

[0122] In the second display mode, the display image displayed on the display 31 may be switched in response to a switching operation by the user. For example, every time a switching operation is performed, the display image corresponding to the second image data on which correction has been performed may be switched, and specifically, as shown in FIG. 24, it is preferable to switch to a display image having a different correction amount from the immediately preceding display image.

[0123] The third display mode is, for example, a mode in which, among the nine display images, a display image corresponding to the second image data on which the first correction has been performed and a display image corresponding to the second image data on which the second correction has been performed are separately displayed on the display 31. Here, one of the first gradation correction and the second gradation correction corresponds to the first correction, and the other corresponds to the second correction.

[0124] A flow when displaying a display image in the third display mode will be described with reference to Fig. 25. In the following, a case will be described in which the second gradation correction is the first correction and the first gradation correction is the second correction. However, the contents described below can also be applied to a case in which the first gradation correction is the first correction and the second gradation correction is the second correction.

[0125] In the third display mode, the creation step includes a first creation step S062 and a second creation step S066. Also, in the third display mode, the display step includes a first display step S063 and a second display step S067, and the selection receiving step includes a first selection receiving step S065 and a second selection receiving step S068.

[0126] In the third display mode, after the acquisition step S061 is performed, a first creation step S062 is performed. In the first creation step S062, a plurality of first corrections with mutually different correction amounts are performed on the first image data to create two or more pieces of second A image data. Specifically, the first corrections are performed with three levels of correction amounts (for example, correction amounts of +2, +1, and -1 for dark areas) to create three pieces of second A image data. The second A image data is data that belongs to the second image data.

[0127] Thereafter, a first display step S063 is performed, in which three display images corresponding to the three 2A image data are displayed on the display 31. The display images displayed in the first display step S063 include images whose gradation values ​​have been corrected by the first correction, for example, images whose brightness in the first gradation portion has been changed. At this time, a reference display image that is not corrected may be displayed.

[0128] During or before the first display step S063, a prompting step S064 is performed, and the prompting step S064 triggers the user to use the finder 30. Thereafter, a first selection receiving step S065 is performed, and when the user selects one of two or more display images displayed on the display 31, the processor 40 receives the selection result. Incidentally, since the first selection receiving step S065 is performed during the first display step S063, the display image selected in the first selection receiving step S065 corresponds to the display image selected in the first display step S063.

[0129] After the first selection receiving step S065 is performed, a second creation step S066 is performed. In the second creation step S066, two or more pieces of 2B image data are created based on the selection result received in the first selection receiving step S065. Specifically, a first correction is performed on the first image data with a correction amount selected by the user, and a second correction is performed with three levels of correction amounts (for example, correction amounts of +2, +1, and -1 for bright areas), thereby creating three pieces of 2B image data. Here, the correction amount selected by the user is the correction amount of the first correction performed when creating the 2A image data corresponding to the display image selected in the first display step S063. The 2nd B-video data is data belonging to the 2nd video data.

[0130] After the second creation step S066 is performed, a second display step S067 is performed, in which three display images corresponding to the three pieces of 2B image data are displayed on the display 31. The display images displayed in the second display step S067 include images whose gradation values ​​have been corrected by the first correction and the second correction, more specifically, images whose brightness has been changed in the first gradation portion and the second gradation portion. At this time, a reference display image that is not corrected may be displayed.

[0131] During the execution of the second display step S067, a second selection receiving step S068 is executed, and when the user selects one of the two or more display images displayed on the display 31, the processor 40 receives the selection result. Incidentally, since the second selection receiving step S068 is performed during the second display step S067, the display image selected in the second selection receiving step S068 corresponds to the display image selected in the second display step S067.

[0132] When the user presses release button 25 after second selection receiving step S068 is performed, a storage step S069 is performed. In the storage step S069, the second B image data corresponding to the display image selected in the second display step S067 is stored in internal memory 50, memory card 52, or the like. In other words, the image data stored in the storage step S069 is second image data created by performing the first correction and the second correction on the first image data with the correction amount selected by the user.

[0133] As described above, in the third display mode, first, the first correction with different correction amounts is performed on the first image data to generate a plurality of 2A image data. Then, display images corresponding to each 2A image data are displayed on the display 31, and the user is allowed to select one of them. After that, the first correction and the second correction are performed on the first image data to generate a plurality of 2B image data. Then, display images corresponding to each 2B image data are displayed on the display 31, and the user is allowed to select one of them. By changing the type of correction and displaying the display image on the display 31 in stages in this way, the number of images displayed at one time on the screen of the display 31 is reduced, and the visibility of the display image is improved. In addition, by changing the type of correction and displaying the display image in stages, the user can select the display image for each type of correction in stages, which improves the convenience for the user.

[0134] In the third display mode, when release button 25 is pressed after second selection receiving step S068 is performed, second B image data corresponding to the display image selected during second display step S067 is stored in storage step S069. On the other hand, for example, if the release button 25 is pressed during the period from the first selection receiving step S065 to the second selection receiving step S068, the storage step may be performed at that time. In the storage step in this case, for example, the 2A image data corresponding to the display image selected in the first selection receiving step S065 may be stored.

[0135] The fourth display mode is, for example, a mode in which the difference parts in each of the nine display images are enlarged and displayed on the display 31 as shown in Fig. 23. The difference parts are parts in each display image where the gradation values ​​differ between the nine pieces of second image data, and more simply, for example, correspond to the first gradation part where the first gradation correction has been performed and the second gradation part where the second gradation correction has been performed.

[0136] In the fourth display mode, the visibility of the portions of the second image data that have different gradation values ​​(i.e., difference portions) among the display images is improved. As a result, the user can properly grasp the effect of the correction applied to the gradation values ​​of the difference portions by looking at the enlarged difference portions.

[0137] It is preferable that the difference part that is enlarged and displayed in the display image is specified by the user, since this improves convenience for the user. The user may specify the difference part through the selection button 26 or the touch panel 27 during or before the display step S053. Furthermore, the user may be able to specify multiple difference parts in one display image, and in this case, each of the multiple specified difference parts may be displayed on the display 31.

[0138] Although four display modes have been described above, display modes other than the above modes may be included. In addition, in the video display flow in the second embodiment, any of the above four display modes may be adopted, or two or more modes may be used in combination. When two or more display modes are combined, it is preferable that the display mode to be used can be changed appropriately. For example, when the above-mentioned first display mode and second display mode are used in combination, the display mode may be switched to the second display mode by the user performing a predetermined mode switching operation while the display video is displayed on the display 31 in the first display mode. That is, the state of the display 31 may be shifted from a state in which nine display videos are arranged in a matrix to a state in which two display videos are displayed.

[0139] <<Other embodiments>> The embodiment described above is a specific example given to easily explain the display method and display device of the present invention, and is merely one example, and other embodiments are also possible. In the above embodiment, a digital camera with an EVF was given as an example of an imaging device constituting the display device of the present invention, but the display device of the present invention may also be another imaging device with an EVF (e.g., a video camera, a smartphone, etc.).

[0140] In the above embodiment, the processor 40 provided in the photographing device body (the portion of the photographing device 10 other than the viewfinder 30) performs the correction, more specifically, creates the image data and display data indicating the output value after the correction. However, this is not limited to this, and for example, a correction circuit (corresponding to an example of a processor) provided in the viewfinder 30 may be provided separately from the processor 40 of the photographing device body. In this case, the correction circuit may create the image data and display data indicating the output value after the correction, and cause the display 31 to display an image corresponding to the created data.

[0141] In the above embodiment, the storage device for storing the video data is provided within the image capture device 10. However, this is not limited to this, and for example, an external terminal or a server computer connected to the image capture device 10 so as to be communicable with the image capture device 10 may serve as the storage device, and the video data may be stored in the storage device. [Explanation of symbols]

[0142] 10. Imaging Device 12 Imaging lens 14 Connection 16 Aperture 18 Shutter 20. Image sensor 22 Rear display 24 Operation Unit 25 Release button 26 Selection button 27 Touch Panel 30 Finder 31 Display 32 Observation Optical System 33 Eyepiece frame 34 Sensors 40 processors 42 Control processing section 44 Video Production Department 45 A / D conversion circuit 46 Video data acquisition circuit 47 Display data creation circuit 48 1st video data acquisition circuit 49 Second video data creation circuit 50 Internal Memory 52 Memory Card

Claims

1. A display method using a display device having a finder with a display provided therein, comprising: an acquisition step of acquiring first image data by photographing; a generating step of generating a plurality of second image data indicating different grayscale values ​​based on the first image data; a display step of displaying a plurality of display images corresponding to the plurality of second image data on the display; a prompting step of prompting a user to use the viewfinder when the plurality of display images are displayed on the display; a storage step of storing the second image data corresponding to a display image selected by a user from the plurality of display images in a storage device; the plurality of second image data include second image data obtained by performing correction on a gradation value indicated by the first image data, In the creating step, the second image data is created by performing a first gradation correction on a gradation value in the first image data that is equal to or less than a first reference value, and the second image data is created by performing a second gradation correction on a gradation value in the first image data that is equal to or more than a second reference value, In the display step, a display image corresponding to the second image data on which the first gradation correction has been performed and a display image corresponding to the second image data on which the second gradation correction has been performed are displayed side by side on the display; When one of the first gradation correction and the second gradation correction is designated as a first correction and the other is designated as a second correction, The creating step includes a first creating step and a second creating step, The display step includes a first display step and a second display step, In the first creation step, two or more second A image data are created by performing the first corrections having different amounts of correction, In the first display step, two or more display images corresponding to the two or more second A image data are displayed on the display; In the second creation step, two or more pieces of second B image data are created by performing the first correction performed when creating the second A image data corresponding to the display image selected in the first display step and a plurality of the second corrections having different amounts of correction from each other; In the second display step, two or more display images corresponding to the two or more second B image data are displayed on the display; In the storage step, the second B-image data corresponding to the display image selected in the second display step is stored in the storage device.

2. In the acquiring step, a plurality of the first image data are acquired under different exposure conditions, The display method according to claim 1 , wherein in the displaying step, a plurality of the display images based on a plurality of the first image data having different exposure conditions are displayed together on the display.

3. 3. The display method according to claim 1, wherein in the displaying step, a difference portion in the display image, in which the grayscale values ​​differ from one another among the plurality of second image data, is enlarged and displayed on the display.

4. 4. The display method according to claim 3, wherein in said displaying step, said difference portion specified by the user is enlarged and displayed on said display.

5. The display method according to claim 1 , further comprising: displaying the display image on the display when a distance between the user and the display device is equal to or shorter than a predetermined distance.

Images