Imaging device, method for controlling imaging device, and program product

Abstract

The imaging device is provided with a display switching determination period setting unit that sets display switching determination periods corresponding to a plurality of display items to be displayed on a display unit according to imaging settings related to the set imaging.

Description

Technical Field

[0001] The present disclosure relates to an imaging device, a method for controlling the imaging device, and a program. Background Art

[0002] There are known imaging devices having a line-of-sight detection function and performing control based on the line-of-sight detection result. For example, Patent Document 1 below describes a camera that clears the display of a function menu displayed on a viewfinder when there is no consistent command input based on the line of sight for a predetermined time.

[0003] Citation List

[0004] Patent Documents

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. H05-110908 Summary of the Invention

[0006] Technical Problem

[0007] Meanwhile, in an imaging device, display items are superimposed and displayed on a through image, an image being captured, etc. by on-screen display (OSD). The display items include the remaining battery level, the number of images that can be taken, the shutter speed, the ISO sensitivity, etc. In the technique described in Patent Document 1, since it is difficult to set a display switching determination period according to an imaging setting (i.e., a setting related to imaging set in the imaging device), there is a problem that a required display item immediately disappears from the screen or an unnecessary display item remains on the screen.

[0008] An object of the present disclosure is to provide an imaging device, a method for controlling the imaging device, and a program that more appropriately perform display control.

[0009] Solution to the Problem

[0010] The present disclosure provides, for example, an imaging device including: a display switching determination period setting unit that sets a display switching determination period for each of a plurality of display items displayed on a display unit according to an imaging setting related to imaging that is set.

[0011] The present disclosure provides, for example, a method for controlling an imaging device, the method including: setting, by a display switching determination period setting unit, a display switching determination period for each of a plurality of display items displayed on a display unit according to an imaging setting related to imaging that is set.

[0012] The present disclosure provides, for example, a program for causing a computer to execute a method for controlling an imaging device, the method including: setting, by a display switching determination period setting unit, a display switching determination period for each of a plurality of display items displayed on a display unit according to imaging settings related to imaging set. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a block diagram for describing a configuration example of an imaging device according to an embodiment.

[0014] Figure 2 is a view referred to when describing a process of specifying a fixation area.

[0015] Figure 3 is a view showing an example of setting a display switching determination period for each of a plurality of display items according to a correlation between an imaging mode and a display item.

[0016] Figure 4 is a view referred to when describing display control according to an embodiment.

[0017] Figure 5 is a view referred to when describing display control according to an embodiment.

[0018] Figure 6 is a view referred to when describing display control according to an embodiment.

[0019] Figure 7 is a view referred to when describing display control according to an embodiment.

[0020] Figure 8 A~ Figure 8 D are views referred to when describing display control according to an embodiment.

[0021] Figure 9 is a flowchart showing a processing flow executed by an imaging device according to an embodiment.

[0022] Figure 10 is a flowchart showing a processing flow executed by an imaging device according to an embodiment.

[0023] Figure 11 is a flowchart showing a processing flow executed by an imaging device according to an embodiment.

[0024] Figure 12 is a view for describing a modification example.

[0025] Figure 13 is a view for describing a modification example.

[0026] Figure 14 is a view for describing a modification example.

[0027] Figure 15 is a view for describing a modified example. Detailed implementation manners

[0028] Hereinafter, embodiments of the present disclosure and the like will be described with reference to the accompanying drawings. Note that the description will be given in the following order.

[0029] <Embodiment>

[0030] <Modified example>

[0031] The embodiments and the like described hereinafter are preferred specific examples of the present disclosure, and the content of the present disclosure is not limited to such embodiments and the like.

[0032] <Embodiment>

[0033] [Configuration example of imaging device]

[0034] First, reference will be made to Figure 1 describe a configuration example of an imaging device (imaging device 100) according to an embodiment. The imaging device 100 includes a control unit 101, an optical imaging system 102, a lens drive driver 103, an imaging element 104, an image signal processing unit 105, a codec unit 106, a storage unit 107, an interface 108, an input unit 109, a display unit 110, a microphone 111, an AF control unit 113, and a gaze detection unit 114. The control unit 101 includes a gaze area specifying unit 101A, an imaging setting determination unit 101B, a display switching determination period setting unit 101C, and an OSD display control unit 101D as functional blocks.

[0035] The control unit 101 includes a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and the like. The CPU executes various processes according to programs stored in the ROM to issue commands, thereby comprehensively controlling the entire imaging device 100 and each unit.

[0036] The gaze area specifying unit 101A specifies the area that the user is gazing at based on gaze information (hereinafter, appropriately referred to as the gaze area). The imaging setting determination unit 101B determines the imaging settings related to the imaging set in the imaging device 100. In the present embodiment, the imaging settings are described as imaging modes. Note that the imaging settings may be contents set by the user input or may be automatically set contents. The display switching determination period setting unit 101C sets a display switching determination period for each of a plurality of display items displayed on the display unit 110 according to the set imaging settings related to imaging. The OSD display control unit 101D executes control related to the display of the display items.

[0037] The optical imaging system 102 includes an imaging lens configured to collect a light beam from a subject on the imaging element 104, a drive mechanism configured to move the imaging lens to perform focusing and zooming, a shutter mechanism, an aperture mechanism, and the like. They are driven based on control signals from the control unit 101 and the lens drive driver 103. An optical image of the subject obtained through the optical imaging system 102 is formed on the imaging element 104.

[0038] The lens drive driver 103 includes, for example, a microcomputer and the like, and moves the imaging lens in the optical axis direction by a predetermined amount based on the focusing control information provided from the AF control unit 113 to perform autofocusing, thereby focusing on the subject as the target. Autofocusing is performed based on the defocus amount. At this time, the defocus amount can be calculated based on the phase difference information based on the pixel values of the image plane phase difference pixels included in the imaging element 104, and autofocusing is performed based on the calculated defocus amount. In addition, the focusing control is not limited to autofocus control and can also be manual focusing control performed manually. In addition, under the control of the control unit 101, the operations of the drive mechanism, the shutter mechanism, the aperture mechanism, and the like of the optical imaging system 102 are controlled. Thus, the exposure time (shutter speed), the aperture value (focal length value), and the like are adjusted.

[0039] The imaging element 104 photoelectrically converts the incident light from the subject obtained through the imaging lens into an electric charge amount and outputs an imaging signal. Then, the imaging element 104 outputs a pixel signal to the image signal processing unit 105. As the imaging element 104, a charge-coupled device (CCD), a complementary metal oxide semiconductor (CMOS), or the like is used.

[0040] The image signal processing unit 105 performs sampling and holding through correlated double sampling (CDS) processing, automatic gain control (AGC) processing, analog / digital (A / D) conversion, and the like on the imaging signal output from the imaging element 104 to maintain a favorable signal-to-noise (S / N) ratio to create an image signal. In addition, the image signal processing unit 105 performs processing for recording on the image signal for recording and performs processing for display on the image signal for display.

[0041] The codec unit 106 performs, for example, an encoding process for recording or communication on the image signal that has undergone a predetermined process.

[0042] The storage unit 107 is a large-capacity storage medium such as a hard disk or a flash memory. The processed video data and image data in the image signal processing unit 105 and the codec unit 106 are stored in a compressed state or an uncompressed state based on a predetermined standard. In addition, an Exchangeable Image File Format (EXIF) including additional information (such as information about the stored data, imaging position information indicating the imaging position, and imaging time information indicating the imaging date and time) is also stored in association with the data.

[0043] The interface 108 is an interface with other devices, the Internet, etc. The interface 108 may include a wired or wireless communication interface. More specifically, the wired or wireless communication interface may include cellular communication such as 3GPP LTE, Wi-Fi, Bluetooth (registered trademark), Near Field Communication (NFC), Ethernet (registered trademark), High-Definition Multimedia Interface (HDMI) (registered trademark), and Universal Serial Bus (USB), etc.

[0044] Note that the imaging device 100 may include a communication unit that can be connected to the Internet, other devices, etc., such as a Wireless Local Area Network (LAN), a Wide Area Network (WAN), or Wireless Fidelity (WiFi). In addition, the communication between the imaging device 100 and an external device may be short-range wireless communication such as Near Field Communication (NFC) or ZigBee (registered trademark), or a tethering connection such as WiFi tethering, Universal Serial Bus tethering (USB tethering), or Bluetooth (registered trademark) tethering (Bluetooth tethering).

[0045] The user gives various instructions, etc. to the imaging device 100 using the input unit 109. When the user inputs to the input unit 109, a control signal corresponding to the input is generated and provided to the control unit 101. Then, the control unit 101 performs various processes corresponding to the control signal. Examples of the input unit 109 include a shutter button for shutter input, physical buttons for various operations, a touch panel, and a touch screen integrally configured with a display serving as the display unit 110, etc.

[0046] The display unit 110 is a display device that displays, for example, a through-image of a display image signal that has undergone display processing, an image and video that have undergone recording image processing and are stored in the storage unit 107, and a Graphical User Interface (GUI), etc. The display unit 110 may be included in an Electronic Viewfinder (EVF). Display items are displayed on the display unit 110.

[0047] The microphone 111 is a sound collection device configured to record voice when recording an image.

[0048] The AF control unit 113 performs autofocus control based on the defocus amount.

[0049] The line-of-sight detection unit 114 detects the user's line of sight to generate a line-of-sight detection result. The generated line-of-sight detection result is provided from the line-of-sight detection unit 114 to the control unit 101.

[0050] [Regarding line-of-sight information and fixation area]

[0051] Next, a specific example of the process of detecting the line of sight of the camera operator (user) performed by the line-of-sight detection unit 114 will be described. For example, the line-of-sight detection unit 114 captures an image of the camera operator's eyes and uses the image of the eyes to detect the direction of the camera operator's line of sight.

[0052] As a method for detecting the direction of the camera operator's line of sight, a well-known method can be applied. For example, the corneal reflection method can be applied: infrared light or the like is emitted, and the reflection from the cornea is utilized to detect the direction of the camera operator's line of sight based on the position of the pupil. In addition, for example, a method of identifying immovable points (such as the inner or outer corners of the eyes) and estimating the line-of-sight direction based on the position of the iris of the eyes is applied.

[0053] The line-of-sight detection unit 114 is provided, for example, in the viewfinder of the imaging device 100. The line-of-sight detection unit 114 can be provided in the housing of the imaging device 100. For example, the line-of-sight detection unit 114 can be provided on the surface of the housing of the imaging device 100 on which the display unit 110 is set.

[0054] The direction of the line of sight detected by the line-of-sight detection unit 114 is provided to the control unit 101 as the line-of-sight detection result.

[0055] The fixation area specifying unit 101A of the control unit 101 generates line-of-sight information based on the line-of-sight detection result provided from the line-of-sight detection unit 114. The line-of-sight information is, for example, information indicating the distribution of the line-of-sight detection result. Specifically, as Figure 2 shown, the line-of-sight information is the distribution of the line-of-sight detection result PA corresponding to the position on the display unit 110 in the line-of-sight direction. The line-of-sight information for each appropriate area AR of the display unit 110 is obtained. The area AR can be set in units of pixels or blocks, where a block includes M pixels × N pixels (M and N are appropriate positive numbers). The fixation area specifying unit 101A designates the area that the user is fixating on as the fixation area based on the distribution of the line-of-sight detection result PA. For example, as Figure 2As shown, the gaze area specifying unit 101A obtains a histogram of values (hereinafter, appropriately referred to as gaze degrees) of the distribution of the line-of-sight detection result PA corresponding to both the X-axis direction and the Y-axis direction on the display unit 110, and designates one or more areas AR corresponding to the peak as the gaze area GA. In addition, the gaze area specifying unit 101A may also obtain the variance value for each point obtained by dividing the histogram at a predetermined resolution, and designate the area where the variance value is equal to or above the threshold as the gaze area GA. In addition, the area of the gaze area may be limited to a predetermined value, and the area from the area with a high gaze degree to the area where the area becomes the predetermined value may be set as the gaze area GA. In addition, the area where the gaze degree is equal to or greater than the threshold may be set as the gaze area GA.

[0056] Note that the line-of-sight information may be information indicating the trajectory of the line-of-sight detection result PA. For example, when the trajectory of the line-of-sight detection result PA falls within a certain area within a predetermined time of about several seconds, the gaze area specifying unit 101A may designate this area as the gaze area GA.

[0057] Generally, the display positions of the display items displayed on the display unit 110 are determined separately for each display item. Therefore, when the overlap between the gaze area GA designated by the gaze area specifying unit 101A and the display position (a certain area) of the display item is equal to or above a threshold (for example, 80%), it can be determined that the cameraman is gazing at the display item, in other words, the line of sight coincides with the display item.

[0058] [Regarding the display switching determination period]

[0059] Next, the display switching determination period set by the display switching determination period setting unit 101C will be described. The display switching determination period setting unit 101C sets the display switching determination period for each of the plurality of display items according to the correlation between the imaging mode and the display item. The correlation is an index indicating the strength of the relationship between the imaging mode and the display item. For example, the correlation is set for each display item. The correlation according to the present embodiment is, in descending order of correlation, "high", "medium", "low", and each correlation is classified according to a predetermined threshold. Each display item is classified into the corresponding correlation based on the threshold of the correlation and the correlation set for the display item itself.

[0060] The display switching determination period refers to the period during which the user continuously views the display item starting from the beginning. In other words, it is determined whether the gaze detection unit 114 continuously detects the user's gaze on the display item during the display switching determination period. If the determination result is continuous detection, the display of the display item is controlled to a high visibility display state (i.e., a display with high visibility), and if the determination result is non - continuous detection, it is controlled to a low visibility display state (i.e., a display with low visibility). In addition, the control unit 101 determines whether to continue detecting the user's gaze on the above - mentioned display item. The display switching determination period according to the present embodiment includes: a high visibility display state switching determination period TA for setting the display of the display item to a high visibility display state, where the high visibility display state is a display state with high visibility; and a low visibility display state switching determination period TB for setting the display of the display item to a low visibility display state, where the low visibility display state is a display state with lower visibility than the high visibility display state. The display switching determination period setting unit 101C sets different display switching determination periods between the high visibility display state switching determination period TA and the low visibility display state switching determination period TB for each of the multiple display items according to the relevance.

[0061] Figure 3 is a view showing an example of setting the display switching determination period (specifically, the high visibility display state switching determination period TA and the low visibility display state switching determination period TB) for each of the multiple display items according to the relevance between the imaging mode and the display item. In Figure 3 the example shown, "A mode (aperture - priority mode)", "S mode (shutter - speed - priority mode)", and "M mode (manual mode)" are exemplified as imaging modes. In addition, in Figure 3 the example shown, "shutter speed (hereinafter, appropriately abbreviated as SS)", "focal length value", "exposure", "white balance (hereinafter, appropriately abbreviated as WB)", "ISO sensitivity" (hereinafter, appropriately abbreviated as ISO), "imaging mode", "number of images that can be taken", "aspect ratio", "image size", "image quality", and "remaining battery power" are exemplified as display items.

[0062] For example, when the imaging mode is "S mode", the display item "SS" is classified as having a "high" relevance. The display items "focal length value", "exposure", "WB", and "ISO" are classified as having a "medium" relevance. The display items "mode", "aspect ratio", "image quality", and "battery" are classified as having a "low" relevance. The imaging modes "A mode" and "M mode" are classified as shown in Figure 3 the figure.

[0063] In this embodiment, when a display item with a high correlation with the set imaging mode is gazed at, the display of the display item is controlled to quickly display in a highly visible state. In addition, even when a display item with a high correlation with the set imaging mode is not gazed at, the display item is controlled not to be displayed in a low-visibility state for a certain period of time. Therefore, the display item with a high correlation with the predetermined imaging mode can be immediately emphasized. In other words, the display item is considered to have set content that is frequently viewed by the person being photographed. In addition, it is possible to prevent the display item that is considered to be frequently viewed by the person being photographed from being immediately displayed in a low-visibility state and becoming difficult to see.

[0064] On the other hand, as the correlation with the set imaging mode decreases, the need for the person being photographed to view the set content of the display item decreases, and the need to quickly display the display item in a highly visible state decreases. In addition, since the need for the person being photographed to view the set content of the display item decreases, the need to quickly display the display item in a low-visibility state increases. This control can prevent a display item with a low correlation with the set imaging mode from being unnecessarily displayed in a highly visible state, or the display item from being unnecessarily displayed for a long time.

[0065] Based on such a view, the display switching determination period setting unit 101C sets the high-visibility display state switching determination period TA to a value smaller than the value of the low-visibility display state switching determination period TB for display items with a correlation equal to or higher than the threshold. In Figure 3 the example shown, the high-visibility display state switching determination period TA for the display item classified as having a "high" correlation is set to 0.2 seconds, and the low-visibility display state switching determination period TB for the display item classified as having a "high" correlation is set to 3 seconds. In addition, the high-visibility display state switching determination period TA for the display item classified as having a "medium" correlation is set to 0.5 seconds, and the low-visibility display state switching determination period TB for the display item classified as having a "medium" correlation is set to 2 seconds.

[0066] In addition, the display switching determination period setting unit 101C sets the high-visibility display state switching determination period to a value larger than the value of the low-visibility display state switching determination period for display items with a correlation less than the threshold. In Figure 3 the example shown, the high-visibility display state switching determination period TA for the display item classified as having a "low" correlation is set to 1 second, and the low-visibility display state switching determination period TB for the display item classified as having a "low" correlation is set to 0.7 seconds.

[0067] [Specific Example of Display Control]

[0068] Next, a specific example of the display control of display items performed by the OSD display control unit 101D will be described. Figure 4 is a view showing an example of an image displayed on the display unit 110. The display unit 110 displays an image captured via the optical imaging system 102, the imaging element 104, etc. In this example, an image IM including two skaters is displayed on the display unit 110.

[0069] At the top and bottom of the display unit 110, respective black bars extending horizontally are displayed, and display items are displayed at these positions. For example, in the upper black bar, display items "Imaging mode (e.g., S)", "Number of images that can be taken (e.g., □2460)", "Aspect ratio (e.g., 3:2)", "Image size (e.g., 24 M)", "Image quality (e.g., good)", and "Remaining battery level (e.g., battery mark and 50%)" are displayed in order from the left. In addition, in the lower black bar, display items "SS (e.g., 1 / 125)", "Focal length value (e.g., F5.6)", "Exposure (e.g., ±0.0)", "WB (e.g., AWB (Auto White Balance))", and "ISO (e.g., Auto)" are displayed in order from the left.

[0070] In the default display state, each display item is displayed in a transparent mode (specifically, a semi-transparent mode) that can be visually recognized by the photographer, for example. For example, the α value (transmittance) in image processing called α blending is set to approximately 40% - 60%, and then each display item is displayed on the display unit 110 by the OSD. In the following description, Figure 4 the shown display state is appropriately referred to as the default display state.

[0071] An example will be considered in which it is detected based on the gaze detection result of the gaze detection unit 114 that the photographer is looking at the image IM. In this case, a state is obtained in which not all display items are being gazed at and the photographer's gaze on the display items is not continuously detected. In this state, the OSD display control unit 101D quickly displays each display item classified as having a "low" relevance in a low visibility display state. For example, at the time point when the low visibility display state switching determination period TB (0.7 seconds) set for the display items with a "low" relevance has elapsed, the OSD display control unit 101D displays each display item in a low visibility display state. Specifically, for example, the OSD display control unit 101D sets the α value in α blending to 100 and displays each display item. Thus, as Figure 5 shown, each display item classified as having a "low" relevance and displayed in the upper black bar becomes invisible.

[0072] In addition, in a state where no display item is being gazed at, when the low visibility display state transition determination period TB (2 seconds) set for the display item with "medium" relevance has elapsed, the OSD display control unit 101D performs control to make the display items "Focus Value", "Exposure", "WB", and "ISO" invisible. In addition, in a state where no display item is being gazed at, when the low visibility display state transition determination period TB (3 seconds) set for the display item with "high" relevance has elapsed, the OSD display control unit 101D performs control to make the display item "SS" invisible. Therefore, as Figure 6 shown, all display items become invisible. Note that control can be performed to make the black bars above and below in Figure 6 invisible.

[0073] In addition, in Figure 4 the default display state, for example, it is assumed that the cameraman is gazing at the position where the display item "SS" is being displayed. That is, it is assumed that the line of sight of the cameraman to the display of the display item "SS" has been continuously detected. Note that the expression "to the display" refers to the display position. At the time point when the high visibility display state transition determination period TA (0.2 seconds) corresponding to the display item "SS" has elapsed in the gazing state, the OSD display control unit 101D displays the display item "SS" in the high visibility display state. For example, the OSD display control unit 101D sets the α value to 0, and as Figure 7 shown, controls the display item "SS" to be more visible than other display items. The same applies to other display items. That is, the OSD display control unit 101D performs control to display the gazed display item in the high visibility display state within the high visibility display state transition determination period TA.

[0074] Note that after the past high visibility display state transition determination period TA, the OSD display control unit 101D immediately changes the display of the display item to the high visibility display state. For example, when the α value in the default display state is set to 50, after the past high visibility display state transition determination period TA, as Figure 8 shown in A, the OSD display control unit 101D immediately changes the α value from 50 to 0, thereby displaying the display item in the high visibility display state. In addition, after the past high visibility display state transition determination period TA, the OSD display control unit 101D can gradually change the display of the display item to the high visibility display state. For example, when the α value in the default display state is set to 50, after the past high visibility display state transition determination period TA, as Figure 8As shown in Fig. B, the OSD display control unit 101D can display the display items in a highly visible display state by gradually (linearly) changing the α value from 50 to 0. The degree of fade-in (the degree of change of the α value) and its time can be set appropriately. In addition, the change of the α value is not necessarily linear, and can be exponential or stepped. Note that in Figure 8 Figs. A and Figure 8 B, in the example shown, when the α value = 100, the display state has the lowest visibility, and when the α value = 0, the display state has the highest visibility.

[0075] This also applies to the transition from the default display state to the low visibility display state. After the past low visibility display state switching determination period TB, the OSD display control unit 101D immediately changes the display of the display items to the low visibility display state. For example, when the α value of the default display state is set to 50, after the past low visibility display state switching determination period TB, as Figure 8 shown in Fig. C, the OSD display control unit 101D immediately changes the α value from 50 to 100, so as to display the display items in the low visibility display state. In addition, after the past low visibility display state switching determination period TB, the OSD display control unit 101D can gradually change the display of the display items to the low visibility display state. For example, when the α value of the default display state is set to 50, after the past low visibility display state switching determination period TB, as Figure 8 shown in Fig. D, the OSD display control unit 101D can display the display items in a highly visible display state by gradually (linearly) changing the α value from 50 to 100. The degree of fade-out (the degree of change of the α value) and its time can be set appropriately. In addition, the change of the α value is not necessarily linear, and can be exponential or stepped.

[0076] [Processing Flow]

[0077] Next, the processing flow (schematic processing flow) executed by the imaging device 100 according to the embodiment will be described with reference to the Figure 9 flowchart shown. For example, when the power of the imaging device 100 is turned on or when the line of sight of the photographer is detected, the following processing is executed. Note that although not shown in the Figure 9 flowchart shown, it is assumed that the fixation area is specified in real time based on the line of sight detection result of the photographer obtained by the line of sight detection unit 114.

[0078] In step ST11, the imaging mode is set. For example, the photographer sets the imaging mode using the input unit 109. Note that the processing of step ST11 is omitted without changing the previously set imaging mode. Then, the processing proceeds to step ST12.

[0079] In step ST12, the imaging setting determination unit 101B determines the set imaging mode. The imaging setting determination unit 101B notifies the display switching determination period setting unit 101C of the determined imaging mode. Then, the process proceeds to step ST13.

[0080] In step ST13, the display switching determination period setting unit 101C sets a high visibility display state switching determination period TA and a low visibility display state switching determination period TB for each display item according to the correlation with the determined imaging mode. Then, the process proceeds to step ST14.

[0081] In step ST14, the display items are displayed in the default display state under the control of the OSD display control unit 101D. Then, the process proceeds to step ST15.

[0082] In step ST15, the OSD display control unit 101D controls the display of the display items according to the detection result of the camera operator's line of sight. Then, the process proceeds to step ST16.

[0083] In step ST16, the imaging setting determination unit 101B determines whether the imaging mode has changed. For example, this determination process corresponding to step ST16 is executed in parallel with the process of step ST15. If the imaging mode has not changed, the process corresponding to step ST15 is repeated. If the imaging mode has changed, the process returns to step ST12, and the changed imaging mode is determined. Then, according to the changed imaging mode, a high visibility display state switching determination period TA and a low visibility display state switching determination period TB are set for each display item.

[0084] Next, the Figure 10 flowchart will be referred to describe the process of the specific process related to the display control of the display items.

[0085] Step ST21 corresponds to the process of step ST14 above. In step ST21, all display items are displayed in the default display state. Then, the process proceeds to step ST22.

[0086] In step ST22, the control unit 101 determines whether the camera operator's line of sight is consistent with a predetermined display item displayed on the display unit 110 based on the gaze area specified by the gaze area specifying unit 101A. If the line of sight is consistent, the process proceeds to step ST23.

[0087] In step ST23, the counting of the timer starts. The timer is, for example, a timer set in the control unit 101. Then, the process proceeds to step ST24.

[0088] In step ST24, the control unit 101 determines whether the line of sight of the camera operator that coincides with a predetermined display item has deviated before the high-visibility display state transition determination period TA (the high-visibility display state corresponding to the display item that coincides with the line of sight) has elapsed. If the line of sight has deviated, the process proceeds to step ST25.

[0089] In step ST25, the count value of the timer is reset. Then, the process proceeds to step ST26. In step ST26, control is executed to return the process to step ST22.

[0090] If, in the determination process of step ST24, the line of sight does not deviate from the predetermined display item, the process proceeds to step ST27. In step ST27, the control unit 101 determines whether the high-visibility display state transition determination period TA has elapsed. If the high-visibility display state transition determination period TA has not elapsed, the process returns to step ST24. If the high-visibility display state transition determination period TA has elapsed, the process proceeds to step ST28.

[0091] In step ST28, the OSD display control unit 101D executes control to display the display item in the high-visibility display state. Then, the process proceeds to step ST29.

[0092] In step ST29, the control unit 101 determines whether the first reset time has elapsed. The first reset time is the time set for returning from the high-visibility display state to the default display state and is set to, for example, about several seconds. If the first reset time has not elapsed, the process returns to step ST28 and continues to display the display item in the high-visibility display state. If the first reset time has elapsed, the process returns to step ST21 and all display items are displayed in the default display state.

[0093] If, in the determination process of step ST22, the line of sight of the camera operator does not coincide with all the display items displayed on the display unit 110, the process proceeds to step ST30.

[0094] In step ST30, the counting of the timer starts. The timer is, for example, a timer set in the control unit 101. Then, the process proceeds to step ST31.

[0095] In step ST31, the control unit 101 determines whether the line of sight of the camera operator coincides with a predetermined display item before the low-visibility display state transition determination period TB has elapsed, based on the viewing area specified by the viewing area specifying unit 101A. If the line of sight coincides, the process proceeds to step ST25.

[0096] In step ST25, the count value of the timer is reset. Then, the process proceeds to step ST26. In step ST26, control is performed to return the process to step ST22.

[0097] In the determination process of step ST31, when the line of sight does not match the predetermined display item, the process proceeds to step ST32. In step ST32, the control unit 101 determines for each display item whether the low visibility display state switching determination period TB has elapsed. When the low visibility display state switching determination period TB has not elapsed, the process returns to step ST31. When the low visibility display state switching determination period TB has elapsed, the process proceeds to step ST33.

[0098] In step ST33, the OSD display control unit 101D performs control to display the display item in the low visibility display state. Then, the process proceeds to step ST34.

[0099] In step ST34, the control unit 101 determines whether the second reset time has elapsed. The second reset time in this process is set to return the display state to the default display state when the duration of displaying all display items in the low visibility display state becomes a certain time or more, and is set to, for example, about 1 minute to several minutes. Since it is possible that the cameraman views the content of the display item again after a certain period of time when all display items have been displayed in the low visibility display state, the second reset time is set. When the second reset time has not elapsed, the process returns to step ST33, and the display item continues to be displayed in the low visibility display state. When the second reset time has elapsed, the process returns to step ST21, and all display items are displayed in the default display state.

[0100] Note that Figure 11 the process shown in the flowchart of is executed in parallel with the counting process of the first reset time or the second reset time. In step ST41, the OSD display control unit 101D displays the display item in the high visibility display state or the low visibility display state. This process corresponds to the process of step ST28 or step ST33 described above. Then, the process proceeds to step ST42.

[0101] In step ST42, the control unit 101 determines whether the line of sight coincides with another display item during the reset time count. Examples of another display item include a display item different from a display item displayed in a highly visible display state, a display item displayed in a default display state, etc. When the line of sight does not coincide with the display item, the process returns to step ST41. When the line of sight coincides with the display item, the process proceeds to step ST43.

[0102] The processing after step ST43 is executed in an interrupt manner. In step ST43, the process of resetting the timer is executed. Then, the process proceeds to step ST44. In step ST44, the process of returning the content of the process to step ST22 is executed.

[0103] According to the embodiment described above, the display control of the display item can be executed according to the imaging mode set in the imaging device. Therefore, the display items considered to be frequently required by the photographer can immediately enter the highly visible display state. In addition, it is possible to prevent the display item from immediately disappearing from the screen. In addition, the display items considered not to be required by the photographer can be immediately set to the low visibility display state.

[0104] <Modification Example>

[0105] Although the embodiments of the present disclosure have been specifically described above, the content of the present disclosure is not limited to the above embodiments, and various modification examples based on the technical idea of the present disclosure are possible.

[0106] [First Modification Example]

[0107] For example, when a predetermined part has been gazed at and a highly visible display state switching determination period TA has elapsed, the display items classified as having a "high" relevance can be concentratedly displayed in a highly visible display state. For example, as Figure 12 shown, the photographer gazes at a predetermined area AR1 of the display unit 110. When the gazing time period exceeds the highly visible display state switching determination time period TA, as Figure 13 shown, the OSD display control unit 101D can execute control to display all display items having a "high" relevance to the imaging mode in a highly visible display state. Note that a frame or a mark can be displayed in the area AR1 for the photographer to recognize. In addition, the area AR1 can be an area provided in the housing of the imaging device 100 instead of the display unit 110. In addition, when one of the display items having a "high" relevance has been gazed at, the other display items having a "high" relevance can also be set to the highly visible display state together.

[0108] [Second Modification Example]

[0109] The imaging settings are not limited to imaging modes and can be related to, for example, the imaging scene. Examples of imaging scenes include "Sports", "Portrait", "Still Life", "Landscape", "Night Scene", and "Food". Similarly, in the case of an imaging scene, each display item is similarly classified as having a "high", "medium", or "low" relevance to the imaging scene. Then, a high visibility display state switching determination period TA and a low visibility display state switching determination period TB are set for each relevance. Figure 14 FIG. is a view showing an example of the high visibility display state switching determination period TA and the low visibility display state switching determination period TB set for each display item classified according to the relevance to the imaging scene, and each relevance. Note that the content of the imaging scene is determined by the imaging setting determination unit 101B.

[0110] [Other Modification Examples]

[0111] As Figure 15 shown, the display item can be superimposed on the image, and is not limited to the top and bottom of the display unit 110.

[0112] The relevance can be set in stages other than three. In addition, the display state switching determination period is not limited to the high and low two stages, and any one can be set, or a period with three or more stages can be set.

[0113] The relevance of each display item can be dynamically changed according to the user's usage history. For example, in the case where there are many opportunities to view the display item "Image Quality", the relevance of "Image Quality" can be changed to high.

[0114] The default display state may not be translucent. The display mode of the high visibility display state can also be appropriately changed. For example, the high visibility display state can be a display mode in which the display item is set to blink or the display item is displayed in a larger size. The display mode of the low visibility display state can also be appropriately changed. For example, the low visibility display state can be a display mode in which the display item is displayed in a smaller size.

[0115] The position of each display item can be changed and set according to the habits of the cameraman to guide his / her own line of sight, etc.

[0116] A general operation input unit configured to change the setting content of the display item can be provided. Then, the setting related to the display item that has been set to the high visibility display state due to being gazed at can be changed by operating the operation input unit. In addition, the setting related to the display item that has been set to the high visibility display state can be changed by voice input.

[0117] The configurations, methods, steps, shapes, materials, numerical values, etc. described in the above embodiments and variations are merely examples, and the configurations, methods, steps, shapes, materials, numerical values, etc. can be used as needed or replaced with known ones. In addition, the configurations, methods, steps, shapes, materials, numerical values, etc. in the embodiments and variations can be combined with each other within the scope where no technical contradiction occurs.

[0118] Note that the content of the present disclosure is not to be construed as being limited by the effects illustrated in this specification.

[0119] The present disclosure can also adopt the following configurations. (1)

[0121] An imaging device, comprising:

[0122] A display switching determination period setting unit that sets a display switching determination period for each of a plurality of display items displayed on a display unit according to imaging settings related to imaging that are set. (2)

[0124] The imaging device according to (1),

[0125] wherein the display switching determination period setting unit sets a display switching determination period for each of the plurality of display items according to the correlation between the imaging settings and the display items. (3)

[0127] The imaging device according to (2),

[0128] wherein the display switching determination period includes: a high visibility display state switching determination period for setting the display of a display item to a high visibility display state, the high visibility display state being a display state with high visibility; and a low visibility display state switching determination period for setting the display of a display item to a low visibility display state, the low visibility display state being a display state with visibility lower than that of the high visibility display state, and

[0129] the display switching determination period setting unit sets different display switching determination periods between the high visibility display state switching determination period and the low visibility display state switching determination period for each of the plurality of display items according to the correlation. (4)

[0131] The imaging device according to (3),

[0132] wherein the display switching determination period setting unit sets the high visibility display state switching determination period to a value smaller than the value of the low visibility display state switching determination period for the display items whose correlation is above a threshold. (5)

[0134] The imaging device according to (3) or (4),

[0135] wherein, for a display item with a correlation less than a threshold value, the display switching determination period setting unit sets the display switching determination period for the high visibility display state to a value larger than that for the low visibility display state. (6)

[0137] The imaging device according to any one of (3) to (5) further includes:

[0138] a line-of-sight detection unit and an OSD display control unit,

[0139] wherein, the OSD display control unit controls the display of the display item according to whether the line-of-sight detection unit has continuously detected the user's line of sight to the display position of the display item during the display switching determination period. (7)

[0141] The imaging device according to (6),

[0142] wherein, when the line-of-sight detection unit has continuously detected the user's line of sight to the display of the display item during the high visibility display state switching determination period, the OSD display control unit changes the display of the display item to the high visibility display state. (8)

[0144] The imaging device according to (7),

[0145] wherein, after the high visibility display state switching determination period has elapsed, the OSD display control unit immediately changes the display of the display item to the high visibility display state. (9)

[0147] The imaging device according to (7),

[0148] wherein, after the high visibility display state switching determination period has elapsed, the OSD display control unit gradually changes the display of the display item to the high visibility display state. (10)

[0150] The imaging device according to (6) to (9),

[0151] wherein, when the line-of-sight detection unit has not continuously detected the user's line of sight to the display item during the low visibility display state switching determination period, the OSD display control unit changes the display of the display item to the low visibility display state. (11)

[0153] The imaging device according to (10),

[0154] wherein, after a period for determining the switching to a low visibility display state has elapsed, the OSD display control unit immediately changes the display of the display item to the low visibility display state. (12)

[0156] The imaging device according to (10),

[0157] wherein, after the period for determining the switching to the low visibility display state has elapsed, the OSD display control unit gradually changes the display of the display item to the low visibility display state. (13)

[0159] A method for controlling an imaging device, the method comprising:

[0160] By a display switching determination period setting unit, according to imaging settings related to imaging that are set, setting a display switching determination period for each of a plurality of display items displayed on a display unit. (14)

[0162] A program for causing a computer to execute a method for controlling an imaging device, the method comprising:

[0163] By a display switching determination period setting unit, according to imaging settings related to imaging that are set, setting a display switching determination period for each of a plurality of display items displayed on a display unit. (15)

[0165] The imaging device according to (6),

[0166] wherein the display of the display item is the display position of the display item.

[0167] List of reference numerals

[0168] 100 Imaging device

[0169] 101 Control unit

[0170] 101A Fixation area specifying unit

[0171] 101B Imaging setting discrimination unit

[0172] 101C Display switching determination period setting unit

[0173] 101D OSD display control unit

[0174] 114 Line-of-sight detection unit

Claims

1. An imaging device, comprising: A display switching determination period setting unit that sets a display switching determination period for each of a plurality of display items displayed on a display unit according to imaging settings related to imaging that are set. Wherein, the display switching determination period setting unit sets a display switching determination period for each of the plurality of display items according to the correlation between the imaging settings and the display items.

2. The imaging device according to claim 1, Among them, The display switching determination period includes: a high visibility display state switching determination period for setting the display of a display item to a high visibility display state, where the high visibility display state is a display state with high visibility; and a low visibility display state switching determination period for setting the display of a display item to a low visibility display state, where the low visibility display state is a display state with visibility lower than that of the high visibility display state, and The display switching determination period setting unit sets different display switching determination periods between the high visibility display state switching determination period and the low visibility display state switching determination period for each of the plurality of display items according to the correlation.

3. The imaging device according to claim 2, Among them, The display switching determination period setting unit sets the high visibility display state switching determination period to a value smaller than the value of the low visibility display state switching determination period for a display item whose correlation is above a threshold.

4. The imaging device according to claim 2, Among them, The display switching determination period setting unit sets the high visibility display state switching determination period to a value larger than the value of the low visibility display state switching determination period for a display item whose correlation is less than a threshold.

5. The imaging device according to claim 2, further comprising: A line-of-sight detection unit and an OSD display control unit, Wherein, the OSD display control unit controls the display of the display item according to whether the line-of-sight detection unit has continuously detected the user's line-of-sight to the display of the display item during the display switching determination period.

6. The imaging device according to claim 5, Among them, In a case where the line-of-sight detection unit has continuously detected the user's line-of-sight to the display position of a display item during the high visibility display state switching determination period, the OSD display control unit changes the display of the display item to the high visibility display state.

7. The imaging device according to claim 6, Among them, After passing through the high visibility display state switching determination period, the OSD display control unit immediately changes the display of the display item to the high visibility display state.

8. The imaging device according to claim 6, Among them, After passing through the high visibility display state switching determination period, the OSD display control unit gradually changes the display of the display item to the high visibility display state.

9. The imaging device according to claim 5, Among them, In a case where the line-of-sight detection unit does not continuously detect the user's line of sight on the display item during the low visibility display state switching determination period, the OSD display control unit changes the display of the display item to the low visibility display state.

10. The imaging device according to claim 9, Among them, After the low visibility display state switching determination period has elapsed, the OSD display control unit immediately changes the display of the display item to the low visibility display state.

11. The imaging device according to claim 9, Among them, After the low visibility display state switching determination period has elapsed, the OSD display control unit gradually changes the display of the display item to the low visibility display state.

12. A method for controlling an imaging device, the method comprising: By a display switching determination period setting unit, according to imaging settings related to imaging that are set, setting a display switching determination period for each of a plurality of display items displayed on a display unit, wherein the display switching determination period setting unit sets the display switching determination period for each of the plurality of display items according to the correlation between the imaging settings and the display items.

13. A program product including instructions for causing a computer to execute operations for controlling an imaging device, the operations including: By a display switching determination period setting unit, according to imaging settings related to imaging that are set, setting a display switching determination period for each of a plurality of display items displayed on a display unit, wherein the display switching determination period setting unit sets the display switching determination period for each of the plurality of display items according to the correlation between the imaging settings and the display items.

Images