Imaging apparatus and method for controlling the same

Abstract

To display a display object to be superimposed on an imaging apparatus at a high frame rate, while preventing a reduction in the visibility of the display object.SOLUTION: An imaging apparatus of the present invention has: drawing means that draws a display object; superimposition means that superimposes the drawn display object on a picked-up image; and control means that performs control to display, on a display, the picked-up image on which the display object is superimposed. When predetermined conditions are not satisfied, the drawing means draws the display object in a predetermined size, and when the predetermined conditions are satisfied, draws the display object in a size smaller than the predetermined size.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an imaging apparatus and a control method thereof. [Background technology]

[0002] A well-known function of digital cameras is the live view display function, which displays images obtained by an image sensor (captured images) on a display device in real time. As digital cameras become more sophisticated, their subject detection and tracking capabilities have improved, creating a demand for high frame rates for displaying not only live view images but also display objects superimposed on the live view images. The increasing resolution of digital camera rear displays and EVFs (Electronic View Finders) and the increasing functionality of digital cameras have led to an increase in the number of display objects displayed at one time. As a result, it has become difficult to display display objects at high frame rates.

[0003] Patent Document 1 discloses a technique for converting the coordinate system of high-resolution graphic data into the coordinate system of low-resolution graphic data, and outputting the graphic data at low resolution based on the low-resolution coordinate system.

[0004] Patent Document 2 discloses a technology for suppressing latency caused by data transmission during image capture and display. In the technology disclosed in Patent Document 2, a portion of the captured image is transmitted as a full-resolution image, another region as an image reduced to 1 / 4 times its original size, and the entire image as an image reduced to 1 / 16 times its original size, and these are transmitted in a stream format line by line in the configuration of a virtual composite image. The area of ​​the composite image is determined based on the transmission bandwidth and frame rate. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Publication No. 2017 / 061434 [Patent Document 2] Japanese Patent Application Laid-Open No. 2016-063537 Summary of the Invention [Problem to be solved by the invention]

[0006] In the technology disclosed in Patent Document 1, graphic data is output at a low resolution, so that the graphic data can be output at a high frame rate. However, the lower resolution reduces the visibility of the graphic data. In the technology disclosed in Patent Document 2, the image transmitted at a low resolution is a captured image, not a display object. Therefore, even if the technology disclosed in Patent Document 2 is used, it is not possible to display a display object at a high frame rate.

[0007] An object of the present invention is to make it possible to display a display object superimposed on an imaging device at a high frame rate while suppressing a decrease in visibility of the display object. [Means for solving the problem]

[0008] The imaging device of the present invention comprises a drawing means for drawing a display object, a superimposing means for superimposing the drawn display object on a captured image, and a control means for controlling the captured image with the superimposed display object to be displayed on a display unit, wherein the drawing means draws the display object at a predetermined size when a predetermined condition is not satisfied, and draws the display object at a size smaller than the predetermined size when the predetermined condition is satisfied. [Effects of the Invention]

[0009] According to the present invention, it is possible to display a display object superimposed on an imaging device at a high frame rate while suppressing a decrease in visibility of the display object. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is an external view of a digital camera. [Figure 2]FIG. 1 is a block diagram of a digital camera. [Figure 3] 10 is a flowchart of a shooting mode process. [Figure 4] FIG. 2 is a schematic diagram of a menu screen and the like. [Figure 5] FIG. 2 is a schematic diagram of a shooting screen and the like. [Figure 6] FIG. 2 is a schematic diagram of a hierarchical structure of an image. DETAILED DESCRIPTION OF THE INVENTION

[0011] An embodiment of the present invention will be described below: An example in which the present invention is applied to a digital camera will be described below.

[0012] As an example, consider a scene where a photograph is taken while adjusting the focus. In such a scene, a digital camera may superimpose display objects such as a detection frame, AF (autofocus) frame, or in-focus frame on the live view image (on an OSD (On Screen Display)). A detection frame is displayed to inform the user of a detected subject. An AF frame is displayed to inform the user of the position or area of ​​the subject to be focused (in focus). A focus frame is displayed to inform the user of the position or area that has been focused (in focus).

[0013] However, if the frame rate of the displayed object is slower than that of the live view image, the correct information may not be conveyed to the user. For example, the detection frame may show an area that is different from the detected subject, the focus frame may show an area that is different from the in-focus area, or the AF process may be performed to focus on an area different from the area shown by the AF frame.

[0014] These discrepancies can be reduced by lowering the resolution of the display objects and increasing the frame rate, but the reduced visibility of the display objects may prevent correct information from being conveyed to the user.

[0015] Although details will be described later, in this embodiment, by switching between executing and not executing a reduction in resolution (reduction) of a display object, it is possible to display the display object at a high frame rate while suppressing a decrease in visibility of the display object superimposed on the imaging device.

[0016] 1(A) and 1(B) are external views of a digital camera 100 as an example of an imaging device to which the present invention can be applied. Fig. 1(A) is a front perspective view of the digital camera 100, and Fig. 1(B) is a rear perspective view of the digital camera 100.

[0017] The display unit 28 is a display unit provided on the back of the digital camera 100, and displays images and various information. The touch panel 70a can detect touch operations on the display surface (touch operation surface) of the display unit 28. The outside-finder display unit 43 is a display unit provided on the top surface of the digital camera 100, and displays various setting values ​​of the digital camera 100, including the shutter speed and aperture. The shutter button 61 is an operation member for issuing shooting instructions. The mode change switch 60 is an operation member for switching between various modes. The terminal cover 40 holds a connector (not shown) for connecting the digital camera 100 to an external device. It is a protective cover.

[0018] The main electronic dial 71 is a rotary operation member that can be turned to change settings such as shutter speed and aperture. The power switch 72 is an operation member that switches the power of the digital camera 100 on and off. The sub electronic dial 73 is a rotary operation member that can be turned to move the selection frame (cursor) or advance images. The four-way key 74 is configured so that the up, down, left, and right portions can be pressed, and processing can be performed according to which portion of the four-way key 74 is pressed. The SET button 75 is a push button that is mainly used to confirm a selection item. The multi-controller (hereinafter referred to as MC) 65 can accept directional instructions in eight directions and pressing the center portion.

[0019] The movie button 76 is used to start or stop movie shooting (recording). The AE lock button 77 is a push button; by pressing the AE lock button 77 in shooting standby mode, the exposure state can be fixed. The enlarge button 78 is an operation button for switching the enlargement mode on and off in the live view display (LV display) of the shooting mode. By turning the enlargement mode on and operating the main electronic dial 71, the live view image (LV image) can be enlarged or reduced. In the playback mode, the enlargement button 78 functions as an operation button for enlarging the playback image or increasing its magnification. The playback button 79 is an operation button for switching between the shooting mode and the playback mode. Pressing the playback button 79 in the shooting mode transitions to the playback mode, and the most recent image recorded on the recording medium 200 (described below) can be displayed on the display unit 28. The menu button 81 is a push button used to issue an instruction to display a menu screen; when the menu button 81 is pressed, a menu screen on which various settings can be made is displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the four-way key 74, the SET button 75, or the MC 65. The line-of-sight confirmation button 82 is an operating member included in the operation unit 70, and is a push button that instructs the user to select or cancel a subject based on the position of the line-of-sight pointer, which will be described later. The line-of-sight confirmation button 82 is located in a position that allows it to be easily operated even when the user is looking through the viewfinder (with the eye placed in the eyepiece 16), and is located in a position that allows it to be operated with the thumb of the right hand holding the grip unit 90.

[0020] The communication terminal 10 is a communication terminal through which the digital camera 100 communicates with the lens unit 150 (described later; detachable). The eyepiece 16 is the eyepiece of an eyepiece finder (a peer-type finder), and the user can view an image displayed on an internal EVF 29 (described later; Electric View Finder) through the eyepiece 16. The eyepiece detection unit 57 is an eyepiece detection sensor that detects whether the user (photographer) has placed their eye on the eyepiece 16. The cover 202 is a cover for a slot that stores a recording medium 200 (described later). The grip unit 90 is a holding unit shaped to be easily held with the user's right hand when holding the digital camera 100. The shutter button 61 and main electronic dial 71 are positioned so that they can be operated with the index finger of the right hand when the digital camera 100 is held by gripping the grip unit 90 with the little finger, ring finger, and middle finger of the right hand. In the same state, the sub electronic dial 73 and the line-of-sight confirmation button 82 are arranged in a position that can be operated with the thumb of the right hand.

[0021] FIG. 2 is a block diagram showing the configuration of the digital camera 100. The lens unit 150 is a lens unit equipped with an interchangeable photographic lens. The lens 103 is usually composed of multiple lenses, but for simplicity's sake, FIG. 2 shows only one lens. The communication terminal 6 is a communication terminal through which the lens unit 150 communicates with the digital camera 100, and the communication terminal 10 is a communication terminal through which the digital camera 100 communicates with the lens unit 150. The lens unit 150 communicates with the system via these communication terminals 6 and 10. The lens unit 150 communicates with the system control unit 50. The lens unit 150 controls the aperture 1 via the aperture drive circuit 2 by the internal lens system control circuit 4. The lens unit 150 also adjusts the focus by displacing the lens 103 via the AF drive circuit 3 by the lens system control circuit 4.

[0022] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50.

[0023] The imaging unit 22 is an imaging element (image sensor) configured with a CCD, CMOS element, or the like that converts an optical image into an electrical signal. The imaging unit 22 may have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 23 converts the analog signal output from the imaging unit 22 into a digital signal.

[0024] The image processing unit 24 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion, etc.) on data from the A / D converter 23 or data from the memory control unit 15. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the arithmetic results obtained by the image processing unit 24. This allows for TTL (through-the-lens) type AF (autofocus) processing, AE (autoexposure) processing, EF (flash pre-flash) processing, etc. to be performed. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs TTL type AWB (auto white balance) processing based on the arithmetic results obtained.

[0025] The memory control unit 15 controls the transmission and reception of data between the A / D converter 23, the image processing unit 24, and the memory 32. The output data from the A / D converter 23 is written to the memory 32 via the image processing unit 24 and the memory control unit 15. Alternatively, the output data from the A / D converter 23 is written to the memory 32 via the memory control unit 15 without going through the image processing unit 24. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, as well as image data to be displayed on the display unit 28 and the EVF 29. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio.

[0026] The memory 32 also serves as a memory (video memory) for displaying images. The display image data written to the memory 32 is displayed on the display unit 28 or the EVF 29 via the memory control unit 15. The display unit 28 and the EVF 29 each perform display on a display device such as an LCD or an organic EL display in accordance with a signal from the memory control unit 15. A live view display (LV) can be performed by sequentially transferring and displaying data that has been A / D converted by the A / D converter 23 and stored in the memory 32 to the display unit 28 or the EVF 29. Hereinafter, an image displayed in live view display will be referred to as a live view image (LV image).

[0027] The gaze detection unit 160 (reception unit) detects the gaze of the user's eye placed in the eyepiece unit 16 as they look at the EVF 29. The gaze detection unit 160 is composed of a dichroic mirror 162, an imaging lens 163, a gaze detection sensor 164, a gaze detection circuit 165, and an infrared light emitting diode 166.

[0028] The infrared light emitting diode 166 is a light emitting element for detecting the user's line of sight within the viewfinder screen (within the display area of ​​the EVF 29), and irradiates the user's eyeball (eye) 161 with infrared light. The infrared light emitted from the infrared light emitting diode 166 is reflected by the eyeball (eye) 161, and the reflected infrared light reaches the dichroic mirror 162. The dichroic mirror 162 reflects only the infrared light and transmits visible light. The reflected infrared light, whose optical path has been changed, forms an image on the imaging surface of the line of sight detection sensor 164 via the imaging lens 163. The imaging lens 163 An optical member 63 constitutes the line-of-sight detection optical system. The line-of-sight detection sensor 164 is composed of an imaging device such as a CCD image sensor.

[0029] The line-of-sight detection sensor 164 photoelectrically converts the incident reflected infrared light into an electric signal and outputs it to the line-of-sight detection circuit 165. The line-of-sight detection circuit 165 detects the line-of-sight position of the user from the movement of the user's eyeball (eye) 161 based on the output signal from the line-of-sight detection sensor 164, and outputs the detection information to the system control unit 50.

[0030] In this embodiment, the gaze detection unit 160 detects the gaze using a method called the corneal reflex method. The corneal reflex method is a method of detecting the direction and position of the gaze from the positional relationship between the light reflected by the eyeball (eye) 161 (particularly the cornea) of the infrared light emitted from the infrared light emitting diode 166 and the pupil of the eyeball (eye) 161. Note that the method of detecting the gaze (direction and position of the gaze) is not particularly limited, and methods other than those described above may also be used. For example, a method called the scleral reflex method may be used, which utilizes the difference in light reflectance between the black and white of the eye.

[0031] Various settings of the digital camera 100 such as shutter speed and aperture are displayed on the outside viewfinder display 43 via an outside viewfinder display drive circuit 44 .

[0032] The nonvolatile memory 56 is an electrically erasable and recordable memory, such as a flash ROM. Constants, programs, etc. for the operation of the system control unit 50 are recorded in the nonvolatile memory 56. The programs referred to here are programs for executing various flowcharts described later in this embodiment.

[0033] The system control unit 50 is a control unit made up of at least one processor or circuit, and controls the entire digital camera 100. The system control unit 50 executes programs recorded in the nonvolatile memory 56 described above to realize each process of this embodiment, which will be described later. The system memory 52 is, for example, a RAM, and the system control unit 50 loads constants and variables for operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like into the system memory 52. ​​The system control unit 50 also performs display control by controlling the memory 32, the display unit 28, etc.

[0034] The system timer 53 is a timekeeping unit that measures the time used for various controls and the time of a built-in clock.

[0035] The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between powered blocks, etc., and detects whether a battery is installed, the type of battery, and the remaining battery power. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the required voltage for the required period to each unit, including the recording medium 200. The power supply unit 30 is composed of primary batteries such as alkaline batteries or lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, or Li batteries, an AC adapter, etc.

[0036] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0037] The communication unit 54 transmits and receives video signals and audio signals to and from external devices connected wirelessly or via a wired cable. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can also communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 transmits and receives images (including live view images) captured by the imaging unit 22 and images recorded on a recording medium. The image recorded in the body 200 can be transmitted, and image data and various other information can be received from external devices.

[0038] The orientation detection unit 55 detects the orientation of the digital camera 100 with respect to the direction of gravity. Based on the orientation detected by the orientation detection unit 55, it is possible to determine whether an image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the orientation detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the orientation detection unit 55. The acceleration sensor or gyro sensor of the orientation detection unit 55 can also be used to detect movement of the digital camera 100 (panning, tilting, lifting, whether the digital camera 100 is stationary, etc.).

[0039] The eyepiece detection unit 57 is an eyepiece detection sensor that detects (approach detection) whether the eye (object) 161 approaches (approach) or moves away (away from) the eyepiece 16 of the eyepiece viewfinder (hereinafter simply referred to as the "viewfinder"). The system control unit 50 switches the display unit 28 and the EVF 29 between on (display state) and off (non-display state) depending on the state detected by the eyepiece detection unit 57. More specifically, at least in a shooting standby state and when the display destination switching is automatic, when the eye is not in contact with the camera, the display is turned on as the display unit 28 and the EVF 29 is hidden. When the eye is in contact with the camera, the display is turned on as the display unit 29 and the EVF 29 is hidden. For example, an infrared proximity sensor can be used as the eyepiece detection unit 57, and it can detect the approach of an object to the eyepiece 16 of a viewfinder incorporating the EVF 29. When an object approaches, infrared light emitted from a light-emitting unit (not shown) of the eyepiece detection unit 57 is reflected by the object and received by a light-receiving unit (not shown) of the infrared proximity sensor. The amount of received infrared light can also determine the distance the object is approaching the eyepiece 16 (eyepiece distance). In this way, the eyepiece detection unit 57 performs eyepiece detection, which detects the proximity of an object to the eyepiece 16. When an object approaching within a predetermined distance from the eyepiece 16 is detected from a non-eyepiece state (non-approach state), it is detected as being in eye contact. When an object detected as approaching moves away from the eyepiece state (approach state) by more than a predetermined distance, it is detected as being away from the eye. The threshold for detecting eye contact and the threshold for detecting eye separation may be different, for example, by providing hysteresis. Furthermore, after eye contact is detected, the eyepiece remains in the eye contact state until eye separation is detected. After eye separation is detected, the eyepiece remains in the non-eye contact state until eye contact is detected. The infrared proximity sensor is just one example, and other sensors may be used for the eye proximity detection unit 57 as long as they can detect the approach of an eye or an object that can be considered as an eye proximity.

[0040] The system control unit 50 controls the line-of-sight detection unit 160 to detect the following line-of-sight states for the EVF 29. The gaze that was not directed at the EVF29 was now directed at the EVF29. In other words, gaze input has begun. - Eye gaze input is being used on the EVF29. -Your eyes must be fixed on a certain position on the EVF29. - The gaze was turned away from the EVF29, meaning that gaze input was terminated. No gaze input to the EVF29 (not looking at the EVF29).

[0041] These operation states and the position (direction) of the gaze toward the EVF 29 are notified to the system control unit 50 via the internal bus, and the system control unit 50 determines what kind of gaze input is being performed based on the notified information.

[0042] The operation unit 70 is an input unit that accepts operations from the user (user operations), and 2, the operation unit 70 includes a mode selector switch 60, a shutter button 61, a power switch 72, a touch panel 70a, etc. The operation unit 70 also includes other operation members 70b, such as a main electronic dial 71, a sub electronic dial 73, a four-way key 74, a SET button 75, a video button 76, an AE lock button 77, a magnification button 78, a playback button 79, a menu button 81, and an MC65.

[0043] The mode selector switch 60 switches the operating mode of the system control unit 50 to one of still image capture mode, video capture mode, playback mode, etc. The mode selector switch 60 allows the user to directly switch to one of these modes. Alternatively, after first switching to a list screen of capture modes with the mode selector switch 60, the user may selectively switch to one of the multiple displayed modes using another operating member. Similarly, the video capture mode may also include multiple modes.

[0044] The shutter button 61 includes a first shutter switch 62 and a second shutter switch 64. The first shutter switch 62 is turned on when the shutter button 61 is pressed halfway (a shooting preparation command) and generates a first shutter switch signal SW1. The system control unit 50 starts shooting preparation operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing in response to the first shutter switch signal SW1. The second shutter switch 64 is turned on when the shutter button 61 is pressed fully (a shooting command) and generates a second shutter switch signal SW2. The system control unit 50 starts a series of shooting processing operations in response to the second shutter switch signal SW2, from reading out a signal from the imaging unit 22 to writing the captured image to the recording medium 200 as an image file.

[0045] The touch panel 70a and the display unit 28 can be configured as an integrated unit. For example, the touch panel 70a is configured so that the light transmittance does not interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. Then, input coordinates on the touch panel 70a are associated with display coordinates on the display surface of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that allows the user to directly operate the screen displayed on the display unit 28.

[0046] The system control unit 50 can detect the following operations or states on the touch panel 70a. A finger or pen that has not been touching the touch panel 70a touches the touch panel 70a again, that is, the start of touching (hereinafter referred to as touch-down). A state in which the touch panel 70a is touched with a finger or a pen (hereinafter referred to as Touch-On). A finger or a pen is moved while touching the touch panel 70a (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 70a is released from the touch panel 70a, that is, the touch ends (hereinafter referred to as "touch-up"). A state in which nothing is touching the touch panel 70a (hereinafter referred to as Touch-Off).

[0047] When Touch Down is detected, Touch On is also detected at the same time. After Touch Down, Touch On will usually continue to be detected unless Touch Up is detected. When Touch Move is detected, Touch On is also detected at the same time. If the touch position does not move, a touch move is not detected. After it is detected that all fingers or pens that were touching have touched up, a touch off occurs.

[0048] These operations and states, as well as the coordinates of the position where the finger or pen touches the touch panel 70a, are notified to the system control unit 50 via the internal bus. The system control unit 50 then determines what kind of operation (touch operation) was performed on the touch panel 70a based on the notified information. Regarding touch-move, the direction of movement of the finger or pen moving on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on changes in the position coordinates. A slide operation is determined to have been performed when a touch-move of a predetermined distance or more is detected. An operation in which a finger is touched on the touch panel 70a, quickly moved a certain distance, and then released is called a flick. A flick is, in other words, an operation in which the finger quickly traces the touch panel 70a as if flicking it. When a touch-move of a predetermined distance or more at a predetermined speed or faster is detected and a touch-up is then detected, a flick is determined to have been performed (a flick can be determined to have followed a slide operation). Furthermore, a touch operation in which multiple points (for example, two points) are touched together (multi-touch) and the touch positions are brought closer together is called a pinch in, and a touch operation in which the touch positions are moved farther apart is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply a pinch). The touch panel 70a may be of any of a variety of touch panel types, including resistive film type, capacitive type, surface acoustic wave type, infrared type, electromagnetic induction type, image recognition type, and optical sensor type. There are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or pen to the touch panel, and either type is acceptable.

[0049] The digital camera 100 may also be provided with an audio input unit (not shown) that transmits audio obtained from a built-in microphone or an audio input device connected via an audio input terminal to the system control unit 50. In this case, the system control unit 50 selects the input audio signal as needed, performs analog-to-digital conversion, and performs level optimization processing, specific frequency reduction processing, etc. to generate an audio signal.

[0050] In this embodiment, it is possible to set whether or not to track. If the user does not specify a tracking target, the AF position is automatically set based on the automatic selection conditions. When tracking is enabled, if a human face is detected in the live view image, the face is prioritized and selected as the AF target subject. If multiple human faces are detected, one face is selected and set as the AF target subject based on priorities such as the face's size, its position close to the digital camera 100 (close side), its position close to the center of the image, or the face of a pre-registered individual. If no human face is detected, a subject other than a face is selected and set as the AF target subject based on priorities such as its proximity to the digital camera 100 (close side), its high contrast, its being a high-priority subject such as an animal or a vehicle, or its being a moving object. If the user specifies a tracking target subject, the tracking target subject is set as the AF target subject.

[0051] FIG. 3 is a flowchart showing the shooting mode processing in the digital camera 100. The shooting mode processing in FIG. 3 is realized by the system control unit 50 expanding a program stored in the non-volatile memory 56 into the system memory 52 and executing it. For example, when the shooting mode is set, the system control unit 50 starts the shooting mode processing in FIG. 3. Note that FIG. 3 omits several operations such as the shooting preparation operation and the shooting processing operation. FIGS. 4(A) and 4(B) are schematic diagrams of menu screens and the like for changing various settings of the digital camera 100, and FIGS. 5(A) to 5(E) are schematic diagrams of the shooting screen and the like of the digital camera 100. FIG. 3 shows processing related to display on the display unit 28 or EVF 29 in the shooting mode. In this embodiment, as explained above, the display unit 28 or EVF 29 is displayed in response to eye proximity detection. 3 is executed for the display unit 28 or the EVF 29 whose display is set to ON.

[0052] In S301, the system control unit 50 initializes flags, control variables, and the like.

[0053] In S302, the system control unit 50 displays a live view image (captured image) obtained using the imaging unit 22 on the display unit 28 or the EVF 29. FIG.

[0054] In S303, the system control unit 50 acquires the setting value of the display frame rate (display mode) set using the operation unit 70. When the user selects the display frame rate setting item 404 on the menu screen shown in FIG. 4A, the display screen transitions from the menu screen of FIG. 4A to the display frame rate setting screen of FIG. 4B. The user can use the display frame rate setting screen to select the power saving priority item 405 or the smoothness priority item 406. The display frame rate (display mode) of the selected item is set. The smoothness priority display frame rate (display frame rate) is higher than the power saving priority display frame rate. In this embodiment, the display frame rate when the smoothness priority item 406 is set is 100 fps, and the display frame rate when the power saving priority item 405 is set is 50 fps.

[0055] In S304, the system control unit 50 determines whether the set display frame rate (display mode) prioritizes smoothness or not, based on the setting value acquired in S303. If smoothness is prioritized, the process proceeds to S309; ​​otherwise, the process proceeds to S305.

[0056] The number of settable display modes (display frame rates) is not particularly limited and may be more than two. Instead of a display mode, a numerical value for the display frame rate, such as 50 fps or 100 fps, may be input and set. In this case, in S304, it may be determined whether the set display frame rate is equal to or greater than a threshold. If the display frame rate is equal to or greater than the threshold, the process may proceed to S309; ​​if not, the process may proceed to S305.

[0057] In S305, the system control unit 50 draws a display object at a predetermined size in the memory 32 or the system memory 52. ​​The system control unit 50 sets a drawing buffer in the memory 32 or the system memory 52 at a size that is a predetermined magnification of the resolution of the display unit (the display unit 28 or the EVF 29). In this embodiment, the system control unit 50 sets a drawing buffer at a size that is 1 times the resolution of the display unit, that is, the same size. The system control unit 50 then draws the display object in the set drawing buffer. In this embodiment, the display unit 28 has a resolution of 1080 × 720, and the EVF 29 has a resolution of 2560 × 1920. Therefore, when displaying on the display unit 28, the system control unit 50 sets a drawing buffer at a size of 1080 × 720, which corresponds to the resolution of the display unit 28, and draws the display object in the drawing buffer. When displaying on the EVF 29, the system control unit 50 sets a drawing buffer at a size of 2560 × 1920, which corresponds to the resolution of the display unit 28, and draws the display object in the drawing buffer.

[0058] In S306, the system control unit 50 superimposes the display object drawn in the drawing buffer on the live view image. Fig. 5(B) shows the shooting screen in a shooting standby state where a signal from the shutter button 61 is not detected. In Fig. 5(B), a shooting information icon 502 and a detection frame 503 are superimposed on the live view image 501 as display objects. The shooting information icon 502 indicates various setting values ​​related to shooting processing. The detection frame 503 , a frame that is displayed at the position where the main subject is detected from the live view image 501.

[0059] In S307, the system control unit 50 displays on the display unit 28 or the EVF 29 the photographed screen (the live view image on which the display object is superimposed) obtained in S306.

[0060] In S308, the system control unit 50 determines whether an instruction to end the shooting mode process has been issued. If it is determined that an instruction to end the shooting mode process has been issued, the system control unit 50 terminates the shooting mode process; if not, the system control unit 50 proceeds to S302. For example, if the mode selector switch 60 has been operated, that is, if an instruction to switch to another operating mode has been issued, the system control unit 50 determines that an instruction to end the shooting mode process has been issued. Also, if the power switch 72 has been operated, that is, if an instruction to power off the digital camera 100 has been issued, the system control unit 50 determines that an instruction to end the shooting mode process has been issued.

[0061] In S309, the system control unit 50 determines whether the digital camera 100 is focusing, shooting, recording, etc. (non-shooting standby state). If it is not in the shooting standby state, the process proceeds to S310, and if not (if it is in the shooting standby state), the process proceeds to S311.

[0062] For example, the system control unit 50 determines that the camera is in focus when it detects the first shutter switch signal SW1 from the shutter button 61, and determines that shooting is in progress when it detects the second shutter switch signal SW2. Furthermore, when the system control unit 50 detects that the video button 76 has been pressed, it determines that video recording is in progress until the video button 76 is pressed again.

[0063] FIG. 5C shows the shooting screen when the first shutter switch signal SW1 and the second shutter switch signal SW2 are detected (focusing and shooting). When the system control unit 50 detects the first shutter switch signal SW1, it performs AF processing to focus at the position of the detection frame 503 shown in FIG. 5B and switches the detection frame 503 to the in-focus frame 504. The system control unit 50 then detects the second shutter switch signal SW2 and performs shooting processing, while displaying a shutter frame 505 along the edge of the shooting screen for a predetermined period of time. The user can also continuously capture still images (continuous shooting) by continuing to press the shutter button 61. In this case, the system control unit 50 uses the system timer 53 to control the display of the shutter frame 505 so that the shutter frame 505 is displayed and hidden at predetermined intervals. The in-focus frame 504 and the shutter frame 505 are types of display objects, and are drawn in the drawing buffer in S305 or S315 (described later) and superimposed on the live view image in S306.

[0064] In S310, the system control unit 50 changes (reduces) the display frame rate. For example, even if smoothness is set as the priority, the system control unit 50 performs processing that prioritizes power saving. Note that the method for changing the display frame rate is not limited to this, and for example, drawing commands that are notified at a predetermined frequency may be thinned out at a fixed rate.

[0065] In S311, the system control unit 50 determines whether the EVF 29 is being used (whether the shooting screen is displayed on the EVF 29). If the EVF 29 is being used, the process proceeds to S312; if not, the process proceeds to S310. Note that in S311, the process may determine whether the display unit with the highest resolution is being used, or whether a display unit with a resolution equal to or greater than a threshold is being used. Therefore, the object of the determination is not limited to the rear display or the EVF, but may also be an externally connected monitor. If the display unit with the highest resolution or a display unit with a resolution equal to or greater than a threshold is being used, the process may proceed to S312; if not, the process may proceed to S310.

[0066] In S312, the system control unit 50 performs AF to keep the focus on a moving subject. The system controller 50 determines whether or not servo AF is set. The user can select one-shot AF or servo AF as the AF operation by selecting the AF operation item 401 on the menu screen shown in FIG. 4(A) (the AF operation can be switched between one-shot AF and servo AF). One-shot AF is an AF operation that fixes focus on a stationary subject, while servo AF is an AF operation that maintains focus on a moving subject. In S312, the system controller 50 determines whether or not servo AF is set. If servo AF is set, the process proceeds to S313; if not, the process proceeds to S310.

[0067] For example, a user may select one-shot AF when photographing a stationary subject, and select servo AF when photographing a moving subject (or a subject that may move). When one-shot AF is set, focus is maintained at the distance of the initially detected subject while the shutter button 61 is half-pressed. When servo AF is set, focus is maintained on the subject according to the position and distance of the detected subject while the shutter button 61 is half-pressed.

[0068] In S313, the system control unit 50 determines whether or not the system is in a tracking state in which a subject is detected from a live view image and is being tracked. If the system is in a tracking state, the system proceeds to S314, and if not, the system proceeds to S310.

[0069] The user can select whether or not to perform tracking by selecting the tracking item 402 on the menu screen shown in Fig. 4(A). If the setting is such that tracking is not performed, the system control unit 50 determines that the system is not in a tracking state. If the setting is such that tracking is performed, the system control unit 50 determines that the system is in a tracking state if a specific subject to be tracked is detected, and determines that the system is not in a tracking state if a specific subject is not detected.

[0070] In S313, it may be determined whether or not tracking is set. If tracking is set, the process may proceed to S314, and if not, the process may proceed to S310.

[0071] FIG. 5(D) shows the shooting screen when the system is not in tracking mode and when it has detected a first shutter switch signal SW1 from the shutter button 61. When the system control unit 50 detects the first shutter switch signal SW1, it performs AF processing and displays a multi-point frame 506 (a tiled arrangement of multiple frames of the same shape) in the focused area. When the system is in tracking mode, a frame (detection frame 503 in FIG. 5(B) or in-focus frame 504 in FIG. 5(C)) is displayed that surrounds the specific subject being tracked. These frames are a type of display object, and are drawn in the drawing buffer in S305 or S315 (described later) and superimposed on the live view image in S306.

[0072] In S314, the system control unit 50 determines whether or not to display a specific display object. If the specific display object is to be displayed, the process proceeds to S315; if not, the process proceeds to S310. A specific display object is a display object whose display quality does not deteriorate (deterioration in display quality is small) even when enlarged. For example, a display object of vector data is a specific display object. A display object made up of only horizontal or vertical straight lines is a specific display object. A display object that is not a specific display object is a display object whose display quality deteriorates significantly when enlarged, for example, due to the occurrence of jaggies. For example, a display object that includes curved lines or diagonal lines is not a specific display object. A display object of raster data may not be a specific display object even if it is a display object made up of only horizontal or vertical straight lines. A display object that includes curved lines or diagonal lines is a display object of vector data, but it may not be a specific display object. The object may not be a particular display object.

[0073] FIG. 6 is a schematic diagram showing the hierarchical structure of multiple images including live view images and display objects. In this embodiment, a first drawing buffer and a second drawing buffer are provided as drawing buffers for drawing display objects. Layer 601 is the layer of live view images and is the lowest layer. Layer 602 is the layer of display objects drawn in the first drawing buffer. In the first drawing buffer, shooting information icons indicating various setting values ​​related to shooting processing are drawn. Layer 603 is the layer of display objects drawn in the second drawing buffer. In the second drawing buffer, display objects whose display position and display / hide status change frequently, such as detection frames, tracking frames, AF frames, focus frames, multi-point frames, shutter frames, and gaze pointers, are drawn.

[0074] The user can select whether or not to display the gaze pointer by selecting the gaze pointer display item 403 on the menu screen shown in Fig. 4(A). If the system control unit 50 is set to not display the gaze pointer, it does not display the gaze pointer. If the system control unit 50 is set to display the gaze pointer, it displays the gaze pointer if the user's gaze position is detected in eye-close mode, and does not display the gaze pointer otherwise.

[0075] FIG. 5(E) shows the shooting screen when the setting to display the gaze pointer is enabled and the first shutter switch signal SW1 from the shutter button 61 is detected. The system control unit 50 displays the gaze pointer 507 at the detected position of the user's gaze. Then, when the system control unit 50 detects the first shutter switch signal SW1, it performs AF processing to focus on the subject displayed near the gaze pointer 507 and displays a focus frame 504 surrounding the subject. The gaze pointer 507 is assumed to be a display object of raster data including a curve. Therefore, if the gaze pointer 507 is to be displayed, the process proceeds to S310. The gaze pointer 507 is then drawn in the drawing buffer in S305 and superimposed on the live view image in S306.

[0076] In S315, the system control unit 50 draws a display object in the memory 32 or the system memory 52 at a size smaller than a predetermined size. The system control unit 50 sets a drawing buffer in the memory 32 or the system memory 52 and draws the display object in the set drawing buffer. In this embodiment, the system control unit 50 sets the first drawing buffer at a size that is 1x the resolution of the display unit to be displayed, i.e., the EVF 29, and draws the display object in that drawing buffer. In contrast, the system control unit 50 sets the second drawing buffer at a size that is 1 / 2 the resolution of the EVF 29 and draws the display object in that drawing buffer. Because the second drawing buffer is set at a size smaller than the drawing buffer set in S305, in S315 the system control unit 50 draws the display object in the second drawing buffer at a size smaller than that set in S305. Note that the number of drawing buffers for drawing display objects is not particularly limited and may be one or three or more. The ratio of the size of the drawing buffer to the display resolution is also not particularly limited.

[0077] In S316, the system control unit 50 enlarges the display object drawn in S315 to a predetermined size (a size corresponding to the resolution of the EVF 29 as the display target). In this embodiment, the display object in the first drawing buffer is not enlarged, but the display object in the second drawing buffer is enlarged by two times. Note that the enlargement algorithm is not particularly limited, and for example, nearest neighbor interpolation or linear interpolation may be used.

[0078] Note that if the predetermined condition for displaying the display object in a small size is a plurality of conditions (S304 In the above example, six conditions (S301, S302, S303, S304, S305, S306, S307, S308, S309, S311 to S314) are included, but the number of conditions may be more or less than six, or may be just one. The order of the multiple determinations corresponding to the multiple conditions is not particularly limited. The predetermined condition may include a condition that the acceleration of the digital camera 100 detected by the orientation detection unit 55 is equal to or greater than a threshold. For example, between S314 and S315, the system control unit 50 may determine whether the acceleration of the digital camera 100 is equal to or greater than a threshold. If the acceleration is equal to or greater than the threshold, the process may proceed to S315, and if not, the process may proceed to S310.

[0079] In addition, although it has been described that a display object is drawn at a predetermined size when at least one of a plurality of conditions is not satisfied, and is drawn at a size smaller than the predetermined size when all of the plurality of conditions are satisfied, this is not limiting. For example, a display object may be drawn at a predetermined size when all of the plurality of conditions are not satisfied, and is drawn at a size smaller than the predetermined size when at least one of the plurality of conditions is satisfied. A display object may be drawn at a size smaller than the predetermined size when a predetermined number or more of conditions are satisfied, and is drawn at the predetermined size otherwise.

[0080] As described above, according to this embodiment, when a predetermined condition is not satisfied, a display object is drawn at a predetermined size, and when the predetermined condition is satisfied, the display object is drawn at a size smaller than the predetermined size. By drawing the display object at a predetermined size, it is possible to suppress a decrease in visibility of the display object. Furthermore, by drawing the display object at a size smaller than the predetermined size, it is possible to display the display object at a high frame rate. In this way, according to this embodiment, it is possible to display the display object at a high frame rate while suppressing a decrease in visibility of the display object superimposed on the imaging device.

[0081] The various controls described above as being performed by the system control unit 50 may or may not be performed by a single piece of hardware (e.g., a processor or circuit). The entire device may be controlled by multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) sharing the processing.

[0082] The above processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Dedicated processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0083] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0084] Furthermore, in the above-described embodiment, the present invention has been described as being applied to a digital camera, but this is not limited to this example and the present invention can also be applied to other imaging devices such as smartphones and tablet terminals.

[0085] <Other embodiments> The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program, or by a circuit that realizes one or more functions.

[0086] The disclosure of this embodiment includes the following configuration, method, program, and medium. (Configuration 1) drawing means for drawing a display object; a superimposing means for superimposing the drawn display object on the captured image; a control means for controlling the captured image on which the display object is superimposed to be displayed on a display unit; and The drawing means draws the display object at a predetermined size when a predetermined condition is not satisfied, and draws the display object at a size smaller than the predetermined size when the predetermined condition is satisfied. An imaging device characterized by: (Configuration 2) The superimposing means enlarges the drawn display object to the predetermined size and superimposes it on the captured image when the predetermined condition is satisfied. 2. The imaging device according to claim 1, (Configuration 3) Any one of a plurality of display modes including a first mode and a second mode having a display frame rate higher than that of the first mode can be set, The predetermined condition includes a condition that the second mode is set. 3. The imaging device according to configuration 1 or 2. (Configuration 4) The predetermined condition includes a condition that the frame rate of the display is equal to or higher than a threshold value. 4. The imaging device according to any one of configurations 1 to 3. (Configuration 5) The predetermined conditions include a condition that an EVF (Electric View Finder) is used. 5. The imaging device according to any one of configurations 1 to 4. (Configuration 6) The predetermined condition includes a condition that a display unit having a resolution equal to or greater than a threshold is used. 6. The imaging device according to any one of configurations 1 to 5, wherein: (Configuration 7) The predetermined conditions include a condition that the camera is focusing, taking a picture, or recording a video. 7. The imaging device according to any one of configurations 1 to 6, wherein: (Configuration 8) The predetermined conditions include a condition that an AF operation for continuously focusing on a moving subject is set. 8. The imaging device according to any one of configurations 1 to 7, wherein: (Configuration 9) The predetermined condition includes a condition that the subject is in a tracking state in which the subject is detected and tracked. 9. The imaging device according to any one of configurations 1 to 8. (Configuration 10) further comprising a detection means for detecting the acceleration of the imaging device; The predetermined condition includes a condition that the acceleration is equal to or greater than a threshold value. 10. The imaging device according to any one of configurations 1 to 9, wherein: (Configuration 11) The predetermined condition includes a condition that the display object is made up of only horizontal or vertical straight lines. 11. The imaging device according to any one of configurations 1 to 10. (Configuration 12) the predetermined condition includes a plurality of conditions, The drawing means draws the display object at the predetermined size when at least one of the plurality of conditions is not satisfied, and draws the display object at a size smaller than the predetermined size when all of the plurality of conditions are satisfied. 12. The imaging device according to any one of configurations 1 to 11, wherein: (method) a drawing step of drawing a display object; a superimposing step of superimposing the drawn display object on the captured image; a control step of controlling the captured image on which the display object is superimposed to be displayed on a display unit; and In the drawing step, the display object is drawn at a predetermined size when a predetermined condition is not satisfied, and the display object is drawn at a size smaller than the predetermined size when the predetermined condition is satisfied. 10. A method for controlling an imaging device, comprising: (program) 13. A program for causing a computer to function as each means of the imaging device according to any one of configurations 1 to 12. (medium) 13. A computer-readable storage medium storing a program for causing a computer to function as each means of the imaging device according to any one of configurations 1 to 12. [Explanation of symbols]

[0087] 100: Digital camera 50: System control unit

Claims

1. drawing means for drawing a display object; a superimposing means for superimposing the drawn display object on the captured image; a control means for controlling the captured image on which the display object is superimposed to be displayed on a display unit; and The drawing means draws the display object at a predetermined size when a predetermined condition is not satisfied, and draws the display object at a size smaller than the predetermined size when the predetermined condition is satisfied. An imaging device characterized by:

2. The superimposing means enlarges the drawn display object to the predetermined size and superimposes it on the captured image when the predetermined condition is satisfied.

2. The imaging device according to claim 1.

3. Any one of a plurality of display modes including a first mode and a second mode having a display frame rate higher than that of the first mode can be set, The predetermined condition includes a condition that the second mode is set.

2. The imaging device according to claim 1.

4. The predetermined condition includes a condition that the frame rate of the display is equal to or higher than a threshold value.

2. The imaging device according to claim 1.

5. The predetermined conditions include a condition that an EVF (Electronic View Finder) is used.

2. The imaging device according to claim 1.

6. The predetermined condition includes a condition that a display unit having a resolution equal to or greater than a threshold is used.

2. The imaging device according to claim 1.

7. The predetermined conditions include a condition that the camera is focusing, taking a picture, or recording a video.

2. The imaging device according to claim 1.

8. The predetermined conditions include a condition that an AF operation that keeps the focus on a moving subject is set.

2. The imaging device according to claim 1.

9. The predetermined condition includes a condition that the subject is in a tracking state in which the subject is detected and tracked.

2. The imaging device according to claim 1.

10. further comprising a detection means for detecting the acceleration of the imaging device; The predetermined condition includes a condition that the acceleration is equal to or greater than a threshold value.

2. The imaging device according to claim 1.

11. The predetermined condition includes a condition that the display object is made up of only horizontal or vertical straight lines.

2. The imaging device according to claim 1.

12. the predetermined condition includes a plurality of conditions, The drawing means draws the display object at the predetermined size when at least one of the plurality of conditions is not satisfied, and draws the display object at a size smaller than the predetermined size when all of the plurality of conditions are satisfied.

2. The imaging device according to claim 1.

13. a drawing step of drawing a display object; a superimposing step of superimposing the drawn display object on the captured image; a control step of controlling the captured image on which the display object is superimposed to be displayed on a display unit; and In the drawing step, the display object is drawn at a predetermined size when a predetermined condition is not satisfied, and the display object is drawn at a size smaller than the predetermined size when the predetermined condition is satisfied.

10. A method for controlling an imaging device, comprising:

14. A program for causing a computer to function as each of the means of the imaging device according to any one of claims 1 to 12.

15. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the imaging device according to any one of claims 1 to 12.

Images