Imaging device

Abstract

To make it easy for a user to compose a composition such that a main subject is stationary at a position desired by the user.SOLUTION: An electronic apparatus according to the present invention includes reception means that can accept an operation to change the position of a specific area set in a part of a captured image, and control means that controls the captured image to be displayed in a live view, and performs control to display a first indicator indicating the degree of the blur with respect to a reference position with a position on a straight line passing through the center of the specific area set as the reference position at which the captured image is recorded in a state where a main subject in the specific area does not blur in a direction perpendicular to the straight line.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an electronic device, and particularly to a technique for assisting in panning shooting.

Background Art

[0002] There is panning shooting as a method of shooting an image (still image) in which the sense of speed of a moving subject is expressed. In panning shooting, shooting is performed at a shutter speed slower than normal while chasing the subject (moving object), and an image in which the background moves and the subject is stationary (an image in which the background is blurred and the subject is not blurred) is obtained. For example, the user obtains an image as described above by shooting while moving the camera (while panning) in accordance with the movement of the subject. At this time, the shutter speed is adjusted to be slower than normal based on the moving speed of the subject (the exposure time is adjusted to be longer than normal based on the moving speed of the subject). However, if there is a difference between the moving speed of the subject and the moving speed of the camera (panning speed) by the user, an image in which not only the background but also the subject is blurred is obtained.

[0003] Patent Document 1 discloses detecting the movement (panning) of an imaging device, detecting a motion vector of a subject from a video signal obtained by the imaging device during panning, and displaying a first index indicating the panning direction and a second index indicating the moving direction of the subject.

[0004] Patent Document 2 discloses calculating an angular acceleration from the angular velocity of a camera and executing an exposure operation when the angular velocity and the angular acceleration satisfy predetermined conditions.

Prior Art Documents

[0006] However, with prior art, including the techniques disclosed in Patent Documents 1 and 2, users cannot easily compose a shot in which the main subject is stationary at their desired position.

[0007] The present invention aims to provide a technology that makes it easy for users to create compositions in which the main subject is stationary at their desired position. [Means for solving the problem]

[0008] The electronic device of the present invention is characterized by having a receiving means capable of receiving an operation to change the position of a specific area set in a part of an image that has been captured, and a control means that controls the display of the captured image in live view, and controls the display of a first indicator that shows the degree of blur in relation to the reference position, with the position on a straight line passing through the center of the specific area being used as a reference position for recording the captured image in a state where there is no blur in the direction perpendicular to the straight line for the main subject in the specific area. [Effects of the Invention]

[0009] According to the present invention, users can easily create compositions in which the main subject is stationary at their desired position. [Brief explanation of the drawing]

[0010] [Figure 1] This is an external view of the Digital Camera 100. [Figure 2] This is a block diagram of the digital camera 100. [Figure 3] This is a flowchart of the shooting mode processing according to the first embodiment. [Figure 4] This is a flowchart of the indicator display process according to the first embodiment. [Figure 5]This figure shows an example of the indicator display according to the first embodiment. [Figure 6] This figure shows an example of the indicator display according to the second embodiment. [Figure 7] This is a flowchart of the shooting mode processing according to the second embodiment. [Figure 8] This is a flowchart of the setup process according to the third embodiment. [Modes for carrying out the invention]

[0011] <External view of Digital Camera 100> Preferred embodiments of the present invention will be described below with reference to the drawings. Figures 1(a) and 1(b) show an external view of a digital camera 100 as an example of a device to which the present invention can be applied. Figure 1(a) is a front perspective view of the digital camera 100, and Figure 1(b) is a rear perspective view of the digital camera 100.

[0012] The display unit 28 is a display unit located on the back of the digital camera 100 and displays images and various information. The touch panel 70a can detect touch operations on the display surface (touch operation surface) of the display unit 28. The viewfinder-external display unit 43 is a display unit located on the top surface of the digital camera 100 and displays various settings of the digital camera 100, including shutter speed and aperture. The shutter button 61 is an operating member for giving shooting instructions. The mode selector switch 60 is an operating member for switching between various modes. The terminal cover 40 is a cover that protects the connector (not shown) for connecting the digital camera 100 to an external device using a connecting cable, etc.

[0013] The main electronic dial 71 is a rotary control element, and by rotating it, settings such as shutter speed and aperture can be changed. The power switch 72 is an operating element that switches the power of the digital camera 100 ON and OFF. The sub electronic dial 73 is a rotary control element, and by rotating it, the selection frame (cursor) can be moved and images can be advanced. The four-way key 74 is configured so that the up, down, left, and right parts can be pressed, and processing can be performed according to the part of the four-way key 74 that is pressed. The SET button 75 is a push button and is mainly used to confirm selection items.

[0014] The video button 76 is used to instruct the start and stop of video recording. The AE lock button 77 is a push button, and by pressing the AE lock button 77 in shooting standby mode, the exposure state can be fixed. The zoom button 78 is an operation button for switching the zoom mode ON and OFF in the live view display (LV display) in shooting mode. By turning the zoom mode ON and then operating the main electronic dial 71, the live view image (LV image) can be enlarged or reduced. In playback mode, the zoom button 78 functions as an operation button for enlarging the playback image or increasing its magnification. The playback button 79 is an operation button for switching between shooting mode and playback mode. By pressing the playback button 79 in shooting mode, the camera switches to playback mode, and the latest image among the images recorded on the recording medium 200 (described later) can be displayed on the display unit 28. The menu button 81 is a push button used to instruct the display of the menu screen, and when the menu button 81 is pressed, a menu screen where various settings can be made is displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the four-way key 74, and the SET button 75.

[0015] The Touch Bar 82 (Multifunction Bar: M-Fn Bar) is a line-shaped touch operation component (line touch sensor) capable of accepting touch operations. -82 is arranged at a position where it can be touched (touched) by the thumb of the right hand holding the grip portion 90 in a normal gripping manner (the gripping manner recommended by the manufacturer). The touch bar 82 is a reception portion that can receive a tap operation (an operation of touching and releasing without moving within a predetermined period) on the touch bar 82, a slide operation to the left and right (an operation of moving the touch position while keeping the touch after touching), and the like. The touch bar 82 is an operation member different from the touch panel 70a and does not have a display function.

[0016] The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens unit 150 (described later; detachable). The eyepiece portion 16 is an eyepiece portion of the viewfinder 17 (a peeping type finder), and the user can visually recognize the image displayed on the internal EVF 29 (described later) through the eyepiece portion 16. The eyepiece detection unit 57 is an eyepiece detection sensor that detects whether or not a user (photographer) is looking into the eyepiece portion 16.

[0017] The lid 202 is a lid of a slot for storing the recording medium 200 (described later). The grip portion 90 is a holding portion having a shape that is easy to hold with the right hand when the user holds the digital camera 100. With the grip portion 90 held by the little finger, ring finger, and middle finger of the right hand and the digital camera 100 held, the shutter button 61 and the main electronic dial 71 are arranged at positions that can be operated by the index finger of the right hand. Also, in the same state, the sub-electronic dial 73 and the touch bar 82 are arranged at positions that can be operated by the thumb of the right hand. The thumb rest portion 91 (thumb standby position) is a grip member provided at a place on the back side of the digital camera 100 where it is easy to place the thumb of the right hand holding the grip portion 90 in a state where no operation member is operated. The thumb rest portion 91 is composed of a rubber member or the like for enhancing the holding force (grip feeling).

[0018] <Configuration Block Diagram of Digital Camera 100> Figure 2 is a block diagram showing a configuration example of the digital camera 100. The lens unit 150 is a lens unit equipped with an interchangeable photographing lens. The lens 103 is usually composed of a plurality of lenses, but in Figure 2, it is simply shown as a single lens for simplicity. The communication terminal 6 is a communication terminal for the lens unit 150 to communicate with the digital camera 100 side, and the communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens unit 150 side. The lens unit 150 communicates with the system control unit 50 via these communication terminals 6 and 10. Then, the lens unit 150 controls the aperture 1 via the aperture drive circuit 2 by the internal lens system control circuit 4. Also, the lens unit 150 focuses by displacing the position of the lens 103 via the AF drive circuit 3 by the lens system control circuit 4.

[0019] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50.

[0020] The imaging unit 22 is an imaging device composed of a CCD, a CMOS element, etc. that converts an optical image into an electrical signal. The imaging unit 22 may have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 23 converts the analog signal output from the imaging unit 22 into a digital signal.

[0021] The image processing unit 24 performs predetermined processing (such as pixel interpolation, resizing processing such as reduction, color conversion processing, etc.) on the data from the A / D converter 23 or the data from the memory control unit 15. Also, the image processing unit 24 performs predetermined arithmetic processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the arithmetic result obtained by the image processing unit 24. As a result, TTL (through-the-lens) type AF (autofocus) processing, AE (automatic exposure) processing, EF (flash pre-emission) processing, etc. are performed. The image processing unit 24 further performs predetermined arithmetic processing using the captured image data, and on the obtained arithmetic result Based on this, TTL-based AWB (Auto White Balance) processing is performed.

[0022] The output data from the A / D converter 23 is written to the memory 32 via the image processing unit 24 and the memory control unit 15. Alternatively, the output data from the A / D converter 23 is written to the memory 32 via the memory control unit 15 without going through the image processing unit 24. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, as well as image data for display on the display unit 28 and EVF 29. The memory 32 has sufficient storage capacity to store a predetermined number of still images, a predetermined amount of video footage, and audio.

[0023] Furthermore, memory 32 also serves as memory for image display (video memory). The D / A converter 19 converts the image display data stored in memory 32 into analog signals and supplies them to the display unit 28 and EVF 29. In this way, the display image data written to memory 32 is displayed by the display unit 28 and EVF 29 via the D / A converter 19. The display unit 28 and EVF 29 each display on a display device such as an LCD or organic EL according to the analog signal from the D / A converter 19. By converting the digital signal that has been A / D converted by the A / D converter 23 and stored in memory 32 into an analog signal in the D / A converter 19 and sequentially transferring it to the display unit 28 or EVF 29 for display, live view display (LV) can be performed. Hereinafter, the image displayed in live view display will be referred to as a live view image (LV image).

[0024] The external viewfinder display unit 43 displays various camera settings, including shutter speed and aperture, via the external viewfinder display unit drive circuit 44.

[0025] The non-volatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM. Constants for the operation of the system control unit 50, programs, etc., are stored in the non-volatile memory 56. The program referred to here is a program for executing various flowcharts in the embodiment described later.

[0026] The system control unit 50 is a control unit consisting of at least one processor or circuit, and controls the entire digital camera 100. The system control unit 50 implements each of the embodiments described later by executing the program recorded in the non-volatile memory 56. The system memory 52 is, for example, RAM, and the system control unit 50 loads constants, variables, and programs read from the non-volatile memory 56 into the system memory 52 for the operation of the system control unit 50. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 19, the display unit 28, etc.

[0027] The system timer 53 is a timekeeping unit that measures the time used for various controls and the time of the built-in clock.

[0028] The power control unit 80 consists of a battery detection circuit, a DC-DC converter, a switch circuit for switching which blocks are energized, and detects whether a battery is installed, the type of battery, and the remaining battery level. The power control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, supplying the necessary voltage to each part, including the recording medium 200, for the required period. The power supply unit 30 consists of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, and Li batteries, and an AC adapter.

[0029] The recording medium I / F18 is an interface to the recording medium 200, such as a memory card or hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of semiconductor memory, magnetic disks, etc.

[0030] The communication unit 54 transmits and receives video and audio signals to and from external devices connected wirelessly or via wired cables. The communication unit 54 can also connect to wireless LAN (Local Area Network) and the internet. Furthermore, the communication unit 54 can communicate with external devices using Bluetooth® and Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) captured by the imaging unit 22 and images recorded on the recording medium 200, and can receive image data and other various information from external devices.

[0031] The attitude detection unit 55 detects the orientation of the digital camera 100 relative to the direction of gravity. Based on the orientation detected by the attitude detection unit 55, it is possible to determine whether the image captured by the imaging unit 22 was taken with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the attitude detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate the image before recording. An acceleration sensor or gyro sensor can be used as the attitude detection unit 55. It is also possible to detect the movement of the digital camera 100 (pan, tilt, lift, whether it is stationary or not, etc.) using the acceleration sensor or gyro sensor in the attitude detection unit 55.

[0032] The eyepiece detection unit 57 is an eyepiece detection sensor that detects the approach (eye-to-eye contact) and retraction (eye-away) of an eye (object) to the eyepiece section 16 of the eyepiece viewfinder 17 (hereinafter simply referred to as "viewfinder"). The system control unit 50 switches the display (display state) / hidden (hidden state) of the display unit 28 and the EVF 29 according to the state detected by the eyepiece detection unit 57. More specifically, at least in the shooting standby state and when the display destination switching is automatic, when not using an eyepiece, the display destination is set to the display unit 28 and the display is turned on, and the EVF 29 is hidden. When using an eyepiece, the display destination is set to the EVF 29 and the display is turned on, and the display unit 28 is hidden. As the eyepiece detection unit 57, for example, an infrared proximity sensor can be used to detect the approach of any object to the eyepiece section 16 of the viewfinder 17 which has a built-in EVF 29. When an object approaches, infrared light emitted from the light-emitting unit (not shown) of the eyepiece detection unit 57 is reflected by the object and received by the light-receiving unit (not shown) of the infrared proximity sensor. The amount of infrared light received allows for the determination of how close the object is to the eyepiece (eyepiece distance). In this way, the eyepiece detection unit 57 performs eyepiece detection to detect the proximity distance of an object to the eyepiece 16. When an object is detected approaching the eyepiece 16 within a predetermined distance from a non-eyepiece state (non-approach state), it is detected as eyepiece use. When the object that was detected approaching moves beyond a predetermined distance from an eyepiece state (approach state), it is detected as eye-seated. The threshold for detecting eyepiece use and the threshold for detecting eye-seated eye-seating may be different, for example, by providing hysteresis. After eyepiece use is detected, the eyepiece remains in the eyepiece state until eye-seated eye-seating is detected. After eye-seated eye-seating is detected, the eyepiece remains in the non-eyepiece state until eyepiece use is detected again. Note that the infrared proximity sensor is just one example; the eyepiece detection unit 57 may use any other sensor that can detect the approach of an eye or object that can be considered an eyepiece.

[0033] The operation unit 70 is an input unit that receives user input (user operation) and is used to input various operation instructions to the system control unit 50. As shown in Figure 2, the operation unit 70 includes a mode switching switch 60, a shutter button 61, a power switch 72, a touch panel 70a, a touch bar 82, etc. The operation unit 70 also includes other operating members 70b such as a main electronic dial 71, a sub electronic dial 73, a four-way key 74, a SET button 75, a video button 76, an AE lock button 77, a zoom button 78, a playback button 79, a menu button 81, etc.

[0034] The mode switching switch 60 sets the operating mode of the system control unit 50 to still image shooting mode, and Switch to one of the following modes: still image shooting mode, playback mode, etc. The modes included in still image shooting mode are auto shooting mode, auto scene detection mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide shooting settings for different shooting scenes. The user can directly switch to any of these modes using the mode switch 60. Alternatively, the user can switch to a list of shooting modes using the mode switch 60, and then selectively switch to one of the displayed modes using other operating components. Similarly, the video shooting mode may also include multiple modes.

[0035] The shutter button 61 is equipped with a first shutter switch 62 and a second shutter switch 64. The first shutter switch 62 turns ON during the operation of the shutter button 61, so-called half-press (instruction to prepare for shooting), and generates a first shutter switch signal SW1. The system control unit 50 starts shooting preparation operations such as AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, and EF (flash pre-flash) processing in response to the first shutter switch signal SW1. The second shutter switch 64 turns ON when the operation of the shutter button 61 is completed, so-called full-press (instruction to shoot), and generates a second shutter switch signal SW2. The system control unit 50 starts a series of shooting operations from reading the signal from the imaging unit 22 to writing the captured image as an image file to the recording medium 200 in response to the second shutter switch signal SW2.

[0036] The touch panel 70a and the display unit 28 can be configured as an integrated unit. For example, the touch panel 70a is configured such that its light transmittance does not interfere with the display of the display unit 28, and is mounted on the upper layer of the display surface of the display unit 28. Then, the input coordinates on the touch panel 70a are associated with the display coordinates on the display surface of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that makes it seem as if the user can directly operate the screen displayed on the display unit 28. The system control unit 50 can detect the following operations or states on the touch panel 70a. - A finger or pen that was not previously touching the touch panel 70a now touches the touch panel 70a, i.e., the start of a touch (hereinafter referred to as Touch-Down). • The state in which the touch panel 70a is being touched with a finger or pen (hereinafter referred to as Touch-On). • The finger or pen is moving while touching the touch panel 70a (hereinafter referred to as Touch-Move). - The finger or pen that was touching the touch panel 70a has been removed (released), i.e., the touch has ended (hereinafter referred to as Touch-Up). • The state in which nothing is being touched on the touch panel 70a (hereinafter referred to as Touch-Off)

[0037] When a touchdown is detected, a touch-on is also detected simultaneously. After a touchdown, touch-ons are usually detected continuously unless a touch-up is detected. Touch-ons are also detected simultaneously if a touch-move is detected. Even if a touch-on is detected, a touch-move will not be detected if the touch position has not moved. After all fingers or pens that were touching have been detected as having touched up, a touch-off occurs.

[0038] These operations and states, as well as the position coordinates of the finger or pen touching the touch panel 70a, are notified to the system control unit 50 via the internal bus. Based on the notified information, the system control unit 50 then determines what operations (touch operations) are to be performed on the touch panel 70a. The system determines whether a touch operation has occurred. For touch moves, the direction of movement of a finger or pen on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on the change in position coordinates. If a touch move of a distance greater than a predetermined distance is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel 70a and then quickly moved a certain distance and released is called a flick. In other words, a flick is an operation in which the finger is quickly traced across the touch panel 70a as if flicking it. If a touch move of a distance greater than a predetermined distance and at a speed greater than a predetermined speed is detected, and a touch-up is then detected, it can be determined that a flick has been performed (it can be determined that a flick followed a slide operation). Furthermore, a touch operation in which multiple locations (for example, two points) are touched together (multitouch) and the touch positions are brought closer together is called a pinch-in, and a touch operation in which the touch positions are moved further apart is called a pinch-out. Pinch-out and pinch-in are collectively referred to as a pinch operation (or simply a pinch). The touch panel 70a may be of any type from among various types of touch panels, such as resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor types. There are methods that detect a touch when there is contact with the touch panel, and methods that detect a touch when a finger or pen approaches the touch panel, and either method is acceptable.

[0039] Furthermore, the system control unit 50 can detect the following operations or states on the touch bar 82. - A finger that was not previously touching the Touch Bar 82 now touches the Touch Bar 82, i.e., the start of a touch (hereinafter referred to as Touch-Down). • The state in which the Touch Bar 82 is touched with a finger (hereinafter referred to as Touch-On) • The finger is moving while touching the Touch Bar 82 (hereinafter referred to as Touch-Move). - The finger that was touching the Touch Bar 82 has left (released) the Touch Bar 82, i.e., the end of the touch (hereinafter referred to as Touch-Up). - The state in which nothing is touching the Touch Bar 82 (hereinafter referred to as Touch-Off)

[0040] When a touchdown is detected, a touch-on is also detected simultaneously. After a touchdown, touch-ons are usually detected continuously unless a touch-up is detected. Touch-ons are also detected simultaneously if a touch-move is detected. Even if a touch-on is detected, a touch-move will not be detected if the touch position has not moved. After all fingers or pens that were touching have been detected as having touched up, a touch-off occurs.

[0041] These operations and states, as well as the position coordinates of the finger touching the touch bar 82, are notified to the system control unit 50 via the internal bus, and the system control unit 50 determines what kind of operation (touch operation) was performed on the touch bar 82 based on the notified information. For touch moves, horizontal movement (left and right direction) on the touch bar 82 is detected. If it is detected that the touch position has moved by a predetermined distance or more (moved by a predetermined amount or more), it is determined that a slide operation has been performed. If a finger is touched on the touch bar 82 and released within a predetermined time without performing a slide operation, it is determined that a tap operation has been performed. The touch bar 82 may be any type of touch sensor from among various types such as resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor.

[0042] <First Embodiment> A first embodiment of the present invention will be described. Figure 3 shows the digital in the first embodiment. This flowchart details the shooting mode processing performed by the camera 100. This processing is achieved by the system control unit 50 loading a program recorded in the non-volatile memory 56 into the system memory 52 and executing it. When the digital camera 100 is started in shooting mode, or when the system control unit 50 switches to shooting mode, the processing shown in Figure 3 begins. The digital camera 100 repeatedly performs the processing shown in Figure 3 while in shooting mode.

[0043] In S301, the system control unit 50 displays the LV image and a GUI such as icons representing the settings status of the digital camera 100 on the display unit 28.

[0044] In S302, the system control unit 50 determines whether the blur assist mode is ON (enabled). If the blur assist mode is ON, the process proceeds to S303; otherwise, the shooting mode processing is terminated. The blur assist mode is a mode that assists (supports) panning shots.

[0045] In S303, the system control unit 50 displays the detection area (a specific area set in a part of the captured image), which is the area to be detected for blur detection, on the display unit 28.

[0046] In S304, the system control unit 50 determines whether a movement operation of the detection area (an operation to instruct the movement of the detection area; an operation to instruct the change of the position of the detection area) has been performed. If a movement operation of the detection area has been performed, the process proceeds to S305; otherwise, it proceeds to S306. Possible movement operations include operations using the four-way key 74 or operations using the touch panel 70a. For example, the system control unit 50 can determine that a movement operation has been performed if it detects a "touch move" which is a touch on the detection area (touch panel 70a) that moves the touch position.

[0047] In S305, the system control unit 50 moves and displays the detection area on the display unit 28 according to the movement operation.

[0048] In S306, the system control unit 50 determines whether a shooting preparation operation (shooting preparation instruction; such as half-pressing the shutter button 61) has been performed. If a shooting preparation operation has been performed, the system proceeds to S307; otherwise, it proceeds to S304.

[0049] In S307, the system control unit 50 performs shooting preparation processing (shooting preparation operations) such as AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, and EF (flash pre-flash) processing.

[0050] In S308, the system control unit 50 displays one or more indicators on the display unit 28 to assist with panning (indicator display processing). Details of the indicator display processing will be described later with reference to Figure 4.

[0051] In S309, the system control unit 50 determines whether a shooting operation (shooting instruction; fully pressing the shutter button 61) has been performed. If a shooting operation has been performed, the process proceeds to S310; otherwise, it proceeds to S311.

[0052] In S310, the system control unit 50 performs a series of imaging processes, from reading the signal from the imaging unit 22 to writing the captured image as an image file to the recording medium 200.

[0053] In S311, the system control unit 50 determines whether the shooting preparation operation has been canceled. If the shooting preparation operation has been canceled, the system proceeds to S312; otherwise, it proceeds to S309.

[0054] In S312, the system control unit 50 determines whether or not another operation (instruction) has been performed. If another operation has been performed, the system proceeds to S313; otherwise, it proceeds to S304.

[0055] In S313, the system control unit 50 determines whether the operation in S312 was an operation to terminate the shooting mode processing (termination instruction). If it was a termination operation, the shooting mode processing is terminated; otherwise, the process proceeds to S314. For example, the system control unit 50 determines that an operation to terminate the shooting mode processing has been performed when the operation to turn off the power of the digital camera 100 is performed, and terminates the shooting mode processing.

[0056] In S314, the system control unit 50 performs processing in accordance with the operation in S312.

[0057] Figure 4 is a flowchart detailing the indicator display process in S308 of Figure 3. This process is achieved when the system control unit 50 loads the program recorded in the non-volatile memory 56 into the system memory 52 and executes it.

[0058] In S401, the system control unit 50 detects an object (main subject) present in the detection area from the captured image (LV image), and detects the size of the main subject in the image (size of the main subject in the display unit 28) based on the detection result of the main subject. The main subject can be detected by various proposed methods. The size of the main subject (main subject size) may be, for example, the area (total number of pixels), width, or height of the main subject. The area (total number of pixels), width, or height of a rectangle circumscribing the main subject may also be used as the size of the main subject.

[0059] In S402, the system control unit 50 determines the indicator distance L according to the size of the main subject detected in S401. The indicator distance L corresponds to the distance (interval) from the detection area to the indicator, and in the first embodiment, it is the distance in the horizontal or vertical direction. For example, the indicator distance L corresponds to the distance from the center of the detection area to the indicator. In the first embodiment, in order to prevent the indicator from overlapping with the main subject and making the main subject difficult to see, the system control unit 50 determines an indicator distance L that is longer the larger the size of the main subject. Note that the indicator distance L may also correspond to the distance (shortest distance) from the edge of the detection area to the indicator. The indicator distance L may also be a fixed value.

[0060] In S403, the system control unit 50 detects the motion vector of the main subject (detected in S401) in the LV image based on the LV image. The motion vector is detected by pattern matching of two images captured at different times, such as the current image and the previous image (the image one field before the current field (frame)).

[0061] In S404, the system control unit 50 determines the horizontal or vertical component of the motion vector (corresponding to the blur of the main subject in the captured (recorded) image) detected in S403 as the motion component N. For example, if the horizontal component (horizontal component) of the motion vector is greater than the vertical component (vertical component) of the motion vector, the system control unit 50 determines the horizontal component of the motion vector as the motion component N. If the vertical component of the motion vector is greater than the horizontal component of the motion vector, the system control unit 50 determines the vertical component of the motion vector as the motion component N. The system control unit 50 may also use the attitude detection unit 55 to detect the direction of movement of the digital camera 100 (imaging device) and determine the component of the motion vector in the direction corresponding to that direction of movement as the motion component N. For example, if the direction of movement of the digital camera 100 is closer to the horizontal direction than to the vertical direction, the system control unit 50 may determine the horizontal component of the motion vector as the motion component N. If the direction of movement of the digital camera 100 is closer to the vertical direction than the horizontal direction, the system control unit 50 will adjust the vertical component of the motion vector. It may be determined as N. The motion component N is used to determine the position of the blur indicator (an indicator that shows the blur (magnitude and direction) of the main subject in the image being captured (recorded) by position). In the first embodiment, the motion component N is also used to determine the characteristics of the blur indicator (such as the number of components of the blur indicator and the color of the blur indicator).

[0062] In S405, the system control unit 50 determines the direction perpendicular to the direction of the motion component N determined in S404 as the reference direction D, which is the direction of the straight line indicating the reference position of the blur indicator (the position for capturing (recording) an image without blur on the main subject). For example, if the horizontal component of the motion vector is greater than the vertical component of the motion vector, the system control unit 50 determines the vertical direction as the reference direction D. If the vertical component of the motion vector is greater than the horizontal component of the motion vector, the system control unit 50 determines the horizontal direction as the reference direction D. The system control unit 50 may also determine the direction perpendicular to the direction corresponding to the direction of movement of the digital camera 100 as the reference direction D. For example, if the direction of movement of the digital camera 100 is closer to the horizontal direction than the vertical direction, the system control unit 50 may determine the vertical direction as the reference direction D. If the direction of movement of the digital camera 100 is closer to the vertical direction than the horizontal direction, the system control unit 50 may determine the horizontal direction as the reference direction D.

[0063] In S406, the system control unit 50 displays one or more indicators, including at least one blur indicator, based on the determined indicator distance L, motion component N, and reference direction D. As will be described in detail later, in the first embodiment, a position on the straight line of the reference direction D passing through the center of the detection area is used as the reference position for capturing (recording) an image when there is no blur in the direction perpendicular to the reference direction D of the main subject in the detection area. The degree of blur is then indicated by the position of the blur indicator relative to the reference position.

[0064] In the first embodiment, the direction of the motion component N and the reference direction D were assumed to be horizontal or vertical, but this is not limited to this. For example, the system control unit 50 may determine the motion vector detected in S403 as the motion component N and determine the direction perpendicular to the motion vector as the reference direction D. Alternatively, the system control unit 50 may determine the component of the motion vector in the direction of movement of the digital camera 100 as the motion component N and determine the direction perpendicular to the direction of movement of the digital camera 100 as the reference direction D.

[0065] Figures 5(a) to 5(f) show examples of displays on the display unit 28 (examples of displays in S406 of Figure 4). In Figures 5(a) to 5(f), LV images showing the main subject 501 and background subject 506 are displayed. The LV image is displayed in S301 of Figure 3. In the real world, the main subject 501 is moving, and the background subject 506 is stationary. Consider the case where panning is performed and the digital camera 100 is panned (moved left and right (horizontally)) or tilted (moved up and down (vertically)) to keep the main subject 501 in a fixed position. If panning is performed well, the main subject 501 remains relatively stationary with respect to the shooting range that changes due to panning or tilting, and the background subject 506 moves relatively with respect to the imaging range. As a result, an image is obtained in which the main subject 501 is not blurred and the background subject 506 is blurred in the direction of panning (the direction of panning or tilting).

[0066] Icon 511 is a type of shooting mode icon that indicates the shooting mode of the digital camera 100 is set to blur assist mode. Icon 512 is an AF mode icon that indicates the focus mode of the digital camera 100 is set to AF mode (autofocus mode). Icon 513 is a type of display item that indicates the shooting settings (shooting conditions) set on the digital camera 100, and shows the currently set image quality settings (number of recording pixels and compression ratio). Icons 511 to 513 are also displayed in S301 in Figure 3. Not limited to icons 511 to 513, other icons related to shooting settings are also displayed. The information may be displayed.

[0067] As shown in Figures 5(a) to 5(f), the system control unit 50 displays a detection area 502 (an item indicating the detection area, such as a frame indicating the detection area) which is the area to be detected for blur detection, overlaid on the LV image. The detection area 502 is displayed in S303 of Figure 3. The detection area 502 is displayed at a position arbitrarily specified by the user (the initial position is the center). The user specifies (sets) the position of the detection area 502 in advance to achieve the composition they want, and then pans or tilts the digital camera 100 so that the main subject 501 fits within the detection area 502. Displaying the detection area 502 makes it easier for the user to capture the main subject 501 according to their desired composition.

[0068] In Figures 5(a) to 5(f), indicator 503 is a blur indicator that shows the blur (magnitude and direction) of the main subject 501 in the captured (recorded) image in terms of position. Indicator 504 is a horizontal reference indicator that shows the center of the detection area 502 in the horizontal direction, and indicator 505 is a vertical reference indicator that shows the center of the detection area 502 in the vertical direction. Blur indicator 503, horizontal reference indicator 504, and vertical reference indicator 505 are displayed at S406 in Figure 4.

[0069] In the examples shown in Figures 5(a) to 5(f), the shake indicator 503, the horizontal reference indicator 504, and the vertical reference indicator 505 are displayed outside the detection area 502. Specifically, the shake indicator 503 is displayed at a distance of the shake indicator distance from the center of the detection area 502, either horizontally or vertically. The horizontal reference indicator 504 is displayed at a distance of the reference indicator distance from the center of the detection area 502, vertically. The vertical reference indicator 505 is displayed at a distance of the reference indicator distance from the center of the detection area 502, horizontally. To prevent the shake indicator 503 from overlapping with the horizontal reference indicator 504 and the vertical reference indicator 505, the shake indicator distance is set to be longer than the reference indicator distance. The reference indicator distance and the shake indicator distance are distances corresponding to the indicator distance L (the longer the indicator distance L, the longer the distance; for example, a distance proportional to the indicator distance L). Therefore, determining the indicator distance L is equivalent to determining the reference indicator distance and the shake indicator distance. By displaying the blur indicator 503, the horizontal reference indicator 504, and the vertical reference indicator 505 in this manner, it is possible to prevent these indicators from overlapping with the main subject 501 and making the main subject 501 difficult to see. The reference indicator distance or the blur indicator distance may or may not be the same as the indicator distance L.

[0070] Furthermore, in the examples shown in Figures 5(a) to 5(f), the components of the deviation indicator 503 are line segments, and the deviation indicator 503 is composed of one or more line segments. The horizontal reference indicator 504 is one line segment parallel to the vertical direction, and the vertical reference indicator 505 is one line segment parallel to the horizontal direction.

[0071] Figures 5(a) to 5(c) show examples of panning shots where the main subject 501 is a car moving horizontally (to the right) in the real world, and the digital camera 100 is moved horizontally (to the right) in accordance with the direction of movement of the main subject 501.

[0072] Figure 5(a) shows an example of a display where the vertical direction is determined as the reference direction D, and the movement speed (panning speed) of the digital camera 100 is slower than the movement speed of the main subject 501. As shown in Figure 5(a), when the reference direction D is the vertical direction, the components of the blur indicator 503 are line segments parallel to the vertical direction (horizontal reference indicator 504). The blur indicator 503 is displayed vertically from the center of the detection area 502, at a distance equal to the blur indicator distance. At this time, the horizontal position (horizontal position) of the horizontal reference indicator 504 is the reference position for capturing (recording) an image when the main subject 501 is free from horizontal blur.

[0073] In the state shown in Figure 5(a), the movement speed of the digital camera 100 is slower than the movement speed of the main subject 501, so an image of the main subject 501 is captured (recorded) with the main subject 501 blurred to the right. For this reason, as shown in Figure 5(a), the blur indicator 503 is displayed to the right of the horizontal reference indicator 504 (on the same side as the direction of the blur of the main subject 501). The horizontal distance (horizontal distance) between the blur indicator 503 and the horizontal reference indicator 504 corresponds to the magnitude of the blur of the main subject 501 and is determined according to the absolute value of the motion component N (the horizontal component of the motion vector of the main subject 501 in the LV image). For example, the greater the absolute value of the motion component N, the longer the distance determined as the horizontal distance between the blur indicator 503 and the horizontal reference indicator 504, such as a distance proportional to the absolute value of the motion component N. Whether the blur indicator 503 is displayed to the right or left of the horizontal reference indicator 504 is determined according to the sign (+ / -) of the motion component N.

[0074] Furthermore, because there is a large difference between the movement speed of the digital camera 100 and the movement speed of the main subject 501, the number of components (line segments) of the blur indicator 503 is set to three, and the color of the blur indicator 503 is set to red. The number of components (line segments) of the blur indicator 503 and the color of the blur indicator 503 correspond to the magnitude of blur of the main subject 501 and are determined according to the absolute value of the motion component N. For example, the number of components of the blur indicator 503 is determined as follows: one when the absolute value of the motion component N is less than or equal to threshold A, two when the absolute value of the motion component N is greater than threshold A and less than or equal to threshold B (> threshold A), and three when the absolute value of the motion component N is greater than threshold B. The color of the blur indicator 503 is determined as follows: green when the absolute value of the motion component N is less than or equal to threshold A, yellow when the absolute value of the motion component N is greater than threshold A and less than or equal to threshold B, and red when the absolute value of the motion component N is greater than threshold B. The colors of the horizontal reference indicator 504 and the vertical reference indicator 505 may be fixed, or they may be changed to the same colors as the fluctuation indicator 503.

[0075] From the display in Figure 5(a) (including the position of the blur indicator 503, the number of components, and the color), the user can easily understand that a large blur to the right occurs in the main subject 501 in the captured (recorded) image. The user can then increase the movement speed of the digital camera 100 to reduce the magnitude of the blur in the main subject 501.

[0076] Figure 5(b) shows an example of the display when the movement speed of the digital camera 100 is increased from the state in Figure 5(a). Even in the state in Figure 5(b), since the movement speed of the digital camera 100 is slower than the movement speed of the main subject 501, an image of the main subject 501 that is blurred to the right will be captured (recorded). For this reason, as shown in Figure 5(b), the blur indicator 503 is displayed to the right of the horizontal reference indicator 504. However, in the state in Figure 5(b), the movement speed of the digital camera 100 has been brought closer to the movement speed of the main subject 501 from the state in Figure 5(a). For this reason, the blur indicator 503 is displayed in a position closer to the horizontal reference indicator 504 compared to Figure 5(a). In addition, the number of components of the blur indicator 503 is set to two, and the color of the blur indicator 503 is set to yellow.

[0077] From the display in Figure 5(b) (position of the blur indicator 503, number of components, color, etc.), the user can easily understand that a moderate amount of blur to the right occurs in the main subject 501 in the captured (recorded) image. The user can then further increase the movement speed of the digital camera 100 to further reduce the amount of blur in the main subject 501. can.

[0078] Figure 5(c) shows an example of the display when the movement speed of the digital camera 100 is further increased from the state shown in Figure 5(b). In the state shown in Figure 5(c), the movement speed of the digital camera 100 has become equal to the movement speed of the main subject 501, so that the main subject 501 can be captured in the detection area 502 and a blur-free image of the main subject 501 can be taken (recorded). For this reason, as shown in Figure 5(c), the blur indicator 503 is displayed at the same horizontal position as the horizontal reference indicator 504. In addition, the blur indicator 503 has only one component and is green in color.

[0079] From the display in Figure 5(c) (including the position of the blur indicator 503, the number of components, and the color), the user can easily understand that the main subject 501 is captured in the detection area 502 without blurring in the image being captured (recorded) (i.e., successful panning). The user can then maintain the movement speed of the digital camera 100 to maintain the current state (the perfect shot).

[0080] Figures 5(d) to 5(f) show examples of panning shots where the main subject 501 is a rocket moving vertically (upward) in the real world, and the digital camera 100 is moved (tilted) vertically (upward) in accordance with the direction of movement of the main subject 501.

[0081] Figure 5(d) shows an example of a display where the horizontal direction is determined as the reference direction D, and the movement speed (tilt speed) of the digital camera 100 is faster than the movement speed of the main subject 501. As shown in Figure 5(d), when the reference direction D is the horizontal direction, the components of the blur indicator 503 are line segments parallel to the horizontal direction (vertical reference indicator 505). The blur indicator 503 is displayed at a position horizontally away from the center of the detection area 502 by the blur indicator distance. At this time, the vertical position of the vertical reference indicator 505 (vertical position) is the position for capturing (recording) an image without vertical blur in the main subject 501.

[0082] In the state shown in Figure 5(d), the movement speed of the digital camera 100 is faster than the movement speed of the main subject 501, so an image of the main subject 501 blurred downwards is captured (recorded). For this reason, as shown in Figure 5(d), the blur indicator 503 is displayed below the vertical reference indicator 505 (on the same side as the direction of blur of the main subject 501). The vertical distance (distance in the vertical direction) between the blur indicator 503 and the vertical reference indicator 505 corresponds to the magnitude of blur of the main subject 501 and is determined according to the absolute value of the motion component N (the vertical component of the motion vector of the main subject 501 in the LV image). For example, the greater the absolute value of the motion component N, the longer the distance determined as the vertical distance between the blur indicator 503 and the vertical reference indicator 505, such as a distance proportional to the absolute value of the motion component N. Whether the blur indicator 503 is displayed below or above the vertical reference indicator 505 is determined according to the sign (+ / -) of the motion component N.

[0083] Furthermore, because there is a large difference between the movement speed of the digital camera 100 and the movement speed of the main subject 501, the number of components (line segments) of the blur indicator 503 is set to three, and the color of the blur indicator 503 is set to red.

[0084] From the display in Figure 5(d) (including the position of the blur indicator 503, the number of components, and the color), the user can easily understand that a large downward blur occurs in the main subject 501 in the captured (recorded) image. The user can then reduce the movement speed of the digital camera 100 to reduce the magnitude of the blur in the main subject 501.

[0085] Figure 5(e) shows an example of the display when the movement speed of the digital camera 100 is reduced from the state in Figure 5(d). Even in the state in Figure 5(e), since the movement speed of the digital camera 100 is faster than the movement speed of the main subject 501, an image of the main subject 501 is captured (recorded) with downward blur. For this reason, as shown in Figure 5(e), the blur indicator 503 is displayed below the vertical reference indicator 505. However, in the state in Figure 5(e), the movement speed of the digital camera 100 is brought closer to the movement speed of the main subject 501 compared to the state in Figure 5(d). For this reason, the blur indicator 503 is displayed in a position closer to the vertical reference indicator 505 compared to Figure 5(d). In addition, the blur indicator 503 has two components, and the color of the blur indicator 503 is yellow.

[0086] From the display in Figure 5(e) (including the position of the blur indicator 503, the number of components, and the color), the user can easily understand that a moderate amount of downward blur occurs in the main subject 501 in the captured (recorded) image. The user can then further reduce the movement speed of the digital camera 100 to further reduce the amount of blur in the main subject 501.

[0087] Figure 5(f) shows an example of the display when the movement speed of the digital camera 100 is further reduced from the state shown in Figure 5(e). In the state shown in Figure 5(f), the movement speed of the digital camera 100 is equal to the movement speed of the main subject 501, so that the main subject 501 can be captured in the detection area 502 and a blur-free image of the main subject 501 can be taken (recorded). For this reason, as shown in Figure 5(f), the blur indicator 503 is displayed in the same vertical position as the vertical reference indicator 505. In addition, the blur indicator 503 has only one component and is green in color.

[0088] From the display in Figure 5(f) (including the position of the blur indicator 503, the number of components, and the color), the user can easily understand that the main subject 501 is captured in the detection area 502 without blurring in the image being captured (recorded) (i.e., successful panning). The user can then maintain the movement speed of the digital camera 100 to maintain the current state (shutter opportunity).

[0089] According to the first embodiment described above, the user can change the detection area that is subject to blur detection. The position on the straight line in the reference direction D passing through the center of the detection area is indicated as the reference position for capturing (recording) an image when the main subject in the detection area is free from blur in the direction perpendicular to the reference direction D. Furthermore, the number of line segments constituting the blur indicator, the position of the line segments relative to the reference position, and the color of the line segments indicate the magnitude and direction of the blur of the main subject detected in the detection area. This allows the user to easily create a composition in which the main subject is captured still at the desired position while checking the blur indicator along with the LV image. Consequently, the user can easily perform panning shots with a specific composition.

[0090] Furthermore, according to the first embodiment, the detection area, horizontal reference indicator, vertical reference indicator, etc., are displayed, and the appearance of the blur indicator (for example, at least one of the number of components and color) is changed according to the degree of blur of the main subject. This makes it easier for the user to create the desired composition while further checking the detection area, horizontal reference indicator, vertical reference indicator, and appearance of the blur indicator.

[0091] Furthermore, according to the first embodiment, the blur indicator, horizontal reference indicator, and vertical reference indicator are displayed outside the detection area. This prevents these indicators from overlapping the main subject 501 and making the main subject 501 difficult to see. This allows users to more easily create their desired composition.

[0092] <Second Embodiment> A second embodiment of the present invention will now be described. In the first embodiment, an example was described in which the reference direction D is determined based on the motion vector (motion vector of the main subject) detected from the LV image and the direction of movement (direction of movement of the digital camera 100) detected using the attitude detection unit 55. In the second embodiment, an example will be described in which the user specifies the direction related to the reference direction D. In addition, in the first embodiment, an example was described in which both a horizontal reference indicator and a vertical reference indicator are displayed. In the second embodiment, an example will be described in which only the indicator that shows the center of the detection area in a direction perpendicular to the reference direction D (an indicator on the straight line of the reference direction D passing through the center of the detection area) is displayed among the horizontal reference indicator and the vertical reference indicator.

[0093] The blur indicator shows the blur (blur of the main subject) in a direction perpendicular to the reference direction D, and the user changes the movement speed and direction of the digital camera 100 to reduce the magnitude of the blur while looking at the blur indicator. Here, the user may have predetermined directions related to the reference direction D, such as the direction of the blur to be reduced or the direction of movement of the digital camera 100 to reduce the blur. In the second embodiment, the user specifies the direction related to the reference direction D. This allows the blur indicator to be displayed to show the blur that the user wants to reduce, making it easier to create the desired composition. The direction specified by the user may be the reference direction D, the direction of the blur to be reduced, or the direction of movement of the digital camera 100. When the direction of the blur to be reduced or the direction of movement of the digital camera 100 is specified, the direction perpendicular to the specified direction is determined as the reference direction D.

[0094] Furthermore, to reduce blur of the main subject, the user brings the blur indicator closer to the indicator that shows the center of the detection area in a direction perpendicular to the reference direction D. At this time, displaying another indicator that shows the center of the detection area is not only meaningless but can also hinder the user's composition. Therefore, in the second embodiment, of the horizontal reference indicator and the vertical reference indicator, only the indicator that shows the center of the detection area in a direction perpendicular to the reference direction D is displayed. This makes it easier for the user to create the desired composition.

[0095] As an example, consider a case where, when the user instructs the camera to activate the blur assist mode, they also instruct (select) "horizontal direction (left and right direction; horizontal direction)" as the direction of movement for the digital camera 100. In this case, as shown in Figure 6(a), the horizontal reference indicator 504 is displayed, but the vertical reference indicator 505 is not. The blur indicator 503 is displayed to show horizontal blur. This allows the user to easily create the desired composition by looking at the blur indicator 503 and the horizontal reference indicator 504, without having to look at the vertical reference indicator 505.

[0096] As another example, consider the case where, when the user instructs the camera to activate the blur assist mode, they also instruct (select) "vertical direction (up and down direction; vertical direction)" as the direction of movement for the digital camera 100. In this case, as shown in Figure 6(b), the vertical reference indicator 505 is displayed, but the horizontal reference indicator 504 is not. The blur indicator 503 is displayed to show vertical blur. This allows the user to easily create the desired composition by looking at the blur indicator 503 and the vertical reference indicator 505, without having to look at the horizontal reference indicator 504.

[0097] By the way, electronic devices such as the Digital Camera 100 correct for unintended camera shake. The camera may have an image stabilization mode, and in addition to the normal image stabilization mode, it may also have a panning image stabilization mode. The image stabilization mode detects camera shake using a vibration gyroscope and moves the corrective optical system perpendicular or horizontal to the optical axis to reduce the amount of blur in the image area caused by the detected camera shake. In the normal image stabilization mode, when panning, intentional movements of the digital camera 100, such as panning, may be mistakenly detected as camera shake, and incorrect correction (movement of the corrective optical system) may be performed to cancel out the change in the image area caused by that movement. For this reason, for example, in the panning image stabilization mode, if a large movement of the digital camera 100 in the horizontal or vertical direction is detected, it is determined that the detected movement is an intentional movement for panning (panning or tilting). Then, correction based on the direction of the detected movement (the direction of the larger movement) is not performed. As such, there are multiple modes related to panning (such as blur assist mode and panning image stabilization mode), so it is preferable to present these multiple modes to the user in an interconnected manner.

[0098] Figure 7 is a flowchart detailing the shooting mode processing performed by the digital camera 100 in the second embodiment. This processing is achieved by the system control unit 50 loading a program recorded in the non-volatile memory 56 into the system memory 52 and executing it. When the digital camera 100 is started in shooting mode, or when the system control unit 50 switches to shooting mode, the processing in Figure 7 begins. The digital camera 100 repeatedly performs the processing in Figure 7 while in shooting mode.

[0099] In the S701, the system control unit 50 displays the LV image and a GUI such as icons representing the settings status of the digital camera 100 on the display unit 28.

[0100] In S702, the system control unit 50 determines whether or not the menu button 81 has been pressed. If the menu button 81 has been pressed, the process proceeds to S703; otherwise, it proceeds to S727.

[0101] In S727, the system control unit 50 determines whether the image stabilization mode is ON (enabled). If the image stabilization mode is ON, the process proceeds to S715; otherwise, the shooting mode processing is terminated.

[0102] In S703, the system control unit 50 displays the menu screen on the display unit 28.

[0103] In S704, the system control unit 50 determines whether or not a setting start operation to initiate the setting of the image stabilization mode has been performed on the menu screen. The setting start operation for the image stabilization mode is, for example, selecting the "Image Stabilization Mode Setting" item on the menu screen using the 4-way key 74 or the touch panel 70a and pressing the SET button 75. If the setting start operation for the image stabilization mode has been performed, the process proceeds to S705; otherwise, it proceeds to S728.

[0104] In S728, the system control unit 28 performs processing corresponding to the menu operation performed when other menu operations (other operations using the menu screen) are performed.

[0105] In S705, the system control unit 50 displays a screen on the display unit 28 for switching the brake assist mode ON / OFF (enabled / disabled).

[0106] In S706, the system control unit 50 determines whether a switching operation has been performed on the shake assist mode setting screen to switch the shake assist mode from OFF to ON. This switching operation is performed, for example, using the four-way key 74, the touch panel 70, the SET button 75, etc. This is performed. If a switching operation is performed to switch the brake assist mode from OFF to ON, the system proceeds to S707; otherwise, it proceeds to S702. The system control unit 50 also hides various screens, such as the menu screen and the brake assist mode screen, as appropriate. For example, the system control unit 50 hides a screen in response to an operation using that screen, or hides a screen if a predetermined amount of time has elapsed since the screen was displayed without any operation using that screen. In the second embodiment, for the sake of clarity of each process in the flowchart of Figure 7, the display is controlled to be in the state immediately after S701 when proceeding to S702.

[0107] In S707, the system control unit 50 determines whether the lens unit 150 attached to the digital camera 100 supports image stabilization. If the lens unit 150 supports image stabilization, the process proceeds to S708; otherwise, it proceeds to S702.

[0108] In S708, the system control unit 50 determines whether the normal image stabilization mode (mode 1) is set. If the normal image stabilization mode is set, the process proceeds to S709; otherwise, it proceeds to S702.

[0109] In S709, the system control unit 50 determines whether the lens unit 150 has a panning image stabilization mode (whether the panning image stabilization mode can be set). If the lens unit 150 has a panning image stabilization mode (mode 2), the process proceeds to S710; otherwise, it proceeds to S711.

[0110] In the S710, the system control unit 50 provides a predetermined notification to prompt the user to set the panning image stabilization mode (mode 2). For example, the system control unit 50 displays a screen on the display unit 28 with a message such as, "We recommend changing to panning image stabilization mode."

[0111] In S711, the system control unit 50 issues a predetermined notification prompting the user to disable the image stabilization mode. For example, the system control unit 50 displays a screen on the display unit 28 with a message such as, "We recommend disabling image stabilization mode."

[0112] In S712, the system control unit 50 issues a predetermined notification prompting the user to set the panning direction (the direction of movement of the digital camera 100). For example, the system control unit 50 displays a message such as "Please set the panning direction" on the display unit 28. For example, the user can set the panning direction to horizontal or vertical.

[0113] In S713, the system control unit 50 determines whether or not a setting operation to set the panning direction has been performed. If the setting operation to set the panning direction has been performed, the process proceeds to S714; otherwise, it proceeds to S715.

[0114] In S714, the system control unit 50 records the panning direction specified in the setting operation in S713 in the system memory 52 (setting the panning direction). For example, the system control unit 50 records a setting value indicating the specified panning direction in the system memory 52. ​​If no panning direction is set, the system memory 52 stores a setting value indicating no direction as the setting value for the panning direction.

[0115] In S715, the system control unit 50 displays the detection area on the display unit 28.

[0116] In S716, the system control unit 50 determines whether or not a movement operation of the detection area has been performed. If a movement operation is performed on the detection area, proceed to S717; otherwise, proceed to S718.

[0117] In S717, the system control unit 50 moves the detection area according to the movement operation.

[0118] In S718, the system control unit 50 determines whether or not the shooting preparation operation has been performed. If the shooting preparation operation has been performed, the process proceeds to S719; otherwise, it proceeds to S716.

[0119] In S719, the system control unit 50 performs the shooting preparation process.

[0120] In S720, the system control unit 50 displays one or more indicators on the display unit 28 to assist with panning (indicator display processing). The indicator display processing is substantially the same as in the first embodiment (Figure 4). However, if a panning direction is set, in S404, the system control unit 50 determines the components of the motion vector (motion vector of the main subject in the LV image) in the panning direction as motion component N. In S405, the system control unit 50 determines the direction perpendicular to the panning direction as the reference direction D. Then, in S406, the system control unit 50 displays only the indicator that shows the center of the detection area in the panning direction from among the horizontal reference indicator and the vertical reference indicator. Of course, the system control unit 50 also displays the blur indicator.

[0121] In S721, the system control unit 50 determines whether or not a shooting operation has been performed. If a shooting operation has been performed, the process proceeds to S722; otherwise, it proceeds to S723.

[0122] In S722, the system control unit 50 performs the image capture process.

[0123] In S723, the system control unit 50 determines whether the shooting preparation operation has been canceled. If the shooting preparation operation has been canceled, the process proceeds to S724; otherwise, it proceeds to S721.

[0124] In S724, the system control unit 50 determines whether or not other operations have been performed. If other operations have been performed, the process proceeds to S725; otherwise, it proceeds to S716.

[0125] In S725, the system control unit 50 determines whether the operation in S724 was an operation to terminate the shooting mode processing. If it was a termination operation, the shooting mode processing is terminated; otherwise, the process proceeds to S726.

[0126] In S726, the system control unit 50 performs processing in accordance with the operation in S724.

[0127] According to the second embodiment described above, the direction with respect to the reference direction D is specified by the user. This allows the blur indicator to be displayed in a way that shows the blur that the user wants to reduce, making it easier to create the desired composition. Furthermore, according to the second embodiment, of the horizontal and vertical reference indicators, only the indicator that shows the center of the detection area in the direction perpendicular to the reference direction D is displayed. This makes it easier for the user to create the desired composition.

[0128] <Third Embodiment> A third embodiment of the present invention will now be described. In the first embodiment, an example was described in which the indicator distance L is determined according to the size of the main subject present in the detection area. In the third embodiment, an example will be described in which the user specifies the indicator distance L.

[0129] As described in the first embodiment, the indicator is displayed so as not to overlap with the main subject. It is preferable that this be done. Therefore, in the third embodiment, the indicator distance L is specified (set) by the user. This makes it possible to more reliably suppress the indicator from overlapping with the main subject and to customize the indicator display to the user's preference. The operation to specify the indicator distance L is performed, for example, using a four-way key 74, a touch panel 70, a SET button 75, etc.

[0130] Figure 8 is a flowchart detailing the setting process for setting (changing) the indicator distance L. This process is achieved by the system control unit 50 loading a program recorded in the non-volatile memory 56 into the system memory 52 and executing it. When an operation to start the setting process for the indicator distance L is performed, the process shown in Figure 8 begins. An operation to start the setting process for the indicator distance L is, for example, selecting the "Indicator Distance Setting" item on the menu screen using the four-way key 74 or the touch panel 70a and pressing the SET button 75.

[0131] In S801, the system control unit 50 displays a distance setting frame on the display unit 28 for setting the indicator distance L. For example, the system control unit 50 displays the distance setting frame for the indicator distance L so that it indicates the same area as the detection area (at the same position and size as the detection area). Note that the item for setting the indicator distance L is not limited to a distance setting frame; it may also be a dialog box for specifying the distance.

[0132] In S802, the system control unit 50 determines whether or not a touch operation has been performed on the touch panel 70a. If a touch operation has been performed, the process proceeds to S803; otherwise, it proceeds to S811.

[0133] In S811, the system control unit 50 determines whether an termination operation (termination instruction) has been performed to end the indicator distance L setting process. If a termination operation has been performed, the indicator distance L setting process is terminated; otherwise, the process proceeds to S802. For example, the system control unit 50 determines that an termination operation has been performed when the power of the digital camera 100 is turned off, and terminates the indicator distance L setting process. When terminating the indicator distance L setting process, the system control unit 50 sets the indicator distance L based on the distance setting frame. For example, the system control unit 50 records the distance from the detection area (e.g., the center of the detection area) to the edge (frame line) of the distance setting frame as the indicator distance L in the system memory 52 or non-volatile memory 56. In this case, in S402 of Figure 4, the system control unit 50 performs a process to acquire the set indicator distance (the main subject size does not need to be detected in S401).

[0134] In S803, the system control unit 50 determines whether the touch operation in S802 was a touch move or not. If it was a touch move, proceed to S804; otherwise, proceed to S807.

[0135] In S804, the system control unit 50 determines whether the movement of the touch position (amount of movement and direction of movement) is within the movable range. The movable range is the range in which the distance setting frame can be moved in accordance with the movement of the touch position. For example, the movable range is the range in which, when the distance setting frame is moved in accordance with the movement of the touch position, the edge of the distance setting frame is located outside the detection area (the edge of the distance setting frame does not overlap the detection area). If the movement of the touch position is within the movable range, the process proceeds to S805; otherwise, the process proceeds to S806.

[0136] In S805, the system control unit 50 moves the distance setting frame in accordance with the movement of the touch position. For example, the system control unit 50 moves the distance setting frame by the same amount as the amount of movement of the touch position and in the same direction as the movement of the touch position. This allows for multiple directions such as up, down, left, and right. The distance from the detection area (e.g., the center of the detection area) to the edge of the distance setting frame can be different in each of the multiple directions, and an indicator distance L can be set for each of the multiple directions.

[0137] In S806, the system control unit 50 determines whether the touch move has finished (whether a touch-up has been performed from the touch panel 70a). If the touch move has finished, the process proceeds to S802; otherwise, it proceeds to S804.

[0138] In S807, the system control unit 50 determines whether the touch operation in S802 was a pinch operation (pinch out or pinch in). If it was a pinch operation, proceed to S808; otherwise, proceed to S802.

[0139] In S808, the system control unit 50 determines whether the change in the distance between the two touch positions during a pinch operation (amount of change and direction of change) is within the expandable / contractable range. The expandable / contractable range is the range in which the distance setting frame can be expanded or contracted in accordance with the change in the distance between the touch positions. For example, the expandable / contractable range is the range in which, when the distance setting frame is expanded or contracted in accordance with the change in the distance between the touch positions, the edge of the distance setting frame is located outside the detection area (the edge of the distance setting frame does not overlap the detection area). If the change in the distance between the touch positions is within the expandable / contractable range, the process proceeds to S809; otherwise, it proceeds to S810.

[0140] In S809, the system control unit 50 expands or contracts the distance setting frame in accordance with the change in the interval between touch positions. For example, the system control unit 50 expands or contracts the distance setting frame by the same amount of change as the change in the interval between touch positions and in the same direction as the change in the interval between touch positions. Alternatively, the system control unit 50 may expand or contract the distance setting frame without changing its position, in accordance with the change in the interval between touch positions, without considering the direction of change in the interval between touch positions. However, by considering the direction of change in the interval between touch positions, the distance from the detection area (e.g., the center of the detection area) to the edge of the distance setting frame can be made different for multiple directions such as up, down, left, and right, and the indicator distance L can be set for each of these multiple directions.

[0141] In S810, the system control unit 50 determines whether the pinch operation has been completed (whether a touch-up has been performed from the touch panel 70a). If the pinch operation has been completed, the system proceeds to S802; otherwise, it proceeds to S808.

[0142] According to the third embodiment described above, the indicator distance L is specified (set) by the user. This makes it possible to more reliably prevent the indicator from overlapping the main subject and to customize the indicator display to the user's preference. Consequently, the user can more effectively create the desired composition.

[0143] <Fourth Embodiment> A fourth embodiment of the present invention will now be described. In the fourth embodiment, an example will be described in which the area where autofocus is performed (AF area) is used as the detection area.

[0144] As described in the first embodiment, in order to take a panning shot of an image in which the main subject is still within the detection area, the detection area is set to the position where the user wants to place the main subject. At this time, many users want to focus on the main subject within the detection area. The AF area is then set to the position where the user wants to focus. Therefore, in the fourth embodiment, the AF area is also used as the detection area (the AF area also serves as the detection area). This eliminates the need for the user to set the detection area separately from the AF area, improving convenience.

[0145] According to the fourth embodiment described above, the AF area also serves as the detection area. This eliminates the need for the user to set a separate detection area from the AF area, improving convenience. Consequently, the user can more effectively create their desired composition.

[0146] Although the present invention has been described in detail above based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Furthermore, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0147] Furthermore, the various controls described above as being performed by the system control unit 50 may be performed by a single piece of hardware, or multiple pieces of hardware (for example, multiple processors or circuits) may share the processing to control the entire device. Also, although the above-described embodiment explained the application of the present invention to a digital camera (imaging device) as an example, it is not limited to this example and can be applied to any electronic device (electronic device having an imaging control function) that is capable of controlling shooting, such as panning. For example, the present invention can be applied to personal computers and PDAs, mobile phone terminals and portable image viewers, printers, digital photo frames, music players, game consoles, e-book readers, video players, etc. The present invention can also be applied to display devices (including projection devices), tablet terminals, smartphones, AI speakers, home appliances, in-vehicle devices, medical devices, etc.

[0148] (Other embodiments) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions. [Explanation of symbols]

[0149] 100: Digital camera 50: System control unit 70a: Touch panel 74: 4-way key

Claims

1. a receiving unit capable of receiving a first operation for changing the position of a specific area set in a part of a captured image; a control means for controlling the display of the captured image in a live view, and for controlling the display of a first indicator that indicates the degree of blur by a position relative to the reference position, the first indicator defining a position on a line passing through the center of the specific area as a reference position for recording the captured image in a state where there is no blur of a main subject in the specific area in a direction perpendicular to the line; An electronic device comprising:

2. The control means further controls the display so that an item indicating the specific area is superimposed on the image displayed in the live view.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

3. The straight line passing through the center of the specific region is a horizontal or vertical straight line.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

4. The control means uses a vertical line as the line passing through the center of the specific area when a horizontal component of the motion vector of the main subject in the captured image is larger than a vertical component of the motion vector, and uses a horizontal line as the line passing through the center of the specific area when the vertical component of the motion vector is larger than a horizontal component of the motion vector.

4. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

5. The control means uses a straight line perpendicular to a direction corresponding to a moving direction of an imaging device used to capture the image as the straight line passing through the center of the specific area.

4. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

6. The accepting means is further capable of accepting a second operation that specifies a direction relative to the straight line that passes through the center of the specific area.

4. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

7. the second operation is an operation for specifying a moving direction of an imaging device used to capture the image, or a direction of the blur that reduces the magnitude of the blur, The control means uses a straight line perpendicular to the direction specified in the second operation as the straight line passing through the center of the specific area.

7. The electronic device according to claim 6, wherein the electronic device is a semiconductor device.

8. The control means further controls the display of a second indicator at a position on the line passing through the center of the specific area, and does not control the display of an indicator at a position on another line passing through the center of the specific area.

8. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

9. the straight line passing through the center of the specific region is a horizontal or vertical straight line, The control means further controls to display a third indicator indicating the center of the specific area in the horizontal direction and a fourth indicator indicating the center of the specific area in the vertical direction.

8. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

10. The first indicator has, as a component, a line segment that is parallel to the line that passes through the center of the specific area.

10. The electronic device according to claim 1.

11. The control means controls the display of the first indicator to change its display mode depending on the magnitude of the shake.

11. The electronic device according to claim 1.

12. The control means controls the display of the first indicator by changing at least one of the number of components of the first indicator and the color of the first indicator according to the magnitude of the shake.

12. The electronic device according to claim 11.

13. The control means controls the display of the first indicator outside the specific area.

13. The electronic device according to claim 1.

14. The accepting means is further capable of accepting a third operation for specifying a distance from the specific area to the first indicator in a direction parallel to the line passing through the center of the specific area.

14. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

15. The control means further determines a distance from the specific region to the first indicator in a direction parallel to the line passing through the center of the specific region, depending on the size of the main subject in the captured image.

14. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

16. The control means determines, as the distance from the specific region to the first indicator in a direction parallel to the line passing through the center of the specific region, a longer distance as the size of the main subject increases.

16. The electronic device according to claim 15.

17. The specific area is an area where autofocusing is performed.

17. The electronic device according to claim 1.

18. receiving an operation to change the position of a specific area set in a part of a captured image; controlling the display of the captured image in a live view, and controlling the display of a first indicator that indicates the degree of blur by a position relative to a reference position, the first indicator being a reference position for recording the captured image in a state where the main subject in the specific area is free from blur in a direction perpendicular to the line; 1. A method for controlling an electronic device, comprising:

19. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 17.

20. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 17.

Images