Imaging apparatus, control method for the same, and program

The imaging device improves review photography by dynamically controlling focus display based on subject recognition, ensuring clear focus indication without obstructing the subject, thus enhancing operational comfort and visibility.

JP2024169176APending Publication Date: 2024-12-05CANON KK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023086425
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-25
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

In review photography, it is difficult for photographers to check if they or the object is in focus due to large distances, and constant focus frame display impedes visibility of the subject's condition, necessitating improved coexistence of focus display and object visibility.

Method used

An imaging device that recognizes the photographer as a main subject and a non-person object as a sub-subject, controlling the display to composite or not composite focus displays based on focus status, and optionally using different focus displays or zoom operations to enhance visibility.

Benefits of technology

Enhances operability in review photography by ensuring clear focus indication without obstructing the subject's visibility, allowing comfortable and intuitive operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024169176000001_ABST
    Figure 2024169176000001_ABST
Patent Text Reader

Abstract

To achieve comfortable operability in review mode photography.SOLUTION: An imaging apparatus of the present invention has recognition means that recognizes, from an image obtained by imaging means picking up an image of a subject, a person as a main subject and an object other than the person as a sub subject; and control means that, according to a result of recognition performed by the recognition means, controls display means displaying the image picked up by the imaging means. When a first mode is selected, the control means causes the display means to display an image obtained by combining focusing display displaying an object to be focused with the image obtained by the imaging means, regardless of whether the imaging apparatus focuses on the main subject or the sub subject, and when a second mode is selected, does not combine the focusing display when the imaging apparatus focuses on the main subject and causes the display means to display the image obtained by combining the focusing display when the imaging apparatus focuses on the sub subject.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging apparatus, and a control method and program thereof. [Background technology]

[0002] In recent years, the number of opportunities for video shooting and creators has increased, and VLOG shooting, which records daily life, has been attracting attention. Among them, there is product review shooting, where the cameraman picks up a specific object (such as a product) and explains the features and appeal of the object, and some cameras are equipped with a review shooting mode. When operating in review shooting mode, this camera controls the camera to focus on the object to be introduced if it is located closer to the cameraman, and to focus on the person if not, improving the quality of the video.

[0003] As a similar prior art, Patent Document 1 proposes a technology that assists the photographer by searching / displaying the next subject to focus on when shooting a large number of subjects. For this purpose, subject information is registered in the camera in advance. The camera is equipped with a mode in which an AF frame is displayed for the registered subject and AF is performed, and a face detection mode in which the AF frame and / or the subject's name frame are displayed but no AF frame tracking is performed.

[0004] Furthermore, Patent Document 2 discloses a camera that, when a user selects a subject within the screen displayed on the camera's display unit, displays the amount of defocus between the current focus position and the focus position of the selected subject, and also displays where the current focus position is within the defocus display. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2010-230871 A [Patent Document 2] JP 2016-142779 A Summary of the Invention [Problem to be solved by the invention]

[0006] Regarding the background technology described above, there are two problems to be solved when taking review shots: The first problem is that when the distance between the photographer and the monitor is relatively large, it becomes difficult for the photographer to confirm whether the focus is on himself (the photographer) or on the object (the review subject).

[0007] The second issue is that, although users want to check the photographer's facial expression or the appearance of the subject being reviewed, constantly displaying a frame around the subject that is displayed as in focus impairs the visibility of the subject's condition. There is a need to solve the above issue and improve the coexistence of focus display and subject visibility. In addition, many publicly known product specifications do not display focus during review mode in order to prioritize the second solution.

[0008] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a technique for realizing comfortable operability in review mode photography. [Means for solving the problem]

[0009] In order to solve the above problems, the present invention has the following configuration. a recognition means for recognizing a person as a main subject and a non-human object as a sub-subject from an image obtained by an imaging means for imaging a subject; a control means for controlling a display means for displaying an image captured by the imaging means in accordance with a recognition result by the recognition means, The control means When a first mode is selected, regardless of whether the main subject or the sub-subject is in focus, an image obtained by the imaging means and a focus indication showing a focus target are displayed on the display means; When the second mode is selected, the display means displays an image on which the in-focus indication is not synthesized when the main subject is in focus, and displays an image on which the in-focus indication is synthesized when the sub-subject is in focus. 1. An imaging device comprising: Effect of the Invention

[0010] According to the present invention, comfortable operability can be achieved in review photography. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is an external view showing the configuration of a digital camera according to a first embodiment. [Diagram 2] FIG. 1 is a block diagram of a digital camera according to a first embodiment. [Diagram 3] FIG. 4 is a view showing an example of a setting screen displayed on the digital camera of the first embodiment. [Figure 4] FIG. 4 is a transition diagram of a display screen in the first embodiment. [Diagram 5] 3 is a flowchart according to the first embodiment. [Figure 6] FIG. 11 is a transition diagram of a display screen according to the second embodiment. [Figure 7] 11 is a flowchart of a second embodiment. [Figure 8] FIG. 13 is a transition diagram of a display screen according to the third embodiment. [Figure 9] 13 is a flowchart of a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0013] A first preferred embodiment of the present invention will be described below with reference to the drawings. FIG. 1(a) and FIG. 1(b) show external views of a digital camera 100 capable of capturing and recording still images and moving images, as an example of an apparatus to which the present embodiment can be applied. The digital camera 100 is an example of an imaging apparatus. FIG. 1(a) is a front perspective view of the digital camera 100, and FIG. 1(b) is a rear perspective view of the digital camera 100. In FIG. 1, a display unit 28 is a display unit provided on the rear surface of the camera that displays images and various information. The touch panel 70a can detect touch operations on the display surface (operation surface) of the display unit 28. An outside-finder display unit 43 is a display unit provided on the top surface of the camera, and displays various settings of the camera, including the shutter speed and aperture.

[0014] The shutter button 61 is an operation unit for issuing shooting instructions. The mode change switch 60 is an operation unit for switching between various modes. The terminal cover 40 is a cover that protects a connector (not shown) that connects a connection cable with an external device to the digital camera 100. The main electronic dial 71 is a rotating operation member included in the operation unit 70, and by turning this main electronic dial 71, settings such as the shutter speed and aperture can be changed.

[0015] The power switch 72 is an operating member that switches the power of the digital camera 100 between ON and OFF. The sub electronic dial 73 is a rotating operating member included in the operating unit 70, and is used to move the selection frame, advance images, etc. The cross key 74 is a cross key operating member (four-way key) included in the operating unit 70, and has push buttons that can be pressed in four directions, up, down, left, and right. Depending on the direction in which the cross key 74 is pressed, an operation corresponding to the part pressed can be performed.

[0016] The SET button 75 is included in the operation unit 70 and is a push button that is mainly used to confirm selection items. The video button 76 is used to start and stop video shooting (recording). The AE lock button 77 is included in the operation unit 70 and can fix the exposure state by pressing it in the shooting standby state. The enlarge button 78 is included in the operation unit 70 and is an operation button for turning the enlargement mode ON and OFF in the live view display in the shooting mode.

[0017] By turning on the enlargement mode and then operating the main electronic dial 71, the live view image can be enlarged or reduced. In the playback mode, it functions as a magnification button for enlarging the playback image and increasing the magnification ratio. The playback button 79 is included in the operation unit 70, and is an operation button for switching between the shooting mode and the playback mode. Pressing the playback button 79 during the shooting mode switches to the playback mode, and the most recent image of the images recorded on the recording medium 200 can be displayed on the display unit 28.

[0018] Menu button 81 is included in operation unit 70, and by pressing it, a menu screen in which various settings can be made is displayed on display unit 28. The user can intuitively make various settings using the menu screen displayed on display unit 28, the cross key 74, the SET button 75, or the multi-controller (hereinafter, MC) 65. MC 65 can accept directional instructions in eight directions and a push operation on the center portion.

[0019] The communication terminal 10 is a communication terminal through which the digital camera 100 communicates with a lens unit 150 (detachable) described below. The eyepiece 16 is an eyepiece of an eyepiece finder (a peer-type finder), and the user can view an image displayed on an internal EVF (Electric View Finder) 29 through the eyepiece 16. The eyepiece detection unit 57 is an eyepiece detection sensor that detects whether or not the photographer has placed his or her eye close to the eyepiece 16. The lid 202 is a lid for a slot that stores a recording medium 200.

[0020] Grip unit 90 is a holding unit shaped to be easily held in the right hand when the user holds digital camera 100. Shutter button 61 and main electronic dial 71 are located at positions that can be operated with the index finger of the right hand when the user holds the digital camera by gripping grip unit 90 with the little finger, ring finger, and middle finger of the right hand. In the same state, sub electronic dial 73 is located at a position that can be operated with the thumb of the right hand.

[0021] FIG. 2 is a block diagram showing an example of the configuration of a digital camera 100 according to this embodiment. In FIG. 2, a lens unit 150 is a lens unit equipped with an interchangeable photographing lens. The lens 103 is usually composed of multiple lenses, but is shown here as a single lens for simplicity. A communication terminal 6 is a communication terminal through which the lens unit 150 communicates with the digital camera 100. The lens unit 150 communicates with the system control unit 50 via this communication terminal 6 and the above-mentioned communication terminal 10, and controls the aperture 1 via the aperture drive circuit 2 by the internal lens system control circuit 4. After that, the lens unit 150 adjusts the focus by displacing the lens 103 via the AF drive circuit 3 by the lens system control circuit 4.

[0022] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50 .

[0023] The imaging unit 22 is an imaging element configured with a CCD, CMOS element, etc., which converts an optical signal of an optical image captured through a lens into an electrical signal. The A / D converter 23 is used to convert an analog signal output from the imaging unit 22 into a digital signal.

[0024] The image processing unit 24 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on the data from the A / D converter 23 or data from the memory control unit 15 described later. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data. The system control unit 50 performs exposure control and distance measurement control based on the arithmetic results obtained by the image processing unit 24. This allows TTL (through-the-lens) type AF (autofocus) processing, AE (autoexposure) processing, and EF (flash pre-flash) processing to be performed. The image processing unit 24 further performs predetermined arithmetic processing using the captured image data, and performs TTL type AWB (auto white balance) processing based on the arithmetic results obtained.

[0025] The memory control unit 15 controls data transmission and reception between the A / D converter 23, the image processing unit 24, and the memory 32. Output data from the A / D converter 23 is written into the memory 32 via the image processing unit 24 and the memory control unit 15, or directly via the memory control unit 15. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, and image data to be displayed on the display unit 28 and the EVF 29. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio.

[0026] The memory 32 also serves as a memory (video memory) for displaying images. The image data for display written in the memory 32 is displayed by the display unit 28 and the EVF 29 via the memory control unit 15. The display unit 28 and the EVF 29 perform display on a display device such as an LCD or an organic EL in response to a signal from the memory control unit 15. A live view display (LV display) can be performed by sequentially transferring and displaying data that has been A / D converted by the A / D converter 23 and stored in the memory 32 to the display unit 28 or the EVF 29. Hereinafter, an image displayed in live view will be referred to as a live view image (LV image).

[0027] The infrared light emitting diode 166 is a light emitting element for detecting the position of the user's line of sight within the viewfinder screen, and irradiates infrared light onto the user's eyeball (eye) 161 placed against the eyepiece 16. The infrared light emitted from the infrared light emitting diode 166 is reflected by the eyeball (eye) 161, and the reflected infrared light reaches the dichroic mirror 162. The dichroic mirror 162 reflects only the infrared light and transmits visible light. The reflected infrared light, whose optical path has been changed, forms an image on the imaging surface of the line of sight detection sensor 164 via the imaging lens 163. The imaging lens 163 is an optical member that constitutes the line of sight detection optical system. The line of sight detection sensor 164 is composed of an imaging device such as a CCD image sensor.

[0028] The gaze detection sensor 164 photoelectrically converts the incident infrared reflected light into an electric signal and outputs it to the gaze detection circuit 165. The gaze detection circuit 165 includes at least one processor, and detects the user's gaze position from the image or movement of the user's eyeball (eye) 161 based on the output signal from the gaze detection sensor 164, and outputs the detection information to the system control unit 50. In this manner, the dichroic mirror 162, the imaging lens 163, the gaze detection sensor 164, the infrared light emitting diode 166, and the gaze detection circuit 165 configure the gaze detection block 160.

[0029] The gaze detection block 160 of this embodiment detects the gaze of the user by a method called the corneal reflex method. The corneal reflex method is a method for detecting the direction and position of the gaze from the positional relationship between the light reflected by the cornea of ​​the eyeball (eye) 161 and the pupil of the eyeball (eye) 161, which is infrared light emitted from an infrared light emitting diode 166. There are also various other methods for detecting the direction and position of the gaze, such as a method called the scleral reflex method that utilizes the difference in light reflectance between the black and white of the eye. Note that a gaze detection means other than the above may be used as long as it can detect the direction and position of the gaze.

[0030] Various settings of the camera, including the shutter speed and aperture, are displayed on the outside viewfinder display section 43 via an outside viewfinder display section drive circuit 44 .

[0031] The non-volatile memory 56 is an electrically erasable and recordable memory, and may be, for example, a Flash-ROM. Constants, programs, and the like for the operation of the system control unit 50 are stored in the non-volatile memory 56. The programs referred to here are computer programs for executing various flowcharts described later in this embodiment.

[0032] The system control unit 50 is a control unit that is made up of at least one processor or circuit, and controls the entire digital camera 100. The processor may be, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), or a quantum processing unit (QPU), or a combination of these.

[0033] The system control unit 50 realizes each process of this embodiment, which will be described later, by executing the programs recorded in the nonvolatile memory 56. The system memory 52 may be, for example, a RAM, in which constants and variables for the operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like are loaded. The system control unit 50 also performs display control by controlling the memory 32, the display unit 28, and the like.

[0034] The system control unit 50 switches the shooting mode according to, for example, setting information set by the user. The shooting modes include, for example, a normal mode in which an image is displayed with a focus indication indicating a focused target, regardless of the subject, and a review mode in which an image is displayed without a focus indication when a person is focused, and an image with a focus indication is displayed when a non-person object such as a product is focused. The review mode is, for example, a product introduction mode in which a product is introduced. The normal mode is an example of a first mode, and the review mode is an example of a second mode.

[0035] The system timer 53 is a timing unit that measures the time used for various controls and the time of a built-in clock.

[0036] The mode changeover switch 60, the first shutter switch 62, the second shutter switch 64, and the operation unit 70 are operation means for inputting various operation instructions to the system control unit 50. The mode changeover switch 60 switches the operation mode of the system control unit 50 to one of a still image shooting mode, a video shooting mode, etc. Modes included in the still image shooting mode include an auto shooting mode, an auto scene discrimination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). In addition, there are various scene modes and custom modes that are shooting settings according to shooting scenes. The mode changeover switch 60 allows the user to directly switch to one of these modes. Alternatively, after switching to a list screen of shooting modes with the mode changeover switch 60, one of the displayed modes may be selected and switched using other operation members. Similarly, the video shooting mode may also include multiple modes.

[0037] The first shutter switch 62 is turned on and generates a first shutter switch signal SW1 when the shutter button 61 provided on the digital camera 100 is pressed halfway (instruction to prepare for shooting) during operation of the shutter button 61. The first shutter switch signal SW1 starts shooting preparation operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing.

[0038] The second shutter switch 64 is turned on when the shutter button 61 is fully pressed (photographing instruction) and generates a second shutter switch signal SW2. The system control unit 50 starts a series of photographing processing operations, from reading out a signal from the imaging unit 22 to writing the captured image to the recording medium 200 as an image file, in response to the second shutter switch signal SW2.

[0039] The operation unit 70 is a variety of operation members that serve as an input unit for accepting operations from the user. The operation unit 70 includes at least the following operation units: the shutter button 61, the multi-controller 65, the touch panel 70a, the main electronic dial 71, the power switch 72, the sub electronic dial 73, the cross key 74, the SET button 75, the movie button 76, the AE lock button 77, the enlargement button 78, the playback button 79, and the menu button 81.

[0040] The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to which electricity is applied, etc., and detects whether a battery is attached, the type of battery, and the remaining battery power. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the necessary voltage for the necessary period to each unit including the recording medium 200. The power supply unit 30 is composed of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, and Li batteries, an AC adapter, etc.

[0041] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0042] The communication unit 54 is connected wirelessly or via a wired cable, and transmits and receives image signals and audio signals. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can also communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including live view images) captured by the imaging unit 22 and images recorded on the recording medium 200, and can also receive images and various other information from external devices.

[0043] The attitude detection unit 55 detects the attitude of the digital camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 55, it is possible to determine whether the image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the attitude detection unit 55. It is also possible to detect the movement of the digital camera 100 (panning, tilting, lifting, whether it is stationary, etc.) using the acceleration sensor or gyro sensor that is the attitude detection unit 55.

[0044] The eye contact detection unit 57 is an eye contact detection sensor that detects the approach (eye contact) and departure (eye separation) of the eye (object) 161 to the eyepiece unit 16 of the finder (approach detection). The system control unit 50 switches between display (display state) and non-display (non-display state) of the display unit 28 and the EVF 29 according to the state detected by the eye contact detection unit 57. More specifically, when at least the digital camera 100 is in a shooting standby state and the switching setting of the display destination of the live view image captured by the imaging unit 22 is the automatic switching setting, the display destination is set to the display unit 28 and the display is turned on and the EVF 29 is turned off while the eye is not placed in contact. Also, when the eye is placed in contact, the display destination is set to the EVF 29 and the display is turned on and the display unit 28 is turned off. The eye contact detection unit 57 can be, for example, an infrared proximity sensor, and can detect the approach of some object to the eyepiece unit 16 of the finder that has the EVF 29 built in. When an object approaches, infrared light projected from a light-projecting portion (not shown) of eyepiece detection unit 57 is reflected and received by a light-receiving portion (not shown) of the infrared proximity sensor. Depending on the amount of infrared light received, it is also possible to determine how close the object is to eyepiece 16 (eyepiece distance).

[0045] In this way, the eyepiece detection unit 57 performs eyepiece detection to detect the proximity of an object to the eyepiece unit 16. In this embodiment, the light-emitting unit and the light-receiving unit of the eyepiece detection unit 57 are devices separate from the infrared light-emitting diode 166 and the line-of-sight detection sensor 164 described above. However, the light-emitting unit of the eyepiece detection unit 57 may also be the infrared light-emitting diode 166. Also, the light-receiving unit may also be the line-of-sight detection sensor 164. When an object approaching within a predetermined distance from the non-eyepiece state (non-approaching state) is detected, it is detected that the eye has been placed in contact with the object. When an object whose approach was detected is moved away from the eyepiece state (approaching state) by a distance of more than a predetermined distance, it is detected that the eye has been moved away. The threshold value for detecting eyepiece and the threshold value for detecting eye-movement may be different, for example, by providing a hysteresis. Also, after detecting eye-movement, it is assumed that the eye is in the eye-movement state until eye-movement is detected. After detecting eye-movement, it is assumed that the eye is in the non-eyepiece state until eye-movement is detected. The infrared proximity sensor is just one example, and other sensors may be used for eye proximity detection unit 57 as long as they can detect the approach of an eye or an object that can be regarded as an eye.

[0046] The system control unit 50 can detect the following operations or states based on the output from the line of sight detection block 160. The first detection of the user's eyes approaching the eyepiece 16 (the start of gaze input). The user's eyes are continuously in close proximity to the eyepiece unit 16 (the user's gaze input state is in progress). The user is gazing at the eyepiece 16. The user's eyes have changed from a close proximity state to a non-detection state from the eyepiece unit 16 (end of gaze input). The state in which the user's eyes are not detected by the eyepiece unit 16 continues (the user is not inputting any gaze input). The term "gazing" as used herein means that the user's gaze position is within a preset range for a given period of time.

[0047] The touch panel 70a and the display unit 28 can be configured as one unit. For example, the touch panel 70a is configured so that the light transmittance does not interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. Then, input coordinates on the touch panel 70a are associated with display coordinates on the display screen of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that makes it seem as if the user can directly operate the screen displayed on the display unit 28. The system control unit 50 can detect the following operations or states on the touch panel 70a. A finger or pen that has not been touching the touch panel 70a touches the touch panel 70a again, that is, the start of touching (hereinafter referred to as touch-down). The touch panel 70a is in a state of being touched with a finger or a pen (hereinafter, referred to as Touch-On). Touching the touch panel 70a with a finger or a pen and moving it (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 70a is released, that is, the touch ends (hereinafter, referred to as "touch-up"). A state in which nothing is being touched on the touch panel 70a (hereinafter referred to as Touch-Off).

[0048] When touch-down is detected, touch-on is also detected at the same time. After touch-down, touch-on will usually continue to be detected unless touch-up is detected. Touch-move is also detected while touch-on is detected. Even if touch-on is detected, touch-move will not be detected if the touch position has not moved. After it is detected that all fingers or pens that were touching have touched up, touch-off occurs.

[0049] These operation / states and the position coordinates of the touch panel 70a touched by a finger or pen are notified to the system control unit 50 via the internal bus. The system control unit 50 determines what kind of operation (touch operation) has been performed on the touch panel 70a based on the notified information. Regarding touch-move, the moving direction of the finger or pen moving on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on changes in the position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed.

[0050] An operation in which a user touches a touch panel with a finger, moves the finger quickly for a certain distance, and then releases the finger is called a flick. In other words, a flick is an operation in which the finger quickly traces the touch panel 70a as if flicking the touch panel. When a touch-move of a certain distance or more at a certain speed or more is detected and a touch-up is detected, it can be determined that a flick has been performed (it can be determined that a flick has occurred following a slide operation).

[0051] Furthermore, a touch operation in which a user simultaneously touches multiple points (for example, two points) and brings the touch positions closer to each other is called a pinch in, and a touch operation in which the touch positions move away from each other is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply pinch).

[0052] The touch panel 70a may be any of various touch panel types, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, an optical sensor type, etc. There are touch panel types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or a pen to the touch panel, and any type may be adopted in this embodiment.

[0053] When a touch-move operation is performed in the eye-closed state, the user can set the method of specifying the position of the position index according to the touch-move operation to either absolute position specification or relative position specification. For example, when the position index is an AF frame and absolute position specification is used, when the touch panel 70a is touched, an AF position corresponding to the touched position (position where the coordinates are input) is set. That is, the position coordinates where the touch operation is performed are associated with the position coordinates of the display unit 28. On the other hand, when relative position specification is used, the position coordinates where the touch operation is performed are not associated with the position coordinates of the display unit 28. When relative position specification is used, the touch position is moved from the currently set AF position in the direction of the touch-move movement by a distance corresponding to the amount of movement of the touch-move, regardless of the touch-down position on the touch panel 70a.

[0054] FIG. 3 shows a menu screen for changing settings displayed on the display unit 28 of the camera of this embodiment.

[0055] This menu screen is roughly divided into areas 300 to 303. The user selects one of the menus by touch input or by operating the up, down, left, right, or selection key.

[0056] Area 300 includes selection tabs relating to general video recording (Rec), tabs relating to autofocus (AF), and the like, and in the figure it is shown that general video recording is selected.

[0057] An area 301 is an area for selecting a mode for video shooting. In this embodiment, in addition to the P·Tv·Av·M·AUTO modes that are common in digital cameras, a Review mode is added as a product review mode.

[0058] Area 302 is for setting whether or not the product review mode is on. The user can set the review mode with this setting. Here, two setting items, area 301 and area 302, are displayed, but it is sufficient to use either one of them.

[0059] Area 303 is a display setting for sub-subject tracking in product review mode. The details will be described later in Fig. 4, but it is possible to change the display method for tracking on the screen after detecting a sub-subject using settings A, B, and C. The information relating to normal mode, review mode, and settings A to C described above is an example of setting information.

[0060] The settings from the setting units 301 to 303 are stored in the non-volatile memory 56 or the like by the system control unit 50, and the system control unit 50 controls the display in accordance with the settings.

[0061] 4 is a state transition diagram of the display on the display unit 28 of the camera of the first embodiment. Hereinafter, the state transition will be described with reference to the drawing.

[0062] For ease of understanding, an example of shooting in review mode will be described in which an image is recorded in which a user, who is the photographer, introduces a product. Here, the user is a person who explains the product and is also a photographer who photographs the product. The product is a non-human object. Hereinafter, the user will be described as the main subject and the product as the secondary subject.

[0063] The state 411 is also a screen showing a state where the photographer 401 is in focus. If the system control unit 50 does not recognize anything other than the photographer 401, it basically keeps the photographer 401 in focus. The system control unit 50 focuses on the area 402, but does not display a frame representing the area 402 on the screen of the display unit 28. In the normal mode, the system control unit 50 displays an image by synthesizing a frame surrounding at least a part of the focus target as a focus display, regardless of whether the system control unit 50 is in focus on the photographer 401 or the review target. When the system control unit 50 recognizes the review target, it transitions to the state 412. For example, the system control unit 50 recognizes an object that the user has registered in advance in the non-volatile memory 56 of the digital camera 100 as the review target. When the system control unit 50 recognizes an object other than a person, it may recognize the recognized object as the review target, or may recognize the review target by a gesture of the person, such as pointing at the object.

[0064] In state 412, the system control unit 50 focuses on the review target 403 in response to detecting the review target 403 in a stationary state. In other words, the system control unit recognizes the photographer 401 and the review target 403, and generates an image in response to the recognition result. At this time, the system control unit 50 focuses on the dashed line area 404, but the dashed line area 404 is not displayed. Instead, the system control unit 50 displays an image by synthesizing a frame 405 that includes the review target 403, which is the focus target, as a focus indication, so that the user can easily understand intuitively. Note that in state 413, an example in which the frame 405 includes the entire review target 403 is illustrated, but the system control unit 50 may display the frame 405 that surrounds at least a part (for example, the center) of the review target 403 as a focus indication. Furthermore, when the system control unit 50 detects a movement of the review target 403, it tracks the review target 403, transitions from state 412 to state 413, and continues displaying the frame 405 while moving it in accordance with the movement of the review target 403.

[0065] States 413 to 415 are movement states when the review target 403 is moved within the angle of view. First, in state 413, the system control unit 50 tracks the review target 403 within the screen using the same expression as in state 412, and makes the frame 405 follow the review target 403. Next, in state 414, the system control unit 50 hides the display of the frame 405 when the review target 403 is moving. By hiding the frame 405, the system control unit 50 can reduce display overlap with the review target 403, and the user can easily check the subject including the review target 403. Then, in state 415, the system control unit 50 expresses that the review target 403 is being tracked and focused by displaying shooting information such as an icon 409, rather than hiding the fact that the review target 403 is being focused on during movement. As described above, the system control unit 50 may devise a frame expression that indicates that the review target 403 is being focused on during movement by detecting the movement of the review target 403 and detecting the movement of the review target 403. If the system controller 50 loses track of the review target 403, the system controller 50 proceeds to state 416.

[0066] State 416 is a state in which the system control unit 50 has lost sight of the review subject 403 and is focusing on the photographer 401. This state 416 is expressed in the same way as state 411, and the frame 405 or icon 409, which indicate that the review subject 403 is in focus, is not displayed.

[0067] State 417 is a state in which the system control unit 50 is unable to detect the review object 406 and is focusing on the entire screen with close object priority. The area in focus is area 407, and the system control unit 50 does not display a frame indicating that the review object 406 has been detected, but displays an expression 408 on the periphery of the screen indicating that focus is being adjusted with close object priority. If the review object 406 moves within the screen, the system control unit 50 proceeds to state 418.

[0068] State 418 is the state when the review object 406 moves within the angle of view. At this time, the system control unit 50 updates the area to be focused in response to the movement of the review object 406, but does not change the frame representation, etc. If the system control unit 50 loses sight of the review object 406, it proceeds to state 416.

[0069] The transition state in this embodiment has been described above.

[0070] Next, the processing contents of the system control unit 50 in the embodiment will be described with reference to the flowchart of the first embodiment in Fig. 5. Each step is realized by the system control unit 50 expanding a program stored in the non-volatile memory 56 into the system memory 52 and executing it.

[0071] In S501, the system control unit 50 determines whether the currently set mode is the review mode. If the system control unit 50 determines that the system is currently operating in the review mode, the process proceeds to S502, and if not, the process ends.

[0072] In S502, the system control unit 50 hides the frame indicating the photographer. Note that the system control unit 50 continues to focus on the photographer without hiding the frame.

[0073] In S503, the system control unit 50 determines whether the sub-subject to be reviewed appears in the captured image. If the system control unit 50 determines that the sub-subject to be reviewed appears in the captured image, the process proceeds to S504. If not, the system control unit 50 proceeds to S505.

[0074] In S504, the system control unit 50 focuses on the review target and displays a frame around the review target (state 412). If the system control unit 50 is unable to recognize the review target but determines that an object other than the photographer has appeared closer than the photographer, the system control unit 50 notifies the user by displaying a different frame (state 417).

[0075] In S505, the system control unit 50 determines whether the sub-subject to be reviewed has moved within the screen. If it is determined that the sub-subject has moved, the system control unit 50 proceeds to S506, and if it is determined that the sub-subject has not moved, the system control unit 50 proceeds to S510. The system control unit 50 also proceeds to S510 when the review subject is not detected in S503.

[0076] In S506, the system control unit 50 determines the setting of the frame display specification when the review target moves. If the setting is A, which tracks the frame even when the review target moves, the system control unit 50 proceeds to S507, if the setting is B, which hides the frame, the system control unit 50 proceeds to S508, and if the setting is C, which changes the expression of the frame, the system control unit 50 proceeds to S509.

[0077] In S507, the system control unit 50 aligns the frame displayed in S504 with the review target and tracks it (state 413).

[0078] In S508, the system control unit 50 makes the frame displayed in S504 non-displayable (state 414).

[0079] In S509, the system control unit 50 indicates that the review subject is in focus using an expression different from the frame displayed in S504 (state 415).

[0080] In S510, the system control unit 50 determines whether the sub-subject of the review target has become undetected. If the system control unit 50 determines that the review target has become undetected, the process proceeds to S511, and if the review target remains detected, the process proceeds to S512. The system control unit 50 also proceeds to S512 when the review target has not been detected in S503.

[0081] In S511, the system control unit 50 makes the frame indicating the state in which the review subject is in focus invisible, and focuses on the photographer.

[0082] In S512, the system control unit 50 determines whether the review mode has ended. If the review mode has ended, the system control unit 50 ends the process, and if the review mode is continuing, the system control unit 50 repeats the process from S502 onwards.

[0083] As described above, in this embodiment, as shown in the state transitions and flowcharts based on the first embodiment, when in review mode for reviewing products, a frame is displayed when the focus is on the review subject, but when the focus is on the photographer, the frame is not displayed, thereby achieving comfortable operability in the review mode.

[0084] In the review shooting, the user shoots and records a video introducing a product, but when recording a video introducing a new product, it is necessary to register the new product as a sub-subject in advance. If the product registration operation and the review mode operation are performed in a series of operations, convenience is increased. Therefore, when the system control unit 50 judges Yes in S501, it may prompt the user to shoot from a plurality of pre-set viewpoints in order to correctly recognize the product to be introduced, and perform the shooting and registration process. After performing the registration operation, the system control unit 50 may proceed to the process from S502 onwards.

[0085] 6 is a diagram showing state transitions in the second embodiment. A description will be given using states 611 to 613.

[0086] In state 611, the photographer 601 is in focus. If the system control unit 50 detects nothing other than the photographer 601, the system control unit 50 basically continues to focus on the photographer 601. At this time, the system control unit 50 focuses on the area 602, and does not display a frame for this area on the screen of the display unit 28. When a review target appears, the system control unit 50 proceeds to state 612 or state 613. At this time, the system control unit 50 switches the focus display based on the anteroposterior relationship between the photographer 601 and the review target. For example, when the review target is closer to the photographer 601 (closer side) as viewed from the digital camera 100, the system control unit 50 proceeds to state 612, and when the review target is farther from the photographer (infinity side), the system control unit 50 proceeds to state 613.

[0087] State 612 is a state in which the review object 603 has been detected and is in focus on the review object closer to the photographer 601, who is the subject that was previously tracked. At this time, the area in which the focus is adjusted to match the position of the review object 603 is area 604, and the system control unit 50 displays a frame 605 indicating the position of the review object 603. When the review object 603 moves within the screen, the system control unit 50 causes a transition similar to the transition from state 413 to state 415 in FIG. 4 described above.

[0088] State 613 is a state in which the review object 606 has been detected and is in focus on the review object 606, which is closer to the infinity side than the photographer 601, who is the subject that was previously being tracked. At this time, the area in which the focus is adjusted to match the position of the review object 606 is area 607, and the system control unit 50 displays a frame 608 indicating the position of the review object 606. When the review object 606 moves within the screen, the system control unit 50 causes a transition similar to the transition from state 413 to state 415 in FIG. 4 described above.

[0089] As described above, the system control unit 50 may change the frame expression depending on whether the review subject is located closer to the photographer or on the infinity side from the camera.

[0090] 7 is a flowchart showing the process of the second embodiment. Each process is realized by the system control unit 50 expanding a program stored in the non-volatile memory 56 into the system memory 52 and executing it. In the following flowchart, the process and control are performed by the system control unit 50. Note that S501 to S512 are the same as in FIG. 5, so the description will be omitted.

[0091] In S701, the system control unit 50 determines the positional relationship between the sub-subject to be reviewed detected in S503 and the photographer, and if the sub-subject to be reviewed is closer to the photographer (closer), the system control unit 50 proceeds to S702, and if the sub-subject to be reviewed is further away (towards infinity), the system control unit 50 proceeds to S703.

[0092] In S702, the system control unit 50 displays a frame on the close side of the review object (state 612), while keeping the focus on the sub-subject of the review object.

[0093] In S703, a frame on the infinity side of the review object is displayed (state 613). At this time, the focus is kept on the sub-subject of the review object.

[0094] As described above, the state transitions and flow chart based on the second embodiment are used to improve the frame expression in the product review mode, thereby achieving improved operability.

[0095] 8 is a diagram showing state transitions in the third embodiment. A description will be given using states 811 to 813 shown in FIG.

[0096] State 811 is a state in which the photographer 801 is in focus. If the system control unit 50 detects nothing other than the photographer 801, it basically continues to focus on the photographer 801. At this time, the area in focus is area 802, and the system control unit 50 does not display a frame on the screen of the display unit 28. When a review target appears, the system control unit 50 proceeds to state 812.

[0097] State 812 is a state in which the review object 803 has been detected and is in focus. At this time, the area in focus according to the position of the review object 803 is area 804. This differs from the first and second embodiments in that the system control unit 50 notifies the user that the review object 803 is in focus by a means other than a frame representation. State 812 is the moment when the system control unit 50 detects the review object 803, and has the same angle of view as state 811 (display 805).

[0098] State 813 is the state when a predetermined time has elapsed since the review object 803 was detected. At this time, the area to be focused on according to the position of the review object 803 is area 804. When the system control unit 50 detects the review object 803, it gradually executes zoom processing toward the review object 803 (display 806). This allows the photographer to confirm that the review object 803 is in focus without having to check the frame representation. Although this diagram shows an example in which the system control unit 50 performs zooming in the enlargement direction, the system control unit 50 may also perform zooming in the reduction direction depending on the size of the sub-subject of the review object 803.

[0099] As described above, when the system control unit 50 detects the review subject and focuses on the review subject, it automatically performs a zoom operation of the camera to match the review subject and notifies the photographer that the review subject has been focused on.

[0100] 9 is a flowchart showing the processing of the third embodiment. Each processing is realized by the system control unit 50 expanding a program stored in the non-volatile memory 56 into the system memory 52 and executing it. Regarding the following flowchart, the processing and control are performed by the system control unit 50. Note that S501 to S512 are the same as in FIG. 5, so the explanation will be omitted.

[0101] In S901, the system control unit 50 performs zooming on the sub-subject of the review target detected in S503. The system control unit 50 performs zooming in the optimal direction (enlargement / reduction) so that the review target fits within the angle of view. Also, the system control unit 50 may improve the quality of the video by having the user set the direction in advance.

[0102] In S902, the system control unit 50 performs zooming to the original angle of view, contrary to the zooming in S901. At this time, the system control unit 50 may control the photographer to perform zooming.

[0103] As described above, the system control unit 50 improves operability by improving the frame expression in the product review mode using the state transitions and flowcharts based on the third embodiment.

[0104] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0105] The disclosure of this specification includes the following imaging device, method, and program. (Item 1) a recognition means for recognizing a person as a main subject and a non-human object as a sub-subject from an image obtained by an imaging means for imaging a subject; a control means for controlling a display means for displaying an image captured by the imaging means in accordance with a recognition result by the recognition means, The control means When a first mode is selected, regardless of whether the main subject or the sub-subject is in focus, an image obtained by the imaging means and a focus indication showing a focus target are displayed on the display means; When the second mode is selected, the display means displays an image on which the in-focus indication is not synthesized when the main subject is in focus, and displays an image on which the in-focus indication is synthesized when the sub-subject is in focus. 1. An imaging device comprising: (Item 2) The control means does not synthesize the in-focus indication when the sub-subject is moving. 2. The imaging device according to item 1, (Item 3) The control means causes the display means to display an image synthesized with a first focus indication when the sub-subject is stationary, and causes the display means to display an image synthesized with a second focus indication different from the first focus indication when the sub-subject is moving. 3. The imaging device according to item 1 or 2, (Item 4) The control means switches the in-focus display based on a front-back relationship between the main subject and the sub-subject. 4. The imaging device according to claim 1, wherein: (Item 5) The control means displays the in-focus indication as a frame, and when the sub-subject is located behind the main subject, the frame is larger than when the sub-subject is located in front of the main subject. 5. The imaging device according to claim 1, wherein: (Item 6) When the sub-subject is focused, the control means causes the display means to display a zoomed image of the sub-subject as the focus display. 6. The imaging device according to claim 1, wherein: (Item 7) A control method for an imaging device, comprising: a recognition step of recognizing a person as a main subject and a non-human object as a sub-subject from an image obtained by an imaging means for imaging a subject; a control step of controlling a display means for displaying an image captured by the imaging means in accordance with a recognition result by the recognition step, The control step includes: When a first mode is selected, regardless of whether the main subject or the sub-subject is in focus, an image obtained by the imaging means and a focus indication showing a focus target are displayed on the display means; When the second mode is selected, the display means displays an image on which the in-focus indication is not synthesized when the main subject is in focus, and displays an image on which the in-focus indication is synthesized when the sub-subject is in focus. 23. A method for controlling an imaging apparatus comprising the steps of: (Item 8) A program that, when read and executed by a computer, causes the computer to execute each step of the method according to item 7.

[0106] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0107] 100: imaging device, 50: system control unit, 28: display unit, 22: imaging unit, 70: operation unit

Claims

1. a recognition means for recognizing a person as a main subject and a non-human object as a sub-subject from an image obtained by an imaging means for imaging a subject; a control means for controlling a display means for displaying an image captured by the imaging means in accordance with a recognition result by the recognition means, The control means When a first mode is selected, regardless of whether the main subject or the sub-subject is in focus, an image obtained by the imaging means and a focus indication showing a focus target are displayed on the display means; When the second mode is selected, the image is displayed on the display means without the focus indication when the main subject is in focus, and an image with the focus indication is displayed on the display means when the sub-subject is in focus.

1. An imaging device comprising:

2. The control means does not synthesize the in-focus indication when the sub-subject is moving.

2. The imaging device according to claim 1 .

3. The control means causes the display means to display an image combined with a first focus indication when the sub-subject is stationary, and causes the display means to display an image combined with a second focus indication different from the first focus indication when the sub-subject is moving.

2. The imaging device according to claim 1 .

4. The control means switches the in-focus display based on a front-back relationship between the main subject and the sub-subject.

2. The imaging device according to claim 1 .

5. The control means displays the in-focus indication as a frame, and when the sub-subject is located behind the main subject, the frame is larger than when the sub-subject is located in front of the main subject.

5. The imaging device according to claim 4.

6. When the sub-subject is focused, the control means causes the display means to display a zoomed image of the sub-subject as the focus display.

2. The imaging device according to claim 1 .

7. A control method for an imaging device, comprising: a recognition step of recognizing a person as a main subject and a non-human object as a sub-subject from an image obtained by an imaging means for imaging a subject; a control step of controlling a display means for displaying an image captured by the imaging means in accordance with a recognition result by the recognition step, The control step includes: When a first mode is selected, regardless of whether the main subject or the sub-subject is in focus, an image obtained by the imaging means and a focus indication showing a focus target are displayed on the display means; When the second mode is selected, the image is displayed on the display means without the focus indication when the main subject is in focus, and an image with the focus indication is displayed on the display means when the sub-subject is in focus.

23. A method for controlling an imaging apparatus comprising the steps of:

8. A program for causing a computer to execute each step of the method according to claim 7 when the program is read and executed by the computer.

Citation Information

Patent Citations

  • Auto focus system

    JP2010230871A

  • Imaging device

    JP2016142779A