Imaging device, imaging control method, and program
By introducing a set registration unit, an identification unit and an imaging control unit in the imaging device, automatic identification and focus of different subject types is realized, and the problem of complex operation when switching subject types in the prior art is solved, thereby improving user experience .
Patent Information
- Application Number
- CN202380029305.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-30
- Filing Date
- 2023-03-09
- Publication Date
- 2024-11-15
AI Technical Summary
The existing imaging devices require the user to manually switch the imaging settings when switching the subject type, resulting in complex operations.
An imaging device is designed, including a setting registration unit, an identification unit and an imaging control unit. The user pre-registers the imaging settings of each subject type. The recognition unit recognizes the subject type based on the image, and the imaging control unit automatically adjusts the imaging parameters.
It realizes that the target and subject type are automatically identified and focused without forcing the user to perform complex operations, and simplifies the user's operation process.
Smart Images

Figure CN118975263A_ABST
Abstract
Description
Technical Field
[0001] The present technology relates to an imaging device, an imaging control method, and a program, and particularly, to a technology for registering imaging settings for each subject type. Background Art
[0002] The imaging device (camera) has a function of recognizing a specific subject such as a person's face in an image and focusing on the subject (see, for example, Patent Document 1).
[0003] Reference List
[0004] Patent Literature
[0005] Patent Document 1WO 2015 / 045911 A Summary of the invention
[0006] Problems to be solved by the present invention
[0007] Furthermore, in conventional imaging devices, whenever the type of a subject to be a recognition target is switched, the user manually switches the imaging setting. Therefore, such imaging devices force the user to perform complicated operations.
[0008] In view of this, the present technology proposes a technology capable of performing imaging based on a subject type to be a recognition target without forcing a user to perform complicated operations.
[0009] Solution to the problem
[0010] According to an imaging device of the present technology, the imaging device includes: a setting registration unit, which registers imaging settings for each subject type; a recognition unit, which recognizes a subject from an image based on the imaging settings of the subject type to be recognized; and an imaging control unit, which controls imaging based on the subject recognized by the recognition unit.
[0011] Therefore, only by having the user register the imaging setting for each subject type in advance, it is possible to recognize and image a subject based on the imaging setting for the subject type to be the recognition target. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 The appearance of the imaging device according to the present embodiment is shown.
[0013] Figure 2 The appearance of the imaging device according to the present embodiment is shown.
[0014] Figure 3 The internal configuration of the imaging device is shown.
[0015] Figure 4 Identifiable parts for each subject type are shown.
[0016] Figure 5 The recognition part in the case where the recognition target is the subject type “bird” is shown.
[0017] Figure 6 The priority in a case where the subject type “animal+bird” is determined as the recognition target is shown.
[0018] Figure 7 The offset range is shown.
[0019] Figure 8 The offset range is shown.
[0020] Fig. 9 Tracking stickiness is shown.
[0021] Fig.10 The recognition sensitivity is shown.
[0022] Fig.11 The menu screen at the time of AF setting is shown.
[0023] Fig.12 The menu screen at the time of AF setting is shown.
[0024] Fig.13 The menu screen at the time of AF setting is shown.
[0025] Fig.14 The function menu is shown.
[0026] Fig.15 An imaging standby screen is shown.
[0027] Fig.16 On / off of AF control and identification target are shown.
[0028] Fig.17 : is a flowchart showing the flow of the setting registration process of the recognition target and the imaging setting.
[0029] Fig.18 is a flowchart showing the automatic focus control process.
[0030] Fig.19 A display of imaging settings according to a modification is shown. DETAILED DESCRIPTION
[0031] Hereinafter, the embodiments will be described in the following order.
[0032] <1. Configuration of Imaging Device>
[0033] <2. Auto Focus Control (AF)>
[0034] <3. Imaging settings registration>
[0035] <4. Set up registration process>
[0036] <5. Automatic focus control processing>
[0037] <6. Modifications>
[0038] <7. Conclusion>
[0039] <8. This technology>
[0040] Note that the "image" in the present technology includes both still images and moving images. In addition, the "image" refers not only to the state in which the image is displayed on the display unit, but also to image data that is not displayed on the display unit.
[0041] The "subject" refers not only to a target to be captured by the imaging device 1, but also includes a subject image appearing in the image. In addition, the "subject" includes not only people, but also various objects such as animals, birds, insects, cars, and trains, and also includes a part (part) thereof.
[0042] The “subject type” indicates the type or kind of the subject, and is a person, an animal, a bird, an insect, a car, a train, etc. In addition, one subject type may include a plurality of (two or more) subject types. In addition, for example, as in the relationship between “bird” and “kingfisher”, one subject type (kingfisher) included in another subject type (bird) may be set as a subject type, respectively.
[0043] The “imaging settings” define settings (conditions) regarding imaging control such as settings used when recognizing a subject from an image and settings used when capturing an image.
[0044] <1. Configuration of Imaging Device>
[0045] Figure 1 and Figure 2 The outer appearance of the imaging device 1 according to the present embodiment is shown. Note that, in the following description, the subject side will be referred to as the front, and the imaging operator side will be referred to as the rear.
[0046] like Figure 1 and Figure 2 As shown in FIG. 1 , the imaging device 1 includes a camera housing 2 in which necessary components are provided inside and outside thereof, and a lens barrel 3 detachable from the camera housing 2 and attached to a front surface portion 2 a . Figure 2 The camera housing 2 is shown with the lens barrel removed therefrom.
[0047] Note that the lens barrel 3 is detachable as a so-called interchangeable lens, just by way of example, and may be a lens barrel that is not detachable from the camera housing 2 .
[0048] The rear monitor 4 is provided on the rear surface portion 2b of the camera housing 2. The rear monitor 4 displays a live view image, a reproduced image of a recorded image, and the like.
[0049] The back monitor 4 includes, for example, a display device such as a liquid crystal display (LCD) or an organic electroluminescence (EL) display.
[0050] The rear monitor 4 is rotatable relative to the camera housing 2. For example, the upper end portion of the rear monitor 4 is set as the rotation axis, and the lower end portion of the rear monitor 4 is rotatable to move backward. Note that the right end portion or the left end portion of the rear monitor 4 may be set as the rotation axis. In addition, the rear monitor may be rotatable in directions around a plurality of axes.
[0051] An electric viewfinder (EVF) 5 is provided on the upper surface portion 2c of the camera housing 2. The EVF 5 includes an EVF monitor 5a and a frame-like surrounding portion 5b projecting rearward to surround upper, right, and left side portions of the EVF monitor 5a.
[0052] The EVF monitor 5a includes an LCD, an organic EL display, etc. Note that an optical viewfinder (OVF) may be provided instead of the EVF monitor 5a.
[0053] Various operation elements 6 are provided on the rear surface portion 2b and the upper surface portion 2c. Examples thereof include a shutter button (release button), a reproduction menu start button, an OK button, a cross key, a cancel button, a zoom key, and a slide key.
[0054] These operating elements 6 have various forms such as buttons, dials, and push-and-rotatable composite operating elements. With the various forms of the operating elements 6, for example, shutter operation, menu operation, reproduction operation, mode selection / switching operation, focus operation, zoom operation, and selection / setting of parameters such as shutter speed and F number can be performed.
[0055] As the operation element 6 , for example, a shutter button 6 a , a plurality of custom buttons 6 b , an up button 6 c , a down button 6 d , a right button 6 e , a left button 6 f , a determination button 6 g , a menu button 6 h , and a function button 6 i are provided.
[0056] Figure 3 The internal configuration of the imaging device 1 is shown.
[0057] In the imaging device 1, light from the subject is incident on an imaging element 12 including, for example, a complementary metal oxide semiconductor (CMOS) sensor or a charge coupled device (CCD) sensor via an imaging optical system 11, and is photoelectrically converted by the imaging element 12, thereby obtaining an analog image signal from the imaging element 12.
[0058] In the imaging optical system 11, various lenses such as a zoom lens, a focus lens, a condenser lens, an aperture mechanism, a zoom lens driving mechanism, and a focus lens driving mechanism are provided. In some cases, a mechanical shutter is provided.
[0059] The imaging element 12 is formed by, for example, two-dimensionally arranging a plurality of pixels including a photodiode (photo gate), a transfer gate (shutter transistor), a switching transistor (address transistor), an amplifying transistor, a reset transistor (reset gate), etc. on a CMOS substrate and forming a vertical scanning circuit, a horizontal scanning circuit and an image signal output circuit.
[0060] The imaging element 12 may be a primary color system or a complementary color system, and the analog image signal obtained from the imaging element 12 is a primary color signal of each color of RGB or a color signal of the complementary color system. In addition, the imaging element 12 may not have a color filter, and the analog image signal obtained from the imaging element 12 may be a black and white image signal.
[0061] In the analog signal processing unit 13 configured as an integrated circuit (IC), the analog image signal from the imaging element 12 is sampled and held for each color signal, and then its amplitude is adjusted by automatic gain control (AGC), and the analog image signal is converted into a digital image signal by analog-to-digital (A / D) conversion.
[0062] A digital image signal (hereinafter, image data) from the analog signal processing unit 13 is input to the temporary storage unit 14 .
[0063] Note that the imaging element 12 and the analog signal processing unit 13, or the imaging element 12, the analog signal processing unit 13, and the temporary storage unit 14 may be integrated. In addition, a frame memory described below as the temporary storage unit 14 may be provided in the stacked imaging element.
[0064] In this example, the temporary storage unit 14 includes two frame memories 14A and 14B.
[0065] The image data from the analog signal processing unit 13 is alternately stored in the frame memories 14A and 14B. That is, the temporary storage unit 14 stores two continuously captured image frames. The image data stored in the temporary storage unit 14 is output to the digital signal processing unit 15 sequentially from the previously stored frames. That is, the image data is alternately and sequentially output to the digital signal processing unit 15 from the frame memories 14A and 14B according to the imaging order.
[0066] By providing the frame memories 14A and 14B as described above, for example, even during continuous imaging, a live view image can be continuously displayed without powering off.
[0067] For example, the digital signal processing unit 15 is configured as an image processor such as a digital signal processor (DSP). The digital signal processing unit 15 performs various types of signal processing on the input image data. For example, as camera processing, the digital signal processing unit 15 performs preprocessing, synchronization processing, YC generation processing, etc.
[0068] In addition, the digital signal processing unit 15 performs compression encoding, formatting, generation or addition of metadata, etc. for recording or communication as file formation processing on the image data subjected to those various kinds of processing, and generates a file for recording or communication. For example, an image file in a format such as Joint Photographic Experts Group (JPEG), Tagged Image File Format (TIFF), or Graphics Interchange Format (GIF) is generated as a still image file. In addition, it is also conceivable to generate an image file in an MP4 format for recording moving images and audio conforming to MPEG-4, for example.
[0069] Note that it is also conceivable to generate an image file as raw image data.
[0070] In addition, the digital signal processing unit 15 performs resolution conversion processing on the image data (input image) subjected to various types of signal processing, and generates, for example, image data with reduced resolution for live view display.
[0071] The storage unit 16 is a buffer memory for image data. The storage unit 16 includes, for example, a dynamic random access memory (D-RAM).
[0072] The image data processed by the digital signal processing unit 15 is temporarily stored in the storage unit 16 , and is transmitted to the display unit 18 , the recording control unit 17 , or the communication unit 19 at a predetermined timing.
[0073] The recording control unit 17 performs, for example, recording and reproduction on a recording medium including a nonvolatile memory. The recording control unit 17 performs a process of recording an image file such as moving image data or still image data on the recording medium.
[0074] The actual form of the recording control unit 17 can be considered diversely. For example, the recording control unit 17 may include a flash memory built in the imaging device 1 and its write / read circuit. In addition, the recording control unit 17 may be in the form of a card recording / reproducing unit that performs recording / reproducing access to a recording medium such as a memory card (e.g., a portable flash memory) that is detachable from the imaging device 1. In addition, the recording control unit 17 may be implemented as a hard disk drive (HDD) or the like as a form built in the imaging device 1.
[0075] The display unit 18 performs various types of displays for the user and is, for example, provided in Figure 1 A rear monitor 4 or EVF 5 is provided in the housing of the imaging device 1 shown in FIG.
[0076] The display unit 18 performs various types of display on the display screen based on instructions from the camera control unit 21 .
[0077] For example, the display unit 18 displays a reproduced image of image data read from the recording medium in the recording control unit 17 .
[0078] Furthermore, the display unit 18 is supplied with image data of a captured image whose resolution has been converted by the digital signal processing unit 15 for display, and performs display corresponding to the image data, for example, display of a live view image.
[0079] Furthermore, the display unit 18 displays various operation menus, icons, messages, and the like, that is, a graphical user interface (GUI), on a screen based on the information from the camera control unit 21 .
[0080] The communication unit 19 performs data communication and network communication with an external device in a wired or wireless manner.
[0081] For example, image data (still image file or moving image file) or metadata is transmitted and output to an external information processing device, a display device, a recording device, a reproducing device, or the like.
[0082] In addition, the communication unit 19 used as a network communication unit can perform various types of communications, for example, through networks such as the Internet, home networks, and local area networks (LANs), and send and receive various types of data to and from servers, terminals, etc. on the networks.
[0083] The operation unit 20 collectively shows an input device for the user to perform various operation units. Specifically, the operation unit 20 is various operation elements 6 provided in the housing of the imaging device 1. In addition, the operation elements 6 corresponding to the operation unit 20 also include, for example, a touch screen and a touch pad provided on the back monitor 4. In addition, the operation unit 20 can be configured as a receiving unit of an operation signal from a remote controller.
[0084] A user operation is detected by the operation unit 20 , and a signal corresponding to the input operation is sent to the camera control unit 21 .
[0085] The camera control unit 21 includes a microcomputer (arithmetic processing unit) including a central processing unit (CPU). The camera control unit 21 is an imaging control device that controls the operation of the imaging device 1.
[0086] The storage unit 22 stores information and the like to be processed by the camera control unit 21. The storage unit 22 collectively illustrates, for example, a read only memory (ROM), a random access memory (RAM), and a flash memory.
[0087] The storage unit 22 may be a storage area built into a microcomputer chip serving as the camera control unit 21 , or may include a separate memory chip.
[0088] The camera control unit 21 controls the entire imaging device 1 by executing a program stored in a ROM, a flash memory, or the like of the storage unit 22 .
[0089] For example, the camera control unit 21 controls instructions for various types of signal processing in the digital signal processing unit 15 , an imaging operation and a recording operation in response to a user operation, a reproduction operation of a recorded image file, and the like.
[0090] Furthermore, the camera control unit 21 performs operation control of the aperture mechanism, shutter speed control of the imaging element 12 , and AGC gain control in the analog signal processing unit 13 as automatic exposure control.
[0091] Furthermore, the camera control unit 21 performs drive control of the focus lens and the zoom lens in response to automatic focus control, manual focus operation, zoom operation, and the like.
[0092] Furthermore, the camera control unit 21 controls the shutter speed, exposure timing, and the like of the imaging element 12 .
[0093] The camera control unit 21 has functions of a setting registration unit 31 , a recognition unit 32 , and an imaging control unit 33 that perform control processing regarding automatic focus control.
[0094] The setting registration unit 31 performs processing of registering imaging settings for each subject type.
[0095] The recognition unit 32 performs a process of recognizing a subject from an image (input image) based on the imaging setting of the type of the subject to be the recognition target.
[0096] The imaging control unit 33 performs processing of controlling imaging based on the subject recognized by the recognition unit 32 .
[0097] Note that the processing performed by the setting registration unit 31 , the recognition unit 32 , and the imaging control unit 33 will be described in detail later.
[0098] The RAM in the storage unit 22 is used as a work area for temporarily storing data, programs, and the like during various types of data processing by the CPU of the camera control unit 21 .
[0099] The ROM and flash memory (nonvolatile memory) in the storage unit 22 are used to store an operating system (OS) for the CPU to control each unit, application programs for various operations, firmware, various types of setting information, and the like.
[0100] Examples of various types of setting information include communication setting information, setting information about imaging operations, and setting information about image processing. Examples of setting information about imaging operations include exposure settings, shutter speed settings, curtain speed settings of a mechanical shutter or an electronic shutter, mode settings, and imaging settings.
[0101] The driver unit 23 includes, for example, a motor driver for a zoom lens driving motor, a motor driver for a focus lens driving motor, and a motor driver for an aperture mechanism motor.
[0102] These motor drivers each apply a drive current to the corresponding driver in response to an instruction from the camera control unit 21 (imaging control unit 33 ), thereby, for example, moving the focus lens and the zoom lens and opening and closing the aperture blades of the aperture mechanism.
[0103] <2. Auto Focus Control (AF)>
[0104] The camera control unit 21 pre-registers the imaging setting determined by the user for each of a plurality of subject types, recognizes the subject from the image based on the imaging setting of the subject type to be the recognition target, and performs automatic focus control to focus on the recognized subject. In addition, in the automatic focus control, the camera control unit 21 can also perform so-called tracking AF control of tracking and focusing on a predetermined subject as a tracking target such as a subject that has been focused once.
[0105] Here, as examples of subject types, "person", "animal", "bird", "insect", and "car / train" are provided. "Animal" is a type in which the subject is a mammal other than a person, for example, a mammal as a pet such as a dog or a cat, or a mammal as a wild animal. "Bird" is a type in which the subject is a bird. "Car / train" is a type in which the subject is a car (automobile) or a train.
[0106] In addition, "animal + bird" is set as the subject type. "Animal + bird" includes the above-mentioned subject types "animal" and "bird". That is, "animal + bird" is a type in which the subject is a mammal or a bird other than a person. As described above, a subject type including a plurality of subject types can be set.
[0107] As imaging settings, set the recognition portion, offset range, tracking viscosity, recognition sensitivity, etc.
[0108] The recognition portion (control target portion) indicates a portion to be controlled such as a portion to be focused on or a portion to be tracked among portions of a subject that are recognizable in recognition processing described later.
[0109] The offset range defines a range in which the tracking target can be offset if a subject (part) having a higher priority than the currently tracked subject (part) is identified, and is set to one of five levels, for example.
[0110] The tracking stickiness defines the degree of tracking stickiness of the currently tracked object (part), and is set to one of five levels, for example.
[0111] The recognition sensitivity defines the recognition difficulty of the object, and is set to one of five levels, for example.
[0112] Note that the recognition location, offset range, tracking stickiness, and recognition sensitivity shown as imaging settings and other settings may be used.
[0113] Furthermore, the recognition portion, the offset range, the tracking viscosity, and the recognition sensitivity may be set according to the subject type or may not be set according to the subject type.
[0114] The setting registration unit 31 determines the imaging setting for each subject type in response to the user operation, and registers (stores) the determined imaging setting in the storage unit 22. Note that the registration of the imaging setting will be described in detail later.
[0115] Figure 4 The identifiable parts of each subject type are shown. Figure 4 In the figure, the identifiable parts are surrounded by squares.
[0116] In the imaging device 1, identifiable parts are determined in advance for each subject type. Figure 4 As shown in , for the subject types “person”, “animal”, and “bird”, “pupil”, “face”, “head”, and “body” are set as identifiable parts.
[0117] Note that the identifiable parts “face” and “head” are identified as the same part, and hereinafter, these parts will be collectively referred to as “head.” However, the identifiable parts “face” and “head” may be identified as different parts.
[0118] Furthermore, for the subject types “person”, “animal”, and “bird”, “right eye” and “left eye” are set as identifiable parts and can be switched.
[0119] The setting registration unit 31 determines and registers the identification part from the identifiable parts for each subject type in response to the user's operation. Here, the identifiable parts "pupil", "head" and "body" can be independently determined as identification parts, and a combination of multiple identifiable parts can also be determined, specifically, "pupil + head" and "automatic (pupil + head + body)".
[0120] The recognition part "Pupil+Head" includes "Pupil" and "Head" as the recognition parts, and "Pupil" takes precedence over "Head". In addition, the recognition part "Automatic" includes "Pupil", "Head" and "Body" as the recognition parts, and "Pupil" takes precedence over "Head", and "Head" takes precedence over "Body".
[0121] Note that, although one or more identifiable parts are also set for the subject types "insect" and "car / train", their description is omitted here.
[0122] The recognition unit 32 recognizes the subject and the identifiable part of the subject by performing recognition processing for each subject type. The recognition processing is performed by an algorithm learned using deep learning such as a convolutional neural network (CNN), for example.
[0123] In the imaging device 1, an algorithm learned in advance by performing deep learning or the like for each subject type is stored in the storage unit 22. The recognition unit 32 recognizes the subject and the identifiable part by using the algorithm of the subject type as the recognition target. Therefore, in the recognition process, a subject of the subject type as the recognition target can be recognized, while a subject of the subject type that is not the recognition target cannot be recognized.
[0124] Then, when an identifiable portion set as an identification portion is identified, the imaging control unit 33 performs automatic focus control to focus on the portion.
[0125] Figure 5 FIG. 1 shows a focus frame of each recognition part in the case where the recognition target is the subject type "bird". Note that Figure 5 In FIG. 1 , the focus area, i.e., the focus frame 100 is indicated by a square.
[0126] In the case where the recognition target is the subject type "bird" and any one of "pupil", "pupil+head" and "automatic" is set as the recognition part, which part is focused on (on which part the focus frame 100 is displayed) according to the recognition part (recognizable part) will be described. Here, the description will be made assuming that "bird" is recognized as the subject.
[0127] When the “pupil” is set as the recognition part and the recognition unit 32 recognizes the pupil, the pupil as the recognition part is focused (the focus frame 100 is displayed) regardless of whether the head and the body are recognized.
[0128] Furthermore, in the case where the “pupil” is set as the recognition part and the recognition unit 32 does not recognize the pupil, focusing is performed based on a predetermined setting regardless of whether the head and body are recognized (for example, the subject at the center of the image is focused). Therefore, in this case, even if a bird as a recognition target is recognized, the bird is not necessarily focused.
[0129] In a case where "pupil+head" is set as the recognition part and the recognition unit 32 recognizes the pupil, the pupil is the recognition part regardless of whether the head and body are recognized, and the pupil having the highest priority is focused.
[0130] Furthermore, when “pupil+head” is set as the recognition part and the recognition unit 32 does not recognize the pupil but recognizes the head, the head as the recognition part is focused on regardless of whether the body is recognized.
[0131] Furthermore, in a case where “pupil+head” is set as the recognition part and the recognition unit 32 does not recognize the head, focusing is performed based on a predetermined setting regardless of whether the body is recognized.
[0132] In a case where "auto" is set as the recognition part and the recognition unit 32 recognizes the pupil, the pupil is the recognition part regardless of whether the head and the body are recognized, and the pupil having the highest priority is focused.
[0133] Furthermore, in a case where “auto” is set as the recognition part and the recognition unit 32 recognizes the head without recognizing the pupil, the head having the next highest priority is focused on regardless of whether the body is recognized.
[0134] Furthermore, in a case where “auto” is set as the recognition part and the recognition unit 32 recognizes the body instead of the pupil and the head, the body as the recognition part is focused on.
[0135] As described above, if the recognition part is registered in advance for each subject type, when it is determined that the subject type is a recognition target, it is not necessary to set the recognition part again every time the subject type is switched.
[0136] Figure 6 The priority is shown in the case where the subject type "animal + bird" is determined as the recognition target. Figure 6 In FIG. 1 , the focus area, i.e., the focus frame 100 is indicated by a square.
[0137] In addition, as described above, "animal + bird" is set as the subject type. The subject type "animal + bird" is subjected to recognition processing by using an algorithm for recognizing animals and birds. Therefore, the subject is recognized in the case where only animals appear in the image, only birds appear in the image, and both animals and birds appear in the image.
[0138] Then, in the case where both an animal and a bird are recognized in the recognition process, the recognition part of the subject is focused according to the priority registered in advance. Therefore, the priority determined here is one of the imaging settings.
[0139] As the priority, “Auto,” “Animal Priority,” and “Bird Priority” are set. In “Auto,” a subject to be focused is determined according to predetermined settings.
[0140] Furthermore, in “animals first”, animals take precedence over birds. Figure 6 In the case where “animal priority” as shown in the upper part of FIG. 1 is set as the priority and both an animal and a bird are recognized as the subject, a focus frame 100 is displayed on the recognized part of the recognized animal ( Figure 6 The “pupil” in the image is located on the eye and the identification part is focused.
[0141] In "birds first", birds take precedence over animals. Figure 6 In the case where “bird priority” as shown in the lower part of FIG. 1 is set as the priority and both an animal and a bird are recognized as the subject, a focus frame 100 is displayed on the recognized part of the bird ( Figure 6 The “pupil” in the image is located on the eye and the identification part is focused.
[0142] Note that, for example, even in the case where “animal priority” is set as the priority level, in the case where only a bird is recognized as a subject, the recognized part of the bird is also focused.
[0143] Figure 7 and Figure 8shows the offset range. Note that Figure 7 , the tracking target 101 is indicated by a square, and the offset range 102 is indicated by an ellipse.
[0144] As described above, the offset range defines a range in which the tracking target can be offset if a subject with a higher priority than the currently tracked subject is recognized, and is set to one of five levels (1: narrow to 5: wide), for example.
[0145] Here, the subject type "animal" is determined as the recognition target, and the "pupil" is determined as the recognition part. Figure 7 As shown in , the pupil of an animal (dog) is set as the tracking target 101, and then another animal (another dog) appears in the image. In this case, when the offset range 102 is 1 (narrow), as shown in Figure 7 As shown in the upper part of , even if another animal appears in the image (even if another animal is recognized), the tracking target 101 can be prevented from shifting to the pupil of the other animal.
[0146] Furthermore, when the shift range 102 is 5 (width), as Figure 7 As shown in the lower part of FIG. 1 , when another animal appears in the image, the tracking target 101 may be shifted to the pupil of the other animal.
[0147] In addition, if Figure 8 As shown in , the pupil of an animal (dog) is set as a tracking target 101, and then the animal hides behind an obstacle once and then reappears. In this case, when the offset range 102 is 1 (narrow), as shown in Figure 8 As shown in the upper part of , when the animal hides behind an obstacle, the tracking target 101 moves to the obstacle, and then when the animal appears again, the animal's pupil is outside the offset range 102, and although the animal is the same, the tracking target 101 does not move to the pupil.
[0148] Furthermore, when the offset range 102 is 5 (wide), as Figure 8 As shown in the lower part of , even if the tracking target 101 moves to the obstacle when the animal hides behind the obstacle, when the animal appears again, the pupil of the animal falls within the displacement range 102, and the tracking target 101 moves to the pupil of the animal again.
[0149] As described above, when the user determines and registers the offset range 102 for each subject type to be a recognition target in advance, the tracking target 101 can be tracked optimally for each subject type.
[0150] Fig. 9Tracking stickiness is shown. Tracking stickiness defines the degree of tracking stickiness of the currently tracked subject (tracking target 101 ), and is set to one of five levels (1: not sticky to 5: sticky), for example.
[0151] like Fig. 9 As shown in the upper part of , in a scene where a bird as a tracking target 101 flies toward the front side, when the tracking stickiness is 1 (non-sticky), the tracking target 101 can be continuously set and tracked without tracking the branches of the rear tree.
[0152] Furthermore, in a scene where a bird as tracking target 101 flies toward the front, when tracking stickiness is 5 (sticky), the tracking range hardly moves from the rear. Therefore, branches of the rear tree can be set as tracking target 101, and the bird in front cannot be tracked.
[0153] In addition, if Fig. 9 As shown in the lower part of FIG, in a scene where the rear animal (cat) as the tracking target 101 is hidden behind the grass in front, when the tracking stickiness is 5 (sticky), the tracking range hardly moves from the rear. Therefore, when the rear animal appears again, the tracking target 101 can be continuously tracked without tracking the grass in front.
[0154] In addition, in a scene where a rear animal (cat) which is tracking target 101 is hidden behind the grass in front, when the tracking stickiness is 1 (not sticky), the grass in front can be set as tracking target 101 when the animal is hidden, and the animal cannot be tracked even if the rear animal appears again.
[0155] As described above, when the user determines and registers tracking viscosity in advance for each subject type to be a recognition target, optimal tracking can be performed for each subject type.
[0156] Fig.10 Recognition sensitivity is shown. Recognition sensitivity defines the ease of recognition of a subject, and is determined, for example, as one of five levels (1: low to 5: high).
[0157] like Fig.10 As shown in the upper part of , in the scene where a bird stays in a tree, when the recognition sensitivity is 1 (low), a complex background such as a tree is less likely to be misidentified as a bird, so the bird is easily recognized.
[0158] Furthermore, in a scene where a bird stays in a tree, when the recognition sensitivity is 5 (high), the tree as a complex background may be misidentified as a bird, and the bird cannot be recognized.
[0159] In addition, if Fig.10 As shown in the lower part of , in a scene where the background is similar in color to the bird, when the recognition sensitivity is 5 (high), the bird is easily recognized.
[0160] Furthermore, in a scene where the background is similar in color to the bird, when the recognition sensitivity is 1 (low), the background may be misidentified as the bird, and the bird cannot be recognized.
[0161] As described above, when the user determines and registers the recognition sensitivity in advance for each subject type to be a recognition target, optimal recognition can be performed for each subject type.
[0162] <3. Imaging settings registration>
[0163] Fig.11 The menu screen at the time of AF setting is shown. In the imaging device 1, imaging settings can be determined and registered for each subject type on the menu screen.
[0164] When the menu button 6h is operated and then the up button 6c, down button 6d, right button 6e, left button 6f and determination button 6g are appropriately operated, a menu screen 41 of “Focus>AF” for performing imaging settings regarding automatic focusing is displayed on the display unit 18.
[0165] The menu screen 41 is provided with a plurality of items such as an “Area Priority during AF” item for switching the automatic focus control on and off to give priority to focusing on the identification part during AF, an “Identification Target” item for selecting an identification target, an “Identification Target Switching Setting” item for determining the identification targets switchable through a function menu or a custom key, and a “Right Eye / Left Eye Selection” item for switching whether to focus on the right eye or the left eye.
[0166] Note that, for example, in the "identification target" entry, the content of the determination (in Fig.11 ) can be displayed to the right of the entry.
[0167] In addition, Fig.11 In FIG. 4 , one item being selected from among a plurality of items set on the menu screen 41 is highlighted by being shaded.
[0168] When the "Recognition Target" item is selected on the menu screen 41 and then the OK button 6g is operated, the menu screen 42 is displayed. On the menu screen 42, a plurality of subject types ("People", "Animal+Bird", "Animal", "Bird", "Insect", and "Car / Train") as possible recognition targets are displayed, and the following items are displayed: Fig.11 You can select any of the subject types indicated by the black circle in the figure. Note that the unselected subject types are indicated by the white circle.
[0169] Then, when the upper button 6c and the lower button 6d are operated to select, for example, “person”, and then the right button 6e is operated, the subject type is determined as the recognition target, and the menu screen 43 is displayed. The menu screen 43 is a screen for determining the imaging setting of the subject type “person”, displays an “offset range” item for selecting an offset range, and also displays the value of the offset range.
[0170] Then, when the right button 6e or the determination button 6g is operated while the "offset range" item is selected, the menu screen 44 is displayed. On the menu screen 44, options "1" to "5" of the offset range are displayed.
[0171] Then, when the up button 6c and the down button 6d are operated to select any one of the options “1” to “5” of the offset range and then the left button 6f or the menu button 6h is operated, the selected offset range is determined and the menu screen 43 is displayed.
[0172] When the left button 6f or the menu button 6h is operated while the menu screen 43 is displayed, the menu screen 42 is displayed. When the left button 6f or the enter button 6g is operated while the menu screen 42 is displayed, the menu screen 41 is displayed.
[0173] Fig.12 The menu screen for AF setting is shown in FIG. Fig.12 As shown in , when the up button 6 c and the down button 6 d are operated on the menu screen 42 to select “animal” and then the right button 6 e is operated, the subject type is determined as a recognition target and a menu screen 45 is displayed.
[0174] Menu screen 45 is a screen for determining the imaging settings of the subject type "animal", and is provided with an "offset range" item, a "tracking viscosity" item for selecting tracking viscosity, an "identification sensitivity" item for selecting identification sensitivity, an "identification part (individual)" item for selecting an identification part, and an "identification part switching setting (individual)" item for selecting an identification part that can be switched through a function menu or a custom button.
[0175] When the "offset range" item is selected on the menu screen 45 and then the right button 6e or the determination button 6g is operated, the menu screen 44 (see Fig.11 ), and the offset range can be selected and determined via the menu screen 44. Furthermore, in the case where the “tracking stickiness” item and the “recognition sensitivity” item are selected, like the case where the “offset range” item is selected, a menu screen is displayed on which any one of the options “1” to “5” of the tracking stickiness and the recognition sensitivity can be selected and determined.
[0176] When the "Identification Part (Individual)" item is selected on the menu screen 45, and then the right button 6e or the determination button 6g is operated, the menu screen 46 is displayed. On the menu screen 46, "Automatic", "Pupil+Head" and "Pupil" are displayed as possible identification parts, and any one of the possible identification parts can be selected, such as Fig.12 As indicated by the black circle in .
[0177] Then, when the upper button 6c and the lower button 6d are operated to select any one of "Auto", "Pupil+Head" and "Pupil" as the identification part, and then the left button 6f or the menu button 6h is operated, the offset range being selected is determined and the menu screen 45 is displayed.
[0178] Furthermore, when "Recognition part switching setting (individual)" is selected on the menu screen 45, and then the right button 6e or the determination button 6g is operated, a menu screen 47 is displayed. On the menu screen 47, "Auto", "Pupil+Head" and "Pupil" are displayed as possible recognition parts switchable by the function menu or the custom key, and one or more of the possible recognition parts can be selected. For example, in the case of Fig.12 In the case where only "Auto" is selected as shown in (when "Auto" is checked), you can select only "Auto" as the recognition part through the function menu or custom button.
[0179] When the OK button is selected on the menu screen 47, the selected possible recognition part is determined as the recognition part switchable by the function menu or the custom key, and the menu screen 45 is displayed. In addition, when the Cancel button is selected on the menu screen 47, the menu screen 45 is displayed without determining the switchable recognition part.
[0180] Note that when "Bird" is selected on the menu screen 42, a menu screen similar to the menu screen 45 displayed when "Animal" is selected is displayed, and the offset range, tracking viscosity, recognition sensitivity, recognition part (individual) and recognition part switching setting (individual) can be selected and determined.
[0181] Fig.13 The menu screen for AF setting is shown in FIG. Fig.13 As shown in FIG. 4 , when the up button 6 c and the down button 6 d are operated to select “animal+bird” on the menu screen 42 and then the right button 6 e is operated, “animal+bird” is determined as the recognition target and the menu screen 48 is displayed.
[0182] Menu screen 48 is a screen for determining and registering the imaging settings of the subject type "animal + bird", and is provided with a "priority" item for selecting a priority, an "identification part" item for selecting an identification part, an "identification part switching setting" item for selecting an identification part switchable through a function menu or a custom key, an "animal: detailed settings" item for performing detailed settings (imaging settings) regarding the subject type "animal", and a "bird: detailed settings" item for performing detailed settings regarding the subject type "bird".
[0183] When the "Priority" item is selected on the menu screen 48 and then the right button 6e or the determination button 6g is operated, the menu screen 49 is displayed. On the menu screen 49, "Automatic" for setting the priority based on a predetermined rule, "Animal Priority" for giving priority to animals, and "Bird Priority" for giving priority to birds are displayed, and one of them can be selected.
[0184] Then, when the up button 6c and the down button 6d are operated to select any one of "auto", "animal priority" and "bird priority" as the priority, and then the left button 6f or the menu button 6h is operated, the selected priority is determined and the menu screen 48 is displayed.
[0185] Furthermore, in the case where the “identification part” item is selected, a menu screen 50 is displayed. On the menu screen 50, “AUTO”, “PUPIHL+HEAD”, “PUPIHL”, and “Follow the setting for each subject target” are displayed as identification parts, and any one of the identification parts can be selected, such as Fig.13 As indicated by the black circle in .
[0186] Here, regarding “settings in accordance with each subject target”, the recognition portion selected on the menu screen 46 when any one of the recognition targets “animal” and “bird” is set as the recognition target is independently set as the recognition portion here.
[0187] Therefore, individual recognition parts are determined for each subject type. For example, "auto" is set as the recognition part for the subject type "animal", and "pupil" is set as the recognition part for the subject type "bird".
[0188] Furthermore, regarding “automatic”, “pupil+head”, and “pupil”, the recognition parts common to the subject types “animal” and “bird” are determined.
[0189] Furthermore, when "Recognition part switching setting" is selected on the menu screen 48 and then the right button 6e or the determination button 6g is operated, a menu screen 51 is displayed. On the menu screen 51, "Automatic", "Pupil+Head", "Pupil", and "Follow the setting for each subject target" are displayed as possible recognition parts switchable by the function menu or the custom key, and one or more of the possible recognition parts can be selected. For example, in the case of Fig.13 If only "Auto" is selected as shown in the figure, you can select only "Auto" as the recognition part through the function menu or custom button.
[0190] As described above, in the imaging device 1 , when the recognition target and the imaging setting are determined via the menu screen, the setting registration unit 31 registers the determined recognition target and the imaging setting in the storage unit 22 in association with the subject type as necessary.
[0191] Therefore, regarding “animal+bird” including a plurality of subject types, the setting registration unit 31 can register the recognition part (imaging setting) common to the plurality of subject types (“animal” and “bird”).
[0192] Furthermore, regarding “animal+bird” including a plurality of subject types, the setting registration unit 31 can also register individual recognition parts (imaging settings) of the plurality of subject types (“animal” and “bird”).
[0193] In addition, when the subject type "animal+bird" including multiple subject types "animal" and "bird" is set as the recognition target, the recognition unit 32 can commonly use the recognition parts (imaging settings) set independently for the subject types "animal" and "bird".
[0194] Furthermore, in the imaging device 1 , the recognition target and the imaging setting can be switched by using the function screen 61 .
[0195] Fig.14 The function screen is shown. Fig.14 As shown in , in the imaging device 1, when the function button 6i is operated while the imaging standby screen 60 is displayed on the display unit 18, the function screen 61 is displayed. In the function screen 61, 12 function menus are pre-registered by menu setting, and icons corresponding to the registered function menus are displayed.
[0196] In the imaging device 1 , for example, recognition target switching and recognition part switching can be set as function menus. For example, the recognition part switching function menu is registered as the second from the left in the upper part of the function menu 61 .
[0197] In this case, when the identification part switching function menu is selected and then the predetermined dial key is operated, for example, possible identification parts selected and determined on the menu screen 47 are displayed above the function menu 61, and any one of the identification parts is highlighted to indicate that the identification part is being selected.
[0198] Then, every time the dial key is operated, a possible identification part selected from among the possible identification parts displayed above the function menu 61 is switched and displayed. Then, the setting registration unit 31 determines the last selected possible identification part as the identification part.
[0199] In addition, when the recognition part switching function menu of the function menu 61 is selected and then the determination button 6g is operated, as shown in FIG. Fig.14 As shown in the lower part of , for example, the possible recognition parts selected and determined on the menu screen 47 are displayed on the left side of the screen, and the selected and determined possible recognition parts are displayed at the upper center of the screen.
[0200] Then, each time the up button 6c or the down button 6d is operated, the possible identification part selected among the possible identification parts displayed on the left side of the screen is switched and displayed. Then, the setting registration unit 31 determines the last selected possible identification part as the identification part.
[0201] Fig.15 An imaging standby screen 60 is shown. Furthermore, in the imaging device 1, the recognition target and the imaging setting can be switched by using the custom button 6b.
[0202] For example, the identification part switching is pre-assigned to any one of the plurality of custom buttons 6b. Then, whenever the custom button 6b to which the identification part switching is assigned is operated while the imaging standby screen 60 is displayed, for example, the possible identification part selected and determined on the menu screen 47 is switched and determined, and the determined identification part is displayed at the center of the imaging standby screen 60.
[0203] Fig.16 On / off of AF control and identification target are shown.
[0204] like Fig.15 As shown in , a plurality of icons indicating various setting contents are displayed on the imaging standby screen 60. In addition, an AF icon 62 indicating on / off of AF control and identifying a target is displayed at the lower left portion of the imaging standby screen 60.
[0205] Fig.16 Any one of the multiple icons in is displayed as the AF icon 62. For example, when the automatic focus control (AF) is on and the recognition target is the subject type "person", an icon with characters "AF on" superimposed thereon on the person type icon is displayed as the AF icon 62.
[0206] Furthermore, in a case where the automatic focus control (AF) is on and the recognition target is the subject type "animal + bird", an icon in which characters "AF on" are superimposed on the animal type icon and the bird type icon is displayed as the AF icon 62. Furthermore, in a case where the recognition target is the subject type "animal + bird", the animal type icon and the bird type icon are displayed by changing the size according to the set priority.
[0207] For example, in case the priority is animal first, the animal type icon is displayed larger than the bird type icon, and in case the priority is automatic, the animal type icon and the bird type icon are displayed in the same size.
[0208] <4. Set up registration process>
[0209] Fig.17 4 is a flowchart showing the flow of the setting registration process of the recognition target and the imaging setting. Fig.17 As shown in FIG. 1 , when the setting registration process is started, in step S1, the setting registration unit 31 determines whether the menu button 6h is operated. When the menu button 6h is operated (yes in step S1), the setting registration unit 31 performs the menu setting process in step S2. In the menu setting process, a menu screen is displayed on the display unit 18 (see FIG. 1 ). Figures 11 to 13 ), or determine and register the recognition target and imaging settings in response to a user operation of the operating element 6.
[0210] In step S3, the setting registration unit 31 determines whether the function button 6i is operated. When the function button 6i is operated (yes in step S3), the setting registration unit 31 performs a function menu setting process in step S4. In the function menu setting process, the function menu 61 (see Fig.14 ), and switches the recognition target or imaging setting (recognition part) in response to the user operation of the operation element 6.
[0211] In step S5, the setting registration unit 31 determines whether the custom button 6b is operated. When the custom button 6b is operated (yes in step S5), the setting registration unit 31 performs a custom button setting process in step S6. In the custom button setting process, the settings (e.g., recognition target and imaging settings) assigned to the operated custom button 6b are switched.
[0212] <5. Automatic focus control processing>
[0213] Fig.18 FIG. 4 is a flowchart showing the automatic focus control process. Fig.18As shown in , when the automatic focus control process starts, the recognition unit 32 reads the recognition target (subject type) stored in the storage unit 22 in step S11. Furthermore, in step S12, the recognition unit 32 reads the imaging settings registered for the subject type of the recognition target from the storage unit 22.
[0214] Then, in step S13, the recognition unit 32 performs recognition processing using an algorithm for the type of subject that is the recognition target, and recognizes the subject and the recognizable part of the subject from the captured image. In step S14, the recognition unit 32 determines whether a subject of the type of subject that is the recognition target is recognized. Then, in the case where a subject of the type of subject that is the recognition target is recognized (yes in step S14), the recognition unit 32 determines in step S15 whether the recognition part of the recognized subject is recognized. Note that here, in the case where multiple subjects are recognized, one subject is determined based on a priority that is registered or set in advance, and it is determined whether the recognition part of the determined subject is recognized.
[0215] In the case where the recognition part of the subject is recognized (Yes in step S15), in step S16, the imaging control unit 33 controls each unit to focus on the recognized recognition part. Here, in the case where multiple recognition parts are recognized, one recognition part is determined according to a preset priority, and the determined recognition part is focused.
[0216] <6. Modifications>
[0217] Note that the embodiments are not limited to the specific examples described above, and may be configured as various modifications.
[0218] In the above embodiments, the recognition target and the imaging setting are determined, registered or switched by the operation of the menu screen, the function menu or the custom button. Fig.19 As shown in , a plurality of recommended imaging settings are pre-stored in the storage unit 22. After the imaging settings stored in the storage unit 22 are displayed on the display unit 18, the setting registration unit 31 registers the imaging settings selected by the user in the storage unit 22 in association with the subject type. Fig.19 In the example of , recommended imaging settings are stored for each subject and imaging scene such as the flight or jump of a small bird or the flight of a large bird.
[0219] Therefore, the user can easily register imaging settings for each subject type by selecting and registering imaging settings recommended according to the subject and the imaging scene from among a plurality of imaging settings.
[0220] Furthermore, even in the case of multiple subject types "animals + birds", recommended imaging settings can be selected and registered according to the subject and imaging scene.
[0221] Note that the recommended imaging settings may be downloaded from the outside (on the Internet) via the communication unit 19 and registered.
[0222] Furthermore, in the above embodiments, focusing is performed as imaging control based on the recognized subject, but other types of processing may be performed.
[0223] <7. Conclusion>
[0224] According to the imaging device 1 of the above embodiment, the following effects can be obtained.
[0225] The imaging device 1 according to the embodiment includes: a setting registration unit 31, which registers imaging settings for each subject type; a recognition unit 32, which recognizes a subject from an image based on the imaging settings of the subject type to be recognized; and an imaging control unit 33, which controls imaging based on the subject recognized by the recognition unit 32.
[0226] Therefore, the imaging device 1 can recognize and image a subject based on the imaging settings of the subject type to be the recognition target, simply by having the user register the imaging settings for each subject type in advance.
[0227] Therefore, the imaging device 1 can perform imaging based on a subject of the subject type to be a recognition target without forcing the user to perform complicated operations.
[0228] Furthermore, the imaging control unit 33 focuses on the subject recognized by the recognition unit 32 .
[0229] Therefore, the imaging device 1 can focus on a subject desired by the user, without forcing the user to perform complicated operations, simply by causing the user to register imaging settings for each subject type in advance.
[0230] Furthermore, the recognition unit 32 recognizes a subject by setting a plurality of subject types as recognition targets.
[0231] Therefore, for example, even in a case where different subject types such as the subject type “animal+bird” are included, the imaging device 1 can focus on subjects of both subject types without switching the subject type.
[0232] Furthermore, in the case where a plurality of subject types are set as recognition targets, the setting registration unit 31 registers common imaging settings for the plurality of subject types set as recognition targets.
[0233] Therefore, for example, even in a case where different subject types such as the subject type “animal+bird” are included, the imaging device 1 can focus on subjects of both subject types simply by performing common imaging settings.
[0234] Furthermore, in the case where a plurality of subject types are set as recognition targets, the setting registration unit 31 registers individual imaging settings for the plurality of subject types set as recognition targets.
[0235] Therefore, for example, in a case including different subject types such as the subject type "animal+bird", the imaging device 1 can perform individual imaging settings desired by the user for each subject type and can perform focusing using different imaging settings for each subject type.
[0236] In addition, for a plurality of subject types set as recognition targets, the setting registration unit 31 commonly uses the imaging settings obtained in the case where the individual subject types are set as recognition targets.
[0237] Therefore, for example, in a case including different subject types such as subject type "animal + bird", the imaging device 1 can commonly use the imaging settings of the subject type "animal" and the imaging settings of the subject type "bird", so the user can register the imaging settings with simpler operations.
[0238] Furthermore, in the case where a plurality of subject types are set as recognition targets and subjects of the plurality of subject types are recognized, the recognition unit 32 controls imaging according to the subject based on the priority registered in advance.
[0239] Therefore, for example, in the case where a subject of a different subject type such as the subject type “animal+bird” is recognized, the imaging device 1 can focus on the subject according to the registered priority.
[0240] In addition, when multiple subject types are set as recognition targets, the setting registration unit 31 registers common imaging settings and individual imaging settings for the multiple subject types set as recognition targets, and the recognition unit 32 recognizes the subject based on one of the common imaging settings and the individual imaging settings.
[0241] Therefore, for example, in a case including different subject types such as the subject type “animal+bird”, the imaging device 1 can recognize and focus on the subject by switching the common imaging setting or the individual imaging setting.
[0242] Furthermore, the imaging setting includes an offset range that defines a range by which the tracking target can be offset when a subject having a higher priority than the currently tracked subject is recognized.
[0243] Therefore, an optimum offset range can be set for each subject type.
[0244] Furthermore, the imaging settings include tracking stickiness, which defines the degree of tracking stickiness of the currently tracked subject.
[0245] Therefore, the optimal tracking stickiness can be set for each subject type.
[0246] Furthermore, the imaging settings include recognition sensitivity, which defines how easy it is to recognize the subject.
[0247] Therefore, the optimum recognition sensitivity can be set for each subject type.
[0248] The setting registration unit registers a part of the subject to be controlled for each subject type.
[0249] Therefore, it is possible to focus on the optimal part for each subject type.
[0250] Furthermore, the setting registration unit 31 registers the priorities of a plurality of parts to be controlled for each subject type.
[0251] Therefore, when the plurality of sites are identified, more optimal sites can be focused on.
[0252] Furthermore, the setting registration unit 31 displays icons indicating imaging settings on the display unit.
[0253] Therefore, the imaging settings can be easily confirmed.
[0254] Furthermore, in the case where a plurality of subject types are set as recognition targets, icons are displayed in sizes according to the priority of the subject types.
[0255] Therefore, the priority of the subject type can be easily confirmed via the icon.
[0256] Furthermore, the setting registration unit 31 can switch the imaging setting through the operation of the predetermined operation element 6 .
[0257] Therefore, the imaging setting can be easily switched.
[0258] Furthermore, in the case where the imaging setting is changed, the setting registration unit 31 displays the changed imaging setting on the display unit.
[0259] Therefore, the changed imaging settings can be easily confirmed.
[0260] Furthermore, in a case where a predetermined imaging setting is displayed on the display unit and the displayed imaging setting is selected, the setting registration unit 31 registers the selected imaging setting.
[0261] Therefore, imaging settings can be registered more easily.
[0262] Furthermore, an imaging control method includes: registering an imaging setting for each subject type; recognizing a subject from an image based on the imaging setting for a subject type to be a recognition target; and controlling imaging based on the recognized subject.
[0263] Furthermore, a program causes a computer to execute processing of registering imaging settings for each subject type, recognizing a subject from an image based on the imaging settings for a subject type to be a recognition target, and controlling imaging based on the recognized subject.
[0264] The program of this embodiment is, for example, a program for causing a processor such as a CPU or a DSP or a device including the processor to execute the above image processing.
[0265] Such a program may be recorded in advance in a HDD as a recording medium built into a device such as a computer device, a ROM in a microcomputer having a CPU, or the like. In addition, such a program may be temporarily or permanently stored (recorded) in a removable recording medium such as a floppy disk, a compact disk read-only memory (CD-ROM), a magneto-optical (MO) disk, a digital versatile disk (DVD), a Blu-ray Disc (registered trademark), a magnetic disk, a semiconductor memory, or a memory card. Such a removable recording medium may be provided as so-called packaged software.
[0266] Furthermore, such a program may be installed from a removable recording medium into a personal computer or the like, or may be downloaded from a download site via a network such as a local area network (LAN) or the Internet.
[0267] Note that the effects described in this specification are merely examples and not limitations, and other effects may be provided.
[0268] <8. This technology>
[0269] Note that the present technology may also have the following configurations.
[0270] (1) An imaging device comprising:
[0271] a setting registration unit that registers imaging settings for each subject type;
[0272] a recognition unit that recognizes a subject from an image based on an imaging setting of a type of the subject to be a recognition target; and
[0273] An imaging control unit controls imaging based on the subject recognized by the recognition unit.
[0274] (2) The imaging device according to (1), wherein
[0275] The imaging control unit focuses on the subject recognized by the recognition unit.
[0276] (3) The imaging device according to (1) or (2), wherein:
[0277] The recognition unit recognizes a subject by setting a plurality of subject types as the recognition target.
[0278] (4) The imaging device according to (3), wherein
[0279] In a case where a plurality of the subject types are set as the recognition targets, the setting registration unit registers common imaging settings for the plurality of the subject types set as the recognition targets.
[0280] (5) The imaging device according to (3) or (4), wherein:
[0281] In a case where a plurality of the subject types are set as the recognition targets, the setting registration unit registers individual imaging settings for the plurality of the subject types set as the recognition targets.
[0282] (6) The imaging device according to (5), wherein
[0283] The setting registration unit commonly uses, for the plurality of subject types set as the recognition target, imaging settings obtained in a case where individual subject types are set as the recognition target.
[0284] (7) The imaging device according to any one of (3) to (6), wherein
[0285] In a case where a plurality of subject types are set as the recognition targets and subjects of the plurality of subject types are recognized, the recognition unit controls imaging according to the subjects based on a priority registered in advance.
[0286] (8) The imaging device according to any one of (3) to (7), wherein:
[0287] In a case where a plurality of the subject types are set as the recognition target, the setting registration unit registers common imaging settings and individual imaging settings for the plurality of the subject types set as the recognition target; and
[0288] The recognition unit recognizes a subject based on one of the common imaging setting and the individual imaging setting.
[0289] (9) The imaging device according to any one of (1) to (8), wherein
[0290] The imaging settings include an offset range that defines a range by which a tracking target may be offset when a subject having a higher priority than a currently tracked subject is recognized.
[0291] (10) The imaging device according to any one of (1) to (9), wherein
[0292] The imaging settings include tracking stickiness, which defines the tracking stickiness of the currently tracked object.
[0293] (11) The imaging device according to any one of (1) to (10), wherein
[0294] The imaging settings include recognition sensitivity, which defines the difficulty of object recognition.
[0295] (12) The imaging device according to any one of (1) to (11), wherein
[0296] The setting registration unit registers a portion of the object to be controlled for each object type.
[0297] (13) The imaging device according to (12), wherein
[0298] The setting registration unit registers priorities of a plurality of parts to be controlled for each subject type.
[0299] (14) The imaging device according to any one of (1) to (13), wherein
[0300] The setting registration unit displays an icon indicating the imaging setting on a display unit.
[0301] (15) The imaging device according to (14), wherein
[0302] In a case where a plurality of subject types are set as the recognition target, the icon is displayed in a size according to the priority of the subject type.
[0303] (16) The imaging device according to any one of (1) to (15), wherein
[0304] The setting registration unit may switch the imaging setting by operation of a predetermined operation element.
[0305] (17) The imaging device according to any one of (1) to (16), wherein
[0306] In a case where the imaging setting is changed, the setting registration unit displays the changed imaging setting on a display unit.
[0307] (18) The imaging device according to any one of (1) to (17), wherein
[0308] In a case where the predetermined imaging setting is displayed on a display unit and the displayed imaging setting is selected, the setting registration unit registers the selected imaging setting.
[0309] (19) An imaging control method, comprising:
[0310] Register imaging settings for each subject type;
[0311] recognizing a subject from an image based on the imaging setting of the type of subject to be targeted for recognition; and
[0312] Imaging is controlled based on the identified subject.
[0313] (20) A program for causing a computer to execute the following processing:
[0314] Register imaging settings for each subject type,
[0315] recognizing a subject from an image based on an imaging setting of a type of subject to be a recognition target, and
[0316] Imaging is controlled based on the identified subject.
[0317] Reference Symbols List
[0318] 1 Imaging device
[0319] 6 Operating elements
[0320] 21 Camera control unit
[0321] 31 Setting up the registration unit
[0322] 32 Identification Units
[0323] 33 Imaging control unit
Claims
1. An imaging device, comprising: a setting registration unit that registers imaging settings for each subject type; a recognition unit that recognizes a subject from an image based on an imaging setting of a type of subject to be a recognition target; and An imaging control unit controls imaging based on the subject recognized by the recognition unit.
2. The imaging device according to claim 1, wherein: The imaging control unit focuses on the subject recognized by the recognition unit.
3. The imaging device according to claim 1, wherein: The recognition unit recognizes a subject by setting a plurality of the subject types as the recognition targets.
4. The imaging device according to claim 3, wherein: In a case where a plurality of the subject types are set as the recognition targets, the setting registration unit registers common imaging settings for the plurality of the subject types set as the recognition targets.
5. The imaging device according to claim 3, wherein: In a case where a plurality of the subject types are set as the recognition targets, the setting registration unit registers individual imaging settings for the plurality of the subject types set as the recognition targets.
6. The imaging device according to claim 5, wherein: The setting registration unit commonly uses, for the plurality of subject types set as the recognition target, imaging settings obtained in a case where individual subject types are set as the recognition target.
7. The imaging device according to claim 3, wherein: In a case where a plurality of the subject types are set as the recognition targets and subjects of the plurality of subject types are recognized, the recognition unit controls imaging according to the subject based on a priority registered in advance.
8. The imaging device according to claim 3, wherein: In a case where a plurality of the subject types are set as the recognition target, the setting registration unit registers common imaging settings and individual imaging settings for the plurality of the subject types set as the recognition target; and The recognition unit recognizes a subject based on one of the common imaging setting and the individual imaging setting.
9. The imaging device according to claim 1, wherein: The imaging settings include an offset range that defines a range by which a tracking target may be offset when a subject having a higher priority than a currently tracked subject is recognized.
10. The imaging device according to claim 1, wherein: The imaging settings include tracking stickiness, which defines the tracking stickiness of the currently tracked object.
11. The imaging device according to claim 1, wherein: The imaging settings include recognition sensitivity, which defines the difficulty of object recognition.
12. The imaging device according to claim 1, wherein: The setting registration unit registers a portion of the object to be controlled for each object type.
13. The imaging device according to claim 12, wherein: The setting registration unit registers priorities of a plurality of parts to be controlled for each subject type.
14. The imaging device according to claim 1, wherein: The setting registration unit displays an icon indicating the imaging setting on a display unit.
15. The imaging device according to claim 14, wherein: In a case where a plurality of the subject types are set as the recognition target, the icon is displayed in a size according to the priority of the subject type.
16. The imaging device according to claim 1, wherein: The setting registration unit may switch the imaging setting by operation of a predetermined operation element.
17. The imaging device according to claim 1, wherein: In a case where the imaging setting is changed, the setting registration unit displays the changed imaging setting on a display unit.
18. The imaging device according to claim 1, wherein: In a case where the predetermined imaging setting is displayed on a display unit and the displayed imaging setting is selected, the setting registration unit registers the selected imaging setting.
19. An imaging control method, comprising: Register imaging settings for each subject type; recognizing a subject from an image based on the imaging setting of the type of subject to be targeted for recognition; and Imaging is controlled based on the identified subject.
20. A program for causing a computer to execute the following processing: Register imaging settings for each subject type, recognizing a subject from an image based on the imaging setting of the type of subject to be targeted for recognition; and Imaging is controlled based on the identified subject.
