Imaging device, control method thereof, program, and storage medium

JP2024078298A5Pending Publication Date: 2025-12-05CANON KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2022190752
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2022-11-29
Publication Date
2025-12-05

AI Technical Summary

Technical Problem

Conventional imaging devices struggle with accurate subject detection when the subject is hidden, small in size, or obscured by other objects, leading to difficulties in maintaining continuous capture.

Method used

The imaging device employs a dual detection system, combining image processing and position information from a measurement unit attached to the subject, with a priority determination mechanism to ensure reliable subject detection even under challenging conditions.

Benefits of technology

Ensures continuous subject capture and accurate position information regardless of mounting position or environmental factors, improving detection reliability and stability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

To provide an imaging apparatus capable of continuously capturing a subject even in a condition where it is difficult to recognize the subject on a screen and even in a condition where the positional detection of positional information attached to the subject by a transmitter is not correct.SOLUTION: The imaging apparatus includes acquisition means for acquiring an image, first detection means for detecting the subject in the image, information acquisition means for acquiring information from measurement means attached to the subject, second detection means for detecting the position of the subject on the basis of the information acquired by the information acquisition means, and determination means for preferentially using one of the first detection means and the second detection means, to determine the position of the subject. When it is determined that the reliability of the detection result of the first detection means is lower than a predetermined value, the determination means decides the position of the subject by prioritizing the detection result of the second detection means.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging device such as a camera, and more particularly to a technique for photographing a moving subject. [Background technology]

[0002] In recent years, technologies have become known for imaging devices such as cameras, smartphones, and the camera platform and gimbals that they are mounted on, that detect subjects based on information from captured images and assist in shooting by tracking the subjects and adjusting the focus.However, methods that detect subjects based on image information can be difficult in situations where the subject is hidden behind another object.

[0003] In response to this, a technology has been proposed in which a camera recognizes the position of a subject by attaching a device that transmits position information to the subject.

[0004] For example, Patent Document 1 describes a method of calculating the position of a subject from position information from a device attached to the subject and the attitude of an imaging device, and displaying information on the position and direction of the subject on a display screen.

[0005] Furthermore, Patent Document 2 describes that a subject detection range on a screen is determined based on position information from a device attached to the subject, and the subject is detected within the determined range. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2002-314851 A [Patent Document 2] JP 2006-270274 A Summary of the Invention [Problem to be solved by the invention]

[0007] However, in the conventional technology disclosed in the above-mentioned Patent Document 1, the subject may not be detected accurately depending on the size of the subject in the image and where on the subject the device that transmits location information is attached. Also, in the conventional technology disclosed in Patent Document 2, it is difficult to detect the subject when the subject is hidden by an object other than the subject.

[0008] SUMMARY OF THE PRESENT EMBODIMENT An object of the present invention is to provide an imaging device that is capable of continuously capturing a subject even under conditions in which the subject on the screen is difficult to recognize. [Means for solving the problem]

[0009] In order to achieve the above-mentioned object, the present invention comprises an acquisition means for acquiring an image, a first detection means for detecting a subject within the image, an information acquisition means for acquiring information from a measurement means attached to the subject, a second detection means for detecting the position of the subject based on the information acquired by the information acquisition means, and a determination means for determining the position of the subject by giving priority to one of the first detection means and the second detection means, wherein the determination means determines the position of the subject by giving priority to the detection result of the second detection means when it is determined that the reliability of the detection result of the first detection means is lower than a predetermined value. Effect of the Invention

[0010] According to the present invention, it is possible to provide an imaging device that can continue to capture a subject even under conditions where it is difficult to recognize the subject on the screen, and that can continue to capture the subject regardless of the installation position of a device for transmitting position information. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing a configuration of an imaging system. [Diagram 2] An example of when the subject is within the frame. [Diagram 3] FIG. 4 is a block diagram showing the configuration of a measurement unit and a second subject detection unit of the imaging device. [Figure 4]5 is a flowchart showing a process from when the imaging device starts detection to when the imaging device detects a subject according to the first embodiment. [Diagram 5] 6 is an example of a screen when determining whether a subject is within the photographic angle of view in the first embodiment. [Figure 6] 13 is an example of the first embodiment when the subject is small on the screen. [Figure 7] 13 is an example of a case in which a subject is hidden by an obstacle in the first embodiment. [Figure 8] 10 is a flowchart showing a process from when the imaging apparatus starts detection to when the imaging apparatus detects a subject according to the second embodiment. [Figure 9] 13 is an example of a case where the movement locus of the measuring means vibrates in the second embodiment. [Figure 10] 13 is an example of the second embodiment when both the measuring means and the subject do not fit within the screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] [First embodiment] Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Note that the following embodiments do not limit the claimed invention. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the accompanying drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0013] 1 is a block diagram showing the configuration of a digital camera 100 equipped with an imaging unit as an example of an imaging device according to an embodiment of the present invention. The imaging system constituting this embodiment can be applied to any electronic device capable of processing captured images and position information of a subject, in addition to the imaging device described later. These electronic devices may include, for example, mobile phones, game consoles, tablet terminals, personal computers, watch-type or eyeglass-type information terminals, head-mounted displays, etc.

[0014] The control unit 101 is, for example, a CPU, which reads out a control program for each block included in the imaging device 1 from a ROM 102 described later, and develops and executes the program in a RAM 103 described later. In this way, the control unit 101 controls the operation of each block included in the imaging device 1.

[0015] The ROM 102 is an electrically erasable and recordable non-volatile memory, and stores operation programs for each block of the imaging device 1 as well as parameters and the like required for the operation of each block.

[0016] The RAM 103 is a rewritable volatile memory, and is used for developing programs executed by the control unit 101 and the like, and for temporarily storing data generated by the operations of each block of the imaging device 1, and the like.

[0017] The optical system 104 is composed of a group of lenses including a zoom lens and a focus lens, and forms a subject image on an imaging surface of an imaging unit 105 described below. The optical system 104 may be configured to be replaceable with respect to the digital camera 100. In that case, the digital camera 100 and the optical system 104 communicate with each other via a group of mount contacts (not shown). The digital camera 100 may be configured to adjust the amount of light taken in by adjusting an aperture system of an aperture (not shown) in the optical system 104, or to adjust the focus position by adjusting the position of the lens group, by controlling communication via the group of mount contacts.

[0018] The imaging unit 105 is an imaging element such as a CCD or CMOS sensor, which photoelectrically converts an optical image formed on the imaging surface of the imaging unit 105 by the optical system 104 and outputs the resulting analog signal to an A / D conversion unit .

[0019] The A / D conversion unit 106 converts the input analog image signal into digital image data. The digital image data output from the A / D conversion unit 106 is temporarily stored in the RAM 103.

[0020] The image processing unit 107 performs various image processing on the image data stored in the RAM 103. Specifically, this includes preprocessing such as signal amplification and reference level adjustment, color interpolation processing for interpolating values ​​of color components not included in the image data, white balance adjustment, and correction processing for correcting the brightness of the image. In addition, the image processing unit 107 can also process information on the brightness (luminance) and contrast of the image data.

[0021] Moreover, image processing unit 107 includes subject detection unit 201 that detects subjects and position calculation unit 202 that calculates the position of the detected subject within the image data. The detection process of subject detection unit 201 includes detection and tracking of characteristic regions (for example, face regions and human body regions), recognition of people and animals, etc. The detection process by subject detection unit 201 uses an existing method, and detailed description thereof will be omitted.

[0022] The position calculation unit 202 will be described with reference to Fig. 2. Fig. 2 shows an example in which a subject 20 is present within the screen 21. The position calculation unit 202 calculates the position and size of the subject 20 on the screen 21 based on image data detected and processed by the subject detection unit 201 of the image processing unit 107. For example, as shown in Fig. 2, the position (X, Y) from the center O of the screen 21 to the center of the subject 20, the height (H) of the subject 20, and the width (W) of the subject 20 are calculated.

[0023] The recording / output unit 108 records data including image data on a recording medium such as a removable memory card, and outputs data to an external device via an external interface. The recording / output unit 108 records the image data processed by the image processing unit 5 as a recorded image via the RAM 103.

[0024] The display unit 109 includes a display device such as an LCD, and displays images stored in the RAM 103 and images recorded in the recording / output unit 108 on the display device. The display unit 109 also displays an operation user interface for receiving instructions from a user. The display unit 109 may further include multiple display devices, such as an EVF (electronic viewfinder) and a rear monitor provided on the photographer's side (rear). The display unit 109 may be capable of simultaneously outputting to multiple display devices, or may be configured to selectively display by switching between them.

[0025] The instruction input unit 110 is an input interface including various physical operation members such as a touch panel and a shutter button, and receives instructions input by a user.

[0026] Angular velocity detection unit 111 is, for example, an angular velocity sensor (gyro sensor) and detects the angular velocity of the digital camera 100 body in the yaw direction and pitch direction caused by camera shake or camera work. An existing method is used as the angular velocity detection method by angular velocity detection unit 111, and detailed description thereof will be omitted.

[0027] The position detection unit 112 is composed of an information acquisition unit 203 and a position calculation unit 204. The information acquisition unit 203 acquires information transmitted by a measuring device 205 attached to the subject. The position detection unit 112 can calculate the position of the subject relative to the digital camera 100 using the position calculation unit 204 based on the data acquired by the information acquisition unit 203.

[0028] The measuring device 205 can measure the position of the subject using an existing method. For example, the position on the earth can be measured using a global positioning system (GPS). Also, the relative position between the measuring device 205 and the image capture device 1 can be measured using multiple or a single transmitter and receiver provided in the measuring device 205 and the digital camera 100, respectively. The measuring device 205 is not limited to these examples, but for convenience, an example using a GPS will be described here.

[0029] As shown in FIG. 3, the measuring device 205 includes a receiving unit 206 and a transmitting unit 207. The receiving unit 206 receives signals from multiple artificial satellites (not shown) and detects the position of the measuring device 205 based on the received signals. The detected position information is recognized as three-dimensional data based on a coordinate system fixed to a macroscopically immovable object such as the Earth. For example, an arbitrary position can be specified by three axes: the center of the Earth is the origin, the rotation axis of the Earth, an axis passing through the origin and a specific point on the equator, and an axis passing through the origin and perpendicular to the axis. The specified position is transmitted by the transmitting unit 207, and the information is acquired by the information acquiring unit 203 of the digital camera 100. Similarly, the information acquiring unit 203 of the digital camera 100 also includes a receiving unit 208, which receives signals from multiple artificial satellites and detects the position of the digital camera 100 based on the received signals. The position calculating unit 204 can calculate the position of the measuring device 205 relative to the digital camera 100 based on the position information of the measuring means 205 and the digital camera 100 acquired by the information acquiring unit 203.

[0030] Furthermore, under the control of the control unit 101, the digital camera 100 performs preparatory shooting (live view shooting) in which analog image signals sequentially output from the imaging unit 105 are sequentially displayed on a display device via the A / D conversion unit 106, RAM 103, image processing unit 105, and display unit 109. During preparatory shooting, it is possible to prepare for shooting by adjusting the composition for actual shooting, which assumes recording on a recording medium or output to an external device, and by changing shooting parameters for actual shooting, such as exposure time (Tv value), aperture value (Av value), and ISO sensitivity.

[0031] Furthermore, the digital camera 100 has a priority determination unit 113, which determines whether the subject detection unit 201 or the position detection unit 112 should be given priority in detecting the position of the subject according to conditions described later.

[0032] In addition, in the present invention, the subject can be automatically tracked by controlling the driving of the camera platform 114 and the optical system 104 in the pan, tilt, and zoom directions based on the detection information of the subject's position acquired by the subject detection unit 201 and the position detection unit 112. This makes it possible to capture an image that includes the subject within the angle of view without any user operation.

[0033] A subject detection method according to a first embodiment of the present invention will be described below with reference to Figs. 4 to 7. In the following embodiments, the subject position is determined using either the subject detection result of image processing unit 107 or position detection unit 112, whichever has the higher reliability. Fig. 4 is a flowchart showing the process from when digital camera 100 starts detection to when the subject is detected. Each step of this flowchart is executed by control unit 101 or each unit of digital camera 100 in response to an instruction from control unit 101.

[0034] First, in step S401, when subject detection processing is started by subject detection unit 201 of digital camera 100, subject position detection processing is performed by position detection unit 112. The contents of the detection processing by position detection unit 112 are as described above, and when the processing ends, the flow proceeds to S402.

[0035] In S402, the angular velocity detection unit 111 detects the amount of shake of the digital camera 100 (shake detection). The image processing unit 105 calculates the amount of shake of the digital camera 100 in the image based on the information on the shake detected by the angular velocity detection unit 111. If the calculated amount of shake is greater than a predetermined value set in advance, the priority determination unit 113 determines that it is difficult for the subject detection unit 201 to detect the subject, and proceeds to S409. The angular velocity detection unit 111 is used to calculate the amount of shake in the image of the digital camera 100 together with the image processing unit 105, but other means such as an accelerometer may be used as long as they have a similar effect. If the amount of shake in the image of the digital camera 100 is equal to or less than the predetermined value, the process proceeds to S403.

[0036] In S403, the priority determination unit 113 determines whether the scene is difficult to recognize based on information such as brightness of the image data processed by the image processing unit 105.

[0037] Specifically, the priority determination unit 15 determines whether the scene is difficult to recognize based on a predetermined threshold value that has been set in advance. The image processing unit 105 can acquire information such as brightness and contrast within an arbitrary range from the image data. For example, the image processing unit 105 calculates the brightness of the entire screen data including the subject, and the priority determination unit 113 acquires the brightness information calculated by the image processing unit 105. If the priority determination unit 113 determines that the acquired brightness value is lower than a predetermined threshold value, the image data corresponds to a difficult scene. Therefore, the priority determination unit 15 determines that it is difficult for the subject detection unit 201 to detect the subject, and proceeds to S409.

[0038] For example, in the case of shooting in backlight, when an image includes an area where sunlight is abundant and an area of ​​a subject in shadow, the area of ​​the subject may become dark, making it difficult to detect the subject. Therefore, if the image processing unit 105 determines that the brightness value of the subject in the image calculated is lower than a predetermined threshold, it is determined that the scene corresponds to a scene where image recognition is difficult, and the priority determination unit 15 determines that it is difficult to detect the subject by the first subject detection means 4, and proceeds to S109. Note that the image processing unit 105 may calculate the brightness and determine whether the calculated brightness value is lower than a predetermined threshold, and the priority determination unit 113 may acquire the judgment result. In this case, the priority determination unit 113 will determine whether the scene is a scene where image recognition is difficult based on the acquired judgment result.

[0039] The image processing unit 105 can calculate the contrast between the subject and the background in the image or the contrast within the subject. At this time, if the image processing unit 105 determines that the calculated contrast is lower than a predetermined threshold (contrast determination), the scene corresponds to one that is difficult to recognize, and the priority determination unit 113 determines that it is difficult for the subject detection unit 201 to detect the subject, and the process proceeds to S409.

[0040] As described above, the image processing unit 105 judges the brightness of a part of the image, the contrast between the subject and the background, or the contrast within the subject, and detects a scene that is difficult to recognize. If the priority determination unit 15 judges that the scene is not difficult to recognize otherwise, the process proceeds to S404. Although examples of scenes that are difficult to recognize have been presented, the present invention is not limited to these.

[0041] In S404, the image processing unit 105 determines whether or not the position of the subject detected by the second subject detection means 7 in S101 is within the photographing angle of view. Here, whether or not the position of the subject is within the angle of view will be described with reference to FIG.

[0042] FIG. 5 shows an example in which a measuring device 205 is attached to the arm of a subject (person). As shown in FIG. 5, the image processing unit 105 sets a first judgment range 23 that is small relative to the entire image. In FIG. 5(a), the measuring device 205 is included in the image, but only a portion of the subject is included in the image. In other words, it is difficult for the subject detection unit 201 to detect the subject. Therefore, as shown in FIG. 5(b), the image processing unit 105 sets a first judgment range 23 and judges whether the measuring device 205 is included within it. In this case, it is expected that most of the subject is included in the image, and the subject detection unit 201 is more likely to succeed in detecting the subject. The first judgment range 23 may be set by a user operation via the instruction input unit 111 or the like, or may be automatically set by the image processing unit 105 using information such as the type, size, and moving speed of the subject. The first judgment range 23 may also be set according to the setting of the angle of view and the focal length of the optical system 104.

[0043] If the subject is located outside the first determination range 23, the priority determination section 113 determines that it is difficult for the subject detection section 201 to detect the subject, and the process proceeds to S409.

[0044] Otherwise, if the priority determination unit 15 determines in S101 that the subject position detected by the position detection unit 112 is inside the first determination range 23, the process proceeds to S405.

[0045] In S405, the image processing unit determines whether the subject is of a size that allows it to be detected within the image, based on the distance from the digital camera 100 to the subject calculated in S401.

[0046] FIG. 6 shows an example in which the size of the subject in the image is small. When the size of the subject in the image is small, it means that the number of pixels on the imaging element of the imaging unit 103 corresponding to the area of ​​the subject is low. In other words, the accuracy of subject detection decreases. The size of the subject in the image is calculated based on the distance from the imaging device 1 to the subject calculated from the position of the subject detected by the position detection unit 112 in S401, the focal length of the optical system 104, and the type and size of the subject obtained by setting by a user operation or automatic discrimination. Therefore, as shown in FIG. 6, the image processing unit 105 sets a second determination range 24 in the image. The second determination range 24 is set to a size that allows the subject detection unit 201 to successfully detect the subject. The image processing unit 105 compares the size of the subject with the size of the second determination range 24.

[0047] If the size of the subject in the image is smaller than the second determination range 24, the priority determination section 113 determines that it is difficult for the subject detection section 201 to detect the subject, and the process proceeds to S409.

[0048] Otherwise, if the size of the subject in the image is larger than the second determination range 24, the process proceeds to S406.

[0049] In S406, if the priority determination unit 113 has not determined in S402 to S405 that it is difficult for the subject detection unit 201 to detect the subject, the subject detection unit 201 performs the subject position detection process in the above-described procedure.

[0050] In S407, it is determined whether the subject can be detected by the subject position detection process performed by the subject detection unit 201 in S406.

[0051] Fig. 7(a) shows a case where the subject can be detected in the image without being hidden by an obstacle (a person other than the subject in this case), and Fig. 7(b) shows a case where the subject is hidden by an obstacle and cannot be detected on the screen. In the case of Fig. 7(b), since the subject cannot be recognized on the screen, the priority determination unit 113 determines that it is difficult for the subject detection unit 201 to detect the subject, and the process proceeds to S409.

[0052] Otherwise, if the subject can be detected by the subject position detection process performed by the subject detection unit 201 in S406, the process proceeds to S408.

[0053] In S408, if the priority determination section 113 has not determined in S402 to S405 and S407 that subject detection by the subject detection section 201 is difficult, the priority determination section 113 prioritizes the detection result by the subject detection section 201 to determine the position of the subject.

[0054] In S409, if the priority determination section 113 determines in S402 to S405 and S407 that it is difficult for the subject detection section 201 to detect the subject, the priority determination section 113 prioritizes the detection result of the position detection section 112 in determining the position of the subject.

[0055] As described above, in the first embodiment, when it is difficult for the subject detection unit 201 to detect the subject (obtain position information), the subject can be continuously captured by prioritizing the detection result of the subject's position by the position detection unit 112. Furthermore, even if an error due to communication conditions or unnecessary vibration of the measuring device 205 is detected, the subject can be continuously captured.

[0056] Second embodiment A subject detection method according to a second embodiment of the present invention will be described below with reference to Fig. 8 to Fig. 10. Fig. 8 is a flowchart showing a process from when imaging device 1 starts detection to when subject 20 is detected. Each step of this flowchart is executed by control unit 101 or each unit of imaging device 1 in response to an instruction from control unit 101.

[0057] In step S801, the position detection unit 112 performs the process of detecting the position of the subject, similarly to S401, and when the process ends, the process proceeds to S802.

[0058] In S802, the information acquisition unit 203 determines the communication status between the digital camera 100 and the measuring device 205. As described above, the information acquisition unit 203 acquires information transmitted by the measuring device 205 attached to the subject, and the position detection unit 112 calculates the position of the subject relative to the digital camera 100 based on the acquired data. If a communication failure occurs between the transmission of information by the transmission unit 206 of the measuring device 205 and the reception unit 208 of the information acquisition unit 203, a time lag occurs in the acquisition of information on the subject's position, causing an error. As a result, the reliability of the information on the subject's position detected by the position detection unit 112 decreases.

[0059] Therefore, if the information acquisition unit 203 detects that the position error due to poor communication is greater than a preset value, the priority determination unit 113 determines that it is difficult for the position detection unit 112 to detect the subject, and the process proceeds to S806.

[0060] In addition to the above, if the information acquisition unit 203 does not detect that the position error due to communication failure is greater than a preset value, the process proceeds to S803.

[0061] In S803, the position detection unit 112 determines whether the measuring device 205 is vibrating significantly in S801.

[0062] For example, as shown in FIG. 9, if the measuring device 205 is attached to the arm of the subject 20, when the subject 20 runs, the measuring device 205 detects the position that follows the swing of the arm. In FIG. 9, T0 indicates the movement trajectory of the center of gravity of the subject 20 running, T1 indicates the movement trajectory of the measuring device 205 when the arm is swung forward, and T2 indicates the movement trajectory of the measuring device 205 when the arm is swung backward. When the position detection unit 112 detects the subject based on the signal of the measuring device 205, the movement trajectory T1 and T2 are detected, whereas the movement trajectory desired by the user is T0. In particular, in an automatic tracking system such as a camera platform that performs pan-tilt driving based on the position information of the subject, the captured image shakes up and down. Therefore, if the change amount or movement speed of the subject detected by the position detection unit 112 does not satisfy a preset condition, the priority determination unit 113 determines that it is difficult for the position detection unit 112 to detect the subject, and proceeds to S806.

[0063] Otherwise, if the amount of change in position or the moving speed of the subject 20 detected by the second subject detection means 7 satisfies a preset condition, the process proceeds to S804.

[0064] In S804, the position detection unit 112 determines whether the measuring device 205 and the subject are within the image based on the distance from the digital camera 100 to the subject calculated from the position of the subject detected in S801.

[0065] 10, when the digital camera 100 and the subject are sufficiently close or when the focal length of the optical system 104 is long, the entire subject may not fit within the image. In such cases, it may not be possible to fit both the measuring device 205 and the position of the subject desired by the user (for example, the face of a person) within the image. Therefore, the image processing unit 105 pre-sets a third determination range 27 that can fit both the measuring device 205 and the position of the subject desired by the user within the image. At this time, by setting the third determination range 27 to a range larger than the screen 21, erroneous detection can be prevented.

[0066] If the size of subject 20 on screen 21 is larger than third determination range 27, priority determination unit 113 determines that it is difficult for position detection unit 112 to detect the subject, and the process proceeds to S806. Here, the size of the subject in the image is calculated based on the distance from digital camera 100 to the subject calculated from the position of the subject detected by position detection unit 112 in S801, as well as the focal length of optical system 104 and the type and size of the subject obtained by a user operation or automatic determination.

[0067] Otherwise, if the size of the subject in the image is smaller than the third determination range 27, the process proceeds to S805.

[0068] In S805, if the priority determination section 113 has not determined in S802 to S804 that it is difficult for the position detection section 112 to detect the position of the subject, the detection result of the position detection section 112 is given priority and the position of the subject 20 is determined.

[0069] In S806, if the priority determination unit 113 determines in S802 to S804 that it is difficult for the position detection unit 112 to detect the position of the subject, the subject detection unit 201 performs the subject position detection process in the above-described procedure. Then, the process proceeds to S807.

[0070] The priority determination unit 113 prioritizes the detection result of the object detection unit 201 to determine the position of the object.

[0071] As described above, in the second embodiment, when it is difficult for the position detection unit 112 to detect the position of the subject, priority is given to the detection of the position of the subject 20 by the first subject detection means 4, so that it is possible to continue capturing the subject even under conditions in which it is difficult to recognize the subject on the screen.

[0072] (Other embodiments) Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0073] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0074] 100 Imaging device 101 Control section 102 ROM 103 RAM 104 Optical system 105 Imaging unit 106 A / D conversion section 107 Image Processing Unit 108 Recording / Output Section 109 Display section 110 Instruction input unit 111 Angular velocity detector 112 Position detection unit 113 Priority determination section 201 Subject detection unit 202 Position calculation section 203 Information Acquisition Department 204 Position calculation section 205 Measuring Equipment

Claims

1. an acquisition means for acquiring an image; a first detection means for detecting a subject from within the image; an information acquisition means for acquiring information from a measurement means attached to the subject; a second detection means for detecting the position of the subject based on the information acquired by the information acquisition means; a determining means for determining the position of the subject by giving priority to one of the first detecting means and the second detecting means, an imaging device characterized in that, when the determination means determines that the reliability of the detection result of the first detection means is lower than a predetermined value, the determination means gives priority to the detection result of the second detection means in determining the position of the subject;

2. a shake detection means for detecting a shake of the imaging device; 2. The imaging apparatus according to claim 1, wherein when the amount of blur is greater than a first value, the determining means determines that the reliability of the detection result of the first detecting means is lower than the predetermined value.

3. a brightness determination means for determining the brightness of the image; 2. The imaging device according to claim 1, wherein when the brightness of at least a part of the image is lower than a first value, the determining means determines that the reliability of the detection result of the first detecting means is lower than the predetermined value.

4. The imaging device described in claim 3, characterized in that when the difference in brightness between a first region of the image determined by the brightness determination means and a second region different from the first region is greater than a second value, the determination means determines that the reliability of the detection result of the first detection means is lower than the predetermined value.

5. A contrast determination means for determining contrast is provided, 2. The imaging device according to claim 1, wherein when the contrast value of at least a part of the image is lower than a first value, the determining means determines that the reliability of the detection result of the first detecting means is lower than the predetermined value.

6. further comprising setting means for setting a first determination range within the image; 2. The imaging device according to claim 1, wherein when the position of the subject detected by the second detection means is outside the first determination range, the determination means determines that the reliability of the detection result of the first detection means is low.

7. the setting means sets a second determination range different from the first determination range within the image; 7. The imaging device according to claim 6, wherein when the size of the subject in the image is smaller than the second determination range, the determination means determines that the reliability of the detection result of the first detection means is low.

8. 8. The imaging apparatus according to claim 1, wherein when the first detecting means cannot detect the subject, the determining means determines that the reliability of the detection result of the first detecting means is low.

9. an acquisition means for acquiring an image; a first detection means for detecting a subject from within the image; an information acquisition means for acquiring information from a measurement means attached to the subject; a second detection means for detecting the position of the subject based on the information acquired by the information acquisition means; a determining means for determining the position of the subject by giving priority to one of the first detecting means and the second detecting means, an imaging device characterized in that, when the determination means determines that the reliability of the detection result of the second detection means is lower than a predetermined value, the determination means determines the position of the subject by giving priority to the detection result of the first detection means.

10. 10. The imaging device according to claim 9, wherein when the error in the position of the subject detected by the second detection means is larger than a first value, the determination means determines that the reliability of the detection result of the second detection means is lower than the predetermined value.

11. 11. The imaging apparatus according to claim 9, wherein when the first detecting means cannot detect the subject, the determining means determines the position of the subject using the detection result of the second detecting means.

12. an acquisition step of acquiring an image; a first detection step of detecting a subject from within the image; an information acquisition step of acquiring information from a measurement means attached to the subject; a second detection step of detecting the position of the subject based on the information acquired in the information acquisition step; a determination step of determining the position of the subject by giving priority to one of the detection results in the first detection step and the second detection step, A control method for an imaging device, characterized in that the judgment step determines the position of the subject by giving priority to the detection result in the second detection step when it is determined that the reliability of the detection result in the first detection step is lower than a predetermined value.

13. an acquisition step of acquiring an image; a first detection step of detecting a subject from within the image; an information acquisition step of acquiring information from a measurement means attached to the subject; a second detection step of detecting the position of the subject based on the information acquired in the information acquisition step; a determination step of determining the position of the subject by giving priority to one of the detection results in the first detection step and the second detection step, A control method for an imaging device, characterized in that the judgment step determines the position of the subject by giving priority to the detection result in the first detection step when it is determined that the reliability of the detection result in the second detection step is lower than a predetermined value.

14. A program for causing a computer to execute each step of the control method according to claim 12 or 13.

15. A computer-readable storage medium storing the program according to claim 14.

16. A computer-readable storage medium storing the program according to claim 15.