Imaging device, control method thereof, and program
The imaging device adjusts calibration indices based on accessory focus detection areas to maintain gaze detection accuracy and reduce user burden, addressing focus control misalignment issues.
Patent Information
- Application Number
- JP2021077482
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-04-30
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2041-04-30
AI Technical Summary
Existing imaging devices face challenges in maintaining gaze detection accuracy during calibration due to variations in focus controllable ranges caused by detachable accessories, leading to increased user burden and potential misalignment of focus control.
The imaging device adjusts the display position and number of calibration indices based on the focus detection area of attached accessories, using a gaze detection unit, calibration unit, and focus detection area acquisition means to maintain accuracy.
This approach ensures accurate gaze detection and focus control by adapting to changes in focus controllable ranges, reducing user burden and improving calibration efficiency.
Smart Images

Figure 0007739037000001 
Figure 0007739037000002 
Figure 0007739037000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an imaging device, a control method thereof, and a program, and more particularly to an imaging device, a control method thereof, and a program that perform focus control based on information on a detected line-of-sight position. [Background technology]
[0002] In recent years, imaging devices have become more automated and intelligent, and imaging devices have been proposed that can recognize the subject intended by the user based on information about the gaze position of the user looking through the viewfinder and perform focus control without the need to manually input the subject position.In this case, when the imaging device detects the user's gaze position, a discrepancy occurs between the user's intended gaze position and the user's gaze position recognized by the imaging device, and it may not be possible to focus on the subject intended by the user.
[0003] In response to this, a technique is known in which an index is displayed in the viewfinder before shooting, the user is instructed to gaze at the index, the user's gaze position is detected while the user is gazing at the index, and calibration is performed to detect the amount of deviation from the index position.Then, during shooting, the user's gaze position recognized by the imaging device is corrected by the detected amount of deviation, so that the corrected gaze position is closer to the gaze position intended by the user (see, for example, Patent Document 1).
[0004] Also known is a technology that determines the detection accuracy of the gaze position and changes the display form of display objects depending on the determined detection accuracy, thereby preventing the selection of a gaze position unintended by the user (see, for example, Patent Document 2). Specifically, since the calibration accuracy is higher near the index that the user gazes at during calibration, the greater the number of indexes, the higher the overall accuracy of the calibration. However, the more indexes there are, the more operations the user is required to perform during calibration, which increases the burden on the user. Therefore, Patent Document 2 determines the detection accuracy of the gaze position, and displays display objects sparsely in areas where the determined gaze detection accuracy is low, and displays display objects densely in areas where the gaze detection accuracy is high. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-008323 [Patent Document 2] Japanese Patent Application Laid-Open No. 2015-152938 Summary of the Invention [Problem to be solved by the invention]
[0006] However, the calibration in Patent Document 1 does not take into consideration the fact that the focus controllable range varies depending on the accessories that are detachably attached to the imaging device.
[0007] For example, if the lens attached to the imaging device at the time of calibration is a lens for a 35mm full-frame sensor, the focus controllable range is 36mm vertically and 24mm horizontally. On the other hand, if the lens is an APS-C sensor lens, the focus controllable range is approximately 15.5mm vertically and 23.3mm horizontally. In other words, the focus controllable range is smaller in the latter case than in the former case.
[0008] Therefore, if the index is displayed in the same position in the viewfinder during calibration regardless of the photographic lens attached to the imaging device, the calibrated index may be outside the range of focus control. This problem may also occur when multiple photographic lenses with the same target sensor but different performance are attached to the imaging device. On the other hand, increasing the number of indexes to improve accuracy increases the time required for calibration and increases the burden on the user.
[0009] In Patent Document 2, for example, it is possible to prevent erroneous detection of gaze detection by enlarging the focus frame in areas where detection accuracy is poor, but if the focus frame becomes too large, there is a problem that it is not possible to perform the focus control desired by the user.
[0010] Therefore, an object of the present invention is to provide an imaging device, a control method thereof, and a program that can maintain the gaze detection accuracy during calibration even when the focus controllable range changes due to differences in detachably attached accessories. [Means for solving the problem]
[0011] The imaging device according to claim 1 of the present invention is an imaging device having a viewfinder inside and capable of detachably mounting a plurality of accessories, View a gaze detection unit for detecting a gaze position of a user; a calibration index for displaying the calibration index on the viewfinder; a display position of the calibration index on the viewfinder; View a calibration unit that acquires correction information for individual differences in the eyes by performing calibration based on the gaze position of the user detected by the gaze detection unit, and corrects the gaze detection unit using the correction information; and a calibration unit that displays a through image on the viewfinder and corrects the through image. View a setting means for detecting a user's line of sight by the line of sight detection means and setting the line of sight as a focus frame; and a focus detection area acquisition means for acquiring a focus detection area from the attached accessory when one of the plurality of accessories is attached, The calibration meansDepending on the acquired focus detection area ,before The calibration method has been changed. and changing the display position of the index in the finder to change the calibration method. It is characterized by: [Effects of the Invention]
[0012] According to the present invention, even if the focus controllable range changes due to differences in accessories detachably attached to the imaging device, the accuracy of gaze detection during calibration can be maintained. [Brief explanation of the drawings]
[0013] [Figure 1] 1 is a diagram illustrating an outline of the internal configuration of an imaging system according to a first embodiment. [Figure 2] FIG. 1 is a diagram illustrating the appearance of an imaging system. [Figure 3] FIG. 2 is a block diagram showing an electrical configuration built into the imaging system. [Figure 4] 4 is a diagram showing the field of view in the finder in FIG. 3 when the finder is in operation. FIG. [Figure 5] FIG. 1 is a diagram for explaining the principle of a gaze detection method. [Figure 6] 10A and 10B are diagrams for explaining a method for detecting coordinates corresponding to a corneal reflection image and a pupil center from eye image data. [Figure 7] 10 is a flowchart of a gaze detection process. [Figure 8] 2A to 2C are diagrams showing examples of focus detection areas displayed in the viewfinder field during calibration when photographic lenses with different focus detection areas are attached to the camera body in FIG. 1. [Figure 9] 10A and 10B are diagrams showing other examples of focus detection areas within the viewfinder field during calibration when photographing lenses with different focus detection areas are attached to the camera body. [Figure 10] 10A and 10B are diagrams showing examples of focus detection areas within the viewfinder field of view during calibration at different viewfinder viewing angles. [Figure 11]10 is a flowchart of a calibration method determination process that is executed when an accessory is attached to a camera housing. [Figure 12] 10 is a flowchart of a re-calibration method determination process executed when an accessory attached to the camera housing is replaced. [Figure 13] 13 is an example of a recalibration warning screen displayed on the finder in step S1204 of FIG. 12. [Figure 14] 12. FIG. 13 is a diagram for explaining a ranging point index whose size is determined according to the line-of-sight detection accuracy in step S1208 of FIG. 12 and is displayed on the viewfinder. DETAILED DESCRIPTION OF THE INVENTION
[0014] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the present invention, and not all of the combinations of features described in the embodiments are necessarily essential to the solution of the present invention.
[0015] Example 1 1 to 11, a calibration according to a first embodiment of the present invention will be described below in which the focus controllable range changes depending on the accessory detachably attached to the camera body. While a photographic lens is used as an example of the accessory in this embodiment, any accessory whose focus controllable range changes depending on the imaging device can be used. For example, the calibration described below is also performed when an extender is attached as an accessory between the camera body and the photographic lens.
[0016] 1 to 3, the configuration of an imaging system 1 including a photographic lens 1A, which is one of the accessories, and a camera housing 1B, which serves as an imaging device, to which the photographic lens 1A is detachably attached, will be described.
[0017] 2A and 2B are diagrams showing the appearance of the imaging system 1, where FIG. 2A is a front perspective view, FIG. 2B is a rear perspective view, and FIG. 2C is a diagram for explaining the operating member 42 of FIG. 2B.
[0018] As shown in FIG. 2(a), a release button 5 is provided on the front surface of the camera housing 1B.
[0019] The release button 5 is an operating member that receives an image capturing operation from the user.
[0020] As shown in FIG. 2(b), an eyepiece window 6 and operation members 41 to 43 are provided on the rear surface of the camera housing 1B.
[0021] The eyepiece window 6 is a window through which the user can view an image for visual confirmation displayed on a viewfinder 10, which will be described later with reference to FIG. 1 and is included inside the camera housing 1B.
[0022] The operation member 41 is a touch panel compatible liquid crystal display, the operation member 42 is a lever type operation member, and the operation member 43 is a button type cross key. In this embodiment, the operation members 41 to 43 used for camera operations such as manually moving and controlling the focus frame on the viewfinder 10 (described later) are provided on the camera housing 1B, but are not limited to this. For example, other operation members such as electronic dials may be provided on the camera housing 1B in addition to or instead of the operation members 41 to 43.
[0023] Fig. 1 is a cross-sectional view of the camera housing B cut along the YZ plane formed by the Y axis and Z axis shown in Fig. 2(a), and shows an outline of the internal configuration of the imaging system 1. In Fig. 1, the same components as those in Fig. 2 are assigned the same reference numerals.
[0024] 1, photographic lens 1A is a photographic lens that is detachably attached to camera body 1B. For convenience, in this embodiment, only two lenses 101 and 102 are shown as lenses inside photographic lens 1A, but it is well known that in reality, photographic lens 1A is made up of many more lenses.
[0025] Camera housing 1B includes therein imaging element 2, CPU 3, memory section 4, viewfinder 10, viewfinder drive circuit 11, eyepiece 12, light sources 13a to 13b, beam splitter 15, light receiving lens 16, and eye imaging element 17.
[0026] The image sensor 2 is disposed on the intended image plane of the photographic lens 1A and captures an image. The image sensor 2 also functions as a photometric sensor.
[0027] The CPU 3 is a central processing unit of a microcomputer that controls the entire imaging system 1 .
[0028] The memory unit 4 records the images captured by the imaging element 2. The memory unit 4 also has a function of storing imaging signals from the imaging element 2 and the eye imaging element 17, and stores correction information (gaze correction coefficients Ax, Bx, Ay, By) that corrects for individual differences in the gaze direction, which will be described later.
[0029] The finder 10 is configured with a display element such as a liquid crystal display for displaying an image (through image) captured by the image capturing element 2.
[0030] The viewfinder drive circuit 11 is a circuit that drives the viewfinder 10.
[0031] The eyepiece 12 is a lens through which the user peers into the eyepiece window 6 (FIG. 2) to observe the visual image displayed on the viewfinder 10.
[0032] Light sources 13a-13b are infrared light-emitting diodes arranged around the eyepiece window 6 (FIG. 2) to illuminate the user's eyeball 14 and detect the user's line of sight. When light sources 13a-13b are turned on, corneal reflection images (Purkinje images) Pd, Pe (FIG. 5) of light sources 13a-13b are formed on the eyeball 14. In this state, light from the eyeball 14 passes through the eyepiece 12 and is reflected by the beam splitter 15. An eye image including an eyeball image is formed on an ocular imaging element 17 (generation means) consisting of a two-dimensional array of photoelectric elements such as a CMOS by the light-receiving lens 16, thereby generating eye image data. The light-receiving lens 16 positions the pupil of the user's eyeball 14 and the ocular imaging element 17 in a conjugate imaging relationship. Using a predetermined algorithm described later, the gaze detection circuit 201 (gaze detection means: Figure 3) detects the gaze direction (the user's viewpoint fixed on the viewing image, hereinafter referred to as the first estimated gaze point position) from the position of the corneal reflection image in the eyeball image formed on the ocular imaging element 17.
[0033] The light splitter 15 reflects the light that has passed through the eyepiece 12 and forms an image on the ocular imaging element 17 via the light receiving lens 16, and also transmits the light from the viewfinder 10 so that the user can see the visual image displayed on the viewfinder 10.
[0034] The photographic lens 1A includes an aperture 111, an aperture drive device 112, a lens drive motor 113, a lens drive member 114 including a drive gear and the like, a photocoupler 115, a pulse plate 116, a mount contact 117, and a focus adjustment circuit 118.
[0035] A photocoupler 115 detects the rotation of a pulse plate 116 that is linked to the lens driving member 114 and transmits the detection result to a focus adjustment circuit 118 .
[0036] The focus adjustment circuit 118 drives the lens drive motor 113 by a predetermined amount based on information from the photocoupler 115 and information on the lens drive amount from the camera body 1B, and moves the photographic lens 1A to the in-focus position.
[0037] The mount contact 117 is an interface between the camera housing 1B and the photographic lens 1A and has a known configuration. Signals are transmitted between the camera housing 1B and the photographic lens 1A via the mount contact 117. The CPU 3 of the camera housing 1B acquires type information and optical information of the photographic lens 1A to determine the focusable range of the photographic lens 1A attached to the camera housing 1B.
[0038] Fig. 3 is a block diagram showing the electrical configuration built into the imaging system 1. In Fig. 3, the same components as those in Figs. 1 and 2 are assigned the same numbers.
[0039] The camera housing 1B includes a line-of-sight detection circuit 201, a photometry circuit 202, an autofocus detection circuit 203, a signal input circuit 204, a viewfinder drive circuit 11, a light source drive circuit 205, a line-of-sight detection reliability determination circuit 31, and a communication circuit 32, each of which is connected to the CPU 3. The photographic lens 1A also includes a focus adjustment circuit 118 and an aperture control circuit 206 included in the aperture drive device 112 (FIG. 1), each of which transmits signals to the CPU 3 of the camera housing 1B via mount contacts 117.
[0040] The gaze detection circuit 201 A / D converts the eye image data formed and output on the eye imaging element 17 and transmits this eye image data to the CPU 3. The CPU 3 extracts each feature point of the eye image required for gaze detection from the eye image data in accordance with a predetermined algorithm described later, and further calculates the gaze position of the user estimated from the position of each extracted feature point (first estimated gaze point position).
[0041] Based on the signal obtained from the image sensor 2, which also functions as a photometric sensor, the photometry circuit 202 amplifies the luminance signal output corresponding to the brightness of the field, then performs logarithmic compression and A / D conversion, and sends it to the CPU 3 as field luminance information.
[0042] The autofocus detection circuit 203 A / D converts signal voltages from multiple pixels included in the image sensor 2 that are used for phase difference detection, and sends the converted signal to the CPU 3. The CPU 3 calculates the distance to the subject corresponding to each focus detection point from the signal voltages from the multiple pixels. This is a well-known technique known as image plane phase difference AF. In this embodiment, there are 180 focus detection points on the image plane of the viewfinder 10, as shown in the viewfinder field of view image (visual image) in Figure 4.
[0043] The signal input circuit 204 is connected to switches SW1 and SW2 (not shown). Switch SW1 is turned on by the first stroke of the release button 5 (FIG. 2(a)) to start photometry, distance measurement, line of sight detection, and other operations of the imaging system 1. Switch SW2 is turned on by the second stroke of the release button 5 to start the release operation. Signals from switches SW1 and SW2 are input to the signal input circuit 204 and sent to the CPU 3.
[0044] The gaze detection reliability determination circuit 31 (reliability determination means) determines the reliability of the first estimated gaze point position calculated by the CPU 3. This determination is performed based on the differences between two sets of eye image data: eye image data acquired during calibration (described later) and eye image data acquired during photography. Specifically, the differences here are differences in pupil diameter, the number of corneal reflections, and the amount of external light detected from each of the two sets of eye image data. More specifically, the gaze detection method described later in FIGS. 5 to 7 calculates the pupil edge. For example, if the number of extracted pupil edges is equal to or greater than a threshold, the reliability is determined to be high; otherwise, the reliability is determined to be low. This is because the pupil 141 (FIG. 5) of the user's eyeball 14 is estimated by connecting the pupil edges, and the more pupil edges that can be extracted, the higher the estimation accuracy. Alternatively, the reliability may be determined based on the degree to which the pupil 141 calculated by connecting the pupil edges is distorted relative to a circle. As another method, the reliability may be determined to be high near the index that the user gazes at during calibration, which will be described later, and low the reliability as the user gazes away from the index. When the gaze position information of the user calculated by the gaze detection circuit 201 is transmitted to the CPU 3, the gaze detection reliability determination circuit 31 transmits the reliability of the gaze position information to the CPU 3.
[0045] The communication circuit 32, under the control of the CPU 3, communicates with a PC (not shown) on a server via a network (not shown) such as a LAN or the Internet.
[0046] The above-mentioned operation members 41 to 43 are configured to transmit their operation signals to the CPU 3, and in response to these signals, movement control by manual operation of the first estimated point of gaze position, which will be described later, is performed.
[0047] FIG. 4 is a diagram showing the viewfinder field, showing the state in which the viewfinder 10 is in operation (the state in which the visual image is displayed).
[0048] As shown in FIG. 4, the field of view within the finder includes a field mask 300, a focus detection area 400, 180 distance measurement point indices 4001 to 4180, and the like.
[0049] Each of the ranging point indices 4001 to 4180 is superimposed on a through image (live view image) displayed on the viewfinder 10 so as to be displayed at a position corresponding to one of a plurality of focus detection points on the imaging surface of the image sensor 2. Of the ranging point indices 4001 to 4180, the ranging point indice that coincides with position A, which is the current first estimated point of interest position, is set as a focus frame by the CPU 3 (setting means) and is highlighted on the viewfinder 10. When the release button 5 is half-pressed, focus adjustment is performed by the autofocus detection circuit 203 and focus adjustment circuit 118 under instructions from the CPU 3, with the focus frame currently set in the viewfinder 10 as the focus position.
[0050] Next, a method for detecting the line of sight by the imaging system 1 will be described with reference to FIGS.
[0051] FIG. 5 is a diagram for explaining the principle of the line-of-sight detection method, and is a schematic diagram of an optical system for performing line-of-sight detection.
[0052] 5, light sources 13a and 13b are light sources such as light-emitting diodes that emit infrared light that is insensitive to the user, and each light source is arranged approximately symmetrically with respect to the optical axis of light-receiving lens 16 to illuminate user's eyeball 14. A portion of the illumination light emitted from light sources 13a and 13b and reflected by eyeball 14 is collected by light-receiving lens 16 onto ocular imaging element 17.
[0053] Figure 6(a) is a schematic diagram of an eye image captured by the eye imaging element 17 (eye image projected onto the eye imaging element 17), and Figure 6(b) is a diagram showing the output intensity of the photoelectric element array in the eye imaging element 17.
[0054] 7 is a flowchart of the gaze detection process, which is executed by the CPU 3 reading out a program stored in a ROM (not shown in FIG. 3).
[0055] 7, when the gaze detection process starts, in step S701, CPU 3 causes light sources 13a and 13b to emit infrared light toward user's eyeball 14. An image of the user's eye illuminated by the infrared light is formed on eye image sensor 17 through light receiving lens 16 and is photoelectrically converted by eye image sensor 17. As a result, a processable electrical signal of the eye image (eye image data) is obtained.
[0056] In step S702, the CPU 3 acquires from the eye imaging element 17 the eye image data obtained from the eye imaging element 17 as described above.
[0057] In step S703, the CPU 3 detects the coordinates corresponding to the corneal reflection images Pd and Pe of the light sources 13a and 13b and the pupil center c from the eye image data obtained in step S702.
[0058] Infrared light emitted from light sources 13a and 13b illuminates cornea 142 of user's eyeball 14. At this time, corneal reflection images Pd and Pe formed by part of the infrared light reflected from the surface of cornea 142 are condensed by light receiving lens 16 and formed on ocular imaging element 17 as corneal reflection images Pd' and Pe'. Similarly, light beams from edges a and b of pupil 141 are also formed on ocular imaging element 17 as pupil edge images a' and b'.
[0059] FIG. 6(b) shows luminance information (luminance distribution) of region α in the eye image of FIG. 6(a). In FIG. 6(b), the horizontal direction of the eye image is the X axis and the vertical direction is the Y axis, and the luminance distribution in the X axis direction is shown. In this embodiment, the X axis (horizontal direction) coordinates of the corneal reflection images Pd' and Pe' are designated Xd and Xe, and the X axis coordinates of the pupil edge images a' and b' are designated Xa and Xb. As shown in FIG. 6(b), an extremely high level of luminance is obtained at the coordinates Xd and Xe of the corneal reflection images Pd' and Pe'. In the range greater than the coordinate Xa and smaller than the coordinate Xb, which corresponds to the region of the pupil 141 (the region of the pupil image 141' obtained by focusing the light beam from the pupil 141 on the ocular imaging element 17), an extremely low level of luminance is obtained except for the coordinates Xd and Xe. In contrast, a luminance intermediate between the two types of luminance described above is obtained in the region of iris 143 outside pupil 141 (the region of iris image 143' outside pupil image 141' obtained by focusing the light beam from iris 143). Specifically, a luminance intermediate between the two types of luminance described above is obtained in a region where the X coordinate (coordinate in the X-axis direction) is smaller than coordinate Xa and a region where the X coordinate is larger than coordinate Xb.
[0060] From the luminance distribution shown in FIG. 6(b), the X-coordinates Xd and Xe of the corneal reflection images Pd' and Pe' and the X-coordinates Xa and Xb of the pupil edge images a' and b' can be obtained. Specifically, the coordinates of the corneal reflection images Pd' and Pe' can be obtained as the coordinates of extremely high luminance, and the coordinates of the pupil edge images a' and b' can be obtained as the coordinates of extremely low luminance. Furthermore, when the rotation angle θx of the optical axis of the eyeball 14 relative to the optical axis of the light receiving lens 16 is small, the coordinate Xc of the pupil center image c' (center of the pupil image 141') obtained when the light beam from the pupil center c is focused on the ocular imaging element 17 can be expressed as Xc ≒ (Xa + Xb) / 2. In other words, the X-coordinate Xc of the pupil center image c' can be calculated from the X-coordinates Xa and Xb of the pupil edge images a' and b'. In this way, the X coordinates of the corneal reflection images Pd' and Pe' and the X coordinate of the pupil center image c' can be estimated.
[0061] 7, in step S704, CPU 3 calculates the imaging magnification β of the eyeball image. The imaging magnification β is determined by the position of eyeball 14 relative to light receiving lens 16, and can be calculated as a function of the distance (Xd-Xe) between corneal reflection images Pd' and Pe'.
[0062] In step S705, the CPU 3 calculates the distance between the optical axis of the eyeball 14 and the optical axis of the light receiving lens 16. Calculating the rotation angle. The X coordinate of the midpoint between the corneal reflection images Pd and Pe and the X coordinate of the center of curvature O of the cornea 142 are approximately the same. Therefore, if the standard distance from the center of curvature O of the cornea 142 to the center c of the pupil 141 is Oc, the rotation angle θX of the eyeball 14 in the ZX plane (plane perpendicular to the Y axis) can be calculated using the following equation 1. The rotation angle θy of the eyeball 14 in the ZY plane (plane perpendicular to the X axis) can also be calculated using a method similar to that for calculating the rotation angle θx. β×Oc×SINθx≒{(Xd+Xe) / 2}-Xc (Formula 1)
[0063] In step S706, the CPU 3 acquires correction coefficients (coefficient m and line-of-sight correction coefficients Ax, Bx, Ay, By) from the memory unit 4. The coefficient m is a constant determined by the configuration of the finder optical system (light-receiving lens 16, etc.) of the imaging system 1, and is a conversion coefficient that converts the rotation angles θx, θy into coordinates corresponding to the pupil center c in the visual image, and is determined in advance and stored in the memory unit 4. The line-of-sight correction coefficients Ax, Bx, Ay, By are parameters that correct individual differences in the eyes, and are acquired by performing a calibration operation (to be described later) and stored in the memory unit 4 before this process starts.
[0064] In step S707, the CPU 3 instructs the line-of-sight detection circuit 201 to calculate the position of the user's gaze fixed on the visual image displayed on the finder 10 (first estimated gaze position). Specifically, the line-of-sight detection circuit 201 calculates the first estimated gaze position using the rotation angles θx, θy of the eyeball 14 calculated in step S705 and the correction coefficient data acquired in step S706. If the coordinates (Hx, Hy) of the first estimated gaze position are coordinates corresponding to the pupil center c, the coordinates (Hx, Hy) of the first estimated gaze position can be calculated by the following equations 2 and 3. Hx=m×(Ax×θx+Bx) (Formula 2) Hy=m×(Ay×θy+By) (Formula 3)
[0065] In step S708, the CPU 3 stores the coordinates (Hx, Hy) of the first estimated gaze point position calculated in step S706 in the memory unit 4, and then ends this process.
[0066] As described above, in the gaze detection process of this embodiment, the first estimated gaze point position was calculated using the rotation angles θx, θy of the eyeball 14 and the correction coefficients (coefficient m and gaze correction coefficients Ax, Bx, Ay, By) that were previously obtained by the calibration work described below.
[0067] However, due to factors such as individual differences in the shape of human eyeballs, it may not be possible to estimate the first estimated gaze point position with high accuracy. Specifically, unless the values of the gaze correction coefficients Ax, Ay, Bx, and By are adjusted to values appropriate for the user, a discrepancy will occur between position B, where the user actually gazes, and position C, which is the first estimated gaze point position calculated in step S707, as shown in FIG. 4(b). In FIG. 4(b), the user is gazing at a person at position B, but the imaging system 1 erroneously estimates that the user is gazing at the background at position C, which is the first estimated gaze point position. As a result, it becomes impossible to perform appropriate focus detection and adjustment for position B, where the user is gazing.
[0068] Therefore, the CPU 3 (calibration means) performs a calibration operation before the imaging system 1 performs imaging (focus detection), obtains line-of-sight correction coefficients Ax, Ay, Bx, and By suitable for the user, and stores them in the memory unit 4.
[0069] Conventionally, calibration work has been performed by highlighting multiple calibration indices D1 to D5 in different positions on the viewfinder 10 as shown in FIG. 4(c) before capturing an image and having the user look at the indices. A known technique involves performing a gaze detection process when the user gazes at each of the indices D1 to D5, and calculating gaze correction coefficients Ax, Ay, Bx, and By appropriate for the user from the calculated coordinates of multiple first estimated gaze point positions and the coordinates of the gazed-at indices. Note that the method is not limited to highlighting the positions of the indices D1 to D5 with a rectangular frame as shown in FIG. 4(c), as long as it indicates the position where the user should look. For example, the positions of the indices D1 to D5 may be highlighted by changing the brightness or color.
[0070] However, since the camera housing 1B of this embodiment is adapted to detachably attach multiple accessories other than the photographic lens 1A, it is known that the range of focus controllable by the camera housing 1B varies depending on the attached accessories.
[0071] The optimum calibration method according to the accessories attached to the camera housing 1B will be described below with reference to FIGS.
[0072] In the following, this embodiment will be described with respect to a case where, in addition to the photographic lens 1A, a photographic lens 1A' with a narrower focus detection area is detachably attached to the camera housing 1B. Specifically, the photographic lenses 1A and 1A' are a photographic lens for a 35 mm full-size sensor (length: 36 mm, width: 24 mm) and a photographic lens for an APS-C sensor (length: approximately 15.5 mm, width: approximately 23.3 mm), respectively, and have similar hardware configurations. However, this is not a limitation as long as the focus detection areas of the photographic lenses 1A and 1A' are different. For example, the photographic lenses 1A and 1A' may be photographic lenses with the same target sensor but different performance.
[0073] 8A and 8B are diagrams showing examples of focus detection areas displayed in the viewfinder field during calibration when photographic lenses with different focus detection areas are attached to the camera housing 1B. FIG. 8A shows a focus detection area 800 displayed in the viewfinder field when photographic lens 1A is attached to the camera housing 1B. FIG. 8B shows a focus detection area 810 displayed in the viewfinder field when photographic lens 1A' is attached to the camera housing 1B. Note that explanations of parts of FIG. 8 that are the same as those of FIG. 4 will be omitted.
[0074] As shown in FIG. 8(a), within the focus detection area 800, an index 801 for use in the calibration operation when the photographing lens 1A is attached to the camera housing 1B is displayed.
[0075] On the other hand, as shown in FIG. 8(b), within the focus detection area 810, an index 811 for use in the calibration operation when the photographing lens 1A' is attached is displayed.
[0076] In FIG. 8(a), the focus detection area 800 covers the entire field of view within the field of view mask 300 in the viewfinder field of view. In contrast, in FIG. 8(b), the focus detection area 810 covers only a portion of the field of view. Therefore, if the index 801 is used in both FIG. 8(a) and FIG. 8(b), most of the index is located outside the focus detection area 810 in FIG. 8(b), which reduces the accuracy of gaze detection. Conversely, if the index 811 is used in both FIG. 8(a) and FIG. 8(b), no index is present at the edge of the focus detection area 800 in FIG. 8(a), which reduces the accuracy of gaze detection at those edges, even within the focus detection area 800.
[0077] Therefore, in the example of Figure 8, as shown in Figures 8(a) and (b), an index for calibration work is set so that it fits within the focus detection area of the photographic lens attached to the camera housing 1B.
[0078] 8, the example in Fig. 8 has been described in which there are five indices for the calibration work, but the number of indices is not limited to this. In other words, the display position, size, and number of indices for the calibration work may be determined according to the focus detection area, not according to the field of view within the viewfinder field.
[0079] In the example of Fig. 8, the positions of the calibration indices are changed to be optimal depending on the size of the focus detection area in order to prevent a deterioration in the accuracy of gaze detection while maintaining the time required for calibration. In contrast, in the example of Fig. 9 described below, when the focus detection area is wide, the number of indices is increased, although this increases the calibration time, in order to provide the gaze detection circuit 201 with the same level of gaze detection accuracy as when the focus detection area is narrow.
[0080] 9 shows other examples of focus detection areas within the viewfinder field during calibration when photographing lenses with different focus detection areas are attached to the camera body 1B. In FIG. 9, explanations of the same parts as in FIG. 4 and FIG. 8 will be omitted.
[0081] Fig. 9(a) shows a focus detection area 800 that is displayed in the viewfinder field when photographic lens 1A is attached to camera body 1B, and Fig. 9(b) shows a focus detection area 810 that is displayed in the viewfinder field when photographic lens 1A' is attached to camera body 1B.
[0082] As shown in FIG. 9(a), within the focus detection area 800, an index 901 for use in the calibration operation when the photographing lens 1A is attached to the camera housing 1B is displayed.
[0083] On the other hand, as shown in FIG. 9(b), within the focus detection area 810, an index 911 for use in the calibration operation when the photographing lens 1A' is attached is displayed.
[0084] 8 and 9 in that the number of indices 901 displayed inside the focus detection area 400 in FIG. 9A is greater than the number of indices 801 in FIG. 8A.
[0085] As mentioned above, calibration tends to have higher detection accuracy near the index that the subject is looking at, and lower detection accuracy the further away from that index. Therefore, in another example shown in Figure 9, the number of indices for calibration work displayed within the focus detection area is set according to the required gaze detection accuracy. That is, in the example of Figure 9, the number of indices for calibration work when photographic lenses with different focus detection areas are attached to the camera housing 1B is changed according to the focus detection area. This makes it possible to achieve the expected gaze detection accuracy in the minimum required calibration time.
[0086] The CPU 3 (display image changing means) of this embodiment has a view angle changing function that changes the view angle of the viewfinder 10, which is made up of a liquid crystal display or the like. This function is used when, for example, the user is wearing glasses and can only see a portion of the image displayed in the viewfinder 10 when looking through the eyepiece window 6, and the user reduces the size of the image displayed in the viewfinder 10 to make the entire image visible.
[0087] Fig. 10 is a diagram showing an example of focus detection areas within the viewfinder field of view during calibration at different viewfinder viewing angles. In Fig. 10, explanations of the same parts as in Fig. 4, and Figs. 8 and 9 will be omitted.
[0088] Both Fig. 10(a) and Fig. 10(b) show the focus detection area within the viewfinder field when calibration is performed with the photographic lens 1A attached to the camera body 1B.
[0089] Fig. 10(a) shows a focus detection area 800 within the viewfinder field of view when the viewfinder field of view is set to the default setting. Fig. 10(b) shows a focus detection area 1000 within the viewfinder field of view when the user uses the viewfinder angle change function to change the viewfinder field of view from the default setting and reduce the size of the image displayed in the viewfinder 10.
[0090] As shown in FIG. 10(b), after the photographic lens 1A is attached to the camera housing 1B, when the size of the image displayed on the viewfinder 10 is reduced by the viewing angle change function, an index 1001 for calibration work is displayed in the focus detection area 1000.
[0091] Please note that in both the display images of the viewfinder 10 in Figures 10(a) and 10(b), the number of focus point targets is the same, 180, but the sizes are different. In this way, when the size of the focus point targets changes depending on the size of the display image of the viewfinder 10, the size of the indices used for calibration also changes accordingly.
[0092] While FIG. 10 illustrates an example in which the ranging point index and the calibration index are the same size and shape, they do not necessarily have to be the same size and shape. That is, at least one of the size and shape of the calibration index may be changed depending on the size of the ranging point target in the viewfinder field of view. For example, the ranging point index and the calibration index may be different in size or shape, and the size of the calibration index may be changed depending on the rate of change of the ranging point index. Furthermore, the size or shape of the calibration index may be changed when the size of the ranging point index falls below a preset threshold. Depending on the performance of the gaze detection circuit 201, if the output image of the viewfinder 10 becomes too small, it may be difficult to achieve gaze detection accuracy for each ranging point index. In such cases, the size of the calibration index may be changed to the size of multiple ranging point indexes before calibration.
[0093] 11 is a flowchart of the calibration method determination process executed when an accessory is attached to the camera housing 1 B. This process is executed by the CPU 3 of the camera housing 1 B reading out a program recorded in a ROM (not shown in FIG. 3) when no accessory is attached to the camera housing 1 B.
[0094] In step S1101, CPU 3 determines whether an accessory has been attached to camera housing 1B. Specifically, CPU 3 determines that an accessory such as photographic lens 1A has been attached to camera housing 1B when the state of the signal output from mount contact 117 changes. If it is detected that an accessory has been attached, the process proceeds to step S1102. In the following, this process will be described taking as an example a case where photographic lens 1A has been attached as the accessory.
[0095] In step S1102, CPU 3 communicates with photographic lens 1A via mount contact 117 to acquire accessory information. In the case of photographic lens 1A, accessory information includes type information and optical information about the two lenses 101 and 102. Generally, information specific to each lens is stored in a storage medium (not shown) inside photographic lens 1A, and CPU 3 of camera housing 1B acquires this information through communication with photographic lens 1A. After acquiring the accessory information, the process proceeds to step S1103.
[0096] In step S1103, CPU 3 (focus detection area acquisition means) calculates focus detection area A based on the accessory information acquired in step S1102. This focus detection area A will be focus detection area 800 in FIG. 8(a) if the accessory attached to camera housing 1B is photographic lens 1A, and will be focus detection area 810 in FIG. 8(b) if the accessory attached to camera housing 1B is photographic lens 1A'. In other words, the area that focus detection area A will be can be uniquely determined from the optical information of the attached accessory. After calculating focus detection area A, the process proceeds to step S1104.
[0097] In step S1104, CPU 3 determines the number of indices for calibration according to the expected value of gaze detection accuracy. The expected value of gaze detection accuracy may be preset in CPU 3, or may be arbitrarily set by the user. As mentioned above, calibration generally provides higher detection accuracy near the gazed-at index, so the more indices there are for calibration, the better. However, the calibration process forces the user to perform certain operations, which can be a heavy burden. Therefore, instead of having the user set the expected value of gaze detection accuracy, it is also possible to have the user set the allowable time for calibration and then set the number of calibration indices possible within that time. After determining the number of calibration indices, the process proceeds to step S1105.
[0098] In step S1105, CPU 3 determines whether the size of the image displayed in viewfinder 10 has been changed by the user using the viewing angle change function. The reason why the user would change the image displayed in viewfinder 10 has already been explained in FIG. 10 , so further explanation is omitted. If the determination shows that the size of the image displayed in viewfinder 10 has been changed, the process proceeds to step S1106; if not, the process proceeds to step S1110. In this embodiment, CPU 3 determines that the size of the image displayed in viewfinder 10 has been changed if the viewing angle value is different from the initial setting, but this is not a limitation. For example, the size of the image displayed in viewfinder 10 at the time of the previous calibration may be stored, and the size at that time may be compared with the current size to determine whether the size of the image displayed in viewfinder 10 has changed.
[0099] In step S1106, CPU 3 calculates focus detection area A2 (focus detection area 1000 in FIG. 10(b)) by multiplying focus detection area A acquired in step S1103 by the rate of change in the size of the image displayed in viewfinder 10. After calculating focus detection area A2, the process proceeds to step S1107.
[0100] In step S1107, CPU 3 determines the position of the calibration index so that it is within the focus detection area A2 acquired in step S1106. Details of the method for determining the position of this calibration index are as described in Figure 8. After the position of the calibration index is determined, the process proceeds to step S1108.
[0101] In step S1108, CPU 3 calculates the size of the ranging point index by multiplying the initially set size of the ranging point index by the rate of change in the size of the output image of viewfinder 10, and updates the size of the ranging point index stored in memory unit 4 with the calculated value. Then, the process proceeds to step S1110.
[0102] In step S1109, CPU 3 determines the position of the calibration index so that it is within focus detection area A acquired in step S1103. Details of the method for determining the position of this calibration index are as described in Fig. 8. After the position of the calibration index is determined, the process proceeds to step S1110.
[0103] In step S1110, the CPU 3 determines the size of the calibration index in accordance with the size of the ranging point index stored in the memory unit 4. The method for determining the size of this calibration index is as described in detail with reference to Fig. 10. Then, this process ends.
[0104] According to the process of FIG. 11, calibration indices of the optimum number and size depending on the focus detection area are displayed on the finder 10 during calibration, so that the accuracy of gaze detection during calibration can be maintained.
[0105] Example 2 Hereinafter, with reference to Figures 12 to 14, we will explain recalibration in accordance with Example 2 of the present invention when the focus controllable range changes due to differences in accessories (here, the photographic lens) detachably attached to the camera housing.
[0106] In this embodiment, the same components as those in the first embodiment are given the same numbers, and redundant explanations will be omitted.
[0107] In the first embodiment, a method of calibration when photographic lens 1A is attached to camera housing 1B was described. In contrast, in the present embodiment, a method of re-calibration when photographic lens 1A' is attached to camera housing 1B and then the photographic lens attached to camera housing 1B is changed to photographic lens 1A will be described.
[0108] Fig. 12 is a flowchart of a recalibration method determination process that is executed when an accessory attached to the camera housing 1B is replaced. This process is executed by the CPU 3 of the camera housing 1B reading out a program recorded in a ROM (not shown in Fig. 3) when an accessory is attached to the camera housing 1B. Furthermore, among the steps in Fig. 12, steps that have the same content as those in Fig. 11 are assigned the same numbers, and duplicated explanations will be omitted.
[0109] In step S1201, CPU 3 determines whether the accessory attached to camera housing 1B has been replaced. Specifically, CPU 3 determines that a new accessory has been attached to camera housing 1B when the state of the signal output from mount contact 117 changes. In the following, this process will be described taking as an example a case where the accessory attached to camera housing 1B has been replaced from photographic lens 1A' to photographic lens 1A.
[0110] If it is determined that the accessory has been replaced (YES in step S1201), the process proceeds to step S1102. Steps S1102 and S1103 have been described above in Fig. 11, so a description thereof will be omitted. After step S1103, the process proceeds to step S1202.
[0111] In step S1202, CPU 3 determines whether the focus detection area A calculated in step S1103 has been calibrated in the past. In this embodiment, each time a calibration is performed in the past, the focus detection area and the correction information (gaze correction coefficients Ax, Bx, Ay, By) obtained in that calibration are associated and stored in memory unit 4 (storage means). If the focus detection area A of the photographic lens 1A newly attached after an accessory change in step S1201 is stored in memory unit 4, CPU 3 determines that the focus detection area A has been calibrated in the past. Note that if multiple users use the camera housing 1B, information about the user who performed the calibration is also stored each time a calibration is performed in the past. In this case, in step S1202, the user's information is used to determine whether the user currently using the camera housing 1B has calibrated the focus detection area A in the past.
[0112] If the result of the determination is that the focus detection area A of the newly attached photographing lens 1A has been calibrated (YES in step S1202), the process proceeds to step S1203, whereas if it has not yet been calibrated, the process proceeds to step S1204.
[0113] In step S1203, the CPU 3 (calibration means) acquires from the memory unit 4 correction information obtained during a previous calibration of the focus detection area A of the newly attached photographing lens 1A, and corrects the line of sight detection circuit 201. Then, this process ends.
[0114] In step S1204, the CPU 3 displays a warning screen on the finder 10 to prompt the user to perform recalibration. This warning screen will be described later with reference to Fig. 13. After the warning screen is displayed, the process proceeds to step S1205.
[0115] In step S1205, CPU 3 determines whether recalibration has been performed or whether a user instruction not to perform recalibration has been given. If the user instruction to perform recalibration has been given (YES in step S1205), the process proceeds to step S1206. On the other hand, if a user instruction not to perform recalibration has been given, the process proceeds to step S1207. Here, a user instruction not to perform recalibration is a user instruction given when the user wants to use gaze detection without recalibration, for example, when the user wants to take a picture immediately. Specifically, when the user cancels the warning screen displayed on viewfinder 10 using operation members 41 to 43 or presses release button 5, CPU 3 determines that a user instruction not to perform recalibration has been given. However, the user instruction not to perform recalibration is not limited to this, and various methods can be used, such as notifying camera housing 1B by voice that recalibration will not be performed.
[0116] In step S1206, the CPU 3 performs gaze detection using the correction information obtained by recalibration corresponding to the focus detection area A of the newly attached photographing lens 1A, and then ends this process.
[0117] In step S1207, the CPU 3 (calculation means) calculates the gaze detection accuracy for the focus detection area A when using the correction information stored in the memory unit 4. The gaze detection accuracy can be calculated from the distance between the calibration indicators, the number of times calibration has been performed, etc. Then, the process proceeds to step S1208. If multiple pieces of correction information are stored in the memory unit 4, the correction information obtained by calibration corresponding to the focus detection area with the smallest error from the focus detection area A of the newly attached photographic lens 1A may be selected. Alternatively, the gaze detection accuracy of each previous calibration may be calculated and the one with the highest accuracy may be selected, or the correction information obtained by calibration corresponding to an area larger than the focus detection area A may be selected.
[0118] In step S1208, CPU 3 changes the size of the ranging point index in accordance with the line-of-sight detection accuracy calculated in step S1207, and displays it in viewfinder 10. The method for determining this will be described later with reference to Figure 14. Then, the process proceeds to step S1209.
[0119] In step S1209, the CPU 3 corrects the gaze detection circuit 201 for the newly attached photographic lens 1A using the correction information stored in the memory unit 4. If multiple pieces of correction information are stored in the memory unit 4, the correction information selected by the method described above in step S1207 is used. Then, this process ends.
[0120] Fig. 13 is an example of a recalibration warning screen displayed on the finder 10 in step S1204 in Fig. 12. Note that in Fig. 13, explanations of the same parts as in Fig. 4 will be omitted.
[0121] As shown in Fig. 13, a warning message 1300 prompting the user to perform recalibration is displayed on the warning screen. In this embodiment, the warning message 1300 is exemplified by the phrase "Please perform recalibration," but the warning message is not limited to this. The warning screen of Fig. 13 may be canceled after being displayed for a predetermined period of time. The warning screen of Fig. 13 may be displayed again for a predetermined period of time until recalibration is performed in step S1205 or until a user instruction is given not to perform recalibration.
[0122] Fig. 14 is a diagram for explaining the range finding point index whose size is determined according to the gaze detection accuracy in step S1208 of Fig. 12 and is displayed on the viewfinder 10. Note that in Fig. 14, explanations of parts that are the same as Fig. 4 will be omitted.
[0123] FIG. 14A is a diagram showing a focus frame 1401 at the time of shooting when calibration corresponding to the focus detection area A has been performed.
[0124] FIG. 14B is a diagram showing a focus frame 1402 at the time of shooting when calibration corresponding to the focus detection area A has not been performed.
[0125] As shown in FIG. 14(b), the size of the ranging point index can be increased depending on the gaze detection accuracy, thereby preventing the focus frame from being set in a position unintended by the user. In this embodiment, when optimal calibration has been performed, the focus frame is displayed in a round shape (first display object) like the focus frame 1401. On the other hand, when optimal calibration has not been performed and the focus frame is large, the focus frame is displayed in a diamond shape (second display object) like the focus frame 1402. However, as long as the user can distinguish whether optimal calibration has been completed, the focus frame 1402 is not limited to the form of this embodiment, and may be displayed in a different shape or color, for example. In addition, a message saying "Please recalibrate" may be displayed near the focus frame 1402.
[0126] With the above configuration, when an accessory attached to the camera housing 1B is replaced, the optimal calibration result can be used to perform gaze detection.
[0127] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.
[0128] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]
[0129] 1. Imaging system 1A Photographic Lens 1B Camera housing 3 CPU 4 Memory section 5 Release button 10 Finder 118 Focus adjustment circuit 201 Gaze detection circuit 203 Auto focus detection circuit
Claims
1. An imaging device having an internal finder and capable of detachably mounting a plurality of accessories, a gaze detection means for detecting a gaze position of a user looking through the viewfinder; a calibration means for displaying an index for a calibration operation in the viewfinder, acquiring correction information for individual eye differences through calibration based on the display position of the index in the viewfinder and the gaze position of the user who is looking at the index and detected by the gaze detection means, and correcting the gaze detection means using the correction information; a setting means for displaying a through image in the viewfinder, detecting a line of sight of a user viewing the through image by the line of sight detection means, and setting the line of sight of the user as a focus frame; a focus detection area acquisition means for acquiring a focus detection area from the attached accessory when the accessory is attached; The calibration means changing the calibration method according to the acquired focus detection area; The imaging device is characterized in that the calibration method is changed by changing the display position of the index in the finder.
2. 2. The imaging apparatus according to claim 1, wherein the calibration means increases the number of the indices displayed on the viewfinder as the focus detection area of an attached accessory from among the plurality of accessories becomes larger.
3. further comprising a display image changing means for changing the size of the display image of the viewfinder, The calibration means changing the size of each of the plurality of focus point indicators displayed on the viewfinder in accordance with the size of the display image changed by the display image change means; 3. The imaging device according to claim 1, wherein at least one of the size and shape of the indices is changed in accordance with the changed sizes of the plurality of range finding point indices.
4. a storage unit configured to store, each time one of the plurality of accessories is attached, a focus detection area of the attached accessory and the correction information acquired by the calibration unit in association with each other; An imaging device as described in any one of claims 1 to 3, characterized in that when one of the multiple accessories is newly attached, if the focus detection area of the newly attached accessory is the same as the focus detection area stored in the memory means, the calibration means calibrates the gaze detection means using correction information stored in association with the focus detection area stored in the memory means.
5. 5. The imaging device according to claim 4, wherein if the focus detection area of the newly attached accessory differs from the focus detection area stored in the memory means, a warning screen is displayed in the viewfinder to prompt recalibration by the calibration means.
6. The imaging device of claim 5, characterized in that if a user instructs not to perform recalibration by the calibration means after the warning screen is displayed on the viewfinder, the imaging device calibrates the gaze detection means using correction information stored in association with the focus detection area stored in the memory means.
7. a calculation unit that calculates, when the user gives the instruction, gaze detection accuracy for the focus detection area of the newly attached accessory when correction information associated with the focus detection area stored in the storage unit is used, and 7. The imaging device according to claim 6, wherein the size of the focal frame is determined in accordance with the calculated line-of-sight detection accuracy.
8. 8. The imaging device according to claim 7, wherein a first display object that is displayed as the focus frame when the focus detection area of the newly attached accessory is the same as the focus detection area stored in the storage means and a second display object that is displayed as the focus frame when the focus detection area of the newly attached accessory is different from the focus detection area stored in the storage means are different in at least one of shape and color.
9. 2. The imaging device according to claim 1, wherein the calibration means moves the display position of the index in the viewfinder closer to the edge of the viewfinder when the focus detection area of the attached accessory is a first area than when the focus detection area of the attached accessory is a second area narrower than the first area.
10. 10. The imaging apparatus according to claim 9, wherein the calibration means moves the display position of the index in the viewfinder closer to the edge of the viewfinder as the focus detection area of the attached accessory becomes wider.
11. 2. The imaging device according to claim 1, wherein the calibration means sets the display position of the index in the viewfinder so that the display position of the index in the viewfinder falls within the range of the focus detection area of the attached accessory.
12. A control method for an imaging device that has an internal viewfinder and is capable of attaching and detaching a plurality of accessories, comprising: a gaze detection step of detecting a gaze position of a user looking through the viewfinder; a calibration step of displaying an index for a calibration operation in the viewfinder, acquiring correction information for individual differences in the eyes by performing calibration based on a display position of the index in the viewfinder and a gaze position of the user who looks at the index and detected in the gaze detection step, and performing correction in the gaze detection step using the correction information; a setting step of displaying a through image in the viewfinder, detecting a line of sight position of a user viewing the through image in the line of sight detection step, and setting the line of sight position as a focus frame; a focus detection area acquisition step of, when one of the plurality of accessories is attached, acquiring a focus detection area from the attached accessory, In the calibration step, changing the calibration method according to the acquired focus detection area; A control method comprising changing the display position of the index in the finder to change the calibration method.
13. A computer-executable program that causes a computer to function as each of the means of the imaging device according to any one of claims 1 to 11.
Citation Information
Patent Citations
Focusing control method and system and photographing equipment
CN109600555A
Camera
JP2000039551A
Optical device with visual axis function
JP2004008323A
Imaging apparatus and imaging apparatus body
JP2009282378A
Information processing apparatus, information processing method, and program
JP2015152938A