Imaging control apparatus, imaging apparatus, and program

The imaging device sets tracking start positions and uses autofocus to maintain focus on the intended subject, addressing the challenge of accurately tracking and focusing in the presence of multiple subjects.

JP2026001178APending Publication Date: 2026-01-06NIKON CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2025167290
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-10-25
Filing Date
2025-10-03
Publication Date
2026-01-06

AI Technical Summary

Technical Problem

Existing imaging devices struggle to accurately track and focus on a specific subject within a range, especially when multiple subjects are present, leading to unintended subjects being tracked instead of the intended one.

Method used

An imaging device with a position setting unit that sets a tracking start position and an autofocus unit that tracks the subject based on detection results, ensuring focus and tracking are maintained on the intended subject by setting specific positions within the imaging range.

Benefits of technology

The device effectively tracks and focuses on the desired subject by preventing unintended subjects from being tracked, allowing for accurate imaging of the intended subject, even when multiple subjects are present.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026001178000001
    Figure 2026001178000001
  • Figure 2026001178000002
    Figure 2026001178000002
  • Figure 2026001178000003
    Figure 2026001178000003
Patent Text Reader

Abstract

To image a subject at a timing desired by a user while focusing on the subject and maintaining the focus in tracking photographing of the subject.SOLUTION: An imaging device comprising: an imaging unit that images a subject; a tracking control unit that starts tracking of the subject based on a detection result of the subject at a tracking start position set in an imaging range of the imaging unit; and an imaging control unit that starts recording of a captured image in a storage medium in a case where the subject tracked by the tracking control unit is detected at the imaging start position set in the imaging range of the imaging unit.SELECTED DRAWING: None
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an imaging control device, an imaging device, and a program. This application claims priority based on Japanese Patent Application No. 2021-173804, filed on October 25, 2021, the contents of which are incorporated herein by reference. [Background technology]

[0002] BACKGROUND ART Conventionally, there is known an imaging device that starts tracking of a subject when the subject is detected by an autofocus function of the imaging device (see, for example, Patent Document 1 below). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-215422 Summary of the Invention

[0004] One aspect of the present invention is an imaging control device that includes a position setting unit that sets a first position indicating a position at which tracking of a subject begins within an imaging range in which the subject is imaged, and a tracking control unit that tracks the subject based on a detection result of the subject overlapping the first position set by the position setting unit.

[0005] One aspect of the present invention is an imaging device including the imaging control device described above.

[0006] One aspect of the present invention is a program that causes a computer used in an imaging control device to function as a position setting unit that sets a first position indicating the position at which tracking of a subject begins within an imaging range in which the subject is imaged, and a tracking control unit that tracks the subject based on a detection result of the subject overlapping the first position set by the position setting unit. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a schematic block diagram showing an example of the configuration of an imaging device 1 according to a first embodiment. [Figure 2A] FIG. 2 is an explanatory diagram showing an example of tracking and capturing an image of a subject according to the first embodiment, and is a diagram showing a state at the start of tracking. [Figure 2B] FIG. 2 is an explanatory diagram showing an example of tracking and capturing an image of a subject according to the first embodiment, and is a diagram showing a state at the start of capturing an image. [Figure 2C] FIG. 2 is an explanatory diagram showing an example of tracking and imaging of a subject according to the first embodiment, showing a state at the end of tracking and imaging. [Figure 3A] 1 is an explanatory diagram showing an example of an image within an imaging range of an imaging device 1. FIG. [Figure 3B] 1 is an explanatory diagram showing an example of an image within an imaging range of an imaging device 1. FIG. [Figure 3C] 1 is an explanatory diagram showing an example of an image within an imaging range of an imaging device 1. FIG. [Figure 3D] 1 is an explanatory diagram showing an example of an image within an imaging range of an imaging device 1. FIG. [Figure 3E] 1 is an explanatory diagram showing an example of an image within an imaging range of an imaging device 1. FIG. [Figure 3F] 1 is an explanatory diagram showing an example of an image within an imaging range of an imaging device 1. FIG. [Figure 3G] 1 is an explanatory diagram showing an example of an image within an imaging range of an imaging device 1. FIG. [Figure 4] 1 is an explanatory diagram showing an example of the functional configuration of an imaging device 1. FIG. [Figure 5] 10 is a flowchart showing an example of a process for setting each position performed by the imaging device 1. [Figure 6] 5 is a flowchart showing an example of tracking and imaging processing according to the first embodiment. [Figure 7] 5 is a flowchart showing an example of tracking and imaging processing according to the first embodiment. [Figure 8A] FIG. 10 is an explanatory diagram showing an example of an image within the imaging range of the imaging device 1 according to the second embodiment, showing an image before the subject reaches the tracking / imaging start position. [Figure 8B] FIG. 10 is an explanatory diagram showing an example of an image within the imaging range of the imaging device 1 according to the second embodiment, showing an image when imaging a subject that has reached a tracking / imaging start position. [Figure 9] 10 is a flowchart showing an example of a tracking and imaging process according to the second embodiment. [Figure 10] FIG. 10 is an explanatory diagram showing an example of a screen when the imaging device 1 according to the third embodiment accepts settings of each position from the user. [Figure 11] 11 is a flowchart showing an example of a setting process of a tracking start position according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] (Embodiment) Hereinafter, first to third embodiments of the present invention will be described with reference to the drawings.

[0009] (Configuration of imaging device 1) Fig. 1 is a schematic block diagram showing an example of the configuration of an imaging device 1 according to the first embodiment. In Fig. 1, the imaging device 1 includes a lens 10, an imaging unit 11, an image processing unit 12, a ROM (Read Only Memory) 13, a RAM (Random Access Memory) 14, a control unit 15, a display unit 16, a storage medium I / F (storage medium interface) 17, an operation unit 18, a storage medium 19, and a bus 30. The image processing unit 12 to the storage medium I / F 17 are connected to one another via the bus 30. The operation unit 18 is connected to the control unit 15.

[0010] The lens 10 is made up of a group of lenses including a focus lens and a zoom lens. The lens 10 includes one or more lenses. The lens 10 is driven by a lens driving device (not shown) under the control of the control unit 15.

[0011] The imaging unit 11 captures an image of a subject and generates pixel data (image data) of the captured image. Specifically, the imaging unit 11 has a plurality of pixels arranged in rows and columns, and generates analog pixel signals of the image by photoelectrically converting the subject image formed on the imaging surface. The analog pixel signals generated by the imaging unit 11 are adjusted and A / D (analog / digital) converted by an analog front-end circuit (not shown). The converted digital pixel signals are output to the image processing unit 12 as image data.

[0012] The image processing unit 12 stores the image data in the RAM 14. The image processing unit 12 also performs various image processing such as white balance adjustment, and causes the display unit 16 to display predetermined image data.

[0013] The ROM 13 stores a control program for controlling the imaging device 1. The control program includes a program related to tracking a subject and capturing an image of the subject, which will be described later. The RAM 14 stores image data captured by the imaging unit 11, various setting information relating to tracking and capturing an object, and the like.

[0014] The control unit 15 is an example of an imaging control device. The control unit 15 includes a processor such as a CPU (Central Processing Unit) and performs overall control of the imaging device 1. The control unit 15 controls each unit of the imaging device 1 by executing an imaging control program pre-stored in the ROM 13. For example, when the control unit 15 receives an instruction to capture an image via the operation unit 18, it stores image data obtained via the imaging unit 11 in the storage medium 19 as a captured image.

[0015] The control unit 15 also controls autofocus and autoexposure. Specifically, the control unit 15 measures the distance to the subject and controls the focus lens of the lens 10 based on the results of this distance measurement. The autofocus includes single-point autofocus and multi-point autofocus. The control unit 15 also changes the exposure time and controls an aperture mechanism (not shown).

[0016] The display unit 16 is a touch panel display. For example, the display unit 16 is a liquid crystal display. The display unit 16 displays an image generated by the image processing unit 12 in response to an instruction from the control unit 15. The display unit 16 displays, for example, image data captured by the imaging unit 11, an operation screen, etc. The display unit 16 also serves as an operation unit 18 that accepts various operations from the user. The operation unit 18 is, for example, a release button, a cross key, a command dial, a touch panel, or other operation keys, and inputs an input signal according to the content of the user's operation to the control unit 15. For example, the operation unit 18 inputs an image capture instruction to the control unit 15 when the user fully presses the release button.

[0017] The storage medium I / F 17 is connected to a removable storage medium 19 such as a card memory, and writes, reads, or erases image data to the storage medium 19 . The storage medium 19 is a storage unit that is detachably connected to the imaging device 1, and stores (records), for example, image data that has been image-processed by the image processing unit 12. The storage medium 19 is, for example, an SD card, a microSD card, or the like.

[0018] The bus 30 connects the image processing unit 12, the ROM 13, the RAM 14, the control unit 15, the display unit 16, and the storage medium I / F 17, and transfers image data, control signals, etc. output from each unit.

[0019] (Subject Tracking and Imaging According to the First Embodiment) The imaging device 1 can be used to capture images of athletes in various sports, such as gymnastics, track and field, and skiing. For example, the imaging device 1 can start tracking an object when it detects the object, such as an athlete. The imaging device 1 has an object detection function and an autofocus function. The object detection function is a function that detects where the object is located within the frame. The autofocus function is a function that focuses on the detected object. Note that the autofocus function may also have the object detection function. Subject tracking refers to continuing to track a detected object. Subject tracking refers to continuing to track the object and further maintaining focus on the object. The subject tracking function enables the imaging device 1 to continue to track and focus on the object even if the object moves and its position within the frame changes. Note that the object is not limited to a person, such as an athlete in the various sports mentioned above, but may also be, for example, an animal.

[0020] Here, if a person or object other than the athlete in the imaging range is tracked as a subject, it will be impossible to track the athlete who is the intended subject. Therefore, the imaging device 1 according to this embodiment allows the user to set a desired subject as the tracking target. Below, the control of subject tracking and imaging according to the first embodiment will be described using the horse vault event in artistic gymnastics as an example.

[0021] 2A to 2C are explanatory diagrams showing an example of tracking and capturing images of a subject according to the first embodiment. FIG. 2A is a diagram showing the state at the start of tracking. FIG. 2B is a diagram showing the state at the start of capturing images. FIG. 2C is a diagram showing the state at the end of tracking and capturing images. In FIGS. 2A to 2C, the imaging device 1 is placed in a capturing zone near the landing mat for a horse vault event, and is capable of tracking a subject (athlete) running from the infinity side (starting point) to the close side. Specifically, in automatic capturing mode, the imaging device 1 is capable of automatically tracking and capturing images of an athlete moving from the back side to the front side in the depth direction of the capturing range.

[0022] 2A, in the imaging device 1, a tracking start position 201 is set in the depth direction of the imaging range from the imaging device 1. In addition, in the imaging device 1, an end position 202 is set on the near side in the depth direction from the tracking start position 201. Furthermore, as shown in FIG. 2B, in the imaging device 1, an imaging start position 203 is set between the tracking start position 201 and the end position 202.

[0023] As shown in FIG. 2A, it is assumed that subject 200 runs from the far side to the near side in the depth direction of imaging device 1. When subject 200 reaches tracking start position 201, imaging device 1 starts tracking subject 200. Then, as shown in FIG. 2B, when subject 200 reaches imaging start position 203, imaging device 1 starts capturing images of subject 200 (continuous image capture). In this example, as subject 200 moves forward from tracking start position 201, imaging device 1 uses an autofocus function to move the focus position closer to the near side in accordance with the movement of subject 200. When subject 200 reaches imaging start position 203, the autofocus function focuses on subject 200, and continues to focus on subject 200 using the autofocus function even while continuous image capture is being performed. Then, as shown in FIG. 2C, when subject 200 reaches end position 202, imaging device 1 ends continuous image capture and tracking of subject 200 and returns the focus position to tracking start position 201. The object 204 indicates that the imaging device 1 is tracking or capturing an image of the subject 200.

[0024] (Images within the imaging range) 3A to 3G are explanatory diagrams showing examples of images within the imaging range of the imaging device 1. Each image shown in FIGS. 3A to 3G represents an image displayed on the display unit 16 or the finder. For example, the images of FIGS. 3A to 3G are displayed on the display unit 16 or the finder in chronological order. That is, the image of FIG. 3B is displayed after FIG. 3A. The image of FIG. 3C is displayed after FIG. 3B. The image of FIG. 3D is displayed after FIG. 3C. The image of FIG. 3E is displayed after FIG. 3D. The image of FIG. 3F is displayed after FIG. 3E. The image of FIG. 3G is displayed after FIG. 3F. Note that each of FIGS. 3A to 3G shows a representative image among multiple images, and other images (not shown) may be captured between the respective images (for example, between FIGS. 3A and 3B). First, in FIG. 3A, a tracking start position image 210 (for example, a double frame) indicating the tracking start point (tracking start position 201) is set as a first position. Since the subject 200 does not overlap with the tracking start position 201, the imaging device 1 does not track or photograph the subject 200.

[0025] Next, in imaging range 300 of Fig. 3B, subject 200 is located at tracking start position 201. When subject 200 overlaps tracking start position 201, imaging device 1 starts tracking subject 200. Furthermore, when tracking subject 200, imaging device 1 displays tracking point image 301 (for example, a dotted frame) indicating a focus point so that it overlaps with subject 200. Then, after starting to track subject 200, imaging device 1 continues tracking subject 200 as shown in Fig. 3C.

[0026] Then, as shown in Fig. 3D, when subject 200 reaches imaging start position 203, imaging device 1 starts continuous imaging. When imaging subject 200, imaging device 1 displays imaging point image 302 (for example, a solid-line frame) indicating the imaging point. Furthermore, after imaging has started, imaging device 1 continues continuous imaging even when the athlete (subject 200) puts his hands on the vaulting horse, as shown in Fig. 3E.

[0027] Furthermore, as shown in Fig. 3F, when the athlete (subject 200) reaches the landing point, the imaging device 1 continues continuous imaging. Then, when the subject 200 reaches end position 202, which is set on the imaging device 1 side of the landing point, the imaging device 1 returns the tracking start point (tracking start position image 210) to tracking start position 201, as shown in Fig. 3G, to prepare for tracking the next competing athlete (subject 200).

[0028] (Functional configuration of imaging device 1) Next, the functional configuration of the imaging device 1 will be described with reference to FIG. Fig. 4 is an explanatory diagram showing an example of the functional configuration of the imaging device 1. As shown in Fig. 4, the imaging device 1 includes a position setting unit 401, a tracking control unit 402, an imaging control unit 403, and a display control unit 404. The position setting unit 401, the tracking control unit 402, and the imaging control unit 403 are realized by the control unit 15 (CPU). That is, the control unit 15 executes an imaging control program stored in the ROM 13 to realize the functions of the units 401 to 403. Furthermore, the display control unit 404 is realized by the control unit 15 and the image processing unit 12. That is, the control unit 15 executes the imaging control program to give predetermined instructions to the image processing unit 12, thereby realizing the function of the display control unit 404.

[0029] Note that the components 401 to 404 do not necessarily have to be included in the imaging device 1, but may also be included in an external device (imaging control device). That is, for example, the imaging device 1 may track and capture an image of the subject 200 based on instructions from an external device. Also, in this embodiment, the imaging device 1 is, for example, a camera, but is not limited to this. The imaging device 1 may also be a video camera, a smartphone, a tablet device, a mobile phone, etc.

[0030] (Regarding setting of tracking start position 201) The position setting unit 401 sets a tracking start position 201 indicating a position at which tracking of the subject 200 starts, within the imaging range 300 in which the subject 200 is imaged. The tracking start position 201 is an example of a first position. The tracking start position 201 set by the position setting unit 401 is stored in, for example, the RAM 14. The position setting unit 401 sets the tracking start position 201 based on a user operation. Note that instead of setting the tracking start position 201 based on a user operation, for example, the imaging device 1 may automatically recognize a position where the subject 200 starts a competition (for example, a starting line), and set that position as the tracking start position 201.

[0031] In the automatic shooting mode of the imaging device 1, the tracking control unit 402 tracks the subject 200 based on the detection result of the subject 200 overlapping the tracking start position 201 set by the position setting unit 401. The detection result of the subject 200 simply includes detecting the presence of the subject 200 in the imaging range 300. Tracking the subject 200 also includes an operation of continuing to track the subject 200 without focusing on the subject 200. In this case, when the subject 200 reaches the imaging start position 203, an operation of focusing on the subject 200 and maintaining the focus is performed. However, in the first embodiment, the tracking of the subject 200 is tracking in which the focus is focused on the subject 200 and maintained. Specifically, tracking means tracking the subject 200 while automatically switching the ranging point (autofocus frame) for the subject 200.

[0032] The direction in which tracking control unit 402 tracks subject 200 is the depth direction of imaging range 300. Specifically, the direction in which subject 200 is tracked is, for example, from the back side to the front side in the depth direction of imaging range 300. However, the direction in which subject 200 is tracked is not limited to this, and it is also possible to track subject 200 from the front side to the back side in the depth direction of imaging range 300. Furthermore, the direction in which subject 200 is tracked can also be the up-down direction of imaging range 300, or the left-right direction of imaging range 300. Furthermore, the direction in which subject 200 is tracked is not limited to one direction, and a combination of multiple directions is also possible.

[0033] (Detection results for subject 200) The detection result of the subject 200 includes, for example, at least one of the face, size, movement, and posture of the subject 200. For the face of the subject 200, a person recognized by a face recognition function provided in the imaging device 1 can be obtained as the detection result. For the size of the subject 200, a person of a predetermined size (e.g., 140 cm to 190 cm) can be obtained as the detection result of the subject 200. For the movement of the subject 200, a person making a predetermined movement (e.g., running motion, direction, speed, etc.) can be obtained as the detection result of the subject 200. For the posture of the subject 200, a person in a predetermined posture (e.g., facing the imaging device 1 or with hands raised) can be obtained as the detection result of the subject 200. In a competition or the like, the bib number worn by the subject 200, who is a player, may be used as the detection result.

[0034] Tracking control unit 402 tracks subject 200 based on at least one of face, size, movement, and posture as a detection result of subject 200 overlapping tracking start position 201. Face, size, movement, and posture are set as conditions for starting tracking. Which of face, size, movement, and posture is set as a condition for starting tracking may be set in advance as an unchangeable condition, or may be set as an unchangeable condition by user selection.

[0035] Furthermore, the conditions for starting tracking (such as the posture of subject 200) may be set in advance for each sport, and when the user selects a sport, the tracking control unit may automatically detect subject 200 that matches the set conditions. For example, if the running posture of subject 200 in a sport is set in advance, it is possible to automatically detect subject 200 that matches that posture.

[0036] (Specific example of setting the tracking start position 201) Tracking start position 201 is set based on focus information of subject 200 and a predetermined imaging region (hereinafter referred to as "predetermined region") within imaging range 300. The focus information is information corresponding to the distance to tracking start position 201 when focusing on tracking start position 201. For example, when tracking start position 201 is set 40 m away, the focus information is information indicating the control amount of lens 10 corresponding to the distance to tracking start position 201 when focusing 40 m away. Furthermore, for example, the focus information may be in-focus information or depth information when focusing 40 m away.

[0037] When setting the tracking start position 201, the user places a person or an object at a position (for example, 40 m ahead) where tracking is to start. In the position setting mode, the imaging device 1 focuses on the person or object. As a result, the position setting unit 401 sets focus information for the tracking start position 201.

[0038] Furthermore, the position setting unit 401 sets a predetermined area within the image capture range 300. The predetermined area can be any area within the image capture range 300 in the vertical and horizontal directions. For example, the position setting unit 401 sets any area within the image capture range 300 designated by the user as the predetermined area. Note that the area is designated, for example, by the user touching the display unit 16 or by the user operating the operation unit 18. In this embodiment, the predetermined area indicating the tracking start position 201 is the area within the image capture range 300 that is included in the tracking start position image 210 shown in FIG. 3A. By setting the focus information of the subject 200 and a predetermined area within the image capture range 300 as the tracking start position 201, an object or person that meets both conditions can be detected as the subject 200 to be tracked. Therefore, for example, even if a referee overlaps with the predetermined area during a competition or the like, if the referee is out of focus, the referee will not be detected as the subject 200, preventing the referee from being erroneously tracked.

[0039] Note that the tracking start position 201 may be set based on at least one of the focus information of the subject 200 and a predetermined area within the imaging range 300. That is, the tracking start position 201 may be set based only on the focus information of the subject 200, or may be set based only on the predetermined area within the imaging range 300. If the tracking start position 201 is set based on the predetermined area within the imaging range 300, tracking starts when the subject 200 overlaps the predetermined area. This includes not only cases where the predetermined area and the subject 200 completely overlap, but also cases where the subject 200 partially overlaps the predetermined area. Also, if the tracking start position 201 is set based on the focus information, tracking of the subject 200 starts when the subject 200 comes into focus (overlaps) at a distance of, for example, 40 m. Note that tracking of the subject 200 may also start when the subject 200 overlaps a defocused area within a predetermined range before and after the focused position in the depth direction.

[0040] (Regarding the setting of the imaging start position 203) The position setting unit 401 sets an imaging start position 203 indicating a position at which imaging of the subject 200 starts. The imaging start position 203 is an example of a second position. In the automatic imaging mode of the imaging device 1, the imaging control unit 403 starts imaging the subject 200 that overlaps with the imaging start position 203 after starting tracking of the subject 200. Image data obtained from the imaging unit 11 through imaging is stored as a captured image in the storage medium 19 or transmitted to an external storage device using a communication function (not shown). The imaging control unit 403 also captures the image data continuously (frame by frame), capturing, for example, 30 frames per second.

[0041] Similar to the setting of tracking start position 201, setting of imaging start position 203 can be performed based on at least one of focus information of subject 200 and a predetermined area of ​​imaging range 300. Specifically, when setting imaging start position 203, the user places a person or object at a position (for example, 20 m ahead) where imaging will start. In position setting mode, imaging device 1 focuses and captures an image of the person or object. As a result, position setting unit 401 sets focus information at imaging start position 203.

[0042] Furthermore, the position setting unit 401 sets a predetermined area designated by the user within the imaging range 300 at the imaging start position 203. In this embodiment, the predetermined area indicating the imaging start position 203 is an area within the imaging range 300 that is approximately the same size as the area at the top right of the screen indicated by the imaging point image 302 shown in FIG.

[0043] The tracking start position 201 and the imaging start position 203 are positions spaced apart from each other in the depth direction of the imaging range 300. When obtaining a captured image of the subject 200 moving from the depth side to the front side of the imaging range 300 as in the present embodiment, the imaging start position 203 is set closer to the subject than the tracking start position 201. However, when obtaining a captured image of the subject 200 moving from the front side to the depth side of the imaging range 300, the imaging start position 203 only needs to be set closer to the depth than the tracking start position 201.

[0044] (Regarding the end of tracking and capturing of subject 200) Tracking control unit 402 ends tracking of subject 200 when a predetermined termination condition is met. Similarly, imaging control unit 403 ends imaging of the subject when a predetermined termination condition is met. The predetermined termination condition is, for example, a condition based on at least one of the following (1) to (5): (1) The end position 202 set in the imaging range 300 overlaps with the subject 200. (2) The subject 200 is no longer detected within the imaging range 300. (3) A predetermined number of images are taken. (4) The specified time has elapsed. (5) The subject 200 moves or assumes a predetermined posture.

[0045] In the case of (2) above, the timing at which tracking of subject 200 ends and the timing at which imaging of subject 200 ends are the same. On the other hand, in the cases of (1), (3), (4), and (5) above, even if tracking of subject 200 is being performed, imaging of subject 200 may end when the conditions of (1), (3), (4), and (5) above are met. That is, by setting the end condition for ending tracking of subject 200 so that tracking of subject 200 ends after imaging of subject 200 ends, the timing at which tracking of subject 200 ends may be later than the timing at which imaging of subject 200 ends. As a result, when imaging of subject 200 is started again at a predetermined timing between the end of imaging and the end of tracking, it is possible to start imaging of subject 200 quickly.

[0046] It should be noted that all of the above (1) to (5) may be set as termination conditions, or the termination conditions may be set and changed arbitrarily according to the user's selection. Also, the predetermined number of sheets in the above (3) and the predetermined time in the above (4) may be set as fixed values ​​set in advance, or may be set and changed according to the user's specification.

[0047] In addition, in (1), the end position 202 for tracking and imaging may be set to the same position or different positions. In addition, in (5), for example, in a horse vaulting event, the imaging end condition may be set to when subject 200 finishes his / her performance and a posture of subject 200 overlapping with end position 202 with both hands raised (for example, subject 200 in FIG. 3F) is detected, and tracking may be set to end when a posture of both hands lowered is detected.

[0048] Furthermore, as in (1) above, when the predetermined end condition is that the end position 202 and the subject 200 overlap, the position setting unit 401 sets the end position 202. As with the setting of the tracking start position 201, the setting of the end position 202 can be performed based on at least one of focus information of the subject 200 and a predetermined area in the imaging range 300. Specifically, when setting the end position 202, the user places a person or object at a position (for example, 10 m ahead) where tracking or imaging will end. In the position setting mode, the imaging device 1 focuses and captures an image of the person or object. As a result, the position setting unit 401 sets focus information at the end position 202.

[0049] Furthermore, the position setting unit 401 sets a predetermined area designated by the user within the imaging range 300 at the end position 202. In this embodiment, the end position 202 is set closer to the imaging device 1 than the landing point. Furthermore, the predetermined area indicating the end position 202 is an area in the center of the screen within the imaging range 300, for example, an area to the lower left of the imaging point image 302 shown in FIG. 3F (an area indicating the near side).

[0050] The method of setting focus information for each of the positions 201-203 is not limited to a method of placing a person or object at each of the positions 201-203 and adjusting the focus. For example, in the position setting mode, the focus information for each of the positions 201-203 may be set by focusing on a player practicing. Alternatively, in the position setting mode, several images of a player practicing may be taken, and the user may select one of the images, and the focus information for each of the positions 201-203 obtained from the selected image may be set. Furthermore, the focus information may be set using a landmark located at the position where tracking or imaging starts or ends. For example, when setting the focus information manually, the focus may be set on a landmark, and the focus information at that time may be stored in the ROM 13 or the RAM 14.

[0051] Furthermore, when a predetermined termination condition is met, the tracking control unit 402 returns the position from which tracking starts to the tracking start position 201. This prepares for tracking the next player.

[0052] (Displaying objects on the display unit 16) Display control unit 404 displays at least one of a first object indicating the position of tracking by tracking control unit 402 and a second object indicating imaging by imaging control unit 403, superimposed on the image of subject 200. The first object is, for example, tracking point image 301 (see FIGS. 3A to 3C). The second object is, for example, imaging point image 302 (see FIG. 3D). Both the first object and the second object are not limited to images in which the focus point is enclosed in a square, and may be, for example, an image in which the focus point is enclosed in a circle, or an image of an arrow (pointer), line, or point indicating the focus point.

[0053] It is not necessary to display the first object indicating tracking or the second object indicating imaging. Furthermore, display control unit 404 may display the first position indicating the position where tracking starts as the third object. The third object is represented by, for example, a double rectangle (see FIG. 3A), but is not limited to this embodiment. Furthermore, when the first position and subject 200 overlap and tracking of subject 200 starts, the display of the third object may be removed and the first object may be displayed, or the display of the third object may be left as is.

[0054] The display control unit 404 displays the first object, the second object, and the third object in different display modes. Specifically, the display control unit 404 displays, for example, the tracking start position image 210, the tracking point image 301, and the imaging point image 302 in different line types (display modes). However, without being limited to this, the display control unit 404 may display the tracking start position image 210, the tracking point image 301, and the imaging point image 302 in different colors or different shapes.

[0055] (About the setting process for setting each position) Fig. 5 is a flowchart showing an example of a process for setting each position performed by the imaging device 1. In Fig. 5, the imaging device 1 determines whether or not it has entered a position setting mode for setting each position (tracking start position 201, end position 202, and imaging start position 203) (step S501). The imaging device 1 waits until it enters the position setting mode (step S501: NO), and when it enters the position setting mode (step S501: YES), it acquires focus information for the position at which tracking starts (for example, 40 m ahead in the depth direction) (step S502).

[0056] Then, imaging device 1 sets a predetermined area within imaging range 300 (for example, an imaging range 40 m ahead) by receiving the setting from the user (step S503). Next, imaging device 1 sets a tracking start condition (at least one of the face, size, movement, and posture of subject 200) by receiving the setting from the user or by prior setting (step S504). Then, imaging device 1 stores the tracking start condition in RAM 14, and also stores a predetermined area within imaging range 300 40 m ahead in RAM 14 as a tracking start position (step S505).

[0057] Next, the imaging device 1 acquires focus information for a position where imaging is to start (for example, 20 m ahead in the depth direction) (step S506). Then, the imaging device 1 sets a predetermined area within the imaging range 300 (for example, the imaging range 20 m ahead) by receiving it from the user (step S507). Next, the imaging device 1 stores the predetermined area within the imaging range 300 20 m ahead as an imaging start position in the RAM 14 (step S508).

[0058] Then, the imaging device 1 acquires focus information of a position (for example, 10 m ahead in the depth direction) where tracking and imaging will end (step S509). Next, the imaging device 1 sets a predetermined area within the imaging range 300 (for example, the imaging range 10 m ahead) by receiving it from the user (step S510). Then, the imaging device 1 stores the predetermined area within the imaging range 300 10 m ahead as an end position in the RAM 14 (step S511).

[0059] Then, the imaging device 1 sets other termination conditions (step S512) and ends the series of processes. The settings of the other termination conditions include, for example, setting the predetermined number of images to be captured, setting the predetermined time for capturing images, and setting whether or not the termination condition is that the subject 200 is no longer detected within the imaging range 300.

[0060] The above-described flowchart completes the setting of each position (tracking start position 201, end position 202, and imaging start position 203).

[0061] (Regarding tracking and imaging processing) 6 and 7 are flowcharts showing an example of the tracking and imaging process according to the first embodiment. In Fig. 6 and Fig. 7, it is assumed that the imaging device 1 is set to an automatic imaging mode in which tracking and imaging according to the first embodiment are performed.

[0062] 6 and 7, the imaging device 1 determines whether or not the subject 200 has been detected at the tracking start position 201 (step S601). The imaging device 1 waits until the subject 200 is detected at the tracking start position 201 (step S601: NO), and when the subject 200 is detected at the tracking start position 201 (step S601: YES), the imaging device 1 determines whether or not a tracking start condition is met (step S602). The tracking start condition includes, for example, at least one of the following: the subject 200 is a person's face; the subject 200 is a predetermined size; the subject 200 is moving in a predetermined manner; and the subject 200 is in a predetermined posture.

[0063] If the tracking start condition is not met (step S602: NO), that is, even if a person other than the player to be tracked, such as a referee who moves differently from the player, is detected in imaging range 300, imaging device 1 returns to step S601 without tracking. On the other hand, if the tracking start condition is met (step S602: YES), that is, if a person (player) to be tracked is detected, imaging device 1 tracks subject 200 (step S603). When tracking of subject 200 starts, imaging device 1 displays tracking point image 301 (see FIGS. 3A to 3C) superimposed on subject 200 on display unit 16 (step S604).

[0064] Then, the imaging device 1 determines whether or not the subject 200 has been detected at the imaging start position 203 (step S605). If the subject 200 has not been detected at the imaging start position 203 (step S605: NO), the imaging device 1 returns to step S603 and continues tracking the subject 200 and displaying the subject 200 and the tracking point image 301.

[0065] On the other hand, when the subject 200 is detected at the imaging start position 203 (step S605: YES), the imaging device 1 captures an image of the subject 200 (step S606). When imaging of the subject 200 starts, the imaging device 1 displays an imaging point image 302 (see FIG. 3D) superimposed on the subject 200 on the display unit 16 (step S607).

[0066] Then, the imaging device 1 determines whether or not the subject 200 is detected at the end position 202 (step S608). If the subject 200 is not detected at the end position 202 (step S608: NO), the imaging device 1 determines whether or not the subject 200 is detected in the imaging range 300 (step S609).

[0067] If the subject 200 is detected in the imaging range 300 (step S609: YES), the imaging device 1 determines whether a predetermined number of images have been captured (step S610). Note that in step S610, it may also be determined whether a predetermined time has elapsed.

[0068] If the predetermined number of images have not been captured (step S610: NO), the imaging device 1 returns to step S606 and continues capturing images of the subject 200 and displaying the subject 200 and the imaging point image 302. On the other hand, if the predetermined number of images have been captured (step S610: YES), the imaging device 1 determines whether or not imaging is in progress (step S611). If imaging is in progress (step S611: YES), the imaging device 1 ends imaging (step S612) and returns to step S608. If imaging is not in progress in step S611 (step S611: NO), the imaging device 1 returns to step S608.

[0069] If the subject is detected at the end position 202 in step S608 (step S608: YES), or if the subject 200 is no longer detected in the imaging range 300 in step S609 (step S609: NO), the imaging device 1 determines whether or not imaging has ended (step S613). If imaging has not ended (step S613: NO), the imaging device 1 ends tracking and imaging (step S614) and proceeds to step S616. If imaging has ended (step S613: YES), the imaging device 1 ends tracking (step S615).

[0070] Next, the imaging device 1 returns the focus point to the tracking start position 201 (step S616). This allows the imaging device 1 to prepare for tracking the next race. Then, the imaging device 1 determines whether the automatic shooting mode has ended (step S617). If the automatic shooting mode has not ended (step S617: NO), the imaging device 1 returns to step S601. On the other hand, if the automatic shooting mode has ended (step S617: YES), the imaging device 1 ends the series of processes.

[0071] As described above, the imaging device 1 according to the first embodiment sets the tracking start position 201 in the imaging range 300 in which the subject 200 is imaged, and tracks the subject 200 based on the detection result of the subject 200 overlapping the tracking start position 201. As a result, even if multiple subjects exist in the imaging range 300, it is possible to prevent tracking of the subjects that do not overlap the tracking start position 201. In other words, it is possible to track only the subject 200 that overlaps the tracking start position 201. Therefore, according to this embodiment, it is possible to track and image the subject 200 desired by the user.

[0072] Furthermore, in the first embodiment, the detection result of the subject 200 includes at least one of the face, size, movement, and posture of the subject 200. This allows for accurate detection of a player as the subject 200 to be tracked. Therefore, the subject 200 desired by the user can be tracked and imaged with high accuracy.

[0073] Furthermore, in the first embodiment, the tracking start position 201 is set based on focus information of the subject 200 and / or a predetermined area within the imaging range 300. This makes it possible to track a player who is in focus and / or a player who is detected within the predetermined area as the subject 200. Therefore, the subject 200 desired by the user can be accurately tracked and imaged.

[0074] Furthermore, in the first embodiment, tracking of the subject 200 includes focusing on the subject 200 and maintaining the focus. This allows the subject 200 to be focused and tracked. Therefore, the subject 200 can be imaged at a timing desired by the user.

[0075] Furthermore, in the first embodiment, the imaging device 1 sets the imaging start position 203, and after starting tracking of the subject 200, starts imaging of the subject 200 that overlaps the imaging start position 203. As a result, even if multiple subjects exist within the imaging range 300, it is possible to prevent imaging of subjects that do not overlap the tracking start position 201 and the imaging start position 203. In other words, it is possible to image only the subject 200 that overlaps the tracking start position 201 and the imaging start position 203. Therefore, it is possible to image the subject 200 that the user desires. Furthermore, since imaging is not performed before the subject 200 overlaps the imaging start position 203, it is possible to prevent unnecessary image data from being stored.

[0076] Furthermore, in the first embodiment, tracking start position 201 and imaging start position 203 are positioned apart from each other in the depth direction of imaging range 300. This allows for efficient tracking and imaging of subject 200 moving in the direction toward or away from imaging device 1. Therefore, by placing imaging device 1 in a position where the direction of movement of athletes in various sports is the direction toward or away from the athletes, desired imaging of the athletes as subject 200 can be performed.

[0077] Furthermore, in the first embodiment, imaging device 1 is configured to end tracking of subject 200 and capturing image of subject 200 when a predetermined end condition is met. This makes it possible to end tracking and capturing image of athletes (subjects 200) who have finished the competition. Furthermore, it is possible to prevent unnecessary image data from being stored in storage medium 19 after the competition has ended.

[0078] Furthermore, in the first embodiment, the end condition for ending tracking of the subject 200 is set so that tracking of the subject 200 ends after imaging of the subject 200 is completed. This allows tracking to continue until imaging is completed, making it possible to obtain good image data. In other words, it is possible to prevent unnecessary image data from being stored in the storage medium 19. Furthermore, when imaging is performed again while the subject 200 is being tracked after imaging has been completed, it is possible to quickly image the subject 200 being tracked.

[0079] In the first embodiment, the predetermined end condition is based on at least one of the following: a predetermined number of images have been captured; subject 200 overlaps with the end position set in imaging range 300; subject 200 is no longer detected in imaging range 300; a predetermined time has passed; and subject 200 is moving or assuming a predetermined posture. This makes it possible to efficiently prevent unnecessary image data from being stored in storage medium 19.

[0080] Furthermore, in the first embodiment, when a predetermined termination condition is met, the imaging device 1 returns the position at which tracking starts to the tracking start position 201. This allows the imaging device 1 to prepare for tracking the next subject 200 (athlete) in various sports.

[0081] Furthermore, in the first embodiment, the imaging device 1 is configured to display at least one of a tracking point image 301 indicating the tracking position and an imaging point image 302 indicating imaging, superimposed on the image of the subject 200. This allows the user to recognize that tracking of the subject 200 or imaging of the subject 200 is being performed. Therefore, the user can visually confirm whether the subject 200 being tracked or imaged is the desired subject 200.

[0082] Furthermore, in the first embodiment, the imaging device 1 is configured to display the tracking point image 301 and the imaging point image 302 in different display modes. This allows the user to recognize whether the subject 200 is being tracked or the subject 200 is being imaged. Therefore, the user can visually recognize whether the subject 200 being tracked is the desired subject 200, or whether the subject 200 being imaged is the desired subject 200.

[0083] Although the imaging device 1 according to the first embodiment has been described taking an image of a gymnast in the horse vault event, the present invention is not limited to this. The imaging device 1 according to the first embodiment can also capture images of gymnasts in events other than the horse vault, and can also capture images of athletes in track and field events such as the long jump, triple jump, high vault, and pole vault.

[0084] (Modifications of the first embodiment and other embodiments) Next, modifications of the first embodiment and other embodiments will be described. Note that in the following modifications and other embodiments, the contents explained in the first embodiment will be omitted as appropriate. Also, the following modifications, other embodiments, and the first embodiment can be combined with each other.

[0085] (Variation 1) First, a first modification of the first embodiment will be described. In the first embodiment described above, the tracking start position 201 is set based on focus information of the subject 200. In the first modification, a configuration will be described in which the tracking start position 201 is set based on distance information in the depth direction of the imaging range 300, in addition to or instead of the configuration of the above embodiment.

[0086] In the first modification, the tracking start position 201 is set based on distance information in the depth direction of the imaging range 300 and a predetermined area within the imaging range 300. The distance information is, for example, information indicating the distance (e.g., 40 m) in the depth direction from the imaging device 1. For example, the distance can be measured using a time-of-flight method. In the position setting mode, the position setting unit 401 sets the tracking start position 201 by receiving the distance (40 m) indicating the tracking start position 201 from the user via the operation unit 18 or the display unit 16. Furthermore, the position setting unit 401 sets the predetermined area within the imaging range 300 in accordance with, for example, a user operation. As a result, the predetermined area within the imaging range 300 indicating the set distance (40 m ahead) is set as the tracking start position 201.

[0087] When tracking start position 201 is set based on distance information in the depth direction of imaging range 300, tracking starts when subject 200 overlaps the set distance (for example, 40 m) (passes 40 m ahead). This includes not only cases where subject 200 completely overlaps the set distance, but also cases where subject 200 partially overlaps. Furthermore, tracking may start when subject 200 passes the set distance, or may start after subject 200 has passed the set distance.

[0088] Furthermore, in the first modification, the end position 202 and the imaging start position 203 can also be set based on distance information in the depth direction of the imaging range 300 and a predetermined area within the imaging range 300. The distance information of the end position 202 or the imaging start position 203 is, for example, information indicating the distance in the depth direction from the imaging device 1 (for example, 10 m for the end position 202, or 20 m for the imaging start position 203). In the position setting mode, the position setting unit 401 sets the end position 202 or the imaging start position 203 by accepting the distance (10 m or 20 m) indicating the end position 202 or the imaging start position 203 from the user via the operation unit 18 or the display unit 16. Furthermore, the position setting unit 401 sets a predetermined area within the imaging range 300 in accordance with, for example, a user operation.

[0089] Note that each of the positions 201 to 203 may be set based on at least one of distance information in the depth direction of the imaging range 300 and a predetermined region within the imaging range 300. That is, each of the positions 201 to 203 may be set based only on distance information in the depth direction of the imaging range 300, or may be set based only on the predetermined region within the imaging range 300.

[0090] As described above, in the first modification, tracking start position 201 is set based on distance information in the depth direction of imaging range 300 and / or a predetermined area within imaging range 300. This makes it possible to track a player at the distance indicated by the distance information and / or a player detected within the predetermined area as subject 200. Therefore, it is possible to accurately track and image the subject 200 desired by the user.

[0091] (Variation 2) Next, a description will be given of Modification 2 of the first embodiment. Modification 2 describes a configuration in which different controls are performed for tracking and imaging after tracking of subject 200 starts and after imaging starts.

[0092] In the second modification, the angle of view (zoom) may be made changeable after tracking of the subject has begun. For example, the angle of view may be made changeable so that the area of ​​the subject remains the same within the imaging range 300. The area of ​​the subject is, for example, the area of ​​the entire body of the athlete. The imaging device 1 narrows the angle of view (zooms) for the subject 200 at the starting point, and widens the angle of view as the subject 200 approaches the imaging device 1. This makes it possible to obtain a good captured image that mainly focuses on the athlete (subject 200).

[0093] In addition, in the second modification, the shutter speed (interval between frames) may be made changeable after image capture has begun. For example, the shutter speed while the athlete moves from the takeoff board to the landing mat may be set faster than the shutter speed while the athlete moves to other positions. This allows more images to be captured of the most important parts of the horse vault series or scenes in which subject 200 moves quickly.

[0094] (Second embodiment) Next, a second embodiment will be described. In the first embodiment described above, a case where a gymnast competing in the horse vault event is tracked and imaged as subject 200 is described. In the second embodiment, a case where a track and field athlete who crosses the finish line first is tracked and imaged as subject 200 is described.

[0095] FIG. 8A is an explanatory diagram showing an example of an image within the imaging range 300 of the imaging device 1 according to the second embodiment, showing an image before the subject reaches the tracking and imaging start position. FIG. 8B is an explanatory diagram showing an example of an image within the imaging range 300 of the imaging device 1 according to the second embodiment, showing an image when imaging a subject that has reached the tracking and imaging start position. In FIG. 8A, a tracking and imaging start position 801 is set at the finish line in the imaging range 300. The tracking and imaging start position 801 is a tracking start position where tracking is performed to focus on and maintain the focus on a specific subject 200. Furthermore, the tracking and imaging start position 801 is both a tracking start position and an imaging start position where imaging begins.

[0096] 8A shows an image before the subject reaches the finish line. Before the subject reaches the finish line (tracking / imaging start position 801), the tracking control unit 402 detects tracking candidates 800 (multiple subjects) to focus on and maintain when the subject overlaps the finish line. Specifically, before the finish line is reached, the tracking control unit 402 detects multiple runners, who are candidates 800 (800a to 800e) for the subject 200 to track, in a horizontal row, without focusing. For this reason, the subject is not in focus before the finish line is reached.

[0097] The position at which detection of the horizontal line starts can be set by the user at any position. For example, the position at which detection of the horizontal line starts can be on the start line, or can be any position between the start line and the finish line. When the imaging control unit 403 detects the candidates 800 at the position at which detection of the horizontal line starts, the imaging control unit 403 starts detecting the candidates 800 in the horizontal line.

[0098] Furthermore, based on the detection results of candidates 800 that overlap with the tracking and image capture start position 801, the tracking control unit 402 tracks the subject 200 that first overlaps with the tracking and image capture start position 801. Specifically, the tracking control unit 402 identifies the leading runner who reaches the finish line first as the subject 200 to be tracked and tracks it. For example, the identification uses the results of image processing such as computer vision based on the detection results of subjects in a horizontal row. In this way, the subject 200 to be tracked is identified from among the multiple candidates 800 (multiple runners).

[0099] 8B shows an image obtained when the first runner to reach the finish line is focused on and tracked as subject 200, and the subject 200 is imaged. As shown in FIG. 8B, the imaging control unit 403 images the runner who first reaches the finish line (tracking and imaging start position 801). In addition, the display control unit 404 displays an imaging point image 302 superimposed on the subject 200 on the display unit 16.

[0100] Then, when a predetermined end condition is met, such as when subject 200 reaches end position 202, tracking and imaging of subject 200 are terminated. Note that, although this embodiment shows an example in which both the tracking start position and imaging start position are set at the finish line, the tracking start position may be set just before the finish line, and the imaging start position may be set at the finish line.

[0101] (Regarding the processing related to tracking and imaging according to the second embodiment) Fig. 9 is a flowchart showing an example of the tracking and imaging process according to the second embodiment. In Fig. 9, it is assumed that the imaging device 1 is set to an automatic imaging mode in which tracking and imaging according to the second embodiment are performed. In Fig. 9, the predetermined end conditions for ending focused tracking and imaging will be explained in a simplified manner.

[0102] 9, the imaging device 1 determines whether or not tracking of a single horizontal line has begun (step S901). The imaging device 1 waits until tracking of a single horizontal line has begun (step S901: NO), and when tracking of a single horizontal line has begun (step S901: YES), it tracks a plurality of candidates 800 in a single horizontal line (step S902). The imaging device 1 then determines whether or not the leading candidate of the candidates 800 has reached the tracking and imaging start position 801 (finish line) (step S903). If the leading candidate has not reached the tracking and imaging start position 801 (step S903: NO), the imaging device 1 returns to step S902 and continues tracking the candidates 800 in a single horizontal line.

[0103] If the leading candidate 800 reaches the tracking and imaging start position 801 (step S903: YES), the imaging device 1 tracks the leading candidate 800 as the subject 200 to be focused on and tracked (step S904). Then, the imaging device 1 images the subject (step S905). When imaging of the subject 200 begins, the imaging device 1 displays the imaging point image 302 (see FIG. 8B) superimposed on the subject 200 on the display unit 16 (step S906).

[0104] Then, the imaging device 1 determines whether a predetermined termination condition is met (step S907). If the predetermined termination condition is not met (step S907: NO), the imaging device 1 returns to step S907 and continues tracking and capturing image of the subject 200 and displaying the subject 200 and the imaging point image 302. On the other hand, if the predetermined termination condition is met (step S907: YES), the imaging device 1 ends tracking and capturing image of the subject 200 (step S908) and returns to the setting of tracking a single horizontal line (step S909).

[0105] Next, the imaging device 1 determines whether the automatic shooting mode is to be ended (step S910). If the automatic shooting mode is not to be ended (step S910: NO), the imaging device 1 returns to step S901. On the other hand, if the automatic shooting mode is to be ended (step S910: YES), the imaging device 1 ends the series of processes.

[0106] As described above, the imaging device 1 according to the second embodiment is configured to track tracking candidates 800 (plurality of subjects) by adjusting and maintaining focus before the subject 200 overlaps the tracking and imaging start position 801. Therefore, even in cases such as track and field events where the leading candidate 800 among multiple candidates 800 (athletes) is not known in advance, the candidate 800 that first overlaps the tracking and imaging start position 801 can be tracked and imaged as the subject 200 to be tracked. Therefore, it is possible to track and image the subject 200 desired by the user.

[0107] (Third embodiment) Next, a third embodiment will be described. In the third embodiment, a configuration will be described in which a position received from a user on the screen of the display unit 16 is set as the tracking start position 201. In the third embodiment, a case will be described in which the tracking start position 201 is set at a gate portion in a ski race.

[0108] In the third embodiment, the position setting unit 401 sets a position received from the user as the tracking start position 201. The operation mode received from the user includes a touch operation on the display unit 16 and a button operation on the operation unit 18. Specifically, the display unit 16 displays the imaging results of the subject. In addition, in the third embodiment, the imaging device 1 includes an input unit. The input unit receives user input when the user touches the display unit 16. The position setting unit 401 sets the area received from the user by the input unit as the tracking start position 201. In addition, the position setting unit 401 can also set the position received from the user as a prohibited position where the subject is not tracked.

[0109] Fig. 10 is an explanatory diagram showing an example of a screen when the imaging device 1 according to the third embodiment accepts the setting of each position from the user. In Fig. 10, a reception screen 1000 is displayed on the display unit 16. The reception screen 1000 displays an imaging result 1001, a tracking start position selection button 1002, a prohibited position selection button 1003, a confirmation button 1004, a tracking start position 201, and a prohibited position 205.

[0110] When the user touches tracking start position selection button 1002 and then touches any position on the screen, the touched position is displayed as tracking start position 201. In the illustration, tracking start position 201 is set to a position around gate 1010 where the runner (subject 200 to be tracked) will pass. Also, when the user touches prohibited position selection button 1003 and then touches any position on the screen, the touched position is displayed as prohibited position 205. In the illustration, prohibited position 205 is set in the area of ​​gate 1010. In other words, it is set so that gate 1010 is not tracked. Confirmation button 1004 accepts confirmation or cancellation of tracking start position 201 and prohibited position 205 accepted by the user.

[0111] In FIG. 10 , the tracking start position 201 and the prohibited position 205 are distinguished from each other by being displayed in different colors, but this is not a limitation. For example, when the user selects the prohibited position 205, the display of that area may be erased. In this case, the user can reset the settings by pressing an initial button (not shown) to display the erased area again. Also, instead of the user touching the screen, the tracking start position 201 and the prohibited position 205 may be set using, for example, a cross key (not shown). In this case, the area already set as the tracking start position 201 may be changed to the prohibited position 205 when selected with the cross key, and the area set as the prohibited position 205 may be changed to the tracking start position 201 when selected with the cross key.

[0112] Furthermore, when the user sets the tracking start position 201 and the prohibition position 205 by touching the screen, the screen may vibrate or a confirmation sound may be emitted to notify the user that the desired settings have been made by touching each position. Alternatively, the imaging device 1 may automatically recognize the gate 1010 and automatically set the gate 1010 as the prohibition position 205. In this case, the user may touch the area surrounding the gate 1010 to fine-tune the prohibition position 205. When the tracking start positions 201 are located at multiple positions within the imaging range, tracking may be started when one of the tracking start positions 201 overlaps with the subject 200, or when all of the tracking start positions 201 overlap with the subject 200. Alternatively, the imaging device 1 may detect the subject 200 passing through the tracking start position 201 and start tracking when the subject 200 passes the tracking start position 201.

[0113] (Regarding the setting process of the tracking start position according to the third embodiment) 11 is a flowchart showing an example of a process for setting a tracking start position according to the third embodiment. In FIG. 11, the imaging device 1 determines whether or not it has entered a position setting mode for setting each position (step S1101). The imaging device 1 waits until it enters the position setting mode (step S1101: NO), and when it enters the position setting mode (step S1101: YES), it displays the imaging result on the display unit 16 (step S1102).

[0114] Then, the imaging device 1 determines whether the tracking start position selection button 1002 (see FIG. 10) has been touched (step S1103). If the tracking start position selection button 1002 has not been touched (step S1103: NO), the imaging device 1 proceeds to step S1105. If the tracking start position selection button 1002 has been touched (step S1103: YES), the imaging device 1 accepts any position on the screen as the tracking start position 201 (step S1104).

[0115] Next, the imaging device 1 determines whether the prohibited position selection button 1003 (see FIG. 10) has been touched (step S1105). If the prohibited position selection button 1003 has not been touched (step S1105: NO), the imaging device 1 proceeds to step S1107. If the prohibited position selection button 1003 has been touched (step S1105: YES), the imaging device 1 accepts any position on the screen as the prohibited position 205 (step S1104).

[0116] Next, the imaging device 1 determines whether the tracking start position 201 and the prohibition position 205 have been confirmed by touching the confirmation button 1004 (see FIG. 10) (step S1107). If the tracking start position 201 and the prohibition position 205 have not been confirmed (step S1107: NO), the imaging device 1 proceeds to step S1109. If the tracking start position 201 and the prohibition position 205 have been confirmed (step S1107: YES), the imaging device 1 stores the tracking start position 201 and the prohibition position 205 received from the user in the RAM 14 (step S1108).

[0117] Then, the imaging device 1 determines whether or not to end the position setting mode (step S1109). If the position setting mode is not to be ended (step S1109: NO), the imaging device 1 returns to step S1103. If the position setting mode is to be ended (step S1109: YES), the imaging device 1 ends the series of processes.

[0118] In the third embodiment, the imaging start position may be the same position as the tracking start position 201. That is, by accepting the tracking start position 201 on the acceptance screen 1000 (see FIG. 10 ), the setting of the imaging start position may also be accepted at the same time. The imaging start position may also be a position different from the tracking start position 201. In this case, the setting of the imaging start position may be accepted from the screen of the display unit 16 separately from the setting of the tracking start position 201.

[0119] Furthermore, in the third embodiment, the termination condition is, for example, when subject 200 is no longer detected from imaging range 300, when a predetermined number of images have been captured, or when a predetermined time has passed. However, the termination condition may also be when subject 200 overlaps with an end position set in imaging range 300. In this case, the end position may be set on the screen of display unit 16, similar to the setting of tracking start position 201.

[0120] As described above, the imaging device 1 according to the third embodiment is configured to set a position received from the user as the tracking start position 201. This allows the user to easily set the tracking start position 201.

[0121] Furthermore, the imaging device 1 according to the third embodiment is configured to set the position received from the user as the prohibited position 205 where the subject is not tracked. This makes it possible to prevent an object other than the desired subject 200 from being tracked as the subject 200.

[0122] Furthermore, the imaging device 1 according to the third embodiment accepts user input when the user touches the display unit 16 that displays the imaging result of the subject, and sets the accepted area as the tracking start position 201. This allows the user to more easily set the tracking start position 201 using the display unit 16.

[0123] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention described in the claims and their equivalents.

[0124] The program for implementing the control unit 15 and the imaging device 1 described above may be recorded on a computer-readable storage medium and loaded into a computer system for execution. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. The term "computer-readable storage medium" also refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into a computer system. The term "computer-readable storage medium" also includes storage devices that retain a program for a certain period of time, such as volatile memory (RAM) within a computer system that acts as a server or client when the program is transmitted via a network such as the Internet or a communication line such as a telephone line. The program may also be transmitted from a computer system storing the program in a storage device to another computer system via a transmission medium or by transmission waves within the transmission medium. The term "transmission medium" used to transmit the program refers to a medium capable of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may also be used to implement some of the functions described above. Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program). [Explanation of symbols]

[0125] 1...imaging device, 12...image processing unit, 15...control unit, 16...display unit, 201...tracking start position, 202...end position, 203...imaging start position, 205...prohibition position, 210...tracking start position image, 300...imaging range, 301...tracking point image, 302...imaging point image, 401...position setting unit, 402...tracking control unit, 403...imaging control unit, 404...display control unit, 800...candidate, 801...tracking / imaging start position, 1001...imaging result

Claims

1. an imaging unit that captures an image of a subject; a tracking control unit that starts tracking of the subject based on a detection result of the subject at a tracking start position set in an imaging range of the imaging unit; an imaging control unit that starts recording a captured image to a storage medium when the subject being tracked by the tracking control unit is detected at an imaging start position set in an imaging range of the imaging unit; An imaging device comprising:

2. The imaging device according to claim 1 , wherein the imaging control unit does not record the captured image from when the tracking control unit starts tracking the subject until when the imaging control unit starts recording the captured image.

3. an image processing unit that generates a captured image from image data captured by the imaging unit; a recording control unit that records the captured image generated by the image processing unit in the storage medium; The imaging device according to claim 1 , further comprising:

4. The imaging device according to claim 1 , wherein at least one of the tracking start position and the imaging start position is set in a predetermined imaging region within an imaging range.

5. The imaging device according to claim 1 , wherein at least one of the tracking start position and the imaging start position is set to a predetermined position in a depth direction of an imaging range.

6. The imaging device according to claim 5 , wherein the tracking start position and the imaging start position are set at positions spaced apart from each other in a depth direction.

7. The imaging device according to claim 1 , wherein at least one of the tracking start position and the imaging start position is set based on focus information.

8. The imaging device according to claim 1 , wherein the tracking of the subject includes tracking that maintains focus on the subject.

9. The imaging device according to claim 8 , wherein the imaging control unit terminates recording of the captured image when a predetermined termination condition is satisfied.

10. The imaging device according to claim 9 , wherein the focus point is returned to the tracking start position when the predetermined termination condition is satisfied.

11. The imaging device according to claim 1 , wherein the subject detection result includes at least one of the subject's face, size, movement, and posture.

12. A program executed by a computer, the program comprising: a tracking control unit that starts tracking of a subject based on a detection result of the subject captured by the imaging unit at a tracking start position set in an imaging range of the imaging unit; an imaging control unit that starts recording a captured image to a storage medium when the subject being tracked by the tracking control unit is detected at an imaging start position set in an imaging range of the imaging unit; A program that functions as a

Citation Information

Patent Citations

  • Tracking device for object to be photographed

    JP1999215422A