Imaging control device, imaging control system, imaging control method, and program

Abstract

This imaging control device comprises: an acquisition unit that acquires a positional relationship between a first object and a second object; and a control unit that controls imaging of at least one of the first object and the second object by an imaging device. The control unit controls the imaging by the imaging device when the positional relationship acquired by the acquisition unit satisfies a predetermined imaging condition.

Description

Imaging control device, imaging control system, imaging control method, and program

[0001] The present invention relates to an imaging control device, an imaging control system, an imaging control method, and a program. This application claims priority to Japanese Patent Application No. 2023-105988, filed on June 28, 2023, the contents of which are incorporated herein by reference.

[0002] Sports scenes are captured by cameramen. Meanwhile, the automation of sports scene capture is progressing. For example, a technology is known in which multiple cameras are remotely linked and simultaneously instructed to capture images. A system has also been proposed that broadcasts a soccer field while automatically changing the angle of view and zoom. Furthermore, an imaging device with a function to track the angle of view to a specified subject is known (Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2021-100239

[0004] One aspect of the present invention is an imaging control device that includes an acquisition unit that acquires the positional relationship between a first object and a second object, and a control unit that controls imaging of at least one of the first object and the second object by an imaging device, wherein the control unit controls imaging by the imaging device when the positional relationship acquired by the acquisition unit satisfies predetermined imaging conditions.

[0005] One aspect of the present invention is an imaging control system including the imaging control device described above and an imaging device controlled by the imaging control device.

[0006] One aspect of the present invention is an imaging control method comprising an acquisition step of acquiring a positional relationship between a first object and a second object, and a control step of controlling imaging of at least one of the first object and the second object by an imaging device, wherein the control step controls imaging by the imaging device when the positional relationship acquired in the acquisition step satisfies predetermined imaging conditions.

[0007] One aspect of the present invention is a program for causing a computer to execute an acquisition step of acquiring a positional relationship between a first object and a second object, and a control step of controlling an imaging device to capture an image of at least one of the first object and the second object, wherein the control step controls imaging by the imaging device when the positional relationship acquired in the acquisition step satisfies predetermined imaging conditions.

[0008] 1 is a diagram showing an example of the configuration of an imaging control system 1 according to the first embodiment. FIG. 2 is a diagram showing an example of the functional configuration of an imaging control device 2 according to the first embodiment. FIG. 3 is a diagram showing an example of the functional configuration of an imaging device 3 according to the first embodiment. FIG. 4 is a diagram for explaining an example of imaging conditions according to the first embodiment. FIG. 5 is a diagram for explaining an example of imaging conditions according to the first embodiment. FIG. 6 is a diagram showing an example of a control flow by the imaging control system 1 at the start of imaging according to the first embodiment. FIG. 7 is a diagram showing an example of a control flow by the imaging control system 1 at the end of imaging according to the first embodiment. FIG. 8 is a diagram for explaining another example of imaging conditions according to a modified example of the first embodiment. FIG. 9 is a diagram showing an example of the functional configuration of an imaging control system 1a according to the second embodiment. FIG. 10 is a diagram showing an example of the functional configuration of an imaging device 3a according to the second embodiment. FIG. 11 is a diagram showing an example of a control flow by the imaging control system 1a at the start of imaging according to the second embodiment. FIG. 12 is a diagram showing another example of a control flow by the imaging control system 1a at the start of imaging according to the modified example of the second embodiment.

[0009] (First embodiment) The first embodiment will be described in detail below with reference to the drawings. [Configuration of imaging control system 1] Fig. 1 is a diagram showing an example of the configuration of an imaging control system 1 according to this embodiment. The imaging control system 1 includes an imaging control device 2, multiple imaging devices 3, and a coordinate information acquisition system 4. As an example, the multiple imaging devices 3 are composed of four imaging devices: a first imaging device 3-1, a second imaging device 3-2, a third imaging device 3-3, and a fourth imaging device 3-4. In the following description, one of the multiple imaging devices 3 will be referred to as the imaging device 3.

[0010] The imaging control system 1 is a system that automatically captures a series of still images of a specific scene of a player of interest (also referred to as a featured player) playing a sport. In this embodiment, the sport is soccer, for example. The specific scene is a decisive or noteworthy scene in a soccer game, such as a goal or a shot.

[0011] The imaging control device 2 controls imaging by each of the multiple imaging devices 3. The imaging control device 2 controls imaging by transmitting an imaging control signal B1 to each of the multiple imaging devices 3. In other words, the imaging control device 2 controls imaging by each of the multiple imaging devices 3 by remote control. One example of the imaging control device 2 is a personal computer (PC). The imaging control device 2 may transmit the imaging control signal B1 to the imaging devices 3 wirelessly or via a wired connection.

[0012] The imaging control device 2 acquires coordinate information A1 supplied from the coordinate information acquisition system 4. The imaging control device 2 calculates the positional relationship between the first object and the second object captured by the imaging device 3 based on the coordinate information A1. The imaging control device 2 controls imaging by each of the multiple imaging devices 3 when the positional relationship satisfies predetermined imaging conditions. In this embodiment, the first object is, for example, a featured player. The second object is a ball. Note that either the first object or the second object may be a referee. The second object may also be a fixed object. An example of a fixed object is a goal post or a white line representing a penalty area.

[0013] The imaging device 3 captures images of sports scenes. Each of the multiple imaging devices 3 tracks and captures an image of a featured player. In this embodiment, as an example, each of the multiple imaging devices 3 tracks and captures an image of a common featured player. The featured player is determined in advance. The featured player is, for example, a striker or a star player.

[0014] As described above, the imaging operation of the imaging device 3 is remotely controlled by the imaging control device 2. The imaging operation performed by the imaging device 3 includes panning, tilting, and zooming. As an example, the imaging device 3 is a pan-tilt-zoom (PTZ) camera. Note that the imaging device 3 may be composed of a camera (e.g., a mirrorless camera) and a remotely controllable camera platform. In this embodiment, as an example, the imaging control device 2 controls imaging by each of the multiple imaging devices 3 provided separately from the imaging control device 2. Note that the imaging control device 2 and the imaging devices 3 may be configured as an integrated device.

[0015] The imaging device 3 outputs the captured image C1 to the imaging control device 2. The imaging control device 2 displays a video (also referred to as a live view) in which the imaging device 3 automatically tracks the noted player. In this embodiment, the captured image C1 includes a plurality of still images of a specific scene that have been continuously captured. The plurality of still images of a specific scene that have been continuously captured are images that are captured under the control of the imaging control device 2 when the positional relationship between the first object and the second object captured by the imaging device 3 satisfies a predetermined imaging condition. Note that instead of outputting the captured image C1 to the imaging control device 2, the imaging device 3 may output the captured image C1 to a server that is communicably connected via a network.

[0016] The coordinate information acquisition system 4 acquires coordinate information A1 for each of one or more objects. The coordinate information A1 is information indicating coordinates that indicate the position of each of the one or more objects. In this embodiment, the coordinate information A1 is acquired for each of one or more people playing a sport. The coordinate information A1 includes information that identifies the object and information that indicates coordinates that indicate the position of the object on the pitch. The coordinates that indicate the position on the pitch are represented, for example, by two-dimensional Cartesian coordinates. The information that identifies the object is, for example, the uniform number of a player on each team.

[0017] The coordinate information acquisition system 4 is a tracking system consisting of cameras and a server. The coordinate information acquisition system 4 acquires coordinate information A1 for each object from images captured by multiple cameras installed at positions capable of capturing images of the pitch. For example, the cameras may be ceiling cameras attached to the ceiling of the stadium or cameras attached to a drone. The number of cameras may also be a single device rather than multiple devices. The coordinate information acquisition system 4 calculates coordinate information A1 for each object based on image recognition from the images captured by the multiple cameras. The coordinate information acquisition system 4 acquires coordinate information A1 instantly (in real time) while the sport is being played. The multiple cameras may be the imaging device 3 or may be installed separately from the imaging device 3.

[0018] In addition, when the imaging device 3 is used as a camera to acquire the coordinate information A1, the imaging device 3 acquires the coordinate information A1 based on the position where the imaging device 3 is installed, the direction in which the imaging device 3 captures images, and the distance information from the imaging device 3 to the object.

[0019] The coordinate information acquisition system 4 may acquire not only the coordinate information A1 from the captured image but also the moving speed, acceleration, and moving direction of the object. In this case, the coordinate information A1 includes information indicating the coordinates, as well as information indicating the moving speed, acceleration, and moving direction of the object.

[0020] 2 is a diagram showing an example of the functional configuration of the imaging control device 2 according to this embodiment. The imaging control device 2 includes an acquisition unit 20, a control unit 21, a communication unit 22, a display unit 23, and a storage unit 24.

[0021] The acquisition unit 20 acquires coordinate information A1 from the coordinate information acquisition system 4. Based on the acquired coordinate information A1, the acquisition unit 20 calculates the positional relationship between the first object and the second object captured by the imaging device 3. The acquisition unit 20 acquires the positional relationship by calculating the positional relationship. Thus, the acquisition unit 20 acquires the positional relationship between the first object and the second object captured by the imaging device 3.

[0022] In this embodiment, as an example, the first object is a player playing soccer, and the second object is a ball. Therefore, the first object is a person, and the second object is a non-person.

[0023] The control unit 21 controls imaging by the imaging device 3. Here, the control unit 21 controls imaging by the imaging device 3 when the positional relationship between the first object and the second object satisfies a predetermined imaging condition. The control unit 21 controls imaging of at least one of the first object and the second object by the imaging device 3. In one example of this embodiment, the control unit 21 controls imaging by each of the multiple imaging devices 3 provided separately from the imaging control device 2.

[0024] In this embodiment, the positional relationship between the first object and the second object is the distance between the first object and the second object. In this embodiment, the positional relationship between the player and the ball is the distance between the player and the ball. The distance between the player and the ball is the distance on the pitch. In other words, the distance between the first object and the second object is the distance within the space in which the first object and the second object exist. The distance within the space is, in other words, the physical distance.

[0025] The control unit 21 controls the imaging device 3 to capture an image when the distance between the first object and the second object is equal to or shorter than a predetermined distance. Note that, for example, a ceiling camera installed in a position where it can capture an image of the pitch may calculate the positional relationship between the first object and the second object without using the coordinate information A1. When the ceiling camera calculates the positional relationship, the ceiling camera measures the distance to the first object and the distance to the second object, and calculates the positional relationship using the measured distance information and information about the height at which the ceiling camera is installed.

[0026] The acquisition unit 20 and the control unit 21 are each realized by, for example, a CPU loading a program from a ROM (Read Only Memory) into a RAM (Random Access Memory) and executing processing in accordance with the program. The ROM and RAM are included in the storage unit 24.

[0027] The communication unit 22 transmits and receives various types of information via the wireless network. For example, the communication unit 22 transmits an imaging control signal B1 to the imaging device 3. The communication unit 22 receives a captured image C1 from the imaging device 3. The communication unit 22 includes a communication interface (I / F) for wireless communication.

[0028] The display unit 23 displays various types of information. The display unit 23 displays the captured image C1 acquired from the imaging device 3. A user of the imaging control system 1 can view or check the captured image C1 captured by the imaging device 3 by displaying it on the display unit 23. The display unit 23 includes, for example, a liquid crystal display or an organic electroluminescence (EL: Electro-Luminescence) display.

[0029] The storage unit 24 stores various types of information. For example, the storage unit 24 stores predetermined imaging conditions that the control unit 21 uses to control imaging by the imaging device 3. The storage unit 24 also stores the captured image C1 acquired from the imaging device 3. The storage unit 24 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device.

[0030] 3 is a diagram showing an example of the functional configuration of the imaging device 3 according to this embodiment. The imaging device 3 includes an imaging control unit 30, a tracking unit 31, an imaging unit 32, a communication unit 33, and a storage unit 34.

[0031] The imaging control unit 30 controls the imaging unit 32. For example, the imaging control unit 30 causes the imaging unit 32 to perform panning, tilting, and zooming. The imaging control unit 30 controls the imaging direction of the imaging unit 32 so that an object imaged by the imaging unit 32 is within the angle of view. The imaging control unit 30 is remotely controlled by the imaging control device 2.

[0032] The tracking unit 31 tracks an object captured by the imaging device 3. The tracking unit 31 tracks the object based on coordinate information indicating the coordinates of the first object or the second object in space. The tracking unit 31 acquires coordinate information A1 from the coordinate information acquisition system 4 as the coordinate information. The tracking unit 31 calculates the direction and angle of view so that the object to be tracked enters the angle of view of the imaging unit 32 based on the coordinate information. The imaging control unit 30 causes the imaging unit 32 to perform panning, tilting, and zooming based on the direction and angle of view calculated by the tracking unit 31.

[0033] The imaging unit 32 is controlled by the imaging control unit 30 to capture an image of the object. This image is referred to as a captured image C1. The imaging unit 32 includes an optical system and an image sensor. The optical system includes mechanisms for panning, tilting, and zooming.

[0034] In this embodiment, the captured image C1 is a still image. The imaging unit 32 is controlled by the imaging control unit 30 to continuously capture a plurality of still images during a period from the start of imaging to the end of imaging. In other words, the imaging unit 32 continuously captures still images. The continuous shooting speed may be, for example, about one to two frames per second. The continuous shooting speed may be faster than about one to two frames per second. Note that the images captured by the imaging unit 32 may be moving images.

[0035] The communication unit 33 transmits and receives various types of information via the wireless network. For example, the communication unit 33 receives an imaging control signal B1 from the imaging control device 2. The communication unit 33 transmits a captured image C1 to the imaging control device 2. The communication unit 33 also receives coordinate information A1 from the coordinate information acquisition system 4. The communication unit 33 includes a communication interface (I / F) for wireless communication.

[0036] The storage unit 34 stores various types of information, such as the captured image C1. The storage unit 34 is configured using, for example, a memory card.

[0037] As described above, the coordinate information A1 supplied from the coordinate information acquisition system 4 is also used by the acquisition unit 20 included in the imaging control device 2 to acquire the positional relationship between the first object and the second object. Therefore, the imaging device 3 tracks an object based on the coordinate information A1 indicating the coordinates of the first object or the second object in space, and the acquisition unit 20 acquires the positional relationship between the first object and the second object based on the coordinates of the first object and the coordinates of the second object indicated by the coordinate information A1 used to track the object.

[0038] When the imaging device 3 acquires the coordinate information A1 as described above, the imaging device 3 may further calculate the positional relationship between the first object and the second object using the acquired coordinate information A1. In this case, the acquisition unit 20 acquires the positional relationship between the first object and the second object calculated by the imaging device 3.

[0039] The imaging control system 1 may include a system for acquiring coordinate information used by the tracking unit 31 for tracking, separate from the coordinate information acquisition system 4. The tracking unit 31 may perform tracking based on image recognition instead of coordinate information.

[0040] The tracking unit 31 may track the ball instead of the player. As described above, the imaging device 3 has the function of tracking the first object or the second object. The control unit 21 provided in the imaging control device 2 controls imaging by the imaging device 3 having the tracking function. The imaging device 3 does not have to have the function of tracking the first object or the second object. In that case, the tracking unit 31 is omitted from the configuration of the imaging device 3.

[0041] It is also possible to capture an image with a wide angle and then generate a zoomed image of the player of interest using digital zoom. In this case, it is sufficient for the player of interest to be within the angle of view during tracking.

[0042] [Image Capture Conditions] Next, the image capture conditions under which the image capture control device 2 controls image capture by the image capture device 3 will be described. Figures 4 and 5 are diagrams for explaining examples of image capture conditions according to this embodiment. As described above, in this embodiment, the control unit 21 provided in the image capture control device 2 controls image capture by the image capture device 3 when the distance between the player and the ball is equal to or less than a predetermined distance. The control of image capture by the image capture device 3 is the start of image capture or the end of image capture. The predetermined distance or less is, for example, 5 meters or less.

[0043] 4 and 5 are images of soccer scenes arranged in chronological order within the angle of view of the imaging device 3. Of the multiple players captured in the images, the player being tracked by the imaging device 3 is a noted player X1. In images P1 and P2, the distance between the noted player X1 and the ball Y1 is far, and the ball Y1 is not captured. In image P3, the ball Y1 is within the angle of view, but the distance between the noted player X1 and the ball Y1 is not less than a predetermined distance.

[0044] Image P4 shows a scene just before the noted player X1 is about to start dribbling after the ball Y1 has been passed to the noted player X1. In image P4, the distance between the noted player X1 and the ball Y1 is equal to or less than a predetermined distance. Because the positional relationship between the noted player X1 and the ball Y1 satisfies the imaging conditions, the control unit 21 of the imaging control device 2 causes the imaging device 3 to start continuous shooting.

[0045] In each of images P5 and P6, the noted player X1 is dribbling the ball. In each of images P5 and P6, the distance between the noted player X1 and the ball Y1 is equal to or shorter than a predetermined distance.

[0046] Image P7 shows a scene immediately after the noted player X1 passes the ball to another player X2 and the ball Y1 leaves the noted player X1. In image P7, the distance between the noted player X1 and the ball Y1 is not equal to or less than a predetermined distance. While continuous shooting is being performed, the imaging condition is that the distance between the noted player X1 and the ball Y1 is equal to or less than a predetermined distance. If the distance between the noted player X1 and the ball Y1 is not equal to or less than the predetermined distance, the control unit 21 causes the imaging device 3 to end continuous shooting.

[0047] Image P8 shows a scene in which another player X2, to whom a noted player X1 has passed the ball, is holding the ball Y1. Images P9 and P10 show scenes in which the other player X2 kicks the ball Y1 and shoots. In each of images P8, P9, and P10, the distance between the noted player X1 and the ball Y1 is greater than a predetermined distance.

[0048] The timing of continuous shooting by the imaging device 3 is controlled by the imaging control device 2 according to the imaging conditions described above. Only scenes in which the distance between the noted player X1 and the ball Y1 is equal to or less than a predetermined value are continuously shot and captured. Therefore, only specific scenes in which the noted player X1 plays while holding the ball Y1 are continuously shot and captured as still images. As described above, the noted player X1 is the target that the imaging device 3 tracks.

[0049] The imaging conditions at the start of imaging and the end of imaging may be different. For example, the imaging condition at the start of imaging is that the distance between the player and the ball is 3 meters or less. The imaging condition at the end of imaging is that the distance between the player and the ball is 10 meters or more. By setting the imaging condition at the end of imaging to be longer than the imaging condition at the start of imaging, it is possible to capture, for example, the facial expression of a player after he has left the ball.

[0050] Furthermore, even if the distance between the noted player X1 and the ball Y1 is not equal to or less than the predetermined distance after image capture begins, the control unit 21 continues capturing images for several seconds without causing the image capture device 3 to end the continuous shooting. A few seconds is, for example, five seconds. By continuing to capture images for several seconds, continuous shooting continues even if, for example, the noted player X1 kicks the ball Y1 hard while dribbling, temporarily causing the distance between the noted player X1 and the ball Y1 to exceed the predetermined distance, and then the noted player X1 catches up with the ball Y1, causing the distance between the noted player X1 and the ball Y1 to again become equal to or less than the predetermined distance. This allows the noted scene to be captured without interruption.

[0051] [Control flow by imaging control system 1] Next, the control flow by the imaging control system 1 will be described with reference to Fig. 6 and Fig. 7. Fig. 6 is a diagram showing an example of the control flow by the imaging control system 1 at the start of imaging according to this embodiment. The control at the start of imaging shown in Fig. 6 is repeatedly executed while the imaging control system 1 is operating.

[0052] Step S10: The coordinate information acquisition system 4 acquires coordinate information A1. The coordinate information acquisition system 4 captures images of multiple players and the ball using multiple cameras. The coordinate information acquisition system 4 recognizes the players or the ball based on image recognition and acquires coordinate information A1 by calculating coordinate information A1. The coordinate information acquisition system 4 transmits the acquired coordinate information A1 to the imaging control device 2 and the imaging device 3, respectively.

[0053] Step S20: The imaging device 3 acquires the coordinate information A1 transmitted from the coordinate information acquisition system 4. Here, the tracking unit 31 acquires the coordinate information A1.

[0054] Step S30: The imaging device 3 performs tracking based on the coordinate information A1. Based on the coordinate information A1, the tracking unit 31 calculates the direction in which the player to be tracked will enter the angle of view of the imaging unit 32. The imaging control unit 30 controls the direction in which the imaging unit 32 captures images based on the direction calculated by the tracking unit 31.

[0055] Step S40: The imaging control device 2 acquires the coordinate information A1 transmitted from the coordinate information acquisition system 4. Here, the acquisition unit 20 acquires the coordinate information A1.

[0056] Step S50: The acquisition unit 20 calculates the positional relationship between the first object and the second object based on the acquired coordinate information A1. The acquisition unit 20 calculates the distance between the player and the ball as the positional relationship between the first object and the second object.

[0057] Step S60: The control unit 21 determines whether or not the positional relationship calculated by the acquisition unit 20 satisfies the image capture start condition. For example, the control unit 21 determines that the positional relationship satisfies the image capture start condition when the distance between the player and the ball is equal to or shorter than a predetermined distance.

[0058] If the control unit 21 determines that the positional relationship calculated by the acquisition unit 20 satisfies the predetermined imaging start condition (step S60; YES), the control unit 21 executes the process of step S70. On the other hand, if the control unit 21 determines that the positional relationship calculated by the acquisition unit 20 does not satisfy the predetermined imaging start condition (step S60; NO), the control unit 21 ends the process.

[0059] Step S70: The control unit 21 transmits an imaging start signal B11 to the imaging device 3. The imaging start signal B11 is a signal for causing the imaging device 3 to start imaging. The imaging start signal B11 is an example of the imaging control signal B1.

[0060] Step S80: The imaging device 3 receives the imaging start signal B11 from the imaging control device 2. Here, the imaging control unit 30 receives the imaging start signal B11.

[0061] Step S90: The imaging device 3 starts imaging. Here, the imaging control unit 30 causes the imaging unit 32 to start imaging based on the received imaging start signal B11. Once imaging starts, the imaging unit 32 continues continuous shooting. The imaging direction of the imaging unit 32 is controlled based on the direction calculated by the tracking unit 31. The imaging control unit 30 stores the image captured by the imaging unit 32 as a captured image C1 in the storage unit 34. With this, the imaging control system 1 ends control at the start of imaging.

[0062] 7 is a diagram showing an example of the control flow at the end of imaging by the imaging control system 1 according to this embodiment. The control at the end of imaging shown in Fig. 7 is executed immediately after step S90 in the control flow at the start of imaging shown in Fig. 6 when imaging is started by the imaging device 3.

[0063] The processes of steps S110, S120, S130, S140, and S150 are similar to the processes of steps S10, S20, S30, S40, and S50 in FIG. 6, and therefore will not be described.

[0064] Step S160: The control unit 21 determines whether the positional relationship calculated by the acquisition unit 20 satisfies the image capture end condition. If the distance between the player and the ball is not equal to or less than a predetermined distance, the control unit 21 determines that the positional relationship satisfies the image capture end condition.

[0065] If the control unit 21 determines that the positional relationship calculated by the acquisition unit 20 satisfies the predetermined imaging end condition (step S160; YES), the control unit 21 executes the process of step S170. On the other hand, if the control unit 21 determines that the positional relationship calculated by the acquisition unit 20 does not satisfy the predetermined imaging end condition (step S160; NO), the control unit 21 ends the process.

[0066] Step S170: The control unit 21 transmits an imaging end signal B12 to the imaging device 3. The imaging end signal B12 is a signal for causing the imaging device 3 to end imaging. The imaging end signal B12 is an example of the imaging control signal B1.

[0067] Step S180: The imaging device 3 receives the imaging end signal B12 from the imaging control device 2. Here, the imaging control unit 30 receives the imaging end signal B12.

[0068] Step S190: The imaging device 3 ends imaging. Here, the imaging control unit 30 causes the imaging unit 32 to end imaging based on the received imaging end signal B12.

[0069] Step S1100: The imaging device 3 transmits the captured image C1 to the imaging control device 2. Here, the imaging control unit 30 reads out the captured image C1 from the storage unit 34. The imaging control unit 30 transmits the read-out captured image C1 to the imaging control device 2. The captured image C1 is a plurality of still images captured by continuous shooting from the start to the end of imaging. With this, the imaging control system 1 ends control at the end of imaging.

[0070] As described above, the control at the start of imaging shown in Fig. 6 is repeatedly executed while the imaging control system 1 is operating. The control at the end of imaging shown in Fig. 7 is executed immediately after step S90 when imaging is started by the imaging device 3 in each of the repeatedly executed controls at the start of imaging.

[0071] In the present embodiment, an example has been described in which the control unit 21 controls the imaging device 3 to capture an image when the positional relationship between the first object and the second object satisfies a predetermined imaging condition, but the present invention is not limited to this. The control unit 21 may also control the imaging device 3 to capture an image when at least one of the position in the space where the object is located, the moving speed of the object, the acceleration of the object, and the moving direction of the object, of at least one of the first object and the second object, satisfies a predetermined imaging condition.

[0072] For example, the imaging condition may be that the position of the noted player or the position of the ball is near the goal (e.g., within the penalty area). Furthermore, in a counter attack scene, the noted player may suddenly change direction of movement, such as by dribbling quickly, or move forcefully toward an attacking direction. Here, the attacking direction refers to the direction of the goal of the opposing team against which the noted player is playing. The imaging condition may also be that the noted player's movement speed or acceleration is equal to or greater than a predetermined value, and that the noted player's movement direction is an attacking direction. As another example, in a counter attack scene, a long pass may be played to a player on the opposing team. The imaging condition may be that the movement speed of the ball is equal to or greater than a predetermined value, the noted player is located on the opposing team's side of the center line, and the noted player's movement speed is equal to or less than a predetermined value.

[0073] Furthermore, the imaging conditions may be set based on at least one of the position of at least one of the first object and the second object in the space in which the object is located, the moving speed of the object, the acceleration of the object, and the moving direction of the object. For example, the imaging conditions may be set so that imaging is performed when the positional relationship between the noted player and the position of the noted player is one meter or less when the noted player is located near the center of the center line, or when the noted player is located near the goal and the positional relationship is five meters or less. In areas near the goal that attract more attention in a soccer match, imaging of the noted player can be started before the player approaches the ball, thereby accelerating the timing at which imaging of the noteworthy (exciting) scene begins.

[0074] The imaging conditions may be set based on both the distance between the first object and the second object and at least one of the position of at least one of the first object and the second object in the space where the object is located, the moving speed of the object, the acceleration of the object, and the moving direction of the object.Furthermore, the imaging conditions may be set based on at least one of the position of at least one of the first object and the second object in the space where the object is located, the moving speed of the object, the acceleration of the object, and the moving direction of the object, instead of the distance between the first object and the second object.

[0075] In the present embodiment, an example has been described in which the positional relationship between the first object and the second object is used as an image capturing condition, but this is not limiting. As a modification of the present embodiment, a case will be described in which the positional relationships between three or more objects are used as an image capturing condition.

[0076] In this modification, the acquisition unit 20 acquires positional relationships among three or more objects including a first object and a second object. For example, the acquisition unit 20 acquires positional relationships among a first object, a second object, and a third object. The first object is a striker player. The second object is a ball. The third object is a goalkeeper.

[0077] The imaging conditions are, for example, that the distance between the striker and the ball is less than a predetermined value, that the distance between the striker and the goalkeeper is less than a predetermined value, and that the distance between the goalkeeper and the ball is less than a predetermined value.

[0078] Fig. 8 is a diagram illustrating another example of imaging conditions according to this modified example. Four images, images P21 to P24, shown in Fig. 8 are images of soccer scenes arranged in chronological order within the field of view of the imaging device 3. Of the multiple players shown in the images, the player that the imaging device 3 tracks is a player of interest X1. The player of interest X1 is a striker.

[0079] In images P21 and P22, the noted player X1 is dribbling toward the goal. The distance between the noted player X1 and the ball Y1 is less than a predetermined distance. On the other hand, the distance between the goalkeeper player X2 and the ball Y1 is not less than a predetermined distance, and the distance between player X2 and the noted player X1 is not less than a predetermined distance. Therefore, image capture has not started.

[0080] In image P23, noted player X1 is about to shoot near the goal where player X2 is standing. The distance between noted player X1 and ball Y1 is less than a predetermined distance. The distance between player X2 and ball Y1 is less than a predetermined distance. The distance between player X2 and noted player X1 is less than a predetermined distance. Because the positional relationships between noted player X1, ball Y1, and player X2 satisfy the imaging conditions, the control unit 21 provided in the imaging control device 2 causes the imaging device 3 to start continuous shooting.

[0081] In image P24, goalkeeper player X2 catches the ball Y1. In image P4, the relative positions of noted player X1, ball Y1, and player X2 satisfy the imaging conditions. Therefore, the continuous shooting by the imaging device 3 continues.

[0082] The acquisition unit 20 may acquire the positional relationship between the third object and at least one of the first object and the second object. For example, consider a case where the acquisition unit 20 starts capturing an image under an imaging condition in which a striker (first object) is dribbling the ball and approaches a goalkeeper (third object). In this case, the acquisition unit 20 may acquire the distance between the striker (first object) and the ball (second object) and the distance between the striker (first object) and the goalkeeper (third object). In other words, the acquisition unit 20 does not need to acquire the distance between the goalkeeper (third object) and the ball (second object).

[0083] The control unit 21 may change the object of interest for at least one of the first object and the second object to another object when the positional relationship between the first object and the second object satisfies a predetermined change condition. The predetermined change condition is, for example, that the first object and the second object are located within a predetermined range and the distance between the first object and the second object changes from a predetermined distance or less to a predetermined distance or more.

[0084] For example, suppose the first object is a striker and the second object is a ball, and the striker takes a shot within the penalty area. In this case, the distance between the striker and the ball within the penalty area changes from a predetermined distance or less to a predetermined distance or more. Because the positional relationship between the first object and the second object satisfies a predetermined change condition, the control unit 21 changes the first object from the striker to the goalkeeper. Therefore, the first object becomes the goalkeeper and the second object becomes the ball. Thereafter, the control unit 21 causes the imaging device 3 to continue taking continuous shots until the distance between the goalkeeper and the ball becomes a predetermined distance or more.

[0085] Note that the goalkeeper may be registered in advance as a candidate for the new first object after the change, and the registered goalkeeper may be changed to the first object when the positional relationship between the first object (striker) and the second object (ball) satisfies a predetermined change condition. Furthermore, in the above example, even if the distance between the striker and the ball changes from less than a predetermined distance to more than a predetermined distance, imaging may be continued for a predetermined period of time without immediately ending when the distance becomes greater than the predetermined distance. By continuing imaging for the predetermined period of time, imaging continues even while the first object is being changed from the striker to the goalkeeper, so imaging can be continued without missing any interesting scenes.

[0086] As in the above-described imaging condition, imaging by the imaging device 3 is controlled when the distance between the featured player and the ball is equal to or less than a predetermined value. The imaging condition in which the distance between the first object and the second object is equal to or less than a predetermined value as described above is also referred to as the first determination condition. The first determination condition reduces the chance of missing a scene in which the featured player is involved with the ball. However, even under the first determination condition, scenes captured may include inconclusive scenes, resulting in a long imaging time. As another example of an imaging condition, a second determination condition such as the following may be set in addition to the first determination condition so that only the most decisive scenes are captured.

[0087] For example, the second determination condition is that at least one of the first object and the second object is located at a specific position in the space where the object is located. In this case, the second determination condition is, for example, that at least one of the featured player and the ball is located within the penalty area. When the imaging condition is satisfied, the control unit 21 controls the imaging device 3 to capture images, thereby increasing the possibility that only the shooting scene will be captured.

[0088] As another example, the second determination condition is that the object's moving speed is in a predetermined direction and is equal to or greater than a predetermined speed. In this case, the second determination condition is, for example, that the ball's moving direction is the noted player's attack direction and the ball's moving speed is equal to or greater than a predetermined speed. When the second determination condition is satisfied, the control unit 21 controls the imaging device 3 to capture images, thereby increasing the likelihood that only counter-attacks or dribbling scenes are captured. Alternatively, the second determination condition may be that the ball's moving direction is the noted player's attack direction and the ball's acceleration is equal to or greater than a predetermined acceleration.

[0089] By capturing images based on both the first and second determination conditions, it is possible to capture only the most decisive scenes. It is possible to set only the first determination condition (i.e., the distance between the target player and the ball must be equal to or shorter than a predetermined distance) as the capture condition, and assign flag information to the captured image C1. When the captured image C1 is played back and reviewed, specific scenes can be extracted from the captured image C1 based on the flag information. The flag information is, for example, information indicating the captured scene. The captured scene includes, for example, scenes such as "inside the penalty area" or "dribbling scenes." By combining the first determination condition with the flag information, filtering can be performed after the capture while reducing the risk of missing shots.

[0090] The control unit 21 records flag information in at least one of the images captured by the imaging device 3. In addition to the captured scene, the flag information may also include imaging conditions, attributes of the first object and the second object, and the start or end time of imaging. The imaging conditions are the imaging start condition and imaging end condition based on the distance between the player and the ball as described above. The attributes of the first object and the second object include, for example, the uniform number of the player.

[0091] Therefore, the control unit 21 records at least one of the imaging conditions, the attributes of the first object and the second object, the imaging start time or end time, and the captured scene in at least one of the images captured by the imaging device 3. By extracting a specific scene, it becomes possible to appropriately extract data in which a desired scene is captured from a large amount of imaging data, or to collectively display the data.

[0092] As described above, the control unit 21 starts imaging by the imaging device 3 when the positional relationship between the first object and the second object acquired by the acquisition unit 20 satisfies the first imaging condition (imaging start condition) as an imaging condition, and ends imaging by the imaging device 3 when the positional relationship satisfies the second imaging condition (imaging end condition) as an imaging condition after starting imaging. The timing for ending imaging may be extended by a predetermined time as follows.

[0093] For example, even if the ball leaves the player of interest and the imaging conditions for ending imaging are met, if the player of interest or the ball is near the goal (for example, inside the penalty area), imaging may continue for a few seconds rather than ending immediately. By continuing imaging for a few seconds, even tense ball fights near the goal can be reliably captured.

[0094] Also, for example, consider a case where the ball moves toward the goal after it leaves the target player. In this case, even if the imaging condition for ending imaging, that is, the distance between the target player and the ball is greater than or equal to a predetermined distance, is met, imaging does not end immediately, but continues for several seconds. A few seconds is, for example, five seconds. This allows reliable imaging of the scene from the shot until a goal is scored, or even after a goal is scored.

[0095] Therefore, even if the positional relationship between the first object and the second object satisfies the second imaging condition, the control unit 21 extends the timing for ending imaging by the imaging device 3 by a predetermined time if at least one of the position in the space in which the object is located, the movement speed of the object, the acceleration of the object, and the movement direction of the object for at least one of the first object and the second object satisfies a predetermined condition.

[0096] As described above, the imaging control device 2 according to this embodiment includes the acquisition unit 20 and the control unit 21. The acquisition unit 20 acquires the positional relationship between the first object and the second object imaged by the imaging device 3. The control unit 21 controls imaging by the imaging device 3. The control unit 21 controls imaging by the imaging device 3 when the positional relationship between the first object and the second object acquired by the acquisition unit 20 satisfies a predetermined imaging condition.

[0097] In ball games such as soccer, it is desirable to capture still images or videos of goals scored or shots taken, but in the past, the timing of the capture depended on the cameraman, which placed a heavy burden on the cameraman and often resulted in the desired scene being missed.

[0098] With the above-described configuration, the imaging control device 2 of this embodiment controls imaging by the imaging device 3 when the positional relationship between the first object and the second object satisfies specified imaging conditions, thereby reducing the chance of failing to capture the desired scene.

[0099] The imaging control device 2 or imaging control system 1 is suitable for use in capturing images of sports scenes such as soccer. A desired scene is, for example, a scene in which a notable player is involved with the ball. In a scene in which a notable player is involved with the ball, the ball and the player are captured together within the angle of view, including, for example, a goal, a shot, or a dribble or pass. Therefore, in this embodiment, an example of a case in which an imaging condition is set such that the distance between the notable player and the ball is equal to or less than a predetermined distance is described.

[0100] Furthermore, when the imaging control system 1 is equipped with multiple imaging devices 3, as in this embodiment, it is possible to automatically obtain still images and videos of desired scenes at multiple angles, thereby reducing the chance of missing an image of a desired scene.

[0101] It should be noted that the imaging control system 1 may be provided with one or more imaging devices 3. The number of imaging devices 3 may be one, two, three, five or more. The same number of imaging devices 3 as the number of objects to be imaged may be provided. For example, the same number of imaging devices 3 as the number of featured players may be provided. Furthermore, as in this embodiment, when the number of imaging devices 3 is less than the number of featured players, the featured players to be tracked and imaged may be changed midway.

[0102] In this embodiment, an example has been described in which one particular featured player is imaged by multiple imaging devices 3, but this is not limiting. A different featured player may be set for each imaging device. In this case, imaging conditions are determined for each imaging device, and imaging control signals B1 are transmitted from the imaging control device 2 to the imaging devices 3 at mutually different timings.

[0103] Second Embodiment A second embodiment of the present invention will be described below in detail with reference to the drawings. In this embodiment, a case will be described in which the imaging device has a pre-capture function. With the pre-capture function, imaging is started before a release command is received, the captured data is temporarily stored, and when a release command is received, the temporarily stored data is also stored in the storage unit as imaging data. The pre-capture function makes it possible to include data captured before a release command is received in the imaging data. In the following description, imaging in which imaging data is stored will also be referred to as full-press imaging, to distinguish it from pre-capture in which captured data is temporarily stored.

[0104] The imaging control system according to this embodiment is referred to as imaging control system 1a. Note that the same components as those in the first embodiment are denoted by the same reference numerals, and descriptions of the same components and operations may be omitted.

[0105] The imaging control system 1a includes an imaging control device 2a, multiple imaging devices 3a, and a coordinate information acquisition system 4. Comparing the imaging control system 1a according to this embodiment with the imaging control system 1 (FIG. 1) according to the first embodiment, the imaging control device 2a and the multiple imaging devices 3a are different. Each of the multiple imaging devices 3a has a pre-capture function.

[0106] Fig. 9 is a diagram showing an example of the functional configuration of an imaging control system 1a according to this embodiment. The imaging control device 2a includes an acquisition unit 20, a control unit 21a, a communication unit 22, a display unit 23, and a storage unit 24. Comparing the imaging control device 2a according to this embodiment (Fig. 9) with the imaging control device 2 according to the first embodiment (Fig. 2), the control unit 21a is different. Here, the functions of the other components (acquisition unit 20, communication unit 22, display unit 23, and storage unit 24) are the same as those of the first embodiment.

[0107] The control unit 21a controls the imaging by the imaging device 3a having a pre-capture function, and controls the full-press imaging by the imaging device 3a and the pre-capture by the imaging device 3a.

[0108] 10 is a diagram showing an example of the functional configuration of an imaging device 3a according to this embodiment. The imaging device 3a includes an imaging control unit 30a, a tracking unit 31, an imaging unit 32, a communication unit 33, a storage unit 34, and a temporary storage unit 35a. Comparing the imaging device 3a according to this embodiment (FIG. 10) with the imaging device 3 according to the first embodiment (FIG. 3), the imaging control unit 30a and the temporary storage unit 35a are different. Here, the functions of the other components (the tracking unit 31, the imaging unit 32, the communication unit 33, and the storage unit 34) are the same as those of the first embodiment.

[0109] The imaging control unit 30a controls the imaging unit 32. The imaging control unit 30a has a pre-capture function that starts imaging before receiving an imaging control signal that controls imaging output from the control unit 21a. In the following description, the imaging control signal is also referred to as a full-press imaging start signal. The imaging control unit 30a stores an image captured by the imaging unit 32 in the temporary storage unit 35a before receiving the full-press imaging start signal, and stores the image stored in the temporary storage unit 35a in the storage unit 34 after receiving the full-press imaging start signal. The temporary storage unit 35a is an example of a first storage unit. The storage unit 34 is an example of a second storage unit.

[0110] The temporary storage unit 35a stores an image captured by the imaging unit 32 before receiving a full-press imaging start signal. The temporary storage unit 35a is configured using a storage device such as a volatile semiconductor storage device, for example.

[0111] [Control flow by imaging control system 1a] Next, the control flow by imaging control system 1a will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of the control flow by imaging control system 1a at the start of imaging according to this embodiment. The control at the start of imaging shown in Fig. 11 is repeatedly executed while imaging control system 1a is operating.

[0112] The processes of steps S210, S220, S230, S240, and S250 are similar to the processes of steps S10, S20, S30, S40, and S50 in FIG. 6, and therefore will not be described further.

[0113] Step S260: The control unit 21a determines whether the positional relationship calculated by the acquisition unit 20 satisfies the pre-capture start condition. For example, the control unit 21a determines that the positional relationship satisfies the pre-capture start condition when the distance between the player and the ball is equal to or less than a predetermined distance. Here, the predetermined distance is, for example, 5 meters or less. The pre-capture start condition is an example of an imaging condition.

[0114] If the control unit 21a determines that the positional relationship calculated by the acquisition unit 20 satisfies the pre-capture start condition (step S260; YES), the control unit 21a executes the process of step S270. On the other hand, if the control unit 21a determines that the positional relationship calculated by the acquisition unit 20 does not satisfy the pre-capture start condition (step S260; NO), the control unit 21a ends the process.

[0115] Step S270: The control unit 21a transmits a pre-capture start signal B21 to the imaging device 3a. The pre-capture start signal B21 is a signal for causing the imaging device 3a to start pre-capture. The pre-capture start signal B21 is an example of the imaging control signal B1.

[0116] Step S280: The imaging device 3a receives the pre-capture start signal B21 from the imaging control device 2a. Here, the imaging control unit 30a receives the pre-capture start signal B21.

[0117] Step S290: The imaging control unit 30a causes the imaging unit 32 to start pre-capture based on the received pre-capture start signal B21. Once pre-capture has started, the imaging unit 32 continues continuous shooting. The imaging control unit 30a causes the images captured by the imaging unit 32 to be stored in the temporary storage unit 35a. Note that in pre-capture, when the number of images stored in the temporary storage unit 35a exceeds a predetermined data amount, the images already stored in the temporary storage unit 35a are deleted in order from the oldest, and newly captured images are stored in the temporary storage unit 35a.

[0118] Step S2100: The control unit 21a determines whether the positional relationship calculated by the acquisition unit 20 satisfies the full-press image capture start condition. For example, the control unit 21a determines that the positional relationship satisfies the full-press image capture start condition when the distance between the player and the ball is equal to or less than a predetermined distance. Here, "equal to or less than a predetermined distance" means, for example, one meter or less. The full-press image capture start condition is an example of an image capture condition.

[0119] If the control unit 21a determines that the positional relationship calculated by the acquisition unit 20 satisfies the full press image capture start condition (step S2100; YES), the control unit 21a executes the process of step S2110. On the other hand, if the control unit 21a determines that the positional relationship calculated by the acquisition unit 20 does not satisfy the full press image capture start condition (step S2100; NO), the control unit 21a ends the process.

[0120] Step S2110: The control unit 21a transmits a full press imaging start signal B22 to the imaging device 3. The full press imaging start signal B22 is a signal for causing the imaging device 3a to start full press imaging. The full press imaging start signal B22 is an example of the imaging control signal B1.

[0121] Step S2120: The imaging device 3a receives the full-press imaging start signal B22 from the imaging control device 2a. Here, the imaging control unit 30a receives the full-press imaging start signal B22.

[0122] Step S2130: The imaging device 3a starts full-press imaging. Here, before causing the imaging unit 32 to start full-press imaging, the imaging control unit 30a causes the imaging unit 32 to end pre-capture and move the images stored in the temporary storage unit 35a to the storage unit 34. Thereafter, the imaging control unit 30a causes the imaging unit 32 to start full-press imaging based on the received full-press imaging start signal B22. Note that the movement of the images stored in the temporary storage unit 35a to the storage unit 34 and the start of full-press imaging by the imaging unit 32 may be performed simultaneously.

[0123] Once imaging begins, the imaging unit 32 continues continuous shooting. The imaging control unit 30a stores the images captured by the imaging unit 32 in the storage unit 34. Therefore, when full-press imaging begins, the image captured by pre-capture before full-press imaging begins and the image captured after full-press imaging begins are stored in the storage unit 34. This completes the imaging start control of the imaging control system 1a.

[0124] The control at the end of imaging in the imaging control system 1a is similar to the control at the end of imaging in the imaging control system 1 according to the first embodiment (FIG. 7), and therefore a description thereof will be omitted.

[0125] As described above, when the distance between the player and the ball is, for example, 5 meters or less, it is determined that the pre-capture start condition is met, and when that distance is, for example, 1 meter or less, it is determined that the positional relationship meets the full press image capture start condition. In other words, the relative positions of the player and the ball differ between the full press image capture start condition and the pre-capture start condition.

[0126] Therefore, in this embodiment, the imaging conditions include a first condition in which the relative positions of the first object and the second object are different from each other, and a second condition. When the positional relationship between the first object and the second object satisfies the first condition, the control unit 21a outputs a first imaging control signal that causes the imaging device 3a to perform a preliminary imaging operation (pre-capture), and when the positional relationship satisfies the second condition, the control unit 21a outputs a second imaging control signal that causes the imaging device 3a to perform an imaging operation. The pre-capture start condition is an example of the first condition. The full-press imaging start condition is an example of the second condition. The pre-capture start signal B21 is an example of the first imaging control signal. The full-press imaging start signal B22 is an example of the second imaging control signal.

[0127] (Modification) As a modification of this embodiment, another example of control at the start of imaging in the imaging control system 1a will be described. Fig. 12 is a diagram showing another example of the flow of control by the imaging control system 1a at the start of imaging according to the modification of this embodiment. The control at the start of imaging shown in Fig. 12 is repeatedly executed while the imaging control system 1a is operating.

[0128] Note that the processes of steps S310, S320, S330, S350, S360, S380, S390, and S3100 are similar to the processes of steps S210, S220, S230, S240, S250, S2110, S2120, and S2130 in FIG. 11, and therefore will not be described further.

[0129] Step S340: The imaging control unit 30a causes the imaging unit 32 to start pre-capture. Once pre-capture has started, the imaging unit 32 continues continuous shooting. The imaging control unit 30a stores the images captured by the imaging unit 32 in the temporary storage unit 35a. In this modified example, the imaging control unit 30a causes the imaging unit 32 to start pre-capture after tracking has been performed. Therefore, the imaging control unit 30a causes the imaging unit 32 to start pre-capture without receiving a pre-capture start signal B21 from the imaging control device 2a.

[0130] Step S370: The control unit 21a determines whether or not the positional relationship calculated by the acquisition unit 20 satisfies the full press image capture start condition. For example, the control unit 21 determines that the positional relationship satisfies the full press image capture start condition when the distance between the player and the ball is equal to or shorter than a predetermined value.

[0131] If the control unit 21a determines that the positional relationship calculated by the acquisition unit 20 satisfies the full press image capture start condition (step S370; YES), the control unit 21a executes the process of step S380. On the other hand, if the control unit 21a determines that the positional relationship calculated by the acquisition unit 20 does not satisfy the full press image capture start condition (step S370; NO), the control unit 21a ends the process.

[0132] This completes the control performed by the imaging control system 1a at the start of imaging. In this modification, the control performed by the imaging control system 1a at the end of imaging is similar to the control performed by the imaging control system 1 according to the first embodiment (FIG. 7), and therefore a description thereof will be omitted.

[0133] As described above, the imaging device 3a has a pre-capture function, but the control unit 21a may control imaging by the imaging device 3a without causing the imaging device 3a to use the pre-capture function. When the pre-capture function is not used, the control at the start of imaging and the control at the end of imaging by the imaging control system 1a are the same as the control at the start of imaging and the control at the end of imaging by the imaging control system 1, respectively.

[0134] Here, when the positional relationship between the first object and the second object satisfies a predetermined imaging condition, if imaging by the imaging device is controlled, the timing to start imaging may be delayed from the desired timing. If the imaging device 3a has a pre-capture function, the pre-capture function can be used in combination with the function to control imaging by the imaging device when the positional relationship between the first object and the second object satisfies a predetermined imaging condition. According to the imaging control device 2a, even if the timing to start imaging is delayed from the desired timing, by including an image captured by the pre-capture function in the captured image, it is possible to reduce the likelihood of missing the desired timing.

[0135] In the above-described embodiments, an example has been described in which the distance between the first object and the second object is calculated by the acquisition unit 20 based on the coordinates indicating the positions of the first object and the second object indicated by the coordinate information A1. However, this is not limiting. The acquisition unit 20 may acquire the distance in the space in which the first object and the second object exist based on the coordinates of the first object and the second object in the image captured by the imaging device 3, 3 a. For example, the acquisition unit 20 calculates the coordinates of the first object and the second object in the captured image based on the panning, tilting, and zoom settings when the image was captured. The acquisition unit 20 calculates the distance in the space in which the first object and the second object exist based on the calculated coordinates.

[0136] In the above-described embodiments, the distance between the first object and the second object is the distance within the space in which the first object and the second object exist, but the present invention is not limited to this. The distance between the first object and the second object may be the distance between areas within the images captured by the imaging devices 3 and 3 a.

[0137] In this case, for example, the control unit 21, 21a determines that the positional relationship between the noted player and the ball satisfies the imaging condition if the distance between the noted player's area and the ball's area in the image captured by the imaging device 3, 3a is equal to or less than a predetermined distance. Therefore, even if the noted player and the ball are located far apart on the pitch, the positional relationship between the noted player and the ball is determined to satisfy the imaging condition if the distance between the noted player's area and the ball's area in the image is close. Note that the control unit 21, 21a uses image recognition to calculate the distance between areas in the image captured by the imaging device 3, 3a.

[0138] In the above-described embodiments, an example has been described in which the positional relationship between the first object and the second object is calculated by the acquisition unit 20 based on the coordinate information A1 acquired from the coordinate information acquisition system 4, but this is not limiting. The positional relationship between the first object and the second object may be calculated by the coordinate information acquisition system 4. In this case, the coordinate information includes information indicating coordinates and information indicating the positional relationship between the first object and the second object. The acquisition unit 20 acquires the positional relationship by acquiring the positional relationship included in the coordinate information output from the coordinate information acquisition system 4.

[0139] In the above-described embodiments, an example in which the imaging device 3, 3a has a tracking function has been described, but this is not limiting. The imaging device 3, 3a does not have to have a tracking function. If the imaging device 3, 3a does not have a tracking function, for example, the imaging control device 2, 2a calculates imaging conditions for tracking and imaging the noted player based on images captured by the imaging device 3, 3a using image recognition. The imaging device 3, 3a tracks the noted player based on the imaging conditions specified by the imaging control device 2, 2a.

[0140] In the above-described embodiments, an example in which still images are continuously captured by the imaging device 3, 3a has been described, but the present invention is not limited to this. The images captured by the imaging device 3, 3a may be moving images. The imaging conditions for capturing moving images are the same as those for continuously capturing still images. When the distance between the target player and the ball becomes equal to or less than a predetermined distance, imaging begins, and when the distance becomes equal to or greater than the predetermined distance, imaging ends. As a result, the captured images are recorded as a short moving image.

[0141] In the above-described embodiments, an example in which a soccer match is captured by the imaging control system 1 or 1a has been described, but the present invention is not limited to this. The imaging control system 1 or 1a may also be used to capture scenes of sports other than soccer, events, etc. In this case, the imaging conditions are set according to the scene to be captured. In addition to sports scenes, the imaging control system 1 or 1a can also be applied to competitive events such as car races.

[0142] Note that a portion of the imaging control device 2, 2a in the above-described embodiment, such as the acquisition unit 20 and the control unit 21, 21a, may be implemented by a computer. In this case, a program for implementing this control function may be recorded on a computer-readable recording medium, and the program may be loaded and executed by a computer system. Note that the term "computer system" as used herein refers to a computer system built into the imaging control device 2, 2a, including hardware such as an OS and peripheral devices. Furthermore, the term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into the computer system. Furthermore, the term "computer-readable recording medium" may also include media that dynamically store programs for a short period of time, such as communication lines used when transmitting programs via networks such as the Internet or telephone lines, or media that store programs for a fixed period of time, such as volatile memory within the computer system that serves as the server or client in such cases. Furthermore, the program may be a program for implementing a portion of the above-described functions, or may be a program that can be implemented in combination with a program already recorded in the computer system. Furthermore, part or all of the imaging control devices 2, 2a in the above-described embodiments may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each functional block of the imaging control devices 2, 2a may be individually implemented as a processor, or part or all of them may be integrated into a processor. Furthermore, the integrated circuit implementation method is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit implementation technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used.

[0143] One embodiment of the present invention has been described in detail above with reference to the drawings, but the specific configuration is not limited to that described above, and various design changes and the like are possible within the scope that does not deviate from the gist of the present invention.

[0144] REFERENCE SIGNS LIST 1, 1a...imaging control system, 2, 2a...imaging control device, 3, 3a...imaging device, 20...acquisition unit, 21, 21a...control unit

Claims

1. An imaging control device comprising: an acquisition unit that acquires a positional relationship between a first object and a second object; and a control unit that controls imaging of at least one of the first object and the second object by an imaging device, wherein the control unit controls imaging by the imaging device when the positional relationship acquired by the acquisition unit satisfies predetermined imaging conditions.

2. The imaging control device according to claim 1, wherein the control unit controls imaging by each of a plurality of imaging devices provided separately from the imaging control device.

3. The imaging control device according to claim 1, wherein the first object is a person and the second object is a non-person object.

4. The imaging control device according to claim 1, wherein the positional relationship is the distance between the first object and the second object, and the control unit controls imaging by the imaging device when the distance between the first object and the second object is equal to or less than a predetermined distance.

5. An imaging control device according to claim 4, wherein the distance between the first object and the second object is the distance between areas in an image captured by the imaging device.

6. The imaging control device according to claim 4, wherein the distance between the first object and the second object is a distance within a space in which the first object and the second object exist.

7. The imaging control device according to claim 6, wherein the acquisition unit acquires the distance within the space in which the first object and the second object exist based on the coordinates of the first object and the second object in an image captured by the imaging device.

8. The imaging control device according to claim 1, wherein the control unit controls imaging by the imaging device when at least one of the position of the object in the space in which it is located, the moving speed of the object, the acceleration of the object, and the moving direction of the object for at least one of the first object and the second object satisfies the specified imaging condition.

9. The imaging control device according to claim 1, wherein the acquisition unit acquires a positional relationship between a third object and at least one of the first object and the second object.

10. The imaging control device according to claim 1, wherein the acquisition unit acquires positional relationships between three or more objects including the first object and the second object.

11. An imaging control device as described in claim 1, wherein when the positional relationship between the first object and the second object satisfies a predetermined change condition, the object of interest for at least one of the first object or the second object is changed to another object.

12. The imaging control device of claim 1, wherein the imaging conditions are set based on at least one of the position of at least one of the first object and the second object in a space in which the object is located, the moving speed of the object, the acceleration of the object, and the moving direction of the object.

13. The imaging control device according to claim 1, wherein the control of imaging by the imaging device is the start of imaging or the end of imaging.

14. The imaging control device according to claim 13, wherein the imaging conditions when imaging is started and the imaging conditions when imaging is ended are different.

15. The imaging control device according to claim 13, wherein the control unit starts imaging by the imaging device when the positional relationship acquired by the acquisition unit satisfies a first imaging condition as the imaging condition, and ends imaging by the imaging device when the positional relationship acquired by the acquisition unit satisfies a second imaging condition as the imaging condition after the start of imaging.

16. The imaging control device according to claim 15, wherein the control unit continues imaging without terminating imaging by the imaging device even if the second imaging condition is satisfied as the imaging condition after imaging has started, and terminates imaging by the imaging device when the time during which the second imaging condition is satisfied exceeds a predetermined time.

17. The imaging control device according to claim 15, wherein the control unit extends the timing for ending imaging by the imaging device by a predetermined time when at least one of the position in the space in which the object is located, the moving speed of the object, the acceleration of the object, and the moving direction of the object, of at least one of the first object and the second object, satisfies a predetermined condition even if the positional relationship satisfies the second imaging condition.

18. An imaging control device as described in claim 1, wherein the imaging device has a pre-capture function that starts imaging before receiving an imaging control signal that controls imaging output from the control unit, and the control unit controls imaging by the imaging device having the pre-capture function.

19. An imaging control device as described in claim 18, wherein the imaging device stores an image captured before receiving the imaging control signal in a first memory unit, and stores the image stored in the first memory unit in a second memory unit after receiving the imaging control signal.

20. The imaging control device according to claim 1, wherein the imaging conditions include a first condition in which the relative positions of the first object and the second object are different from each other, and a second condition, and the control unit outputs a first imaging control signal that causes the imaging device to perform an imaging preparatory operation when the positional relationship satisfies the first condition, and outputs a second imaging control signal that causes the imaging device to perform an imaging operation when the positional relationship satisfies the second condition.

21. The imaging control device according to claim 1, wherein the imaging device has a function of tracking the first object or the second object, and the control unit controls imaging by the imaging device having the tracking function.

22. The imaging control device of claim 21, wherein the imaging device tracks an object based on coordinate information indicating the coordinates in space of the first object or the second object, and the acquisition unit acquires the positional relationship between the first object and the second object based on the coordinates of the first object and the coordinates of the second object indicated by the coordinate information used to track the object.

23. The imaging control device according to claim 1, wherein the control unit records at least one of the imaging conditions, attributes of the first object and the second object, imaging start time or end time, and imaging scene in at least one of the images captured by the imaging device.

24. An imaging control system comprising: an imaging control device according to any one of claims 1 to 23; and an imaging device controlled by the imaging control device.

25. An imaging control method comprising: an acquisition step of acquiring a positional relationship between a first object and a second object; and a control step of controlling imaging of at least one of the first object and the second object by an imaging device, wherein the control step controls imaging by the imaging device when the positional relationship acquired in the acquisition step satisfies a predetermined imaging condition.

26. A program for causing a computer to execute an acquisition step of acquiring a positional relationship between a first object and a second object, and a control step of controlling imaging of at least one of the first object and the second object by an imaging device, wherein the control step controls imaging by the imaging device when the positional relationship acquired in the acquisition step satisfies a predetermined imaging condition.