Control unit and control method for the same
The control device addresses viewer disorientation in live sports streaming by selecting cameras based on object position and priority scoring, ensuring smooth transitions and improved image quality.
Patent Information
- Application Number
- JP2023078700
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-11
- Publication Date
- 2024-11-21
AI Technical Summary
Existing camera selection techniques for live sports streaming fail to provide smooth transitions when a new subject appears, leading to a disjointed viewing experience due to inappropriate camera changes.
A control device that selects a suitable camera for photographing by acquiring object position, status information, generating a camera list excluding the currently distributing camera, and determining the best camera based on position and priority scoring.
Ensures smooth transitions and delivers more engaging images by selecting the appropriate camera for new subjects, reducing viewer disorientation and enhancing the quality of live video distribution.
Smart Images

Figure 2024162794000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to control of photography using multiple cameras. [Background technology]
[0002] In recent years, the demand for online distribution of live video has been increasing. Accordingly, in video production sites, automation and labor-saving of shooting and video editing are progressing. Labor-saving is particularly noticeable in sports broadcasts, which require many people such as cameramen and switchers. For example, efforts are being made to reduce the burden on cameramen by using automatic subject tracking technology and to improve the efficiency of video editing by automatically generating highlight videos.
[0003] One of the issues in live streaming using multiple cameras, such as sports broadcasts, is which camera should be selected to obtain images that are more attractive and powerful to viewers. Patent Document 1 discloses a technology for determining which camera will capture a subject when multiple cameras are used for shooting. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2006-81128 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, in Patent Document 1, the camera that captures the subject is assigned based on the position information of the subject. This can cause problems in use cases such as live sports distribution. For example, when a target object (new subject) to be photographed appears, if the subject is switched without changing the camera used for video distribution, the distributed video will be unnatural to the viewer.
[0006] The present disclosure has been made in consideration of such problems, and has an object to provide a technique for selecting a camera suitable for shooting from a plurality of cameras. [Means for solving the problem]
[0007] In order to solve the above-mentioned problems, the control device according to the present disclosure has the following configuration. That is, the control device for controlling a plurality of cameras for capturing video to be distributed includes: an object position acquisition means for acquiring a position of a target object that is a new subject in a distribution video; a status acquisition means for acquiring status information indicating whether each of the plurality of cameras is a camera currently capturing video to be distributed; a generating means for generating a camera list including one or more cameras that are candidates for photographing the target object based on the state information; a camera position acquisition means for acquiring a position of each camera included in the camera list; a determining means for determining a camera to photograph the target object from among one or more cameras included in the camera list, based on a position of the target object and a position of the camera; having The generating means generates the camera list excluding the camera currently capturing video to be distributed from among the plurality of cameras. Effect of the Invention
[0008] According to the present disclosure, it is possible to provide a technique for selecting a camera suitable for image capture from a plurality of cameras. [Brief description of the drawings]
[0009] [Figure 1] FIG. 2 is a diagram illustrating a hardware configuration of the imaging system. [Diagram 2] FIG. 2 is a diagram illustrating a functional configuration of an information processing device. [Diagram 3] 4 is a flowchart showing an operation of the information processing device. [Figure 4] FIG. 1 is a diagram showing an arrangement of multiple cameras. [Diagram 5] FIG. 13 is a diagram showing an example of a UI screen for selecting a subject. [Figure 6] 4 is a flowchart showing a process of selecting a subject (S301) and a process of acquiring subject information (S302). [Figure 7] FIG. 11 is a diagram illustrating a method for calculating a priority score. [Figure 8] 13 is a flowchart showing a priority score calculation process (S306). [Figure 9] FIG. 11 is a diagram illustrating a shooting situation in the second embodiment. [Figure 10] 13 is a flowchart showing a camera list generation process (S304) (second embodiment). [Figure 11] 13 is a flowchart showing a camera list generation process (S304) (third embodiment). [Figure 12] 13 is a flowchart showing the operation of an information processing device (fourth embodiment). DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the present disclosure according to the claims. Although the embodiments describe a plurality of features, not all of these features are essential to the present disclosure, and the plurality of features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.
[0011] (First embodiment) As a first embodiment of a control device according to the present disclosure, an information processing device that determines a camera that captures video for live streaming will be described below as an example.
[0012] <System configuration> 1 is a diagram showing a hardware configuration of an imaging system. The imaging system includes a camera group 108 including a plurality of imaging devices (cameras), an information processing device 101 communicably connected to the camera group 108, a selection device 109, and a switching device 111.
[0013] The camera group 108 includes a plurality of cameras for capturing images of live streaming, and when capturing images of a soccer match, for example, the cameras are positioned so that the field on which the match is being played can be captured from various viewpoints.
[0014] The selection device 109 is a user terminal such as a tablet or a personal computer (PC), and is a device for the user to select a subject that he or she wishes to photograph. The switching device 111 is a device for switching videos to be distributed, such as a live switcher. The information processing device 101, the camera group 108, the selection device 109, and the switching device 111 are connected to each other via a network 110. Note that the connection form is not particularly limited, and may be, for example, a wired connection using a LAN cable, or a wireless connection such as a wireless LAN.
[0015] Fig. 4 is a diagram showing an example of the arrangement of multiple cameras. In Fig. 4, five cameras (cameras 404-408) are arranged around a field 401, which is an event area where a soccer match is held. Cameras 404-407 are subject to switching control by switching device 111 and are capable of panning, tilting, and zooming. Meanwhile, camera 408 is an overhead camera that captures the entire field 401.
[0016] Player 402 and player 403 are fitted with devices (such as a global positioning system (GPS) receiver) capable of acquiring position information, and information processing device 410 (information processing device 101) is configured to be able to acquire the position information of each player. Note that the method of acquiring the player's position information is not limited to GPS. For example, a method of calculating the position of each player from an overhead image obtained by camera 408 may also be used.
[0017] The information processing device 101 is a computer device such as a PC (personal computer), etc. The information processing device 101 includes a CPU 102, a ROM 103, a RAM 104, a storage unit 105, and a communication unit 106, which are connected to each other via a bus 107.
[0018] The CPU 102 executes a program stored in the ROM 103 and controls the operation of each unit in the information processing device 101. The CPU 102 also loads a program stored in the storage unit 105 into the RAM 104 and executes it, thereby realizing each functional unit described with reference to FIG.
[0019] The ROM 103 is a read-only memory that stores a boot program and firmware. The RAM 104 is a work memory that temporarily stores programs and data for processing by the CPU 102, and various processing programs and data are loaded by the CPU 102.
[0020] The storage unit 105 is a recording medium for storing a large amount of changeable data, such as a hard disk drive (HDD), a solid state drive (SSD), etc. The storage unit 105 stores various processing programs and various data for implementing the functional units described below.
[0021] The communication unit 106 communicates with external devices via the network 110. For example, the information processing device 101 acquires information from the camera group 108 or the selection device 109 via the communication unit 106, and stores the information in the RAM 104 or the storage unit 105. In addition, the information processing device 101 transmits a control instruction via the communication unit 106 to a camera determined to be assigned to shooting, which will be described later.
[0022] 2 is a diagram showing a functional configuration of the information processing device 101. The information processing device 101 has a state acquisition unit 201, a list generation unit 202, a position information acquisition unit 203, a subject reception unit 204, a subject information acquisition unit 205, a priority calculation unit 206, and a camera determination unit 207. As described above, each functional unit can be realized by the CPU 102 executing a program. However, a part or all of the above-mentioned functional units may be realized by dedicated hardware such as an application specific integrated circuit (ASIC). In addition, the information processing device 101 may be configured as a single device, or may be configured by multiple devices connected via a network, for example.
[0023] Status acquisition unit 201 acquires status information about the shooting status of each camera. Here, the status information indicates whether the shot video is being used for distribution, and is acquired from switching device 111.
[0024] A list generating unit 202 generates a list of cameras that can be assigned to shooting, based on the status information acquired by the status acquiring unit 201. A position information acquiring unit 203 acquires the position information of each camera.
[0025] The subject receiving unit 204 receives the designation of a target object (here, a player) to be a new subject to be photographed. The subject information acquiring unit 205 acquires information on the subject received by the subject receiving unit 204 based on an overhead video captured by an overhead camera (camera 408) included in the camera group 108.
[0026] The priority calculation unit 206 calculates a priority score to be assigned to each camera based on the position information of each camera acquired by the position information acquisition unit 203 and the subject information acquired by the subject information acquisition unit 205. The camera determination unit 207 determines the camera to capture the image based on the priority score calculated by the priority calculation unit 206.
[0027] <Device Operation> In the following, an operation will be described in a case where a player 402 (current subject) holding the ball is photographed by a camera 407, and the photographed video is being distributed, and it is decided to photograph a player 403 (new subject) as a new target object. Specifically, a method in which the information processing device 101 decides which camera to use to photograph the player 403 will be described.
[0028] FIG. 3 is a flowchart showing the operation of the information processing device 101 according to the first embodiment.
[0029] In S301, the subject receiving unit 204 receives a designation of a subject. The subject receiving unit 204 acquires from the selection device 109 the subject selected by the user via the selection device 109, as will be described in detail later.
[0030] In S302, the subject information acquisition unit 205 acquires information on the subject accepted in S301. Although details will be described later, the subject information acquisition unit 205 acquires information on the position and movement direction of the subject calculated by the selection device 109 based on the overhead video captured by the camera 408 with respect to the subject selected in S301 from the selection device 109 (object position acquisition).
[0031] In S303, status acquisition unit 201 acquires status information of each camera included in camera group 108. Here, information is acquired as to whether each camera is currently shooting video to be distributed. In S304, status acquisition unit 201 generates a camera list including one or more cameras that are candidates for shooting the subject accepted in S301, based on the status information acquired in S303. Specifically, a camera list is generated that excludes the camera (camera 407 in this case) that is currently shooting video to be distributed out of all cameras (cameras 404 to 407 in this case).
[0032] In S305, the position information acquisition unit 203 acquires the position information of each camera included in the camera group 108 (camera position acquisition). The method of acquiring the position information is not particularly limited. For example, if the installation location of each camera is fixed, the position information may be registered in advance. Alternatively, each camera may be equipped with a GPS receiver, and the position information acquired by the position information acquisition unit 203 may acquire the position information determined by each camera performing positioning.
[0033] In S306, the priority calculation unit 206 calculates a priority score for each camera registered in the camera list generated in S304. Details of the calculation of the priority score will be described later, but the priority score is calculated based on the subject information acquired in S302 and the position information of the camera acquired in S305.
[0034] In S307, the camera determination unit 207 determines the camera with the highest priority score among the cameras registered in the camera list as the camera to be used for shooting. Then, the information processing device 101 instructs the determined camera to shoot. For example, the information processing device 101 instructs the determined camera to perform shooting control such as pan, tilt, and zoom and output video. After that, the switching device 111 switches the camera to be used for distribution.
[0035] <Selecting a subject and obtaining subject information> The subject selection process (S301) and subject information acquisition process (S302) will be described in detail below. Note that, in this description, the subject selection process (S301) and subject information acquisition process (S302) are executed by the selection device 109, and the subject acceptance unit 204 and subject information acquisition unit 205 of the information processing device 101 acquire information from the selection device 109. However, the selection device 109 and the information processing device 101 may be integrated into one device, and the information processing device 101 may directly execute these processes.
[0036] Fig. 5 is a diagram showing an example of a user interface (UI) screen for selecting a subject. The UI screen shown in Fig. 5 is assumed to be displayed on a touch screen 501 of a tablet PC, which is the selection device 109, but is not particularly limited to this. For example, it may be a general PC to which a monitor for displaying images and a mouse for performing input operations are connected.
[0037] A bird's-eye view image captured by a camera 408 capturing the entire field 401 on which a game is being played is displayed on a touch screen 501. A user designates a player to be photographed (a new subject to be photographed) by tapping a player included in the image displayed on the touch screen 501 with a finger or a stylus. If the selection device 109 is a general PC, the user moves the mouse cursor over a player included in the image and clicks the mouse.
[0038] FIG. 6 is a detailed flowchart of the selection device 109 corresponding to the subject selection process (S301) and the acquisition of subject information (S302).
[0039] In S601, the selection device 109 acquires an overhead image captured by the camera 408. In S602, the selection device 109 calculates position information indicating the position tapped by the user on the touch screen 501 (position calculation).
[0040] In S603, the selection device 109 calculates the position information on the field of the player corresponding to the position indicated by the position information acquired in S602 by analyzing the image frames. Note that the position information is position information in a coordinate system that can be associated with the position information of the camera group 108 acquired in S305. In addition, the selection device 109 calculates the moving direction of the player by analyzing a plurality of image frames adjacent in the time axis direction (direction calculation).
[0041] <Calculation of priority score> The calculation process of the priority score (S306) will be described in detail below. Fig. 7 is a diagram for explaining a method of calculating the priority score.
[0042] Fig. 7(a) is a diagram explaining information used in calculating the priority score. In Fig. 7(a), the coordinates indicating the position of the subject player 403 are (x0, y0), and the angle of the moving direction of the player 403 with respect to the reference line is θa. In addition, the coordinates indicating the camera position of the camera 406 included in the three cameras (cameras 404 to 406) registered in the camera list are (x1, y1).
[0043] 8 is a flowchart showing the calculation process of the priority score (S306). Here, it is assumed that a video of an approaching player 403 is to be captured.
[0044] In S801, the priority calculation unit 206 selects one camera. Specifically, it selects one camera registered in the camera list for which calculation of the priority score has not been completed.
[0045] In S802, the priority calculation unit 206 calculates the distance L between the subject (player 403) and the camera based on the position coordinates of the subject and the position coordinates of the camera selected in S801.
[0046] In S803, the priority calculation unit 206 calculates an angle θb between the line segment connecting the position coordinates of the subject (player 403) and the position coordinates of the camera selected in S801 and the reference line. Note that although the reference line is set to the downward direction in FIG. 7(a) here, another reference line may be used.
[0047] In S804, the priority calculation unit 206 calculates the priority score. An example of the calculation formula for the priority score is shown below.
[0048] (Priority score)=(α / L)+(β / |θb-θa|) As described above, there is a request to "shoot a video of the player 403 approaching." Therefore, the priority score is set so that the closer the distance between the subject and the camera is, the higher the score will be, and the closer the camera is to the subject's moving direction, the higher the score will be. Note that α is a weighting coefficient for distance, and β is a weighting coefficient for angle. The user can adjust whether to place greater importance on distance or angle by setting α and β.
[0049] In S805, the priority calculation unit 206 determines whether the priority scores have been calculated for all cameras registered in the camera list. If the priority score calculation for all cameras has been completed, this flow ends. If not, the process returns to S801.
[0050] 8B is an example of the priority scores calculated for three cameras (cameras 404 to 406) included in the camera list. Note that camera 407 is currently being used for video distribution, and is excluded from the camera list generated in S304, so it is not included in the priority score calculation. In Fig. 8(b), camera 406 has the highest priority score, so in S307, camera 406 is determined to be the camera to be used to shoot player 403. Thereafter, the information processing device 101 instructs camera 406 to perform pan / tilt / zoom control suitable for shooting player 403 and output video. Thereafter, the switching device 111 switches the camera to be used for distribution from camera 407 to camera 406.
[0051] As described above, according to the first embodiment, when a new subject is to be photographed using multiple cameras, a camera suitable for photographing the new subject is selected from a camera list excluding the camera currently being used for video distribution. This control makes it possible to reduce the distribution of video that is unnatural to the viewer. It also makes it possible to distribute more powerful video to the viewer.
[0052] Second embodiment In the second embodiment, another method of the camera list generation process (S304) will be described. In sports such as soccer, where two different teams attack each other's ends (positions), if end reversal (left-right reversal) occurs in the distributed video, it will be unsightly for viewers. Therefore, in the second embodiment, a form will be described in which a camera list is generated excluding cameras that cause end reversal, and a camera to be used for shooting is determined.
[0053] Fig. 9 is a diagram for explaining the shooting conditions in the second embodiment. First, a specific example of a case where an end reversal occurs will be explained with reference to Figs. 9(a) and 9(b). First, assume that an image 901 shot by the camera 406 is distributed to a viewer terminal. In the image 901, a player 903 is shown in close-up running to the right toward the opponent team's end.
[0054] Now, suppose that the video to be distributed is switched from video 901 from camera 406 to video 902 from camera 404. Because camera 404 is shooting from the opposite side of the field to camera 406, video 902 shows a close-up of player 903 running leftward toward the opposing team's end. In other words, when switching from video 901 to video 902, even though player 903 continues to run toward the opposing team's end, the direction of the "opponent team's end" in the distributed video changes (reversed left and right), confusing the viewer.
[0055] Therefore, in the second embodiment, in the camera list generation process (S304), a camera list is generated taking into consideration the position / shooting direction of each camera. Note that the hardware configuration of the shooting system and the functional configuration of the information processing device are similar to those in the first embodiment, and therefore their explanations are omitted. Also, the overall operation of the information processing device 101 is similar to that in the first embodiment, and therefore their explanations are omitted.
[0056] FIG. 10 is a flowchart showing the camera list generation process (S304) in the second embodiment.
[0057] In S1001, the status acquisition unit 201 generates a camera list based on the status information of each camera acquired in S303. The process is the same as in S304.
[0058] In S1002, the status acquisition unit 201 acquires position information of the camera currently distributing video. In the example of Fig. 9, the position information of the camera 406 is acquired. In addition, in S1003, the status acquisition unit 201 acquires position information of each camera in the camera list. In the example of Fig. 9, the position information of the cameras 404, 405, and 407 is acquired.
[0059] In S1004, the status acquisition unit 201 compares the position information acquired in S1002 with the position information of each camera acquired in S1003. Then, it excludes cameras on the opposite side of the field (opposite side) from the camera position acquired in S1002. That is, if the camera currently distributing video is located on the back stand side, it excludes cameras on the main stand side. Also, if the camera currently distributing video is located on the main stand side, it excludes cameras on the back stand side. Therefore, the camera list includes only cameras on the same side.
[0060] In the priority score calculation process (S306), the position information of the subject is acquired, and the priority score of the camera closer to the subject is calculated to be higher.
[0061] As described above, according to the second embodiment, it is possible to prevent a situation in which the ends of distributed videos are reversed when switching between videos.
[0062] Third embodiment In the third embodiment, still another method of the camera list generation process (S304) will be described. When the post-switching camera is determined according to the above-mentioned embodiment, problems may occur in certain situations such as "a player has the ball in front of the goal and is about to score a goal." For example, when the above-mentioned embodiment is followed, the camera behind the goal may be determined as the post-switching camera. However, a video producer (such as a person operating a switcher) may want to reserve the camera behind the goal to capture the moment a goal is scored, and not want to allocate it to capture the players.
[0063] Therefore, in the third embodiment, a form will be described in which the designation of a camera to be excluded from the camera list is received from a user who is a video producer. Note that the hardware configuration of the shooting system and the functional configuration of the information processing device are similar to those in the first embodiment, and therefore their explanations will be omitted. Also, the overall operation of the information processing device 101 is similar to that in the first embodiment, and therefore their explanations will be omitted.
[0064] FIG. 11 is a flowchart showing the camera list generation process (S304) (third embodiment).
[0065] In S1101, the status acquisition unit 201 generates a camera list based on the status information of each camera acquired in S303. The process is the same as in S304.
[0066] In S1102, the status acquisition unit 201 accepts, from the user, a designation of a camera to be excluded from the camera list. In S1103, the status acquisition unit 201 excludes the camera acquired in S1202 from the camera list generated in S1101.
[0067] As described above, according to the third embodiment, when switching the video, it is possible to prevent the camera determination unit 207 from selecting a specific camera (for example, a camera behind the goal) as the camera after switching. In other words, it is possible to reserve a specific camera for specific shooting (shooting a goal scene).
[0068] The method by which the user specifies a specific camera is not particularly limited. For example, the camera may be specified by a touch operation on the selection device 109. The camera may also be specified by voice input using voice analysis. The camera may also be specified via a device other than the selection device 109.
[0069] (Fourth embodiment) In the fourth embodiment, a form will be described in which the process of calculating the priority score and the process of determining the camera to be used for shooting are executed again, triggered by the passage of time and position information of the subject.
[0070] In the above embodiment, once a camera is assigned to capture a certain subject, the camera continues to capture the subject. However, in sports such as soccer and basketball, the subject player is moving, and so continuing to capture the subject player may cause problems.
[0071] For example, if a camera that captures a subject is installed at the same height as the player's viewpoint, if the subject (a specific player) moves farther away from the camera, there is a higher possibility that the subject will be blocked by other players.
[0072] Therefore, in the fourth embodiment, calculation of the priority score and determination of the camera are repeatedly performed to update the camera used for distribution. Note that the hardware configuration of the imaging system and the functional configuration of the information processing device are the same as those in the first embodiment, and therefore the description thereof will be omitted.
[0073] <Device Operation> 12 is a flowchart showing the operation of the information processing device 101 according to the fourth embodiment. Here, it is assumed that a subject is designated in advance by the selection device 109, and the selection device 109 sequentially calculates information on the position and moving direction of the subject based on an overhead video captured by the camera 408.
[0074] In S1201, the subject information acquisition unit 205 acquires subject information. The processing method is the same as S302. In S1202, the status acquisition unit 201 acquires status information of each camera included in the camera group 108. The processing method is the same as S303. In S1203, the status acquisition unit 201 generates a camera list based on the status information acquired in S1202. The processing method is the same as S304.
[0075] In S1204, the position information acquisition unit 203 acquires position information of each camera included in the camera group 108. The processing method is the same as S305. In S1205, the priority calculation unit 206 calculates a priority score for each camera registered in the camera list generated in S1203. The processing method is the same as S306. In S1206, the camera determination unit 207 determines the camera with the highest priority score among the cameras registered in the camera list as the camera to be used for shooting. The processing method is the same as S307.
[0076] In S1207, the information processing device 101 determines whether or not a predetermined time has elapsed after the processing of S1206. If it is determined that the predetermined time has elapsed, the process proceeds to S1208. Note that the predetermined time may be any time previously set by the user, or may be a time autonomously determined by the information processing device 101 (for example, based on machine learning). In S1208, the subject information acquisition unit 205 acquires information about the subject. The processing method is the same as that of S302.
[0077] In S1209, the information processing device 101 calculates the moving distance of the subject based on the position information of the subject acquired in S1202 and the position information of the subject acquired in S1208. Then, it is determined whether or not the moving distance is equal to or greater than a predetermined distance. If it is determined that the moving distance is equal to or greater than the predetermined distance, the process proceeds to S1202, and if not, the process proceeds to S1210. Note that the predetermined distance may be any distance previously set by the user, or may be a distance autonomously determined by the information processing device 101 (for example, based on machine learning).
[0078] In S1210, the information processing device 101 determines whether or not an end instruction has been given from the user. If an end instruction has been given, this flow ends. If not, the process returns to S1208. The timing and method of the end instruction given by the user are not particularly limited. For example, the instruction may be given by a touch operation on the selection device 109. The instruction may also be given by voice input using voice analysis. The instruction may also be given via a device other than the selection device 109.
[0079] As described above, according to the fourth embodiment, if the subject moves a predetermined distance or more from the position at the time the camera used for the current distribution was determined, the calculation of the priority score and the determination of the camera are executed again. As a result, if the subject moves, the camera used for distribution is updated (changed), making it possible to reduce the occurrence of a situation in which the subject is blocked by another player.
[0080] The disclosure of this specification includes the following control device, control method, and program. (Item 1) A control device for controlling a plurality of cameras for capturing images to be distributed, an object position acquisition means for acquiring a position of a target object that is a new subject in a distribution video; a status acquisition means for acquiring status information indicating whether each of the plurality of cameras is a camera currently capturing video to be distributed; a generating means for generating a camera list including one or more cameras that are candidates for photographing the target object based on the state information; a camera position acquisition means for acquiring a position of each camera included in the camera list; a determining means for determining a camera to photograph the target object from among one or more cameras included in the camera list, based on a position of the target object and a position of the camera; having The generating means generates the camera list excluding the camera currently capturing the distribution video from among the plurality of cameras. A control device comprising: (Item 2) The camera further includes a control unit that controls the camera selected by the selection unit to capture an image of the target object, The shooting control includes at least one control of pan, tilt, and zoom. 2. The control device according to item 1, (Item 3) The cameras are positioned at different locations around an event area where an event takes place; The object position acquisition means a reception unit that receives, from a user, a designation of the target object included in an overhead image of the event area captured by an overhead camera different from the plurality of cameras; a position calculation means for calculating a position of the target object based on the designation of the target object accepted by the accepting means and the overhead image; Includes 3. The control device according to item 1 or 2, (Item 4) the object position acquisition means further includes a direction calculation means for calculating a moving direction of the target object based on the overhead view image; The determining means further comprises a calculating means for calculating a priority score for each of the one or more cameras included in the camera list; the priority score is calculated based on a distance between the target object and a camera and an angle of a moving direction of the target object with respect to a line segment connecting the target object and the camera; The determining means determines the camera having the highest priority score as the camera to photograph the target object. 4. The control device according to item 3, (Item 5) The generating means further excludes from the camera list a camera located on an opposite side of the event area from a position of a camera currently capturing a distribution video. 5. The control device according to item 3 or 4, (Item 6) The generating means further excludes a camera designated by a user from the camera list. 5. The control device according to item 3 or 4, (Item 7) the object position acquisition means is configured to acquire the position of the target object at predetermined time intervals; The camera further includes an update means for updating the camera for photographing the target object by operating the object position acquisition means, the generation means, and the determination means again when the target object moves by a predetermined distance or more after the camera for photographing the target object has been determined. 8. The control device according to any one of items 1 to 7, (Item 8) A control method for a control device that controls a plurality of cameras for capturing video to be distributed, comprising the steps of: an object position acquisition step of acquiring a position of a target object that is a new subject in the distribution video; a status acquisition step of acquiring status information indicating whether each of the plurality of cameras is a camera currently capturing video to be distributed; a generating step of generating a camera list including one or more cameras that are candidates for photographing the target object based on the state information; a camera position acquisition step of acquiring a position of each camera included in the camera list; a determination step of determining a camera to photograph the target object from among one or more cameras included in the camera list based on the position of the target object and the position of the camera; Including, In the generating step, the camera list is generated by excluding the camera currently capturing the distribution video from among the plurality of cameras. A control method comprising: (Item 9) A program for causing a computer to execute the control method described in item 8.
[0081] (Other Examples) The present disclosure can also be realized by a process in which a program for implementing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more functions.
[0082] The present disclosure is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to disclose the scope of the invention. [Explanation of symbols]
[0083] 101 information processing device; 108 camera group; 109 selection device; 111 switching device; 201 status acquisition unit; 202 list generation unit; 203 position information acquisition unit; 204 subject reception unit; 205 subject information acquisition unit; 206 priority calculation unit; 207 camera determination unit
Claims
1. A control device for controlling a plurality of cameras for capturing images to be distributed, an object position acquisition means for acquiring a position of a target object that is a new subject in a distribution video; a status acquisition means for acquiring status information indicating whether each of the plurality of cameras is a camera currently capturing video to be distributed; a generating means for generating a camera list including one or more cameras that are candidates for photographing the target object based on the state information; a camera position acquisition means for acquiring a position of each camera included in the camera list; a determining means for determining a camera to photograph the target object from among one or more cameras included in the camera list, based on a position of the target object and a position of the camera; having The generating means generates the camera list excluding the camera currently capturing the distribution video from among the plurality of cameras. A control device comprising:
2. The camera further includes a control unit that controls the camera selected by the selection unit to capture an image of the target object, The shooting control includes at least one control of pan, tilt, and zoom. The control device according to claim 1 .
3. The cameras are positioned at different locations around an event area where an event takes place; The object position acquisition means a reception unit that receives, from a user, a designation of the target object included in an overhead image of the event area captured by an overhead camera different from the plurality of cameras; a position calculation means for calculating a position of the target object based on the designation of the target object accepted by the accepting means and the overhead image; Includes The control device according to claim 1 .
4. the object position acquisition means further includes a direction calculation means for calculating a moving direction of the target object based on the overhead view image; The determining means further comprises a calculating means for calculating a priority score for each of the one or more cameras included in the camera list; the priority score is calculated based on a distance between the target object and a camera and an angle of a moving direction of the target object with respect to a line segment connecting the target object and the camera; The determining means determines the camera having the highest priority score as the camera to photograph the target object.
4. The control device according to claim 3.
5. The generating means further excludes from the camera list a camera located on an opposite side of the event area from a position of a camera currently capturing a distribution video.
4. The control device according to claim 3.
6. The generating means further excludes a camera designated by a user from the camera list.
4. The control device according to claim 3.
7. the object position acquisition means is configured to acquire the position of the target object at predetermined time intervals; The camera further includes an update means for updating the camera for photographing the target object by operating the object position acquisition means, the generation means, and the determination means again when the target object moves by a predetermined distance or more after the camera for photographing the target object has been determined. The control device according to claim 1 .
8. A control method for a control device that controls a plurality of cameras for capturing video to be distributed, comprising the steps of: an object position acquisition step of acquiring a position of a target object that is a new subject in the distribution video; a status acquisition step of acquiring status information indicating whether each of the plurality of cameras is a camera currently capturing video to be distributed; a generating step of generating a camera list including one or more cameras that are candidates for photographing the target object based on the state information; a camera position acquisition step of acquiring a position of each camera included in the camera list; a determining step of determining a camera to photograph the target object from among one or more cameras included in the camera list based on the position of the target object and the position of the camera; Including, In the generating step, the camera list is generated by excluding the camera currently capturing the distribution video from among the plurality of cameras. A control method comprising:
9. A program for causing a computer to execute the control method according to claim 8.
Citation Information
Patent Citations
Photographing system, karaoke system, and photographing method
JP2006081128A
