Imaging control device, imaging apparatus, video distribution system, imaging control method, program, and storage medium

The imaging control device in video distribution systems adjusts zoom and imaging direction based on distribution status to maintain video quality and smooth tracking, addressing the challenge of cameras not currently distributing video.

JP2025182080APending Publication Date: 2025-12-11CANON KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2025169104
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-10-07
Publication Date
2025-12-11

AI Technical Summary

Technical Problem

In video distribution systems using automatic tracking technology, cameras not currently distributing video face the challenge of maintaining video quality while continuing smooth tracking.

Method used

An imaging control device that acquires distribution status and adjusts zoom and imaging direction based on the distribution status, using a detection means to identify subjects and control the imaging device accordingly.

Benefits of technology

Enables high-quality video distribution with smooth subject tracking by adjusting camera parameters based on distribution status, ensuring viewers receive uninterrupted and high-quality footage.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025182080000001_ABST
    Figure 2025182080000001_ABST
Patent Text Reader

Abstract

To appropriately control an imaging apparatus that generates video data for distribution.SOLUTION: An imaging control device 200 has acquisition means 201 for acquiring a distribution status of video data generated by an imaging apparatus 100, and control means 201 for controlling the zoom of the imaging apparatus. The control means changes the zoom value according to the distribution status. It also has detection means 206 for detecting subjects from the video data. The control means controls the imaging direction of the imaging apparatus according to a position of the detected subject, and changes parameters for controlling the imaging direction according to the distribution status.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an imaging control technique used in a video distribution system that distributes video data generated by an imaging device (camera). [Background technology]

[0002] In video distribution systems like the one described above, automatic tracking technology is sometimes used, which controls the camera to automatically track a specific subject detected by AI (Artificial Intelligence). Users can use a switcher to broadcast footage from the camera that is automatically tracking the subject. In this case, because viewers will be watching the footage from the camera that is currently being broadcast, camera control is required that does not impair video quality.

[0003] Patent document 1 discloses camera control in which a camera acquires the video usage status from a switcher, and when video from the camera is being distributed, the pan and tilt drive speed is limited to prevent the quality of the video being distributed from being impaired. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-34824 Summary of the Invention [Problem to be solved by the invention]

[0005] On the other hand, in a video distribution system using automatic tracking technology, it is necessary for cameras that are not currently distributing video to not only not lose video quality but also to continue automatic tracking smoothly.

[0006] The present invention provides an imaging control device and the like that are capable of appropriately controlling an imaging device that generates video data to be distributed. [Means for solving the problem]

[0007] An imaging control device according to one aspect of the present invention includes an acquisition means for acquiring a distribution status of video data generated by an imaging device, and a control means for controlling the zoom of the imaging device. The control means changes the zoom value depending on the distribution status. Another aspect of the present invention includes an imaging control device including an acquisition means for acquiring a distribution status of video data generated by the imaging device, a detection means for detecting a subject from the video data, and a control means for controlling the imaging direction of the imaging device depending on the position of the detected subject. The control means changes parameters for controlling the imaging direction depending on the distribution status. Note that an imaging device having the above-described imaging control device also constitutes another aspect of the present invention.

[0008] Another aspect of the present invention provides an imaging control method comprising the steps of acquiring a distribution status of video data generated by an imaging device and controlling a zoom value of the imaging device. The zoom control step is characterized by changing the zoom value according to the distribution status. Another aspect of the present invention provides an imaging control method comprising the steps of acquiring a distribution status of video data generated by the imaging device, detecting a subject from the video data, and controlling an imaging direction of the imaging device according to the position of the detected subject. The imaging direction control step is characterized by changing a parameter for controlling the imaging direction according to the distribution status. Note that a program for causing a computer to execute each of the above imaging control methods also constitutes another aspect of the present invention. [Effects of the Invention]

[0009] According to the present invention, it is possible to appropriately control an imaging device that generates video data to be distributed. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram showing an overview of a video distribution system according to a first embodiment. [Figure 2]FIG. 1 is a block diagram showing the configuration of a video distribution system according to a first embodiment. [Figure 3] 10 is a flowchart showing a subject tracking process of the workstation in the first embodiment. [Figure 4] 4 is a flowchart showing a subject tracking process of the camera in the first embodiment. [Figure 5] 5A and 5B are diagrams illustrating tracking sensitivity and pan / tilt control amount in the first embodiment. [Figure 6] 10 is a flowchart showing a subject tracking process of the workstation. [Figure 7] FIG. 10 is a diagram showing an overview of a video distribution system according to a second embodiment. [Figure 8] FIG. 10 is a block diagram showing the configuration of a video distribution system according to a second embodiment. [Figure 9] 10 is a flowchart showing a subject tracking process of the camera in the second embodiment. [Figure 10] FIG. 10 is a diagram showing an overview of a video distribution system according to a third embodiment. [Figure 11] FIG. 10 is a block diagram showing the configuration of a video distribution system according to a third embodiment. [Figure 12] 11 is a flowchart showing a subject tracking process by a controller in the third embodiment. [Figure 13] 11 is a flowchart showing a subject tracking process of the camera in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [Example]

[0012] [Configuration of video distribution system 10] FIG. 1 shows a video distribution system according to a first embodiment of the present invention. The video distribution system 10 is configured with cameras 100 (100a, 100b) as multiple imaging devices, each capturing an image of a scene including a subject 20, a workstation 200, and a switcher 300. The cameras 100 and the workstations 200 are connected to each other via a network 400 so that they can communicate with each other. Any connection method or communication protocol may be used. The cameras 100 and the workstations 200 may also be directly connected using a communication cable without using the network 400. The number of cameras 100 may be three or more.

[0013] Workstation 200, which serves as an imaging control device, controls the operation of each camera 100 by transmitting, via network 400 (or a communication cable), video request commands that request each camera 100 to transmit a video stream as video data and setting commands that instruct the setting of various parameters. Each camera 100 transmits a video stream to workstation 200 via the video cable (or network 400) in response to the video request command, and stores various parameters in response to the setting command. Workstation 200 also transmits commands to control pan, tilt, and zoom to each camera 100 via network 400 (or a communication cable), thereby controlling the orientation and size of the imaging angle of view of each camera 100 in the pan and tilt directions.

[0014] The multiple cameras 100 and the multiple video input units of the switcher 300 are connected by video cables, and the video streams output by each camera 100 are input to the switcher 300. The switcher 300 selects, from the video streams from the multiple cameras 100, a video stream to be distributed to an external device (not shown) for viewing (hereinafter referred to as distributed video) and a video stream to be distributed to the external device after the distributed video (hereinafter referred to as preview video). The cameras 100 and the switcher 300 are connected to each other via a network 400 so that they can communicate with each other. Any connection format or communication protocol may be used. The cameras 100 and the switcher 300 may also be directly connected using a communication cable without going through the network 400.

[0015] The switcher 300 can transmit selection commands to the multiple cameras 100 to notify the cameras that acquire distribution video (hereinafter referred to as distribution cameras) and cameras that acquire preview video (hereinafter referred to as preview cameras) that they have been selected. A camera that receives a selection command indicating a distribution camera turns on its distribution lamp 30, and a camera that receives a selection command indicating a preview camera turns on its preview lamp 40. The switcher 300 can also transmit selection commands to cameras (hereinafter referred to as standby cameras) that acquire a video stream that is not distribution video or preview video (hereinafter referred to as standby video) among the multiple cameras 100 to notify the standby camera that they have been selected. Standby video is video that is neither distribution video nor preview video. It is also possible to change standby video into distribution video. A camera that receives a selection command indicating a standby camera turns off its distribution lamp 30 and preview lamp 40.

[0016] In this embodiment, the video distribution status refers to which of the multiple cameras 100 are selected as distribution cameras, preview cameras, and standby cameras, i.e., which cameras' video data is selected as distribution video, preview video, and standby video. The video distribution status can also be described as the usage status of the video data. The state in which a video is selected (used) as distribution video corresponds to the distribution state, and the state in which a video is selected as standby video (waiting for distribution) corresponds to the standby state. Furthermore, the state in which a video is selected as preview video (which can become distribution state before standby state) corresponds to the preview state.

[0017] The workstation 200 can acquire information indicating the current video distribution status of each camera (hereinafter referred to as distribution status information) by transmitting a command to the multiple cameras 100 to inquire about the current video distribution status.

[0018] FIG. 2 shows the configuration of a camera 100, a workstation 200, and a switcher 300 in the video distribution system of this embodiment.

[0019] [Camera 100 Configuration] The camera 100 has a CPU 101, a RAM 102, a ROM 103, an imaging unit 104, a video output unit 105, a communication unit 106, a PTZ control unit 107, and a distribution status display unit 108, which are interconnected via an internal bus 109.

[0020] The CPU 101 controls the overall operation of the camera 100. The RAM 102 serves as a work memory and temporarily stores control programs and data. The ROM 103 stores the control programs executed by the CPU 101. The imaging unit 104 photoelectrically converts an optical image formed by an optical system using an imaging element, and generates video data from an output signal from the imaging element. The imaging element is composed of a photoelectric conversion element such as a CMOS (Complementary Metal Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor.

[0021] The video output unit 105 is an interface for outputting video data generated by the imaging unit 104 to the outside, and is configured with an SDI (Serial Digital Interface) or an HDMI (High-Definition Multimedia Interface) (registered trademark), etc. The communication unit 106 performs network communication with external devices. In this embodiment, the communication unit 106 communicates with the workstation 200 and the switcher 300.

[0022] The PTZ (Panoramac Tilt Zoom) control unit 107 includes a zoom drive unit that drives the optical system of the imaging unit 104 to change the size of the imaging angle of view, and a pan / tilt drive unit that pans and tilts the imaging unit 104 to change the orientation of the imaging angle of view (imaging direction). In this embodiment, optical zoom is performed by driving the optical system of the imaging unit 104, but electronic zoom that enlarges and reduces video data may also be performed.

[0023] The distribution status display unit 108 includes the streaming lamp 30 and the preview lamp 40 shown in FIG. 1 , which light up to notify the user that the camera has been selected as a streaming camera or a preview camera based on instructions from the CPU 101. When the CPU 101 receives a selection command from the switcher 300 via the communication unit 106 indicating that the camera has been selected as a streaming camera or a preview camera, the CPU 101 instructs the distribution status display unit 108 to turn on the corresponding lamp. For example, if the camera has been selected as a streaming camera, the CPU 101 turns on the streaming lamp 30 in red, and if the camera has been selected as a preview camera, the CPU 101 turns on the preview lamp 40 in green. Furthermore, when the CPU 101 receives a selection command indicating that the camera has been selected as a standby camera, the CPU 101 instructs the distribution status display unit 108 to turn off the streaming lamp 30 and the preview lamp 40. The CPU 101 stores the received selection command in the RAM 102 as a current selection command, and also stores the previous selection command that was previously received and stored in the RAM 102 as a previous command.

[0024] [Workstation 200 Configuration] The workstation 200 includes a CPU 201 , a RAM 202 , a ROM 203 , a communication unit 204 , a video input unit 205 , an inference unit 206 , and a user input I / F 207 , which are interconnected via an internal bus 208 .

[0025] The CPU 201, which serves as an acquisition means and control means, controls the overall operation of the workstation 200. The RAM 202 serves as work memory and temporarily stores control programs and data. The ROM 203 is a non-volatile storage device, such as a flash memory, HDD, SSD, or SD card, and is used as a permanent storage area for the OS, various programs, and various data, as well as a short-term storage area for various data.

[0026] A communication unit 204 performs network communication with external devices. In this embodiment, the communication unit 204 communicates with the camera 100. A video input unit 205 is an interface for receiving video data from the camera 100, and is configured with SDI or HDMI.

[0027] The inference unit 206 as a detection means is configured with a GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), etc., and executes inference processing to estimate (detect) the presence or absence and position of a specific object from video data received from the video input unit 205, etc. Note that the inference processing performed by the inference unit 206 may be performed by the CPU 201.

[0028] The user input I / F 207 is an interface such as a USB (Universal Serial Bus) to which input devices such as a mouse, keyboard, and touch panel are connected, and transmits to the CPU 201 instructions corresponding to user operations on the input devices.

[0029] [Switcher 300 Configuration] The switcher 300 includes a CPU 301 , a RAM 302 , a video input unit 303 , a video switch control unit 304 , a video output unit 305 , a user input I / F 306 , and a communication unit 307 , which are interconnected via an internal bus 308 .

[0030] The CPU 301 controls the overall operation of the switcher 300. The RAM 302 serves as a work memory and temporarily stores control programs and data.

[0031] The video input units 303 (A303a, B303b) are interfaces for receiving video data from the cameras 100, and are configured using SDI or HDMI. The video input unit A303a receives video data from the camera 100a, and the video input unit B303b receives video data from the camera 100b. The number of video input units 303 only needs to correspond to the number of cameras 100, and may be three or more.

[0032] The video switch control unit 304 outputs video data selected by a user input I / F 306 (to be described later) from the plurality of video data input to the video input unit 303 to a video output unit 305 (to be described later).

[0033] The video output unit 305 is an interface for outputting video data to a live distribution device or a program recording device (not shown), and is configured with SDI or HDMI.

[0034] User input I / F 306 is an interface for accepting user operations on switcher 300, and is configured with buttons, dials, a joystick, a touch panel, etc. In response to a user's operation to switch the video distribution status via user input I / F 306, CPU 301 selects video data to be used for distribution video or video data to be used for preview video from the video data input from camera 100 input to video input unit 303. CPU 301 then instructs video switch control unit 304 to switch the video data to be output in accordance with the selection result. For example, when the video data input to video input unit A 303a is selected as distribution video and the video data input to video input unit B 303b is selected as preview video, and an operation to switch these video data inversely is performed, CPU 301 operates as follows. First, CPU 301 transmits a selection command to camera 100a connected to video input unit A 303a via communication unit 307, notifying that camera 100a has been selected as the preview camera (the video data from camera 100a is selected as the preview video). Furthermore, a selection command is transmitted to camera 100b connected to video input unit 303b via communication unit 307, notifying that camera 100b has been selected as the distribution camera (video data from camera 100b will be used as video to be distributed). Next, CPU 301 stores in RAM 302 data indicating the video distribution status after the switch, in which the video data from camera 100a is used as preview video and the video data from camera 100b is used as video to be distributed.

[0035] [Subject tracking processing] Next, a process will be described in which workstation 200 controls camera 100 to track an object detected from video data from camera 100. The flowchart in Fig. 3 shows the object tracking process executed by CPU 201 of workstation 200 in accordance with a control program. The flowchart in Fig. 4 shows the object tracking process executed by CPU 101 of camera 100 in accordance with a control program. "S" in the diagram indicates a step.

[0036] The CPU 201 of the workstation 200 starts the processing of FIG. 3 by receiving a command to instruct subject tracking via the communication unit 204 or the user input I / F 207.

[0037] In S301, the CPU 201 checks whether or not a command instructing the end of this process has been received (whether or not to continue the process) via the communication unit 204 or the user input I / F 207. If no command has been received, the process proceeds to S302, and if a command has been received, the process ends.

[0038] In S302 , the CPU 201 receives the video data captured by the camera 100 from the video input unit 205 of the workstation 200 and stores it in the RAM 202 .

[0039] Next, in S303, the CPU 201 reads the video data from the RAM 202 and outputs it to the inference unit 206, causing the inference unit 206 to estimate (determine) the type of subject and the position of the subject in the video data. The inference unit 206 has a trained model created using machine learning such as deep learning, and outputs information indicating the type and position of a subject such as a person as output data from image data as input data, along with a score indicating the likelihood of the information. In this embodiment, the information on the position of the subject is output as coordinates indicating the center of gravity of the subject within the video data. The CPU 201 stores the information indicating the type and position of the subject and the score in the RAM 202.

[0040] Next, in S304, CPU 201 transmits a command to CPU 101 of camera 100 inquiring about the current state of camera 100, and stores camera information, which is a response from camera 100, in RAM 202. The camera information includes information related to the operation of camera 100, such as the maximum, minimum and current angles of pan and tilt, and the maximum, minimum and current angle of view (zoom value) of zoom, and information related to the image, such as the resolution and format of the image data to be output.

[0041] Next, in S305, CPU 201 calculates a control amount for the pan / tilt drive unit for causing camera 100 to track the subject, using the subject position information stored in RAM 202 in S303, tracking sensitivity (described later), and camera information acquired from camera 100 in S304. Then, CPU 201 converts the control amount into a control command in accordance with a protocol previously determined as a method for controlling camera 100, and writes the control amount to RAM 202. The control amount is a value that specifies the drive direction and drive speed for each of pan drive and tilt drive of camera 100. The procedure for calculating the control amount will be described later.

[0042] Next, in S306, the CPU 201 transmits the control command written to the RAM 202 in S305 to the camera 100. Then, the process returns to S301.

[0043] Meanwhile, the CPU 101 of the camera 100 starts processing upon receiving the control command sent by the workstation 200 in S306.

[0044] In step S401, the CPU 101 reads the received control command and writes it to the RAM 102.

[0045] Next, in S402, the CPU 101 reads out the driving directions and driving speeds of the pan driving and tilt driving from the control command written to the RAM 102 in S401.

[0046] Next, in S403, the CPU 101 derives drive parameters for pan drive and tilt drive based on the values ​​read out in S402. The drive parameters are parameters for controlling the pan drive motor and tilt drive motor included in the PTZ control unit 107. At this time, the received control command may be converted into the drive parameters using a conversion table stored in advance in the RAM 102.

[0047] Next, in S404, the CPU 101 controls the PTZ control unit 107 based on the drive parameters derived in S403. As a result, the camera 100 pans and tilts to change the imaging direction. Then, the CPU 101 ends this process.

[0048] [Calculation of control amount and tracking sensitivity] The calculation method of the control amount in S305 in Fig. 3 will be described. CPU 201 of workstation 200 controls camera 100 so as to bring a target position (for example, the center) within the imaging angle of view closer to the subject position. At this time, CPU 201 calculates the control amount of PTZ control unit 107 of camera 100 required to bring the target position closer to the subject position. Specifically, as shown in Fig. 5, the control amount is calculated by multiplying the distance from the target position to the subject position by a gain equivalent to tracking sensitivity. Tracking sensitivity is a parameter related to the speed of control (change) of the direction of the imaging angle of view relative to the movement of the subject (change in the subject position), that is, the change in the distance from the target position to the subject position.

[0049] The control amount Yp is expressed by the following formula, where Xt is the target position, Xh is the subject position, and K is the gain. Yp=(Xh-Xt)×K 5, when the gain K is set to a standard value, the control amount Yp changes with respect to changes in distance as shown by line 501a, and when a gain K smaller than the standard value is set, the control amount Yp changes gradually with respect to distance as shown by line 501b. When a gain K larger than the standard value is set, the control amount Yp changes sharply with respect to changes in distance as shown by line 501c. In this way, the control amount Yp can be adjusted by changing the gain K.

[0050] Any method for adjusting the control amount may be adopted as long as it performs a steep tracking operation in response to the movement of the subject when the tracking sensitivity is high, and performs a gentle tracking operation in response to the movement of the subject when the tracking sensitivity is low.

[0051] In addition, a blind area may be set near the target position, where panning or tilting is not controlled even if the subject position is detected. In this case, if the tracking sensitivity is high (i.e., if the camera is a preview camera or a standby camera, as described below), the size of the blind area as a parameter may be reduced, and if the tracking sensitivity is low (i.e., if the camera is a distribution camera), the size of the blind area may be increased. Furthermore, a control amount proportional to the tracking sensitivity may be set for the PTZ control unit 107, regardless of the relationship between the target position and the subject position. Furthermore, the absolute value of the difference between the target position and the subject position may be compared with a predetermined threshold, and if the absolute value of the difference is below the threshold, the driving speed of the panning or tilting may be reduced, and if the absolute value of the difference is above the threshold, the driving speed may be increased. In this case, the threshold may be changed depending on the tracking sensitivity. That is, if the tracking sensitivity is high, the threshold may be reduced, and if the tracking sensitivity is low, the threshold may be increased. These methods may also be used in combination.

[0052] [Camera control processing] The flowchart in Figure 6 shows a camera control process (image capture control method) executed by the CPU 201 of the workstation 200 according to a control program, in which the control parameters (hereinafter referred to as camera control parameters) used by the camera 100 to track a subject are changed depending on the video distribution situation.

[0053] In S601, the CPU 201 of the workstation 200 initializes the camera control parameters for tracking a subject. Specifically, the tracking sensitivity, zoom value for zooming in (hereinafter referred to as the zoom-in value), and zoom value for zooming out (hereinafter referred to as the zoom-out value) of each of the distribution camera, preview camera, and standby camera are read from the ROM 203 and stored in the RAM 202.

[0054] The tracking sensitivity of the broadcast camera is lower than that of the preview camera and the standby camera. Alternatively, the tracking sensitivity of the preview camera and the standby camera may be different from each other. For example, the tracking sensitivity of the preview camera may be higher than that of the standby camera.

[0055] Furthermore, the zoom values ​​of the streaming camera and preview camera are zoom-in values, and the zoom value of the standby camera is a zoom-out value. The zoom-in value is a zoom value that is more telephoto than the zoom-out value, and conversely, the zoom-out value is a zoom value that is more wide-angle than the zoom-in value. The zoom-in values ​​of the streaming camera and the preview camera may be different from each other. For example, the zoom-in value of the preview camera may be more wide-angle than the zoom-in value of the streaming camera. Furthermore, the zoom-in value and zoom-out value can also be used in electronic zoom.

[0056] Furthermore, parameter values ​​input by the user via the user input I / F 207 may be used as the initial setting tracking sensitivity, zoom-in value, and zoom-out value.

[0057] In S602, the CPU 201 checks whether or not a command instructing the end of this process has been received (whether or not to continue the process) via the communication unit 204 or the user input I / F 207. If no command has been received, the process proceeds to S603, and if a command has been received, the process ends.

[0058] In S603, the CPU 201 instructs the camera 100 to transmit distribution status information indicating the current video distribution status. Upon receiving this instruction, the CPU 101 of each camera 100 transmits the current distribution status information to the workstation 200. The CPU 201 stores the video distribution status indicated by the acquired current distribution status information in the RAM 202, and stores the already stored video distribution status in the RAM 202 as the previous video distribution status. Note that in this step, the CPU 201 may instruct the switcher 300 (CPU 301) to transmit the current distribution status information, and acquire the current distribution status information from the switcher 300.

[0059] Next, in S604, the CPU 201 compares the current video distribution status stored in the RAM 202 in S603 with the previous video distribution status. If they match (the video distribution status has not changed), the process returns to S602, and if they do not match (the video distribution status has changed), the process proceeds to S605.

[0060] In S605, the CPU 201 determines whether video data from any camera is currently being distributed (i.e., whether any camera is a distribution camera) in the current video distribution status stored in the RAM 202 in S603. If it is a distribution camera, the process proceeds to S606, and if it is a camera other than a distribution camera, the process proceeds to S607.

[0061] In S606, the CPU 201 reads from RAM 202 the tracking sensitivity of the distribution camera that was initially set in S601, sets it as the tracking sensitivity (gain) to be used in calculating the control amount in S305, and stores it in RAM 202. The tracking sensitivity of the distribution camera set in this step is lower than the tracking sensitivity of the preview camera and standby camera that are set in S607, which will be described later. This is to prevent a decrease in video quality due to tracking the movement of the subject being too fast during video distribution. The CPU 201 then proceeds to S610.

[0062] Meanwhile, in S607, the CPU 201 reads from the RAM 202 the tracking sensitivities of the preview camera and standby camera that were initially set in S601, sets them as the tracking sensitivities to be used in calculating the control amount in S305, and stores them in the RAM 202. The tracking sensitivity set in this step is greater than the tracking sensitivity set in S606. This is to allow cameras other than the distribution camera to track the movement of the subject at high speed. The CPU 201 then proceeds to S608.

[0063] In S608, the CPU 201 determines whether video data from any camera is being previewed (i.e., whether any camera is a preview camera) in the current video distribution status stored in the RAM 202 in S603. If it is a preview camera, the process proceeds to S610, and if it is a standby camera other than the preview camera, the process proceeds to S609.

[0064] In S609, the CPU 201 reads the zoom-out value stored in the RAM 202 in S601 and transmits it to the standby camera, instructing it to change the zoom value. Upon receiving this instruction, the CPU 101 of the standby camera causes the imaging unit 104 to zoom to the received zoom-out value via the PTZ control unit 107. This reduces the possibility that the standby camera will lose track of the subject. The zoom speed at this time may be faster than the zoom speed of the distribution camera. The CPU 201 then returns to S602.

[0065] Note that when zooming out the standby camera, the zoom out may be to the minimum zoom value (wide-angle end) without setting a zoom out value in advance. In this case, the CPU 201 of the workstation 200 instructs the CPU 101 of the standby camera to set the zoom value to the minimum. The CPU 201 of the workstation 200 may also determine the zoom value using output data from the inference unit 206.

[0066] In S610, the CPU 201 of the workstation 200 determines whether the current streaming camera or preview camera was the previous standby camera in the previous video streaming status stored in RAM 202 in S603. If it was the previous standby camera, the process proceeds to S611; if not, the process returns to S602.

[0067] In S611, the CPU 201 of the workstation 200 reads the zoom-in value stored in RAM 202 in S601 and transmits it to the current streaming camera or preview camera that was the standby camera previously, instructing it to change the zoom value. Upon receiving this instruction, the CPU 101 of the streaming camera or preview camera that was the standby camera previously causes the imaging unit 104 to zoom to the received zoom-in value via the PTZ control unit 107. This allows the streaming camera and preview camera to capture close-up images of the subject. The zoom speed of the streaming camera in this case may be slower than the zoom speed of the standby camera. This suppresses sudden changes in the angle of view of the streaming video, providing a natural-looking video. The zoom speed of the preview camera may also be set to the same high speed as the standby camera, or may be set to a zoom speed intermediate between that of the streaming camera and the standby camera.

[0068] Note that when zooming in on a streaming camera or preview camera, the zoom value may be returned to the value before the camera was switched to a standby camera (when it was the original streaming or preview camera) without setting a zoom-in value in advance. In this case, before zooming out in S609, the CPU 201 of the workstation 200 inquires of the camera 100 about the zoom value, and stores the zoom value in response in RAM 202. Then, in S611, the CPU 201 reads the zoom value stored in RAM 202 and transmits it to the current streaming or preview camera, instructing it to change the zoom value.

[0069] Furthermore, the CPU 201 of the workstation 200 may determine the zoom value using the output data of the inference unit 206. For example, the CPU 201 may acquire positional information of the four corners of the subject from the inference unit 206 to calculate the size of the subject, and then calculate the zoom value so that the subject will be a predetermined size. This may then be sent to the current distribution or preview camera to instruct it to change the zoom value.

[0070] According to the present embodiment described above, the workstation 200 acquires the video distribution status of the camera 100 and changes the camera control parameters (tracking sensitivity, zoom value, etc.) according to the video distribution status. This allows a video distribution system that performs automatic tracking to provide viewers with high-quality video and to perform smooth subject tracking. In other words, it is possible to appropriately control the camera 100 that generates the video data to be distributed.

[0071] In this embodiment, the case where three types of cameras (a distribution camera, a preview camera, and a standby camera) are used has been described, but two types of cameras (a distribution camera and a standby camera) may also be used. In this case, after the processing of S607 in Fig. 6, the processing of S609 is performed without performing the processing of S608. [Example]

[0072] Next, a second embodiment of the present invention will be described. In the first embodiment, the workstation 200 estimates the subject position from the video data and controls the camera 100 based on the results. In contrast, in this embodiment, the camera 100 has similar estimation and control functions, thereby configuring a video distribution system that does not include a workstation. In other words, the camera 100 includes an imaging control device.

[0073] Fig. 7 shows a video distribution system of this embodiment. Fig. 8 shows the configuration of cameras 100 (100a, 100b) and switcher 300 in the video distribution system of this embodiment. Camera 100 has an inference unit 110 in addition to the components shown in Fig. 2. The configuration of switcher 300 is the same as that of switcher 300 shown in Fig. 2. However, in this embodiment, switcher 300 does not execute the processing shown in Fig. 6.

[0074] FIG. 9 shows the subject tracking process executed by the CPU 101 of the camera 100 in accordance with a control program in this embodiment.

[0075] The CPU 101 starts the processing of FIG. 9 by receiving a command to instruct subject tracking via the communication unit 106.

[0076] In S901, the CPU 101 checks whether or not a command instructing the end of this process has been received (whether or not to continue the process) via the communication unit 106. If no command has been received, the process proceeds to S902, and if a command has been received, the process ends.

[0077] In S902 , the CPU 101 stores the video data captured by the imaging unit 104 in the RAM 102 .

[0078] Next, in S903, the CPU 101 reads the video data from the RAM 202 and outputs it to the inference unit 110, causing the inference unit 110 to estimate (determine) the type of subject and the position of the subject in the video data. The inference unit 110 outputs information indicating the type and position of a subject such as a person as output data from the video data, as well as a score indicating the likelihood of the information and the score, and stores the information indicating the type and position of the subject and the score in the RAM 102, similar to the inference unit 206 shown in FIG.

[0079] Next, in S904, the CPU 101 inquires of the PTZ control unit 107 about the driving status of the camera 100. The driving status of the camera 100 includes the maximum, minimum, and current pan and tilt angles and the maximum, minimum, and current zoom values. The CPU 101 also reads the setting status of the camera 100, such as the resolution and format of the video data, from the RAM 102 and ROM 103.

[0080] Next, in S905, the CPU 101 calculates a control command (control amount) for tracking the subject from the subject position information and tracking sensitivity stored in the RAM 102 in S903 and the driving state of the camera 100 acquired in S904. The method for calculating the control amount is the same as that of S305 in FIG.

[0081] Next, in S906, the CPU 101 derives drive parameters for pan drive and tilt drive from the control command calculated in S905.

[0082] Then, in S907, the CPU 101 controls the PTZ control unit 107 based on the drive parameters derived in S906, thereby panning and tilting the camera 100 to change the imaging direction, and the CPU 101 returns to S901.

[0083] According to this embodiment, the camera 100 can be operated to track a subject without a workstation.

[0084] In this embodiment, the CPU 101 of the camera 100 performs a camera control process similar to the process shown in Figure 6 in the first embodiment, thereby changing the camera control parameters for tracking the subject according to the video distribution status of the camera 100.

[0085] In S601, CPU 101 performs initial setting of camera control parameters. Specifically, the tracking sensitivity, zoom-in value, and zoom-out value of each of the distribution camera, preview camera, and standby camera are read from ROM 103 and stored in RAM 102. Note that parameter values ​​input by the user via a user input I / F (not shown) provided in camera 100 may be used as the initial setting of tracking sensitivity, zoom-in value, and zoom-out value.

[0086] Next, in S602, the CPU 101 checks whether or not a command instructing the end of this process has been received (whether or not to continue the process) via the communication unit 106. If no command has been received, the process proceeds to S603, and if a command has been received, the process ends.

[0087] In S603, the CPU 101 reads out the current video distribution status and the previous video distribution status stored in the RAM 102.

[0088] Next, in S604, the CPU 101 compares the current video distribution status read in S603 with the previous video distribution status. If they match, the process proceeds to S602, and if they do not match, the process proceeds to S605.

[0089] In S605, CPU 101 determines whether video data from any camera is being distributed (i.e., whether any camera is a distribution camera) in the current video distribution status read out in S603. If it is a distribution camera, the process proceeds to S606, and if it is a camera other than a distribution camera, the process proceeds to S607.

[0090] In S606, the CPU 101 reads the tracking sensitivity of the distribution camera that was initially set in S601 from the RAM 102, sets this as the tracking sensitivity (gain) to be used in calculating the control amount in S905, and stores it in the RAM 102. After that, the CPU 201 proceeds to S610.

[0091] In S607, the CPU 101 reads out the tracking sensitivity of the preview and standby cameras initially set in S601 from the RAM 102, sets it as the tracking sensitivity to be used in calculating the control amount in S905, and stores it in the RAM 102. After that, the CPU 201 proceeds to S608.

[0092] In S608, the CPU 101 determines whether video data from any camera is being previewed (i.e., whether any camera is a preview camera) in the current video distribution status stored in the RAM 102 in S603. If it is a preview camera, the process proceeds to S610, and if it is a standby camera other than the preview camera, the process proceeds to S609.

[0093] In S609, the CPU 101 of the standby camera reads out the zoom-out value stored in the RAM 102 in S601, and causes the imaging unit 104 to perform zoom driving to the received zoom-out value via the PTZ control unit 107.

[0094] In S610, the CPU 101 determines whether the current distribution camera or preview camera was the previous standby camera in the previous video distribution status stored in RAM 102 in S603. If it was the previous standby camera, the process proceeds to S611; if not, the process returns to S602.

[0095] In S611, the CPU 101 of the current distribution camera or preview camera that was the standby camera last time reads out the zoom-in value stored in the RAM 102 in S601, and causes the imaging unit 104 to zoom to the received zoom-in value via the PTZ control unit 107.

[0096] In this embodiment, even when the camera 100 is equipped with an automatic tracking function (even if it does not have a workstation), the camera control parameters are changed according to the video distribution situation. This allows viewers to watch high-quality video in a video distribution system that performs automatic tracking, and enables smooth subject tracking. [Example]

[0097] Next, a third embodiment of the present invention will be described. In this embodiment, a controller 600 is provided as an imaging control device instead of the workstation 200 of the first embodiment. In the first and second embodiments, the workstation 200 or the camera 100 controls the camera 100 based on the subject position estimated from the video data, but in this embodiment, the controller 600 operated by a user controls the camera 100. That is, in this embodiment, the camera 100 is controlled so as to automatically track the subject without estimating the subject position from the video data.

[0098] 10 , when the user controls the camera 100 through the controller 600, the video 50 acquired by the camera 100 is displayed on the controller 600 (or a monitor not shown), and the user operates the controller 600 while viewing the video 50. In this case, the video 50 is a distribution video or a preview video from a distribution camera or a preview camera selected by the switcher 300.

[0099] Thereafter, when the standby camera is switched to the distribution camera or the preview camera by switcher 300, if the zoom value of the standby camera is on the telephoto side, there is a high possibility that subject 20 will disappear from video 50 and be lost, and it will take time to re-image subject 20. In this embodiment, even in such cases, it is possible to reduce the possibility of losing the subject, while still being able to distribute high-quality video for viewers to view.

[0100] The camera 100, the switcher 300, and the controller 600 can communicate with each other via a network 400. They may also be connected via a communication cable.

[0101] The controller 600 controls the operation of each camera 100 by transmitting, via the network 400 (or a communication cable), video request commands that request each camera 100 to transmit a video stream and setting commands that instruct the setting of various parameters to each camera 100. Each camera 100 transmits a video stream to the controller 600 via the video cable (or the network 400) in response to the video request command, and stores various parameters in response to the setting command. The controller 600 controls the orientation and size of the imaging angle of view of each camera 100 in the pan and tilt directions by transmitting commands to each camera 100 that control panning, tilting, and zooming.

[0102] 11 shows the configurations of the camera 100, switcher 300, and controller 600 in the video distribution system of this embodiment. The configurations of the camera 100 and switcher 300 are the same as those in the first embodiment.

[0103] The controller 600 includes a CPU 601 , a RAM 602 , a ROM 603 , a communication unit 604 , a display unit 605 , and a user input I / F 606 , which are interconnected via an internal bus 607 .

[0104] The CPU 601 controls the overall operation of the controller 600. The RAM 602 serves as a work memory and temporarily stores control programs and data. The ROM 603 is a non-volatile storage medium such as a flash memory, and is used as a permanent storage area for the OS, various programs, and various data. The ROM 603 is also used as a short-term storage area for various data.

[0105] The communication unit 604 communicates with external devices via a network. In this embodiment, the communication unit 604 communicates with the camera 100. The display unit 605 is configured with a liquid crystal panel, an organic EL panel, or the like, and displays video data acquired from the camera 100 and a screen for setting the controller 600.

[0106] The user input I / F 606 is connected to input devices such as buttons, dials, joysticks, and touch panels provided on the controller 600, and transmits instructions corresponding to user operations on the input devices to the CPU 601. This makes it possible to select a camera to which a control command corresponding to the user's operation on the input device is to be sent, and information regarding the selection of the camera to which the control command is to be sent is stored in the RAM 602.

[0107] The flowchart in Fig. 12 shows the camera control process executed by the CPU 601 of the controller 600 in accordance with a control program. In this embodiment, the camera 100 is controlled based on control commands sent from the controller 600, but the process performed by the camera 100 is the same as that in Fig. 4, and therefore will not be described here.

[0108] The CPU 601 of the controller 600 starts this processing by detecting an operation on an input device (a joystick in this case) of the controller 600 via the user input I / F 606.

[0109] In S1201, the CPU 601 reads the joystick operation by the user.

[0110] Next, in S1202, the CPU 601 acquires the joystick operation direction and operation amount. An example of a joystick is one that outputs analog voltages from variable resistors provided in both the pan and tilt directions. The CPU 601 acquires the operation direction and operation amount by reading digital values ​​obtained by A / D converting the analog voltages output from the joystick. The CPU 601 can also acquire the speed of change of the digital values ​​in a predetermined range, such as 0 to 1023, in both the pan and tilt directions as the joystick operation speed (angular velocity).

[0111] Next, in S1203, the CPU 601 converts the joystick operation direction, operation amount, and operation speed into a control command in accordance with a predetermined protocol, and writes the command to the RAM 602.

[0112] Next, in S1204, the CPU 601 reads the control command and information regarding the selection of the camera to which the control command is to be sent from the RAM 602 in S1203. Then, the CPU 601 sends the control command to the selected camera 100 via the communication unit 604.

[0113] Through the above processing, the panning and tilting of the camera 100 can be controlled in accordance with the user's operation on the controller 600.

[0114] The flowchart in FIG. 13 shows a camera control process (image capture control method) executed by CPU 601 of controller 600 according to a control program, in which camera control parameters for camera 100 to track a subject are changed depending on the video distribution situation.

[0115] In S1301, the CPU 601 performs initial setting of camera control parameters. Specifically, the CPU 601 reads out the zoom-in value and zoom-out value from the ROM 603 and stores them in the RAM 602. Note that parameter values ​​input by the user via an input device connected to the user input I / F 606 may be used as the initial setting zoom-in value and zoom-out value.

[0116] Next, in S1302, the CPU 601 checks whether or not a command instructing the end of this process has been received (whether or not to continue the process) via the communication unit 604 or the user input I / F 606. If no command has been received, the process proceeds to S1303, and if a command has been received, the process ends.

[0117] In S1303, the CPU 601 instructs the camera 100 to transmit the current video distribution status (distribution status information). Upon receiving this instruction, the CPU 101 of the camera 100 transmits the current video distribution status to the controller 600. The CPU 601 of the controller 600 that has received the current video distribution status stores it in the RAM 602. The CPU 601 also stores the already stored video distribution status in the RAM 602 as the previous video distribution status.

[0118] Next, in S1304, the CPU 601 compares the current video distribution status stored in the RAM 602 in S1303 with the previous video distribution status. If they match (the video distribution status has not changed), the process proceeds to S1302, and if they do not match (the video distribution status has changed), the process proceeds to S1305.

[0119] In S1305, the CPU 601 determines whether video data from any camera is waiting (i.e., whether any camera is a standby camera) in the current video distribution status stored in the RAM 602 in S1303. If it is a standby camera, the process proceeds to S1306, and if it is a distribution camera other than the standby camera or the preview camera, the process proceeds to S1307.

[0120] In S1306, the CPU 601 reads the zoom-out value stored in the RAM 602 in S1301 and transmits it to the standby camera to instruct it to change the zoom value. Upon receiving this instruction, the CPU 101 of the standby camera causes the imaging unit 104 to zoom to the received zoom-out value via the PTZ control unit 107. This reduces the possibility that the standby camera will lose track of the subject. The CPU 601 then returns to S1302.

[0121] In this embodiment, the standby camera may be caused to zoom out to the minimum zoom value without setting a zoom-out value in advance. In this case, the CPU 601 instructs the CPU 101 of the standby camera to set the zoom value to the minimum.

[0122] In S1307, the CPU 601 of the controller 600 determines whether the current distribution camera or preview camera was the previous standby camera in the previous video distribution status stored in RAM 602 in S1303. If it was the previous standby camera, proceed to S1308; if not, return to S1302.

[0123] In S1308, the CPU 601 reads the zoom-in value stored in RAM 602 in S1301 and transmits it to the current streaming camera or preview camera that was the standby camera last time, instructing it to change the zoom value. Upon receiving this instruction, the CPU 101 of the streaming camera or preview camera that was the standby camera last time causes the imaging unit 104 to zoom to the received zoom-in value via the PTZ control unit 107. This allows the streaming camera or preview camera to capture a close-up image of the subject. The CPU 601 then returns to S1302.

[0124] Note that when zooming in on a streaming camera or preview camera, the zoom value may be returned to the value before the camera was last switched to a standby camera (when it was the original streaming or preview camera) without setting a zoom-in value in advance. In this case, before zooming out in S1306, the CPU 601 inquires of the camera 100 about the zoom value, and stores the zoom value in response in RAM 602. Then, in S1308, the CPU 601 reads the zoom value stored in RAM 602 and transmits it to the current streaming or preview camera, instructing it to change the zoom value.

[0125] In this embodiment, controller 600 acquires the video distribution status of camera 100 and controls camera 100 based on the acquired video distribution status, but camera 100 may read its own video distribution status and control itself. In this case, CPU 101 of camera 100 reads the tracking sensitivity, zoom-in value, zoom-out value, and current and previous video distribution status of the distribution camera, preview camera, and standby camera stored in RAM 102, and performs processing of S1303 to S1308.

[0126] According to the present embodiment described above, when the camera 100 is controlled in response to a user operation on the controller 600, it is possible to allow the viewer to view high-quality video and to perform smooth subject tracking.

[0127] The above embodiment includes the following configurations.

[0128] (Configuration 1) an acquisition means for acquiring a distribution status of video data generated by an imaging device; a control means for controlling the zoom of the imaging device; The imaging control device is characterized in that the control means changes a zoom value depending on the distribution status. (Configuration 2) a detection means for detecting a subject from the video data; 2. The imaging control device according to configuration 1, wherein the control means controls the zoom value based on the detected subject. (Configuration 3) There are a plurality of the imaging devices, the acquiring means acquires the distribution status of the plurality of pieces of video data generated by the plurality of imaging devices, 3. The imaging control device according to configuration 1 or 2, wherein the control means changes the zoom value of each of the plurality of imaging devices in accordance with the distribution status. (Configuration 4) the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; 4. The imaging control device according to any one of configurations 1 to 3, wherein the control means sets the zoom value to a wider angle in the standby state than in the distribution state. (Configuration 5) the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; The control means When the distribution state is changed to the standby state, the zoom value in the distribution state is stored; 5. The imaging control device according to any one of configurations 1 to 4, wherein when the standby state is changed to the distribution state, the zoom value is changed to the stored zoom value. (Configuration 6) the distribution status includes a distribution state in which the video data is being distributed, a standby state in which distribution is being awaited, and a preview state which may become the distribution state before the standby state; 6. The imaging control device according to any one of configurations 1 to 5, wherein the control means changes the zoom value between the preview state and the standby state. (Configuration 7) 7. The imaging control device according to configuration 6, wherein the control means sets the zoom value to a wider angle in the standby state than in the preview state. (Configuration 8) the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; 8. The imaging control device according to any one of configurations 1 to 7, wherein the control means makes the zoom speed slower in the distribution state than in the standby state. (Configuration 9) a detection means for detecting a subject from the video data; The control means controlling the imaging direction of the imaging device in accordance with the detected position of the subject; 9. The imaging control device according to any one of configurations 1 to 8, wherein a parameter for controlling the imaging direction is changed depending on the distribution status. (Configuration 10) 10. The imaging control device according to configuration 9, wherein the parameter is a sensitivity related to the speed of control of the imaging direction in response to a change in the position of the subject. (Configuration 11) an acquisition means for acquiring a distribution status of video data generated by an imaging device; a detection means for detecting a subject from the video data; a control unit that controls an imaging direction of the imaging device in accordance with the detected position of the subject; The imaging control device is characterized in that the control means changes a parameter for controlling the imaging direction in accordance with the distribution status. (Configuration 12) 12. The imaging control device according to configuration 11, wherein the parameter is a sensitivity related to the speed of control of the imaging direction in response to a change in the position of the subject. (Configuration 13) the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; 13. The imaging control device according to claim 12, wherein the control means sets the sensitivity so that the speed is slower in the distribution state than in the standby state. (Configuration 14) the distribution status includes a distribution state in which the video data is being distributed, a standby state in which distribution is being awaited, and a preview state which may become the distribution state before the standby state; 14. The imaging control device according to any one of configurations 11 to 13, wherein the control means changes the sensitivity between the distribution state and the preview state. (Configuration 15) 15. The imaging control device according to configuration 14, wherein the control means sets the sensitivity so that the speed is slower in the distribution state than in the preview state. (Configuration 16) The control means setting an insensitive area in which the imaging direction is not controlled in response to the movement of the subject; 17. The imaging control device according to any one of configurations 11 to 16, wherein the parameter is the size of the insensitive region. (Configuration 17) the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; 17. The imaging control device according to configuration 16, wherein the control means increases the size of the insensitive area in the distribution state compared to the standby state. (Configuration 18) an imaging unit that captures images and generates video data; 18. An imaging device comprising the imaging control device according to any one of configurations 1 to 17.

[0129] (Other Examples) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0130] The embodiments described above are merely representative examples, and various modifications and alterations are possible to each embodiment when implementing the present invention. [Explanation of symbols]

[0131] 100 cameras 101 CPU 200 workstations 201 CPU 300 Switcher 301 CPU 600 Controller 601 CPU

Claims

1. an acquisition means for acquiring a distribution status of video data generated by an imaging device; a control means for controlling the zoom of the imaging device; The imaging control device is characterized in that the control means changes a zoom value depending on the distribution status.

2. a detection means for detecting a subject from the video data; 2. The imaging control device according to claim 1, wherein the control means controls the zoom value based on the detected subject.

3. There are a plurality of the imaging devices, the acquiring means acquires the distribution status of the plurality of pieces of video data generated by the plurality of imaging devices, 2. The imaging control device according to claim 1, wherein the control means changes the zoom value of each of the plurality of imaging devices in accordance with the distribution status.

4. the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; 2. The imaging control device according to claim 1, wherein the control means sets the zoom value to a wider angle in the standby state than in the distribution state.

5. the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; The control means When the distribution state is changed to the standby state, the zoom value in the distribution state is stored; 2. The imaging control device according to claim 1, wherein when the standby state is changed to the distribution state, the zoom value is changed to the stored zoom value.

6. the distribution status includes a distribution state in which the video data is being distributed, a standby state in which distribution is being awaited, and a preview state which may become the distribution state before the standby state; 2. The imaging control device according to claim 1, wherein the control means changes the zoom value between the preview state and the standby state.

7. 7. The imaging control device according to claim 6, wherein the control means sets the zoom value in the standby state to a wider angle side than in the preview state.

8. the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; 2. The imaging control device according to claim 1, wherein the control means makes the zoom speed slower in the distribution state than in the standby state.

9. a detection means for detecting a subject from the video data; The control means controlling the imaging direction of the imaging device in accordance with the detected position of the subject; 2. The imaging control device according to claim 1, wherein a parameter for controlling the imaging direction is changed depending on the distribution status.

10. 10. The imaging control device according to claim 9, wherein the parameter is a sensitivity relating to a speed of control of the imaging direction in response to a change in the position of the subject.

11. an acquisition means for acquiring a distribution status of video data generated by an imaging device; a detection means for detecting a subject from the video data; a control unit that controls an imaging direction of the imaging device in accordance with the detected position of the subject; The imaging control device is characterized in that the control means changes a parameter for controlling the imaging direction in accordance with the distribution status.

12. 12. The imaging control device according to claim 11, wherein the parameter is a sensitivity relating to a speed of control of the imaging direction in response to a change in the position of the subject.

13. the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; 13. The imaging control device according to claim 12, wherein the control means sets the sensitivity so that the speed is slower in the distribution state than in the standby state.

14. the distribution status includes a distribution state in which the video data is being distributed, a standby state in which distribution is being awaited, and a preview state which may become the distribution state before the standby state; 12. The imaging control device according to claim 11, wherein the control means changes the sensitivity between the distribution state and the preview state.

15. 15. The imaging control device according to claim 14, wherein the control means sets the sensitivity so that the speed is slower in the distribution state than in the preview state.

16. The control means setting an insensitive area in which the imaging direction is not controlled in response to the movement of the subject; 12. The imaging control device according to claim 11, wherein the parameter is the size of the insensitive region.

17. the distribution status includes a distribution state in which the video data is being distributed and a standby state in which the video data is being awaited for distribution; 17. The imaging control device according to claim 16, wherein the control means increases the size of the insensitive area in the distribution state compared to the standby state.

18. an imaging unit that captures images and generates video data; An imaging device comprising the imaging control device according to claim 1 .

19. acquiring a distribution status of video data generated by an imaging device; controlling the zoom of the imaging device; An imaging control method, wherein in the step of controlling zoom, a zoom value is changed depending on the distribution status.

20. acquiring a distribution status of video data generated by an imaging device; detecting a subject from the video data; controlling the imaging direction of the imaging device in accordance with the detected position of the subject; An imaging control method, wherein in the step of controlling the imaging direction, a parameter for controlling the imaging direction is changed depending on the distribution status.

21. 21. A program causing a computer to execute the imaging control method according to claim 19.

Citation Information

Patent Citations

  • Photographing system, photographing device, image switching device, and data storage device

    JP2007158860A

  • Technology for automatically tracking objects

    JP2011519527A

  • Imaging system

    JP2014236255A

  • Imaging apparatus, control device, program, storage medium, and control method

    JP2021034824A

  • Methods and systems for auto-zoom based adaptive video streaming

    US20170302719A1