Picked-up image distribution control device

Abstract

To reduce the possibility of unintended images being distributed to users.SOLUTION: A control device includes control means for controlling the output of an image captured by an imaging apparatus, and acquisition means for acquiring positional information from the imaging apparatus. The control means, on the basis of the positional information acquired by the acquisition means, controls so that the image captured by the imaging apparatus is not output to an external device when it determines that the position of the imaging apparatus has moved.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] A control device, a control method, and a program for distribution of captured images. [Background technology]

[0002] In the field of video production, IP streaming is known, which distributes video captured by a network-connectable camera in real time. By connecting to such a camera, it is possible to control the distribution (output) of the video captured by the camera.

[0003] On the other hand, if a person bumps into the camera or the tripod on which the camera is mounted, the camera's position may shift. Since the user is connected to the camera in a different room or a remote location, they cannot immediately adjust the position. In such a case, if images captured by the camera are distributed in real time, images that the user did not intend may be distributed.

[0004] As a method for reducing the possibility of unintended distribution of captured images, Patent Document 1 discloses a technique for controlling the timing of pan-tilt-zoom drive based on the distribution status of captured images. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2024-17812 Summary of the Invention [Problem to be solved by the invention]

[0006] However, in Patent Document 1, if the imaging device is moved, there is a possibility that video unintended by the user may be distributed. Therefore, an object of the present invention is to reduce the possibility that video unintended by the user may be distributed. [Means for solving the problem]

[0007] A control device comprising: a control means for controlling the output of an image captured by an imaging device; and an acquisition means for acquiring positional information from the imaging device, wherein, when it is determined that the position of the imaging device has moved based on the positional information acquired by the acquisition means, the control device controls so that the image captured by the imaging device is not output to the external device. [Effects of the Invention]

[0008] According to the present invention, it is possible to reduce the possibility that video unintended by the user is distributed. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram showing an example of the configuration of a video distribution system according to a first embodiment. [Figure 2] FIG. 1 is a diagram showing an example of the configuration of an imaging apparatus according to a first embodiment. [Figure 3] FIG. 2 is a diagram showing an example of the configuration of a server device according to the first embodiment. [Figure 4] FIG. 2 is a diagram showing an example of the configuration of a client device according to the first embodiment. [Figure 5] 3 shows an example of a functional configuration according to the first embodiment. [Figure 6] 6 is a flowchart showing an example of the operation of the server device according to the first embodiment. [Figure 7] FIG. 10 is a diagram showing an example of the configuration of an imaging apparatus according to a second embodiment. [Figure 8] 10 shows an example of a functional configuration according to a second embodiment. [Figure 9] 10 is a flowchart showing an example of the operation of a server device according to the second embodiment. [Figure 10] 10A is a control command indicating a registration instruction for a preset function according to the third embodiment, and FIG. 10B is a control command indicating a start instruction for a preset function according to the third embodiment. [Figure 11] 10 is a flowchart showing an example of the operation of a server device according to the third embodiment. [Figure 12] FIG. 10 is a diagram showing an example of the configuration of a video distribution system according to a fourth embodiment. [Figure 13] 10 is a flowchart showing an example of the operation of a server device according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings. The embodiments described below are examples of means for realizing the present invention, and should be appropriately modified or changed depending on the configuration of the device to which the present invention is applied and various conditions. The present invention is not limited to the following embodiments. In addition, the present invention may be configured by appropriately combining parts of the embodiments described below. Furthermore, in the accompanying drawings, the same reference numerals are used to denote identical or similar components, and redundant explanations will be omitted.

[0011] In the embodiment described below, outputting a captured image to at least one or more client devices 300 via the network 400 is referred to as "delivery," but this is not limited to this. For example, the state in which the captured image is being output to an external device via the output I / F 206, which will be described later, may be referred to as "delivery."

[0012] First Embodiment 1 is a configuration diagram of a distribution system according to this embodiment. The distribution system in this embodiment includes an imaging device 100, a server device 200, a client device 300, and a network 400. The imaging device 100 is connected to the server device 200 via a LAN (Local Area Network), but this is not a limitation. For example, the connection may be via an SDI (Serial Digital Interface) or an HDMI (High-Definition Multimedia Interface), a registered trademark.

[0013] Furthermore, the server device 200 is connected to a client device 300 via a network 400, and each device can communicate with each other.

[0014] In this embodiment, delivering a captured image means that the captured image captured by the imaging device is output to the client device 300 via the network 400. In this case, the number of client devices that output the captured image may be one or more.

[0015] (Internal configuration of the imaging device) 2 is a diagram showing an example of the configuration of an imaging device 100 according to this embodiment. The imaging device 100 has an imaging unit 101, an encoder unit 102, a network I / F 103, a CPU (Central Processing Unit) 104, and a RAM (Random Access Memory) 105. It also has a ROM (Read Only Memory) 106, an imaging optical system 107 that is detachable from the imaging device 100, a sensor unit 108, and an internal bus 109 that enables mutual communication.

[0016] The imaging optical system 107 is a lens that focuses light from a subject onto an imaging surface of an imaging element 101a (described later), and is composed of, for example, a zoom lens, a focus lens, and a blur correction lens.

[0017] In this embodiment, the imaging device 100 and the imaging optical system 107 are provided as separate, detachable bodies, but the imaging device 100 may have the imaging optical system 107, as in a lens-integrated camera.

[0018] The imaging unit 101 captures an image of a subject using an imaging optical system 107 and generates an image. The imaging unit 101 has an image sensor 101a, an amplifier 101b, and an image processing unit 101c. Exposure parameters can be set and changed for each pixel group consisting of multiple pixels (e.g., 128 x 128 pixels) on the imaging surface. Exposure parameters are parameters related to exposure, and include exposure time, analog gain, and exposure value.

[0019] The image sensor 101a converts light from the subject that is focused on the imaging surface by the imaging optical system 107 into an electrical signal for each pixel and outputs the signal. The image sensor 101a captures an image of the subject with an exposure time for each pixel group according to the set exposure parameters.

[0020] The image sensor 101a is an IC (Integrated Circuit) chip in which pixels, each made of a photoelectric conversion element such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor, are arranged in a matrix. The image sensor 101a is sensitive mainly to visible light, with each pixel having high sensitivity to one of red (R), green (G), and blue (B), but also has some sensitivity to infrared light. This allows it to clearly capture an image of a subject that is bright with infrared light, such as during times of day when sunlight is present or in a place illuminated by infrared lighting.

[0021] The amplifier 101b amplifies and outputs the electrical signal output from the image sensor 101a. The amplifier 101b is provided for each pixel or pixel group, and its signal amplification factor (analog gain) is set according to the exposure parameters for each pixel group.

[0022] The image processing unit 101c performs A / D conversion on the analog electrical signal output from the amplifier 101b to a digital signal, and performs image processing including demosaicing, white balance processing, and gamma processing to generate a digital image. The image processing unit 101c performs electronic image stabilization based on the digital values ​​of the image signals output from each pixel or pixel group, amplified for each pixel or pixel group. Electronic image stabilization can correct image shake, and performs pan / tilt shift correction and roll angle correction. The sensor unit is, for example, a gyro sensor, and can obtain the angular velocity of the imaging device 100 by vector detection.

[0023] The encoder unit 102 encodes the image data output from the imaging unit 101 (image processing unit 101c) into a predetermined file format such as the H.265 / HEVC (High Efficiency Video Coding) encoding method or the H.266 / VVC (Versatile Video Coding) encoding method.

[0024] The network I / F 103 transmits the image data that has been encoded by the encoder unit 102 to the server device 200 via a LAN. The encoded image data may be stored in an internal storage device such as a RAM 105 or a ROM 106 (described later) or in a removable storage medium (not shown) such as an SD card. Storage in these cases may also be performed after output from the image processing unit 101c. In this case, the image data is saved as RAW data before encoding. The network I / F 103 also accepts operations and instructions for the imaging device 100 from the server device 200 or the client device 300 via the network 400. The accepted operations and instructions include, for example, changing the settings of functions that the imaging device 100 has.

[0025] The CPU 104 is a central processing unit that controls the image capturing apparatus 100 .

[0026] The RAM 105 temporarily stores computer programs executed by the CPU 104. The RAM 105 also provides a work area used when the CPU 104 executes processing. The RAM 105 also functions as a frame memory and a buffer memory.

[0027] The ROM 106 stores a program for the CPU 104 to control the image capturing apparatus 100 and the like.

[0028] The sensor unit 108 generates information about the position of the imaging device 100 and outputs it to the CPU 201. A sensor that detects acceleration or angular velocity is used to generate the information about the position. Alternatively, other sensors that detect the movement of the imaging device 100, such as a GPS (Global Positioning System), may be used.

[0029] (Internal configuration of the server device) 4 is a diagram showing an example of the configuration of a server device connected to the imaging device according to this embodiment. The server device 200 is an information processing device having a CPU 201, a RAM 202, a ROM 203, a video input I / F 204, an input I / F 205, an output I / F 206, and a network I / F 207.

[0030] The CPU 201 is a central processing unit that controls the server device 200 .

[0031] The RAM 202 has a work area for temporarily storing programs for the CPU 201 to control the server device 200, images input from the imaging device 100, and the like.

[0032] The ROM 203 stores a program for the CPU 201 to control the server device 200, images input from the imaging device 100, and the like.

[0033] The video input I / F 204 is connected to the imaging device 100 via a LAN cable, an HDMI cable, an SDI cable, a wireless LAN, or a USB cable, and an image captured by the imaging device 100 is input to the server device 200.

[0034] The input I / F 205 is connected to the input device 210 and outputs to the CPU 201 operations for the server device 200 input by the user via the input device 210. The input device 210 receives operation instructions from the user, such as a mouse, keyboard, or touch panel, and outputs the received results to the input I / F 205. The input I / F 205 receives operations from the user input to the input device 210, and the instructions resulting from the operations are converted into control commands by the CPU 201.

[0035] The output I / F 206 is an interface that connects to a display device 220 and displays an image output from the imaging device 100 on the display device 220. The display device 220 is a display such as an LCD for displaying acquired captured images, various settings, and the like.

[0036] The network I / F 207 is an interface that connects to the network 400. Images captured by the imaging device 100 and input to the server device 200 are distributed to the client device 300 via the network 400. The network I / F 207 is also an interface that receives a video distribution request from the client device 300 and distributes the video.

[0037] (Internal configuration of the client device) 3 is a diagram showing an example of the configuration of a client device 300 connected to the imaging device according to this embodiment via the Internet. The client device 300 is an information processing device having a CPU 301, a RAM 302, a ROM 303, an input I / F 304, an output I / F 305, and a network I / F 306.

[0038] The CPU 301 is a central processing unit that controls the client device 300 .

[0039] The RAM 302 has a work area in which the CPU 301 temporarily stores programs and the like for controlling the client device 300 .

[0040] The ROM 303 stores a program for the CPU 301 to control the client device 300 and the like.

[0041] The input I / F 304 is an interface for accepting operations for the client device 300 input by a user via an input device (not shown).

[0042] The output I / F 305 is an interface for connecting to a display device (not shown) and displaying images captured by the imaging device 100 on the display device (not shown).

[0043] The network I / F 306 is an interface that connects to the server device 200 via the network 400, and is used to input distribution requests to the imaging device 100 and to accept captured images output from the imaging device 100 obtained from the server device 200.

[0044] (Functional configuration) FIG. 5 is a diagram illustrating an example of the functional configuration of the server device 200 according to this embodiment. The server device 200 includes a position detection unit 501, a position determination unit 502, and a distribution control unit 503. In this embodiment, the server device 200 includes the functional blocks illustrated in FIG. 5 . However, the functional blocks may be implemented in the imaging device 100. Software-implemented functions are implemented by storing a program in the ROM 203 memory shown in FIG. 3 . The program is then loaded into the RAM 202 and executed by the CPU 201. Hardware-implemented functions are implemented by having an FPGA read at least one memory in the ROM 203 and generate a circuit. FPGA stands for Field Programmable Gate Array. Alternatively, a gate array circuit may be formed in a similar manner to an FPGA to implement the hardware. Alternatively, the hardware may be implemented using an ASIC (Application Specific Integrated Circuit). The functional block configuration illustrated in FIG. 5 is merely an example; multiple functional blocks may form a single functional block, or any functional block may be divided into blocks that perform multiple functions.

[0045] The position detection unit 501 detects the position of the imaging device 100. The position detection unit 501 acquires position information from the sensor unit 108 of the imaging device 100. In this case, the position information is information about the latitude and longitude of the imaging device 100 if the sensor unit 108 has a GPS. If the sensor unit 108 uses a sensor that detects acceleration or angular velocity, the position information is the acceleration or angular velocity of the imaging device 100. From the acquired position information, the movement distance and movement direction are calculated from the detected values ​​and captured images. Alternatively, the image captured by the imaging device 100 may be acquired, and the movement distance and movement direction of the imaging device 100 may be calculated from the difference between the captured images for each unit frame. Furthermore, the calculated position information about the imaging device is output to the position determination unit 502. In this embodiment, the position detection unit 501 is included in the server device 200, but this is not a limitation. For example, the position detection unit 501 may be included in the imaging device 100. In this case, the imaging device 100 calculates the movement distance and movement direction and outputs the calculation results to the position determination unit 502.

[0046] The position determination unit 502 determines whether the image capture device 100 has moved by a predetermined threshold or more based on the calculation result calculated by the position detection unit 501. Furthermore, the position determination unit 502 outputs the determination result to the distribution control unit 503.

[0047] The distribution control unit 503 determines whether or not to distribute the captured image captured by the imaging device 100 to the client device 300 via the network 400. If not, the server device 200 stops outputting the captured image to the client device 300.

[0048] The system control unit 504 has a processor (e.g., a CPU or DSP) and memory (e.g., a RAM), and the processor executes processing using computer programs and data stored in the memory, thereby controlling the operation of each component constituting the server device 200.

[0049] In the present embodiment, the server device 200 has the position detection unit 501, the position determination unit 502, and the delivery control unit 503, but this is not limiting. For example, at least one of these may be included in the imaging device 100. If the imaging device 100 has the delivery control unit 503, it may stop outputting captured images to the server device 200. Alternatively, it may output control information to the server device 200 to stop outputting captured images.

[0050] (Operation description) 6 is a flowchart showing an example of the operation of the video distribution system according to this embodiment. This operation begins when a program stored in a storage medium such as ROM 203 is loaded, and at least one of CPUs 201 reads and executes the program using RAM 202 as a work area. Details of the operation are explained below. This flowchart begins when server device 200 connects to imaging device 100, and is executed repeatedly until the connection with imaging device 100 is terminated.

[0051] In step S601, the position detection unit 501 acquires information (position information) relating to the position of the image capture device 100. If the information is acquired, the process proceeds to step S602. If the information cannot be acquired, the process proceeds to step S605. Here, the case where the position information cannot be acquired refers to, for example, a case where a captured image cannot be acquired when calculating the movement distance and movement direction of the image capture device 100 from the difference between captured images for each unit frame.

[0052] In step S602, the position detection unit 501 calculates the amount of movement of the imaging device 100. The calculated amount of movement is output to the position determination unit 502, and the process proceeds to step S603.

[0053] When calculating the movement amount of the image capture device 100 using a position sensor that detects acceleration or angular velocity, the movement amount is calculated based on the integrated value of the position sensor's detection values. Due to the characteristics of the position sensor, if the image capture device 100 moves significantly per unit time beyond its detection range, the acceleration or angular velocity output may saturate, making it impossible to obtain an accurate value. Therefore, when operating this embodiment, the range setting is increased. When calculating the movement distance of the image capture device 100 from an image rather than a position sensor, the difference between the captured images captured frame by frame is calculated, and the movement amount of the image capture device 100 per frame is calculated from the movement distance of the feature points and the focal length.

[0054] In step S603, the position determination unit 502 determines whether the amount of movement calculated in step S602 is greater than a predetermined threshold value r. If it is determined that the amount of movement is greater than the predetermined threshold value r, it is determined that the image capture device 100 has moved, and the determination result is output to the distribution control unit 503, and the process proceeds to step S604. If it is not determined that the amount of movement is greater than the processing threshold value r, the process proceeds to step S605. At this time, the predetermined threshold value r is variable and can be set by the user. Alternatively, the value may be changed automatically depending on the shooting conditions of the image capture device 100. For example, since the degree of impact of positional movement of the image capture device 100 on the distributed video varies depending on the zoom position, the threshold may be set smaller when the zoom is closer to telephoto and larger when the zoom is closer to wide-angle. In this case, position information in the optical axis direction of the image capture optical system 107 is acquired from the image capture device 100, and the threshold is dynamically changed.

[0055] In step S604, the distribution control unit 503 controls (restricts) the captured image acquired from the imaging device 100 so that it cannot be selected as a captured image to be distributed, and the process proceeds to step S605. Furthermore, if the captured image is selected as a captured image to be distributed in step S602, the distribution control unit 503 controls (restricts) the image so that it is not output to the client device 300 in step S603. Furthermore, the distribution control unit 503 controls (restricts) the image so that it is not selectable by the user as a captured image to be distributed, and the process proceeds to step S605. When the output is stopped, the user may be notified that the output has been stopped. At this time, the image of the video from the imaging device 100 may be grayed out on the display device 220 connected to the server device 200. In addition to graying out, a message that the output has been stopped may be superimposed on the video or a pop-up notification may be displayed.

[0056] In step S605, the system control unit 504 determines whether the connection between the imaging device 100 and the server device 200 has been disconnected. If the connection has been disconnected, this flow ends. If it is not determined that the connection has been disconnected, the process proceeds to step S601.

[0057] 6, when the imaging device 100 moves, the server device 200 can perform control so as not to distribute the captured images to the client device 300. In the control according to this embodiment, by periodically calculating the amount of movement, it becomes possible to perform control so as not to distribute the captured images as the imaging device 100 moves, and it becomes possible to prevent unintended captured images from being distributed to the client device 300.

[0058] <Second embodiment> In the first embodiment, the server device 200 was not able to control the imaging range of the imaging device 100, whereas in the second embodiment, the server device 200 can control the imaging range of the imaging device 100 having a driving unit 700, which will be described later. In this embodiment, the server device 200 detects the movement of the imaging device 100 using the position detection unit 501, and controls the imaging range of the imaging device 100 based on the amount of movement calculated by the position detection unit 501.

[0059] A video distribution system including an imaging device according to this embodiment and a part of the device configuration of the imaging device according to this embodiment are the same as those of the first embodiment, so the same numbers are used for overlapping configurations and descriptions thereof will be omitted.

[0060] 7, the imaging device 100 has a pan driver 701 that drives the imaging optical system 107 in a pan direction and a tilt driver 702 that drives it in a tilt direction. The imaging direction can be changed by driving at least one of the pan driver 107 and the tilt driver 108. In addition, the imaging angle of view and focus can be changed by driving the lens of the imaging optical system in the optical axis direction (lens drive).

[0061] Furthermore, when the imaging device 100 according to this embodiment acquires control information related to the imaging direction from the server device 200, it can drive the pan driver 701 to the pan target position set by the server device 200, the tilt driver 702 to the tilt target position, and the imaging optical system 107 to the lens target position. When a control instruction requesting information related to the drive position of the tilt driver 702 is acquired from the CPU 104, the tilt driver 702 outputs information related to the drive position of the tilt driver 702.

[0062] The pan drive unit 701 is composed of a mechanical drive system that performs panning and a drive motor, and can, for example, rotate the imaging direction (the optical axis of the imaging lens) 360 degrees in the pan direction. The pan drive unit 701 is composed of an actuator such as a stepping motor and an encoder that detects the pan position. When a control instruction requesting information regarding the drive position of the pan drive unit is received from the CPU 104, the pan drive unit 701 outputs information regarding the drive position of the pan drive unit 701.

[0063] The tilt drive unit 702 is composed of a mechanical drive system that performs panning and a drive motor, and can, for example, rotate the imaging direction (the optical axis of the imaging lens) 360 degrees in the tilt direction. The tilt drive unit 702 is composed of an actuator such as a stepping motor, and an encoder that detects the pan position. When a control instruction requesting information about the drive position of the tilt drive unit is received from the CPU 104, the tilt drive unit 702 outputs information about the drive position of the tilt drive unit 702.

[0064] The imaging optical system 107 is composed of a drive system for a focus lens and a zoom lens, and a motor as a drive source thereof. For example, it has a lens mechanism that performs optical zoom and an actuator such as a stepping motor. When a control instruction requesting information about the drive position of the imaging optical system 107 is received from the CPU 104, the imaging optical system 107 outputs information about the drive position of the imaging optical system 107.

[0065] The method for outputting the drive position of each drive unit has been described above. Information about the drive positions of the pan drive unit 701, tilt drive unit 702, and imaging optical system 107 differs from information about the position of the imaging device 100 output by the sensor unit 108, and can be controlled by the user outputting an instruction to change the imaging range. In other words, it does not change even if the imaging device 100 moves.

[0066] 8 is a diagram showing an example of the functional configuration of the server device 200 according to this embodiment. A drive control unit 801 can control the pan drive unit 701, tilt drive unit 702, and imaging optical system 107 of the imaging device 100, allowing the user to remotely change the imaging range. A control instruction from the user is realized, for example, by the input I / F 205 in FIG. 3 accepting an operation from the user on the imaging device 100, and the instruction resulting from the operation being converted into a control command by the CPU 201 and output to the imaging device 100.

[0067] (Operation description) 9 is a flowchart showing an example of the operation of the video distribution system according to this embodiment. This operation begins when a program stored in a storage medium such as ROM 203 is loaded, and at least one of CPUs 201 reads and executes the program using RAM 202 as a work area. Details of the operation are explained below. This flowchart begins when server device 200 connects to imaging device 100, and is executed repeatedly until the connection with imaging device 100 is terminated.

[0068] In this embodiment, steps S601 to S605 are the same as those in the first embodiment, and therefore a description thereof will be omitted.

[0069] In step S901, the drive control unit 801 calculates the drive amount based on the movement amount calculated in step S602. After calculating the drive amount, the process proceeds to step S902.

[0070] In step S902, the drive control unit 801 outputs a control command to each drive unit of the imaging device 100 based on the drive amount calculated in step S901. In this embodiment, the drive control unit 801 controls the drive of the imaging device 100 to change the imaging range, but this is not limited to this. For example, correction processing such as distortion correction may be performed on the captured image acquired from the imaging device 100. In this case, the image processing unit 101c of the imaging device 100 may perform this processing, or the server device 200 may perform correction processing on the uncorrected captured image. After changing the imaging range or performing correction processing on the captured image, the process proceeds to step S903.

[0071] In step S903, the input I / F 205 accepts a user operation related to the distribution of the captured image captured by the imaging device 100 in step S902 (acceptance of user operation). If the distribution of the captured image by the imaging device 100 is permitted by the user operation, the process proceeds to step S904. If the distribution of the captured image captured by the imaging device is not permitted by the user operation, the process proceeds to step S605. In this embodiment, the process of step S903 is repeated until a user operation is accepted, but this is not limited to this. Here, if there is no instruction from the user for a certain period of time, it may be determined that distribution is not permitted and the process proceeds to step S605.

[0072] In step S904, the delivery control unit 503 controls the captured image acquired from the imaging device 100 so that it can be selected as a captured image to be delivered (captured image output is possible), and the process proceeds to step S605. Furthermore, if a user operation to select the captured image as a captured image to be delivered is accepted in step S904, the delivery control unit 503 controls the captured image to be output to the client device 300, and the process proceeds to step S605.

[0073] As described above, in this embodiment, the flow shown in Fig. 9 allows the server device 200 to control so as not to distribute images to the client device 300 when the imaging device 100 has moved. Furthermore, by changing the imaging range or correcting the captured image after the imaging device 100 has moved, the user can resume distribution without changing the position of the imaging device 100. The control according to this embodiment makes it possible to control so as not to distribute captured images when the imaging device 100 has moved, thereby preventing unintended captured images from being distributed to the client device 300. Furthermore, by changing the imaging range or correcting the captured image without user intervention, the user can quickly resume distribution.

[0074] In this embodiment, when the position determination unit 502 determines in step S603 that the imaging device 100 has moved, the drive control unit 801 controls the imaging device 100 based on the amount of movement, but this is not limited to this. For example, after controlling the imaging device 100 to not deliver images captured by the imaging device 100 to the client device 300 in step S604, a user operation to permit control of the imaging device 100 based on the amount of movement may be accepted. In this case, the process proceeds to step S901 after accepting a user operation to permit control based on the amount of movement.

[0075] <Third embodiment> In the second embodiment, the server device 200, which has detected the movement of the imaging device 100 using the position detection unit 501, corrects the imaging range or captured image of the imaging device 100 based on the amount of movement calculated by the position detection unit 501. In the third embodiment, the imaging device 100 further has a preset function that associates each of the drive positions of the imaging optical system 107, pan drive unit 701, and tilt drive unit 702 with a preset number and registers them as preset positions. Therefore, in this embodiment, the drive control unit 801 corrects the preset position that has been set in advance based on the amount of movement calculated by the position detection unit 501.

[0076] Since the video distribution system including the imaging device of this embodiment and part of the device configuration of the imaging device of this embodiment are the same as those of the first or second embodiment, the same numbers are used for overlapping configurations and descriptions are omitted.

[0077] In the imaging device 100 of this embodiment, preset numbers are associated with the positions of the imaging optical system 107, the pan driver 701, and the tilt driver 702, and these are registered as preset positions, but this is not limited to this. For example, a preset position may be registered by associating a preset number with at least one of the position of the imaging optical system 107, the position of the pan driver 701, and the position of the tilt driver 702. Alternatively, a preset position may be registered using a zoom value, a pan value, and a tilt value obtained by converting the position of the optical lens of the imaging optical system 107 and the positions of the pan driver 701 and the tilt driver 702 into predetermined values. Furthermore, in addition to the positions of the pan / tilt driver and the lens of the imaging optical system 107, image quality settings and the like may also be included in the preset registration.

[0078] (Preset function) Here, the process of registering a preset position will be described with reference to FIG. 10. Control command 1000 in FIG. 10(A) is a control command indicating an instruction to register or delete a preset position in this embodiment. Parameter 1001 is a command identifier that identifies various control commands, and its value "0100" indicates an instruction to register or delete a preset. Parameter 1002 is a parameter indicating preset registration or preset deletion, and specifies a value indicating registration or deletion. Parameter 1003 is a parameter indicating a preset number. For example, 20 preset numbers can be registered, and a preset number is specified from among them. Parameter 1004 is a parameter indicating a camera number corresponding to a camera for which a preset position is to be registered. For example, 10 camera numbers can be registered, and an imaging device that outputs a control command from among them is specified. In this embodiment, it is assumed that imaging device 100 is registered as camera number 1. Note that the control command is an example, and the identifiers and parameters are not limited to this.

[0079] The server device 200 accepts a user operation to register a preset position via the input I / F 205. A user operation to register a preset position means, for example, the user selecting a button indicating preset registration for the imaging device having the camera number displayed on the display screen of the display device 220. Upon accepting the user operation to register a preset position, the CPU 201 (system control unit 504) transmits a control command 1000 indicating preset registration to the imaging device corresponding to the camera number. In this embodiment, the imaging device registered with camera number 1 is the imaging device 100, and therefore the control command is transmitted to the imaging device 100.

[0080] 10A, when the CPU 104 acquires a control command 1000 and specifies preset registration by parameter 1002, the current pan position, tilt position, and lens position are registered to preset number 3, which is the preset number specified by parameter 1003. In this embodiment, storing information in the RAM 202 that associates the positions of the imaging optical system 107, pan driver 701, and tilt driver 702 with the preset number is referred to as "preset registration." Furthermore, when a user operation to erase a preset position is performed, that is, when deletion is specified by parameter 1002 of the control command 1000 acquired by the imaging device 100, the information on the pan position, tilt position, and lens position of the preset number specified by parameter 1003, which is stored in the RAM 202, is deleted.

[0081] The process of calling a registered preset position will be described with reference to Fig. 10(B). The server device 200 receives a user operation to start movement to a preset position via the input I / F 205. A user operation to start movement to a preset position indicates, for example, the user selecting a button that indicates movement to a preset number displayed on the display screen of the display device 220. Upon receiving a user operation to start movement to a preset position, the CPU 201 (system control unit 504) transmits a control command 1100 indicating movement to the preset position to the imaging device 100.

[0082] When parameter 1102 specifies that the movement of the preset is to be stopped, the movement to the preset position that is currently moving (operating) is stopped. Furthermore, after stopping, the pan, tilt, and lens position at the stopping point are set, but this is not limited to this. For example, the camera may move to a preset position, that is, move to a home position or an initial position. In this embodiment, the control command 1100 is described as specifying the command identifier 1101, parameter 1102, and parameter 1103, but this is not limited to this. When parameter 1102 specifies that the movement of the preset is to be stopped, the preset number in parameter 1103 does not need to be specified. When parameter 1102 specifies that the movement of the preset is to be stopped, the system control unit 1006 does not need to read parameter 2203.

[0083] In this embodiment, the control command 1100 does not specify a speed, but this is not limiting. If there is information regarding a speed specified by the user, the robot moves to a preset position according to the information regarding the specified speed.

[0084] As shown in FIG. 10(B), when CPU 104 acquires control command 1100 and parameter 1102 specifies the start of preset movement, it drives lens driver 104, pan driver 106, and tilt driver 108 to move from the current pan position, tilt position, and lens position to the pan position, tilt position, and lens position of preset number 3 specified by parameter 1103.

[0085] In this embodiment, a user can call a preset position associated with a registered preset number using a predetermined command for an imaging device corresponding to a camera number. Also, different preset positions can be registered for multiple preset numbers, and the user can move to a specified preset position by specifying the preset number (preset movement). The preset movement in this embodiment is realized by moving at a controlled speed from the positions of the lens driving unit, pan driving unit, and tilt driving unit at the time when a command specifying the preset movement is received to the preset position registered with the specified preset number.

[0086] (Operation description) 11 is a flowchart showing an example of the operation of the video distribution system according to this embodiment. This operation begins when a program stored in a storage medium such as ROM 203 is loaded, and at least one of CPUs 201 reads and executes the program using RAM 202 as a work area. Details of the operation are explained below. This flowchart begins when server device 200 connects to imaging device 100, and is executed repeatedly until the connection with imaging device 100 is terminated.

[0087] In this embodiment, steps S601 to S605 are the same as those in the first embodiment, and therefore their explanations will be omitted. Also, steps S901 to S902 and step S904 are the same as those in the second embodiment, and therefore their explanations will be omitted.

[0088] In step S1101, the input I / F 205 accepts a user operation related to the distribution of captured images captured by the imaging device 100. If the user operation permits the distribution of captured images by the imaging device 100, the process proceeds to step S904. If the user operation does not permit the distribution of captured images captured by the imaging device, the process proceeds to step S1102. In this embodiment, the process of step S903 is repeated until a user operation is accepted, but this is not limited to this. Here, if there is no instruction from the user for a certain period of time, the process may proceed to step S1102, assuming that distribution is not permitted.

[0089] In step S1102, the input I / F 205 accepts a user operation related to updating the preset position. If the user operation permits updating the preset position held by the imaging device 100, the process proceeds to step S1103. If the user operation does not permit updating the preset position held by the imaging device 100, the process proceeds to step S605. In this embodiment, the process of step S1102 is repeated until a user operation is accepted, but this is not limiting. Here, if there is no instruction from the user for a certain period of time, it may be determined that distribution is not permitted and the process proceeds to step S605.

[0090] In step S1103, the CPU 201 acquires information about the preset number in which the camera number corresponding to the image capture device 100 is registered. For the acquired preset number, the CPU 201 calculates a control command to update the preset position based on the drive amount calculated in step S901, and after outputting the control command to the image capture device 100, the process proceeds to step S605.

[0091] The imaging device 100, which has received the control command output in step S1103, updates the preset position of the corresponding preset number based on the received control command and driving amount.

[0092] In this embodiment, if the position determination unit 502 determines in step S603 that the imaging device 100 has moved, the pre-registered preset position is updated. Specifically, a case will be described in which the pan, tilt, and zoom values ​​are registered as (0,0,0) for preset number 3. If it is calculated in step S901 that the imaging device 100 has moved 10 degrees in the pan direction, the preset position registered for preset number 3 is updated to (-10,0,0).

[0093] As described above, in this embodiment, the flow shown in FIG. 11 allows the server device 200 to control not to distribute images to the client device 300 when the imaging device 100 has moved. Furthermore, by updating the preset position registered in advance after the imaging device 100 has moved, distribution can be resumed without the user having to change the position of the imaging device 100. The control according to this embodiment makes it possible to control not to distribute captured images when the imaging device 100 has moved, thereby preventing unintended distribution of captured images to the client device 300. Furthermore, by updating the preset position without user intervention, the user can quickly resume distribution and use various functions such as preset movement.

[0094] <Fourth embodiment> In the first embodiment, the server device 200 acquires captured images from one imaging device 100, whereas in the fourth embodiment, the server device 200 can acquire captured images from imaging devices 100(a) to 100(c). In this embodiment, when the position detection unit 501 detects the movement of the imaging device 100(a), the server device 200 controls the server device 200 not to distribute captured images from the imaging device 100(a), and distributes captured images from the imaging device 100(b) or imaging device 100(c) that is not moving.

[0095] 12 is a configuration diagram of a distribution system according to this embodiment. The distribution system according to this embodiment includes imaging devices 100(a), 100(b), 100(c), a server device 200, a client device 300, and a network 400.

[0096] 13 is a flowchart showing an example of the operation of the video distribution system according to this embodiment. This operation begins when a program stored in a storage medium such as ROM 203 is loaded, and at least one of CPUs 201 reads and executes the program using RAM 202 as a work area. Details of the operation are explained below. This flowchart begins when server device 200 connects imaging device 100(a) to imaging device 100(c), and is executed repeatedly until imaging device 100(a) is disconnected from imaging device 100(c).

[0097] In step S604, the distribution control unit 503 controls the captured image acquired from the imaging device 100(a) so that it cannot be selected as a captured image to be distributed, and the process proceeds to step S605. Furthermore, if the captured image is selected as a captured image to be distributed in step S602, the distribution control unit 503 controls the output to the client device 300 to be stopped in step S603. Furthermore, the distribution control unit 503 controls the captured image so that it cannot be selected as a captured image to be distributed by the user, and the process proceeds to step S605. If the output is stopped, the user may be notified that the output has been stopped. At this time, the display device 220 connected to the server device 200 may gray out the captured image of the imaging device 100(a) from among the captured images acquired from the imaging devices 100(a) to 100(c). In addition to graying out, a message that the output has been stopped may be superimposed on the video or a pop-up notification may be displayed.

[0098] In step S1301, it is determined whether the captured image of the imaging device 100(a) has been output as a distribution image to the client device 300 in step S604. If the captured image of the imaging device 100(a) has been output as a distribution image to the client device 300 in step S604, the process proceeds to step S1302. If the captured image of the imaging device 100(a) has not been output as a distribution image to the client device 300 in step S604, the process proceeds to step S605. This allows the currently output distribution image to continue to be output to the client device 300.

[0099] In step S1302, the CPU 201 controls the image capture device 100(b) or the image capture device 100(c) to be output as an image to be distributed to the client device 300. The CPU 201 acquires information regarding the priority order of the images to be distributed from the RAM 202. After acquiring the information, the CPU 201 determines an image to be distributed based on the priority order, outputs the image captured by the image capture device with the highest priority as an image to be distributed to the client device 300, and proceeds to step S605.

[0100] Which captured image to distribute is determined based on, but not limited to, information regarding the priority order of images to be distributed that is set in advance by the user via the input device 210. For example, a captured image that is similar to the shooting range of captured image 100(a) from among the acquired captured images may be determined as the image to be distributed, or a captured image that is suitable for distribution may be determined as the image to be distributed.

[0101] 13, in this embodiment, when the imaging device 100(a) moves, the server device 200 can perform control so as not to distribute images captured by the imaging device 100(a) to the client device 300. Furthermore, by determining images to be distributed from a plurality of imaging devices that are already connected after the imaging device 100(a) moves, the client can continue to view the distributed images without interruption.

[0102] <Other embodiments> The present invention can be realized by reading and executing a program that realizes the functions of the above-described first and second embodiments. This program is supplied to a system or device via a network or a storage medium, and is read and executed by one or more processors in the computer of the system or device. The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more functions. [Explanation of symbols]

[0103] 100 Imaging device 501 Position detection unit 502 Distribution control unit

Claims

1. a control means for controlling output of an image captured by the imaging device; an acquisition means for acquiring information regarding the position of the imaging device; and A control device characterized in that, when it is determined that the position of the imaging device has moved based on the information regarding the position acquired by the acquisition means, the control means controls the captured image so that it is not output to an external device.

2. The control device further includes a receiving unit that receives a user operation to permit output of the captured image, and when distribution of the captured image is permitted by the user operation, the control unit controls so that the captured image can be output to the external device.

2. The control device according to claim 1.

3. and a determining unit for determining that the position of the imaging device has moved based on the amount of movement of the imaging device, the amount of movement being calculated based on information relating to the position of the imaging device.

2. The control device according to claim 1.

4. The determination means determines that the position of the imaging device has moved if the amount of movement is greater than a predetermined threshold.

4. The control device according to claim 3.

5. The control device according to claim 3, characterized in that when the determination means determines that the position of the imaging device has moved based on the information regarding the position acquired by the acquisition means, the control means does not output the captured image to the external device.

6. The control device according to claim 3 , wherein when the determining means determines that the position of the imaging device has moved based on the information about the position obtained by the obtaining means, the control device controls the imaging device so as not to output the captured image.

7. When the determination means determines that the position of the imaging device has moved based on the information regarding the position acquired by the acquisition means, the image captured by the imaging device is restricted so as not to be output to the external device.

4. The control device according to claim 3.

8. When the determination means determines that the position of the imaging device has moved based on the information about the position acquired by the acquisition means, the determination means notifies the user that control is being exercised to prevent the captured image captured by the imaging device from being output to the external device.

8. The control device according to claim 7.

9. the control device further includes a drive control means for controlling an imaging means capable of driving a pan drive means, a tilt drive means, and a lens drive means; When the determination means determines that the position of the imaging device has moved based on the information regarding the position acquired by the acquisition means, the drive control means controls the imaging device to change the imaging range based on the amount of movement.

5. The control device according to claim 4.

10. a correction unit that performs image processing on the captured image of the imaging device; When the determination means determines that the position of the imaging device has moved based on the information regarding the position acquired by the acquisition means, the correction means corrects the captured image of the imaging device based on the amount of movement.

5. The control device according to claim 4.

11. A control device for controlling an imaging unit that has at least one or more preset positions for specifying an imaging range and that is capable of driving a pan driving unit, a tilt driving unit, and a lens driving unit so as to move the preset positions, The control device according to claim 4 , wherein when the determining means determines that the position of the imaging device has moved based on the information about the position acquired by the acquiring means, the control means controls to update the preset position based on the amount of movement.

12. a control step of controlling output of a captured image captured by the imaging device; an acquisition step of acquiring information about a position from the imaging device; and A control method characterized in that, if it is determined that the position of the imaging device has moved based on the information regarding the position acquired in the acquisition process, the control process controls so that the captured image is not output to an external device.

13. A program for causing a computer to function as the control device according to any one of claims 1 to 11.

Images