Control device, imaging device, and control method

Abstract

To reduce the complexity of installing monitoring camera.SOLUTION: A control device 1 controls an imaging device 2 equipped with an adjustment mechanism for adjusting the imaging direction and angle of view. The control device 1 includes an acquisition unit 131 that acquires image data captured by the imaging device 2, an image analysis unit 132 that analyzes the acquired image data and identifies one or more reflection points of a laser beam contained in the image data that are referenced for setting the imaging direction and angle of view of the imaging device 2, and an imaging device control unit 133 that controls the adjustment mechanism such that the one or more reflection points are included in predetermined positions in an image captured by the imaging device 2.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a control device, an imaging device, and a control method. [Background technology]

[0002] There are known methods for setting a monitoring area for a surveillance camera (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2001-204007 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the installation of security cameras, the range of surveillance cameras is adjusted while checking the images captured by the security cameras. In this type of work, an environment is required for checking the images captured by the security cameras, which causes a problem of the work becoming complicated.

[0005] The present invention has been made in consideration of these points, and has an object to reduce the complexity of the installation work of a surveillance camera. [Means for solving the problem]

[0006] A control device of a first aspect of the present invention is a control device that controls an imaging device equipped with an adjustment mechanism for adjusting an imaging direction and an angle of view, and includes an acquisition unit that acquires image data captured by the imaging device, an image analysis unit that analyzes the acquired image data and identifies one or more reflection points of a laser beam contained in the image data that are referenced for setting the imaging direction and angle of view of the imaging device, and an imaging device control unit that controls the adjustment mechanism so that the one or more reflection points are included in predetermined positions in an image captured by the imaging device.

[0007] The acquisition unit acquires the image data, which is a moving image, and the image analysis unit identifies a blinking pattern contained in the image data, which is a pattern in which reflected light reflected from the reflection point blinks, and the imaging device control unit may control the adjustment mechanism to make a setting according to the blinking pattern when the blinking pattern identified by the image analysis unit is a predetermined pattern.

[0008] The image analysis unit may identify a color of the reflection point contained in the image data, and the imaging device control unit may control the imaging device when the reflection point of the specified color is identified.

[0009] The imaging device control unit may determine an adjustment amount of the angle of view so that the one or more reflection points are positioned at a reference point that is predetermined as a position at which the reflection points should be captured in the angle of view captured by the imaging device 2, and control the adjustment mechanism based on the determined adjustment amount.

[0010] A control method according to a second aspect of the present invention is a computer-executed control method for controlling an imaging device having an adjustment mechanism for adjusting an imaging direction and an angle of view, the control method comprising the steps of: acquiring image data captured by the imaging device; analyzing the acquired image data and identifying one or more reflection points of a laser beam contained in the image data that are referenced for setting the imaging direction and angle of view of the imaging device; and controlling the adjustment mechanism so that the one or more reflection points are included in predetermined positions in an image captured by the imaging device.

[0011] An imaging device according to a third aspect of the present invention includes an adjustment mechanism for adjusting the imaging direction and angle of view, an imaging means for capturing images and generating image data, an image analysis unit for analyzing the image data generated by the imaging means and identifying one or more reflection points of a laser beam contained in the image data that are referenced for setting the imaging direction and angle of view, and a field of view control unit for controlling the adjustment mechanism so that the one or more reflection points are included in predetermined positions in an image captured by the imaging means. Effect of the Invention

[0012] The present invention has the effect of reducing the complexity of the installation work of a surveillance camera. [Brief description of the drawings]

[0013] [Figure 1] FIG. 2 is a diagram for explaining an overview of a control system S. [Diagram 2] FIG. 2 is a diagram for explaining an overview of a control system S. [Diagram 3] FIG. 2 is a diagram for explaining an overview of a control system S. [Figure 4] 1 is a block diagram showing a configuration of a control device 1. FIG. [Diagram 5] 4 is a diagram showing an example of a data structure of pattern information stored in a storage unit 12. FIG. [Figure 6] 4 is a flowchart showing a process flow in the control device 1. [Figure 7] FIG. 13 is a block diagram showing a configuration of an imaging device 2A according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] [Overview of Control System S] 1 to 3 are diagrams illustrating an overview of a control system S according to an embodiment. The control system S is a system for controlling a surveillance camera. The control system S includes a control device 1, an imaging device 2, and a light source 3.

[0015] The control device 1 is a device for controlling the imaging device 2. More specifically, the control device 1 controls the angle of view of the imaging device 2. The control device 1 may also control the imaging device 2 to set various parameters for shooting. The control device 1 is, for example, a server.

[0016] The imaging device 2 is a surveillance camera. The imaging device 2 may capture still images or moving images. The imaging device 2 transmits generated image data to the control device 1. The imaging device 2 includes an adjustment mechanism for adjusting the imaging direction and the angle of view. As an example, the imaging device 2 includes a two-axis or three-axis rotation mechanism that can be remotely controlled. The imaging device 2 may include a mechanism that can adjust the position of the viewpoint of the imaging device 2, which can be remotely controlled.

[0017] The light source 3 is a light source that irradiates a laser beam. Although details will be described later, the light beam irradiated by the light source 3 is referred to in order to determine the imaging direction and angle of view of the imaging device 2. The light source 3 may irradiate a light beam of a predetermined wavelength so that a reflection point R caused by the light beam irradiated by the light source 3 can be identified in an image captured by the imaging device 2, or may irradiate a light beam that blinks at a predetermined period. The light source 3 may be a wavelength-variable laser.

[0018] The light source 3 may be configured to be able to communicate with the control device 1 via a network, and may be controlled by the control device 1. Furthermore, the light source 3 may have an adjustment mechanism for adjusting the irradiation direction.

[0019] The processing in the control system S will be described. The light source 3 emits light rays to indicate the range to be captured by the imaging device 2. As an example, the light source 3 emits light rays toward the center of the range to be captured by the imaging device 2. The control device 1 acquires image data captured by the imaging device 2 ((1) in FIG. 1). The control device 1 identifies a reflection point R where the light rays emitted by the light source 3 are reflected by the background ((2) in FIG. 1).

[0020] The control device 1 determines the adjustment amount of the angle of view of the imaging device 2 based on the position of the identified reflection point R ((3) in FIG. 1). The adjustment amount of the angle of view is, for example, the direction and angle of rotation of the imaging device 2. The adjustment amount of the angle of view may be the adjustment amount of the zoom magnification of the imaging device 2. The adjustment amount of the angle of view may also be the amount of movement of the imaging device 2.

[0021] An example of determining the adjustment amount of the angle of view of the imaging device 2 based on one reflection point R1 will be described with reference to Fig. 2. In this case, the coordinates of a position (hereinafter referred to as a reference point) S1 where the reflection point should be captured in the camera coordinate system are set in advance. The control device 1 determines the adjustment amount of the angle of view so that the coordinates of the position P1 where the reflection point R1 is captured in the camera coordinate system match the coordinates of the reference point S1 based on the acquired image data.

[0022] In addition, when the angle of view is determined based on a plurality of reflection points, the control device 1 is given a plurality of reference points in advance in the camera coordinate system, and determines the adjustment amount of the angle of view based on the coordinates of the plurality of reference points and the plurality of reflection points. An example of adjusting the angle of view based on two reflection points will be described with reference to FIG. 3. For example, the control device 1 determines the angle of view based on the reflection point R2 of the light ray indicating the center of the angle of view and the reflection point R3 of the light ray for determining the zoom magnification. In this case, the light ray indicating the center of the angle of view and the light ray for determining the zoom magnification of the angle of view have different wavelengths of light irradiated from the light source 3, so that the control device 1 can distinguish between the respective light rays. The control device 1 determines the rotation direction and angle of the imaging device 2 so that the position P2 in the camera coordinate system of the reflection point R2 of the light ray indicating the center of the angle of view is located at the reference point (S2) indicating the center of the angle of view. When the imaging device 2 is rotated based on the determined rotation direction and angle, the imaging device 2 determines the adjustment amount of the zoom magnification of the imaging device 2 so that the position P3 in the camera coordinate system of the other reflection point R3 coincides with the reference point S3. The reference point S3 may be a set of reference points, or may be specified by a line or an area.

[0023] The control device 1 controls the adjustment mechanism of the imaging device 2 based on the determined amount of adjustment ((4) in FIG. 1). Specifically, the control device 1 transmits control information including the determined amount of adjustment to the imaging device 2. The control information is information for instructing changes to the angle of view and parameters. The imaging device 2 changes the angle of view based on the acquired control information.

[0024] The information processing system S has the effect of reducing the complexity of the installation work of the surveillance cameras.

[0025] [Configuration of control device 1] 4 is a block diagram showing the configuration of the control device 1. The control device 1 has a communication unit 11, a storage unit 12, and a control unit 13. The control unit 13 has an acquisition unit 131, an image analysis unit 132, and an imaging device control unit 133.

[0026] The communication unit 11 is a communication interface for transmitting and receiving data to and from other devices via a network. The storage unit 12 is a storage medium including a ROM (Read Only Memory), a RAM (Random Access Memory), an SSD (Solid State Drive), a hard disk drive, etc. The storage unit 12 stores in advance a program to be executed by the control unit 13.

[0027] The control unit 13 is a processor such as a CPU (Central Processing Unit), etc. The control unit 13 executes a program stored in the storage unit 12 to function as an acquisition unit 131, an image analysis unit 132, and an imaging device control unit 133.

[0028] The acquisition unit 131 acquires image data captured by the imaging device 2. The image analysis unit 132 analyzes the acquired image data and identifies one or more reflection points included in the image data. The image analysis unit 132 analyzes the acquired image data using a known image analysis technique and identifies reflection points of light rays emitted by the light source 3 included in the image data. As an example, the storage unit 12 stores a trained model that has been trained to output the positions of reflection points included in an image, and the image analysis unit 132 inputs the acquired image data into the trained model stored in the storage unit 12 and identifies the reflection points based on the output information.

[0029] The imaging device control unit 133 controls the adjustment mechanism so that one or more reflection points are included in a predetermined position in the image captured by the imaging device 2. That is, the imaging device control unit 133 determines the adjustment amount of the angle of view so that one or more reflection points are located at a reference point that is previously determined as a position where the reflection point should be captured in the angle of view captured by the imaging device 2. As an example, the imaging device control unit 133 determines the amount of movement or rotation of the imaging device 2 based on the reference point in the image data and the position in the camera coordinate system of the reflection point identified by the image analysis unit 132. For example, the imaging device control unit 133 determines the amount of movement or rotation of the imaging device 2 using a known coordinate conversion process. The imaging device control unit 133 may determine the adjustment amount of the zoom magnification for enlarging or reducing the image. The imaging device control unit 133 controls so that the angle of view of the imaging device 2 is adjusted based on the determined amount of movement or rotation of the imaging device 2. Note that the imaging device control unit 133 may control so that the zoom magnification of the imaging device 2 is adjusted based on the determined adjustment amount of the zoom magnification. The imaging device control unit 133 transmits to the imaging device 2 control information including the parameters to be controlled and the amounts of adjustment of the parameters.

[0030] With this configuration, the information processing device 1 has the effect of reducing the complexity of the installation work of the surveillance camera.

[0031] The control device 1 may be configured to control parameters other than the parameters for determining the angle of view. As an example, the control device 1 may be configured to set parameters such as the sensitivity, frame rate, and resolution of the imaging device 2. As an example, the control device 1 may receive the setting contents in the form of a code representing the length of time during which a reflection point included in the imaging data is identified.

[0032] The acquisition unit 131 acquires image data that is a moving image. The image analysis unit 132 identifies a blinking pattern, which is a pattern in which reflected light reflected from a reflection point blinks, included in the image data. The image analysis unit 132 identifies the blinking pattern by identifying a reflection point for each frame that constitutes the acquired image data. In other words, the blinking pattern can be rephrased as a pattern of whether or not a reflection point is identified at the same position in the image. The storage unit 12 stores pattern information that associates a blinking pattern with the contents to be set in the imaging device 2 when the blinking pattern is identified. FIG. 5 is a diagram showing an example of a data structure of the pattern information stored in the storage unit 12. In the pattern information shown in FIG. 5, a "pattern" and a "setting contents" are associated with each other. The "pattern" indicates a blinking pattern. For example, if the "pattern" is "short and long," it indicates that the reflection point is identified for a relatively short time, and then the reflection point is identified for a relatively long time after it disappears from the image. The image analysis unit 132 may recognize that the blinking pattern is at its end when the reflection point disappears from the image for a predetermined time or more. "Setting contents" indicates the contents to be set in the imaging device 2 when the blinking pattern is identified.

[0033] The image analysis unit 132 determines whether the identified blinking pattern matches a blinking pattern included in the pattern information stored in the storage unit 12. If the blinking pattern identified by the image analysis unit 132 is a predetermined pattern, the imaging device control unit 133 controls the adjustment mechanism to make settings according to the blinking pattern. If the identified blinking pattern matches a blinking pattern included in the pattern information, the imaging device control unit 133 transmits control information to the imaging device 2 for making settings corresponding to the identified blinking pattern.

[0034] By configuring the control device 1 in this way, it becomes possible to set the angle of view and the shooting parameters using a single interface, which has the effect of reducing the effort required to set up the surveillance camera.

[0035] The control device 1 may control a plurality of imaging devices 2. When there are a plurality of imaging devices in the vicinity of the area of ​​the photographing target, it is necessary to be able to distinguish which imaging device 2 the reflection point specified by the image analysis unit 132 is the reflection point for controlling. As an example, the control device 1 may be configured to distinguish the imaging device 2 to be set based on the wavelength (color) of the light irradiated by the light source 3.

[0036] The image analysis unit 132 identifies the color of the reflection point included in the image data. When the image analysis unit 132 identifies the reflection point, it identifies the color of the reflection point. As an example, the trained model stored in the storage unit 12 is trained to output the position of the reflection point included in the image and the color of the reflection point. The image analysis unit 132 inputs the acquired image data into the trained model stored in the storage unit 12, and identifies the position and color of the reflection point included in the image based on the output information.

[0037] The imaging device control unit 133 controls the imaging device 2 when a reflection point of a predetermined color is identified. The predetermined color is, for example, set in advance for each imaging device 2. The imaging device control unit 133 determines whether the color of the identified reflection point matches a predetermined color set in advance for the imaging device 2. The imaging device control unit 133 does not control the imaging device 2 when the color of the identified reflection point does not match the predetermined color. When the color of the identified reflection point matches the predetermined color, the imaging device control unit 133 identifies, for example, a parameter of a control target for adjusting the angle of view of the imaging device 2 and an adjustment amount of the parameter based on the position of a reflection point of a predetermined color included in the image data. The imaging device control unit 133 transmits control information including the identified parameter of the control target and the adjustment amount of the parameter to the imaging device 2 to be controlled.

[0038] By configuring the control device 1 in this manner, even when it is necessary to set a plurality of imaging devices 2, it is possible to distinguish between the imaging devices 2 to be set.

[0039] The control device 1 may be configured to specify a reflection point of a light beam emitted from the light source 3, thereby setting a predetermined color corresponding to the imaging device 2. As an example, when a reflection point is specified based on image data acquired by the image analysis unit 132, and when the reflection point blinks in a predetermined pattern, the imaging device control unit 133 sets the color of the reflection point as a predetermined color corresponding to the imaging device 2. As an example, the imaging device control unit 133 may store the imaging device 2 and the predetermined color corresponding to the imaging device 2 in the storage unit 12 in association with each other.

[0040] By configuring the control device 1 in this way, it becomes possible to set up the imaging device 2 without using a terminal device or the like, and it is possible to reduce the effort required to install a surveillance camera.

[0041] Although the case where the reflection point is identified by the color of the image data has been described, the control device 1 may be configured to identify the wavelength of the light source irradiating the reflection point and determine whether or not the reflection point is set based on the identified wavelength. The storage unit 12 may store a trained model that has been trained to output the position of the reflection point included in the image and the wavelength of the light source irradiated toward the reflection point. In this case, the image analysis unit 132 inputs the acquired image data into the trained model to identify the position of the reflection point and the wavelength of the light source irradiating the reflection point. The imaging device control unit 133 controls the imaging device 2 based on the identified reflection point when the wavelength of the light source irradiating the reflection point identified by the image analysis unit 132 is a predetermined wavelength that is determined in advance as a wavelength for setting the imaging device 2.

[0042] The control device 1 may further include a light source control unit for controlling the light source 3 and a reception unit for receiving control contents for the light source 3. In this case, the reception unit receives an operation for changing the irradiation direction and an operation for determining the parameters to be set from an information terminal used by a user. The light source control unit transmits control information for controlling the light source based on the contents received by the reception unit.

[0043] [Processing flow in the control device 1] 6 is a flowchart showing the flow of processing in the control device 1. The flowchart shown in FIG.

[0044] The acquisition unit 131 acquires image data (S01). The image analysis unit 132 analyzes the image data acquired by the acquisition unit 131 and identifies reflection points included in the image data (S02). The imaging device control unit 133 controls the adjustment mechanism of the imaging device 2 (S03). More specifically, the imaging device control unit 133 determines parameters for controlling the adjustment mechanism based on the positions of the identified reflection points in the acquired image data, and transmits control information including the determined parameters to the imaging device 2.

[0045] The image analysis unit 132 identifies the blinking pattern of the reflection point (S04). The image analysis unit 132 determines whether the blinking pattern of the reflection point matches a predetermined blinking pattern (S05). If it matches the predetermined blinking pattern (YES in S05), the imaging device control unit 133 controls the imaging device 2 according to the blinking pattern (S06). More specifically, the imaging device control unit 133 transmits control information to the imaging device 2 for controlling the imaging device 2 to change the settings according to the matching blinking pattern. The control device 1 waits for a predetermined time (S07) and proceeds to the process at S04.

[0046] If there is no match with the predetermined blinking pattern (NO in S05), the control device 1 ends the process.

[0047] <Modification> The imaging device may be configured to analyze an image captured by the imaging device and determine the angle of view. Fig. 7 is a block diagram showing the configuration of an imaging device 2A according to a modified example. The imaging device 2A has an imaging means 21, an adjustment mechanism 22, a communication unit 23, a storage unit 24, and a control unit 25. The control unit 25 has an image analysis unit 251, an angle of view control unit 252, and a setting unit 253.

[0048] The imaging means 21 is, for example, an imaging element. Image data is generated based on light incident through a lens. The adjustment mechanism 22 adjusts the imaging direction and angle of view of the imaging device 2A. The adjustment mechanism 22 is, for example, a two-axis or three-axis rotation mechanism.

[0049] The communication unit 23 is a communication interface for transmitting and receiving data to and from other devices via a network. The storage unit 24 is a storage medium including a ROM, a RAM, an SSD, a hard disk drive, etc. The storage unit 24 may be a storage medium mounted on the imaging device 2A. The storage unit 24 stores in advance a program to be executed by the control unit 25.

[0050] The control unit 25 is, for example, a processor such as a CPU. The control unit 25 executes the programs stored in the storage unit 24 to function as an image analysis unit 251, a view angle control unit 252, and a setting unit 253.

[0051] The processing of the image analysis unit 251 overlaps with that of the image analysis unit 132 already described, so a detailed description will be omitted. The image analysis unit 251 identifies reflection points based on image data generated by the imaging means 21.

[0052] The angle-of-view control unit 252 controls the adjustment mechanism 22 so that one or more reflection points are included in a predetermined position in an image captured by the imaging means. The processing of the angle-of-view control unit 252 also overlaps with the processing of the imaging device control unit 133 already described, and therefore a detailed description thereof will be omitted.

[0053] When the image analysis section 251 identifies a predetermined blinking pattern, the setting section 253 reflects the setting corresponding to the identified blinking pattern.

[0054] In the imaging device 2A according to the modified example, it is possible to easily configure a system, which has the effect of reducing the effort required for installing a surveillance camera.

[0055] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0056] 1 Control device 2. Imaging device 3 light source 11 Communications Department 12 Storage section 13 Control section 21 Imaging means 22 Adjustment mechanism 23 Communications Department 24 Memory section 25 Control Unit 131 Acquisition Department 132 Image Analysis Unit 133 Imaging device control section 251 Image Analysis Unit 252 Angle of view control section 253 Setting section

Claims

1. A control device for controlling an imaging device having an adjustment mechanism for adjusting an imaging direction and an angle of view, an acquisition unit that acquires image data captured by the imaging device; an image analysis unit that analyzes the acquired image data and identifies one or more reflection points of the laser beam included in the image data and that are referenced for setting an imaging direction and an angle of view of the imaging device; an imaging device control unit that controls the adjustment mechanism so that the one or more reflection points are included in a predetermined position in an image captured by the imaging device; A control device having the above configuration.

2. The acquisition unit acquires the image data, which is a moving image; The image analysis unit identifies a blinking pattern included in the image data, which is a pattern in which reflected light reflected from the reflection point blinks, When the blinking pattern identified by the image analysis unit is a predetermined pattern, the imaging device control unit controls the adjustment mechanism to perform a setting according to the blinking pattern. The control device according to claim 1 .

3. The image analysis unit identifies a color of the reflection point included in the image data, the imaging device control unit controls the imaging device when the reflection point of the predetermined color is identified. The control device according to claim 1 or 2.

4. The imaging device control unit determines an adjustment amount of the angle of view so that the one or more reflection points are located at a reference point that is predetermined as a position at which the reflection points should be captured in the angle of view captured by the imaging device 2, and controls the adjustment mechanism based on the determined adjustment amount. The control device according to claim 1 or 2.

5. The computer executes 1. A control method for controlling an imaging device having an adjustment mechanism for adjusting an imaging direction and an angle of view, comprising: acquiring image data captured by the imaging device; A step of analyzing the acquired image data and identifying one or more reflection points of the laser beam included in the image data, which are used to set an imaging direction and an angle of view of the imaging device; controlling the adjustment mechanism so that the one or more reflection points are included at predetermined positions in an image captured by the imaging device; The control method includes:

6. an adjustment mechanism for adjusting an imaging direction and an angle of view; An imaging means for capturing an image and generating image data; an image analysis unit that analyzes the image data generated by the imaging means and identifies one or more reflection points of the laser beam included in the image data that are referenced for setting an imaging direction and an angle of view; a view angle control unit that controls the adjustment mechanism so that the one or more reflection points are included at a predetermined position in the image captured by the imaging unit; An imaging device having the above configuration.

Images