Control device, control method, and program

Abstract

To provide a technique that reduces the possibility of unnecessary changes to the imaging angle of view.SOLUTION: A control device is for sequentially capturing images at multiple imaging angles of view corresponding to multiple positions, in which position identification means identifies the position of a wireless device. Determination means determines whether to shift the imaging angle of view to a first imaging angle of view of the multiple imaging angles of view. When the determination means determines that the imaging angle of view should be shifted to the first imaging angle of view, the control means shifts the imaging angle of view to the first imaging angle of view. When the determination means determines that a specific wireless device associated with the first imaging angle of view is present within the first imaging angle of view or that the specific wireless device will move within the first imaging angle of view, the determination means determines that the imaging angle of view should be shifted to the first imaging angle of view.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a control technique for imaging. [Background technology]

[0002] In recent years, imaging devices (remote cameras) capable of changing the imaging direction in the pan and tilt directions have become known. Such imaging devices often also have a zoom function and are generally called PTZ (pan-tilt-zoom) cameras. Some such imaging devices have a function called a preset function, which allows a user to store a desired imaging angle of view in advance. Information indicating the imaging angle of view is stored, and when preset information indicating the preset is specified, the imaging device changes the imaging direction and zoom magnification to the specified imaging angle of view. Here, the imaging direction can be expressed as, for example, coordinate values ​​representing the angle of the pan direction (horizontal direction) (pan angle) and the angle of the tilt direction (vertical direction) (tilt angle). By storing these and the zoom magnification, a desired imaging angle of view can be stored. There is also a preset rotation function that sets multiple preset information in advance and rotates through the multiple imaging angles of view indicated by the multiple preset information.

[0003] When the preset patrol function is used for video production, a capturing angle of view (preset information) may be specified to capture a specific person such as a presenter. However, if the person is not within the specified angle of view after the angle of view is changed, the capturing angle of view will have been changed unnecessarily.

[0004] Patent Document 1 describes a technique in which, when an abnormal value is detected from a sensor device installed in a space, a predetermined angle of view that captures the abnormal area is added to the preset tour route.

[0005] Furthermore, in Patent Document 2, a pressure sensor is attached to an object present at a location where an image is to be captured using a preset tour function. In Patent Document 2, when a preset tour is performed, a preset movement is performed when an event is detected from a sensor device present at the next tour destination. On the other hand, when an event is not detected, the angle of view is not moved by the preset tour but skipped, and a determination is made as to whether a preset movement to the next tour destination (image capture angle of view) is possible. However, in applications such as video production, there is a demand to capture an image of a specific subject when it is in a specific position, and Patent Document 2 cannot solve this problem. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent Publication No. 2021-121081 [Patent Document 2] Patent Publication No. 2005-124124 Summary of the Invention [Problem to be solved by the invention]

[0007] In video production applications, there is a demand for capturing an image of a specific subject in a specific position. In other words, if the specific subject is not in a specific position, capturing an image of that location may result in the angle of view being changed unnecessarily.

[0008] Therefore, an object of the present invention is to provide a technique for reducing the possibility of changing the imaging angle of view unnecessarily. [Means for solving the problem]

[0009] In order to solve the above problem, a control device of the present invention has the following configuration: That is, a control device for sequentially capturing images at a plurality of imaging angles of view corresponding to a plurality of positions includes: position identification means for identifying a position of a wireless device; determination means for determining whether to shift the imaging angle of view to a first imaging angle of view among the plurality of imaging angles of view; and control means for shifting the imaging angle of view to the first imaging angle of view when the determination means determines that the imaging angle of view should be shifted to the first imaging angle of view, and when the determination means determines that a specific wireless device associated with the first imaging angle of view is present within the first imaging angle of view or that the specific wireless device will move into the first imaging angle of view, the determination means determines to shift the imaging angle of view to the first imaging angle of view. [Effects of the Invention]

[0010] According to the present invention, it is possible to reduce the possibility of changing the imaging angle of view unnecessarily. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a system according to a first embodiment. [Figure 2] FIG. 1 is a diagram illustrating an example of a functional block diagram of the first embodiment. [Figure 3] FIG. 10 is a diagram illustrating an example of a flowchart of preset cyclic processing according to the first embodiment. [Figure 4] 10 is a diagram illustrating an example of a method for registering a device ID of a wireless transmission device that is permitted to have preset movement according to the first embodiment. FIG. [Figure 5] FIG. 10 is a diagram illustrating an example of a flowchart of preset movement determination processing according to the first embodiment. [Figure 6] 10A to 10C are diagrams illustrating examples of subject movement in preset movement determination according to the first embodiment. [Figure 7] FIG. 1 is a diagram illustrating an example of a hardware configuration according to a first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The embodiments described below are merely examples of implementations of the present invention. The present invention may be modified or changed as appropriate depending on the configuration and various conditions of the device to which the present invention is applied, and is not necessarily limited to the following embodiments. Furthermore, not all of the combinations of configurations described in the embodiments are necessarily essential to the solution of the present invention. Furthermore, the term "video" below does not necessarily refer to video but may also refer to still images. Furthermore, in the following description, "preset movement" refers to changing the imaging angle of view to the next imaging angle of view defined in the preset cycling function. In other words, this refers to a process of changing the imaging direction of the imaging device in the pan direction or tilt direction or by changing the zoom magnification to change the imaging angle of view to the next imaging angle of view. Furthermore, the present invention can be used for video production applications, but of course, it can also be used for other video-related applications, such as surveillance applications.

[0013] First Embodiment Fig. 1 is a diagram showing an example of a system configuration in this embodiment. The system includes an imaging device (control device) 101, an information terminal 102, a wireless transmitting device 103, a wireless receiving device 104, and networks 106 and 107. Fig. 1 also includes a subject 105 as an imaging target. An example will be described in which the imaging device 101 functions as the control device of this embodiment. However, the function as the control device may be provided by a device other than the imaging device 101 (for example, the information terminal 102).

[0014] The image capturing device 101 distributes video and performs various controls via wired or wireless networks 106 and 107 .

[0015] The information terminal 102 is connected to the imaging device 101 via a network 106, and is set in advance in the imaging device 101 via a browser. A user can register multiple angles of view (hereinafter referred to as presets or preset positions as appropriate) specified by an imaging direction and zoom magnification as preset positions via the information terminal 102. These multiple preset positions correspond to multiple imaging target positions, and images are captured at these positions in order.

[0016] In the case of an imaging device that does not have a zoom function, the information on the zoom magnification may be omitted.

[0017] When a certain preset is selected by the user from among a plurality of registered presets, the information terminal 102 issues an instruction (command) to the imaging device 101 to move the angle of view to that preset.

[0018] The wireless transmitting device 103 and the wireless receiving device 104 are, for example, equipped with a wireless communication module conforming to the direction detection function of the Bluetooth (registered trademark) 5.1 specification, and are connected via a network 106. Hereinafter, in this embodiment, it is assumed that the wireless transmitting device 103 is carried by the subject 105. Furthermore, it is assumed that the wireless receiving device 104 is built into the imaging device 101, but this is not limiting. For example, the wireless receiving device 104 may be disposed outside the imaging device 101, and reception information may be transmitted from the external wireless receiving device 104 to the imaging device 101 via a network.

[0019] The network 106 is a network for connecting the image capture device 101 and the information terminal 102. In this embodiment, the communication form of the network 106 is wired, but it can also be implemented wirelessly.

[0020] The network 107 complies with wireless communication standards such as Bluetooth (registered trademark) and Ultra Wide Band (registered trademark), for example, and enables mutual communication with the wireless transmitting device 103 and the wireless receiving device 104. In this embodiment, the communication form of the network 107 is wireless because it places few restrictions on the movement of the subject and is easy to use in practice, but it can also be implemented using a wired connection.

[0021] FIG. 2 is a functional block diagram of the imaging device 101 of the system.

[0022] The imaging device 101 includes an imaging unit 201, a lens control unit 202, a driving unit 203, an A / D conversion unit 204, a video signal processing unit 205, a wired communication processing unit 206, a wireless communication processing unit 207, a storage unit 208, and a control unit 209. Each unit will be described below.

[0023] The imaging unit 201 has a zoom lens, a focus lens, an aperture, and an image sensor. The zoom lens and focus lens are moved on the optical axis by a lens control unit 202. The aperture is operated by the lens control unit 202. The image sensor converts light that has passed through the zoom lens, focus lens, and aperture into an electrical signal by photoelectric effect. This electrical signal is amplified by an amplifier and output to an A / D conversion unit 204.

[0024] The driving unit 203 is made up of a pan driving unit and a tilt driving unit, and can rotate the imaging unit 201 in the horizontal direction (pan direction) and the vertical direction (tilt direction) by controlling it via an actuator (not shown).

[0025] The A / D conversion unit 204 converts the electrical signal into a digital signal and outputs it to the video signal processing unit 205 .

[0026] The video signal processor 205 performs various image processing on the digital signal to generate a video signal. The various image processing processes include defect correction, gamma processing, noise reduction, and the like.

[0027] The wired communication processing unit 206 processes network communications with the information terminal 102 via the network 106 .

[0028] The wireless communication processing unit 207 performs processing for wireless communication with the wireless transmission device 103 via the network 107. In this embodiment, the wireless communication processing unit 207 is included in the imaging device 101, but this is not limiting. For example, a device having the wireless communication processing unit 207 may be disposed outside the imaging device 101, and the processing contents may be transmitted to the imaging device 101 via the network 106 or 107.

[0029] The storage unit 208 can be realized by a ROM, a RAM, a storage device, or the like. The ROM is a non-volatile memory such as an EEPROM or a flash memory, and the RAM is a volatile memory such as an SRAM or a DRAM. The storage device is an HDD or an SSD, for example. Programs for realizing the functions of this embodiment and data used when the programs are executed are stored in the ROM or the storage device. These programs and data are loaded into the RAM as appropriate under the control of the control unit 209, and are executed by the control unit 209 to function as each unit in this embodiment.

[0030] The control unit 209 can be realized by, for example, a central processing unit (CPU). The control unit 209 has a wireless position specifying unit 2091, a preset position registering unit 2092, a preset tour setting unit 2093, a wireless device ID registering unit 2094, a preset movement determining unit 2095, and a PTZ control unit 2096 in this embodiment. Each unit will be described below.

[0031] The wireless position identification unit 2091 calculates the direction of arrival of radio waves transmitted from the wireless transmission device 103 attached to the subject 105, and identifies the relative position between the image capture device 101 and the wireless transmission device 103. A method for identifying the relative position may include, for example, a direction detection function conforming to the Bluetooth (registered trademark) 5.1 specification. Other identification methods such as Angle of Departure (AoD) may also be used.

[0032] The preset position registration unit 2092 registers preset positions (positions of the angle of view) to which the image capturing device 101 moves.

[0033] The preset patrol setting unit 2093 sets the patrol route of the preset positions (the order in which images are taken) and the movement time when the angle of view is moved between each preset. For example, this information is input in advance by the user.

[0034] Furthermore, a preset number is assigned to each preset position in the order according to the preset circular route. Here, the preset positions set as the preset circular route do not need to include all of the preset positions registered by the preset position registration unit 2092, and may include only arbitrary preset positions.

[0035] The wireless device ID registration unit 2094 associates the device ID of the wireless transmission device with each preset number registered by the preset position registration unit 2093. Details will be described later.

[0036] The preset movement determination unit 2095 determines whether or not to perform preset movement (movement of the angle of view) to the next preset tour destination, as will be described in detail later.

[0037] The PTZ control unit 2096 controls the driving of pan, tilt, and zoom using the lens control unit 202 and the drive unit 203 based on the setting values ​​set by the preset cycling setting unit 2093. The PTZ control unit 2096 controls the lens control unit 202 and the drive unit 203 so that images are captured in order at each of the angles of view specified by the multiple presets, according to the preset cycling path.

[0038] An example of the preset cyclic processing of this embodiment is shown in the flowchart of FIG.

[0039] In step S301, the wireless location identification unit 2091 receives radio waves transmitted from the wireless transmission device 103 at the wireless reception device 104, thereby acquiring location information of the wireless transmission device 103 relative to the imaging device 101. This location information of the wireless transmission device 103 includes, for example, information indicating an azimuth angle, information indicating an elevation angle, and information indicating a distance. In this embodiment, a wireless transmission device is carried for each subject, and location information is acquired for each wireless transmission device at regular time intervals. In addition, a specific device ID is assigned to each wireless transmission device, and the device ID is stored in the storage unit 208 in association with the location information of the wireless transmission device 103.

[0040] In step S302, the preset position registration unit 2092 registers the preset positions to which the imaging device 101 will patrol.

[0041] In step S303, the preset patrol setting unit 2093 sets a preset patrol route and a movement time T required to move the angle of view between each preset. A preset number is assigned to each preset position in the order of the patrol route. The movement time T can be freely set within the range of pan / tilt / zoom speeds that the imaging device 101 can drive.

[0042] In step S304, the device ID of the wireless transmission device is associated with the preset position registered in step S302 to determine whether to perform a preset movement (movement of the angle of view), as will be described in detail later with reference to FIG.

[0043] In step S305, an initial value of the preset number i, which is the start position of the preset tour, is set. In this embodiment, the initial value of the preset number i is set to 1, but this is not limiting. For example, a value other than 1 may be set as the initial value. Numbers 1 to 3 are assigned to each preset position, and if the initial value is 1 and the preset movement determination conditions described below are met, imaging is performed as follows. That is, imaging is performed sequentially in the order of preset number 1, preset number 2, and preset number 3.

[0044] In step S306, a preset movement determination process is performed, the details of which will be described later with reference to FIG.

[0045] In step S307, 1 is added to the preset number i to move to the next preset position.

[0046] In step S308, it is determined whether the next preset number i to move to has been set in step S303. If it has been set, the process proceeds to step S306, and if it has not been set, the process proceeds to step S305.

[0047] Next, an example of the detailed processing of step S304 will be described with reference to FIG.

[0048] FIG. 4 is a diagram showing an example of processing for associating a device ID of a wireless transmission device with each preset position (angle of view) in order to determine whether to execute a preset movement (movement of the angle of view).

[0049] In this example, the GUI has check boxes and device IDs of wireless transmission devices registered by the wireless device ID registration unit 2094 for each preset position registered by the preset cycle setting unit 2093. For example, if either a wireless transmission device with device ID 1 or 4 exists in Preset 1, and preset movement to Preset 1 is permitted, the check boxes to the left of Device ID 1 and 4 are checked. If only one or both of Device IDs 2 and 3 with unchecked check boxes exist in Preset 1, the setting is such that preset movement to that preset is not permitted. In this case, if Device ID 1, which permits preset movement, and Device ID 2, which does not permit preset movement, exist in Preset 1, priority is given to permitting preset movement, and preset movement is performed. Regarding these, processing is performed to associate each preset position with the device IDs of one or more wireless transmission devices for which preset movement is permitted.

[0050] Next, an example of the detailed processing of step S306 executed by the control unit 209 will be described with reference to the flowchart in Fig. 5. Fig. 5 shows the processing for determining whether to move to the next preset position. Here, if it is determined that the preset movement is not to be performed, that preset position is skipped.

[0051] Here, it is assumed that the wireless transmission device 103 (subject 105) in FIG. 6 is the wireless transmission device 103 that has been set as a device for determining whether to move to preset i+1 by the GUI in FIG.

[0052] In step S501, the travel time T from preset i to preset i+1 is acquired. Here, the travel time T is a time that is set in advance by the preset tour setting unit 2093.

[0053] In step S502, it is determined whether the wireless transmission device associated with preset i+1 will be within the imaging angle of view of preset i+1 after T seconds (a predetermined time) from the position information acquired continuously or intermittently (for example, every 0.5 seconds) in step S301. The position of each wireless transmission device is determined at least at regular time intervals.

[0054] For example, as shown in FIG. 6(a), if it is determined from the position information acquired continuously or intermittently that the subject 105 is moving in a certain unique direction and that the subject 105 will move into the angle of view of the preset i+1 after T seconds, the process proceeds to step S503.

[0055] As shown in FIG. 6(b), if it is determined from the position information acquired continuously or intermittently that the subject 105 is not moving in a specific direction and that the subject exists outside the imaging angle of view of the preset i+1 after T seconds, the preset movement determination process is terminated.

[0056] Also, as shown in FIG. 6(c), if it is determined from the position information acquired continuously or intermittently that the subject 105 is moving in a certain unique direction and that the subject will move from within the angle of view of the preset i+1 to outside the angle of view after T seconds, the preset movement determination process is terminated.

[0057] 6(d), if it is determined from the position information acquired continuously or intermittently that the subject 105 is moving in a specific direction and will remain within the angle of view of the preset i+1 after T seconds, the process proceeds to step S503. In this embodiment, the position of the wireless transmission device after T seconds is estimated based on the position information, but this is not limited to this. For example, an imaging device that continues to capture images of the subject 105 may be prepared separately from the imaging device 101, and the position of the subject 105 after T seconds may be determined from information from this imaging device.

[0058] Note that if it is determined that the wireless transmission device 103 that is not set as a device for determining whether to move to preset i+1 is present (or will move) within the angle of view of preset i+1, the process does not proceed to step S503 and ends the preset movement determination process.

[0059] In step S503, pan / tilt drive is performed to the imaging angle of view of preset i+1 by the PTZ control unit 2096. The zoom magnification is also changed as necessary.

[0060] As described above, it is determined whether a specific wireless device (specific subject) exists (or moves) within a preset position (angle of view), and if it is determined that the specific wireless device does not exist, the angle of view is not moved to that preset position. In other words, even if a wireless device other than the specific wireless device exists within the angle of view indicated by the preset, the angle of view is not moved to that angle of view. In other words, the movement to that angle of view is skipped, and a determination is made as to whether to move to the next angle of view. This reduces the possibility of unnecessary changes to the imaging angle of view.

[0061] Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0062] (Other Examples) Next, a hardware configuration for realizing each function of the control device according to the embodiment of the present invention will be described with reference to Fig. 7. Note that each component of the imaging device in each embodiment, other than the imaging element and lens, may also be realized by the hardware configuration shown in Fig. 7.

[0063] A RAM (Random Access Memory) 1102 temporarily stores computer programs executed by a CPU (Central Processing Unit) 1101. The RAM 1102 also temporarily stores data (commands and video data) acquired from the outside via a communication interface 1104. The RAM 1102 also provides a work area used by the CPU 1101 when executing various processes. The RAM 1102 also functions as, for example, a frame memory or a buffer memory.

[0064] The CPU 1101 executes computer programs stored in the RAM 1102. In addition to the CPU, a processor such as a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit) may also be used.

[0065] An HDD (Hard Disk Drive) 1103 stores operating system programs and video data, as well as computer programs.

[0066] Computer programs and data stored in the HDD 1103 are loaded into the RAM 1102 as needed under the control of the CPU 1101, and executed by the CPU 1101. Other storage media than the HDD, such as flash memory, may also be used. A bus 1105 connects the various pieces of hardware. The various pieces of hardware exchange data via the bus 1105. The above is the hardware configuration in each embodiment.

[0067] The present invention can also be realized by a process in which one or more processors read and execute a program that realizes one or more functions of the above-described embodiments. The program may be supplied to a system or device having a processor via a network or a storage medium. The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more functions of the above-described embodiments.

[0068] The control device in each embodiment may be realized by the hardware shown in Fig. 7 or by other hardware, or may be realized by software.

[0069] Furthermore, the present invention is not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present invention. For example, combinations of the embodiments and modifications are also included in the disclosure of this specification. [Explanation of symbols]

[0070] 101 Imaging device 2091 Wireless location identification section 2095 Preset movement judgment unit 2093 Preset Tour Setting Section 2096 PTZ control unit

Claims

1. A control device for sequentially capturing images at a plurality of image capturing angles corresponding to a plurality of positions, a location determination means for determining the location of the wireless device; a determination means for determining whether to move the imaging angle of view to a first imaging angle of view among the plurality of imaging angles of view; a control means for moving the imaging angle of view to the first imaging angle of view when the determination means determines that the imaging angle of view should be moved to the first imaging angle of view; and When the determination means determines that a specific wireless device associated with the first imaging angle of view is present within the first imaging angle of view or that the specific wireless device moves within the first imaging angle of view, the determination means determines to move the imaging angle of view to the first imaging angle of view. A control device characterized by:

2. The location identification means identifies the locations of the wireless devices based on a function of detecting the direction of wireless signals.

2. The control device according to claim 1.

3. The location specifying means specifies the locations of the plurality of wireless devices at regular time intervals.

2. The control device according to claim 1.

4. A plurality of specific wireless devices can be associated with one imaging angle of view; When the determination means determines that any one of the plurality of specific wireless devices will be present within the first imaging angle of view after a predetermined time, or that any one of the plurality of specific wireless devices will move within the first imaging angle of view after a predetermined time, the determination means determines to move the imaging angle of view to the first imaging angle of view.

2. The control device according to claim 1.

5. The determination means determines whether the specific wireless device is present within the first imaging angle of view after a predetermined time, and if it is determined that the specific wireless device is present, determines to move the imaging angle of view to the first imaging angle of view.

2. The control device according to claim 1.

6. When the determining means determines that the specific wireless device will move from within the first imaging angle of view to outside the first imaging angle of view after a predetermined time, the determining means determines not to move the imaging angle of view to the first imaging angle of view.

2. The control device according to claim 1.

7. A control method for sequentially capturing images at a plurality of image capturing angles corresponding to a plurality of positions, comprising: a location determination step of determining the location of the wireless device; a determination step of determining whether to move the imaging angle of view to a first imaging angle of view among the plurality of imaging angles of view; a control step of moving the imaging angle of view to the first imaging angle of view when it is determined in the determination step that the imaging angle of view should be moved to the first imaging angle of view; and In the determination step, when it is determined that a specific wireless device associated with the first image capture angle of view is present within the first image capture angle of view or that the specific wireless device will move within the first image capture angle of view, it is determined that the image capture angle of view should be moved to the first image capture angle of view. A control method comprising:

8. A program causing a computer to execute the control method according to claim 7.

Images