Imaging apparatus control apparatus and control method
The imaging device's control system addresses the issue of unnecessary imaging by detecting subject presence and adjusting parameters to minimize wasted footage.
Patent Information
- Application Number
- JP2023114202
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-07-12
- Publication Date
- 2025-01-24
AI Technical Summary
Existing imaging devices with preset functions continue to image areas without intended subjects due to subjects moving away from preset positions, resulting in unnecessary footage.
The imaging device is equipped with a control system that detects the presence of a subject at preset positions and adjusts imaging parameters such as stay time and movement routes to ensure imaging only occurs when the subject is present.
This system effectively reduces unnecessary imaging time by adjusting parameters when subjects are absent and ensures efficient capture of intended subjects.
Smart Images

Figure 2025011842000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a control device and a control method for an imaging device. [Background technology]
[0002] An imaging device capable of pan-tilt-zoom drive can operate the zoom lens and pan-tilt drive using a remote control device, and output a flexible image. A common function of an imaging device is to register the pan-tilt-zoom position information in advance in a memory, and output an image of the registered position (desired registered coordinates) by moving the imaging unit to the registered position at a specified timing (hereinafter referred to as a "preset function"). Patent Document 1 describes a technology in which an imaging device with a preset function changes a preset position, stay time, movement speed, etc. in response to event detection. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2021-121081 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the technology described in Patent Document 1 does not disclose control when a specific imaging target is no longer present at a preset position. Therefore, if a preset position is set in advance at a position where a person (specific imaging target) is assumed to be present and the camera is automatically rotated around the preset position, imaging will continue at that location as a preset position even if the person moves away from the preset position. As a result, imaging will continue in an area where there is no person, resulting in an image that is not as originally intended.
[0005] In view of the above-mentioned problems, an object of the present invention is to provide a control device that enables an imaging device to appropriately perform cyclic imaging. [Means for solving the problem]
[0006] In order to achieve the above-mentioned object, a control device according to one embodiment of the present invention is a control device that controls an imaging device having an imaging unit, and includes: a control means that controls the imaging unit to cycle through a plurality of imaging positions to capture images in a predetermined imaging order; a detection means that detects a predetermined imaging target; and a shortening means that, when the detection means does not detect the predetermined imaging target at any of the plurality of imaging positions, shortens the imaging time at that imaging position. Effect of the Invention
[0007] According to the present invention, the imaging device can appropriately perform cyclic imaging. [Brief description of the drawings]
[0008] [Figure 1] 1 is a diagram showing an imaging system including an imaging device according to a first embodiment of the present invention. [Diagram 2] 2 is a diagram for explaining a preset function of the imaging apparatus in FIG. 1; [Diagram 3] 2 is a flowchart showing an overview of processing executed by the imaging device of FIG. 1. [Figure 4] 2 is a flowchart showing details of a process executed by the imaging device of FIG. 1. [Diagram 5] FIG. 11 is a diagram for explaining a preset function according to the second embodiment of the present invention. [Figure 6] 10 is a flowchart showing a process executed by an imaging apparatus according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, the embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the present invention, and not all of the combinations of features described in the embodiments are necessarily essential to the solution of the present invention. The configuration of the embodiments may be appropriately modified or changed depending on the specifications of the device to which the present invention is applied and various conditions (conditions of use, environment of use, etc.). The technical scope of the present invention is determined by the claims, and is not limited by the individual embodiments below. Also, parts of each embodiment may be appropriately combined. In all figures, parts having the same function are given the same reference symbols, and repeated explanations thereof will be omitted.
[0010] First embodiment Hereinafter, an imaging system 10 including an imaging device 100 according to a first embodiment of the present invention will be described with reference to FIG. As shown in FIG. 1, the imaging system 10 includes an imaging device 100, other imaging devices 120a to 120n, a switcher 108, and a display device 109. The switcher 108 and the display device 109 are connected to the imaging device 100. The imaging device 100 has an imaging section 101. The display device 109 is connected to the switcher 108. The other imaging devices 120a to 120n are connected to the switcher 108. The display device 109 is, for example, a liquid crystal display. Note that a display device other than the display device 109 may be connected to the switcher 108.
[0011] The imaging device 100 of this embodiment is capable of zoom-pan-tilt operations, and has a preset function that can orient (move) the imaging unit 101 to a preregistered position at a predetermined zoom magnification during zoom-pan-tilt operations. When using the preset function, the imaging device 100 (imaging unit 101) moves to a preregistered position (preset position) according to a predetermined imaging sequence, stops (stays) for a predetermined time, and captures an image. In other words, the imaging device 100 (imaging unit 101) can capture an image by circulating multiple preset positions (imaging positions). For example, when the imaging device 100 with the preset function is used for studio imaging, the preset position, stay time, movement speed, etc. of the imaging unit 101 are set in advance during a rehearsal before imaging.
[0012] The imaging unit 101 has a zoom lens 101-1, a focus lens 101-2, an aperture 101-3, and an image sensor 101-4. The image sensor 101-4 is composed of an image sensor or the like. The zoom lens 101-1 is moved along the optical axis by the lens control unit 102. Similarly, the focus lens 101-2 is moved along the optical axis by the lens control unit 102. The aperture 101-3 is driven to operate by the lens control unit 102. The camera platform 103 is made up of a pan drive section and a tilt drive section, and is driven via a motor (actuator) 112a to rotate the imaging section 101 in the horizontal and vertical directions.
[0013] The image sensor 101-4 photoelectrically converts light that has passed through the zoom lens 101-1, the focus lens 101-2, and the aperture 101-3 to generate an analog image signal. The generated analog image signal is amplified by sampling and then output to an A / D conversion unit 104. The A / D conversion unit 104 converts the amplified analog image signal into a digital image signal and outputs it to a camera signal processing unit 105. The camera signal processing unit 105 performs various image processes on the digital image signal to generate a video signal.
[0014] The storage unit 106 is composed of a volatile memory (RAM such as SRAM or DRAM) and a non-volatile memory (ROM such as EEPROM or flash ROM). The storage unit 106 may also include a storage device such as an HDD (hard disk drive) or SSD (solid state drive). Programs for implementing the functions and processes according to this embodiment and data used when the programs are executed are stored in the storage unit 106. These programs and data are appropriately loaded into the storage unit (e.g., RAM) 106 via a bus 119 under the control of the CPU 116, executed by the CPU 116, and function as each unit according to this embodiment. The storage unit 106 may also include a removable storage medium such as a USB memory or an SD card. ROM is an abbreviation for Read Only Memory. EEPROM is an abbreviation for Electrically Erasable Programmable ROM. RAM is an abbreviation for Random Access Memory. SRAM is a static RAM, and DRAM is a dynamic RAM. USB is an abbreviation for Universal Serial Bus.
[0015] The storage unit 106 includes a preset information storage unit 107. The preset information storage unit 107 stores parameters related to preset tours such as preset positions, moving speeds, and stay times (resting times). The parameters are input from, for example, an external terminal device. More specifically, for example, the preset information storage unit 107 stores parameters related to presets transmitted from the switcher 108 or external terminal devices via a network.
[0016] The interface (I / F) 110 is various I / Fs related to input and output. The interface 110 is connected to an input device 111 such as an operation key, a keyboard, a mouse, etc. The interface 110 receives instruction information from the input device 111 and notifies the CPU 116 via a bus 119. The interface 110 is also connected to a display device 109, and displays information such as captured images and operation menus temporarily stored in the storage unit 106. The interface 110 may be connected to a network via a wired LAN or a wireless LAN. LAN is an abbreviation for Local Area Network.
[0017] The image analysis unit 114 is a processing unit that performs image analysis such as face detection, human detection, moving object detection, passage detection, etc. The image analysis result is notified to the CPU 116 via the bus 119. The compression / decompression unit 115 performs compression processing on the captured image to generate compressed data in accordance with a control instruction from the CPU 116 via the bus 119. The compressed data is output via the interface 110 to the display device 109 or a network.
[0018] The CPU 116 is a central processing unit. The CPU 116 is a control unit that performs overall control of the imaging device 100. The CPU 116 has a drive unit 117 and a circulating unit 118. The CPU 116 is implemented by a chip having a calculation function such as an IC, an MCU, an ASIC, or an FPGA. The imaging device 101 (CPU 116) has a function for performing image processing on video data captured by the imaging unit 101 and distributing the processed video data.
[0019] The CPU 116 calculates a target value from the data related to the preset control coordinates read from the preset information storage unit 107, issues a drive command to the drive unit (motor driver) 117, and drives the motors 112a and 112b. The motor 112a drives the pan head 103. The motor 112b moves the focus lens 101-1 in the optical axis direction under the control of the lens control unit 102, thereby performing zoom and focus of the imaging device 100. Although one motor 112a is shown on the pan head 103 in FIG. 1, a motor for panning and a motor for tilting are actually provided. Although one drive unit 117 is shown on the CPU 116 in FIG. 1, multiple drive units 117 may be provided. For example, one drive unit 117 may have multiple channels capable of driving multiple motors 112a and 112b, or multiple drive units 117 may have only the number of channels for driving each of the multiple motors 112a and 112b.
[0020] The driving unit 117 controls the driving of pan, tilt, and zoom (hereinafter, may be referred to as "PTZ driving") using the lens control unit 102 and the camera platform 103. The driving unit 117 also analyzes device information of the lens control unit 102 and the camera platform 103, and can obtain pan, tilt, and zoom values.
[0021] The patrol unit 118 controls the overall processing of the preset patrol function in the imaging device 100. The patrol unit 118 controls the PTZ drive of the imaging unit 101 via the drive unit 117 based on setting rules that define the order of patrolling the preset positions (imaging order), the drive speed (movement speed) during patrol, the preset still time (stay time), and the like.
[0022] The video data output from the imaging device 100 is output from the interface 110 to external devices (the switcher 108 and the display device 109). The interface 110 is connected to the switcher 108 and the display device 109 by a wired connection conforming to standards such as SDI, MIPI, and HDMI (registered trademark). A connection conforming to a standard such as SDI is suitable for transmitting an image from the imaging device 100 to the display device 109. SDI is an abbreviation for Serial Digital Interface. MIPI is an abbreviation for Mobile Industry Processor Interface. HDMI is an abbreviation for High-Definition Multimedia Interface. The interface 110 may be connected to the switcher 108 and the display device 109 wirelessly. The external devices connected to the interface 110 are not limited to the switcher 108 and the display device 109. For example, a peripheral device other than the display device 109 may be connected to the interface 110, or a server or a terminal device (such as a personal computer, a smartphone, or an IP controller) may be connected to the interface 110. The image of the imaging device 100 may be distributed from the interface 110 to an external device (such as a server or a terminal device) via a network such as IP distribution. A storage medium (storage medium) such as an SD card can also be connected to the interface 110. SD is an abbreviation for Secure Digital.
[0023] In the imaging system 100 including the multiple imaging devices 100, 120a to 120n, the switcher 108 decides (switches) which imaging device's image is to be displayed on the display device 109. The switcher 108 also has a function of switching the imaging device to which instructions such as changing the preset position are to be given. In this specification, the preset refers to a function of driving all the driving systems such as pan, tilt, zoom, and focus to a previously specified destination.
[0024] Some of the functional modules (104, 105, 114, 115, 117, 118) included in the imaging device 100 shown in FIG. 1 may be realized by hardware. In the case of hardware realization, for example, a specific compiler may be used to automatically generate a dedicated circuit on an FPGA from a program for realizing the function of each functional module. FPGA is an abbreviation for Field Programmable Gate Array. Also, a gate array circuit may be formed in the same manner as an FPGA and realized as hardware. Also, it may be realized by an ASIC (Application Specific Integrated Circuit). Note that the configuration of the functional modules shown in FIG. 1 is an example, and a plurality of functional modules may constitute one functional module, or any of the functional modules may be divided into modules performing a plurality of functions.
[0025] The control contents of this embodiment will be described below with reference to FIG. 2. In this embodiment, it is assumed that a video is produced by imaging (preset patrol imaging) in a studio or the like, but the application is not necessarily limited to this. When imaging in a studio or the like, the use of a system in which one imager images multiple imaging positions is increasingly used to reduce the number of people required. In such a case, preset driving is used as a function for automatically driving the imaging device to image multiple locations in the studio. In this case, the positions to be preset driven before imaging are set in advance by an IP controller (not shown), a switcher 108, or the like.
[0026] In this embodiment, a case will be described in which a preset position is set in advance at a location where a person (imaging subject) is expected to be present during imaging in a studio or the like, and imaging device 100 performs a patrol operation (patrol imaging). FIG. 2(a) shows an overall view of a studio where video production and the like is performed. In this embodiment, it is assumed that four preset positions (preset positions 201 to 204) are set. It is assumed that the imaging unit 101 of the imaging device 100 is set to be driven from the preset position 201 to the preset position 202, the preset position 203, and the preset position 204 in this order, and to return to the preset position 201. It is assumed that the optical axis of the imaging unit 101 passes through a movement path 205 when moving from the preset position 201 to the preset position 202, and passes through a movement path 206 when moving from the preset position 202 to the preset position 203. It is assumed that the optical axis of the imaging unit 101 passes through a movement path 207 when moving from the preset position 203 to the preset position 204, and passes through a movement path 208 when moving from the preset position 204 to the preset position 201.
[0027] Assume that a person (e.g., a presenter) 211 is located at preset position 201, and a person (e.g., an assistant) 212 is located at preset position 202. Assume that a monitor 220 is placed at preset position 203, and a person 213 making a remote appearance is displayed on the monitor 220. Assume that people 214 watching the image capture in a studio are located at preset position 204. In this embodiment, the people 211-214 are the subjects of image capture. Preset positions are set in advance at places where the people 211-214 are expected to be located during image capture in a studio, etc., and the image capture device 100 performs a patrol operation.
[0028] Consider a case where the person to be imaged moves away from the preset position (preset position) due to the movement of the person or a change in the situation during image capture. Specifically, consider a case where the remote appearance of the person 213 who was displayed on the monitor 220 ends, and nothing is displayed on the monitor 220 as shown in FIG. 2(b). In this case, if the preset (circulation) setting of the imaging device 100 is not changed, the preset position 203 remains set as a position to be preset circulated, so the imaging device 100 circulates all preset positions from the preset position 201 to the preset position 204. Therefore, the preset position 203 where the person 213 is not present is imaged. Since the image captured at the preset position 203 does not include the object to be imaged (person 213), the image captured at the preset position 203 becomes unnecessary image (useless image). A method for not capturing such useless image will be described below.
[0029] If it is found before starting to capture the image of the preset position 203 that the person 213 has left the preset position 203, the imaging device 100 of this embodiment sets the stay time, which is one of the parameters of the preset function, to 0 seconds for the preset position 203. When the stay time is set to 0 seconds, in this embodiment, the optical axis of the imaging unit 101 passes through, for example, the curved movement path 210 shown in FIG. If the stay time at the preset position 203 is set to 0 seconds while keeping the setting of moving around using the linear movement paths 206 and 207 without adopting the curved movement path 210, a jerky image may occur near the preset position 203. For this reason, it is necessary to smooth the drive speed near the preset position 203 on the drive path 206 and the drive path 207. In this embodiment, the CPU 116 sets the movement path 210 as a new movement path. If the CPU 116 can determine that a person has left the angle of view while capturing an image of the preset position 203, the imaging unit 101 may move to the next preset position 204 without waiting for the previously set stay time. In other words, even if a predetermined imaging target is detected, if the imaging target cannot be detected before the imaging time set for that imaging position has elapsed, the imaging unit 101 may be caused to move to the next imaging position.
[0030] By switching the movement route 206 to the movement route 207 to the movement route 210, the time for capturing an image of an area without people is shortened by the stay time at the preset position 203 compared to the case where the switching is not performed, and it becomes possible to capture an image of an area with people (preset positions 201, 202, 204) efficiently. In this way, the CPU 116 shortens the image capturing time at the preset position 203. When no person is present at the other preset positions 201, 202, and 204, a process of changing the stay time setting to 0 seconds (stay time switching process) is also performed.
[0031] In this embodiment, the preset position 203 is not excluded from the preset tour, but the staying time at the preset position 203 is set to 0 seconds, so that the imaging unit 101 faces the preset position 203 (imaging of the preset position 203 is continued). Although the staying time at the preset position 203 is 0 seconds, the movement path 210 passes through the preset position 203. This is to return the staying time from 0 seconds to the initially set value when the person reappears on the monitor 220 (preset position 203), so that imaging can be performed at the preset position 203 (restored as the initial preset imaging position).
[0032] Hereinafter, a processing sequence in the imaging device 100 of this embodiment will be described with reference to Fig. 3 and Fig. 4. Fig. 3 shows a sequence only for control to change the stay time at the preset position 203 to 0 seconds. Fig. 4 shows a sequence including control to return the stay time to the initial setting value when a person reappears at the preset position 203 where the stay time was set to 0 seconds. In each step of Fig. 3 and Fig. 4, the CPU 116 executes processing based on a program read from the storage unit 106. In the figures, S stands for Step.
[0033] First, the basic processing sequence in this embodiment will be described with reference to Fig. 3. The flow chart in Fig. 3 starts when the power of the image capture device 100 is turned on (S301). The imaging device 100 is set to a preset rotation mode in which the imaging device 100 rotates among the preset positions 201 to 204 (S302). This setting is performed, for example, by the CPU 116 (FIG. 1) based on an instruction / signal input by the user of the imaging device 100 via the input unit 111 (FIG. 1), or by the CPU 116 based on a predetermined input signal input to the imaging device 100 from outside.
[0034] When capturing images of the preset positions 201 to 204, the imaging device 100 always determines whether or not a person is present at the preset positions 201 to 204 (S303). The detection of a person is performed by the image analysis unit 114, and the determination of whether a person is present at the preset positions 201 to 204 is performed by the CPU 116 based on the detection result of the image analysis unit 114. If it is determined that there is a person at the preset positions 201 to 204, S303 is repeated. That is, the preset patrol mode in which the camera patrols the preset positions 201 to 204 is continued. If it is determined that there is no person at the preset positions 201 to 204 (for example, preset position 203), the staying time at the preset position 203 is changed to 0 seconds before the preset position 203 is reached in the next preset tour (S304). By executing such processing, when the preset position 203 is imaged in the next tour after it is determined that there is no person at the preset position 203, the staying time (image capturing time) at the preset position 203 becomes 0 seconds. As a result, the time to capture an image of an area where there is no person (preset position 203) can be shortened.
[0035] Next, a sequence including a process of restoring a preset position 203 whose stay time has been set to 0 seconds to a preset position 203 with the initial stay time will be described with reference to FIG. S401 to S403 are the same as S301 to S303 in FIG. 3, so the description will be omitted. In S403, if it is determined that there is a person at the preset positions 201 to 204, the process proceeds to S404, and the setting of the preset tour set in S402 is continued. After S404, the process returns to S403.
[0036] If it is determined in S403 that there is no person at the preset positions 201 to 204 (for example, the preset position 203), the process proceeds to S405. S405 is the same as S304 in FIG.
[0037] After S405, when the next tour is performed, it is determined whether or not a person is present at the preset position 203 (staying time 0 seconds) (S406). The detection and determination of a person are performed by the image analysis unit 114 and the CPU 116. If it is determined in S406 that there is no person at the preset position 203, the current preset position setting is continued (S408). That is, the stay time setting for the preset position 203 is kept at 0 seconds even in the next tour. After S408, the process returns to S406. Therefore, until a person is detected at the preset position 203, the stay time setting for the preset position 203 is continued to be set at 0 seconds, and the preset tour is performed.
[0038] In S406, if it is determined that a person is again present at the preset position 203, the stay time for the preset position 203 is returned from 0 seconds to the initial setting value (initial stay time) set in S402. As a result, the preset position 203 is restored as a preset position for "staying for a predetermined time and capturing an image" (S407). After S407, the process returns to S403. By returning to S403, the process (control) of maintaining or changing the stay time at the preset position is repeated based on whether or not a person is present at the preset position in the subsequent tours.
[0039] By controlling as described above, when using the preset patrol function in video production, it is possible to shorten the time spent capturing images of areas without people, and reduce the time spent capturing unnecessary images that are not intended by the photographer. Also, when a person returns to a preset position, the setting can be returned so that capturing images at that preset position is performed for a specified time (initial setting time). As described above, according to the imaging device 100 of this embodiment, when a person (a predetermined imaging subject) is no longer present at a preset position, the settings (imaging time) related to the preset position can be dynamically changed (switched) during imaging.
[0040] In recent years, the number of people has been reduced, and even in studio shooting, instead of one camera operator being assigned to one camera, there are increasing cases where multiple cameras are operated by one person or a small number of people using a switcher, etc. The imaging device 100 of this embodiment can be applied to cases where one person uses a preset function to capture images at multiple imaging positions (preset positions).
[0041] In FIG. 2, the number of preset positions is four (reference numerals 201 to 204) and four drive directions (movement paths 205 to 208) are specifically illustrated, but the preset positions, the number, and the movement paths are not limited to those illustrated. In the above embodiment, the imaging device 100 is included in the imaging system 10. However, the imaging device 100 may be provided independently without being included in the imaging system 10. The components that execute the processes in FIGS. 3 and 4 (drive unit 117, circulator 118, preset information storage unit 107, etc.) may be separated from imaging device 100 as an imaging control device.
[0042] In the above description, when the person 213 has disappeared from the preset position 203, the stay time of the preset function for the preset position 203 is set to 0 seconds, but this embodiment is not limited to this. For example, instead of setting the stay time to 0 seconds, the stay time may be set to be shorter than the time previously set. By shortening the stay time, it is possible to shorten the imaging time at the preset position 203 where there is no person. The predetermined imaging target does not have to be a person, but may be, for example, an animal or a robot.
[0043] In the above embodiment, the preset position 203 is not excluded from the preset tour, but the stay time at the preset position 203 is set to 0 seconds. However, the preset position 203 may be excluded from the preset tour. In this case, the movement path from the preset position 202 to the preset position 204 does not need to pass through the preset position 203 like the movement path 210 in FIG. 2B, and may be a path that moves linearly from the preset position 202 to the preset position 204. For example, as shown in FIG. 2C, the linear path 210A may be moved. By not making the preset tour of the preset position 203, the time spent capturing unnecessary images can be reduced.
[0044] Second embodiment The second embodiment of the present invention will be described below with reference to Figures 5 and 6. In the following description, the same configurations and processes as those in the first embodiment are given the same reference numerals and descriptions thereof will be omitted. As shown in Fig. 5(a), in the second embodiment, imaging is performed cyclically at four preset positions. However, the four preset positions are preset positions 201, 202, 503, and 204. In the second embodiment, it is assumed that a moving object (a moving person) 501 is located at preset position 503. In the second embodiment, the monitor 220 is not provided. Fig. 5(a) shows imaging during the Nth cyclical operation.
[0045] When producing a video in a studio or the like, a person at a preset position may move out of the angle of view while capturing images by performing a preset tour. In Fig. 5, a scene is assumed in which a person 501 is detected at a preset position 503 and is walking in the direction of an arrow 502.
[0046] The imaging device 100 performs moving object detection at the preset positions 201, 202, 503, and 204 in addition to the person detection described in the first embodiment. Moving object detection means detecting the direction and speed of a moving object. If the moving object detection determines that the person 501 is moving at a predetermined speed (threshold) or faster, the following process is performed. In this embodiment, the predetermined speed (or faster) is assumed to be the speed at which the person 501 leaves the angle of view 509 when the imaging unit 101 faces the preset position 503 in the next round (N+1th round). This predetermined speed is a speed that changes depending on the angle of view. Therefore, the predetermined speed (threshold) for moving object detection when the zoom magnification is high is lower than the predetermined speed for moving object detection when the zoom magnification is low.
[0047] Assume that a person 501 moving at a predetermined speed (threshold) or more is determined to be at a preset position 503 by the motion detection performed in the Nth patrol imaging (FIG. 5(a)). In this case, as shown in FIG. 5(b), when the imaging unit 101 is driven to pan and tilt to the preset position 503 in the next patrol (N+1th patrol), a setting is made so that imaging can be performed at a wider angle of view 510 than the angle of view 509 at the preset position 503 in FIG. 5(a). That is, the CPU 111 and the driving unit 117 perform control to change the zoom magnification to the wider side so that imaging can be performed at the wider angle of view 510. The CPU 116 determines the angle of view 510 according to the moving speed of the person 501. When changing the zoom magnification to the wide side, it may be changed to the wide end or may be changed to a zoom magnification set in advance. It is to be noted that the center of the angle of view 509 and the angle of view 510 are the same.
[0048] By changing the zoom magnification (angle of view 509) initially set for the preset position 503 to the wide side (angle of view 510), even if the person 501 moves from the position at the previous tour (the position in FIG. 5(a)), the person 501 can be accommodated within the angle of view as long as the movement is within the enlarged area 504.
[0049] In subsequent tours (N+2 or later tours), preset tour imaging and human and moving object detection are performed at the angle of view 510 for the preset position 503 as shown in Fig. 5C. In other words, imaging and human and moving object detection are continuously performed at the angle of view 510 for the preset position 503 until the person 501 is no longer in the area 504 of the angle of view 510. When the person 501 is no longer at the preset position 503 (FIG. 5(d)), the time spent at the preset position 503 is set to 0 seconds, and the zoom magnification is returned to the previously set magnification (FIG. 5(a), angle of view 509). Then, the movement route from the preset position 202 to the preset position 204 is set to movement route 505 (similar to movement route 210 in FIG. 2(b)). After that, the control described in the first embodiment is executed until a person is detected again, and if a person is detected, it is determined whether the person is moving at or above a predetermined speed, and the above control is repeated.
[0050] 6, a control sequence when a moving person (moving object) 501 is present at the preset position 503 will be described. The same processes as those in the control of the first embodiment (FIG. 4) are denoted by the same reference numerals and description thereof will be omitted. 6 (S401 to S403) are the same as those in the first embodiment. If the determination result in S403 is Yes, the process proceeds to S604.
[0051] In S604, it is determined whether or not there is a moving object moving at a predetermined speed or faster within the angle of view (area) of the preset positions 201, 202, 503, and 204. If it is determined in S604 that there is no moving object moving at a predetermined speed or faster at the preset positions 201, 204, 503, and 204, the process proceeds to S404, where the preset tour set in S402 is continued while the human detection and moving object detection functions are operated. After S404, the process returns to S403.
[0052] If it is determined in S604 that a moving object (person) 501 moving at a predetermined speed or faster is present at the preset position 503, the process proceeds to S605. In S605, the CPU 116 performs a setting such that the zoom magnification is reduced and the angle of view is widened when capturing an image of the preset position 503 in the next tour (N+1th tour). Then, in the (N+1)th tour, it is determined whether or not the target moving object 501 is present at the preset position 503 (S606). If it is determined that the moving object 501 is present, the preset tour operation is continued at the angle of view 510 with the reduced zoom magnification (S607). After S607, the process returns to S606. If it is determined in S606 that there is no moving object 501, the CPU 116 returns the angle of view to the original angle of view (to angle of view 509) and changes the setting of the duration of stay at the preset position 503 to 0 seconds (S608). After S608, the process returns to S403.
[0053] By performing the above-described control, even if the person 501 moves from the location set in the preset position 503, the person 501 can be imaged as long as it falls within the wide angle of view 510 (area 504) of the imaging device 100.
[0054] Note that if the zoom magnification (angle of view 509 in FIG. 5A) set in the Nth cyclic imaging is the minimum zoom magnification (wide end) that can be set in the imaging device 100, the angle of view 509 cannot be further widened. In this case, the CPU 116 sets the stay time at the preset position 503 to 0 seconds.
[0055] The present invention can also be realized by supplying a program for implementing one or more of the functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. The above-mentioned embodiments are merely examples of the implementation of the present invention, and the technical scope of the present invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various forms without departing from its technical concept or main characteristics.
[0056] The disclosure of this embodiment includes the following configuration, method, and program. Configuration 1 A control device for controlling an imaging device having an imaging unit, a control means for controlling the imaging unit to capture images in a cyclic manner at a plurality of imaging positions in accordance with a predetermined imaging order; A detection means for detecting a predetermined imaging target; a shortening means for shortening an imaging time at one of the plurality of imaging positions when the predetermined imaging target is not detected by the detection means at the imaging position; A control device comprising: Configuration 2 2. The control device according to configuration 1, wherein, when the predetermined imaging target is not detected by the detection means, the reduction means reduces the imaging time at the imaging position to 0 seconds. Configuration 3 3. The control device according to claim 1, wherein when the predetermined imaging target is detected at the imaging position after the imaging time has been reduced by the reduction means, the reduction means returns the imaging time to an initial setting value. Configuration 4 4. The control device according to any one of configurations 1 to 3, wherein the control means does not exclude, from the predetermined imaging sequence, an imaging position where the predetermined imaging target is not detected by the detection means. Configuration 5 the imaging unit is set to capture images of the plurality of imaging positions cyclically along a predetermined route, 3. The control device according to configuration 2, wherein when the imaging time is shortened to 0 seconds, the control means changes the moving path of the imaging unit from the predetermined path.
[0057] Configuration 6 4. The control device according to any one of configurations 1 to 3, wherein the control means excludes an imaging position where the predetermined imaging target is not detected by the detection means from the predetermined imaging sequence. Configuration 7 The control device according to any one of configurations 1 to 6, characterized in that even if the detection means detects the specified imaging target, if the specified imaging target becomes undetectable before an imaging time set for that imaging position has elapsed, the control means causes the imaging unit to cycle to a next imaging position. Configuration 8 The control device further includes a determination unit for determining whether or not the predetermined imaging target is present, the determination unit being configured to determine whether or not the predetermined imaging target is present, the control device further including a determination unit for determining whether or not the predetermined imaging target is present, the determination unit being configured to determine ... The control device according to any one of configurations 1 to 7, characterized in that when the determination means determines that there is an imaging target moving at or above the predetermined speed at any one of the plurality of imaging positions, the control means increases the angle of view of the imaging unit at that imaging position. Configuration 9 The control device according to configuration 8, wherein the control means increases the angle of view so that the imaging unit can accommodate an imaging target moving at or above the predetermined speed within the angle of view of the imaging unit during the next cyclic imaging.
[0058] Configuration 10 10. The control device according to configuration 8 or 9, wherein the control means determines the angle of view in accordance with a moving speed of the imaging target. Configuration 11 11. The control device according to any one of configurations 8 to 10, wherein, when the imaging target moves out of the increased angle of view, the control means returns the angle of view to the original angle of view. Configuration 12 The control device according to any one of configurations 8 to 11, characterized in that when the control means increases the angle of view, the control means does not exclude from the predetermined imaging sequence an imaging position where it is determined that there is an imaging target moving at or above the predetermined speed. Configuration 13 The control device according to any one of configurations 8 to 12, characterized in that, when the control means is unable to increase the angle of view of the imaging unit, the shortening means shortens the imaging time at an imaging position where it is determined that there is an imaging target moving at or above the predetermined speed. Method 1 A control method for controlling an imaging device having an imaging unit, comprising: controlling the imaging unit to capture images in a cyclic manner at a plurality of imaging positions in accordance with a predetermined imaging order; detecting a predetermined imaging target; When the predetermined imaging target is not detected at any one of the plurality of imaging positions by the detecting step, shortening an imaging time at the imaging position; A control method comprising the steps of: program A program for causing a computer to function as each of the means possessed by the control device according to any one of configurations 1 to 13. [Explanation of symbols]
[0059] 100: imaging device, 101: imaging section, 107: preset information storage section, 114: image analysis section, 116: CPU, 117: driving section, 118: patrol section, 201-204: preset positions, 205-208: movement path, 211-214: imaging target
Claims
1. A control device for controlling an imaging device having an imaging unit, a control means for controlling the imaging unit to capture images in a cyclic manner at a plurality of imaging positions in accordance with a predetermined imaging order; A detection means for detecting a predetermined imaging target; a shortening means for shortening an imaging time at one of the plurality of imaging positions when the predetermined imaging target is not detected by the detection means at the imaging position; A control device comprising:
2. 2. The control device according to claim 1, wherein, when the predetermined imaging target is not detected by the detection means, the reduction means reduces the imaging time at the imaging position to 0 seconds.
3. 3. The control device according to claim 1, wherein, when the predetermined imaging target is detected at the imaging position after the imaging time has been reduced by the reduction unit, the reduction unit returns the imaging time to an initial setting value.
4. 2. The control device according to claim 1, wherein the control means does not exclude, from the predetermined imaging sequence, an imaging position where the predetermined imaging target is not detected by the detection means.
5. the imaging unit is set to capture images of the plurality of imaging positions cyclically along a predetermined route, 3. The control device according to claim 2, wherein, when the image capturing time is reduced to 0 seconds, the control means changes the moving path of the image capturing unit from the predetermined path.
6. 2. The control device according to claim 1, wherein the control means excludes from the predetermined imaging sequence an imaging position where the predetermined imaging target is not detected by the detection means.
7. 2. The control device according to claim 1, wherein even if the detection means detects the specified imaging target, if the specified imaging target becomes undetectable before an imaging time set for that imaging position has elapsed, the control means causes the imaging unit to cycle to a next imaging position.
8. The control device further includes a determination unit for determining whether or not the predetermined imaging target is present, the determination unit being configured to determine whether or not the predetermined imaging target is present, the control device further including a determination unit for determining whether or not the predetermined imaging target is present, the determination unit being configured to determine ... The control device according to claim 1, characterized in that when the determination means determines that there is an object to be imaged moving at or above the predetermined speed at any of the plurality of image capturing positions, the control means increases the angle of view of the imaging unit at that image capturing position.
9. 9. The control device according to claim 8, wherein the control means increases the angle of view of the imaging unit in the next cyclic imaging so that an object moving at or above the predetermined speed can be accommodated within the angle of view of the imaging unit.
10. 9. The control device according to claim 8, wherein the control means determines the angle of view in accordance with a moving speed of the imaging target.
11. 9. The control device according to claim 8, wherein, when the imaging target moves out of the increased angle of view, the control means returns the angle of view to the original angle of view.
12. 9. The control device according to claim 8, wherein when the control means increases the angle of view, the control means does not exclude from the predetermined imaging sequence an imaging position where it is determined that there is an imaging target moving at or above the predetermined speed.
13. The control device according to claim 8, characterized in that, when the control means is unable to increase the angle of view of the imaging unit, the shortening means shortens the imaging time at an imaging position where it is determined that there is an imaging target moving at or above the predetermined speed.
14. A control method for controlling an imaging device having an imaging unit, comprising: controlling the imaging unit to capture images in a cyclic manner at a plurality of imaging positions in accordance with a predetermined imaging order; detecting a predetermined imaging target; When the predetermined imaging target is not detected at any one of the plurality of imaging positions by the detecting step, shortening an imaging time at the imaging position; A control method comprising the steps of:
15. A program for causing a computer to function as each of the means possessed by the control device according to claim 1.
Citation Information
Patent Citations
Information processing device, control method of the same, and program
JP2021121081A
Cited By
Methods and systems for operating a PTZ camera having multiple preset positions
EP4811809A1