Management device, imaging system, management method, and management program

Abstract

Provided are a management device, an imaging system, a management method, and a management program with which it is possible to mutually use captured images generated by a plurality of imaging devices having different distances to a subject. The management device (11) is provided with a CPU (6) (0A), and is capable of communicating with a surveillance camera (10) that captures an image of a subject, and with a terminal device (100) that is located in a region that can be captured by the surveillance camera (10). The CPU 6 (0A) acquires attribute information of the terminal device (100) on the basis of at least one of the result of image processing for the first imaging data acquired by the surveillance camera (10) and information relating to imaging by the surveillance camera (10).

Description

Technical Field

[0001] The invention relates to a management device, a camera system, a management method and a management program. Background Art

[0002] Patent document 1 describes the following information processing system: if a confirmation request for a designated farmland is received from a farmland image taken by a fixed-point camera, the confirmation request is sent from the information processing terminal to a mobile terminal together with the camera ID (identification) of the fixed-point camera for the designated farmland; if the sent camera ID is consistent with the camera ID of a fixed-point camera separately held by the mobile terminal, a detailed image of the designated farmland is captured by the mobile terminal, and the acquired image data is sent to a server device.

[0003] Patent document 2 describes a work support system in which an entire area camera image taken by a camera device is displayed on a user's mobile terminal, and if any position on the entire area camera image displayed on the mobile terminal is indicated, an image of the indicated position is displayed on the mobile terminal.

[0004] Patent Document 3 describes an image storage management system that confirms the location of a camera based on its location information, sends photography instruction information to the camera to perform photography, and sends the acquired image data to an image management device via a network.

[0005] Patent document 4 describes a disaster information collection and management device, which adds location information of the shooting location to image data taken by a mobile information terminal and sends it to a disaster information center. A determination unit of the disaster information center determines the distance between the position of the representative point of each disaster-stricken area and the shooting location of the image data, establishes an association with the disaster-stricken area with the smallest determined distance, and stores the image data in a disaster information accumulation unit.

[0006] Previous technical literature

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Publication No. 2019-121055

[0009] Patent Document 2: Japanese Patent Application Publication No. 2018-164220

[0010] Patent Document 3: Japanese Patent Application Publication No. 2004-032608

[0011] Patent Document 4: Japanese Patent Application Publication No. 2001-344285 Summary of the invention

[0012] One embodiment of the technology according to the present invention provides a management device, an imaging system, a management method, and a management program capable of mutually utilizing captured images generated by a plurality of imaging devices having different distances to a subject.

[0013] Means for solving technical problems

[0014] (1) A management device capable of communicating with a first camera device for photographing a subject and a second camera device located in an area that can be photographed by the first camera device, and comprising a processor, wherein:

[0015] The above processor performs the following processing:

[0016] The attribute information of the second imaging device is acquired based on at least one of a result of image processing on the first imaging data acquired by the first imaging device and information related to imaging by the first imaging device.

[0017] (2) The management device according to (1), wherein:

[0018] The above processor performs the following processing:

[0019] Based on the attribute information, imaging instruction information indicating imaging conditions of the subject is sent to the second imaging device.

[0020] (3) The management device according to (2), wherein:

[0021] The imaging conditions are specified by a user of the management device.

[0022] (4) The management device according to (2), wherein:

[0023] The imaging conditions are conditions for supplementing the deficiencies of the first imaging data.

[0024] (5) The management device according to (4), wherein:

[0025] The above-mentioned imaging conditions are expressed by a stereotype tool.

[0026] (6) The management device according to any one of (2) to (5), wherein:

[0027] The above processor performs the following processing:

[0028] At least one of a first captured image represented by the first captured image data and a second captured image represented by the second captured image data acquired by the second captured image device is output to a display device, and the designation of the captured image condition is accepted from a user.

[0029] (7) The management device according to any one of (1) to (6), wherein:

[0030] The information related to the above-mentioned imaging is a range set according to the imaging direction of the above-mentioned first imaging device.

[0031] (8) The management device according to (7), wherein:

[0032] The above range is set according to the field angle of the above first imaging device.

[0033] (9) The management device according to (7) or (8), wherein:

[0034] The above range is set based on the position information associated with the above imaging direction.

[0035] (10) The management device according to any one of (7) to (9), wherein:

[0036] The above processor performs the following processing:

[0037] The attribute information is acquired based on the range and GPS information of a plurality of imaging devices including the second imaging device.

[0038] (11) The management device according to any one of (1) to (10), wherein:

[0039] The above processor performs the following processing:

[0040] The attribute information of the second camera device is acquired based on the recognition result of the holder of the second camera device or the installation object of the second camera device based on the image processing.

[0041] (12) A management device capable of communicating with a first camera device for photographing a subject and a second camera device located at a position different from the first camera device, and comprising a processor, wherein:

[0042] The above processor performs the following processing:

[0043] causing the first imaging device to perform imaging based on at least one of the position information of the second imaging device and the imaging condition specified by the second imaging device; and

[0044] The first imaging data acquired by the first imaging device is sent to the second imaging device.

[0045] (13) The management device according to (12), wherein:

[0046] The above processor performs the following processing:

[0047] At least one of a first captured image represented by the first captured image data acquired by the first imaging device and a second captured image represented by the second captured image data acquired by the second imaging device is output to a display device.

[0048] (14) The management device according to any one of (1) to (13), which is capable of communicating with a rotating device that rotates the first imaging device.

[0049] The processor acquires correspondence information between a control value of the swivel device and a position of an imaging object by the first imaging device.

[0050] (15) The management device according to (14), wherein:

[0051] The above processor performs the following processing:

[0052] while controlling the rotation device to change the imaging direction of the first imaging device, synthesizing a plurality of image data acquired by the first imaging device to generate first synthesized image data; and

[0053] Correspondence information between the coordinates of the first synthesized image represented by the first synthesized image data and the control value of the slewing device is generated.

[0054] (16) A camera system comprising:

[0055] A first camera device for photographing a subject;

[0056] A second camera device is located in an area that can be photographed by the first camera device; and

[0057] a management device capable of communicating with the first camera device and the second camera device,

[0058] The processor of the management device performs the following processing:

[0059] The attribute information of the second imaging device is acquired based on at least one of a result of image processing on the first imaging data acquired by the first imaging device and information related to imaging by the first imaging device.

[0060] (17) A camera system comprising:

[0061] A first camera device for photographing a subject;

[0062] a second camera device located at a position different from that of the first camera device; and

[0063] a management device capable of communicating with the first camera device and the second camera device,

[0064] The processor of the management device performs the following processing:

[0065] causing the first imaging device to perform imaging based on at least one of the position information of the second imaging device and the imaging condition specified by the second imaging device; and

[0066] The first imaging data acquired by the first imaging device is sent to the second imaging device.

[0067] (18) A management method performed by a management device capable of communicating with a first camera device that captures a subject and a second camera device located in an area that can be captured by the first camera device, wherein:

[0068] The processor of the management device performs the following processing:

[0069] The attribute information of the second imaging device is acquired based on at least one of a result of image processing on the first imaging data acquired by the first imaging device and information related to imaging by the first imaging device.

[0070] (19) A management method performed by a management device capable of communicating with a first imaging device for imaging a subject and a second imaging device located at a position different from the first imaging device, wherein:

[0071] The processor of the management device performs the following processing:

[0072] causing the first imaging device to perform imaging based on at least one of the position information of the second imaging device and the imaging condition specified by the second imaging device; and

[0073] The first imaging data acquired by the first imaging device is sent to the second imaging device.

[0074] (20) A management program for a management device capable of communicating with a first camera device for photographing a subject and a second camera device located in an area capable of photographing the subject by the first camera device, wherein:

[0075] The management program is used to enable the processor of the management device to perform the following processing:

[0076] The attribute information of the second imaging device is acquired based on at least one of a result of image processing on the first imaging data acquired by the first imaging device and information related to imaging by the first imaging device.

[0077] (21) A management program for a management device capable of communicating with a first imaging device for imaging a subject and a second imaging device located at a position different from the first imaging device, wherein:

[0078] The management program is used to enable the processor of the management device to perform the following processing:

[0079] causing the first camera to shoot based on at least one of the position information of the second camera and the shooting conditions specified by the second camera,

[0080] The first imaging data acquired by the first imaging device is sent to the second imaging device.

[0081] Effects of the Invention

[0082] According to the present invention, it is possible to provide a management device, an imaging system, a management method, and a management program that can mutually utilize captured images generated by a plurality of imaging devices having different distances to a subject. BRIEF DESCRIPTION OF THE DRAWINGS

[0083] Figure 1 This is a diagram showing an example of an imaging system 1 equipped with a management device 11 according to the present embodiment.

[0084] Figure 2 FIG. 1 is a diagram showing an example of rotation of the monitoring camera 10 in the pitch direction by the rotation mechanism 16 .

[0085] Figure 3 FIG. 1 is a diagram showing an example of the rotation of the monitoring camera 10 in the yaw direction by the rotation mechanism 16 .

[0086] Figure 4 It is a block diagram showing an example of the configuration of the optical system and the electrical system of the monitoring camera 10 .

[0087] Figure 5 It is a diagram showing an example of the configuration of the electric system of the turning mechanism 16 and the management device 11 .

[0088] Figure 6 This is a diagram showing an example of the hardware configuration of a terminal device held by a worker in a monitoring target area.

[0089] Figure 7 This is a diagram showing an example of an image displayed on the management device 11.

[0090] Figure 8 This is a flowchart showing an example of a first aspect of processing by the management device 11 .

[0091] Fig. 9This is a timing chart showing an example of a first aspect of processing by the imaging system 1 .

[0092] Fig.10 This is a diagram showing an example of a camera image sent from the terminal device 100.

[0093] Fig.11 This is a diagram showing an example of a camera image sent from the terminal device 100.

[0094] Fig.12 It is a diagram showing a first modification of the imaging system 1 .

[0095] Fig.13 Yes means Fig.12 A diagram showing an example of the configuration of an electrical system of the management device 11 shown.

[0096] Fig.14 It means in Fig.12 , Fig.13 A diagram showing an example of an image displayed by the management device 11 in the structure shown.

[0097] Fig.15 It is a diagram showing a second modification of the imaging system 1 .

[0098] Fig.16 Yes means Fig.15 A diagram showing an example of the configuration of an electrical system of the management device 11 shown.

[0099] Fig.17 This is a diagram showing an example of a process for confirming a person who is unwell or injured.

[0100] Fig.18 This is a flowchart showing an example of the second aspect of the processing by the management device 11.

[0101] Fig.19 It is a timing chart showing an example of the second aspect of the processing by the imaging system 1 .

[0102] Fig. 20 This is a timing chart showing another example of the second aspect of the processing by the imaging system 1 .

[0103] Fig.21 This is a diagram showing an example of a manner in which the management program is installed in the control device 60 of the management device 11 from a storage medium storing the management program for management control. DETAILED DESCRIPTION

[0104] Hereinafter, an example of an embodiment of the present invention will be described with reference to the drawings.

[0105] <Image capture system of embodiment>

[0106] Figure 1 FIG. 1 is a diagram showing an example of an imaging system 1 equipped with a management device according to the present embodiment. Figure 1 As shown, as an example, the imaging system 1 includes a monitoring camera 10, a management device 11, and a swivel mechanism 16. The monitoring camera 10 is an example of a first imaging device in the present invention.

[0107] The monitoring camera 10 is a camera used to monitor facilities that are the basis of life or industrial activities. The monitoring camera 10 monitors, for example, construction sites, rivers, bridges, etc. The monitoring camera 10 uses a camera capable of telephoto shooting, an ultra-high-resolution camera, etc. In addition, the monitoring camera 10 can use a wide-angle camera. The monitoring camera 10 is set to a pillar, a wall, or a part of a building (such as a roof) indoors or outdoors via a rotating mechanism 16, and shoots a subject, i.e., a photographed object. The monitoring camera 10 sends the photographed image obtained by shooting and the photographing information related to the shooting to the management device 11 via the communication line 12.

[0108] The management device 11 includes a display 13a, a keyboard 13b, a mouse 13c, and a secondary storage device 14. Examples of the display 13a include a liquid crystal display, a plasma display, an organic EL (Electro-Luminescence) display, a CRT (Cathode Ray Tube) display, etc. The display 13a is an example of a display device of the present invention.

[0109] An example of the secondary storage device 14 is a hard disk drive (HDD). The secondary storage device 14 is not limited to a HDD, and may be any nonvolatile memory such as a flash memory, a solid state drive (SSD), or an electrically erasable and programmable read only memory (EEPROM).

[0110] The management device 11 receives the captured images or captured information transmitted from the monitoring camera 10 , and displays the received captured images or captured information on the display 13 a or stores them in the secondary storage device 14 .

[0111] The management device 11 performs imaging control for controlling the imaging by the monitoring camera 10. For example, the management device 11 performs imaging control by communicating with the monitoring camera 10 via the communication line 12. The imaging control is a control for setting imaging parameters for the monitoring camera 10 to perform imaging in the monitoring camera 10 and causing the monitoring camera 10 to perform imaging. The imaging parameters include parameters related to exposure and parameters of zoom position, etc.

[0112] Furthermore, the management device 11 controls the rotation mechanism 16 to control the camera direction (pan or tilt) of the monitoring camera 10. For example, the management device 11 sets the rotation direction, rotation amount, rotation speed, etc. of the monitoring camera 10 according to the operation of the keyboard 13b or the mouse 13c or the touch operation on the screen of the display 13a.

[0113] <Rotation of the Monitoring Camera 10 by the Rotation Mechanism 16>

[0114] Figure 2 FIG. 1 is a diagram showing an example of rotation of the monitoring camera 10 in the pitch direction by the rotation mechanism 16 . Figure 3 1 is a diagram showing an example of the rotation of the yaw direction of the monitoring camera 10 by the rotation mechanism 16. The monitoring camera 10 is mounted on the rotation mechanism 16. The rotation mechanism 16 can change the imaging direction of the monitoring camera 10 by rotating the monitoring camera 10.

[0115] Specifically, if Figure 2 As shown in FIG. 1 , as an example, the swivel mechanism 16 is capable of causing the monitoring camera 10 to rotate in a swivel direction (pitch direction) that intersects the yaw direction and has the pitch axis PA as the center axis, and Figure 3 As an example, a double-axis rotating mechanism is shown which rotates in the rotation direction (deflection direction) with the deflection axis YA as the central axis. In addition, in the rotating mechanism 16 involved in this embodiment, an example of a double-axis rotating mechanism is shown, but the technology of the present invention is not limited to this, and it can be a three-axis rotating mechanism or a single-axis rotating mechanism.

[0116] <Structure of the Optical and Electrical Systems of the Surveillance Camera 10>

[0117] Figure 4 1 is a block diagram showing an example of the structure of the optical system and the electrical system of the monitoring camera 10. Figure 4As shown, as an example, the surveillance camera 10 includes an optical system 15 and an imaging element 25. The imaging element 25 is located at the rear section of the optical system 15. The optical system 15 includes an objective lens 15A and a lens group 15B. The objective lens 15A and the lens group 15B are arranged in the order of the objective lens 15A and the lens group 15B along the optical axis OA of the optical system 15 from the object subject side (object side) to the light receiving surface 25A side (image side) of the imaging element 25. The lens group 15B includes an anti-vibration lens 15B1, a focusing lens (not shown) and a zoom lens 15B2. The zoom lens 15B2 is supported so as to be movable along the optical axis OA by a lens actuator 21 described later. The anti-vibration lens 15B1 is supported so as to be movable in a direction orthogonal to the optical axis OA by a lens actuator 17 described later.

[0118] By extending the focal length by the zoom lens 15B2, the monitoring camera 10 becomes telephoto, so the angle of view becomes smaller (the imaging range becomes narrower). By shortening the focal length by the zoom lens 15B2, the angle of view becomes larger (the imaging range becomes wider).

[0119] In addition, the optical system 15 may include various lenses not shown in the figure in addition to the objective lens 15A and the lens group 15B. In addition, the optical system 15 may include an aperture. The positions of the lenses, lens groups, and apertures included in the optical system 15 are not limited. Figure 4 The technology of the present invention is also applicable to positions different from the positions shown.

[0120] The anti-vibration lens 15B1 is movable in a direction perpendicular to the optical axis OA, and the zoom lens 15B2 is movable along the optical axis OA.

[0121] The optical system 15 includes lens actuators 17 and 21. The lens actuator 17 applies a force to the anti-vibration lens 15B1 to change the position in a direction perpendicular to the optical axis of the anti-vibration lens 15B1. The lens actuator 17 is controlled by an OIS (Optical Image Stabilizer) driver 23. By driving the lens actuator 17 under the control of the OIS driver 23, the position of the anti-vibration lens 15B1 changes in a direction perpendicular to the optical axis OA.

[0122] The lens actuator 21 applies a force to the zoom lens 15B2 for moving along the optical axis OA of the optical system 15. The lens actuator 21 is controlled by the lens driver 28. The position of the zoom lens 15B2 moves along the optical axis OA by driving the lens actuator 21 under the control of the lens driver 28. By the position of the zoom lens 15B2 moving along the optical axis OA, the focal length of the monitoring camera 10 changes.

[0123] In addition, when the outline of the captured image is, for example, a rectangle having short sides in the pitch axis PA direction and long sides in the yaw axis YA direction, the field angle in the pitch axis PA direction is narrower than the field angle in the yaw axis YA direction and narrower than the diagonal field angle.

[0124] By the optical system 15 configured in this way, light representing the imaging subject is imaged on the light receiving surface 25A of the imaging element 25 , and the imaging subject is captured by the imaging element 25 .

[0125] The vibrations applied to the surveillance camera 10 include, for example, the vibrations caused by the passage of cars, the vibrations caused by wind, and the vibrations caused by road construction outdoors, and for example, the vibrations caused by the operation of air conditioners and the vibrations caused by the coming and going of people indoors. Therefore, the surveillance camera 10 generates jitters due to the vibrations applied to the surveillance camera 10 (hereinafter, also simply referred to as "vibrations").

[0126] In addition, in the present embodiment, "jitter" refers to a phenomenon in which the image of the object subject on the light receiving surface 25A of the imaging element 25 in the monitoring camera 10 changes due to a change in the positional relationship between the optical axis OA and the light receiving surface 25A. In other words, "jitter" can also be said to be a phenomenon in which the optical image obtained by imaging on the light receiving surface 25A changes due to the tilt of the optical axis OA caused by the vibration applied to the monitoring camera 10. The change of the optical axis OA refers to, for example, the tilt of the optical axis OA relative to the reference axis (for example, the optical axis OA before the jitter occurs). Hereinafter, jitter caused by vibration is also referred to as "jitter".

[0127] The jitter is included in the captured image as a noise component and affects the image quality of the captured image. Therefore, in order to remove the noise component caused by the jitter and included in the captured image, the monitoring camera 10 includes a lens-side jitter correction mechanism 29, an imaging element-side jitter correction mechanism 45, and an electronic jitter correction unit 33 for correcting the jitter.

[0128] The lens-side shake correction mechanism 29 and the imaging element-side shake correction mechanism 45 are mechanical shake correction mechanisms. The mechanical shake correction mechanism is a mechanism that corrects shake by applying power generated by a driving source such as a motor (for example, a voice coil motor) to a shake correction element (for example, the anti-vibration lens 15B1 and / or the imaging element 25) to move the shake correction element in a direction perpendicular to the optical axis of the imaging optical system.

[0129] Specifically, the lens-side shake correction mechanism 29 is a mechanism that corrects shake by applying power generated by a driving source such as a motor (e.g., a voice coil motor) to the anti-vibration lens 15B1, thereby moving the anti-vibration lens 15B1 in a direction perpendicular to the optical axis of the imaging optical system. The imaging element-side shake correction mechanism 45 is a mechanism that corrects shake by applying power generated by a driving source such as a motor (e.g., a voice coil motor) to the imaging element 25, thereby moving the imaging element 25 in a direction perpendicular to the optical axis of the imaging optical system. The electronic shake correction unit 33 corrects shake by performing image processing on the captured image according to the amount of shake. That is, the shake correction unit (shake correction component) performs shake correction mechanically or electronically through a hardware structure and / or a software structure. Here, mechanical shake correction refers to shake correction achieved by mechanically moving shake correction elements such as the anti-vibration lens 15B1 and / or the imaging element 25 using power generated by a driving source such as a motor (e.g., a voice coil motor), and electronic shake correction refers to shake correction achieved, for example, by performing image processing using a processor.

[0130] like Figure 4 As shown, the lens-side image stabilization mechanism 29 includes, as an example, an anti-vibration lens 15B1 , a lens actuator 17 , an OIS driver 23 , and a position sensor 39 .

[0131] As the shake correction method by the lens-side shake correction mechanism 29, various well-known methods can be adopted. In the present embodiment, as the shake correction method, a method of correcting the shake by moving the anti-vibration lens 15B1 according to the shake amount detected by the shake amount detection sensor 40 (described later) is adopted. Specifically, the shake correction is performed by moving the anti-vibration lens 15B1 in the direction of eliminating the shake only by the amount of the shake to eliminate the shake.

[0132] The anti-vibration lens 15B1 is provided with a lens actuator 17. The lens actuator 17 is a displacement mechanism equipped with a voice coil motor, and drives the voice coil motor to move the anti-vibration lens 15B1 in a direction perpendicular to the optical axis of the anti-vibration lens 15B1. In addition, here, as the lens actuator 17, a displacement mechanism equipped with a voice coil motor is used, but the technology of the present invention is not limited to this, and other power sources such as a stepping motor or a piezoelectric element can be applied instead of the voice coil motor.

[0133] The lens actuator 17 is controlled by the OIS driver 23. By driving the lens actuator 17 under the control of the OIS driver 23, the position of the anti-vibration lens 15B1 is mechanically changed within a two-dimensional plane perpendicular to the optical axis OA.

[0134] The position sensor 39 detects the current position of the anti-vibration lens 15B1 and outputs a position signal indicating the detected current position. Here, as an example of the position sensor 39, a device including a Hall element is used. Here, the current position of the anti-vibration lens 15B1 refers to the current position within the two-dimensional plane of the anti-vibration lens. The two-dimensional plane of the anti-vibration lens refers to a two-dimensional plane perpendicular to the optical axis of the anti-vibration lens 15B1. In addition, in the present embodiment, as an example of the position sensor 39, a device including a Hall element is used, but the technology of the present invention is not limited to this, and a magnetic sensor or an optical sensor may be used instead of the Hall element.

[0135] The lens-side shake correction mechanism 29 corrects the shake by moving the anti-vibration lens 15B1 in at least one of the pitch axis PA direction and the yaw axis YA direction within the actual shooting range. That is, the lens-side shake correction mechanism 29 corrects the shake by moving the anti-vibration lens 15B1 within the two-dimensional plane of the anti-vibration lens by an amount of movement corresponding to the amount of shake.

[0136] The imaging element side shake correction mechanism 45 includes the imaging element 25 , a BIS (Body Image Stabilizer) driver 22 , an imaging element actuator 27 , and a position sensor 47 .

[0137] As with the shake correction method by the lens-side shake correction mechanism 29, the shake correction method by the imaging element-side shake correction mechanism 45 can also adopt various well-known methods. In the present embodiment, as the shake correction method, a method of correcting the shake by moving the imaging element 25 according to the shake amount detected by the shake amount detection sensor 40 is adopted. Specifically, the shake correction is performed by moving the imaging element 25 in the direction to eliminate the shake only by the amount to eliminate the shake.

[0138] An imaging element actuator 27 is mounted on the imaging element 25. The imaging element actuator 27 is a displacement mechanism equipped with a voice coil motor, and drives the voice coil motor to move the imaging element 25 in a vertical direction relative to the optical axis of the anti-vibration lens 15B1. In addition, here, as the imaging element actuator 27, a displacement mechanism equipped with a voice coil motor is used, but the technology of the present invention is not limited to this, and other power sources such as a stepping motor or a piezoelectric element can be applied instead of the voice coil motor.

[0139] The imaging element actuator 27 is controlled by the BIS driver 22. By driving the imaging element actuator 27 under the control of the BIS driver 22, the position of the imaging element 25 is mechanically changed in a direction perpendicular to the optical axis OA.

[0140] The position sensor 47 detects the current position of the imaging element 25 and outputs a position signal indicating the detected current position. Here, as an example of the position sensor 47, a device including a Hall element is used. Here, the current position of the imaging element 25 refers to the current position within the two-dimensional plane of the imaging element. The two-dimensional plane of the imaging element refers to a two-dimensional plane perpendicular to the optical axis of the anti-vibration lens 15B1. In addition, in the present embodiment, as an example of the position sensor 47, a device including a Hall element is used, but the technology of the present invention is not limited to this, and a magnetic sensor or an optical sensor, etc. can be used instead of the Hall element.

[0141] The monitoring camera 10 includes a computer 19, a DSP (Digital Signal Processor) 31, an image memory 32, an electronic shake correction unit 33, a communication I / F 34, a shake amount detection sensor 40, and a UI (User Interface) system device 43. The computer 19 includes a memory 35, a storage device 36, and a CPU (Central Processing Unit) 37.

[0142] The imaging element 25, DSP 31, image memory 32, electronic shake correction unit 33, communication I / F 34, memory 35, storage device 36, CPU 37, shake amount detection sensor 40, and UI system device 43 are connected to the bus 38. In addition, the OIS driver 23 is also connected to the bus 38. Figure 4 In the example shown, for convenience of illustration, one bus is shown as the bus 38, but a plurality of buses may be provided. The bus 38 may be a serial bus or a parallel bus such as a data bus, an address bus, and a control bus.

[0143] The memory 35 temporarily stores various information and is used as a working memory. As an example of the memory 35, a RAM (Random Access Memory) can be cited, but it is not limited to this, and other types of storage devices can also be used. Various programs for the monitoring camera 10 are stored in the storage device 36. The CPU 37 controls the monitoring camera 10 as a whole by reading various programs from the storage device 36 and executing the read various programs on the memory 35. As the storage device 36, for example, a flash memory, an SSD, an EEPROM, or an HDD can be cited. In addition, for example, various non-volatile memories such as a magnetoresistive memory and a ferroelectric memory can be used instead of a flash memory or in combination with a flash memory.

[0144] The imaging element 25 is a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The imaging element 25 captures the target subject at a default frame rate under the instruction of the CPU 37. The "default frame rate" mentioned here refers to, for example, tens of frames per second to hundreds of frames per second. In addition, the imaging element 25 itself may also have a built-in control device (imaging element control device). In this case, the imaging element control device performs detailed control inside the imaging element 25 according to the camera instruction output by the CPU 37. In addition, the imaging element 25 may also capture the target subject at a default frame rate under the instruction of the DSP 31. In this case, the imaging element control device performs detailed control inside the imaging element 25 according to the camera instruction output by the DSP 31. In addition, the DSP 31 is sometimes also referred to as an ISP (Image Signal Processor).

[0145] The light receiving surface 25A of the imaging element 25 is formed by a plurality of photosensitive pixels (not shown) arranged in a matrix. In the imaging element 25, each photosensitive pixel is exposed, and photoelectric conversion is performed for each photosensitive pixel. The charge obtained by photoelectric conversion for each photosensitive pixel is an analog imaging signal representing the object. Here, as a plurality of photosensitive pixels, a plurality of photoelectric conversion elements having sensitivity to visible light (for example, a photoelectric conversion element having a color filter) are used. In the imaging element 25, as a plurality of photoelectric conversion elements, a photoelectric conversion element having sensitivity to R (red) light (for example, a photoelectric conversion element having an R filter corresponding to R), a photoelectric conversion element having sensitivity to G (green) light (for example, a photoelectric conversion element having a G filter corresponding to G), and a photoelectric conversion element having sensitivity to B (blue) light (for example, a photoelectric conversion element having a B filter corresponding to B) are used. In the monitoring camera 10, shooting based on visible light (for example, light on the short wavelength side of about 700 nanometers or less) is performed by using these photosensitive pixels. However, the present embodiment is not limited thereto, and photography based on infrared light (for example, light with a wavelength longer than about 700 nanometers) can be performed. In this case, as a plurality of photosensitive pixels, a plurality of photoelectric conversion elements having sensitivity to infrared light can be used. In particular, for photography regarding SWIR (Short-wavelength infrared), for example, an InGaAs sensor and / or a type-II quantum well (T2SL; Simulation of Type-IIQuantum Well) sensor can be used.

[0146] The imaging element 25 performs signal processing such as A / D (Analog / Digital) conversion on the analog imaging signal to generate a digital imaging signal, that is, a digital image. The imaging element 25 is connected to the DSP 31 via the bus 38 and outputs the generated digital image to the DSP 31 via the bus 38 in units of frames.

[0147] In addition, here, as an example of the imaging element 25, a CMOS image sensor is cited for explanation, but the technology of the present invention is not limited to this. As the imaging element 25, a CCD (Charge Coupled Device) image sensor can be applied. In this case, the imaging element 25 is connected to the bus 38 via an AFE (Analog Front End) (not shown) with a built-in CCD driver. The AFE generates a digital image by performing signal processing such as A / D conversion on the analog camera signal obtained by the imaging element 25, and outputs the generated digital image to the DSP 31. The CCD image sensor is driven by a CCD driver built into the AFE. Of course, a CCD driver can also be provided separately.

[0148] The DSP 31 performs various digital signal processing on the digital image. The various digital signal processing refers to, for example, demosaic processing, noise removal processing, grayscale correction processing, and color correction processing. The DSP 31 outputs the digital image after the digital signal processing to the image memory 32 for each frame. The image memory 32 stores the digital image from the DSP 31.

[0149] The shake amount detection sensor 40 is a device including, for example, a gyro sensor, and detects the shake amount of the monitoring camera 10. In other words, the shake amount detection sensor 40 detects the shake amount in each of a pair of axial directions. The gyro sensor detects the respective axes (reference numerals 14 and 15 ) around the pitch axis PA, the yaw axis YA, and the roll axis RA (axis parallel to the optical axis OA). Figure 1 The shake amount detection sensor 40 detects the shake amount of the monitoring camera 10 by converting the amount of rotational shake around the pitch axis PA and the amount of rotational shake around the yaw axis YA detected by the gyro sensor into the amount of shake in a two-dimensional plane parallel to the pitch axis PA and the yaw axis YA.

[0150] Here, a gyro sensor is cited as an example of the shake amount detection sensor 40, but this is only an example, and the shake amount detection sensor 40 may also be an acceleration sensor. The acceleration sensor detects the shake amount in a two-dimensional plane parallel to the pitch axis PA and the yaw axis YA. The shake amount detection sensor 40 outputs the detected shake amount to the CPU 37.

[0151] Here, an example of detecting the amount of shake by the physical sensor, the shake amount detection sensor 40, is given, but the technology of the present invention is not limited to this. For example, a motion vector obtained by comparing the captured images before and after the time series stored in the image memory 32 can be used as the amount of shake. In addition, the amount of shake to be used finally can be derived from the amount of shake detected by the physical sensor and the motion vector obtained by image processing.

[0152] The CPU 37 acquires the amount of shake detected by the shake amount detection sensor 40, and controls the lens-side shake correction mechanism 29, the imaging element-side shake correction mechanism 45, and the electronic shake correction unit 33 according to the acquired shake amount. The amount of shake detected by the shake amount detection sensor 40 is used for shake correction by the lens-side shake correction mechanism 29 and the electronic shake correction unit 33.

[0153] The electronic image stabilization unit 33 is a device including an ASIC (Application Specific Integrated Circuit) and performs image processing on the captured image in the image memory 32 according to the image stabilization amount detected by the image stabilization amount detection sensor 40 to stabilize the image.

[0154] In addition, here, as the electronic jitter correction unit 33, a device including an ASIC is exemplified, but the technology of the present invention is not limited to this. For example, it can be a device including an FPGA (Field Programmable Gate Array) or a PLD (Programmable Logic Device). And, for example, the electronic jitter correction unit 33 can be a device including multiple of ASIC, FPGA and PLD. And, as the electronic jitter correction unit 33, a computer including a CPU, a storage device and a memory can be used. The CPU can be single or multiple. And the electronic jitter correction unit 33 can be implemented by a combination of hardware structure and software structure.

[0155] The communication I / F 34 is, for example, a network interface, and controls the transmission of various information with the management device 11 via a network. The network is, for example, a WAN (Wide Area Network) such as the Internet or a LAN (Local Area Network). The communication I / F 34 performs communication between the monitoring camera 10 and the management device 11.

[0156] The UI system device 43 includes a receiving device 43A and a display 43B. The receiving device 43A is, for example, a hardware key or a touch panel, and receives various instructions from the user. The CPU 37 acquires various instructions received by the receiving device 43A and operates according to the acquired instructions.

[0157] The display 43B displays various information under the control of the CPU 37. Examples of the various information displayed on the display 43B include the contents of various instructions received by the receiving device 43A and captured images.

[0158] <Structure of the electrical system of the rotary mechanism 16 and the management device 11>

[0159] Figure 5 1 is a diagram showing an example of the structure of the electrical system of the rotary mechanism 16 and the management device 11. Figure 5 As shown, the swivel mechanism 16 includes a yaw axis swivel mechanism 71 , a pitch axis swivel mechanism 72 , motors 73 , 74 , drivers 75 , 76 , and communication I / Fs 79 , 80 , as an example.

[0160] The yaw axis rotation mechanism 71 rotates the monitoring camera 10 in the yaw direction. The motor 73 generates power by being driven under the control of the driver 75. The yaw axis rotation mechanism 71 rotates the monitoring camera 10 in the yaw direction by receiving the power generated by the motor 73. The pitch axis rotation mechanism 72 rotates the monitoring camera 10 in the pitch direction. The motor 74 generates power by being driven under the control of the driver 76. The pitch axis rotation mechanism 72 rotates the monitoring camera 10 in the pitch direction by receiving the power generated by the motor 74.

[0161] The communication I / Fs 79 and 80 are, for example, network interfaces, and control the transmission of various information with the management device 11 via a network. The network is, for example, a WAN such as the Internet or a LAN. The communication I / Fs 79 and 80 perform communication between the rotation mechanism 16 and the management device 11.

[0162] like Figure 5 As shown, as an example, the management device 11 includes a display 13a, a secondary storage device 14, a control device 60, a receiving device 62, and communication I / Fs 66, 67, 68, and 69. The control device 60 includes a CPU 60A, a storage device 60B, and a memory 60C. The CPU 60A is an example of a processor in the present invention.

[0163] The receiving device 62, the display 13a, the secondary storage device 14, the CPU 60A, the storage device 60B, the memory 60C, and the communication I / F 66 are connected to the bus 70. Figure 5In the example shown, for the convenience of illustration, one bus is shown as the bus 70, but a plurality of buses may be provided. The bus 70 may be a serial bus or a parallel bus including a data bus, an address bus, a control bus, and the like.

[0164] The memory 60C temporarily stores various information and is used as a working memory. As an example of the memory 60C, a RAM can be cited, but it is not limited to this and can be other types of storage devices. Various programs for the management device 11 (hereinafter referred to as "management device programs") are stored in the storage device 60B.

[0165] The CPU 60A reads out the management device program from the storage device 60B and executes the read management device program on the memory 60C, thereby controlling the entire management device 11. The management device program includes the management program in the present invention.

[0166] The communication I / F 66 is, for example, a network interface. The communication I / F 66 is connected to the communication I / F 34 of the monitoring camera 10 via a network so as to be communicable, and performs transmission control of various information with the monitoring camera 10. The communication I / Fs 67 and 68 are, for example, network interfaces. The communication I / F 67 is connected to the communication I / F 79 of the rotation mechanism 16 via a network so as to be communicable, and performs transmission control of various information with the yaw axis rotation mechanism 71. The communication I / F 68 is connected to the communication I / F 80 of the rotation mechanism 16 via a network so as to be communicable, and performs transmission control of various information with the pitch axis rotation mechanism 72.

[0167] The communication I / F 69 is, for example, a network interface. In the area of ​​the monitoring object (camera object) based on the camera system 1 (hereinafter referred to as the "monitoring object area"), there are a plurality of operators, each of whom holds a terminal device such as a smart phone (for example, a reference Figure 6 ). The communication I / F 69 communicates directly or indirectly with the terminal devices held by each operator in the monitoring target area via the network. The terminal device is an example of the second camera device in the present invention. The network is, for example, a WAN or a LAN. The monitoring target area is, for example, a place where multiple operators perform dangerous operations, including, for example, a construction site, a disaster site, etc.

[0168] The CPU 60A receives captured images and captured information from the monitoring camera 10 via the communication I / F 66 and the communication I / F 34. The CPU 60A controls the image capturing operation of the image capturing object by the monitoring camera 10 via the communication I / F 66 and the communication I / F 34.

[0169] The CPU 60A controls the rotation operation of the yaw axis rotation mechanism 71 by controlling the driver 75 and the motor 73 of the rotation mechanism 16 via the communication I / F 67 and the communication I / F 79. The CPU 60A controls the rotation operation of the pitch axis rotation mechanism 72 by controlling the driver 76 and the motor 74 of the rotation mechanism 16 via the communication I / F 68 and the communication I / F 80.

[0170] The CPU 60A communicates with the communication I / F 69 and the communication I / F 103 (see Figure 6 ) Send and receive camera images, camera information, etc. between the terminal device.

[0171] The CPU 60A obtains the attribute information of the terminal device based on at least one of the result of image processing of the first camera data acquired by the monitoring camera 10 and the information related to the shooting of the monitoring camera 10. The image processing of the first camera data refers to the recognition of the object (e.g., the operator) in the image by image analysis. The information related to the shooting of the monitoring camera 10 refers to the camera range specified by the longitude and latitude set according to the camera direction (pan / tilt value) of the monitoring camera 10. The camera range is set according to the position information corresponding to the camera direction. In addition to the camera direction, the camera range can also be set in consideration of the field of view. The CPU 60A obtains the attribute information of the terminal device based on the camera range and the GPS information of multiple terminal devices. When the CPU 60A obtains the attribute information of the terminal device based on the result of image processing, the attribute information is obtained based on the recognition result of the holder of the terminal device or the setting object of the terminal device (e.g., a terminal device set on a robot, a terminal device set in a car, etc.). The attribute information of the terminal device is correspondingly associated with the owner of the terminal device and the setting object.

[0172] Based on the acquired attribute information of the terminal device, the CPU 60A sends the shooting instruction information indicating the shooting conditions of the subject to be photographed by the terminal device to the specified terminal device. The shooting instruction information indicating the shooting conditions is specified by the user of the management device 11. The shooting instruction information is sent as instruction information such as "Please shoot part a in area A". The shooting conditions are conditions that supplement the insufficient parts of the first camera data acquired by the monitoring camera 10. The shooting conditions are represented by standardized tools such as e-mail, Teams (registered trademark), and Line (registered trademark). The CPU 60A outputs at least one of the first camera image represented by the first camera data and the second camera image represented by the second camera data acquired in the terminal device to the display 13a, and accepts the designation of the shooting conditions from the user.

[0173] The CPU 60A causes the monitoring camera 10 to shoot a prescribed image specified by at least one of the location information of the terminal device and the shooting conditions specified by the terminal device. The prescribed image shot according to the location information of the terminal device refers to, for example, a peripheral image of the location where the terminal device exists. The prescribed image shot according to the shooting conditions specified by the terminal device refers to, for example, a peripheral image of the location specified by the terminal device. The CPU 60A sends the first shooting data of the prescribed image shot by the monitoring camera 10 to the specified terminal device. When the CPU 60A communicates with the terminal device, for example, at least one of the first shooting image represented by the first shooting data acquired by the monitoring camera 10 and the second shooting image represented by the second shooting data acquired by the terminal device can be output to the display 13a. The CPU 60A maintains the corresponding information of the rotation control value (translation / tilt value) of the rotation mechanism 16 and the location (latitude and longitude) of the shooting object based on the monitoring camera 10 in the memory 60C or the secondary storage device 14.

[0174] The receiving device 62 is, for example, a keyboard 13b, a mouse 13c, and a touch panel of the display 13a, and receives various instructions from the user. The CPU 60A obtains various instructions received by the receiving device 62 and operates according to the instructions obtained. For example, when the receiving device 62 receives processing content for the monitoring camera 10 and / or the rotating mechanism 16, the CPU 60A operates the monitoring camera 10 and / or the rotating mechanism 16 according to the instruction content received by the receiving device 62.

[0175] The display 13a displays various information under the control of the CPU 60A. Examples of the various information displayed on the display 13a include the contents of various instructions received by the receiving device 62 and the captured images or captured information received by the communication I / F 66. The CPU 60A outputs the contents of various instructions received by the receiving device 62 and the captured images or captured information received by the communication I / F 66 to the display 13a.

[0176] The secondary storage device 14 is, for example, a nonvolatile memory, and stores various information under the control of the CPU 60A. Examples of the various information stored in the secondary storage device 14 include a captured image or captured information received by the communication I / F 66. The CPU 60A stores the captured image or captured information received by the communication I / F 66 in the secondary storage device 14.

[0177] <Hardware Configuration of Terminal Devices Possessed by Workers in the Monitoring Area>

[0178] Figure 6FIG. 1 is a diagram showing an example of the hardware configuration of a terminal device held by a worker in a monitoring target area. Figure 7 The operator W1 in the monitoring target area E1 shown in FIG. Figure 6 The terminal device 100 shown in FIG. 1 includes a processor 101, a memory 102, a communication I / F 103, a GNSS (Global Navigation Satellite System) unit 104, a user I / F 105, and a camera unit 106. The processor 101, the memory 102, the communication I / F 103, the GNSS unit 104, the user I / F 105, and the camera unit 106 are connected, for example, via a bus 109.

[0179] The processor 101 is a circuit that performs signal processing, for example, a CPU that performs overall control of the terminal device 100. In addition, the processor 101 may be implemented by other digital circuits such as FPGA or DSP. Furthermore, the processor 101 may be implemented by combining a plurality of digital circuits.

[0180] The memory 102 includes, for example, a main memory and an auxiliary memory. The main memory is, for example, a RAM. The main memory is used as a working area for the processor 101. The auxiliary memory is, for example, a non-volatile memory such as a magnetic disk, an optical disk, or a flash memory. Various programs that enable the terminal device 100 to operate are stored in the auxiliary memory. The programs stored in the auxiliary memory are loaded into the main memory and executed by the processor 101.

[0181] Furthermore, the auxiliary memory may include a portable memory that can be removed from the terminal device 100. The portable memory includes a memory card such as a USB (Universal Serial Bus) flash drive or an SD (Secure Digital) memory card, or an external hard disk drive.

[0182] The communication I / F 103 is a communication interface for wireless communication with the outside of the terminal device 100. For example, the communication I / F 103 communicates indirectly with the management device 11 by connecting to the Internet via a mobile communication network. The communication I / F 103 is controlled by the processor 101.

[0183] The GNSS unit 104 is, for example, a satellite positioning system such as GPS (Global Positioning System), and acquires location information (latitude and longitude) of the terminal device 100 . The GNSS unit 104 is controlled by the processor 101 .

[0184] The user I / F 105 includes, for example, an input device for receiving operation input from the user or an output device for outputting information to the user. The input device can be implemented, for example, by a key (e.g., a keyboard) or a remote controller. The output device can be implemented, for example, by a display or a speaker. In addition, the input device and the output device can be implemented by a touch panel. The user I / F 105 is controlled by the processor 101.

[0185] The imaging unit 106 is a part having a function of capturing an image of an imaging target, that is, a monitoring target area. The imaging unit 106 is controlled by the processor 101 .

[0186] <Image displayed by the management device 11>

[0187] Figure 7 1 is a diagram showing an example of an image displayed by the management device 11. The management device 11 can display, for example, a wide-area image 90 and a detailed image 91 to a user of the management device 11 (for example, a person monitoring the monitoring target area E1) via the display 13a. In this example, the viewing angle of the monitoring camera 10 is a viewing angle capable of capturing only a partial area of ​​the monitoring target area.

[0188] The wide-area image 90 is a pseudo wide-angle image representing the entirety of the monitoring target area E1, which is generated by controlling the monitoring camera 10 and the swivel mechanism 16 by the management device 11, causing the monitoring camera 10 to capture each area of ​​the monitoring target area E1 multiple times, and synthesizing (connecting) each camera information obtained by the capturing. The pseudo wide-angle image is an example of the first synthesized image in the present invention. This series of camera control and generation of the wide-area image 90 is performed regularly, for example, at a predetermined time (for example, 7 a.m.) every day.

[0189] The detailed image 91 is an image that is generated based on the latest imaging information acquired by the monitoring camera 10 and that shows a partial area e1 of the monitoring target area E1 in real time.

[0190] The wide-area image 90 and the detailed image 91 may be displayed in parallel and simultaneously, for example, or may be displayed by switching between them in accordance with an operation by a user of the management device 11 or the like.

[0191] The wide area image 90 includes an area designation cursor 90a. The user of the management device 11 can change the position and size of the area designation cursor 90a by operating the acceptance device 62.

[0192] For example, the memory 60C or the secondary storage device 14 of the management device 11 stores corresponding information that uniquely establishes a corresponding association between the coordinates of the wide-area image 90, the longitude and latitude (longitude and latitude) of the position corresponding to its coordinates in the monitoring object area E1, and the control parameters of the rotating mechanism 16 (control values ​​of the translation and tilt of the monitoring camera 10) for shooting with the position corresponding to its coordinates in the monitoring object area E1 as the center.

[0193] For example, when generating the wide area image 90, the management device 11 derives the correspondence between the coordinates of the wide area image 90 and the control parameters of the slewing mechanism 16. Furthermore, for example, regarding a plurality of positions included in the monitoring target area E1 and with known longitudes and latitudes, the management device 11 adjusts the control parameters of the slewing mechanism 16 so that the monitoring camera 10 can capture the positions centered thereon, and derives the correspondence between the control parameters of the slewing mechanism 16 and the longitudes and latitudes by establishing a correspondence association between the adjusted control parameters and the longitudes and latitudes of the positions (known). Thus, it is possible to generate correspondence information in which the coordinates of the wide area image 90, the control parameters of the slewing mechanism 16, and the longitudes and latitudes are established in a correspondence association.

[0194] When the area designation cursor 90a is set by the operation from the user, the management device 11 acquires the control parameters of the rotation mechanism 16 corresponding to the coordinates of the center of the area designated by the area designation cursor 90a in the wide area image 90 from the corresponding information, and sets the acquired control parameters in the rotation mechanism 16. Thus, a detailed image 91 showing the area designated by the user of the management device 11 using the area designation cursor 90a in the monitoring target area E1 is displayed.

[0195] That is, the user of the management device 11 can observe the entire monitoring target area E1 through the wide area image 90. Furthermore, when the user of the management device 11 wishes to observe the local area e1 of the monitoring target area E1 in detail, the user can observe the detailed image 91 showing the local area e1 in detail by setting the area designation cursor 90a on a part of the local area e1 in the wide area image 90. Figure 7 In the illustrated example, the entire image of the construction site is shown in the wide-area image 90 , and the vehicle V1 and the worker W1 are shown in the detailed image 91 .

[0196] In this way, by using the real-time video information obtained by the monitoring camera 10 and the pseudo wide-angle image generated by synthesizing the video information obtained by causing the monitoring camera 10 to photograph each area of ​​the monitoring object area E1, it is possible to display both the wide-area image 90 and the detailed image 91 through a set of monitoring cameras 10 and a rotating mechanism 16.

[0197] <First Method of Processing by Management Device 11>

[0198] Figure 8 This is a flowchart showing an example of a first method of processing by the management device 11. The first method of processing by the management device 11 is a process in which the management device 11 causes the terminal device 100 to capture an image, for example, in response to a camera request from the management device 11 side, and receives the captured image from the terminal device 100.

[0199] For example, assume that a plurality of workers are working at a construction site, and the construction site is photographed by a surveillance camera 10 installed at a position overlooking the construction site. The workers hold a terminal device 100. The management device 11 displays a detailed image 91 (for example, a reference image 91) on the display 13a. Figure 7 ), the detailed image 91 represents a wide-area image 90 composed of a plurality of monitoring target areas E1 of the construction site photographed by the monitoring camera 10 (for example, referring to Figure 7 ) in the area designated by the area designation cursor 90a. If an operation is performed by the user (monitor) to send instruction information for the detailed image 91 displayed on the display 13a (for example, operation of the start button in the menu screen), the management device 11 executes Figure 8 As described above, the management device 11 stores the correspondence information in which the coordinates of the wide area image 90, the control parameters of the slewing mechanism 16, and the longitude and latitude are associated with each other.

[0200] First, the management device 11 obtains the position information corresponding to the current detailed image 91 (step S11). The position information corresponding to the detailed image 91 is the longitude and latitude information of the camera object (local area e1) correspondingly associated with the camera image (detailed image 91) based on the monitoring camera 10 and the rotating mechanism 16. The position information corresponding to the detailed image 91 is, for example, the longitude and latitude information of the location that appears at the center of the detailed image 91. In addition, the position information corresponding to the detailed image 91 can be, for example, the longitude and latitude information of the camera object correspondingly associated with the camera image that also takes the field of view angle into consideration. For example, based on the above-mentioned corresponding information, the management device 11 obtains the position information (longitude and latitude information) corresponding to the current control parameters of the rotating mechanism 16 as the position information (longitude and latitude information) corresponding to the current detailed image 91.

[0201] Next, the management device 11 obtains the position information of the terminal device 100 held by each worker in the monitoring target area E1 (step S12). This position information is obtained by the terminal device 100 in the imaging area (monitoring target area E1) that can be imaged by the monitoring camera 10 and the slewing mechanism 16.

[0202] The terminal device 100 of each operator in the monitoring target area E1 repeatedly sends the GPS information of the terminal device 100 obtained by the GNSS unit 104 of the terminal device 100 to the management device 11. In response, the management device 11 obtains the latest position information among the received position information for the terminal device 100 of each operator in the monitoring target area E1 in step S12.

[0203] Alternatively, in step S12 , the management device 11 may send a request signal to the terminal device 100 of each worker in the monitoring target area E1 to request transmission of the position information, and acquire the position information transmitted from the terminal device 100 in response to the request signal.

[0204] Next, the management device 11 obtains the worker W1 (reference number) shown in the detailed image 91 based on the position information corresponding to the detailed image 91 obtained in step S11 and the position information of the terminal device 100 obtained in step S12. Figure 7 ) of the terminal device 100 (step S13). The attribute information of the terminal device 100 is, for example, a camera ID assigned to each terminal device 100. The attribute information of the terminal device 100 is acquired within the imaging range (for example, the detailed image 91) set according to the imaging direction (pan / tilt value) of the monitoring camera 10.

[0205] The attribute information of the terminal device 100 can be acquired within the imaging range set in consideration of the viewing angle of the monitoring camera 10. In addition, when a plurality of workers are shown in the detailed image 91, the user of the management device 11 can select a worker.

[0206] Next, the management device 11 receives from the user of the management device 11 a designation of a photographing condition for causing the terminal device 100 that has acquired the attribute information in step S13 to request photographing a designated image (step S14). The photographing condition is created, for example, as message information input from the receiving device 62 (e.g., the keyboard 13b, etc.). In the case where the monitored area is a construction site, for example, the photographing condition is such as "I want to know the location of the dump truck V1 (reference Figure 7 ) and information on the driver's seat, so please take a picture" is used to create shooting instruction information to supplement the insufficient images that cannot be obtained during the shooting of the monitoring camera 10. The management device 11 can support the specification of shooting conditions by, for example, displaying a template or option of the shooting conditions on the display 13a.

[0207] Next, the management device 11 transmits the image capturing instruction information received in step S14 to the operator W1 holding the terminal device 100, for example, by email, based on the attribute information of the terminal device 100 acquired in step S13 (step S15). The transmitted image capturing instruction information includes information on the destination to which the image data captured by the terminal device 100 is requested to be transmitted, for example, the email address of the management device 11.

[0208] Next, the management device 11 determines whether or not captured image data (second captured image data) captured by the terminal device 100 has been received from the terminal device 100 that transmitted the image capturing instruction information in step S15 (step S16).

[0209] In step S16, if the second camera image data is not received from the terminal device 100 (step S16: No), the management device 11 waits until the second camera image data is received. In step S16, if the second camera image data is received from the terminal device 100 (step S16: Yes), the management device 11 displays the received second camera image data on the display 13a (step S17). The management device 11 may associate the received second camera image data with the detailed image 91 displayed on the display 13a in step S11 and store them in the memory 60C or the secondary storage device 14.

[0210] In addition, the first mode of processing by the management device 11 described above starts from the state where the detailed image 91 is displayed on the display 13a, but is not limited to this. For example, the wide-area image 90 (pseudo wide-angle image) may be displayed in advance on the display 13a, and even when the user specifies a predetermined coordinate in the wide-area image 90, the same first mode of processing may be started.

[0211] As described above, according to the first method of processing by the management device 11, it is possible to request, using the terminal device 100 of a worker working on the construction site, to capture a specific area that is difficult to capture in detail using the monitoring camera 10 installed at a position overlooking the construction site. As a result, images captured by the monitoring camera 10 and the terminal device 100 at different distances from the captured object can be mutually utilized.

[0212] <First Method of Processing by Image Capture System 1>

[0213] Fig. 9This is a timing diagram showing an example of the first method of processing by the camera system 1. The first method of processing by the camera system 1 is, for example, the following processing: the management device 11 requests the terminal device 100 to capture image information that is insufficient for the image captured by the monitoring camera 10 alone, and the terminal device 100 sends the image captured in accordance with the request to the management device 11.

[0214] For example, at a construction site, a monitoring camera 10 is installed at a position where the construction site can be overlooked. The monitoring camera 10 captures the conditions of the construction site. At the construction site, multiple workers are working. The workers hold terminal devices 100. In the management room where the management device 11 is installed, there are users (monitoring personnel) who monitor the construction site.

[0215] First, the monitoring camera 10 sends the camera image data (first camera data) of the construction site to the management device 11 (step S21). The monitoring camera 10 divides the entire construction site into a plurality of monitoring target areas E1 for imaging, and sends the camera image data of each monitoring target area E1 to the management device 11.

[0216] Next, the management device 11 receives the first image data transmitted from the monitoring camera 10 and displays the wide-area image 90 (first image) composed of a plurality of monitoring target areas E1 on the display 13a (step S22).

[0217] Next, the management device 11 receives a shooting instruction sending operation from the user (step S23). The shooting instruction sending operation is an operation to start a shooting instruction for causing the terminal device 100 to shoot a specified image. For example, the shooting instruction sending operation includes a touch operation of a shooting instruction start button on a menu screen displayed on the display 13a and an operation to specify the terminal device 100 that is required to shoot a specified image. The terminal device 100 that is required to shoot a specified image is specified by an operation of area specification based on the area specification cursor 90a. In the wide-area image 90, the area is specified in such a way that any operator is included in the area specification cursor 90a.

[0218] Next, the management apparatus 11 acquires the attribute information of the terminal device 100 (step S24). By the area designation in step S23, a detailed image 91 (for example, see FIG. 1 ) indicating the area designated by the area designation cursor 90a is displayed on the display 13a of the management apparatus 11. Figure 7). First, the management device 11 obtains the position information corresponding to the detailed image 91. For example, based on the above-mentioned corresponding information, the management device 11 obtains the position information (latitude and longitude information) corresponding to the current control parameters of the slewing mechanism 16 as the position information (latitude and longitude information) corresponding to the detailed image 91. Next, the management device 11 obtains the position information (GPS information) of the terminal device 100 held by the operator in the detailed image 91. Next, based on the position information corresponding to the detailed image 91 and the position information of the terminal device 100, the management device 11 obtains, for example, the operator W1 (reference Figure 7 )’s attribute information of the terminal device 100.

[0219] Next, the management device 11 receives the designation of a photographing condition for causing the terminal device 100 to request photographing a designated image from the user (step S25). The photographing condition may be, for example, "I want to know the location of the dump truck V1 (reference Figure 7 ) and information on the driver's seat, so please take a picture" is used to create shooting instruction information for supplementing insufficient images that cannot be obtained during the shooting of the monitoring camera 10.

[0220] Next, the management device 11 transmits imaging instruction information indicating an imaging instruction including the imaging conditions accepted in step S25 to the worker W1 holding the terminal device 100 based on the attribute information of the terminal device 100 acquired in step S24 (step S26 ).

[0221] Next, the terminal device 100 receives the image capturing instruction information sent from the management device 11 in step S26, and displays the contents of the image capturing instruction on the screen of the terminal device 100 (step S27). At this time, the terminal device 100 can send the detailed image 91 captured by the monitoring camera 10 from the management device 11, and display the detailed image 91 on the screen of the terminal device 100 in parallel with the image capturing instruction information.

[0222] Next, the terminal device 100 receives a camera operation performed by the operator W1 holding the terminal device 100 (step S28). The operator W1 performs a camera operation to capture a predetermined image (the front of the dump truck, the driver's seat) according to the camera instruction information. Next, the terminal device 100 captures an image by the camera unit 106 according to the camera operation of the operator W1 (step S29).

[0223] Next, the terminal device 100 transmits the image data (second captured image data) of the image captured in step S29 to the management apparatus 11 (step S30).

[0224] Next, the management device 11 receives the second captured image data transmitted from the terminal device 100 in step S30, and displays the second captured image on the display 13a (step S31).

[0225] Fig.10 This figure shows an example of a camera image that is captured by the terminal device 100 in accordance with a camera request from the management device 11 and sent from the terminal device 100 to the management device 11. Specifically, it is a camera image 111 of "the front of the dump truck V1" captured in accordance with the camera conditions received from the user of the management device 11 in steps S14 and S25.

[0226] Fig.11 This is a diagram showing another example of a captured image captured by the terminal device 100 in response to a capture request from the management device 11 and transmitted from the terminal device 100 to the management device 11 . Fig.11 It is magnified Fig.10 The illustrated partial enlarged view of a portion of the captured image 111. Specifically, it is a captured image 112 of the "driver's seat of the dump truck V1" captured based on the imaging conditions received from the user of the management device 11 in steps S14 and S25.

[0227] As described above, according to the first mode of processing by the camera system 1, it is possible to request the terminal device 100 of a worker working on the construction site to capture a specific area that is difficult to capture in detail using the monitoring camera 10 installed at a position overlooking the construction site, and in response to the request, the image captured by the terminal device 100 is sent to the management device 11. In this way, images captured by the monitoring camera 10 and the terminal device 100 at different distances from the captured object can be mutually utilized.

[0228] <Modification 1 of the Imaging System 1>

[0229] Fig.12 FIG. 1 is a diagram showing a modified example 1 of the imaging system 1. Fig.12 As shown, the camera system 1 has Figure 1 In addition to the structure shown in the figure, a monitoring camera 10a may be included. The monitoring camera 10a is a camera with a wider field of view than the monitoring camera 10, and is set in a manner that can capture the entire monitoring target area E1. The structure of the monitoring camera 10a is, for example, similar to Figure 4 The structure of the surveillance camera 10 shown is the same, but the difference is that the optical system 15 has wider-angle optical characteristics.

[0230] Fig.13 Yes means Fig.12 FIG. 1 is a diagram showing an example of a configuration of an electrical system of the management device 11. Fig.12In the imaging system 1 shown, the monitoring camera 10a includes a communication I / F 34a which is the same as the communication I / F 34 of the monitoring camera 10. The communication I / F 34a performs communication between the monitoring camera 10a and the management device 11.

[0231] The communication I / F 66 of the management device 11 is communicatively connected to the communication I / F 34 a of the monitoring camera 10 in addition to the communication I / F 34 of the monitoring camera 10 , and controls transmission of various information between the monitoring cameras 10 and 10 a .

[0232] Fig.14 It means in Fig.12 , Fig.13 FIG. 1 is a diagram showing an example of an image displayed by the management device 11 in the structure shown. Fig.12 , Fig.13 In the illustrated configuration, the management device 11 displays an image based on the imaging information obtained from the monitoring camera 10a as the wide-area image 90 showing the monitoring target area E1. That is, the wide-area image 90 in this case is not a pseudo wide-angle image generated by synthesizing the imaging information obtained by causing the monitoring camera 10 to image the respective areas of the monitoring target area E1, but is a wide-angle image based on a single imaging information obtained by the wide-angle monitoring camera 10a.

[0233] In this case, the wide area image 90 may be a non-real-time image obtained by periodic imaging as described above, or may be a real-time image obtained from the latest imaging information obtained by imaging by the monitoring camera 10 a .

[0234] In this case, the management device 11 stores the correspondence information that uniquely associates the coordinates of the wide-area image 90, the control parameters of the slewing mechanism 16, and the longitude and latitude. In this case, among the coordinates of the wide-area image 90 corresponding to the control parameters and the longitude and latitude of the slewing mechanism 16, for a plurality of positions included in the monitoring target area E1 and having known longitude and latitude, the corresponding coordinates are specified and exported by the user of the management device 11 in the wide-area image 90, for example. The management device 11 uses the correspondence information to execute Figure 8 Processing shown.

[0235] <Modification 2 of the Imaging System 1>

[0236] Fig.15 FIG. 2 is a diagram showing a second modification of the imaging system 1. Fig.15 As shown, the camera system 1 can be set to Fig.12 In the illustrated structure, the structures of the monitoring camera 10 and the rotating mechanism 16 are omitted.

[0237] Fig.16 Yes means Fig.15FIG. 1 is a diagram showing an example of a configuration of an electrical system of the management device 11. Fig.15 In the camera system 1 shown in FIG. 1 , the management device 11 becomes Fig.13 The communication I / F 67 and the communication I / F 68 are omitted in the illustrated configuration. The communication I / F 66 of the management device 11 is communicatively connected to the communication I / F 34a of the monitoring camera 10a, and performs transmission control of various information with the monitoring camera 10a.

[0238] exist Fig.15 , Fig.16 In the structure shown, the image displayed by the management device 11 is, for example, Fig.14 The wide-area image 90 and the detailed image 91 shown are the same. The management device 11 displays a digital zoom image of the area designated by the area designation cursor 90a in the wide-area image 90 cut out and enlarged as the detailed image 91 showing the local area e1. In this case, the wide-area image 90 is, for example, a real-time image obtained from the latest imaging information obtained by the monitoring camera 10a.

[0239] In this case, the management device 11 stores the correspondence information that uniquely associates the coordinates of the wide-area image 90 with the longitude and latitude. That is, the correspondence information in this case does not require the control parameters of the slewing mechanism 16. In this case, among the coordinates of the wide-area image 90 corresponding to the longitude and latitude, the corresponding coordinates in the wide-area image 90 are derived by, for example, specifying the corresponding coordinates in the wide-area image 90 for a plurality of positions whose longitude and latitude are known and are included in the monitoring target area E1 by the user of the management device 11.

[0240] The management device 11 uses this correspondence information to execute Figure 8 In this case, in step S11 , the management device 11 acquires the longitude and latitude corresponding to the detailed image 91 based on the coordinates and corresponding information of the digitally zoomed area in the wide-area image 90 .

[0241] <Confirmation and handling of those who are unwell or injured>

[0242] Fig.17 1 is a diagram showing an example of a process for identifying a sick or injured person, etc. The imaging system 1 can also be applied to a system that can identify a worker who has collapsed or is unable to move due to heat stroke or injury, etc. in a monitoring target area E1 (for example, a construction site).

[0243] For example, the terminal device 100 detects abnormalities of the workers who hold the terminal device 100. The detection of abnormalities of the workers is performed, for example, based on at least one of the following situations: the state where the longitude and latitude acquired by the GNSS unit 104 of the terminal device 100 remain unchanged for a certain period of time or more, or the stationary state of the terminal device 100 detected by the acceleration sensor of the terminal device 100 continues for a certain period of time or more, or the biometric information of the worker measured by a wearable device that can communicate with the terminal device 100 and is worn by the worker is an abnormal value.

[0244] In this case, the terminal device 100 sends the abnormality detection information indicating that the abnormality of the operator is detected to the management device 11 together with the latitude and longitude information obtained by the GNSS unit 104 of the terminal device 100. When the management device 11 receives the abnormality detection information and the latitude and longitude information, it displays the detailed image 91 of the area corresponding to the latitude and longitude in the wide-area image 90. Thus, when the abnormality of the operator is detected by the terminal device 100, the detailed image 91 indicating the position of the operator can be automatically displayed. Therefore, the user of the management device 11 can quickly confirm the status of the operator whose abnormality is detected.

[0245] exist Fig.17 In the state shown, the worker W1 falls in the local area e1, and the terminal device 100 held by the worker W1 sends abnormality detection information and longitude and latitude information to the management device 11. In this case, the management device 11 displays a detailed image 91 of the local area e1 based on the longitude and latitude information received together with the abnormality detection information. Thus, the user of the management device 11 can quickly confirm the situation that the worker W1 has fallen.

[0246] In addition, the user of the management device 11 can send instruction information to inquire about the status of the worker W1 or send instruction information to instruct other workers around the worker W1 to rescue, etc. by performing the above-mentioned instruction information sending operation while displaying the detailed image 91 showing the worker W1.

[0247] <Second Method of Processing by Management Device 11>

[0248] Fig.18 1 is a flowchart showing an example of a second method of processing by the management device 11. The second method of processing by the management device 11 is processing in which the management device 11 causes the monitoring camera 10 to capture a requested image based on a capture request from the terminal device 100, and transmits the captured requested image to the terminal device 100.

[0249] For example, assume the following situation: at a disaster site, workers are working and monitoring the disaster site through surveillance cameras 10 installed on a high platform around the disaster site. The workers have terminal devices 100. If a camera request signal for capturing the surrounding area of ​​the workers at the disaster site is sent from the workers' terminal devices 100 to the management device 11, the management device 11 executes Fig.18 In addition, the management device 11 and the Figure 7 Similarly to the case of the wide area image 90 of the construction site described in , the corresponding information in which the coordinates of the wide area image of the monitoring camera 10 monitoring the disaster site, the control parameters of the slewing mechanism 16, and the longitude and latitude are associated with each other is stored.

[0250] The management device 11 determines whether the position information indicating the photographed position is received from the terminal device 100 (step S41).

[0251] In step S41, if the position information is not received from the terminal device 100 (step S41: No), the management device 11 waits until the position information is received. In step S41, if the position information is received from the terminal device 100 (step S41: Yes), the management device 11 obtains the rotation control value of the rotation mechanism 16 for photographing the position required to be photographed based on the received position information and the above-mentioned corresponding information (step S42). The rotation control value of the rotation mechanism 16 is a pan / tilt value for photographing the position required to be photographed.

[0252] Next, the management device 11 transmits a swing instruction signal for controlling the swing of the swing mechanism 16 to the swing mechanism 16 based on the swing control value acquired in step S42 to swing the swing mechanism 16 (step S43 ).

[0253] Next, the management device 11 transmits an image capturing instruction signal for controlling the image capturing of the monitoring camera 10 to the monitoring camera 10 to capture an image (step S44 ).

[0254] Next, the management device 11 receives the captured image data (first captured image data) captured by the monitoring camera 10 from the monitoring camera 10 (step S45 ).

[0255] Next, the management device 11 sends the first camera image data of the monitoring camera 10 received in step S45 to the terminal device 100 of the operator who requested the shooting (step S46). At this time, the management device 11 can display the first camera image represented by the first camera image data received from the monitoring camera 10 on the display 13a.

[0256] As described above, according to the second mode of processing by the management device 11, the monitoring camera 10 installed at a position overlooking the disaster site can capture information that is difficult for workers working at the disaster site to know, such as images for knowing the surrounding conditions of the workers, and send the captured images to the workers' terminal device 100. As a result, images captured by the monitoring camera 10 and the terminal device 100 at different distances from the captured object can be mutually utilized.

[0257] In the above example, the terminal device 100 of the worker requests the management device 11 to take a picture of the surrounding area of ​​the worker at the disaster site, but the present invention is not limited to this. For example, the worker may specify a location to be photographed, and the monitoring camera 10 may take a picture of the surrounding area of ​​the specified location.

[0258] <Second Method of Processing by Image Capture System 1>

[0259] Fig.19 This is a timing diagram showing an example of the second method of processing by the camera system 1. The second method of processing by the camera system 1 is, for example, the following processing: the terminal device 100 requests the management device 11 to capture an image of a specified position, and the management device 11 causes the monitoring camera 10 to capture an image based on the request and sends the captured image to the terminal device 100.

[0260] For example, at a disaster site, a monitoring camera 10 is installed on a high platform around the disaster site. The situation at the disaster site is photographed by the monitoring camera 10. At the disaster site, workers are working. The workers hold a terminal device 100. In the management room where the management device 11 is installed, there is a user (monitoring personnel) who monitors the situation at the disaster site.

[0261] First, the terminal device 100 receives a peripheral camera operation from the operator holding the terminal device 100 (step S51). The peripheral camera operation is an operation that causes the management device 11 to start a camera request for capturing an image of the surrounding area (the surrounding area of ​​the terminal device 100) where the operator is located. For example, the peripheral camera operation is an operation of touching a camera request start button on a menu screen displayed on the screen of the terminal device 100. If the peripheral camera operation is received in step S51, the terminal device 100 sends the location information (GPS information) of the terminal device 100 to the management device 11 (step S52).

[0262] Next, the management device 11 receives the position information of the terminal device 100 sent in step S52, and obtains the rotation control value of the rotation mechanism 16 from the received position information (step S53). For example, the management device 11 obtains the rotation control value (pan / tilt value) of the rotation mechanism 16 for photographing the position required to be photographed based on the received position information and the above-mentioned corresponding information. Next, the management device 11 sends a rotation instruction signal for controlling the rotation of the rotation mechanism 16 to the rotation mechanism 16 based on the rotation control value obtained in step S53 (step S54).

[0263] Next, the swing mechanism 16 receives the swing instruction signal sent in step S54, and performs a swing operation according to the received swing instruction signal (step S55).

[0264] Next, when the rotation of the rotation mechanism 16 in step S55 is completed, the management device 11 sends a shooting instruction signal for controlling the shooting of the monitoring camera 10 to the monitoring camera 10 (step S56). The management device 11 may, for example, pre-calculate the focus value relative to the shooting position, and include the calculated focus value information in the shooting instruction signal and send it.

[0265] Next, the monitoring camera 10 receives the image capturing instruction signal sent in step S56, and performs image capturing according to the received image capturing instruction signal (step S57). Next, the monitoring camera 10 transmits the image captured in step S57, i.e., the image data (first image capturing data) of the surrounding area where the operator is located (the surrounding area of ​​the terminal device 100), to the management device 11 (step S58).

[0266] Next, the management device 11 receives the first captured image data transmitted in step S58, and transmits the first captured image data to the terminal device 100 of the worker who requested the image capture (step S59).

[0267] Next, the terminal device 100 receives the first captured image data transmitted from the management apparatus 11 in step S59, and displays the first captured image on the screen of the terminal device 100 (step S60).

[0268] As described above, according to the second mode of processing based on the camera system 1, it is possible to request information that is difficult for workers at the disaster site to know, such as images for knowing the surrounding conditions of the workers, from the management device 11, and to capture images of the surroundings of the workers in accordance with the request through the monitoring camera 10 installed at a position overlooking the disaster site, and to send the captured images to the terminal device 100 of the workers. As a result, images captured by the monitoring camera 10 and the terminal device 100 at different distances from the captured object can be mutually utilized. Workers at the disaster site can accurately confirm the surrounding conditions of the site, thereby improving workability and ensuring safety.

[0269] Fig. 20 1 is a timing chart showing another example of the second method of processing by the imaging system 1. Fig. 20 In the example shown, first, the terminal device 100 receives an operation for specifying a camera position from an operator holding the terminal device 100 (step S61). The operation for specifying a camera position is an operation for causing the management device 11 to start a camera request for capturing a peripheral image of a position specified by the operator. For example, the operation for specifying a camera position includes a touch operation of a camera request start button on a menu screen displayed on the screen of the terminal device 100 and an operation for specifying a camera request position. The camera request position is specified, for example, by a touch operation to specify an arbitrary position on a peripheral map displayed on the screen of the terminal device 100. If the operation for specifying a camera position is accepted in step S61, the terminal device 100 sends the location information (latitude and longitude) of the specified location to the management device 11 (step S62).

[0270] Next, the management device 11 receives the position information of the designated position sent in step S62, and acquires the swing control value of the swing mechanism 16 from the received position information (step S63). Fig.19 The acquisition method of step S53 in is the same.

[0271] And, since the processing of the next steps S64 to S67 is the same as Fig.19 The processing from step S54 to step S57 in is the same, so the description is omitted.

[0272] Next, the monitoring camera 10 transmits the image captured in step S67, that is, the image data (first captured image data) of the surrounding image of the position designated by the operator to the management device 11 (step S68).

[0273] And, since the processing of the next steps S69 to S70 is the same as Fig.19 The processing up to steps S59 to S60 in is the same, so the description is omitted.

[0274] As described above, according to another example of the second mode, it is possible to request the management device 11 to capture an image of a location specified by a worker at the disaster site, and the monitoring camera 10 captures an image corresponding to the request, and transmits the captured image to the worker's terminal device 100. Thus, images captured by the monitoring camera 10 and the terminal device 100 at different distances from the captured object can be mutually utilized. The workers at the disaster site can accurately confirm the status of the disaster.

[0275] <Storage medium for management program>

[0276] In the above management control, an example is given in which the management program of each embodiment is stored in the storage device 60B of the management device 11 and the CPU 60A of the management device 11 executes the management program through the memory 60C. However, the technology of the present invention is not limited to this.

[0277] Fig.21 1 is a diagram showing an example of a method of installing a management program from a storage medium storing a management control management program into the control device 60 of the management device 11. Fig.21 As shown, the management program 221 can be stored in a non-temporary storage medium, namely, a storage medium 220. Fig.21 In the illustrated example, a management program 221 stored in a storage medium 220 is installed in the control device 60 , and the CPU 60A executes the above-described processes according to the management program 221 .

[0278] Various embodiments have been described above, but the present invention is certainly not limited to these examples. Obviously, those skilled in the art can think of various variations or modifications within the scope described in the technical solution, and it should be understood that these variations or modifications naturally also belong to the technical scope of the present invention. Furthermore, the various constituent elements in the above embodiments can be arbitrarily combined within the scope of the purpose of the invention.

[0279] In addition, this application is based on the Japanese patent application (Japanese Patent Application No. 2022-153055) filed on September 26, 2022, and the contents thereof are incorporated herein by reference.

[0280] Explanation of symbols

[0281] 1-camera system, 10, 10a-surveillance camera, 11-management device, 12-communication line, 13a, 43B-display, 13b-keyboard, 13c-mouse, 14-secondary storage device, 15-optical system, 15B-lens group, 15B1-anti-vibration lens, 15B2-zoom lens, 16-rotation mechanism, 17, 21-lens actuator, 19-computer, 22, 23, 75, 76-driver, 22-BIS driver, 23-OIS driver, 25-imaging element, 25A-light receiving surface, 27-imaging element actuator, 28-lens driver, 29, 45-correction mechanism, 31-DSP, 32-image memory, 33-correction unit, 34, 34a, 66 to 69, 79, 80, 103-communication I / F, 35 , 60C, 102-memory, 36, 60B-storage device, 37, 60A-CPU, 38, 70, 109-bus, 39, 47-position sensor, 40-jitter detection sensor, 43-UI system device, 43A, 62-receiving device, 60-control device, 71-yaw axis rotation mechanism, 72-pitch axis rotation mechanism, 73, 74-motor, 90-wide area image, 90a-area designation cursor, 91-detailed image, 100-terminal device, 101-processor, 104-GNSS unit, 105-user I / F, 106-camera unit, 111, 112-camera image, 220-storage medium, 221-management program, e1-local area, W1-operator, V1-dump truck, E1-monitored area.

Claims

1. A management device capable of communicating with a first camera device for photographing a subject and a second camera device located in an area that can be photographed by the first camera device, and comprising a processor, wherein: The processor performs the following processing: The attribute information of the second imaging device is acquired based on at least one of a result of image processing on the first imaging data acquired by the first imaging device and information related to imaging by the first imaging device.

2. The management device according to claim 1, wherein: The processor performs the following processing: Based on the attribute information, imaging instruction information indicating imaging conditions of the object is sent to the second imaging device.

3. The management device according to claim 2, wherein: The imaging conditions are specified by a user of the management device.

4. The management device according to claim 2, wherein: The imaging condition is a condition for supplementing the deficiencies of the first imaging data.

5. The management device according to claim 4, wherein: The imaging conditions are represented by a stereotype tool.

6. The management device according to claim 2, wherein: The processor performs the following processing: At least one of a first captured image represented by the first captured image data and a second captured image represented by the second captured image data acquired by the second captured image device is output to a display device, and the designation of the captured image condition is accepted from a user.

7. The management device according to claim 1, wherein: The information related to the imaging is a range set according to the imaging direction of the first imaging device.

8. The management device according to claim 7, wherein: The range is set according to the field of view of the first imaging device.

9. The management device according to claim 7, wherein: The range is set based on position information associated with the imaging direction.

10. The management device according to claim 7, wherein: The processor performs the following processing: The attribute information is acquired based on the range and GPS information of a plurality of imaging devices including the second imaging device.

11. The management device according to claim 1, wherein: The processor performs the following processing: Attribute information of the second imaging device is acquired based on a result of recognition of a holder of the second imaging device or a setting target of the second imaging device based on the image processing.

12. A management device capable of communicating with a first camera device for photographing a subject and a second camera device located at a position different from the first camera device, and comprising a processor, wherein: The processor performs the following processing: causing the first imaging device to perform imaging based on at least one of the position information of the second imaging device and the imaging condition specified by the second imaging device; and The first imaging data acquired by the first imaging device is transmitted to the second imaging device.

13. The management device according to claim 12, wherein: The processor performs the following processing: At least one of a first captured image represented by the first captured image data acquired by the first imaging device and a second captured image represented by the second captured image data acquired by the second imaging device is output to a display device.

14. The management device according to any one of claims 1 to 13, which is capable of communicating with a rotating device that rotates the first camera device. The processor acquires correspondence information between a control value of the slewing device and a position of an imaging object by the first imaging device.

15. The management device according to claim 14, wherein: The processor performs the following processing: while controlling the rotation device to change the imaging direction of the first imaging device, synthesizing a plurality of image data acquired by the first imaging device to generate first synthesized image data; and Correspondence information between the coordinates of the first synthesized image represented by the first synthesized image data and the control value of the slewing device is generated.

16. A camera system comprising: A first camera device for photographing a subject; a second camera device located in an area that can be photographed by the first camera device; and a management device capable of communicating with the first camera device and the second camera device, The processor of the management device performs the following processing: The attribute information of the second imaging device is acquired based on at least one of a result of image processing on the first imaging data acquired by the first imaging device and information related to imaging by the first imaging device.

17. A camera system comprising: A first camera device for photographing a subject; a second camera device located at a position different from that of the first camera device; and a management device capable of communicating with the first camera device and the second camera device, The processor of the management device performs the following processing: causing the first imaging device to perform imaging based on at least one of the position information of the second imaging device and the imaging condition specified by the second imaging device; and The first imaging data acquired by the first imaging device is transmitted to the second imaging device.

18. A management method, which is performed by a management device capable of communicating with a first camera device that captures a subject and a second camera device located in an area that can be captured by the first camera device, wherein: The processor of the management device performs the following processing: The attribute information of the second imaging device is acquired based on at least one of a result of image processing on the first imaging data acquired by the first imaging device and information related to imaging by the first imaging device.

19. A management method, which is performed by a management device capable of communicating with a first camera device for photographing a subject and a second camera device located at a position different from the first camera device, wherein: The processor of the management device performs the following processing: causing the first imaging device to perform imaging based on at least one of the position information of the second imaging device and the imaging condition specified by the second imaging device; and The first imaging data acquired by the first imaging device is transmitted to the second imaging device.

20. A management program for a management device capable of communicating with a first camera device for photographing a subject and a second camera device located in an area capable of photographing by the first camera device, wherein: The management program is used to enable the processor of the management device to perform the following processing: The attribute information of the second imaging device is acquired based on at least one of a result of image processing on the first imaging data acquired by the first imaging device and information related to imaging by the first imaging device.

21. A management program for a management device capable of communicating with a first camera device for photographing a subject and a second camera device located at a position different from the first camera device, wherein: The management program is used to enable the processor of the management device to perform the following processing: causing the first camera to perform photographing based on at least one of the position information of the second camera and the photographing condition specified by the second camera, The first imaging data acquired by the first imaging device is transmitted to the second imaging device.

Images