Display control device, display control method, and computer program

The integration of fixed and temporary cameras with sensor-driven positioning adjustments addresses the limitations of fixed cameras, ensuring comprehensive event capture and enhanced surveillance coverage.

JP7586235B2Active Publication Date: 2024-11-19NEC CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2023115859
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2015-07-02
Filing Date
2023-07-14
Publication Date
2024-11-19
Estimated Expiration
2036-07-01

AI Technical Summary

Technical Problem

Fixed cameras in surveillance systems often fail to capture unusual events due to blind spots and cost constraints, limiting the visibility of security personnel at the command center.

Method used

A surveillance system incorporating fixed cameras and temporary cameras, with control means to extend coverage by adjusting the positioning of temporary cameras based on sensor data from both fixed and temporary cameras.

Benefits of technology

Enhances surveillance coverage by filling blind spots and capturing anomalous events, providing comprehensive incident monitoring with flexible and efficient deployment of temporary cameras.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007586235000001
    Figure 0007586235000001
  • Figure 0007586235000002
    Figure 0007586235000002
  • Figure 0007586235000003
    Figure 0007586235000003
Patent Text Reader

Abstract

To extend a cover range of a monitoring system which monitors a monitoring area.SOLUTION: A device obtains orientation information of a first camera, from the first camera; and determines a shooting direction of the first camera based on the orientation information of the first camera. The device obtains from a second camera position information of the second camera a shooting position of which can be changed and causes a display device to display a map. In addition, the device causes an icon indicating a position of the first camera, an icon indicating the shooting direction of the first camera based on the shooting direction of the first camera, and an icon indicating a position of the second camera based on the position information of the second camera to be displayed on the map. An icon indicating the first camera and an icon indicating the second camera are differently displayed on the display device.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a surveillance system, and more particularly to a surveillance system having fixed and temporary cameras. [Background technology]

[0002] Surveillance systems, such as video surveillance systems, have been used in some areas for routine surveillance and incident detection, with the intention of capturing abnormal events such as terrorist acts, riots, thefts, fights, fires, car accidents, etc.

[0003] However, in some situations, fixed cameras cannot capture unusual events within the monitored area due to blind spots, cost constraints, and privacy concerns, so security personnel at the command center cannot see what is happening in the areas not covered by any fixed cameras.

[0004] Therefore, what is needed is an improved surveillance system that extends the coverage area of ​​fixed cameras and captures anomalous events within a monitored area so that such events can be better understood. Furthermore, other desirable features and characteristics will become apparent from the following detailed description and the appended claims, taken in conjunction with the accompanying drawings and this background of this disclosure. Summary of the Invention

[0005] In a first aspect of the present invention, a surveillance system is disclosed that includes a fixed camera, one or more temporary cameras, and a control means connected to the fixed camera and the one or more temporary cameras, the control means configured to extend the coverage area of ​​the fixed camera using the one or more temporary cameras connected to the fixed camera, each of the one or more temporary cameras including one or more sensors and configured to be adjusted in position based on sensor data acquired from the one or more sensors of the one or more temporary cameras and one or more fixed camera sensors co-located with the fixed camera.

[0006] In a second aspect of the present invention, a method is disclosed for monitoring one or more areas of interest using a fixed camera and one or more temporary cameras and a control means connected to the fixed camera and the one or more temporary cameras, the method includes acquiring sensor data from one or more sensors of the one or more temporary cameras and one or more fixed camera sensors co-located with the fixed cameras, and further including adjusting the position of each of the one or more temporary cameras based on the acquired sensor data to extend coverage of the fixed cameras using the one or more temporary cameras.

[0007] In a third aspect of the present invention, a non-transitory computer readable medium is disclosed that includes program instructions to cause a computer to execute a method for monitoring one or more areas of interest using a fixed camera and one or more temporary cameras and a control means connected to the fixed camera and the one or more temporary cameras, the method including acquiring sensor data from one or more sensors of the one or more temporary cameras and one or more fixed camera sensors co-located with the fixed cameras, and further including adjusting the position of each of the one or more temporary cameras based on the acquired sensor data to extend coverage of the fixed cameras using the one or more temporary cameras. [Brief description of the drawings]

[0008] The accompanying drawings, in which like reference numbers refer to identical or functionally similar elements throughout the different views, and which, together with the following detailed description, are incorporated in and form a part of this specification, illustrate various embodiments and serve to explain various principles and advantages associated with the present embodiments.

[0009] [Figure 1] 1 shows an incident captured by a fixed camera in a conventional surveillance system.

[0010] [Diagram 2] 4 shows an example of the coverage area of ​​a fixed camera and a temporary camera according to the present embodiment.

[0011] [Diagram 3] 4 shows an example of connection between a fixed camera and a temporary camera according to the present embodiment.

[0012] [Figure 4] 1 illustrates an exemplary architecture of a system according to an embodiment;

[0013] [Diagram 5] 1 shows an exemplary block diagram of a system according to an embodiment of the present invention.

[0014] [Figure 6] 1 shows an exemplary block diagram of a system according to an embodiment of the present invention.

[0015] [Figure 7] 1 shows a block diagram of Example 1 according to the present embodiment.

[0016] [Figure 8] 1 shows a block diagram of Example 2 according to the present embodiment.

[0017] [Figure 9] 13 shows a block diagram of Example 3 according to the present embodiment.

[0018] [Figure 10] 2 shows an exemplary flow chart of a method according to the present embodiment;

[0019] [Figure 11] 2 shows an exemplary flow chart of a method according to the present embodiment;

[0020] [Figure 12] 1 illustrates a computer system for implementing a method for monitoring incident-related data according to an embodiment.

[0021] Those skilled in the art will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale, for example, the size of some of the elements in the visualized simulations or steps in the flowcharts may be exaggerated relative to other elements to help better understand the embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] The following detailed description is merely exemplary in nature and is not intended to limit the invention or the application and uses of the invention. Furthermore, there is no intention to be bound by the preceding background of the invention or the theories presented in the following detailed description. The present embodiments are intended to provide an improved method for monitoring incident-related data.

[0023] Fig. 1 shows an incident captured by a fixed camera of a conventional surveillance system. As shown in Fig. 1, the field of view (FOV) 106 of the fixed camera 102 of the conventional surveillance system is limited and cannot capture the entire scene 110 of the incident 108. In a conventional surveillance system with a fixed camera 102, only limited information 104 is available to security personnel in a command center. Therefore, it is difficult to understand an incident 108 that is not completely captured in the field of view 106 of the fixed camera 102.

[0024] To improve upon traditional surveillance systems with fixed cameras, according to the present embodiment, temporary cameras are deployed in locations outside the coverage area of ​​the fixed cameras where crimes are increasing or major events are planned. This is very important because the commander in the command center needs to know what really happened in the field if the incident was not captured by the fixed cameras. The newly deployed temporary camera connects and registers itself to the current network so that the footage can be shared and the commander knows where the temporary camera is located.

[0025] 2 shows an example of coverage of fixed and temporary cameras according to the present embodiment. In addition to the fixed camera 202, four temporary cameras 208, 212, 216 and 220 are placed outside the fixed camera coverage area 206. As a result, the four temporary cameras 208, 212, 216 and 220 enable the surveillance system to cover FOVs 210, 214, 218 and 222.

[0026] 3, the newly placed temporary cameras 308, 312, 316, and 320 are connected to the existing fixed camera 302, for example, via a data relay ad-hoc network 324. The data relay ad-hoc network 324 gives the surveillance system a degree of freedom in terms of the placement of the temporary cameras 308, 312, 316, and 320. In addition, the data acquired from the temporary cameras 308, 312, 316, and 320 is sent to the fixed camera 302 and transferred to a command and control center 326.

[0027] Figure 4 shows an example architecture of the system according to this embodiment. For the registration process, each camera automatically registers its position to the system. Some important information, such as location information and FOV information, are shared within the system.

[0028] 4, a Camera Management Client (CMC) 416 in the temporary camera 402 collects sensor data such as position data, orientation data, etc. from sensors in the temporary camera 402 such as a GPS receiver 410, a gyroscope 412, and an acceleration sensor 414, and transmits the collected sensor data to the control means 406 via the network 404 together with security camera images captured by a camera 408 of the temporary camera 402. Similarly, the CMC 446 in the fixed camera 448 transmits sensor data collected from sensors 440, 442, and 444 together with security camera images captured by a camera 438 of the fixed camera 448 to the control means 406 via the network. Additionally, the temporary camera 402 may include a microphone for acquiring audio data.

[0029] A camera management server (CMS) 418 of the control means 406 receives data from the CMCs 416 and 446, and registers the data from the CMCs 416 and 446 in the control means 406. The CMS 418 sends adjustment data 432, such as latitude and longitude, of the temporary camera 402 and the fixed camera 448 to a camera position database 422, and then transfers it to the FOV estimator 420. The CMS 418 also sends direction data 430, including the horizontal direction 434 and vertical direction of the temporary camera 402 and the fixed camera 448, to the FOV estimator 420. The FOV estimator 420 estimates the FOV of the cameras 402 and 448 based on the horizontal direction 434 estimated by the gyroscopes 412 and 442 and the distance 436 estimated from the depression angle (vertical direction) by the acceleration sensors 414 and 444. Furthermore, a compass is used to identify the north direction. The compass is used to determine the camera's orientation.

[0030] Based on the estimated FOV, the situation processor 424 calculates the area (blind spot) not captured by the estimated FOV. Based on the blind spot calculated by the situation processor 424, the attitude adjuster 426 sends feedback to all or some of the cameras 402, 448 via the network 404 to adjust the position and / or orientation of the cameras to cover the blind spot. After the position and / or orientation are adjusted, the estimated FOV is sent to the application 428 for the security commander.

[0031] FIG. 5 shows an example block diagram of a system 500 according to this embodiment. In this configuration, the system 500 continuously receives sensor data via sensor data receivers 502, 504 and estimates the FOV to be shown on the map. In a first step, the position sensor receiver 502 receives alignment data from a position sensor module, such as a GPS receiver. Also, the attitude sensor receiver 504 receives data from an attitude sensor, such as a gyroscope, accelerometer, or compass. In a second step, the FOV estimator 506 uses the sensor data to estimate the FOV. In a third step, the FOV estimator 506 sends the estimated FOV to an application 508 for displaying the information on a map or providing the information in another form.

[0032] FIG. 6 shows an example block diagram of a system 600 according to the present embodiment. In this configuration, during the registration process, the camera management client (CMC) 610 collects sensor data by the sensor data receivers 602, 604, and the camera management server (CMS) 612 analyzes the sensor data. In a first step, the position sensor receiver 602 receives the position data from the position sensor module, and the attitude sensor receiver 604 receives the data from the attitude sensor module. In a second step, the CMC 610 receives the data from all the sensor data receivers 602, 604 and sends the sensor data to the CMS 612. In a third step, the CMS 612 sends the attitude data to the FOV estimation module 606 to use the data to estimate the FOV. In a fourth step, the CMS 612 stores the position data and the estimated FOV in the camera position database 614. In a fifth step, the camera position database 614 sends the position data and the FOV data to the situation processing module 616 to calculate parameters to identify both the areas covered and the areas not covered by the camera. In a sixth step, the pose control module 618 adjusts the pose of the temporary camera to point the temporary camera towards the area of ​​interest based on the estimated FOV data from the database 614. In a seventh step, the pose control module 618 sends the position and FOV data to the application 608 to indicate the camera position, area of ​​interest and FOV and to play the real-time video.

[0033] FIG. 7 shows a block diagram of Example 1 according to the present embodiment. In a first step, the position sensor receiver 706 receives the position data from the GPS sensor module. Also, the attitude sensor receivers 702 and 704 receive the compass data and the acceleration data from the compass sensor and the acceleration sensor. In a second step, the FOV estimation module 708 estimates the FOV by estimating the camera direction 712 using the compass data as shown in a top view 718, the depression angle using the acceleration data as shown in a side view 720, and the distance 714 using the depression angle and the typical height of the camera installation, and the geolocation 716 of the camera on the map 722 can be estimated from the position data 724. In a third step, the estimated FOV is sent to the application 710 to indicate the camera position, FOV, and to play the real-time video.

[0034] 8 shows a block diagram of Example 2 according to this embodiment. In a first step, the position sensor receiver 806 receives the alignment data from the GPS sensor module. Also, the attitude sensor receivers 802 and 804 receive the compass data and the acceleration data from the compass sensor and the acceleration sensor. In a second step, the camera management client (CMC) 812, 814 receives the alignment data, the compass data and the acceleration data from the GPS receiver module 806, the compass data receiver module 804 and the acceleration data receiver module 802, and then transmits these data to the camera management server (CMS) 816.

[0035] In a third step, the camera management server (CMS) 816 sends multiple compass and acceleration data from each camera management client (CMC) 812, 814 to the FOV estimation module 808 so that the FOV estimation module 808 can estimate the FOV for each camera by estimating the camera orientation using the compass data, the depression angle using the acceleration data, and the distance using the depression angle together with the typical height of the camera installation, and return the results to the CMS 816.

[0036] In a fourth step, the camera management server (CMS) 816 sends the ID, geolocation adjustment, estimated direction data, and estimated distance data of each camera to the camera location database 818. In a fifth step, the camera location database 818 sends the geolocation and FOV information of each camera along with the ID (Identification) number to the situation processing module 820 for calculating the angle, space, and position parameters to identify both the areas covered and the areas not covered by the camera. In a sixth step, the attitude control module 822 adjusts the horizontal rotation angle using a 3-axis gyroscope, the vertical rotation angle using a 3-axis accelerometer, and controls the height of the temporary camera using pressure and altitude sensor data to control the temporary camera to face the area of ​​interest. In a seventh step, the attitude control module 822 sends the geolocation and FOV information of each camera along with the ID number to the application 810 for indicating the camera's position and FOV and playing real-time video.

[0037] 9 shows a block diagram of Example 3 according to this embodiment. In Example 3, the system 900 uses accurate height information from a height data receiver module 934 instead of the preset height information used in Examples 1 and 2. The accurate height information is useful for improving the accuracy of FOV estimation.

[0038] In a first step, the position sensor receiver 906 receives the position data from the GPS sensor module, and the acceleration data receiver module 902, the compass data receiver module 904, and the height data receiver module 934 receive the compass data, the acceleration data, and the height information from the compass sensor, the acceleration sensor, and the height sensor. In a second step, the camera management clients (CMCs) 912, 914 receive the alignment data, the compass data, the acceleration data, and the height data from the GPS receiver module 906, the compass data receiver module 904, the acceleration data receiver module 902, and the height data receiver module 934, respectively, and then transmit these data to the camera management server (CMS) 916. In a third step, the camera management server (CMS) 916 sends multiple compass, acceleration and height data from each of the camera management clients (CMC) 912, 914 to the FOV estimation module 908 so that the FOV estimation module 908 can estimate the FOV of the cameras 924, 926, 928, 930 and 932 by estimating the camera orientation using the compass data, the depression angle using the acceleration data, and the distance using the depression angle together with the precise detected height of the camera installation, and return the results to the CMS 916.

[0039] In a fourth step, the camera management server (CMS) 916 stores each camera's ID, geolocation adjustment, and estimated directional distance and height data in a camera location database 918. In a fifth step, the camera location database 918 sends each camera's geolocation, FOV and height along with the ID number to a situation processing module 920 for calculating angular, spatial and position parameters to identify both covered and uncovered areas by the camera.

[0040] In a sixth step, the attitude control module 922 adjusts the horizontal rotation angle using the 3-axis gyroscope, the vertical rotation angle using the 3-axis accelerometer, and controls the height of the temporary camera using the pressure and altitude sensor data to control the temporary camera to face the area of ​​interest. In a seventh step, the attitude control module 922 sends the geolocation information and FOV information of each camera along with the ID number to the application 910 to indicate the position and FOV of the cameras 924, 926, 928, 930 and 932 and play the real-time video of the cameras.

[0041] Examples 4 and 5 are based on Examples 1, 2 and 3. The difference lies in the application 710, 810, 910. In Example 4, the application 710, 810, 910 can be present in a command and control center and displays the location of one specific or multiple temporary cameras along with the real-time footage of the cameras, their IDs and monitored areas. The application can raise an alarm if it detects an abnormal incident.

[0042] In example 5, the application 710, 810, 910 may be a mobile application, including for a moving vehicle or for a smart phone, that can display the location of one particular or multiple temporary cameras along with the camera's real-time footage, ID and monitoring area, and can generate an alert if an abnormal incident is captured.

[0043] 10 shows an example flowchart 1000 of the method according to the present embodiment. As shown in step 1002, sensor data is acquired from one or more sensors of one or more temporary cameras and one or more fixed camera sensors co-located with the fixed cameras. Then, as shown in step 1004, the one or more temporary cameras are each adjusted in position based on the acquired sensor data to extend the coverage area of ​​the fixed cameras using the one or more temporary cameras.

[0044] FIG. 11 shows an exemplary flow chart 1100 of the method according to the present embodiment. Sensor data is acquired from one or more sensors of one or more temporary cameras and one or more fixed camera sensors co-located with the fixed cameras (step 1102). Then, the field of view (FOV) of each of the fixed cameras and the one or more temporary cameras is estimated based on the alignment data, horizontal data, vertical data and height information by a FOV estimator of the control means (step 1104). Then, one or more areas within the area of ​​interest that are not covered by the estimated FOV of each of the fixed cameras and the one or more temporary cameras are determined by the situation processor of the control means (step 1106). Then, the horizontal and / or vertical rotation angles and / or heights of the one or more temporary cameras are adjusted by one or more actuators of each of the temporary cameras using gyroscopes and / or accelerometers and / or altitude sensors to cover some or all of one or more areas within the area of ​​interest that are determined by the situation processing device to be not covered by the estimated FOV of each of the one or more temporary cameras (step 1108).

[0045] In accordance with this embodiment, one or more temporary cameras are repositioned according to alignment data, horizontal data, vertical data, and height information obtained from one or more sensors of the one or more temporary cameras and one or more fixed camera sensors co-located with the fixed cameras.

[0046] In one example, a command and control center can send commands to security personnel on-site to reposition temporary cameras by moving them to additional locations or raising or lowering them to better capture areas of interest.

[0047] The temporary cameras may be placed on tripods, mounted in high / low positions, or temporarily attached. The temporary cameras may be flexibly relocated with or without human intervention. If the area of ​​interest expands or moves due to additional incidents, some of the temporary cameras may be relocated and / or new temporary cameras may be deployed to capture the expanded or moved area of ​​interest. An ad-hoc network may also be established for the relocated or newly deployed temporary cameras, and data from the temporary cameras may be transmitted to a command and control center via the ad-hoc network.

[0048] According to this embodiment, in order to make the current surveillance system flexible and robust and enhance the coverage area of ​​the limited fixed cameras, the temporary cameras play a supporting role compared to the fixed cameras, especially in blind spots or places where crimes are expected, and are very effective and efficient to deploy in areas without network infrastructure, reducing the time and effort of manual configuration.

[0049] According to this embodiment, a camera management client (CMC) module integrated in the temporary camera communicates with a camera management server (CMS) installed in a command and control center so that automatic temporary camera recognition and registration, situation processing and attitude adjustment can be performed. This allows not only one temporary camera to support a fixed camera, but also allows multiple temporary cameras to communicate with the network and self-register in a self-managed manner, and can include situation processing to calculate areas of interest and remote control functions to adjust attitude.

[0050] The described exemplary embodiment method and system can be implemented on a computer system 1200, as shown generally in Figure 12. It can be implemented as software, such as a computer program, that runs within the computer system 1200 and instructs the computer system 1200 to perform the exemplary embodiment method.

[0051] In some parts of the description which follows, the description is explicitly or implicitly in terms of algorithms and functional or symbolic representations of data operations within a computer memory. These algorithmic descriptions and functional or symbolic representations are the means used by those skilled in the data processing arts to effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of steps leading to a desired result. The steps are those requiring physical manipulations of physical quantities, such as electrical, magnetic or optical signals, capable of being stored, transferred, combined, compared and otherwise manipulated.

[0052] Unless otherwise noted, and as will become apparent hereinafter, discussions throughout this specification of the terms "scanning," "calculating," "determining," "replacing," "generating," "initializing," "outputting," or similar terms will be understood to refer to operations and processes of a computer system or similar electronic device that manipulates and transforms data, represented as physical quantities within a computer system, into other data, similarly represented as physical quantities within a computer system or other information storage, transmission, or display device.

[0053] This specification also discloses apparatus for performing the method operations. Such apparatus may be specially constructed for the required purposes, or may comprise a general-purpose computer or other device selectively activated or reconfigured by a computer program stored in the computer. The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose machines may be used with programs in accordance with the teachings herein. Alternatively, it may become appropriate to construct more specialized apparatus to perform the required method steps. The structure of a conventional general-purpose computer will appear in the description below.

[0054] In addition, this specification also implicitly discloses a computer program, in which it will be apparent to one skilled in the art that the individual steps of the methods described herein can be implemented by computer code. The computer program is not intended to be limited to any particular programming language and its implementation. It will be understood that various programming languages ​​and codings thereof can be used to implement the teachings of the disclosure contained herein. Furthermore, the computer program is not intended to be limited to any particular control flow. There may be many other variations of the computer program that can use different control flows without departing from the spirit and scope of the present invention.

[0055] Furthermore, one or more steps of the computer program may be executed in parallel rather than sequentially. Such a computer program may be stored on any computer-readable medium. Computer-readable media may include storage devices such as magnetic or optical disks, memory chips, or other storage devices suitable for interfacing with a general-purpose computer. Computer-readable media may also include wired media as exemplified by the Internet system, or wireless media as exemplified by the GSM mobile phone system. When the computer program is loaded and effectively executed on such a general-purpose computer, it becomes an apparatus for performing the steps of a suitable method.

[0056] The computer system 1200 includes a computer module 1202 , input modules such as a keyboard 1204 and a mouse 1206 , and a number of output devices such as a display 1208 and a printer 1210 .

[0057] The computer module 1202 is connected via a suitable transceiver 1214 to a computer network 1212, enabling access to, for example, the Internet or other network systems such as a Local Area Network (LAN) or a Wide Area Network (WAN).

[0058] The computer module 1202 in the example includes a processing unit 1218, a random access memory (RAM) 1220 and a read only memory (ROM) 1222. The computer module 1202 also includes a number of input / output (I / O) interfaces, such as an I / O interface 1224 to the display 1208 and an I / O interface 1226 to the keyboard 1204.

[0059] The components of the computer module 1202 typically communicate via an interconnected bus 1228 in a manner known to those skilled in the relevant art.

[0060] The application program is typically provided to a user of the computer system 1200 encoded on a data storage medium such as a CD-ROM or a flash memory carrier and is read using a drive corresponding to the data storage medium in the data storage device 1230. The application program is read and controlled during execution by the processing unit 1218. Intermediate storage of program data can be achieved using the RAM 1220.

[0061] While exemplary embodiments have been shown in the foregoing detailed description of the invention, it should be understood that numerous variations exist. For example, one skilled in the art will recognize from the teachings herein that the present technology may be applied to any portion of other types of chemical sensors.

[0062] The illustrated embodiments are merely examples and are in no way intended to limit the scope, applicability, operation, or configuration of the present invention. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the exemplary embodiments of the present invention. It will be understood that various changes can be made in the functions, arrangement of elements, and method of operation described in the illustrated embodiments without departing from the scope of the present invention as set forth in the appended claims. This application claims the benefit of priority to Singapore Patent Application No. 10201505251X, filed on July 2, 2015, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0063] 100 Incidents captured by conventional fixed cameras 102 Fixed Camera 104 Incidents caught on fixed cameras 106 Fixed Camera Field of View 108 Location of the incident 110 The whole incident Coverage area of ​​200 fixed cameras and 4 temporary cameras 202 Fixed Camera 206 Fixed Camera Field of View 208 Temporary Camera 1 210 Temporary Camera 1's Field of View 212 Temporary Camera 2 214 Temporary Camera 2's Field of View 216 Temporary Camera 3 218 Temporary Camera 3's Field of View 220 Temporary Camera 4 222 Temporary Camera 4's Field of View 300 fixed camera and 4 temporary cameras connected 302 Fixed Camera 308 Temporary Camera 1 312 Temporary Camera 2 316 Temporary Camera 3 320 Temporary Camera 4 324 Ad-hoc Network for Data Relay Link to 326 Command and Control Center 400 System Architecture 402 Temporary Camera 404 Network 406 Control Means 408 Camera 410 GPS receiver 412 Gyroscope 414 Acceleration Sensor 416 Camera Management Client 418 Camera Management Server 420 FOV Estimator 422 Camera Position Database 424 Situation Processing Device 426 Posture adjustment device 428 Applications 430 Horizontal and Vertical Data 432 Adjustment Data 434 Horizontal 436 distance 438 Camera 440 GPS receiver 442 Gyroscope 444 Acceleration Sensor 446 Camera Management Client 448 Fixed Camera 500 Systems 502 Position Sensor Receiver 504 Attitude Sensor Receiver 506 FOV estimator 508 Application 600 System 602 Position Sensor Receiver 604 Attitude Sensor Receiver 606 FOV estimator 608 Applications 610 Camera Management Client 612 Camera Management Server 614 Camera Position Database 616 Situation Processing Module 618 Attitude Control Device 700 Example block diagram of an embodiment 702 Acceleration Data Receiver 704 Compass Data Receiver 706 GPS Data Receiver 708 FOV estimator 710 Applications 712 directions 714 distance 716 Geolocation information 718 Top view 720 Side View 722 Map 724 longitude, latitude 800 Example Block Diagram of an Embodiment 802 Acceleration Data Receiver 804 Directional Data Receiver 806 GPS Data Receiver 808 FOV Estimator 810 Application 812 Camera Management Client #1 814 Camera Management Client #N 816 Camera Management Server 818 Camera Location Database 820 Situation Handling 822 Attitude Control 824 Fixed Camera 826 Temporary Camera 1 828 Temporary Camera 2 830 Temporary Camera 3 832 Temporary Camera 4 900 System 902 Acceleration Data Receiver 904 Directional Data Receiver 906 GPS Data Receiver 908 FOV estimator 910 Application 912 Camera Management Client #1 914 Camera Management Client #N 916 Camera Management Server 918 Camera Location Database 920 Situation Handling 922 Attitude Control 924 Fixed Camera 926 Temporary Camera 1 928 Temporary Camera 2 930 Temporary Camera 3 932 Temporary Camera 4 934 Height Data Receiver Module Flowchart according to the embodiment 1002 Acquire sensor data from a sensor co-located with the camera 1004 Adjust the temporary camera based on the acquired sensor data 1100 Flowchart according to the embodiment 1102 Acquire sensor data 1104 Estimate the FOV of each camera 1106 Determine areas not covered by the estimated FOV of the camera 1108 Adjust the temporary camera 1200 Computer Systems 1202 Computer Module 1204 Keyboard 1206 Mouse 1208 Display 1210 Printer 1212 Computer Networks 1214 Suitable transmitting and receiving equipment 1218 Processing equipment 1220 Random Access Memory (RAM) 1222 Read-Only Memory (ROM) I / O interface to 1224 display 1226 I / O interface to keyboard 1228 Interconnect Bus 1230 Data storage device

Claims

1. A process for acquiring information regarding a direction of a first camera from a first camera which is a fixed camera; A process of determining a direction in which the first camera takes an image based on information regarding the direction of the first camera; A process of acquiring position information of a second camera capable of moving a photographing position and information regarding a direction of the second camera from the second camera; Displaying the map on a display device; a computer program causing one or more computers to perform a process of displaying on the map an icon representing a position of the first camera, an icon representing a direction in which the first camera takes pictures based on a direction in which the first camera takes pictures, an icon representing a position of the second camera based on position information of the second camera, and an icon representing the direction in which the second camera takes pictures calculated from information relating to the direction of the second camera, a computer program that causes the icon representing the position of the second camera to be displayed on the display device so as to be smaller than the icon representing the position of the first camera;

2. The computer program product according to claim 1 , further comprising: causing one or more computers to perform a process of displaying, on the display device, an image captured by the second camera together with the map.

3. The computer program product of claim 1 , further comprising: causing one or more computers to perform a process of displaying, together with the map, information for identifying the second camera on the display device.

4. acquiring position information of the first camera from the first camera; displaying an icon representing the first camera on the display device based on position information of the first camera; 2. The computer program of claim 1, further comprising:

5. The computer program product according to claim 1 , wherein the icon representing the direction in which the first camera captures images represents a range captured by the first camera.

6. The computer program product according to claim 5 , wherein the range photographed by the first camera is determined using information relating to a distance from the first camera.

7. A functional unit that acquires information regarding a direction of a first camera from a first camera that is a fixed camera; a functional unit that determines a direction in which the first camera captures an image based on information about the direction of the first camera; a functional unit that acquires, from a second camera, position information of the second camera capable of moving a photographing position and information regarding a direction of the second camera; A functional unit for displaying a map on a display device; a functional unit that displays on the map an icon representing a position of the first camera, an icon representing a direction in which the first camera takes pictures based on a direction in which the first camera takes pictures, an icon representing a position of the second camera based on position information of the second camera, and an icon representing a direction in which the second camera takes pictures calculated from information relating to the direction of the second camera, a display control device that causes the icon representing the position of the second camera to be displayed on the display device to be smaller than the icon representing the position of the first camera;

8. The display control device according to claim 7 , further comprising: a display device that displays, together with the map, an image captured by the second camera.

9. The display control device according to claim 7 , further comprising: displaying, on said display device, information for identifying said second camera together with said map.

10. acquiring position information of the first camera from the first camera; The display control device according to claim 7 , wherein an icon representing the first camera is displayed on the display device based on position information of the first camera.

11. The display control device according to claim 7 , wherein the icon representing the direction in which the first camera captures images represents a range captured by the first camera.

12. The display control device according to claim 11 , wherein the range photographed by the first camera is determined using information relating to a distance from the first camera.

13. by one or more computers, obtaining information about a direction of a first camera from a first camera that is a fixed camera; determining a direction in which the first camera takes an image based on information about the direction of the first camera; acquiring, from a second camera, position information of the second camera capable of moving a photographing position and information regarding a direction of the second camera; Displaying the map on a display device; displaying on the map an icon representing the position of the first camera, an icon representing the direction in which the first camera takes pictures based on the direction in which the first camera takes pictures, an icon representing the position of the second camera based on position information of the second camera, and an icon representing the direction in which the second camera takes pictures calculated from information relating to the direction of the second camera; Also, the display control method causes the icon representing the position of the second camera to be displayed on the display device to be smaller than the icon representing the position of the first camera.

14. The display control method according to claim 13 , further comprising causing the display device to display an image captured by the second camera together with the map.

15. The display control method according to claim 13 , further comprising causing the display device to display information for identifying the second camera together with the map.

16. acquiring position information of the first camera from the first camera; The display control method according to claim 13 , further comprising causing the display device to display an icon representing the first camera based on position information of the first camera.

17. The display control method according to claim 13 , wherein the icon representing the direction in which the first camera captures images represents a range captured by the first camera.

18. The display control method according to claim 13 , wherein the range photographed by the first camera is determined using information relating to a distance from the first camera.

Citation Information

Patent Citations

  • Image distribution device and image information distribution system

    JP2003329462A

  • Camera information display unit and camera information display method

    JP2010011307A

  • Monitoring image display device

    JP2010268186A

  • Video monitoring system, and monitoring video display device

    JP2011176452A

  • Imaging device and image processing device

    JP2015091055A