Surveillance camera management system and surveillance camera management method
The surveillance camera management system uses a robot with a two-dimensional code to detect abnormalities by ensuring the camera captures the code within a specified time, reducing data transmission and costs while effectively identifying misalignment and lens dirt.
Patent Information
- Application Number
- JP2023107249
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-06-29
- Publication Date
- 2025-12-05
- Estimated Expiration
- 2043-06-29
AI Technical Summary
Existing surveillance camera systems require extensive data communication for abnormality detection, leading to high communication costs, especially when managing multiple remote facilities.
A surveillance camera management system utilizing a robot equipped with a two-dimensional code and wireless communication, where a control device detects abnormalities based on the presence of the robot within the camera's field of view and the ability to read the code within a specified time frame, minimizing data transmission by analyzing the presence of moving objects and the code.
This approach allows for efficient detection of camera abnormalities such as misalignment and lens dirt while significantly reducing data communication requirements, thereby lowering costs and maintaining effective surveillance.
Smart Images

Figure 0007781108000001 
Figure 0007781108000002 
Figure 0007781108000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a surveillance camera management system and a surveillance camera management method. [Background technology]
[0002] In surveillance cameras that monitor facilities, abnormalities can occur due to issues with the installation of the surveillance camera (misaligned viewing angle) or due to dirt on the surveillance camera lens. Whether or not such abnormalities have occurred is often checked visually by the facility manager. Alternatively, devices have been developed that automatically detect abnormalities in surveillance cameras by analyzing images captured by the surveillance cameras.
[0003] For example, Japanese Patent Application Laid-Open Publication No. 2018-26724 (Patent Document 1) discloses an image processing device in which a user holding a marker walks around a monitored area, a monitoring camera captures images of the marker at each position, and the position and attitude of the camera are adjusted using the position coordinates of the captured marker. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Publication No. 2018-26724 Summary of the Invention [Problem to be solved by the invention]
[0005] When using a device such as the image processing device in Patent Document 1 to detect abnormalities such as deviation in the angle of view or lens dirt of a surveillance camera, the image is analyzed based on multiple image (video) information obtained from the surveillance camera, which results in a large amount of data being obtained from the surveillance camera.
[0006] For example, in a case where multiple facilities in remote locations are managed by a cloud server, multiple images captured by surveillance cameras installed in the facilities must be acquired by a server device in the remote location via a communication line, and the server device must analyze the acquired images to detect abnormalities. In this case, the communication charges for acquiring the images are expensive.
[0007] The present disclosure has been made to solve the above-mentioned problems, and its purpose is to provide a surveillance camera management system and a surveillance camera management method that can detect abnormalities in surveillance cameras while minimizing the amount of data communication required for abnormality detection. [Means for solving the problem]
[0008] A surveillance camera management system according to the present disclosure includes a communication device, a surveillance camera, and a control device. The communication device is installed within a facility where a robot travels autonomously, and acquires identification information identifying the robot from the robot via wireless communication when the robot travels within a predetermined range within which communication with the robot is possible. The surveillance camera has the function of capturing images within the facility and detecting moving objects. The control device detects an abnormality in the surveillance camera based on information acquired from the communication device and information acquired from the surveillance camera. The predetermined range includes the range that the surveillance camera captures when the installation status of the surveillance camera is normal. The control device determines that the installation status is abnormal if the surveillance camera does not detect a moving object within a first time period after the identification information is acquired by the communication device.
[0009] A surveillance camera management method according to the present disclosure includes the steps of: when a robot is installed in a facility where the robot travels autonomously and travels within a predetermined range within which communication with the robot is possible, a communication device wirelessly acquires identification information identifying the robot from the robot; acquiring information from a surveillance camera that captures images of the facility and has the function of detecting moving objects; and detecting an abnormality in the surveillance camera based on the information acquired from the communication device and the information acquired from the surveillance camera. The predetermined range includes the range that the surveillance camera captures when the installation status of the surveillance camera is normal. In the surveillance camera management method, the detecting step further includes a step of determining that the installation status of the surveillance camera is abnormal if no moving object is detected by the surveillance camera within a first time period after the identification information is acquired by the communication device. [Effects of the Invention]
[0010] According to the present disclosure, it is possible to detect abnormalities in a surveillance camera while minimizing the amount of data communication required for abnormality detection. [Brief explanation of the drawings]
[0011] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a surveillance camera management system. [Figure 2] FIG. 1 is a diagram illustrating a hardware configuration of a surveillance camera management system. [Figure 3] FIG. 2 is a diagram illustrating a communication range and a camera imaging range. [Figure 4] 10 is an example of a camera image when the surveillance camera lens is clean. [Figure 5] 10 is an example of a camera image when the lens of a surveillance camera is dirty. [Figure 6] FIG. 10 is a diagram illustrating a situation in which the installation state of the surveillance camera is abnormal. [Figure 7] 10 is an example of a camera image when the installation state of a surveillance camera is abnormal. [Figure 8] 10 is an example of detection result data. [Figure 9]10 is a flowchart of a server-side process and a robot-side process. [Figure 10] 10 is a display example of determination result data. DETAILED DESCRIPTION OF THE INVENTION
[0012] Hereinafter, embodiments will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. The names and functions of these components are also the same. Therefore, detailed descriptions thereof will not be repeated.
[0013] Fig. 1 is a diagram showing the configuration of a surveillance camera management system 100. Fig. 2 is a diagram showing the hardware configuration of the surveillance camera management system 100.
[0014] As shown in FIG. 1, the surveillance camera management system 100 includes a server device 10 as a control device, a terminal 30, a gateway 29, a plurality of wireless communication devices 72 as communication devices, a plurality of surveillance cameras 70, and a robot 40.
[0015] Among these, the gateway 29, the wireless communication device 72, the surveillance camera 70, and the robot 40 are installed in a facility 1. The facility 1 is, for example, an office building, a commercial facility, a public facility, or the like.
[0016] Server device 10 is a server that manages surveillance cameras 70 and is installed in a monitoring center 2 separate from facility 1. Server device 10 can acquire information obtained from surveillance cameras 70, wireless communication devices 72, etc. via communication lines. Server device 10 is configured to be able to manage surveillance cameras 70 installed in multiple facilities. Terminal 30 may be installed in facility 1, in monitoring center 2, or in another facility.
[0017] The robot 40 is an autonomous mobile robot that moves autonomously within the facility 1. The robot 40 is a patrol robot that patrols and monitors the facility 1. However, the robot 40 is not limited to this, and may be a transport robot that transports luggage within the facility 1, a cleaning robot that cleans the facility, or any other robot that moves autonomously within the facility 1.
[0018] The device management device 20 is connected to a plurality of wireless communication devices 72 and a plurality of monitoring cameras 70. The device management device 20 controls the wireless communication devices 72 and the monitoring cameras 70, and is also capable of controlling the robot 40 via the wireless communication devices 72.
[0019] The device management device 20 can be connected to the communication network NW via a gateway 29. The server device 10, the terminal 30, and the device management device 20 can be connected to each other for communication via the communication network NW.
[0020] A plurality of wireless communication devices 72 are installed on the ceilings 61 of each room, corridor, etc. in the facility 1. These wireless communication devices 72 communicate with the wireless communication device 42 provided in the robot 40, and can identify the current location of the robot 40.
[0021] Surveillance cameras 70 are installed on the walls 62 of each room, hallway, etc. within facility 1, and capture images of the inside of the facility. Although not shown, images captured by surveillance cameras 70 are displayed on a monitor installed in a management room within facility 1. The manager of facility 1 can monitor the inside of facility 1 using the images displayed on this monitor.
[0022] The robot 40 travels on the floor 63 and patrols the facility 1. When the robot 40 enters the communication range of the wireless communication device 72, the position of the robot 40 is identified by the wireless communication device 72, and when the robot 40 enters the imaging range of the monitoring camera 70, the image of the robot 40 is captured by the monitoring camera 70. The monitoring camera 70 is also provided with a moving object detection function (described later) that detects moving objects, and detects the robot 40 that enters the imaging range as a moving object.
[0023] 2, the server device 10 includes a processor 11, a read-only memory (ROM) 12, a random access memory (RAM) 13, a hard disk drive (HDD) 14, and a communication interface (IF) 15. The processor 11 is, for example, a central processing unit (CPU). These components exchange various types of data via a communication bus 16.
[0024] The processor 11 loads a program stored in the HDD 14 or the ROM 12 into the RAM 13 and executes it. The program describes the processes to be executed by the server device 10.
[0025] The communication IF 15 is an input / output device for exchanging signals or data with the device management device 20 and the terminal 30. The server device 10 can obtain information about the robot 40 and the surveillance camera 70 from the device management device 20 and information from the terminal 30 via the communication IF 15.
[0026] The HDD 14 is a storage device that stores various types of information, such as detection result data 81, determination result data 82, information about the facility 1, and information about the robot 40, which will be described later.
[0027] The robot 40 includes a control unit 41 , a wireless communication device 42 , a two-dimensional code 43 , a memory unit 44 , a camera 45 , a battery 48 , and a drive unit 47 .
[0028] A two-dimensional code is displayed on the surface of the robot 40 as an identification image for identifying the robot 40. The two-dimensional code 43 is, for example, a QR code (registered trademark) or the like. It is not limited to a two-dimensional code, and may be a barcode or the like. The two-dimensional code 43 may be printed on something (a plate, paper, etc.) attached to a predetermined location on the robot 40, or the robot 40 may be equipped with a display device such as a display and the two-dimensional code may be displayed on the display device, or any other code may be used as long as it presents an image that can be read by a reading device and that identifies the robot 40.
[0029] The control unit 41 controls the entire robot 40. Although not shown in the figure, the control unit 41 has a CPU, a ROM, a RAM, and a communication IF as its main components. The CPU loads a program stored in the ROM into the RAM and executes it. The program stored in the ROM describes the processing to be executed by the robot 40. Note that the processing is not limited to being performed by software, and can also be performed by dedicated hardware (electronic circuits).
[0030] The wireless communication device 42 outputs a signal for detecting the position of the robot 40, for example, using a communication method that complies with the BLE (Bluetooth Low Energy; "Bluetooth" is a registered trademark) communication standard. Instead of the BLE communication standard, a communication method that complies with the UWB (Ultra Wide Band) communication standard may be used. The wireless communication device 42 also transmits a signal indicating an ID for identifying the robot 40 to the device management device 20, for example, using a communication method that complies with a wireless communication standard such as LTE (Long Term Evolution).
[0031] The camera 45 captures an image of the surroundings of the robot 40 and outputs the captured image to the control unit 41. Instead of the camera 45, a laser rangefinder or the like may be provided that measures the distance between the robot 40 and an object present around the robot 40.
[0032] The driving unit 47 generates a driving force for moving the robot 40. The driving unit 47 includes, for example, wheels for moving the robot 40 and a motor for driving the wheels. The driving unit 47 can be operated by receiving a supply of power from a battery 48.
[0033] The control unit 41 controls the driving unit 47 so that the robot 40 moves autonomously based on the captured image from the camera 45. The battery 48 supplies power for operating the driving unit 47 and other devices of the robot 40. The memory unit 44 temporarily stores various information used by the robot 40.
[0034] The multiple wireless communication devices 72 are installed at an appropriate distance from each other on the ceiling 61, and receive signals transmitted from the robot 40 using a communication method conforming to the same communication standard as the wireless communication device 42 of the robot 40, and detect the reception strength of the signals. The position of the robot 40 within the facility can be detected from the reception strength of each wireless communication device 72. The wireless communication devices 72 output the reception strength of the signals received from the robot 40 to the equipment management device 20. The wireless communication devices 72 may be installed on a wall.
[0035] The equipment management device 20 controls equipment such as wireless communication devices 72, surveillance cameras 70, and robots 40 installed in the facility 1. The equipment management device 20 may control these devices directly, or may control them based on commands from the server device 10. The equipment management device 20 identifies the position of the robot 40 based on the reception strength received by each wireless communication device 72.
[0036] The device management device 20 is connected to a communication network NW. A server device 10, a terminal 30, and the device management device 20 connected via a gateway 29 are connected to the communication network NW.
[0037] The server device 10 detects an abnormality in the surveillance camera 70 based on information acquired from the wireless communication device 72 and the surveillance camera 70 via a communication line. The server device 10 may also be configured to be capable of outputting commands to the robot 40 and acquiring information such as the position information of the robot 40.
[0038] The terminal 30 is, for example, a personal computer or a notebook computer. The terminal 30 includes an input unit 34 and a display 35 that displays various information. The display 35 can display abnormality information of the surveillance camera 70 detected by the server device 10. The input unit 34 is, for example, a keyboard and a mouse. Instructions can be given to the terminal 30 by operating the input unit 34.
[0039] The terminal 30 is configured to include a CPU, RAM, ROM, and a communication IF, similar to the server device 10. The management and control of the robot 40 may be performed by the server device 10, the equipment management device 20, or another server.
[0040] A specific description will be given below. Fig. 3 is a diagram for explaining the communication range 102 and the camera image capture range 101. The communication range 102 indicates the range in which the wireless communication device 72 can communicate. The camera image capture range 101 indicates the range in which the surveillance camera 70 captures an image.
[0041] 3, wireless communication device 72 is installed at the center of the circle indicating communication range 102, and surveillance camera 70 is installed at the center of the circle indicating camera imaging range 101. Note that these ranges are illustrated as circles for convenience, but are not necessarily circular.
[0042] In this embodiment, surveillance cameras 70 are installed at multiple locations in facility 1, and wireless communication devices 72 are always installed near (for example, within a distance of 1 meter or less) the installed surveillance cameras 70. Furthermore, communication range 102 (for example, within a circle with a diameter of 20 meters) is wider than camera image capture range 101 (for example, within a circle with a diameter of 10 meters). When surveillance cameras 70 are installed properly, each device is installed so that communication range 102 includes camera image capture range 101 captured by surveillance cameras 70.
[0043] When the robot 40 patrols the facility 1, it passes in front of each of the surveillance cameras 70 installed in the facility 1. In this case, the robot 40 first enters the communication range 102, and then travels so as to enter the camera imaging range 101.
[0044] When the robot 40 is traveling within the communication range 102, the wireless communication device 72 acquires robot information including a robot ID as identification information for identifying the robot 40 from the robot 40 via wireless communication. The device management device 20 receives the robot ID and the like from the wireless communication device 72, and thereby detects the robot. In addition to the robot ID, the robot information also includes information such as the serial number of the robot 40 and the model of the robot 40.
[0045] When the robot 40 moves further and enters the camera's imaging range 101, the surveillance camera 70 captures an image of the robot 40. This detects a moving object and the two-dimensional code attached to the robot 40. Based on this information, it is determined whether or not there is an abnormality in the surveillance camera. This will be explained in detail below.
[0046] 4 is an example of a camera image 91 when the lens of the surveillance camera 70 is clean. When the robot 40 enters the camera imaging range 101, the surveillance camera 70 captures an image of the robot 40, as shown in the camera image 91 in FIG.
[0047] The surveillance camera 70 is equipped with a moving object detection function that detects moving objects. A rectangular moving object detection area 110 is displayed around the robot 40 in the camera image 91, thereby indicating that a moving object has been detected. Since there are no other moving objects other than the robot 40 within the area captured by the surveillance camera 70, the robot 40 is extracted as a moving object by comparing the differences between multiple images captured periodically. When the surveillance camera 70 detects a moving object, it notifies the device management device 20 that a moving object has been detected.
[0048] A two-dimensional code 43 is attached to the robot 40. If the two-dimensional code is included in the image, the surveillance camera 70 extracts the two-dimensional code image. The extracted two-dimensional code image is transmitted to the device management device 20. Note that the surveillance camera 70 may directly detect the information included in the two-dimensional code (robot ID) instead of the two-dimensional code image.
[0049] Fig. 5 is an example of a camera image 92 when the lens of the surveillance camera 70 is dirty. In this example, the lens of the surveillance camera 70 is dirty, and as shown in the camera image 92 in Fig. 5, dirt 120 is captured in the center of the image.
[0050] 4, when the robot 40 enters the camera imaging range 101, the robot 40 is imaged by the surveillance camera 70. Based on the image difference information, the robot 40 is detected as a moving object (moving object detection range 111), but the image of the robot 40 is blurred due to dirt 120.
[0051] Because the two-dimensional code portion of the image is unclear, the surveillance camera 70 is unable to extract the two-dimensional code image from the image, and therefore is unable to transmit the two-dimensional code image to the device management device 20.
[0052] Fig. 6 is a diagram illustrating a situation in which the installation state of the surveillance camera 70 is abnormal. Fig. 7 is an example of a camera image 93 when the installation state of the surveillance camera 70 is abnormal. As shown in Fig. 6, the surveillance camera 70 is tilted upward (the installation state is abnormal), so it is unable to capture the range that it should capture. Although the robot 40 is in the same position as in Fig. 1, as shown in Fig. 7, the robot 40 is not captured in the camera image 91.
[0053] If the installation condition of the surveillance camera 70 is abnormal, the robot 40 will first be detected by the wireless communication device 72 when it enters the communication range 102, but then the robot 40 will not enter the camera imaging range 101, so no moving object will be detected.
[0054] As described above, the device management device 20 acquires robot information including the robot ID from the wireless communication device 72, and acquires moving object detection information (whether or not a moving object has been detected) and two-dimensional code information (two-dimensional code image) from the surveillance camera 70. Furthermore, the device management device 20 transmits the robot information, moving object detection information, and two-dimensional code information to the server device 10.
[0055] The server device 10 records this information as detection result data 81. FIG.
[0056] The detection result data 81 records data on one of the following events as an "occurring event": "robot detection," "moving object detection," or "two-dimensional code detection." Each piece of data records the "time" when the event occurred, the "detecting device" when the event was detected, and the "acquired information" acquired at that time.
[0057] For example, at 13:00:00 on May 18, 2023, the robot 40 is detected by the communication device X1, and the robot ID: 0001 and other information are acquired as the robot information.
[0058] Five seconds later, at 13:00:05 on May 18, 2023, a moving object is detected by camera Y1, and five seconds later, at 13:00:10 on May 18, 2023, a two-dimensional code (robot ID: 0001) is detected by camera Y1.
[0059] The above shows a case where, as shown in Figures 3 and 4, robot 40 is detected when robot 40 enters communication range 102, and then, when robot 40 enters camera imaging range 101, robot 40 is detected as a moving object and a two-dimensional code is detected.
[0060] Furthermore, at 15:10:20 on May 19, 2023, robot 40 is detected by communication device X1, and robot ID: 0001 and other information are acquired as robot information. Five seconds later, at 15:10:25 on May 19, 2023, a moving object is detected by camera Y1. However, no two-dimensional code is detected by camera Y1 thereafter.
[0061] The above shows a case where, as shown in Figure 4, robot 40 is detected when it enters communication range 102, and then robot 40 is detected as a moving object when it enters camera imaging range 101, but the two-dimensional code is not detected due to dirt on the lens.
[0062] Furthermore, at 14:05:30 on May 25, 2023, communication device X1 detected robot 40, and acquired robot ID: 0001 and other information as robot information. However, after that, camera Y1 did not detect any moving object or two-dimensional code.
[0063] This shows a case where, as shown in Figures 6 and 7, the robot 40 was detected when it entered the communication range 102, but the robot 40 was not subsequently captured on the surveillance camera 70 due to an abnormality in the installation condition of the surveillance camera 70.
[0064] The following explanation will be given using flowcharts. Figure 9 is a flowchart of server-side processing and robot-side processing. Server-side processing is processing executed by the server device 10. Robot-side processing is processing executed by the robot 40. Server-side processing is executed when the server device 10 is started up, and robot-side processing is executed when the robot 40 is started up. Hereinafter, "step" will also be simply referred to as "S".
[0065] When the robot-side processing starts, the robot 40 determines in S201 whether or not communication has been established with the wireless communication device 72. As shown in Fig. 3, when the robot 40 enters the communication range 102, communication with the wireless communication device 72 is established. If communication with the wireless communication device 72 is not established (NO in S201), the robot 40 waits until communication is established.
[0066] When communication is established, in S202, the robot 40 transmits robot information including a robot ID to the wireless communication device 72. Upon receiving the robot information, the wireless communication device 72 further transmits the robot information to the device management device 20. The device management device 20 further transmits the robot information to the server device 10.
[0067] In S203, the robot 40 acquires the monitoring camera information from the equipment management device 20 via the wireless communication device 72. The monitoring camera information is information indicating the position of the monitoring camera .
[0068] When the robot 40 travels within the imaging range (camera imaging range 101) of the monitoring camera 70, it changes its direction so that the identification image (two-dimensional code) is captured, and the process returns to S201.
[0069] Specifically, after establishing communication with the wireless communication device 72, the robot 40 moves so as to enter the camera image capture range 101 of the surveillance camera 70. At that time, the robot changes its direction so that the two-dimensional code attached to the robot 40 is captured by the surveillance camera 70. For example, after entering the camera image capture range 101 of the surveillance camera 70, the robot may pause and face the surveillance camera 70.
[0070] In this embodiment, when the robot 40 is patrolling the facility 1, after entering the communication range 102 of the wireless communication device 72, it moves in principle so as to enter the imaging range 101 of the surveillance camera 70. However, if the patrol route is such that after entering the communication range 102 of the wireless communication device 72, it does not enter the camera imaging range 101 of the surveillance camera 70, the route may be corrected so as to enter the imaging range 101 of the surveillance camera 70, or if the route is not corrected, the abnormality determination process may not be performed.
[0071] When the robot 40 enters the imaging range 101 of the monitoring camera 70, the monitoring camera 70 transmits moving object detection information and two-dimensional code information to the device management device 20. The device management device 20 further transmits this information to the server device 10.
[0072] Next, the server-side processing will be described. When the server-side processing starts, the server device 10 waits until it acquires robot information (robot ID, etc.) from the device management device 20 (S101).
[0073] When the server device 10 acquires the robot information, in S102, it determines whether or not a moving object has been detected within a first time period (30 seconds in this embodiment) since the robot was detected.
[0074] If the server device 10 detects a moving object within a first time period (30 seconds) after detecting the robot (YES in S102), it determines that there is no deviation in the angle of view (the installation state of the surveillance camera 70 is normal) (S103). In this way, the server device 10 determines that the installation state is normal when a moving object is detected within the first time period after the identification information is acquired by the wireless communication device 72.
[0075] If the server device 10 does not detect a moving object within a first time period (30 seconds) after detecting the robot (NO in S102), it determines that there is a view angle deviation (the installation state of the surveillance camera 70 is abnormal) (S104). In this way, the server device 10 determines that the installation state of the surveillance camera 70 is abnormal if the surveillance camera 70 does not detect a moving object within the first time period after the identification information is acquired by the wireless communication device 72.
[0076] In S105, the server device 10 determines whether or not a two-dimensional code is detected (a two-dimensional code image is extracted) within a second time period (30 seconds in this embodiment) after the moving object is detected. If this condition is met, the process proceeds to S106, and if this condition is not met, the process proceeds to S108.
[0077] In S106, the server device 10 determines whether the robot 40 identified from the identification image (two-dimensional code) detected by the surveillance camera 70 matches the robot 40 identified from the identification information (robot ID) received by the wireless communication device 72. In other words, it determines whether the robot IDs match. If this condition is met, the process proceeds to S107, and if this condition is not met, the process proceeds to S108.
[0078] In S107, the server device 10 determines that there is no dirt (no abnormality) on the lens of the surveillance camera 70. In S108, the server device 10 determines that there is dirt on the lens of the surveillance camera 70 (no abnormality).
[0079] In this way, when the server device 10 determines that the installation condition is normal and an identification image (two-dimensional code) is not extracted from the image captured by the surveillance camera 70 within a second time period after a moving object is detected, it determines that there is dirt on the lens of the surveillance camera 70, which is an abnormality in the surveillance camera 70.
[0080] Furthermore, when the server device 10 determines that the installation state is normal, and an identification image (two-dimensional code) is extracted from the image captured by the surveillance camera 70 within a second time period after a moving object is detected, and the robot 40 identified from the identification image (two-dimensional code) does not match the robot 40 identified from the identification information (robot ID), the server device 10 determines that there is dirt on the lens, which is an abnormality in the surveillance camera 70.
[0081] In S109, the server device 10 updates the detection result data 81 (see FIG. 8) and the determination result data 82 (described later with reference to FIG. 10). In S110, the server device 10 transmits the determination result data 82 to the terminal 30, and returns the process to S101.
[0082] As a result, when an abnormality is detected in the surveillance camera 70, the display 35 of the terminal 30 can display a message indicating that an abnormality has been detected in the surveillance camera 70. Specifically, the display 35 displays the determination result data 82, which indicates that an abnormality has been detected in the surveillance camera 70. Fig. 10 is a display example of the determination result data 82.
[0083] The "time," "detection device," and "occurring event" in the judgment result data 82 are the same as those in the detection result data 81. In the judgment result data 82, the result of the judgment based on the information in the detection result data 81 is recorded as the "judgment result."
[0084] For example, in the data from May 18th, a moving object is detected five seconds (within the first time period) after the detection of robot 40 with robot ID "0001," and therefore it is determined that there is "no deviation in the angle of view." Furthermore, a two-dimensional code is detected five seconds (within the second time period) after the detection of the moving object. The robot ID identified from this two-dimensional code is "0001," which matches the robot ID when robot 40 was detected, and therefore it is determined that there is "no dirt on the lens."
[0085] Furthermore, in the data for May 19, a moving object was detected 5 seconds (within the first time period) after the detection of robot 40 with robot ID "0001," so it was determined that there was "no deviation in the angle of view." Furthermore, no two-dimensional code was detected within the second time period (30 seconds) after the detection of the moving object, so it was determined that there was "dirt on the lens," and this was recorded in the determination result data 82, and the fact that an abnormality in "dirt on the lens" had been detected was displayed on display 35.
[0086] Furthermore, in the data for May 25th, since no moving object was detected within the first time period in which robot 40 with robot ID "0001" was detected, it was determined that "there was a deviation in the angle of view," and this was recorded in the judgment result data 82, and the fact that an abnormality in the "angle of view" had been detected was displayed on display 35.
[0087] In this embodiment, the surveillance camera 70 and the wireless communication device 72 are included in the configuration, but the surveillance camera 70 itself may also have the functionality of the wireless communication device 72. In this case, the surveillance camera 70 is configured to acquire the robot ID of the robot 40 when the surveillance camera device establishes communication with the robot 40. Alternatively, the surveillance camera device may detect a moving object and, when extracting a two-dimensional code image from the image, acquire the robot ID from the two-dimensional code image. In this case, the surveillance camera device may transmit the robot ID acquired through communication, the moving object detection information, and the robot ID acquired from the two-dimensional code image to the equipment management device 20.
[0088] 9 may be performed by the device management device 20. In this case, the device management device 20 may transmit only the determination result shown in FIG.
[0089] As described above, the surveillance camera management system 100 includes a wireless communication device 72 as a communication device, a surveillance camera 70, and a server device 10 as a control device. The wireless communication device 72 is installed in the facility 1 where the robot 40 moves autonomously, and acquires identification information (robot ID) for identifying the robot 40 from the robot 40 via wireless communication when the robot 40 moves within a predetermined range (communication range 102) within which communication with the robot 40 is possible. The surveillance camera 70 has a function of capturing images of the facility 1 and detecting moving objects (moving object detection function). The server device 10 detects an abnormality in the surveillance camera 70 based on information acquired from the wireless communication device 72 and the surveillance camera 70 via a communication line. The predetermined range (communication range 102) includes a range (camera imaging range 101) that the surveillance camera 70 captures when the installation status of the surveillance camera 70 is normal. The server device 10 determines that the installation status is abnormal if the surveillance camera 70 does not detect a moving object within a first time period after the identification information is acquired by the wireless communication device 72.
[0090] In this way, it is possible to detect an abnormality in the installation state of the surveillance camera 70 (deviation in the angle of view) without checking the images captured by the surveillance camera 70. Furthermore, since it is not necessary to transmit the images captured by the surveillance camera 70 to the server device 10, it is possible to reduce the amount of data transmitted to the server device 10, thereby saving on communication charges. This makes it possible to detect an abnormality in the surveillance camera 70 (deviation in the angle of view) while minimizing the amount of data communication required for abnormality detection.
[0091] An identification image (two-dimensional code) that identifies the robot 40 is displayed on the surface of the robot 40. If a moving object is detected within a first time period after the identification information is acquired by the wireless communication device 72, the server device 10 determines that the installation state is normal. If the installation state is determined to be normal and an identification image (two-dimensional code) is not extracted from the image captured by the surveillance camera 70 within a second time period after the moving object is detected, the server device 10 determines that an abnormality in the surveillance camera 70 exists, that the lens of the surveillance camera 70 is dirty.
[0092] When the server device 10 determines that the installation state is normal, and an identification image (two-dimensional code) is extracted from the image captured by the surveillance camera 70 within a second time period after a moving object is detected, and the robot 40 identified from the identification image (two-dimensional code) does not match the robot 40 identified from the identification information (robot ID), the server device 10 determines that there is dirt on the lens, which is an abnormality in the surveillance camera 70.
[0093] In this way, it is possible to detect dirt on the lens of the surveillance camera 70 without checking the images captured by the surveillance camera 70. Furthermore, since it is not necessary to transmit the images captured by the surveillance camera 70 to the server device 10, it is possible to reduce the amount of data transmitted to the server device 10, thereby reducing communication charges. This makes it possible to detect abnormalities in the surveillance camera 70 (misalignment of the angle of view, lens dirt) while minimizing the amount of data communication required for abnormality detection.
[0094] The surveillance camera management system 100 further includes a robot 40. When the robot 40 travels within the imaging range (camera imaging range 101) of the surveillance camera 70, it changes direction so that an identification image (two-dimensional code) is captured. This allows the surveillance camera management system 100 to reliably recognize the identification image.
[0095] The surveillance camera management system 100 further includes a display 35 as a display device for displaying information. When an abnormality in the surveillance camera 70 is detected, the display 35 displays a message to that effect. This allows the user to immediately grasp the abnormality in the surveillance camera 70 without having to check the images captured by the surveillance camera 70.
[0096] [Note] The above-described embodiment is a specific example of the following additional notes.
[0097] (Appendix 1) a communication device that is installed in a facility where the robot travels autonomously and that acquires, via wireless communication, identification information that identifies the robot from the robot when the robot travels within a predetermined range where communication with the robot is possible; a surveillance camera having a function of capturing images of the inside of the facility and detecting moving objects; a control device that detects an abnormality in the surveillance camera based on information acquired from the communication device and the surveillance camera via a communication line; the predetermined range includes a range that the monitoring camera captures when the monitoring camera is installed normally, A surveillance camera management system in which the control device determines that the installation status is abnormal if no moving object is detected by the surveillance camera within a first time period after the identification information is acquired by the communication device.
[0098] (Appendix 2) an identification image for identifying the robot is displayed on the surface of the robot; The control device determining that the installation state is normal when the moving object is detected within the first time period after the identification information is acquired by the communication device; A surveillance camera management system as described in Appendix 1, wherein when the installation condition is determined to be normal and the identification image is not extracted from the image captured by the surveillance camera within a second time period after the moving object is detected, it is determined that there is dirt on the lens of the surveillance camera, which is an abnormality in the surveillance camera.
[0099] (Appendix 3) The surveillance camera management system described in Appendix 2, wherein the control device determines that the installation condition is normal, and when the identification image is extracted from the image captured by the surveillance camera within the second time period after the moving object is detected, and the robot identified from the identification image does not match the robot identified from the identification information, determines that the lens is dirty, indicating an abnormality in the surveillance camera.
[0100] (Appendix 4) The robot further comprises: 4. The surveillance camera management system according to claim 2, wherein the robot changes direction when traveling within the imaging range of the surveillance camera so that the identification image is captured.
[0101] (Appendix 5) Further comprising a display device for displaying information, 5. The surveillance camera management system according to any one of Supplementary Note 1 to Supplementary Note 4, wherein, when an abnormality in the surveillance camera is detected, the display device displays a message that an abnormality in the surveillance camera has been detected.
[0102] (Appendix 6) a step in which, when the robot is installed in a facility where the robot can travel by itself and the robot is traveling within a predetermined range where communication with the robot is possible, a communication device acquires identification information for identifying the robot from the robot via wireless communication; acquiring information from a surveillance camera that captures images of the facility and has a function of detecting moving objects; detecting an abnormality in the surveillance camera based on information acquired from the communication device and the surveillance camera via a communication line; the predetermined range includes a range that the monitoring camera captures when the monitoring camera is installed normally, A surveillance camera management method, wherein the detecting step further includes a step of determining that the installation status of the surveillance camera is abnormal if no moving object is detected by the surveillance camera within a first time period after the identification information is acquired by the communication device.
[0103] The embodiments disclosed herein are merely examples and are not limited to the above. The scope of the present invention is defined by the claims, and it is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]
[0104] 1 Facility, 2 Monitoring center, 10 Server device, 11, 21 Processor, 12, 22 ROM, 13, 23 RAM, 14, 24 HDD, 15, 25 Communication IF, 16, 26, 46 Communication bus, 20 Device management device, 29 Gateway, 30 Terminal, 34 Input unit, 35 Display, 40 Robot, 41 Control unit, 42, 72 Wireless communication device, 43 Two-dimensional code, 44 Memory unit, 45 Camera, 47 Drive unit, 48 Battery, 61 Ceiling, 62 Wall, 63 Floor, 70 Surveillance camera, 81 Detection result data, 82 Judgment result data, 91-93 Camera images, 100 Surveillance camera management system, 101 Camera imaging range, 102 Communication range, 110, 111 Motion detection range, 120 Dirt, NW Communication network.
Claims
1. A robot that moves autonomously within a facility; a communication device that is installed within the facility and that acquires, from the robot via wireless communication, identification information that identifies the robot when the robot is traveling within a predetermined range where communication with the robot is possible; a surveillance camera having a function of capturing images of the inside of the facility and detecting moving objects; an equipment management device that is communicatively connected to the communication device and the monitoring camera and is capable of controlling the robot via the communication device; a control device that is communicatively connected to the device management device and that detects an abnormality in the surveillance camera based on information acquired from the communication device and the surveillance camera via the device management device; the predetermined range includes a range that the monitoring camera captures when the monitoring camera is installed normally, the control device determines that the installation state is normal when the moving object is detected within a first time period after the identification information is acquired by the communication device; an identification image for identifying the robot is displayed on the surface of the robot; the robot acquires information indicating the position of the monitoring camera from the device management device via the communication device, and when traveling within an imaging range of the monitoring camera, changes its direction so that the identification image is captured; The control device If it is determined that the installation state is normal and the identification image is not extracted from the image captured by the monitoring camera within a second time period after the moving object is detected, it is determined that the abnormality of the monitoring camera is that the lens of the monitoring camera is dirty, A surveillance camera management system that determines that the installation status is abnormal if the surveillance camera does not detect the moving object within the first time period after the identification information is acquired by the communication device.
2. The surveillance camera management system of claim 1, wherein the control device determines that the installation condition is normal, and when the identification image is extracted from the image captured by the surveillance camera within the second time after the moving object is detected, and the robot identified from the identification image does not match the robot identified from the identification information, the control device determines that the lens is dirty, indicating an abnormality in the surveillance camera.
3. Further comprising a display device for displaying information, The surveillance camera management system according to claim 1 , wherein, when an abnormality in the surveillance camera is detected, the display device displays a message indicating that an abnormality in the surveillance camera has been detected.
4. a step in which, when the robot is installed in a facility where the robot can travel by itself and the robot is traveling within a predetermined range where communication with the robot is possible, a communication device acquires identification information for identifying the robot from the robot via wireless communication; acquiring information from a surveillance camera that captures images of the inside of the facility and has a function of detecting moving objects via an equipment management device; detecting an abnormality in the surveillance camera based on information acquired from the communication device and the surveillance camera via the device management device; the equipment management device is communicatively connected to the communication device and the monitoring camera, and is capable of controlling the robot via the communication device; the predetermined range includes a range that the monitoring camera captures when the monitoring camera is installed normally, the detecting step further includes a step of determining that the installation state is normal when the moving object is detected within a first time period after the identification information is acquired by the communication device; an identification image for identifying the robot is displayed on the surface of the robot; The method further includes a step of: acquiring information indicating the position of the monitoring camera from the device management device via the communication device; and changing a direction of the robot when traveling within an imaging range of the monitoring camera so that the identification image is captured; The detecting step includes: When the installation state is determined to be normal and the identification image is not extracted from the image captured by the monitoring camera within a second time period after the moving object is detected, determining that the monitoring camera is abnormal because the lens of the monitoring camera is dirty; A surveillance camera management method further comprising a step of determining that the installation status is abnormal if the moving object is not detected by the surveillance camera within the first time period after the identification information is acquired by the communication device.
Citation Information
Patent Citations
Surveillance camera system having camera abnormality detection device
JP2012034147A
Monitor system
JP2015041913A
Image processing device, image processing method, and program
JP2018026724A
Robot system
JP2019063947A
Information processing apparatus, information processing method, and program
JP2019087791A